JP2016071103A - Control device, control method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a configuration for executing display information output control in which the visibility of a user-mounted or portable display unit.SOLUTION: A control unit executes, in accordance with the movement state of a user holding a display unit, the control of switching between hold display in which display information output to the display unit is continuously executed and pulse display in which a lights-up (ON) period that is a display information output period and a lights-out (OFF) period that is a display information non-output period are repeated, or the control of switching between afterimage-considered pulse display and normal pulse display. When the movement of the user holding the display unit is (a) stationary or a low cyclic movement having a long period of oscillation, (b) a high cyclic movement, or (c) a non-cyclic movement, the control unit executes different display control according to each of these modes.SELECTED DRAWING: Figure 1

Description

  The present disclosure relates to a control device, a control method, and a program. In particular, the present invention relates to a control device, a control method, and a program for performing display control of a display device worn on a user's body such as a head-mounted display that is a head-mounted display or carried by the user.

  In recent years, portable display devices and head-mounted display devices such as head mounted displays (HMDs) have become widespread, and many users are moving these portable or wearable display devices. Or during exercise. However, there is a problem that these portable or wearable display devices vibrate according to the movement of the user and the like, and it becomes difficult to recognize display information on the display unit. This difficulty in recognizing display information may cause accidents and eye fatigue due to distraction to the surroundings, and there is a concern that dangerous situations may occur.

  In particular, a display device that is worn on the head and views a video, that is, a head mount display (HMD), does not require the user to hold it in his / her hand, and can display his / her favorite video while exercising such as walking and running. You can enjoy music. However, on the other hand, it is difficult to suppress vibration according to exercise such as walking and running, and there is a problem that it becomes more difficult to recognize display information on the display unit.

The head-mounted display (HMD) has a display unit that can be observed with either the left or right eye, or both eyes, and is configured to control vision and hearing in combination with headphones. .
For example, Japanese Patent Application Laid-Open No. 2011-145488 discloses a related art that discloses the structure and principle of a head-mounted display.

  As described above, when a portable or wearable display device is used, the display information can be confirmed relatively stably if the user is stationary, but the display information is displayed when an operation such as walking or running is performed. There arises a problem that it becomes difficult to recognize.

JP 2011-145488 A

  The present disclosure has been made in view of, for example, the above-described problems, and is a display device having movement such as vibration, such as a head-mounted display or the like that is mounted on a user's body or a portable type that is carried by the user. It is an object of the present invention to provide a control device, a control method, and a program that can suppress a decrease in the recognition rate by display control.

The first aspect of the present disclosure is:
A control unit that executes display information output control for a user-mounted or portable display unit;
The controller is
According to the exercise status of the user holding the display unit,
A hold display for continuously executing display information output to the display unit;
Switching control of pulse display as intermittent display that repeats a lighting (ON) period that is an output period of display information to the display unit and an extinguishing (OFF) period that is a non-output period of display information, or
An afterimage-considering pulse display in which a lighting (ON) period that is an output period of display information for the display unit and an extinguishing (OFF) period that is a non-output period of display information are set and the extinguishing period is set within an afterimage recognition period , Switching control of normal pulse display with the extinction period set longer than the afterimage recognition period,
It exists in the control apparatus which performs any switching control.

Furthermore, in one embodiment of the control device of the present disclosure, the control unit is configured such that a user's motion holding the display unit is
(A) When it is a stationary or low-periodic motion with a long vibration cycle,
(B) In the case of a high periodic motion with a short vibration period,
(C) When the non-periodic motion has a non-constant vibration cycle,
Different display controls are executed depending on the aspects (a) to (c).

  Furthermore, in one embodiment of the control device according to the present disclosure, the control unit controls switching between hold display and pulse display according to a user's eyeball speed estimated according to a user's eye movement state holding the display unit. Or, switching control between afterimage-considering pulse display and normal pulse display is executed.

  Furthermore, in one embodiment of the control device of the present disclosure, the control unit is a lighting (ON) period in the pulse display according to the user's eyeball speed estimated according to the user's movement situation holding the display unit. Change the setting.

  Furthermore, in one embodiment of the control device of the present disclosure, the control unit changes a setting of a lighting (ON) period in the pulse display according to an exercise cycle of a user holding the display unit.

  Furthermore, in one embodiment of the control device of the present disclosure, the control unit increases the setting of the lighting (ON) period in the pulse display when the movement cycle of the user holding the display unit is equal to or less than a threshold, When the motion cycle is longer than the threshold value, pulse display control is executed to increase the setting of the lighting (ON) period in the pulse display.

  Furthermore, in one embodiment of the control device according to the present disclosure, the control unit calculates a stable period in which the user's eyeball velocity is substantially zero in accordance with an exercise situation of the user holding the display unit, and calculates the calculated stable period. The pulse display control in which the lighting (ON) period in the pulse display is set is executed.

  Furthermore, in one embodiment of the control device of the present disclosure, the control unit stops output of the display unit when detecting a shock that is an impact on a user holding the display unit.

  Furthermore, in one embodiment of the control device according to the present disclosure, the control unit executes luminance control of the display unit according to environmental luminance in an environment in which the display unit is used.

  Furthermore, in one embodiment of the control device of the present disclosure, the control unit performs control to change an output mode of display information on the display unit according to an exercise situation of a user holding the display unit.

  Furthermore, in an embodiment of the control device of the present disclosure, the control unit sets a large amount of display information when executing hold display or pulse display with a long lighting (ON) time, and a pulse with a short lighting (ON) time. At the time of display, display control with a small display information amount is executed.

  Furthermore, in one embodiment of the control device according to the present disclosure, the control unit executes hold display when the eyeball speed of the user holding the display unit is less than a threshold value during execution of switching control between hold display and pulse display. If the threshold is greater than or equal to the threshold value, pulse display is performed.When switching between afterimage-considered pulse display and normal pulse display is performed, if the eyeball velocity of the user holding the display unit is less than the threshold value, afterimage-considered pulse display is performed. In case of, normal pulse display is executed.

  Furthermore, in one embodiment of the control device of the present disclosure, the control unit calculates a user's eye velocity based on the user's movement information input from the sensor information, and holds a display and a pulse according to the calculated eye velocity. Display switching control or switching control between afterimage-considering pulse display and normal pulse display is executed.

  Furthermore, in one embodiment of the control device according to the present disclosure, the control device includes an acceleration sensor, and the control unit calculates the eyeball velocity of the user by applying detection information of the acceleration sensor, and calculates the calculated eyeball velocity. In response to this, switching control between hold display and pulse display or switching control between afterimage-considering pulse display and normal pulse display is executed.

  Furthermore, in one embodiment of the control device according to the present disclosure, the display unit is a head-mounted display unit that is worn on a user's head, and the control unit is configured to respond to dynamics up and down the user's head. The eyeball moving speed at the time of the generated eyeball movement is calculated, and switching control between hold display and pulse display or switching control between afterimage consideration pulse display and normal pulse display is executed according to the calculated eyeball moving speed.

  Furthermore, in one embodiment of the control device of the present disclosure, the control unit executes pulse display in which one lighting (ON) period is 10 ms or less when performing pulse display.

Furthermore, the second aspect of the present disclosure is:
A control method executed by a control device for a user-mounted or portable display unit,
The control unit
According to the exercise status of the user holding the display unit,
A hold display for continuously executing display information output to the display unit;
Switching control of pulse display as intermittent display that repeats a lighting (ON) period that is an output period of display information to the display unit and an extinguishing (OFF) period that is a non-output period of display information, or
An afterimage-considering pulse display in which a lighting (ON) period that is an output period of display information for the display unit and an extinguishing (OFF) period that is a non-output period of display information are set and the extinguishing period is set within an afterimage recognition period , Switching control of normal pulse display with the extinction period set longer than the afterimage recognition period,
There is a control method for executing any switching control.

Furthermore, the third aspect of the present disclosure is:
A program that causes a control device to execute control on a user-mounted or portable display unit,
The program is stored in the control device.
According to the exercise status of the user holding the display unit,
A hold display for continuously executing display information output to the display unit;
Switching control for switching between pulse display as intermittent display that repeats a lighting (ON) period that is an output period of display information to the display unit and an extinguishing (OFF) period that is a non-output period of display information, or
An afterimage-considering pulse display in which a lighting (ON) period that is an output period of display information for the display unit and an extinguishing (OFF) period that is a non-output period of display information are set and the extinguishing period is set within an afterimage recognition period , Switching control to switch the normal pulse display with the extinguishing period set longer than the afterimage recognition period,
It is in a program that executes any switching control.

  Note that the program of the present disclosure is a program that can be provided by, for example, a storage medium or a communication medium that is provided in a computer-readable format to an image processing apparatus or a computer system that can execute various program codes. By providing such a program in a computer-readable format, processing corresponding to the program is realized on the information processing apparatus or the computer system.

  Other objects, features, and advantages of the present disclosure will become apparent from a more detailed description based on embodiments of the present invention described later and the accompanying drawings. In this specification, the system is a logical set configuration of a plurality of devices, and is not limited to one in which the devices of each configuration are in the same casing.

According to the configuration of an embodiment of the present disclosure, a configuration for executing display information output control with improved visibility of a user-mounted or portable display unit is realized.
Specifically, the control unit performs a hold display that continuously executes display information output to the display unit according to the exercise status of the user holding the display unit, and lighting that is an output period of the display information to the display unit ( (ON) period and switching control of pulse display as intermittent display that repeats a light-off (OFF) period, which is a non-output period of display information, or switching control between afterimage-considering pulse display and normal pulse display. When the movement of the user holding the display unit is (a) stationary or low-periodic movement with a long vibration period, (b) high-periodic movement with a short vibration period, (c) In the case of non-periodic motion with a constant vibration cycle, different display control is executed depending on each of these modes.
With this configuration, output control of display information with improved visibility of the display unit is realized.
Note that the effects described in the present specification are merely examples and are not limited, and may have additional effects.

It is a figure explaining the structural example of a head mount display. It is a figure explaining the visibility fall factor of a display apparatus. It is a figure explaining an example of the method of making the image of a display part look virtually distant. It is a figure explaining the experiment which evaluates a recognition level using the application which blinks and displays a display character. It is a figure explaining the intermittent display (pulse display) of a display part. It is a figure explaining the experiment which attaches the test subject (user) with the head mount display which has the display part which enabled the pulse display, and confirms the display information of a display part, performing various exercise | movement and operation | movement. It is a figure explaining head movement and eyeball movement which maintain gaze stability during walking. It is a figure explaining the example of a calculation process of the eyeball moving speed (angular velocity) at the time of a walk. It is a figure explaining the example of calculation processing of the eyeball moving speed (angular velocity) at the time of running. It is a figure explaining the correspondence of eyeball moving speed and a visibility fall level. The result of analyzing the amount of character shift and the size of the recognizable character according to the moving speed of the eyeball and the information display time during the three types of movements of walking, low-speed running, and high-speed running It is a figure explaining about. It is the figure which put together the two analysis results obtained from the result shown in FIG. It is a figure explaining the example of the display control according to the various exercise | movement states of the user with which the human body wearing type or portable display apparatus, such as a head mounted display, was equipped with or carried. It is a figure explaining the example of a setting of the display mode in each user state, and display information. It is a figure which shows the point of the position (direction angle) and moving speed (angular velocity) of the eyeball at the time of walking and running, and the eyeball sail 0. It is a figure explaining the example of a display control in the case of performing the pulse display which makes the display part light (ON) at the timing when the eyeball speed becomes substantially 0 at the time of walking. It is a figure explaining the example of a display control in the case of performing the pulse display which makes the display part light (ON) at the timing when the eyeball speed becomes substantially 0 at the time of running. It is a figure explaining the experimental apparatus which confirms about the light quantity control of the pulse display according to the brightness of a background visual field. It is a figure explaining the result of the experiment which applied the experimental apparatus shown in FIG. It is a figure which shows the graph which converted the measured display brightness | luminance into 1 frame average brightness | luminance (1 frame = 16.67 ms) about the required brightness | luminance in the environment over 4000 nt. It is a figure which shows the environmental brightness | luminance of external environment on a horizontal axis | shaft, sets the 1-frame average brightness | luminance of the flame | frame used as display information of a display part on a vertical axis | shaft, and demonstrates the display part brightness | luminance required with respect to environmental brightness | luminance. . It is a figure which shows the flowchart explaining the basic sequence of switching control of a hold display and a pulse display. It is a figure which shows the flowchart explaining an exercise | movement condition determination processing sequence. It is a figure which shows the flowchart explaining the display control sequence at the time of stationary or low-cycle exercise | movement execution. It is a figure which shows the flowchart explaining the display control sequence at the time of high-cycle exercise | movement execution. It is a figure which shows the flowchart explaining the display control sequence at the time of non-periodic exercise | movement execution. It is a figure explaining the specific example of an afterimage consideration pulse display. It is a figure explaining the example of a setting of the display mode in each user state, and display information. It is a figure which shows the flowchart explaining the basic display control sequence in the case of performing an alternative process whether the display of a display apparatus is an afterimage consideration pulse display or a normal pulse display. It is a figure which shows the flowchart explaining the setting of a display parameter, and a display control sequence in case the display of a display apparatus is made into an afterimage consideration pulse display. It is a figure explaining the hardware structural example of the control apparatus of this indication.

Hereinafter, the details of the control device, the control method, and the program of the present disclosure will be described with reference to the drawings. The description will be made according to the following items.
1. 1. Example of head mounted display configuration 2. Factors and analysis of visibility degradation of display information 3. Consideration on suppression of visibility degradation 4. Consideration of visibility degradation caused by afterimage and follow-up vision (retinal slip) 5. About suppression of visibility degradation by pulse display 6. About the theory of visibility improvement by pulse display 7. Configuration for executing control according to user's movement 8. Control of display timing in pulse display 9. Brightness control of display unit Processing sequence of display control 10-1. Basic sequence for switching control between hold display and pulse display 10-2. Exercise situation determination processing sequence 10-3. Display control sequence during execution of stationary or low-cycle motion 10-4. Display control sequence during execution of high-cycle motion 10-5. 10. Display control sequence during execution of non-periodic motion 11. Example of switching process between afterimage-considering pulse display and normal pulse display in which the non-display period is set within the afterimage recognition period 12. Regarding hardware configuration example of control device Summary of composition of this disclosure

[1. Example of head mounted display configuration]
First, a configuration example of a head mounted display (HMD) that is an example of the display device of the present disclosure will be described.
FIG. 1 is a view showing a user wearing a head mounted display (HMD) 10.
The head-mounted display 10 has a configuration that can be mounted on the user's head. The head-mounted display 10 shown in the figure is configured such that the display unit 11 is provided on the right eye side of the user and no display is provided on the left eye side. The display unit 11 is set so as not to cover the front surface of the eye. With such a configuration, the user can usually observe the outside world without looking at the display unit 11.

Therefore, the user can perform walking (walking), running (running), or running on a bicycle or motorcycle while wearing the head-mounted display 10. The user can confirm display information on the display unit 11 by temporarily moving his / her line of sight to the display unit 11 while performing these exercises and the like.
That is, the display information can be confirmed by moving the line of sight occasionally while performing operations such as walking and running.

Examples of display information include map information indicating the current location, temperature / humidity information, and information on the user's heart rate.
The head-mounted display 10 is provided with various sensors for acquiring each of these pieces of information. Under the control of the control unit 15, display information based on the sensor detection information is generated and display processing is performed. .

  In addition to the display unit 11, the head mounted display 10 is provided with speakers 12 </ b> L and 12 </ b> R at the positions of the left and right ears, and outputs sound in accordance with display information on the display unit 11. The control unit 15 executes output control of display information for the display unit 11 and audio output control for the speakers 12L and 12R.

[2. Causes and analysis of visibility degradation of display information]
When the user views display information on a portable or wearable display device such as the head-mounted display 10 shown in FIG. 1, the display information can be confirmed relatively stably if the user is stationary. It is. However, for example, when the display unit is viewed while performing an operation such as walking or running, there is a problem that display information cannot be recognized immediately, that is, display information is difficult to recognize.

Factors that make display information such as a head-mounted display (HMD) difficult to recognize during exercise can be classified into the following two factors.
(1) Shaking of the head mounted display (HMD) body (2) Human eye movement There are these two factors.

  Visibility degradation due to “(1) Head Mount Display (HMD) body shake” is caused by the physical displacement of the eyeball due to positional displacement or vibration of the eyeball relative to the display section of the Head Mount Display (HMD). This is a drop in visibility caused by a deviation or a high vibration speed.

  Further, the reduction in visibility caused by “(2) human eye movement” is specifically based on a plurality of biological reactions as follows. In other words, “vestibular eye movements” that reflexively move the eyeballs in accordance with body movements that humans are performing unconsciously, “saccade eye movements” that are used to obtain peripheral vision information, and objects This is a decrease in visibility due to “focusing” and “following vision” that occur for recognition and recognition.

Examples of conventional countermeasures against the visibility degradation based on such factors include the following.
For “(1) shaking of the head mounted display (HMD) main body”, physical measures such as fixing the display device firmly to the head and using a parallel light lens are effective. These methods are effective when the display unit is sufficiently light, and when the “force” from the outside is small. However, when a large “force” such as acceleration exceeding a predetermined value is applied from the outside, the vibration width becomes large, and the vibration is not only in a certain direction, but, for example, a twist occurs, and vibrations in a plurality of directions occur. In such a case, there is a problem that a retinal slip or the like occurs and a reduction in recognition rate cannot be prevented.

Regarding the other effective measures regarding “(2) human eye movements”, no particularly disclosed one was found.
Therefore, (2) the decrease in visibility caused by human eye movement was analyzed.

  In FIG. 2, for example, a user who is looking at the outside world (front) while exercising walking, running, biking, etc. wearing a head-mounted display moves his / her line of sight to the display section of the head-mounted display. It is a figure explaining the phenomenon which causes the state transition until it recognizes display information and the visibility fall which generate | occur | produces in each state.

Until the displayed information is recognized by looking at the display section of the head mounted display, the following four state transitions occur as shown in FIG.
(State 1) An outside world observation state looking far away (in front of the outside world) outside the display unit,
(State 2) A line-of-sight movement state in which the line of sight moves to the display unit,
(State 3) Focus adjustment state for adjusting the focus on the display unit,
(State 4) Display information recognition state for recognizing display information on the display unit,

  (State 1) The external world observation state in which the user is looking far away (front of the external world) outside the display unit is, for example, a state where the user is moving toward the front. This is a state in which the outside world in front is seen by walking, running, cycling, etc., facing in the traveling direction.

(State 2) The line-of-sight movement state in which the line of sight moves to the display unit is a state in which the user moves his / her line of sight in order to see the display unit of the head-mounted display, for example, the display unit at the end of the right eye It is.
At this time, the user performs a fine eye movement called a saccade eye movement, and tries to capture the position of the display unit (display) at the center of the eye. However, if the display unit (display) is shaking at this line-of-sight movement stage, the display unit cannot be captured in a short time. If you can't catch it right away, eye movements that look for other places or return your gaze to the front occur.

  In order to be able to execute the line-of-sight movement accurately and at high speed, it is necessary to reduce the shaking of the display unit as much as possible. By reducing the shaking of the display unit, it is possible to help capture by saccade eye movement.

  (State 3) The focus adjustment state in which the focus is adjusted on the display unit is a process after capturing the display unit, and is a state in which the eyeball is focused on the display surface of the display unit. Although there are individual differences in focusing time, it is generally said that 400 ms is a standard time for focusing. If it takes time to focus, focusing will not be successful due to the shaking of the display unit body and body during that time.

In order to suppress a reduction in visibility in the focusing process, it is effective to perform setting so that the same image can be seen as long as the eye moves, even if the eyeball is slightly deviated from the display unit.
In addition, if the display information on the display unit is controlled to be observed as a virtual image in the distance, the user who has observed the distance becomes almost unnecessary to focus even if the viewpoint is moved to the display information on the display unit. It becomes possible to shorten the time required for the alignment.

  Note that the display information on the display unit can be observed far away by setting the optical system of the display unit. Specifically, the lens of the optical system may be set so that display information on the display unit is observed on the retina with a setting close to parallel light. This lens setting example will be described later.

(State 4) The display information recognition state for recognizing display information on the display unit is a state in which a display information recognition process is performed after the focus is achieved.
Problems in this display information recognition process include the afterimage effect of human eyes and the effect of following vision (retinal slip).

To put it simply, the afterimage effect is to hold what a human sees with eyes for a short time. A well-known example of a phenomenon that is difficult to see due to the afterimage effect is that you feel "motion blur" when you watch a fast-moving screen such as sports on an LCD TV that has a constant backlight. There is.
This is because, for example, when a moving image such as sports is displayed on the display unit and observed, the afterimage of the first frame appears to overlap the image of the second frame when changing from the first frame to the second frame constituting the moving image. This is a problem that occurs.

  Follow-up vision (retinal sliding) is to capture a moving object at the center of the field of view and then move the eyeball by predicting movement in order to follow it continuously. When a deviation occurs between the predicted position and the actual display position, misrecognition such as a process of supplementing what the brain does not actually see as if it was visible or disappearing occurs. This also contributes to motion blur.

[3. Consideration on suppression of visibility degradation]
As described with reference to FIG. 2, various factors that cause a decrease in visibility before a user looking at the outside world moves his / her line of sight to the display unit of the head-mounted display and recognizes display information. There is.

As shown in FIG. 2, factors that cause a reduction in visibility can be classified into two categories: eyeball factors and body movement factors.
As countermeasures against the shaking and impact of the display as a body movement factor, it is considered effective to reduce the size, weight, and setting of vibration absorbing members such as head pads and cushions.
In addition, since the “saccade”, one of the eyeball factors, is greatly affected by the shaking of the display, as a device for reducing the shaking of the head mounted display, the small size of the head mounted display itself is similar to the above. Measures such as reduction in weight, weight reduction, and setting of vibration absorbing members such as head pads and cushions are considered effective.

  In addition, a decrease in visibility due to “focusing”, which is one of the eyeball factors, is a state in which the eyeball is focused at a long distance in the external observation state before the user moves the line of sight to the display unit. On the other hand, when viewing the display information on the display unit, the display information at a short distance must be viewed, which is caused by the gap in the focal position.

As a countermeasure for this, as described above, there is an effective method of devising the optical system of the display unit so that the image of the display unit can be seen virtually in the distance.
This method will be described with reference to FIG.
FIG. 3 shows a cross-sectional configuration of a display device 30 such as a head-mounted display and a user's eye 20 that observes display information.

The display device 30 includes a lens 32 on the front surface of the display surface 31. The user observes display information on the display surface 31 through the lens 32.
The distance between the display surface 31 and the user's eye 20 is about 30 mm.

  In order to directly recognize the display information on the display surface 31 without using the lens 32, the focal length of the eye 20 must be set to 30 mm. For example, from the state of looking at a distant view, if you move the viewpoint to the display surface 31 and try to focus, it will be necessary to change the focus position to a position 30 mm from the distant position, and focus time will be required Therefore, display information recognition delay occurs.

However, in the configuration shown in FIG. 3, the output light 51a of the display surface 31 is controlled by the lens 32 as indicated by the control line 51b. That is, the output light of the display surface 31 is controlled by the lens 32 to a setting that is almost similar to parallel light and is observed by the user's eye 20.
With this control, display information on the display surface 31, for example, the character [A] shown in the figure is observed on the user's eye 20 at positions along the control lines 51b and 51c, that is, the virtual observation position 35 shown in the figure. It will be.

  In the example shown in the figure, the virtual observation position 35 is at a distance of about 3 m from the eye 20. The distance to the virtual observation position 35 is a distance determined by the configuration of the lens 32 and can be changed by setting the lens.

  In this way, the viewing position of the display information on the display surface 31 is set far by the lens 32, so that the user can view the display information output on the display surface 31 of the display device 30 from the state of viewing the distant scenery outside. When the lens is moved, the fluctuation amount of the focal length of the eye 20 can be reduced. Thereby, the time required for the alignment of the focal position is reduced, and the display information can be recognized immediately.

The lens control method shown in FIG. 3 is a method that is already used in existing head-mounted displays as a parallel light and long-distance imaging method.
Further, when this lens control method is used, for example, even if the position of the eye 20 with respect to the display device 30 is displaced as shown in the eyes 20p and 20q in the figure, the amount of displacement with respect to the virtual observation position 35 is the position with respect to the display surface 31. Since it is relatively reduced compared to the amount of deviation, it is not necessary to move the viewpoint, and display information can be observed more stably.

[4. Consideration of loss of visibility due to afterimage and follow-up vision (retinal slip)]
Next, consideration will be given to the deterioration in visibility caused by afterimage and follow-up vision (retinal slip), which are one cause of the reduction in visibility of the eyeball factor shown in FIG.

  As described above with reference to FIG. 2, the afterimage effect is an effect of holding what the human eye sees for a short time. For example, in an LCD TV with the backlight on all the time, when viewing a fast-moving screen such as sports, afterimages of the previous frame appear to overlap the images of the subsequent frame, and so on. There is.

  Follow-up vision (retinal sliding) is to capture a moving object at the center of the field of view and then move the eyeball by predicting movement to follow it continuously. This is a process that makes it seem as if something that is not actually seen is seen due to a deviation between the predicted position and the actual display position, and this causes a motion blur.

As an example of a method for avoiding afterimages, there is a motion flow technique adopted in a television apparatus manufactured by Sony. This is a method of reducing the influence of afterimages by turning on and off the backlight of the liquid crystal display device.
Specifically, by performing the process of turning on the LED backlight in order from top to bottom in order of about 1 ms (1/960), the image is set to the same setting as that of a 16 × (960 frames per second) image. This makes it possible to significantly reduce the viewer's afterimage feeling.
That is, the afterimage feeling is reduced by shortening the display time of the frame image which is one fixed image.

  We conducted a simple experiment to obtain data for applying this to a user-mounted or portable display. This experiment will be described with reference to FIG. An experiment was conducted in which a display character 41 composed of two digits was output to a display device 40 as a tablet terminal, and an application for displaying the display character by blinking was created, and this was observed to evaluate the recognition level.

The display application that operates on the display device 40 randomly generates and displays a two-digit number. The display pattern is
(A) “Continuous display (hold display) pattern” that continues to light continuously with numbers.
(B) “intermittent display (pulse display) pattern” in which numbers are turned on and off in 10 ms.
These two types were set and executed.

  The test subject confirmed the visibility of the display information by holding the display device 40 in one hand and observing the display information with the display device 40 shaken lightly. As an evaluation result of several people, an evaluation result was determined that the “intermittent display (pulse display) pattern” that repeatedly turns on and off compared to the “continuous display (hold display) pattern” was clearly visible. .

[5. Suppression of visibility reduction by pulse display]
Based on the experiment described with reference to FIG. 4, in the information display for a human-mounted or portable display device such as a head-mounted display, pulse display for repeatedly outputting (ON) and stopping (OFF) display information However, it has been confirmed that it has an effect of suppressing visibility deterioration.
In the pulse display, information display on the display unit is repeatedly displayed and not displayed at short intervals. This process makes it possible to display a short-time output image on the retina, and is considered to have an effect of avoiding slipping on the retina.

Next, consideration will be given to the correlation between the pulse display control and visibility, such as the display information output (ON) and stop (OFF) period settings.
A control board was attached to an existing head-mounted display, and various experiments were conducted by creating an experimental device that can turn on and off the liquid crystal backlight that constitutes the display section at high speed.

The backlight of the display unit is set to “intermittent display (ON / OFF) with various settings as shown in FIG. 5 in addition to the setting of“ continuous display (hold display) ”that is always ON. “Pulse display)” can be executed.
As shown in FIG. 5, each on / off time (ON / OFF) can be arbitrarily set within the following range.
Lighting time = 1ms-10ms,
Off time = 10 ms to 500 ms,
A head mounted display equipped with a display unit that can be turned ON / OFF by setting the time in the above range was attached to a subject (user), and an experiment was conducted.

The ON time of the graph shown in FIG. 5 can be adjusted in the range of 1 to 10 ms, and the OFF time can be adjusted in the range of 10 to 500 ms.
ON and OFF are repeated at set time intervals, and as a result, the display information on the display unit becomes a pulse display that repeats ON / OFF.

  As shown in FIG. 6, a head mounted display having a display unit capable of displaying a pulse is attached to a subject (user), and the subject walks, runs, bicycles, goes up and down stairs, slides, and shakes his neck. Various exercises and movements were executed. An experiment was conducted in which the subject confirmed the display information on the display unit while performing these various exercises.

As a result of this experiment, the following conclusion was obtained as a result of evaluating the visibility of the display information on the display unit.
(Conclusion 1) Comparison between “continuous display (hold display)” and “intermittent display (pulse display)”
As for visibility, “intermittent display (pulse display)” is better than “continuous display (hold display)”.
(Conclusion 2) Comparison of “intermittent display (pulse display)” of various ON / OFF settings,
The visibility is remarkable when the lighting (ON) time is set to 1 to 5 ms and the light-off (OFF) time is set to 100 ms to 300 ms.
These conclusions were obtained.

[6. About the theory of visibility improvement by pulse display]
The effectiveness of pulse display based on the principle of retinal slip generation was theoretically verified.
FIG. 7 is a diagram based on the paper “Head and eye movements for maintaining gaze stability during walking” (Osaka University, Hirasaki Akira 2000).

  The users 50U, 50M. 50D indicates the position and inclination of the face during walking. Humans move their heads up and down vertically during walking. At this time, in order to stabilize the line of sight, the head is tilted unconsciously.

The user 50M shows the position and inclination of the face at the intermediate position in the vertical direction during walking.
The user 50U indicates the position and inclination of the face when the user is located at the top during walking.
The user 50D shows the position and inclination of the face when positioned at the bottom when walking.
A human sets an observation target (Target) when walking and walks while watching the observation target. Therefore, when the head moves up and down, the head is tilted up and down to direct the line of sight to the observation target (Target).

  The observation target (Target) can be set at various positions. In the figure, as a setting example, a far observation position (Far Target) and a near observation position (Near Target) are shown. For example, the user sets one of these as an observation target (Target), and walks while viewing the observation target.

For example, since the user 50M at the intermediate position shown in the drawing is viewing the observation target (Target) having the same height as the line of sight of the user M, the inclination of the head is zero. However, the user 50U whose head has moved upward in the vertical direction tilts his / her head downward in order to see the same observation target (Target). The tilt angle is the head rotation angle (Φh) shown in the figure.
Similarly, the user 50D whose head has moved to the lower part in the vertical direction tilts his head upward in order to see the same observation target (Target). The tilt angle is the head rotation angle (Φh) shown in the figure.

  However, the inclination angle of the head is not completely accurate with respect to the observation target. For example, when looking at a far-distance observation target (Far target), the inclination (φh) of the head becomes large. It will end up looking at a place (HFP) that is a little closer. In order to correct this, a correction process is performed in which the eyeball moves in the direction opposite to the head. This movement angle of the eyeball is an eyeball rotation angle (Φe) shown in the figure.

  By such rotation of the head and rotation of the eyeball to bond the head rotation that has gone too far, it becomes possible to observe the observation target continuously and perform stable walking.

  In addition, when walking while observing a far-distance observation target (Far Target), correction processing is performed in which the eyeball moves in the direction opposite to the head, but the near-field observation target (Near Target) close to the user is observed. When walking, correction processing is performed in which the eyeball moves in the same direction as the head.

  That is, both in the case of observing the far-field observation target (Far Target) and in the case of walking while observing the near-field observation target (Near Target), the head is almost in the head direction fixed position (HPF: The inclination is adjusted so as to be suitable for the head fixation point. The eyeball moves in the same direction as or opposite to the inclination of the head, depending on the positional relationship between the head direction directed to the head direction fixed position (HPF) and the observation target (Target). By this processing, it is possible to walk without removing the line of sight with respect to the observation target (Target).

Such a movement process of the eyeball is one of the causes of a decrease in visibility. It is said that when the rotational angular velocity of the eyeball is 2-4 deg / s or higher, the visibility is reduced.
The eyeball movement speed (angular speed) during walking and running was calculated on the assumption that the head tilt and eyeball movement as shown in FIG. 7 occur.
FIG. 8 is a diagram illustrating an example of calculation processing of the eyeball moving speed (angular speed) during walking.
FIG. 9 is a diagram showing a calculation curve for the eyeball moving speed (angular speed) during running.

First, with reference to FIG. 8, an example of calculation processing of the eyeball moving speed (angular speed) during walking will be described.
FIG. 8 shows the following two graphs.
(A1) Time transition of head position during walking (A2) Time transition of eyeball direction and eyeball movement speed (angular velocity) during walking

  (A1) The temporal transition of the head position during walking is based on the theory described with reference to FIG. 7 and is a graph showing the vertical movement of the head according to walking. In addition, the moving distance of the head during walking was set to 50 mm in the vertical width and the frequency (corresponding to the number of steps per second) was set to 2 Hz.

  (A2) During the time transition of the eyeball direction and the eyeball movement speed (angular speed) during walking, the eyeball direction (= eyeball direction angle (Φe)) is based on the theory described with reference to FIG. (Angular velocity) (= eyeball angular velocity (Φe−v)) is eyeball velocity data (angular velocity) calculated based on time transition data in the direction of the eyeball.

In the graph shown in FIG. 8A2, dotted line data is angle transition data indicating the direction of the eyeball, and solid line data indicates the moving speed (angular speed) of the eyeball.
The moving speed of the eyeball (angular velocity) = Φe−v indicated by the solid line in FIG.
Φe−v = −1.8 deg / s to +1.8 deg / s
This is a graph that periodically repeats this range.

The movement speed (angular velocity) of the eyeball during walking = Φe−v = −1.8 deg / s to +1.8 deg / s
The angular velocity at which the visibility degradation described above occurs is 2 to 4 deg / s or less. At this level, it is determined that the visibility degradation is small.

Next, an example of a calculation process of the eyeball moving speed (angular speed) during running will be described with reference to FIG.
FIG. 9 shows the following two graphs as in FIG.
(B1) Time transition of head position during running (B2) Time transition of eye direction and eye movement speed (angular velocity) during running

  (B1) The time transition of the head position during running is based on the theory described with reference to FIG. 7, and is a graph showing the vertical movement of the head according to running. In addition, the moving distance of the head during running was set to 100 mm in the vertical width and the frequency (corresponding to the number of steps per second) was set to 3 Hz.

  (B2) During the time transition of the eyeball direction and the eyeball movement speed (angular speed) during running, the eyeball direction (= eyeball direction angle (Φe)) is based on the theory described with reference to FIG. (Angular velocity) (= eyeball angular velocity (Φe−v)) is velocity data calculated based on time transition data in the direction of the eyeball.

In the graph shown in FIG. 9B2, dotted line data is angle transition data indicating the direction of the eyeball, and solid line data indicates the moving speed (angular speed) of the eyeball.
The moving speed (angular velocity) of the eyeball indicated by the solid line in FIG. 9 (B2) = Φe−v is
Φe−v = −5.5 deg / s to +5.5 deg / s
This is a graph that periodically repeats this range.

The moving speed of the eyeball during running (angular velocity) = Φe−v = −5.5 deg / s to +5.5 deg / s
The angular velocity at which the visibility degradation described above occurs exceeds 2-4 deg / s, and it is determined that the visibility degradation occurs at this level.

Next, the correspondence between the eyeball movement speed and the visibility reduction level will be described with reference to FIG.
FIG. 10A shows the size feeling of characters displayed on a 24-inch virtual image monitor 3 m ahead.
The display information shown in FIG. 10A is information that the user who observes the display device 30 including the lens 32 described above with reference to FIG. 3 observes the display information on the display unit 31 at the virtual observation position 35. It corresponds to.

The display information shown in FIG.
(1) Characters A, B, C and Landolt ring [C] of nine sizes from 88 mm to (9) 5.2 mm are shown.
Note that (1) 88 mm in length indicates a character or Landolt ring having a length of 88 mm.

  The smallest characters are (9) a character ABC and a Landolt ring C having a length of 5.2 mm. The characters ABC and Landolt ring C shown in (9) 5.2 mm in length are characters that can be seen by a person with a visual acuity of 0.8. That is, it is a premise that a person with a visual acuity of 0.8 can see a character ABC and a Landolt ring with a length of 5.2 mm (9) in a stationary state where the body is not moving.

  Next, a condition is set as to how much these characters deviate to reduce visibility. In this case, the condition for determining the decrease in visibility was set when the image was shifted by 10% with respect to the character height (about 50% of the gap in the Landolt ring was filled), as shown in FIG.

For example, it is determined that the largest character shown in FIG. 10A is (1) a character with a length of 88 mm cannot be recognized when a deviation of 10% occurs with respect to a character height of 88 mm, that is,
88mm × 0.1 = 8.8mm
This occurs when a character misalignment occurs.

Further, (3) it is determined that a 44 mm long character cannot be recognized as shown in FIG. 10A when a 10% deviation occurs with respect to a character height of 44 mm, that is,
44 mm x 0.1 = 4.48 mm
This occurs when a character misalignment occurs.

Furthermore, it is determined that the smallest character shown in FIG. 10 (a) (9) a character with a length of 5.2 mm cannot be recognized when a deviation of 10% occurs with respect to a character height of 5.2 mm. That is,
5.2 mm × 0.1 = 0.52 mm
This occurs when a character misalignment occurs.

  Thus, it is easy to recognize a large character even if the shift amount is large, and a small character has a small shift amount and is difficult to recognize.

  For example, when the information shown in FIG. 10A is continuously displayed on the display unit, and the observer views the display information on the display unit while walking or running, the description has been given with reference to FIGS. Thus, the movement of the eyeball occurs. By this eye movement, an image in which a character shift as shown in FIG. 10B is generated is recognized.

  However, for example, when the information shown in FIG. 10A is displayed on the display unit for a short time, that is, pulse display instead of continuous display (hold display), an eyeball within the time corresponding to the display period is displayed on the observer's eyes. Only a shift amount corresponding to the movement is recognized. Therefore, it is expected that the recognition level is improved by the pulse display.

As described above with reference to FIGS. 8, 9 and the like, the moving speed of the eyeballs varies depending on the exercise being performed, such as during walking.
Therefore, according to the display time of the display information on the display unit and the type of exercise performed by the display unit observer, the size of the identifiable character, that is, the visibility determination described with reference to FIG. The size of the character that generates the threshold (character height deviation of 10%) is different.

FIG. 11 shows the following three types of motion states:
(1) walking,
(2) Low speed running, which is slower
(3) High-speed running that is faster running,
It is the result of analyzing the amount of character shift generated according to the moving speed of the eyeball during execution of these three types of movement and the information display time, and the size (size) of the recognizable character.

The eyeball moving speed was calculated according to the logic described with reference to FIGS. 7, 8, and 9, and the following values were used.
(1) Eye movement speed during walking = 2 deg / s,
(2) Eye movement speed at low speed running which is slower running = 5 deg / s,
(3) Eye movement speed at high speed running which is faster running = 10 deg / s,

  In addition, the display time of characters in the pulse display is set to 6 types of 1 ms, 2 ms, 3 ms, 5 ms, 10 ms, and 16 ms. The display time of 16 ms corresponds to continuous display (halt display).

The amount of displacement on the retina was calculated based on the product of the eyeball movement speed and the display time. That is,
Retina displacement amount = eyeball moving speed × display time Calculated by the above calculation formula.
Furthermore, the “retinal displacement amount” calculated by the above calculation formula is the “deviation amount” described with reference to FIG. The recognizable character size is set to a recognizable character size of 10 times the amount of deviation based on the criterion that recognition is impossible when a display deviation amount of 10% of the character size occurs.

First, the case of walking (eyeball movement speed 2 deg / s) will be described.
In the case of a set image with a display time = 1 ms (equivalent to pulse display), the deviation amount = 0.1 mm. A character size that can be identified is calculated using the above-described visibility lowering condition (corresponding to a gap of 10% in character height and 50% gap in the Landolt ring).
Deviation amount: 10% = 0.1 mm The character size (vertical size) is 1.00 mm. This is a size of (9) 5.2 mm or less in FIG.
That is, when walking, the display time is set to 1 ms, so that characters of all sizes (1) to (9) in FIG. 10A can be recognized.

On the other hand, when the set image has a display time of 16 ms (corresponding to hold display), the shift amount is 1.68 mm. This is compared with the above-described visibility reduction condition (corresponding to a gap of 10% in character height and 50% gap in the Landolt ring being filled).
Deviation amount: 10% = 1.68 mm Character size (vertical size) is 16.8 mm. This is located between (6) length 18.0 mm to (7) length 14.0 mm in FIG.

  That is, when the walking time is set to display time = 16 ms (corresponding to hold display), characters of size (6) or larger in FIG. 10A can be recognized, but (7) in FIG. 10A. This means that characters of the following sizes cannot be recognized.

When walking (eye movement speed 2 deg / s), the longest display time for visually recognizing the character (9) 5.2 mm in FIG. 10A is the recognizable character size 5.2 mm from the data shown in FIG. That is, it can be determined that display time = 5 ms.
That is, during walking (eye movement speed 2 deg / s), by performing pulse display with the ON output period set to a time of 5 ms or less, all sizes (1) to (9) shown in FIG. Characters can be recognized.

  The dotted line frame shown in FIG. 11 is a frame indicating an entry corresponding to the longest display time in which all characters (1) 88 mm to (9) 5.2 mm in FIG. 10A can be recognized.

Next, the case of low-speed running (eye movement speed 5 deg / s) will be described.
In the case of a set image with a display time = 1 ms (equivalent to pulse display), the deviation amount = 0.21 mm. A character size that can be identified is calculated using the above-described visibility lowering condition (corresponding to a gap of 10% in character height and 50% gap in the Landolt ring).
Deviation amount: 10% = 0.21 mm Character size (vertical size) is 2.10 mm. This is a size of (9) 5.2 mm or less in FIG.
In other words, in the case of low-speed running, when the pulse display of display time = 1 ms is used, characters (1) to (9) in FIG. 10A can be recognized.

On the other hand, when the set image has a display time of 5 ms (equivalent to pulse display), the deviation amount is 0.63 mm. This is compared with the above-described visibility reduction condition (corresponding to a gap of 10% in character height and 50% gap in the Landolt ring being filled).
Deviation amount: 10% = 0.63 mm Character size (vertical size) is 6.30 mm. This is located between (8) 10.0 mm long to (9) 5.2 mm long in FIG.

  In other words, when the display time is 5 ms (equivalent to pulse display) during low-speed running, characters of size (8) or larger in FIG. 10A can be recognized, but (9) in FIG. ) Characters of the following sizes cannot be recognized.

The maximum display time for visually recognizing the character (9) 5.2 mm in FIG. 10A during low-speed running (eye movement speed 5 deg / s) is based on the data shown in FIG. It can be determined that the entry indicates 2 mm or less, that is, the display time = 2 ms.
That is, during low-speed running (eye movement speed 5 deg / s), by performing pulse display with the ON output period set to a time of 2 ms or less, all sizes (1) to (9) shown in FIG. Can be recognized.

Next, the case of high-speed running (eyeball movement speed 10 deg / s) will be described.
In the case of a set image with a display time = 1 ms (equivalent to pulse display), the deviation amount is 0.521 mm. A character size that can be identified is calculated using the above-described visibility lowering condition (corresponding to a gap of 10% in character height and 50% gap in the Landolt ring).
Deviation amount: 10% = 0.52 mm The character size (vertical size) is 5.20 mm. This is a size corresponding to (9) length 5.2 mm in FIG.
In other words, when high-speed running and pulse display with a display time = 1 ms, characters of all sizes (1) to (9) in FIG. 10A can be recognized.

On the other hand, when the set image has a display time of 2 ms (equivalent to pulse display), the deviation amount is 1.05 mm. This is compared with the above-described visibility reduction condition (corresponding to a gap of 10% in character height and 50% gap in the Landolt ring being filled).
Deviation amount: 10% = 1.05 mm Character size (vertical size) is 10.50 mm. This is located between (7) 14.0 mm in length and (8) 10.0 mm in FIG.

  That is, when the display time is 2 ms (corresponding to pulse display) during high-speed running, characters of size (7) or larger in FIG. 10A can be recognized, but (8) in FIG. ) Characters of the following sizes cannot be recognized.

The maximum display time for visually recognizing the character (9) 5.2 mm in FIG. 10A during high-speed running (eye movement speed 10 deg / s) is based on the data shown in FIG. It can be determined that the entry indicates 2 mm or less, that is, the display time = 1 ms.
That is, during high-speed running (eye movement speed 10 deg / s), by performing pulse display with the ON output period set to a time of 1 ms or less, all sizes (1) to (9) shown in FIG. Can be recognized.

FIG. 12 is a table summarizing two analysis results obtained from the results shown in FIG. FIG. 12 shows the results of analyzing the following two analysis results for each of (a) walking, (b) low-speed running, and (c) high-speed running.
(Analysis result 1) Among the characters shown in FIG. 10A, the character size that can be recognized in the continuous display (hold display = 16 ms) and the character size that cannot be recognized. (Analysis result 2) The minimum character shown in FIG. Display time of pulse display capable of recognizing 5.2 mm long characters

(Analysis result 1) shows the character size that can be recognized when continuous display (hold display = 16 ms) is performed for each of (a) walking, (b) low-speed running, and (c) high-speed running. Indicates the character size.
As shown in the figure, the following analysis results were obtained.

(A) Walking (eye movement speed = 2 deg / s)
Recognizable: (1) Vertical 88 mm to (6) Vertical 18.0 mm in FIG.
Unrecognizable: (7) Length 14.0 mm to (9) Length 5.2 mm in FIG.
(B) Low speed running (eye movement speed = 5 deg / s)
Recognizable: (1) Vertical 88 mm to (3) Vertical 44.0 mm in FIG.
Unrecognizable: (4) length 33.6 mm to (9) length 5.2 mm in FIG.
(C) High-speed running (eye movement speed = 10 deg / s)
Recognizable: (1) in FIG. 10A (1) Only 88 mm long Unrecognizable: (2) in FIG. 10A (2) 67.2 mm to (9) 5.2 mm long

  As understood from the above results, the character size recognizable in the hold display gradually increases as the exercise becomes intense.

Also, (Analysis result 2) is a pulse display that can recognize a character with a minimum length of 5.2 mm shown in FIG. 10A for each of (a) walking, (b) low-speed running, and (c) high-speed running. The display time is shown.
As shown in the figure, the following analysis results were obtained.

(A) Walking (eye movement speed = 2 deg / s)
Pulse display with a display time of 5 ms or less (b) Low-speed running (eye movement speed = 5 deg / s)
Pulse display with a display time of 2 ms or less (c) High-speed running (eye movement speed = 10 deg / s)
Pulse display with a display time of 1 ms or less

  As understood from the above results, it is necessary to set the display time in the pulse display to 5 mms or less during walking, and to further shorten the display time in the pulse display as the exercise becomes intense.

When the pulse display time is set to 1 ms to 5 ms, (a) walking, (b) low speed running, (c) high speed running, and (1) 88 mm to (9) shown in FIG. ) The visibility of all characters with a length of 5.2 mm can be ensured.
As can be understood from the analysis results shown in FIGS. 11 and 12, a display device that can clearly recognize the display contents during exercise is realized by controlling the “display character (symbol) size and pulse display time” according to the exercise intensity. It was confirmed that it was possible.

[7. Configuration for executing control according to user movement]
From the above analysis results, considering only the point that the display information of a human-mounted or portable display device such as a head-mounted display can be clearly recognized during exercise, the display time is shorter than the afterimage time. It can be said that it is possible to solve the problem by using a pulse display having a non-display time.

However, it is presumed that, for example, the pulse display when it is stopped is not only obstructive, but the visibility may be worse and worse than the normal display (hold display).
In consideration of such circumstances, the display content (characters, images, etc.) and other information depending on the user's activity / operation status (walking, running, cycling, etc.) and the external light environment (morning, night, night, region, etc.) It is considered preferable to control the parameter value (optimum adjustment).

Hereinafter, an embodiment will be described in which display control according to the situation is executed in this way to improve comfort in the display information recognition process.
The embodiment described below is an embodiment of a display device that can be used comfortably in various use environments and states by controlling the display mode, timing, content, brightness, and the like according to the exercise / activity state.

FIG. 13 is a diagram for explaining an example of display control according to various exercise states of a user who wears or carries a human-mounted or portable display device such as a head-mounted display.
In FIG. 13, the following five exercise situations are set as the exercise situations of the user.
(1) Stationary (STAY)
(2) Walking (WALK)
(3) Low speed running (JOG)
(4) High speed running (RUN)
(5) Bicycle (BIKE)

FIG. 13 shows the following information corresponding to these five exercise situations.
(A) Movement vibration period (Sec)
(B) Head movement width (mm)
(C) Eye velocity (deg / s)
(D) Optimal display mode (e) Optimal display time (f) Information depth

(A) The motion cycle basically corresponds to the motion cycle of a body part such as a head equipped with a display device such as a head, mount, or display.
When stationary, it is infinite (∞), 0.5 seconds for walking, 0.3 seconds for low-speed running, and 0.2 seconds for high-speed running. These cycles correspond to the cycle of one step when executing walking and running. In the case of cycling, periodic data could not be obtained, depending on speed and road conditions.

(B) The head movement width corresponds to the movement width of each head in the cycle (a).
It is 0 mm for stationary, 50 mm for walking, 100 mm for low-speed running, and 100 mm for high-speed running. In the case of cycling, the speed varies depending on the road conditions.

(C) The eyeball velocity is data on the eyeball angular velocity (deg / s) based on the theory described above with reference to FIG.
It is 0 deg / s for stationary, 2.0 deg / s for walking, 5.0 deg / s for low speed running, and 10 deg / s for high speed running. In the case of cycling, the speed varies depending on the road conditions.

  (D) The optimal display mode is setting information of an optimal display mode according to the user exercise situation obtained based on the analysis results described above with reference to FIGS. That is, this is display mode setting information that allows the display information on the display unit to be recognized without unreasonableness. Specifically, this is an optimal display mode in which the eyeball movement speed is calculated based on the motion state of the head and determined according to the calculation result.

In the example shown in FIG.
When the user state is stationary, walking, or low-speed running, hold (continuation) display is used, and when the user state is walking, low-speed running, high-speed running, or bicycle running, pulse display is used.
In walking and low-speed running, it indicates that either hold display or pulse display may be selected.

  In still, walking, and low-speed running, the display is held (continuous). However, when intense body movement or shock that causes the eyeball to move at high speed is detected, the display is temporarily turned off (OFF). Execute control.

In addition, when performing pulse display during walking, low-speed running, high-speed running, and bicycle running, it is preferable to further control the display ON / OFF timing in the pulse display according to the user's exercise.
Specifically, the following control is performed.
* Pulse display with a display period set to the eyeball stability timing obtained from the motion cycle result, and short pulse display with a short lighting (ON) time when the operation cycle is less than a preset threshold (for example, 0.25 seconds) When the operation cycle is longer than the threshold value, a long pulse display with a long lighting (ON) time is used.
* Fixed-cycle pulse display in non-periodic motion By performing such display control, the user can recognize display information more stably.

(D) Since the optimum display time is hold (continuation) display when the user state is stationary, walking, or low-speed running, the display time is continuous, that is, infinite (∞).
In the case of pulse display during walking, low-speed running, high-speed running, and bicycle running, it is preferable to control according to the activity status and external illuminance.
Specifically, it is preferable to perform pulse display in which the lighting (ON) time is set to 2 to 10 ms and the extinguishing (OFF) time is set to 50 to 200 ms.

(E) The information depth means the level of information displayed on the display unit.
For example, in a stationary state, a full display for displaying detailed information including a sentence using a small character size, a map, a detailed figure, and the like is performed.
In a situation where movement occurs such as walking or running, the display of information such as small character information is stopped, and information of a level that can be recognized with a medium amount of deviation is displayed. For example, current location information, simple maps, navigation information, and the like.
Furthermore, in a situation where movement is intense, such as high-speed running or bicycle running, only information of a level that can be recognized even if the amount of deviation is large is displayed.
Specifically, for example, simple instruction information, danger avoidance information, and the like.

In FIG. 14, the figure which put together the example of the setting of the display mode in each following user state and display information is shown.
(1) Stationary (STAY)
(2) Walking (WALK)
(3) Low speed running (JOG)
(4) High speed running (RUN)
(5) Bicycle (BIKE)

Hold display is used for stationary, walking, and low-speed running, and pulse display is used for walking, low-speed running, high-speed running, and bicycle running.
In the case of walking or low-speed running, either setting of hold display or pulse display may be used. Specifically, for example, it is preferable to perform the switching control according to the eyeball moving speed. If the moving speed is less than or equal to a preset threshold (for example, 3.5 deg / s), the hold display is set, and if the moving speed is equal to or higher than the threshold, the pulse display is set.

The display information is displayed by increasing the amount of information as the eye movement speed, such as still or walking, is reduced, and by constructing display information using a small character size.
The display processing is performed by constructing display information with a smaller amount of information and a larger character size as the eyeball moving speed is higher, such as high-speed running and bicycle running.

[8. Control of display timing in pulse display]
In the pulse display described with reference to FIG. 13, the pulse display in which the display period is set to the eyeball stability timing obtained from the motion cycle result has been briefly described. Hereinafter, this process will be described in detail.

As described above with reference to FIGS. 8 and 9, during walking or running, the eyeball generates a movement according to the user's movement cycle.
The moving speed (angular velocity) of the eyeball at this time also varies at a predetermined cycle.

FIG. 15 is a graph showing the position (direction angle) and moving speed (angular velocity) of the eyeball during walking and running described above with reference to FIGS. 8 and 9.
FIG. 15A is a graph showing the position (direction angle) and moving speed (angular velocity) of the eyeball during walking, and corresponds to the graph of FIG. 8A2.
FIG. 15B is a graph showing the position (direction angle) and moving speed (angular velocity) of the eyeball during running, and corresponds to the graph of FIG. 9B2.

In each of these graphs, the eyeball moving speed (angular velocity) is shown as a solid line graph. The moving speed of the eyeball indicated by the solid line has a periodic speed change, and points indicating a speed of 0 regularly appear.
For example, in the case of walking, points indicated by arrows (p), (q), and (r) shown in FIG. 15 (A) are points at which the moving speed = 0.
In the case of running, the points indicated by the arrows (p), (q), (r), and (s) shown in FIG. 15B are points at which the moving speed = 0.
At these timings, even when the user is walking or running, the eyeball is in a stationary state in which there is almost no movement of the eyeball.

  By controlling the timing of these arrows as the ON (lighting) time in the pulse display, it is possible to observe the display information with almost no movement of the eyeball of the user, and stable display information can be recognized. Become.

  FIG. 16 shows a graph of the eyeball direction and the eyeball movement speed during walking on the upper stage. The lower part shows an example of display control in the case of performing pulse display in which the display unit is turned on (ON) at the timing when the eyeball velocity derived from this graph becomes almost zero.

The graph shown in the lower part of FIG. 16 shows a pulse display in which the display is turned on (ON) at the timing when the eyeball velocity becomes almost zero, that is, each timing of p, q, and r, and the other timings are turned off (OFF). This is the setting to be made.
It should be noted that pulse display with the ON period set to 2 to 10 ms and the OFF period set to about 200 ms can realize pulse display that is set to ON only at the timing when the eyeball velocity becomes almost zero during walking.

  FIG. 17 shows a graph of the eyeball direction and the eyeball movement speed during running in the upper part. The lower part shows an example of display control in the case of performing pulse display in which the display unit is turned on (ON) at the timing when the eyeball velocity derived from this graph becomes almost zero.

The graph shown in the lower part of FIG. 17 is a pulse in which the display is turned on (ON) and the other timings are turned off (OFF) at the timing when the eyeball velocity becomes almost zero, that is, at each timing of p, q, r, and s. It is a setting to display.
It should be noted that the pulse display with the ON period set to 2 to 10 ms and the OFF period set to about 150 ms can realize the pulse display set to ON only at the timing when the eyeball velocity becomes almost zero during running.

[9. Display brightness control]
The visibility in the case of performing pulse display varies depending on the value of the product of display time and luminance. This is because the human eye feels brightness according to the amount of light integrated over time, and its spectral amount is required when the display time is short. (Baroque law)
It is also necessary to consider the use in bright outdoors. If the background field is bright, the pupil will shrink, and the amount of light in the pulse display must be increased accordingly. Since there is no paper on the relationship between display time and brightness in milliseconds, we constructed an experimental system and actually measured it. FIG. 18 is a block diagram of the experimental system.

First, a light box 77 for photographic negative projection is disposed as a background luminance device. The light box 77 presents light equivalent to outside light to the subject (maximum 4000 nt).
A display device 70 is arranged on the right side. The display device 70 includes an LED 71 including a control unit, a diffusion plate 72, and an OHP sheet 73. The display device 70 is a display monitor that assumes a virtual image screen of a head-mounted display (maximum 2500 nt).

  The light emitted from the display device 70 is reflected by the half mirror 74 to which the central light shielding sheet 75 is attached and is input to the eyes of the subject 78. The display character of the display device 70 is a white Landolt ring (C) made of the OHP sheet 73. This system created a simulated environment in which the display information on the head-mounted display was observed while exposed to outdoor light.

The display device 70 can arbitrarily change the brightness and the display time. In the experiment, when the display time was decreased from 3 ms to 1 ms, the luminance at which the subject 78 began to recognize the Landolt ring and the luminance at which the Landolt ring was clearly visible were measured. There are 4 subjects.
The graph shown in FIG. 19 is a graph showing the results.

FIG. 19 shows experimental results of pulse display of the following pattern.
(A) Display brightness in which display information is recognized in a pulse display of 1 ms on and 300 ms off,
(B) Display brightness in which display information is recognized in a pulse display of 2 ms on and 300 ms off,
(C) Display luminance in which display information is recognized in a pulse display of 3 ms on and 300 ms off,
Each line shown in FIG. 19 shows an average value of four subjects.

According to this experimental result, it can be seen that, for example, when the background luminance is 4000 nt when the lighting is performed for 3 ms, the display luminance can be visually recognized if the display luminance is 400 nt or more.
Further, it was confirmed by actual measurement that the display luminance is 4000 nt or more when the background luminance is 4000 nt and the display luminance is 1200 nt when the background luminance is 4000 nt when the lighting is 1 ms.

  Subsequently, based on the experimental results, the necessary luminance necessary for visual recognition of the display information when information is displayed on the display unit in a bright environment is calculated. The background luminance of 4000 nt that can be actually measured with the system shown in FIG. 18 is a brightness equivalent to a sunny day / daytime in spring, and a brighter environment is assumed when used during actual sports.

  FIG. 20 is a graph obtained by converting the actually measured display luminance into one frame average luminance (1 frame = 16.67 ms) in calculating the necessary luminance in an environment exceeding 4000 nt. The horizontal axis represents the environmental luminance of the background environment corresponding to the outside, and the vertical axis represents the average luminance of one frame used as display information on the display unit. From this graph, it can be seen that the relationship between the display average luminance and the background luminance does not depend on the display time (2 ms, 3 ms).

Based on the above results, FIG. 21 shows the result of calculating data corresponding to the actual external environment.
In FIG. 21, the horizontal axis represents the ambient luminance of the external environment, and the vertical axis represents the one-frame average luminance of a frame used as display information on the display unit.
The environmental brightness of the outside environment is, for example, about 6000 nt for summer sunny weather, about 11000 nt for summer sunny weather, and about 16000 nt for summer sunny and reflected environments such as the sea.

For example, in the case of a standard environment as an exercise environment such as running (summer clear = 11000 nt), when the lighting (ON) time of the display unit for executing the pulse display is 4 ms, 2 ms, 1 ms,
4 ms pulse display = 1000 nt required brightness
2 ms pulse display = necessary brightness 2000 nt,
1 ms pulse display = required brightness 4000 nt
As described above, necessary luminance information necessary for information recognition in each pulse display was obtained.

Also, in the clear sunny reflection (= 16000 nt) that is the extreme environment of brightness, when the lighting (ON) time of the display unit that performs pulse display is 3 ms, 2 ms, and 1 ms,
3 ms pulse display = required brightness 2000 nt,
2 ms pulse display = required brightness 3000 nt,
1 ms pulse display = required brightness 6000 nt
As described above, necessary luminance information necessary for information recognition in each pulse display was obtained.

[10. About display control processing sequence]
Next, a sequence of display control processing executed by the control device of the present disclosure will be described with reference to the flowchart shown in FIG.
Note that the processing described with reference to the flowchart shown in FIG. 22 and the following is executed according to control of a data processing unit (control unit) including a CPU or the like having a program execution function, for example, according to a program stored in the memory of the control device. .

(10-1. Basic sequence for switching control between hold display and pulse display)
The flowchart shown in FIG. 22 is a basic display when the display device display is a hold (continuous) display or a pulse display that repeats lighting (ON) / extinguishing (OFF), or alternative processing is performed. It is a flowchart explaining a control sequence.
The process of each step will be described.

(Step S11)
First, in step S11, sensor information attached to a display device such as a head-mounted display is acquired. The display device includes various sensors such as a sensor that detects a user's movement. The control unit acquires these sensor information. In step S11, specifically, sensor information such as an acceleration sensor is acquired.

(Step S12)
Next, in step S12, the control unit determines the user's movement based on the acquired sensor information, and calculates the maximum movement speed of the eyeball based on the determined user's movement.
The calculation process of the eyeball speed is executed as a calculation process according to the theory described above with reference to FIGS.

(Step S13)
Next, in step S13, it is determined whether the maximum eyeball speed calculated in step S12 is greater than or equal to a predetermined threshold value. The threshold is, for example, an eyeball velocity of 2 deg / s, and the determination formula is as follows.
Maximum eye speed> 2 deg / sec

If the determination formula is satisfied, that is, if it is determined that the maximum eyeball speed calculated in step S12 is equal to or greater than a predetermined threshold value, the process proceeds to step S14.
If the determination formula is not satisfied, that is, if it is determined that the maximum eyeball speed calculated in step S12 is less than a predetermined threshold value, the process proceeds to step S15.
Note that the above threshold value is an example, and various threshold values can be set.

(Step S14)
If the above determination formula is satisfied, that is, if it is determined that the maximum eyeball speed calculated in step S12 is equal to or greater than a predetermined threshold value, the process proceeds to step S14, where the display on the display unit is set to pulse display and display processing is performed. Run.
In addition, it is preferable to set the lighting (ON) time in the pulse display to 2 to 10 msec and the extinguishing (OFF) time to 50 to 200 msec.

(Step S15)
If the determination formula is not satisfied, that is, if it is determined that the maximum eyeball speed calculated in step S12 is less than a predetermined threshold value, the process proceeds to step S15, and the display on the display unit is set to hold (continuation) display. Execute display processing.

Note that the processing according to the flow shown in FIG. 22 is repeatedly executed periodically. Therefore, the hold display and the pulse display are appropriately switched according to the change in the exercise state of the user.
However, if this switching is frequently performed, there is a concern that the visibility may be lowered. Therefore, an appropriate hysteresis is provided for switching between the pulse display and the hold display so that the mode is not frequently switched.

  In the above description, the movement speed of the eyeball has been calculated based on the user's movement and based on the theory described above with reference to FIGS. 7 to 9. It is also possible to use a sensor that directly monitors and measures the movement of the sensor.

In addition, when calculating the moving speed of the eyeball from the measurement value of the sensor mounted on the head that detects the user's movement, for example, processing according to the following equation is applicable.
Target viewpoint (for example, 3.0 m) = L [m],
Constant = a (where 0 <a <0.3), and in the following example, a = 0.21.
Head position (height change amount) Ph] m],
And
Eye movement angular velocity: Ve [deg / sec] is obtained by the following equation.
Ve = d (arctan (Ph / L) −arntan (Ph / aL)) / dt

(10-2. Exercise status determination processing sequence)
Next, a processing sequence for determining an exercise situation of a user wearing a display device such as a head-mounted display will be described with reference to a flowchart shown in FIG.
The process of each step will be described.

(Step S101)
First, in step S101, sensor information attached to a display device such as a head-mounted display is acquired. The display device includes various sensors such as a sensor that detects a user's movement, and the control unit acquires the sensor information. In step S101, specifically, sensor information such as an acceleration sensor is acquired.

(Step S102)
Based on the sensor information acquired in step S101, the control unit determines whether the user is stationary, performing a periodic motion that repeats a certain motion, or performing a non-periodic motion.
The periodic exercise is, for example, walking (walking) described with reference to FIG. 8, running such as running described with reference to FIG.
The non-periodic exercise is an exercise accompanied by a non-constant movement, such as a bicycle run.

When it is determined that the user is in a stationary state or in a state of performing periodic exercise, the process proceeds to step S103.
If it is determined that the user is performing a non-periodic motion that is not a periodic motion, the process proceeds to step S106.

(Step S103)
If it is determined in step S102 that the user is stationary or performing a periodic exercise, the process proceeds to step S103, and further, whether the user is stationary or walking, or is in a running (running) state. judge. This determination is made based on the length of the exercise cycle. That is, as described above with reference to FIG. 13, determination based on the length of the motion vibration period in FIG. 13 (1) is possible.

If it is determined in step S103 that the user is stationary or walking, the process proceeds to step S104.
On the other hand, if it is determined in step S103 that the user is in the running (running) state, the process proceeds to step S105.

(Step S104)
If it is determined in step S103 that the user is stationary or walking, the process proceeds to step S104, and display control corresponding to stationary or low-cycle motion is executed in step S104. That is, display control corresponding to the case where the user is standing still or walking is executed.
This process corresponds to the hold display process shown in the (d) column of FIG.

(Step S105)
If it is determined in step S103 that the user is in the running (running) state, the process proceeds to step S105, and in step S105, display control corresponding to the high-cycle motion is executed. That is, display control corresponding to the case where the user is walking or running (running) is executed.
This process is a process corresponding to the display control process during the execution of the periodic motion excluding the non-periodic motion in the bicycle running or the like during the pulse display processing shown in the column (d) of FIG.

(Step S106)
If it is determined in step S102 that the user is performing a non-periodic exercise, the process proceeds to step S106, and display control corresponding to the non-periodic exercise state is executed in step S106. That is, display control corresponding to the case where the user is traveling on a bicycle is executed.
This process is a process corresponding to the display control process during the execution of the aperiodic motion during the pulse display process shown in the column (d) of FIG.

(10-3. Display control sequence when stationary or low-cycle motion is executed)
Next, with reference to the flowchart shown in FIG. 24, a display control processing sequence in the case where the user is performing a low-cycle motion such as stationary or walking will be described. That is, this is a detailed sequence of the display control process in step S104 shown in FIG.
The process of each step will be described.

(Step S201)
First, in step S201, sensor information attached to a display device such as a head-mounted display is acquired. In addition to the user's movements, the display device is equipped with various sensors that measure the user's position, the user's body condition (heart rate and sweating amount), and the outside temperature, humidity, and illuminance. ing. The control unit acquires these sensor information.

(Step S202)
Next, in step S202, the control unit builds display information to be presented to the user based on the acquired sensor information.
For example, it is composed of map information indicating the current position based on information obtained from the position sensor, information indicating the physical condition of the user obtained from a sensor that grasps the state of the user's body, information on the outside temperature and humidity, etc. Build display information.

(Step S203)
In step S203, a screen for combining the display information generated in step S202 and outputting it to the display unit is generated. The display screen is a halt display screen for continuous display. Further, the display brightness is determined according to the brightness of the outside world obtained by the illuminance sensor, that is, the brightness determined according to the environmental brightness. Specifically, as described above with reference to FIGS. 19 to 21 and the like, the display information determined in accordance with the environmental luminance is set to a recognizable luminance level.

(Step S204)
In step S204, continuation (hold) display of the display screen generated in step S203 is started.

  The flow shown on the right side of FIG. 24 is an interrupt control flow executed while the processing of steps S201 to S204 on the left side is continued. This processing flow will be described.

(Step S251)
In step S251, the control unit acquires sensor information attached to a display device such as a head-mounted display. The display device is provided with a sensor that detects, for example, a sudden impact, for example, an acceleration sensor.
The control unit determines whether or not there is a shock such as an impact on the display device based on the output from the acceleration sensor.
If it is determined that a shock has been detected, the process proceeds to step S252.

(Step S252)
If it is determined in step S251 that a shock has been detected, the output of the display unit is stopped in step S252.
This process corresponds to the display-off process at the time of shock detection during the hold display execution in the optimum display mode of FIG. 13D described above with reference to FIG.

(10-4. Display control sequence during high-cycle motion execution)
Next, with reference to the flowchart shown in FIG. 25, a display control processing sequence when the user is performing high-cycle exercise such as running will be described. That is, it is a detailed sequence of the display control process in step S105 shown in FIG.
The process of each step will be described.

(Step S301)
First, in step S301, sensor information attached to a display device such as a head-mounted display is acquired. As described above, in addition to the user's movement, the display device has various sensors that measure the user's position, the user's body condition (heart rate and sweating amount), and the outside temperature, humidity, illuminance, etc. A sensor is provided. The control unit acquires these sensor information.

(Step S302)
In step S302, the control unit builds display information to be presented to the user based on the acquired sensor information.
For example, it is composed of map information indicating the current position based on information obtained from the position sensor, information indicating the physical condition of the user obtained from a sensor that grasps the state of the user's body, information on the outside temperature and humidity, etc. Build display information.

(Step S303)
In step S303, the eyeball stability timing is calculated. In other words, the timing at which the eyeball movement speed as described above with reference to FIGS. 16 and 17 becomes approximately zero is calculated. This timing can be calculated based on the movement period of the eyeball calculated from the user's movement period.

This timing information can be calculated by a learning process of the user's exercise status data.
In step S303, for example, correspondence data between the user's movement cycle and the eyeball stability timing is created, and data that can immediately determine whether the current time is the eyeball stability timing from the user's movement situation detected by the sensor. Generate.

(Step S304)
In step S304, it is determined whether or not the user operation cycle is equal to or less than a predetermined threshold.
If it is equal to or less than the threshold value, the process proceeds to step S306. If larger than the threshold value, the process proceeds to step S305.
In this process, for example, when intense exercise with a short cycle such as high-speed running is performed, the process proceeds to step S306, pulse display with a short lighting time for display ON is executed, and a relatively long cycle such as low-speed running is performed. If a gentle exercise is being performed, it means that the process proceeds to step S305, and pulse display with a longer lighting time for display ON is executed.

(Step S305)
Step S305 is processing when it is determined in step S304 that the user's operation cycle is larger than a predetermined threshold value. In other words, this is processing when a gentle exercise with a relatively long period, such as low-speed running, is performed. In this case, in step S305, the pulse display with the lighting time set to ON for display is set to be executed.

(Step S306)
Step S306 is processing when it is determined in step S304 that the user's operation cycle is equal to or less than a predetermined threshold. That is, it is a process when a long and intense exercise with a short cycle, such as high-speed running, is performed, and in this case, in step S306, a setting is made to execute pulse display with the lighting time set to display ON shortened.

(Step S307)
In step S305 or step S306, after the pulse display setting is completed, it is determined in step S307 whether or not the eyeball stabilization timing has come. That is, based on the correspondence data between the user's exercise situation and eyeball stability timing calculated in step S303, it is sequentially determined whether or not it is eyeball stability timing from the exercise information detected from the sensor.

  If it is determined that the current time is the eyeball stabilization timing, the process also proceeds to step S308, and otherwise, the process returns to step S301.

(Step S308)
In step S308, it is determined whether or not the turn-off time (OFF) in the pulse display is within a predetermined time range.
As described with reference to FIGS. 10 to 13, for example, the appropriate time for turning on (ON) and turning off (OFF) in the pulse display is as follows.
Lighting (ON) time = 2-10 ms,
OFF time = 50 to 200 ms,
It is.
In step S308, it is determined whether or not the turn-off (OFF) time is in the range of 50 to 200 ms.
In the case of Yes, it progresses to step S309, and in No, it returns to step S301.

(Step S309)
In step S309, display information is output in the pulse display, that is, the display unit is turned on (ON) and the display information is output. The lighting (ON) time is the lighting (ON) time set in step S305 or step S306. If lighting time passes, it will return to step S301.

(10-5. Display control sequence during execution of non-periodic motion)
Next, with reference to the flowchart shown in FIG. 26, a display control processing sequence in the case where the user is performing a non-periodic exercise such as a bicycle run will be described. That is, this is a detailed sequence of the display control process in step S106 shown in FIG.
The process of each step will be described.

(Step S401)
First, in step S401, sensor information attached to a display device such as a head-mounted display is acquired. In addition to the user's movements, the display device is equipped with various sensors that measure the user's position, the user's body condition (heart rate and sweating amount), and the outside temperature, humidity, and illuminance. ing. The control unit acquires these sensor information.

(Step S402)
Next, in step S402, the control unit builds display information to be presented to the user based on the acquired sensor information.
For example, it is composed of map information indicating the current position based on information obtained from the position sensor, information indicating the physical condition of the user obtained from a sensor that grasps the state of the user's body, information on the outside temperature and humidity, etc. Build display information.

(Step S403)
In step S403, a screen for combining the display information generated in step S402 and outputting it to the display unit is generated. The display screen is a pulse display screen. Further, the display brightness is determined according to the brightness of the outside world obtained by the illuminance sensor, that is, the brightness determined according to the environmental brightness. Specifically, as described above with reference to FIGS. 19 to 21 and the like, the display information determined in accordance with the environmental luminance is set to a recognizable luminance level.

(Step S404)
In step S404, pulse display of the display screen generated in step S403 is started.

  The flow shown on the right side of FIG. 26 is an interrupt control flow executed while the processing of steps S401 to S404 on the left side is continued. This processing flow will be described.

(Step S451)
In step S451, the control unit acquires sensor information attached to a display device such as a head-mounted display. The display device is provided with a sensor that detects, for example, a sudden impact, for example, an acceleration sensor.
The control unit determines whether or not there is a shock such as an impact on the display device based on the output from the acceleration sensor.
If it is determined that a shock has been detected, the process proceeds to step S452.

(Step S452)
If it is determined in step S451 that a shock has been detected, the output of the display unit is stopped in step S452.

[11. Example of switching between afterimage-considering pulse display and normal pulse display with non-display period set within afterimage recognition period]
In the above-described embodiment, the configuration for performing switching control of the following two settings has been described.
(A) “Continuous display (hold display)” in which the backlight of the display unit is always ON,
(B) “intermittent display (pulse display)” that repeats turning on / off (ON / OFF) of the backlight of the display unit;
It has been described as an embodiment for performing these switching controls.
As described above with reference to FIGS. 13 and 14, when the user state is stationary, walking, and low-speed running, the hold (continuation) display is used. When the user state is walking, low-speed running, high-speed running, and bicycle running, a pulse is displayed. This is a display control.

Another example of such display control will be described. Hereinafter, the display control to be described switches the display on the display unit in the following two modes.
(A) Pulse display that repeats turning on / off (ON / OFF) of the backlight of the display unit, and an afterimage-considering pulse display in which the non-display period is set within the afterimage recognition period;
(B) Pulse display in which the backlight of the display unit is repeatedly turned on / off (ON / OFF), a normal pulse display in which the non-display period is set to be longer than the afterimage recognition period,
The control which switches the display of said (a), (b) is performed.

“(A) Afterimage-considering pulse display” has substantially the same effect as “always-on“ continuous display (hold display) ”in the above-described embodiment, that is, the observer can continuously observe the display information. It is a display method that is in a state.
This afterimage considering pulse display will be described with reference to FIG.

FIG. 27 is a graph showing time on the horizontal axis and ON / OFF setting of the display unit on the vertical axis.
For example, at time t1 to t2 and time t3 to t4, the display unit is in an ON state and information display is executed.
On the other hand, at time t2 to t3 and time t4 to t5, the display unit is in an OFF state and information display is not executed.
However, immediately after the display unit is switched from the ON state to the OFF state, an afterimage is generated in the human eye, and the display information, for example, the character [ABC] displayed on the display unit shown in the figure is recognized. is there. That is, a “afterimage recognition period” of a predetermined period occurs.
Only after the “afterimage recognition period” of a predetermined period has elapsed, a person can recognize that nothing is displayed on the display unit.
However, if the display unit is set to the ON state again before the “afterimage recognition period” elapses, the person determines that the display information on the display unit is continuously displayed.

As described above, the afterimage pulse display is a pulse display in which the non-display period (for example, times t2 to t3, t4 to t5, and the like shown in the drawing) is set to a time within the “afterimage recognition period”.
By performing such a pulse display, a person recognizes that the display information on the display unit is continuously displayed.
That is, the same effect as the halt display in the above-described embodiment is generated.

Note that (b) normal pulse display is a pulse display in which the non-display period is set to be longer than the afterimage recognition period, and corresponds to the pulse display described in the above-described embodiment.
Hereinafter, the display control to be described switches the display of the display unit in these two modes.
That is,
(A) Pulse display that repeats turning on / off (ON / OFF) of the backlight of the display unit, and an afterimage-considering pulse display in which the non-display period is set within the afterimage recognition period;
(B) Pulse display in which the backlight of the display unit is repeatedly turned on / off (ON / OFF), a normal pulse display in which the non-display period is set to be longer than the afterimage recognition period,
The control which switches the display of said (a), (b) is performed.

  Specifically, as shown in FIG. 28, after-image consideration pulse display is used when the user state is stationary, walking, and low-speed running, and normal pulse display is used when walking, low-speed running, high-speed running, and bicycle driving. is there.

The flowchart shown in FIG. 29 is a flowchart for explaining a basic display control sequence in a case where an alternative process is performed for the display device to display afterimage-considered pulse display or normal pulse display.
The process of each step will be described.

(Step S501)
First, in step S501, sensor information attached to a display device such as a head-mounted display is acquired. The display device includes various sensors such as a sensor that detects a user's movement. The control unit acquires these sensor information. In step S501, specifically, sensor information such as an acceleration sensor is acquired.

(Step S502)
Next, in step S502, the control unit determines the user's movement based on the acquired sensor information, and calculates the maximum movement speed of the eyeball based on the determined user's movement.
The calculation process of the eyeball speed is executed as a calculation process according to the theory described above with reference to FIGS.

(Step S503)
Next, in step S503, it is determined whether the maximum eyeball speed calculated in step S502 is greater than or equal to a predetermined threshold value. The threshold is, for example, an eyeball velocity of 2 deg / s, and the determination formula is as follows.
Maximum eye speed> 2 deg / sec

If the determination formula is satisfied, that is, if it is determined that the maximum eye velocity calculated in step S502 is equal to or greater than a predetermined threshold, the process proceeds to step S504.
If the determination formula is not satisfied, that is, if it is determined that the maximum eyeball speed calculated in step S502 is less than a predetermined threshold value, the process proceeds to step S505.
Note that the above threshold value is an example, and various threshold values can be set.

(Step S504)
If the determination formula is satisfied, that is, if it is determined that the maximum eyeball speed calculated in step S502 is equal to or greater than a predetermined threshold value, the process proceeds to step S504, where the display unit displays normal pulse display, that is, the display unit is not displayed. Display processing is executed with the display period set to normal pulse display set to be longer than the afterimage recognition period.

(Step S505)
When the determination formula is not satisfied, that is, when it is determined that the maximum eyeball speed calculated in step S502 is less than a predetermined threshold value, the process proceeds to step S505, and the display unit displays the afterimage-considered pulse display, that is, the display unit. The non-display period is set to the afterimage considering pulse display set within the afterimage recognition period, and the display process is executed.

Note that the processing according to the flow shown in FIG. 29 is periodically and repeatedly executed. Therefore, the afterimage-considered pulse display and the normal pulse display are appropriately switched according to the change in the user's exercise status.
However, if this switching is frequently performed, there is a concern that the visibility may be lowered. Therefore, an appropriate hysteresis is provided for switching between the low-speed pulse display and the normal pulse display so that the mode is not frequently switched.

It is desirable that the eyeball velocity is measured by directly monitoring the eyeball movement. When the movement of the eyeball cannot be measured directly, for example, the setting may be calculated from the following values during exercise (running).
(1) The movement of the torso, such as the head, waist and shoulders, the movement of the legs and arms, the running speed, the movement cycle, etc.

As a specific example, from the sensor measurement value mounted on the head,
"Ve: Eyeball moving angular velocity [deg / sec]"
An example of estimating the will be described.

For example, the following parameters are set.
L: Target viewpoint (tentatively 3.0 m) [m]
a: Constant (0 <a <0.3) (assuming 0.21),
Ph: Head position (height change amount) [m]
Under these parameter settings,
Ve: Eye movement angular velocity [deg / sec] can be calculated by the following equation.
Ve = d (arctan (Ph / L) -arctan (Ph / aL)) / dt

FIG. 30 is a flowchart for explaining the display parameter setting and display control sequence when the display on the display device is the afterimage-considered pulse display. The afterimage-considering pulse display is executed as a repetitive process of “display and non-display” for a fixed time. However, when a shock (acceleration) is applied such that the vibration width of the eyepiece lens part exceeds the visible limit, it is preferable to set the display operation to be paused (display off) for safety. .
The process of each step will be described.

(Step S521)
First, in step S521, a non-display time (period) is set.
The non-display time is calculated by the following formula, for example.
Non-display time = afterimage recognition time (period) x 0.8
As an example of a specific value, for example, it is possible to set a value (default value) = 96 ms in consideration of a general afterimage recognition time. Note that the afterimage recognition time varies depending on the user, and when a value unique to each user can be measured, the measured value may be set.

(Step S522)
Next, the display time per time is set.
The display time is set to 10 ms, for example.

(Step S523)
Next, an afterimage considering pulse display screen is generated. For example, it is composed of map information indicating the current position based on information obtained from the position sensor, information indicating the physical condition of the user obtained from a sensor that grasps the state of the user's body, information on the outside temperature and humidity, etc. Build display information. The display brightness is determined according to the brightness of the outside world obtained by the illuminance sensor, that is, the brightness determined according to the environmental brightness. Specifically, as described above with reference to FIGS. 19 to 21 and the like, the display information determined in accordance with the environmental luminance is set to a recognizable luminance level.

In the flow shown in FIG. 30, the set value for the non-display period is set to 96 ms, for example. However, as described above, for example, when there is a measurement value of the user, the setting is adjusted to be equal to or less than the measurement value. preferable. In the control example according to the flowchart shown in FIG. 30, the 20% margin is set for the afterimage recognition period.
In addition, the display time is 10 ms in the flow shown in FIG. 30, but this is an example. In practice, it is preferable to determine the display time in consideration of the luminance-power consumption characteristics / response speed of the display element, external luminance, and the like. .
It should be noted that general video content can be viewed even at low speed display by matching the ON / OFF repetition time to one frame such as video. For example, the non-display period = 2 ms and the display time = (1 frame-2 ms) are set.

[12. Example of hardware configuration of control device]
Next, a hardware configuration example of a control device that performs the above-described processing will be described with reference to FIG.

The control device 100 is a display device that is worn on the human body of a user, such as a head-mounted display, or a device that performs control of a portable display device.
As illustrated in FIG. 31, the control device 100 includes a control unit 101, a memory 102, an operation unit 103, a display unit 104, an audio output unit 105, a communication unit 106, and various sensors.

The sensors include a geomagnetic sensor 121, a GPS unit 122, an atmospheric pressure sensor 123, a heart rate sensor 124, a sweating amount sensor 125, a gyro sensor 126, an acceleration sensor 127, an illuminance sensor 128, a temperature / humidity sensor 129, and the like.
In addition, the sensor shown in the figure is an example, and a configuration including another sensor may be employed.

  The control unit 101 is a data processing unit having a program execution function such as a CPU, and executes various processes according to a data processing program stored in the memory 102. Specifically, for example, the processing according to the flowcharts shown in FIGS.

In addition to the program executed by the control unit, the memory 102 stores data such as content output via the display unit 104 and the audio output unit 105, sensor information acquired by each sensor, and the like.
The operation unit 103 includes various operation units such as a power switch, selection of output data for the display unit 104, and volume operation for sound output.

The display unit 104 is a display unit configured by an LCD or the like, for example, and displays various data under the control of the control unit 101. In addition, based on control of the control part 101, the display in various aspects, such as a hold display and a pulse display, is performed.
The audio output unit 105 is a speaker, for example, and outputs music, audio information, and the like corresponding to the content displayed on the display unit 105.
The communication unit 105 includes wireless, wired, and various setting communication units, and transmits and receives data to and from an external terminal.

The geomagnetic sensor 121 acquires geomagnetic information to be applied to calculation processing such as current location information. The sensor information acquired by each sensor is input to the control unit 101, and various types of pre-defined information are calculated by processing according to the sensor information analysis program stored in the memory 102.
The geomagnetic information acquired by the geomagnetic sensor 121 is input to the control unit 101 and used for current location information calculation processing and the like.

  The GPS unit 122 is also a sensor used for acquiring current position data using a GPS satellite, and information acquired by the GPS unit 122 is input to the control unit 101 and used for current location information calculation processing and the like.

The atmospheric pressure sensor 123 is a sensor that measures atmospheric pressure.
The heart rate sensor 124 is a sensor that measures a user's heart rate.
The perspiration amount sensor 124 is a sensor that measures the perspiration amount of the user.
The gyro sensor 126 is an angle or angular velocity detection sensor.
The acceleration sensor 127 is a sensor that detects acceleration.
The illuminance sensor 128 is a sensor that detects the illuminance of the outside world.
The temperature / humidity sensor 129 is a sensor that measures the temperature and humidity of the outside world.

  Detection information of each of these sensors is input to the control unit 102. Used to construct and control display information.

[12. Summary of composition of the present disclosure]
As described above, the embodiments of the present disclosure have been described in detail with reference to specific embodiments. However, it is obvious that those skilled in the art can make modifications and substitutions of the embodiments without departing from the gist of the present disclosure. In other words, the present invention has been disclosed in the form of exemplification, and should not be interpreted in a limited manner. In order to determine the gist of the present disclosure, the claims should be taken into consideration.

The technology disclosed in this specification can take the following configurations.
(1) It has a control part which performs display information output control to a user wearing type or portable type display part,
The controller is
According to the exercise status of the user holding the display unit,
A hold display for continuously executing display information output to the display unit;
Switching control of pulse display as intermittent display that repeats a lighting (ON) period that is an output period of display information to the display unit and an extinguishing (OFF) period that is a non-output period of display information, or
An afterimage-considering pulse display in which a lighting (ON) period that is an output period of display information for the display unit and an extinguishing (OFF) period that is a non-output period of display information are set and the extinguishing period is set within an afterimage recognition period , Switching control of normal pulse display with the extinction period set longer than the afterimage recognition period,
A control device that executes any switching control.

(2) The control unit
The movement of the user holding the display unit is
(A) When it is a stationary or low-periodic motion with a long vibration cycle,
(B) In the case of a high periodic motion with a short vibration period,
(C) When the non-periodic motion has a non-constant vibration cycle,
The control device according to (1), wherein different display controls are executed depending on the aspects (a) to (c).

(3) The control unit
The switching control between the hold display and the pulse display or the switching control between the afterimage-considering pulse display and the normal pulse display is executed according to the eyeball velocity of the user estimated according to the user's movement situation holding the display unit ( The control device according to 1) or (2).

(4) The control unit
The setting of the lighting (ON) period in a pulse display is changed in any one of said (1)-(3) according to the user's eyeball speed estimated according to the user's exercise | movement condition holding the said display part. Control device.

(5) The control unit
The control device according to any one of (1) to (4), wherein setting of a lighting (ON) period in pulse display is changed according to an exercise cycle of a user holding the display unit.

(6) The control unit
When the exercise cycle of the user holding the display unit is less than or equal to the threshold value, the setting of the lighting (ON) period in the pulse display is lengthened. When the exercise cycle of the user is longer than the threshold value, the setting of the lighting (ON) period in the pulse display The control device according to any one of (1) to (5), wherein pulse display control is performed to increase the length of the time.

(7) The control unit
A stable period in which the user's eyeball velocity is approximately zero is calculated according to the user's exercise status holding the display unit, and pulse display control is performed in which a lighting (ON) period in pulse display is set in the calculated stable period. The control device according to any one of (1) to (6).

(8) The control unit
The control device according to any one of (1) to (7), wherein when a shock that is an impact on a user holding the display unit is detected, the output of the display unit is stopped.

(9) The control unit
The control device according to any one of (1) to (8), wherein brightness control of the display unit is executed in accordance with environmental brightness in an environment using the display unit.

(10) The control unit
The control device according to any one of (1) to (10), wherein control is performed to change an output mode of display information on the display unit according to an exercise situation of a user holding the display unit.

(11) The control unit
A display information amount is set to be large when a hold display or a pulse display with a long lighting (ON) time is executed, and a display control with a small display information amount is executed when a pulse display with a short lighting (ON) time is executed. The control device according to any one of 1) to (10).

(12) The control unit
At the time of switching control between hold display and pulse display, if the eyeball speed of the user holding the display unit is less than the threshold value, the hold display is executed, and if it is more than the threshold value, the pulse display is executed,
When switching control between afterimage-considered pulse display and normal pulse display is executed, if the eyeball velocity of the user holding the display unit is less than the threshold value, afterimage-considered pulse display is executed, and if it is equal to or higher than the threshold value, normal pulse display is executed ( The control device according to any one of 1) to (11).

(13) The control unit
Based on the user's movement information input from the sensor information, the user's eyeball velocity is calculated, and according to the calculated eyeball velocity, switching control between hold display and pulse display, or switching control between afterimage-considering pulse display and normal pulse display is performed. The control device according to any one of (1) to (12) to be executed.

(14) The control device includes an acceleration sensor;
The controller is
The detection information of the acceleration sensor is applied to calculate the user's eyeball velocity, and switching control between hold display and pulse display or switching control between afterimage-considering pulse display and normal pulse display is executed according to the calculated eyeball velocity. The control device according to any one of (1) to (13).

(15) The display unit is a head-mounted display unit worn on a user's head,
The controller is
Calculates the eye movement speed at the time of eye movement that occurs according to the up and down motion of the user's head, and controls switching between hold display and pulse display, or afterimage-considering pulse display and normal according to the calculated eye movement speed The control device according to any one of (1) to (14), which executes switching control of pulse display.

(16) The control unit
The control device according to any one of (1) to (15), wherein when performing pulse display, pulse display is performed with one lighting (ON) period of 10 ms or less.

(17) A control method executed by a control device for a user-mounted or portable display unit,
The control unit
According to the exercise status of the user holding the display unit,
A hold display for continuously executing display information output to the display unit;
Switching control of pulse display as intermittent display that repeats a lighting (ON) period that is an output period of display information to the display unit and an extinguishing (OFF) period that is a non-output period of display information, or
An afterimage-considering pulse display in which a lighting (ON) period that is an output period of display information for the display unit and an extinguishing (OFF) period that is a non-output period of display information are set and the extinguishing period is set within an afterimage recognition period , Switching control of normal pulse display with the extinction period set longer than the afterimage recognition period,
A control method for executing any switching control.

(18) A program that causes a control device to execute control on a user-mounted or portable display unit,
The program is stored in the control device.
According to the exercise status of the user holding the display unit,
A hold display for continuously executing display information output to the display unit;
Switching control for switching between pulse display as intermittent display that repeats a lighting (ON) period that is an output period of display information to the display unit and an extinguishing (OFF) period that is a non-output period of display information, or
An afterimage-considering pulse display in which a lighting (ON) period that is an output period of display information for the display unit and an extinguishing (OFF) period that is a non-output period of display information are set and the extinguishing period is set within an afterimage recognition period , Switching control to switch the normal pulse display with the extinguishing period set longer than the afterimage recognition period,
A program that executes any switching control.

  The series of processing described in the specification can be executed by hardware, software, or a combined configuration of both. When executing processing by software, the program recording the processing sequence is installed in a memory in a computer incorporated in dedicated hardware and executed, or the program is executed on a general-purpose computer capable of executing various processing. It can be installed and run. For example, the program can be recorded in advance on a recording medium. In addition to being installed on a computer from a recording medium, the program can be received via a network such as a LAN (Local Area Network) or the Internet, and installed on a recording medium such as a built-in hard disk.

  Note that the various processes described in the specification are not only executed in time series according to the description, but may be executed in parallel or individually according to the processing capability of the apparatus that executes the processes or as necessary. Further, in this specification, the system is a logical set configuration of a plurality of devices, and the devices of each configuration are not limited to being in the same casing.

As described above, according to the configuration of an embodiment of the present disclosure, a configuration for executing display information output control with improved visibility of a user-mounted or portable display unit is realized.
Specifically, the control unit performs a hold display that continuously executes display information output to the display unit according to the exercise status of the user holding the display unit, and lighting that is an output period of the display information to the display unit ( (ON) period and switching control of pulse display as intermittent display that repeats a light-off (OFF) period, which is a non-output period of display information, or switching control between afterimage-considering pulse display and normal pulse display. When the movement of the user holding the display unit is (a) stationary or low-periodic movement with a long vibration period, (b) high-periodic movement with a short vibration period, (c) In the case of non-periodic motion with a constant vibration cycle, different display control is executed depending on each of these modes.
With this configuration, output control of display information with improved visibility of the display unit is realized.

DESCRIPTION OF SYMBOLS 10 Head mount display 11 Display part 12 Speaker 15 Control part 30 Display apparatus 31 Display surface 32 Lens 35 Virtual observation position 40 Display apparatus 41 Display character 100 Control apparatus 101 Control part 102 Memory 103 Operation part 104 Display part 105 Audio | voice output Unit 106 communication unit 121 geomagnetic sensor 122 GPS unit 123 barometric pressure sensor 124 heart rate sensor 125 sweat rate sensor 126 gyro sensor 127 acceleration sensor 128 illuminance sensor 129 temperature / humidity sensor

Claims (18)

A control unit that executes display information output control for a user-mounted or portable display unit;
The controller is
According to the exercise status of the user holding the display unit,
A hold display for continuously executing display information output to the display unit;
Switching control of pulse display as intermittent display that repeats a lighting (ON) period that is an output period of display information to the display unit and an extinguishing (OFF) period that is a non-output period of display information, or
An afterimage-considering pulse display in which a lighting (ON) period that is an output period of display information for the display unit and an extinguishing (OFF) period that is a non-output period of display information are set and the extinguishing period is set within an afterimage recognition period , Switching control of normal pulse display with the extinction period set longer than the afterimage recognition period,
A control device that executes any switching control. The controller is
The movement of the user holding the display unit is
(A) When it is a stationary or low-periodic motion with a long vibration cycle,
(B) In the case of a high periodic motion with a short vibration period,
(C) When the non-periodic motion has a non-constant vibration cycle,
The control device according to claim 1, wherein different display controls are executed according to the aspects (a) to (c). The controller is
The switching control between the hold display and the pulse display or the switching control between the afterimage-considering pulse display and the normal pulse display is executed according to the eyeball velocity of the user estimated according to the movement situation of the user holding the display unit. The control apparatus according to 1. The controller is
The control device according to claim 1, wherein the setting of a lighting (ON) period in pulse display is changed according to a user's eyeball speed estimated according to an exercise situation of the user holding the display unit. The controller is
The control device according to claim 1, wherein the setting of a lighting (ON) period in the pulse display is changed according to an exercise cycle of a user holding the display unit. The controller is
When the exercise cycle of the user holding the display unit is less than or equal to the threshold value, the setting of the lighting (ON) period in the pulse display is lengthened. When the exercise cycle of the user is longer than the threshold value, the setting of the lighting (ON) period in the pulse display The control apparatus according to claim 1, wherein pulse display control is performed to increase the length of the control signal. The controller is
A stable period in which the user's eyeball velocity is approximately zero is calculated according to the user's exercise status holding the display unit, and pulse display control is performed in which a lighting (ON) period in pulse display is set in the calculated stable period. The control device according to claim 1. The controller is
The control device according to claim 1, wherein when a shock that is an impact on a user holding the display unit is detected, the output of the display unit is stopped. The controller is
The control device according to claim 1, wherein brightness control of the display unit is executed in accordance with environmental brightness in an environment in which the display unit is used. The controller is
The control device according to claim 1, wherein control is performed to change an output mode of display information on the display unit according to an exercise situation of a user holding the display unit. The controller is
A display control is performed in which a large amount of display information is set when a hold display or a pulse display with a long lighting (ON) time is executed, and a small amount of display information is set when a pulse display with a short lighting (ON) time is executed. The control apparatus according to 1. The controller is
At the time of switching control between hold display and pulse display, if the eyeball speed of the user holding the display unit is less than the threshold value, the hold display is executed, and if it is more than the threshold value, the pulse display is executed,
Claims: When performing switching control between afterimage-considered pulse display and normal pulse display, afterimage-considered pulse display is executed if the eyeball velocity of the user holding the display unit is less than the threshold value, and normal pulse display is executed if the eyeball velocity is greater than or equal to the threshold value. The control apparatus according to 1. The controller is
Based on the user's movement information input from the sensor information, the user's eyeball velocity is calculated, and according to the calculated eyeball velocity, switching control between hold display and pulse display, or switching control between afterimage-considering pulse display and normal pulse display is performed. The control device according to claim 1 to be executed. The control device has an acceleration sensor;
The controller is
The detection information of the acceleration sensor is applied to calculate the user's eyeball velocity, and switching control between hold display and pulse display or switching control between afterimage-considering pulse display and normal pulse display is executed according to the calculated eyeball velocity. The control device according to claim 1. The display unit is a head-mounted display unit worn on the user's head,
The controller is
Calculates the eye movement speed at the time of eye movement that occurs according to the up and down motion of the user's head, and controls switching between hold display and pulse display, or afterimage-considering pulse display and normal according to the calculated eye movement speed The control device according to claim 1, which performs switching control of pulse display. The controller is
2. The control device according to claim 1, wherein when performing the pulse display, the pulse display is performed with one lighting (ON) period of 10 ms or less. A control method executed by a control device for a user-mounted or portable display unit,
The control unit
According to the exercise status of the user holding the display unit,
A hold display for continuously executing display information output to the display unit;
Switching control of pulse display as intermittent display that repeats a lighting (ON) period that is an output period of display information to the display unit and an extinguishing (OFF) period that is a non-output period of display information, or
An afterimage-considering pulse display in which a lighting (ON) period that is an output period of display information for the display unit and an extinguishing (OFF) period that is a non-output period of display information are set and the extinguishing period is set within an afterimage recognition period , Switching control of normal pulse display with the extinction period set longer than the afterimage recognition period,
A control method for executing any switching control. A program that causes a control device to execute control on a user-mounted or portable display unit,
The program is stored in the control device.
According to the exercise status of the user holding the display unit,
A hold display for continuously executing display information output to the display unit;
Switching control for switching between pulse display as intermittent display that repeats a lighting (ON) period that is an output period of display information to the display unit and an extinguishing (OFF) period that is a non-output period of display information, or
An afterimage-considering pulse display in which a lighting (ON) period that is an output period of display information for the display unit and an extinguishing (OFF) period that is a non-output period of display information are set and the extinguishing period is set within an afterimage recognition period , Switching control to switch the normal pulse display with the extinguishing period set longer than the afterimage recognition period,
A program that executes any switching control.

Images