WO2009128563A1

WO2009128563A1 - Computer, method, and program

Info

Publication number: WO2009128563A1
Application number: PCT/JP2009/058034
Authority: WO
Inventors: 山本正男
Original assignee: スカラ株式会社
Priority date: 2008-04-16
Filing date: 2009-04-16
Publication date: 2009-10-22
Also published as: JP5398081B2; JPWO2009128563A1

Abstract

A technique for causing a person to blink voluntarily while watching a display device which displays an image under control of a computer. A computer (10) is connected to the display device (20) and a digital camera (30). The digital camera (30) takes a face image that is a moving image of a user's face and sends face image data relating to the face image to the computer (10). The computer (10) detects blinking of the user from the face image data. When judging that blinking of the user becomes less frequent than a predetermined reference frequency, the computer (10) displays such an object which annoys the user, on the display device (20). The computer (10) continues the display of the object until the user blinks next.

Description

Title of invention

Computer, Method, Program Technical Field

The present invention mainly relates to a computer that controls image display for a display device that displays an image.

Rice field

Technical background

Now that office IT has become more advanced, workers who work at desks have been spending a long time in front of display devices. It is widely known that various harmful effects occur when watching a display device for a long time. For example, one of the reasons is that the number of blinks of workers is drastically reduced by staring at the display device.

It is well known that a reduction in the number of blinks should be avoided because it can cause pain and fatigue in the eyes due to dry eyes, and can also lead to decreased visual acuity.

Various treatments have been proposed to deal with the number of blinks, such as applying eye drops or performing massage around the eyes.

However, no practical technology has been proposed to keep the blinks from decreasing.

If such technology exists, a variety of people can benefit as well as workers who do desk work.

For example, since personal computers are advancing in many schools and homes, people who see personal computer display devices in such places. Or, for example, televisions with game machines or other entertainment machines. Those who enjoy video games using a receiver can enjoy significant benefits if they have technology to prevent eye blinks.

Also, blink reduction is likely to occur for those who use head-mounted displays. Although it is well known that fatigue is likely to occur in those who view a display device that is built into a head mounted display using a head mounted display, Eye reduction is one of the causes of fatigue for people using head-mounted displays, so if people who use head-mounted displays can prompt blinks, those who use head-mounted displays This will reduce fatigue.

An object of the present invention is to propose a technique for causing a person who watches a display device that displays an image to perform blinks spontaneously. Summary of the Invention

In order to solve the problem, the present inventor proposes the following invention.

The present invention can be broadly divided into the following first to fifth inventions.

The first invention is used in combination with an imaging device that captures a face image that is a moving image of a user's face and generates face image data that is data of the face image, and a display device that displays the image. A computer comprising: input means for receiving the face image data from the imaging device; and display control means for controlling an image displayed on the display device.

Then, the computer performs image processing on the face image data received by the input unit, thereby detecting a user's blink, and based on the user's blink detected by the detection unit. When it is determined that the number of blinks of the user is less than a predetermined reference, it is difficult to see the image displayed on the display device in the normal state until then, and the display First control means for generating first control data for causing the display control means to perform processing to be displayed on the device, and the display of the display device up to that time by the first control data. When the detection means detects a blink of the user when it is more difficult to see, an image is displayed on the display device in a normal state. Second control means for generating the second control data for causing the display control means to perform the processing to cause the first control data and the second control data to be generated. The received display control means includes the first control data, An image based on the second control data can be displayed on the display device.

The computer according to the first aspect of the present invention includes display control means for controlling display of an image performed on the display device. The display control means receives the first control data generated by the first control means, the second control means, and the second control data, and controls the display device based on the first control data. The first control means is configured to generate the first control data when it is determined that the number of blinks of the user is less than a predetermined reference, and the display control means that has received the first control data is The image displayed on the display device at normal time is displayed on the display device so that it is harder to see than before. On the other hand, the second control means generates, based on the first control data, second control data when the detection means detects the user's blink when the display on the display device is more difficult to see. In addition, the display control means that has received it restores the image to be displayed on the display device to the normal one.

When a display device controlled by such a computer is used, it is difficult to see an image displayed on the display device when the number of blinks of the user decreases (for example, an image displayed on the display device is The original image, such as a key that prevents the user from acquiring the meaning that could be acquired from the original image, or at least making it difficult to acquire such a meaning, or making the user feel uncomfortable. Therefore, a user who feels sparse is given a motivation to spontaneously blink. As a result, the number of blinks of the user can be kept above a certain number.

If the first control means of the first invention determines that the number of blinks of the user has fallen below a predetermined reference according to the state of the blink detected by the detection means, the determination method The details of are unquestionable.

For example, the first control unit may determine that the number of blinks of the user is less than a predetermined reference when the detection unit does not detect the blink of the user for a certain period of time. It does not matter. This fixed time can be variably set in consideration of, for example, the user's sex and age. Alternatively, the first control means determines that the number of blinks of the user is less than a predetermined reference when the detection means does not detect blinks of a predetermined reference time user. You can do it. In this case, the “reference time” does not necessarily have to be constant. For example, in the initial setting, when the blink does not occur for 30 seconds, the first control means determines that the number of blinks of the user is less than a predetermined reference. If the blink does not occur for 30 seconds frequently, if the blink does not occur for 20 seconds, it is determined that the number of blinks of the user is less than the predetermined reference value. It is also possible to make eyes more active.

Alternatively, the first control means may determine whether the number of blinks of the user is a predetermined reference when the number of blinks of the user detected by the detection means falls below a predetermined number of blinks per unit time. It may be determined to be less. For example, if the number of blinks of the user is less than 20 times per minute and the number of blinks of the user is less than this, it is determined that the number of blinks of the user is less than the predetermined standard. Can be done.

The display control means of the first invention, when receiving the first control data, performs a process of causing the display device to display an image that has been displayed on the display device at a normal time until it is less visible than before. Do. Any process can be used to make the image more difficult to see than usual as long as the purpose is achieved.

For example, when the display control means receives the first control data, a state in which at least a part of the image displayed on the display device is changed so as to lower the brightness than normal. It is also possible to display on the display device. For example, this may be the case when the brightness of the image is reduced as a whole, or when a black frame is provided around the image and the width of the frame is gradually increased.

Alternatively, when the display control means receives the first control data, a state in which at least a part of the image displayed on the display device is changed so as to increase the brightness compared with the normal time. It is also possible to display on the display device. For example, if you increase the overall brightness of an image, This corresponds to the case where the width of the frame is gradually increased.

Alternatively, when the display control unit receives the first control data, the image to be displayed on the display device is changed so that at least a part of the image is distorted in a normal image. You may make it display on the said display apparatus in a state. It is possible to make it difficult to view the image by distorting part or all of the image as if the screen is viewed through the lens, or by shaking the image like a ripple on the water surface.

Alternatively, when the display control unit receives the first control data, at least a part of the image to be displayed on the display device is changed so that the normal image is clouded. You may make it display on the said display apparatus in a state. By making the image blurry overall, it can be difficult to see the image. Specifically, this can be easily realized by performing alpha blending on a gray image before the normal image and blurring the outline of the normal image.

As described above, the image that is difficult to view may be one in which changes as described above are dynamically changed as described above. Further, the display control unit may execute a process of increasing the degree of change between the time when the first control data is received and the time when the second control data is received. In this way, after the first control data is received by the display control means, it becomes more difficult to see the image, so there is a great motivation for the user to blink quickly. Become.

In this case, the display control means may execute a process of gradually increasing the degree of change between the time when the first control data is received and the time when the second control data is received. Alternatively, the display control means may execute a process of gradually increasing the degree of change between the time when the first control data is received and the time when the second control data is received. .

When the first control data is received, the display control means is configured such that an image to be displayed on the display device is overlapped with a predetermined object that hides the normal image on the normal image. May be displayed. object The project can be made less perceived by the user who wants to see the normal image, and by doing so, the motivation for the user to blink can be further enhanced.

When displaying an object, the display control means may display the object as moving on a normal image. When displaying an object, the display control means may display the object on the normal image as if at least one of its position, its size, and its shape changes. Yo! In either case, it is useful to make the user feel that the object is sparse.

The same effect as that obtained by the computer of the first invention can be obtained by the following method, for example.

An example of the method is used in combination with an imaging device that captures a facial image that is a moving image of a user's face and generates facial image data that is the facial image data, and a display device that displays the image. An input unit that receives the face image data from the imaging device, a display control unit that controls an image displayed on the display device, and a control unit that performs information processing are executed by a computer. It is a method. In this method, the control means detects the user's blink by performing image processing on the face image data received by the input means, and detects the user's blink. When it is determined that the number of blinks of the user is less than a predetermined reference based on the blinks of the user detected in the process, the image displayed on the display device at the normal time is displayed. The process of generating the first control data for causing the display control means to perform the process of making the display device display less difficult than the state up to the above state, and the display of the display device is caused by the first control data. When the user's blink is detected as a result of performing image processing on the face image data received by the input means when it is more difficult to see, the display Generating second control data for causing the display control means to perform processing for displaying an image in a normal state on the display, and including the first control data and the second control data. The display control means that has received the above information displays an image based on the first control data and the second control data on the display device. To be able to.

The same effect as that obtained by the computer of the first invention can be obtained by the following program, for example. If the following program is used, a general-purpose computer can obtain the same effects as those of the above computer.

An example of the program is used in combination with an imaging device that captures a facial image that is a moving image of a user's face and generates facial image data that is data of the facial image, and a display device that displays the image. An input unit that receives the face image data from the imaging device, a display control unit that controls an image displayed on the display device, and a control unit that performs information processing, This is a program for causing the control means to execute the following process. In this program, the control means performs image processing on the face image data received by the input means, thereby detecting a user's blink and detecting the user's blink. When it is determined that the number of blinks of the user is less than a predetermined reference based on the detected blinks of the user, the image displayed on the display device at the normal time until then is displayed. The process of generating the first control data for causing the display control means to perform the process of making the display device display more difficult to display, and the display of the display device is further improved by the first control data. When the user's blink is detected as a result of performing image processing on the face image data received by the input means when it is difficult to see, the display Generating the second control data for causing the display control means to perform a process of displaying an image in a normal state on the ray apparatus, and executing the first control data and the second control data. The display control means that has received the data is configured to display an image based on the first control data and the second control data on the display device.

According to a second aspect of the present invention, there is provided a blink detection unit that detects blinks of a user and generates blink data, a unit that outputs the blink data, and a display device that displays an image. And an input means for receiving the blink data from the blink detection device, and an image displayed on the display device. A computer having display control means for controlling.

When the computer determines that the number of blinks of the user is less than a predetermined reference based on the blink of the user indicated by the blink data received by the input means, The first control data is generated to cause the display control means to perform a process of making the display device display the image displayed on the display device, which is sometimes harder to see than the previous state. When the blink data is received via the input means when the display of the display device is more difficult to see than the control device and the first control data, the display device receives The second control is adapted to generate second control data for causing the display control means to perform processing for displaying an image in a normal state. Means for receiving the first control data and the second control data, the display control means receiving an image based on the first control data and the second control data. It can be displayed on the display device. This computer is obtained by removing the detection means from the computer of the first invention. Since the computer according to the second invention is obtained by removing the detection means from the computer according to the first invention, when the computer according to the second invention is used, a detection means corresponding to the detection means according to the first invention is arranged outside the computer. There is a need to. In the second invention, the blink detection device corresponding to the detection means of the first invention is arranged in the blink detection device. When compared with the first invention, the second invention can be understood as merely a movement of the detection means in the first invention to the imaging device in the first invention. When the blink detection device detects a user's blink using facial image data generated by the imaging means provided in or outside the blink detection device, the blink detection means of the second invention is It can be the same as the detection means of the first invention. However, it should be noted that the blink detection means in the second invention does not always determine the user's blink based on the face image data obtained by imaging the user's face.

In addition to image processing, there are the following methods for detecting blinks. For example, there is a method of detecting a blink by detecting a weak current generated by a muscle that has been moved by performing an blink while an electrode is in contact with the user's eye. In addition, it is a position that does not interfere with the user's eyelid in the vicinity of the user's eyes, and When two blinks occur, two electrodes are provided so that the electric force lines are formed between them at a position that crosses the repulsive force lines S from them. There is a method to detect the user's blink by detecting the change in capacitance between the two electrodes that occurs when the eyelid crosses the gland. In addition, an infrared light source that irradiates infrared rays around the user's eyes and an infrared sensor that measures the amount or intensity of infrared reflected light from the surroundings of the user's eyes. There is a method for detecting a user's blink by detecting the change in the amount or intensity of infrared reflected light from the surroundings of the user's eyes. The blink detection means may be used as long as it can detect blinks based on these principles or other principles.

The computer of the second invention requires less processing than the computer of the first invention because of the lack of detection means. This means that the specifications required for the computer of the second invention can be lowered, and if the computer has the same specifications, the burden on other processing other than letting the user perform blinking spontaneously is also imposed. It leads to what can be made smaller.

The first control means, the second control means, and the display control means in the second invention can be the same as those in the first invention.

Effects similar to those of the computer of the second invention can be obtained, for example, by the following method.

The method includes: a blink detection unit that detects blinks of a user and generates blink data; a unit that outputs the blink data; a blink detection device that includes: a display device that displays an image; An input unit that receives the blink data from the blink detection device; a display control unit that controls an image displayed on the display device; and a control unit that performs information processing; This method is executed on a computer equipped with

Then, in this method, when the control unit determines that the number of blinks of the user is less than a predetermined reference based on the blink of the user indicated by the blink data received by the input unit In addition, first control data is generated to cause the display control means to perform processing for making the display device display an image that has been displayed on the display device at a normal time more difficult than in the previous state. Do When the blink data is received via the input means when the display of the display device is more difficult to see than before due to the process and the first control data, an image is normally displayed on the display device. Generating second control data for causing the display control means to perform processing to be displayed in the state of time, and including the first control data and the second control data. The display control means allows the display device to display an image based on the first control data and the second control data.

The same effect as the computer of the second invention can be obtained by a general-purpose computer, for example, by using the following program.

The program includes a blink detection unit that detects blinks of a user and generates blink data, a means for outputting the blink data, a blink detection device including: a display device that displays an image; An input unit that receives the blink data from the blink detection device, a display control unit that controls an image displayed on the display device, and a control unit that performs information processing. When it is determined that the number of blinks of the user is less than a predetermined reference based on the blink of the user indicated by the blink data received by the input means in the control means of the computer equipped with In addition, the process of displaying the image displayed on the display device at the normal time until then on the display device is more difficult to see than the previous state. A process of generating first control data to be performed by the control means, and when the display of the display device is more difficult to see due to the first control data, the blink data is transmitted via the input means. And generating the second control data for causing the display control means to perform a process of displaying the image in a normal state on the display device. The display control means that has received the control data and the second control data allows the display device to display an image based on the first control data and the second control data. The program.

The inventor of the present application proposes the blink detection device of the second invention as an invention to be included in the present application.

This blink detection device is used in combination with the computer of the second invention. A blink detection unit that detects blinks of the user and generates blink data; and a unit that outputs the blink data to the computer.

The blink detection means of the blink detection device includes a detection unit capable of measuring a change in a predetermined physical quantity that occurs when a user performs blinks, and the blink detection means Of these, at least the detection unit may be provided with a fixing means that can be detachably fixed to the glasses.

The third invention is as follows.

A third invention is a computer that is used in combination with a display device that displays an image, and includes a display control means for controlling an image displayed on the display device, and detects a blink of a user. A blink detection means for generating blink data, and when it is determined that the number of blinks of the user is less than a predetermined reference based on the blink of the user indicated by the blink data. Generating the first control data for causing the display control means to perform the process of making the display device display the image that has been displayed on the display device at a normal time more difficult to see than the previous state. First control means, and when the blink data is received for the first time after the first control data is generated, an image is displayed on the display device in a normal state. Second control means for generating second control data for causing the display control means to perform processing to be displayed in step (i), and output for outputting the first control data and the second control data to the computer And a blink detection device comprising: an input means for receiving the first control data and the second control data from the blink detection device; and When receiving the first control data or the second control data, the display control means can display an image based on the first control data or the second control data on the display device. It is a computer connected to.

This computer is obtained by removing the detection means, the first control means, and the second control means from the computer of the first invention. Since the computer according to the third invention is obtained by removing the detection means, the first control means, and the second control means from the computer according to the first invention, when using the computer according to the third invention, the computer is externally provided. The blink detection means corresponding to the detection means of the first invention, the first control means, and the second control means are arranged. There is a need. In the third invention, the blink detection device includes the blink detection means corresponding to the detection means of the first invention, and the first control having the same function as the first control means and the second control means in the first invention. The means and the second control means are also arranged in the blink detection device.

When compared with the first invention, the third invention is nothing but the image pickup apparatus according to the first invention, in which the detection means, the first control means, and the second control means in the first invention are moved. Can be caught. When the blink detection device detects a user's blink using face image data generated by the imaging means provided in or outside the blink detection device, the blink detection means of the third invention is the first It can be the same as the detection means of the invention. However, it should be noted that the blink detection means in the third invention is not always based on the face image data obtained by imaging the user's face, as in the second invention! / It is a point that it does not always judge the user's blink.

As in the case of the second invention, the method for detecting blinks in the third invention can be appropriately selected from various detection methods.

Since the computer of the third invention is obtained by further removing the first control means and the second control means from the computer of the second invention, it must be executed inside the computer of the first invention. Not only will there be less processing, it will be even less than in the second invention. This means that the specs required for the computer of the third invention can be made lower than in the case of the second invention. In addition, if the computer has the same specifications, the user is allowed to perform blinking spontaneously. This means that the burden on other processes other than the above can be made even smaller than in the case of the computer of the second invention. The first control means, the second control means, and the display control means in the third invention can be the same as those in the first invention.

The same effect as the computer of the third invention can be obtained by the following method. '

The method is used in combination with a display device that displays an image, and is a computer including a display control unit that controls an image displayed on the display device, and a control unit that executes information processing. A blink detection unit that detects blinks of the user and generates blink data; and blinks of the user indicated by the blink data If it is determined that the number of blinks of the user is less than a predetermined reference based on the image, the image displayed on the display device at the normal time is more difficult to see than before. First control means for generating first control data for causing the display control means to perform processing to be displayed on the display device; and the blink data after the first control data is generated. Second control means configured to generate second control data for causing the display control means to perform processing for displaying an image in a normal state on the display device when first received; And a blink detection device having an output means for outputting the first control data and the second control data to the computer, and the first control data and the first control data. One that is the one having the means for receiving control data from the blink detector, and means for accepting said second control data from the blink detector, a method performed.

In this method, the control means receives the first control data from the blink detection device via the means for receiving the first control data from the blink detection device, from the blink detection device. A process of receiving the second control data via the means for receiving the second control data from the blink detection device, and receiving the first control data or the second control data, A step of causing the display control means to display an image based on the first control data or the second control data on the display device.

The same effect as the computer of the third invention can be obtained by a general-purpose computer by the following program.

The program is used in combination with a display device that displays an image, and is a computer that includes display control means for controlling an image displayed on the display device, and control means for executing information processing. Yes, a blink detection unit that detects blinks of the user and generates blink data, and the number of blinks of the user is less than a predetermined reference based on the blinks of the user indicated by the blink data. If it is determined that the display device is connected, the display control unit is caused to display the image displayed on the display device at a normal time until it is harder to see than the previous state. For generating first control data for the first A control means for causing the display control means to perform processing for displaying an image in a normal state on the display device when the blink data is first received after the first control data is generated. A blink control device comprising: second control means adapted to generate second control data; and output means for outputting the first control data and the second control data to the computer. The first control data is received from the blink detection device, and the second control data is received from the blink detection device. A process of receiving the first control data from the blink detection device via the means for receiving the first control data from the blink detection device; A process of receiving the second control data through the means for receiving the second control data from the blink detection device, the first control data, or the second control data, A program for causing the display control means to execute a process of displaying an image based on the first control data or the second control data on the display device.

The inventor of the present application proposes the blink detection device of the third invention as an invention to be included in the present application.

The blink detection device is used together with the computer of the third invention. Then, the blink detection device detects a user's blink and generates blink data, and the number of blinks of the user based on the user's blink indicated by the blink data. When the display is less than a predetermined standard, the display process is performed so that the image displayed on the display device at the normal time until then is displayed on the display device so that it is harder to see than the previous state. First control means for generating first control data to be executed by the control means, and when the blink data is received for the first time after the first control data is generated, Second control means for generating second control data for causing the display control means to perform processing for displaying an image on the display device in a normal state; and the first control data and the previous Second system Output means for outputting control data to the computer.

The fourth invention is as follows. In summary, it can be said that the fourth invention is an application of the first to third inventions to a head mount display. A head mounted display according to a fourth aspect of the present invention is a display device that displays an image, display control means that controls an image displayed on the display device, and a blink that detects blinks of a user and generates blink data. When it is determined that the number of blinks of the user is less than a predetermined reference based on the blink of the user indicated by the eye detection means and the blink data, the display is displayed on the display device at a normal time until then. First control means configured to generate first control data for causing the display control means to perform processing for making the display device display the image that has been difficult to see than the previous state, and When the blink data is received for the first time after the first control data is generated, the display process for displaying an image in a normal state is displayed on the display device. And a, a second control means adapted to generate a second control data for causing the control means. Then, the display control means receives the first control data from the first control means when the first control means generates the first control data, and the second control means uses the second control data. When the first control data or the second control data is received, the first control data is received from the second control means. An image based on the control data or the second control data is displayed on the display device, and the display device and the blink detection means are attached to the head mounted display. A head mounting means to be mounted on the user's head.

The blink detection means of the fourth invention can be the same as the blink detection means of the second and third inventions. The blink detection means in the fourth invention can detect blinks by a method appropriately selected from various detection methods, as in the second and third inventions.

It is sufficient that the head mounting means includes a display device and a blink detection means. The display control means, the first control means, and the second control means may be attached to the head mount means, but may be provided outside the head mount means. For example, a head-mounted display is used to instruct display of images on a head-mount means and a display device included in the head-mount means, and a control unit connected to the head-mount means by wire or wirelessly. It can be composed of two major elements: In such a case, the display control means, the first control means, and the second control means can be attached to the control unit.

The same effect as this head mounted display can be obtained, for example, by the following method.

The method includes: a display device that displays an image; a display control unit that controls an image displayed on the display device; a blink detection unit that detects blinks of a user and generates blink data; The control means for performing the above-mentioned, the display device, and the blink detection means are mounted. The head mounting means mounted on the user's head is mounted on the head mounted display. Is the method. In this method, the process of determining whether the number of blinks of the user is less than a predetermined reference based on the blink of the user indicated by the blink data, the number of blinks of the user is less than the predetermined reference In order to cause the display control unit to perform a process of making the display device display an image that has been displayed on the display device at a normal time until it is harder to see than the previous state. The first control data is generated, and when the blink data is received for the first time after the first control data is generated, the display control displays the image in a normal state. A process of generating second control data to be performed by the means, when the first control data is generated, and when the second control data is generated Includes a step of outputting the display control means to the display control means, whereby the display control means that has received the first control data or the second control data has the first control data or the An image based on the second control data is displayed on the display device.

The above-described head mounted display includes a head mounting means, and is configured to be attached to the user's head. On the other hand, the head mounted display may be attached to the glasses worn by the user.

Such a head-mounted display includes a display device that displays an image, display control means that controls an image displayed on the display device, and a user A blink detection unit that detects blinks and generates blink data, and determines that the number of blinks of the user is less than a predetermined reference based on the blinks of the user indicated by the blink data In this case, the first control data for causing the display control means to perform a process of making the display device display the image that has been displayed on the display device at a normal time more difficult to see than before. A first control means configured to generate, and a process of displaying an image in a normal state on the display device when the blink data is first received after the generation of the first control data. And second control means for generating second control data for causing the display control means to perform. Then, the display control means receives the first control data from the first control means when the first control means generates the first control data, and the second control means uses the second control data. When the first control data or the second control data is received, the first control data is received from the second control means. An image based on the control data or the second control data is displayed on the display device, and the display device and the blink detection means are attached to the head mounted display. And a fixing means to be attached to the glasses worn by the user.

The method includes: a display device that displays an image; a display control unit that controls an image displayed on the display device; a blink detection unit that detects blinks of a user and generates blink data; The control means for performing the display, the display device, and the blink detection means are attached, and fixing means to be attached to the glasses worn by the user. This is a method executed by the control means. In this method, the process of determining whether the number of blinks of the user is less than a predetermined reference based on the blink of the user indicated by the blink data, the number of blinks of the user is less than the predetermined reference. If it is determined that the image is displayed, the display control process is performed so that the image displayed on the display device at a normal time is displayed on the display device so that it is more difficult to view the image than before. A process of generating first control data to be performed in a stage, and when the blink data is first received after the generation of the first control data, the display device displays an image in a normal state. A process of generating second control data for causing the display control means to perform processing, when the first control data is generated, when the second control data is generated, A process of outputting to the display control means, whereby the display control means that has received the first control data or the second control data is the first control data or the second control. An image based on the data is displayed on the display device.

The fifth invention is a display device. In summary, in the fifth invention, the display device in the first invention is a combination of the computer in the first invention and the imaging device in the first invention. The data necessary for detection is not necessarily obtained via the imaging device. According to a fifth aspect of the present invention, there is provided a display device that detects a blink of a user and generates blink data, a display that displays an image, a display control unit that controls an image displayed on the display, and information A display device comprising: control means for performing processing;

The control means of the display device includes: an input means for receiving the blink data from the detection means; and a user's blink based on the user's blink indicated by the blink data received by the input means. When it is determined that the number of times is less than the predetermined standard, the process for displaying the image that has been displayed on the display in the normal state until then on the display is made more difficult to see than before. First control means for generating first control data to be executed by the control means, and the blink data when the display on the display is more difficult to see by the first control data. When the image is received via the input means, the display control means performs processing for displaying an image on the display in a normal state. A second control unit adapted to generate second control data for receiving the first control data and the second control data, wherein the display control means receives the first control data, The first control data and an image based on the second control data can be displayed on the display. The detection means of the fifth invention can be the same as the detection means or the blink detection means in the first to third inventions. The detection means in the fifth invention can detect blinks by a method appropriately selected from various detection methods as in the first to third inventions.

The same effect as this display device can be obtained, for example, by the following method.

The method includes detecting means for detecting a blink of a user and generating blink data, a display for displaying an image, a display control means for controlling an image displayed on the display, and information processing. And a control means having an input means for receiving the blink data from the detection means, and a method executed on a display comprising:

In this method, when the control means determines that the number of blinks of the user is less than a predetermined reference based on the blink of the user indicated by the blink data received by the input means In addition, first control data is generated for causing the display control means to perform a process of displaying the image that has been displayed on the display at a normal time until then on the display so that the image is less visible than before. When the blink data is received via the input means when the display on the display is more difficult to see due to the process and the first control data, an image is displayed on the display in a normal state. Generating the second control data for causing the display control means to perform the process of displaying in step (a), and thereby the first control data. The display control means that has received the second control data can display an image based on the first control data and the second control data on the display. Brief Description of Drawings

FIG. 1 is a perspective view showing the overall configuration of the computer and its surroundings according to the first embodiment of the present invention.

FIG. 2 is a hardware configuration diagram of the computer shown in FIG.

Figure 3 is a plot showing the function blocks generated in the computer shown in Figure 1. FIG.

FIG. 4 is a flowchart showing the flow of processing executed by the computer shown in FIG.

FIG. 5 is a block diagram showing functional blocks generated inside the computer and digital camera of the second embodiment.

FIG. 6 is a perspective view schematically showing the configuration of the blink detector used in the fourth modification. FIG. 7 is a diagram schematically showing a configuration of an example of a detection sensor in the blink detector shown in FIG.

FIG. 8 is a block diagram showing functional blocks generated inside the computer and the digital power camera according to the third embodiment.

FIG. 9 is a diagram showing a state in which the head mount display device of the fourth embodiment is attached to the glasses.

FIG. 10 is an explanatory view of a method of attaching the head mounted display device shown in FIG. 9 to the glasses.

Figure 11 shows the top view of the case of the head-mounted display device shown in Figure 9.

FIG. 12 is a partial cross-sectional view showing the internal configuration of the case of the head mounted display device shown in FIG.

FIG. 13 is an operation explanatory diagram of the moving mechanism of the head-mounted display device shown in FIG.

FIG. 14 is a detailed configuration diagram of the adjustment mechanism of the head mounted display device shown in FIG.

FIG. 15 is an operation explanatory diagram of the adjustment mechanism of the head mounted display device shown in FIG.

FIG. 16 is an explanatory diagram of the light guide in the free-form surface prism of the head mount display device shown in FIG.

FIG. 17 is a rear view of the head mounted display device shown in FIG.

Fig. 1 8a shows the head mounted display device shown in Fig. 9 attached. It is the figure which looked at the glasses from the front. -Fig. 18 b is a view of the glasses with the head-mounted display device shown in Fig. 9 attached, as seen from the front.

FIG. 19 is a front view showing an example of an external appearance of the computer and the digital camera according to the first embodiment incorporated in a display device.

FIG. 20 is a perspective view showing a state in which a blink detection option, which is a further modification of the blink detector according to Modification 4, is attached to a main body that is glasses. BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, preferred first to fourth embodiments of the present invention will be described in detail with reference to the drawings.

In the description of each embodiment, the same reference numerals are given to the overlapping objects, and the overlapping description will be omitted in some cases. First embodiment

1 in FIG. 1 is the computer in the first embodiment. This computer 10 is connected to a display device 20, a digital camera 30, and an input device 40. The computer 10 of this embodiment is a general-purpose personal computer. However, the computer 10 does not have to be a general-purpose personal computer, for example, a mobile phone with a built-in digital power camera. The display device 20 displays a predetermined image on the screen. The image displayed on the screen of the display device 20 is controlled by the computer 10 as will be described later. In this embodiment, the display device 20 is a liquid crystal display device. However, the display device 20 can be composed of a suitable material such as CRT, organic EL, and plasma. The display device 20 according to this embodiment is a display device used in combination with the computer 10. The display device 20 described below is not limited to this. For example, as will be described later, for example, a television. It may be a receiver.

In addition, like a notebook personal computer, the display device 20 is In some embodiments, the computer 10 may be integrated with the computer 10, but in this embodiment, an example in which the computer 10 and the display device 20 are separated will be described. The digital camera 30 captures a face image, which is a moving image of the face of the user using the computer 10, and generates face image data, which is face image data. The digital camera 30 generates face image data by capturing the face of the user with an image sensor such as a CCD or MOS (not shown).

The output from the digital camera 30 is input to the computer 10 via the cable 31. In this embodiment, the digital camera 30 and the computer 10 are connected by a wired USB connection. However, the connection between the digital camera 30 and the computer 10 is not limited to this. For example, the digital camera 30 and the computer 10 can be connected by other types of wired connection or wireless connection using radio waves or infrared rays. It does not matter.

The digital camera 30 is placed at an appropriate position so that a face image can be taken. In this embodiment, although not limited to this, the digital camera 30 is placed on the display device 20.

The digital camera 30 may be a general-purpose one as long as it can capture a face image, which is a moving image of the user's face, and generate face image data, which is face image data. Recently, webcams used for transmitting facial images over the Internet have been widely used. Prior to sending a face image via the Internet, such a web camera first executes a face image capture to a computer. Such a web camera is suitable for use as the digital camera 30.

In recent personal computers, particularly notebook personal computers, there are those in which a digital camera is embedded in a part of a display device, for example, a part of a frame surrounding a screen. In such a case, the digital camera 30 is integrated with the display device 20 or the computer 10. The same is true for mobile phones, and mobile phones are also equipped with display devices and digital cameras. However, in this embodiment, an example in which the computer 10 and the display device 20 are separated from the digital camera 30 will be described. The input device 40 is a device for a user to input to the computer 10. Although not limited to this, the input device 40 in this embodiment includes, for example, a general-purpose keyboard and a mouse.

Next, the configuration of the computer 10 will be described.

The computer 10 has hardware as shown in FIG. In this embodiment, the computer 10 includes a CPU (Central Processing Unit) 111, a ROM (Read Only Memory) 112, a RAM (Random Access Memory) 113, an HDD (Hard Disc Drive) 114, an interface 115, and the like. A bus 116 to be connected is provided.

The CPU 111 controls the entire computer 10. The CPU 111 executes various processes as described below by executing the program.

The ROM 112 stores a program for operating the CPU 111, data necessary for controlling the computer 10, and the like.

The RAMI 13 provides a work area for the CPU 111 to perform data processing.

The HDD 114 also records programs and data for operating the CPU 111. For example, an OS for operating the CPU 111 is recorded on the HDD 114. The program of the present invention is recorded in the ROM 112 or the HDD 114. Note that the program of the present invention may be installed in the computer 10 from the time of shipment of the computer 10, or may be installed in the computer 10 by the user after the computer 10 is shipped, for example. When installed after the shipment of the computer 10, the program of the present invention may be recorded on the computer 10 from a recording medium such as a CD-ROM, or may be recorded on the computer 10 via a download from a predetermined network such as the Internet. Even if it was done. The program of the present invention may be configured to cause the CPU 111 to execute processing described later alone, and to cause the CPU 111 to execute processing described below in cooperation with the OS and other programs. It does not matter.

Interface 115 is CPU111, ROM112, RAMI13, HD D l 14 is a window to connect the outside and CPU1 1 1, ROM1 1 2, RAMI 1 3, HDD 1 14 can exchange data with the outside via interface 1 1 5 ing. For example, the interface 1 15 is connected to the USB terminal, and is connected to the digital camera 30 connected to the cable 31 via the USB terminal. The interface 1 1 5 receives face image data from the digital camera 30. The interface 1 1 5 is also connected to the input device 40 and receives data generated when the user operates the input device 40. The interface 1 15 is also connected to the display device 20 and outputs image data for displaying an image on the display device 20.

When the CPU 1 1 1 executes the program of the present invention, a function block force as shown in FIG. 3 is generated in the computer 10.

An input unit 121, an information processing unit 122, and an output unit 123 are generated inside the computer.

The input unit 121 accepts input from the outside. In this embodiment, the input unit 121 receives face image data from the digital camera 30 and receives data to be described later from the input device 40. The input unit 121 is configured to send the face image data received from the digital camera 30 and the data received from the input device 40 to the information processing unit 122.

The information processing unit 122 executes information processing based on the face image data received from the digital power camera 30 and the data received from the input device 40. This information processing prompts the user to blink by the method described later.

The information processing unit 122 includes a main control unit 122A, a blink detection unit 122B, a blink determination unit 122C, an image processing unit 122D, and an image processing data recording unit 122E. The main control unit 122 A has nothing to do with prompting the user to blink! /, Information processing, for example, information processing related to word processor software based on data received from the input device 40, information related to spreadsheet software Processes, information processing related to game software, information processing related to Internet browsers, information processing related to electronic mail software, etc. are executed. The main control unit 122 A As a result, the normal image data for the normal image displayed on the display device 20 is generated and sent to the image processing unit 1 2 2 D. The main control unit 1 2 2 A also determines specific data for specifying the type of image processing performed by the image processing unit 1 2 2 D as described later, based on the contents of the input received from the input device 40. Generated and sent to the image processor 1 2 2 D.

The blink detection unit 1 2 2 B is based on the face image data received from the digital camera 30 via the input unit 1 2 1, and is not necessarily limited to this, but in this embodiment, it is substantially real time. Detecting user blinks.

The blink detection unit 1 2 2 B detects the blink of the user by performing image processing on the moving face image. The content of the image processing is not particularly limited, but the blink detection unit 1 2 2 B of this embodiment binarizes the wrinkle image specified by the face image data based on a predetermined threshold value for the brightness. Blinks are detected by detecting black eyes in the eyeballs shown in the image. The threshold value can be appropriately determined based on the color of the eyeball's black eyes, the user's skin color, and the like. For example, the threshold value can be changed by input from the input device 40.

In this case, the blink detection unit 1 2 2 B can detect the black eye from the face image if the user is not blinking when the black eye can be detected from the dark image. If not, the user's blink is detected by determining that the user is blinking. Judgment of whether or not the black eye can be detected from the face image is made, for example, by determining whether the number of pixels corresponding to the black eye in the face image is larger or smaller than a predetermined value. Can do. In this case, when the number of pixels corresponding to the black eye is larger than the predetermined value, if the black eye is detected from the face image, the number of pixels corresponding to the black eye is larger than the predetermined value. When it is small, it can be determined that the black eye cannot be detected from the face image.

The blink detection unit 1 2 2 B generates blink data indicating that a blink has been detected each time a user's blink is detected, and sends it to the blink determination unit 1 2 2 C. ing. The blink determination unit 1 2 2 C is configured to determine whether or not the number of blinks of the user is less than a predetermined reference. The blink determination unit 1 2 2 C receives blink data from the blink detection unit 1 2 2 B and performs the above-described determination based on the blink data. It has become. Although not necessarily limited to this, in this embodiment, the blink determination unit 1 2 2 C determines that the blink data received from the blink detection unit 1 2 2 B is determined in advance from the previous user's blink to the present time. The number of blinks of the user is set to the predetermined standard when the fixed time has passed (that is, when a predetermined fixed time has passed since the last blink data was received). Judge that it is less. The fixed time in this case can be determined appropriately based on the user's sex, age, physical condition, etc., but can be set to an appropriate time between 3 and 6 seconds, for example. The blink determination unit 1 2 2 C generates the first data when it is determined that the number of blinks of the user is less than a predetermined reference.

The blink determination unit 1 2 2 C also detects that the blink detection unit 1 2 2 B detects the user's blink for the first time after the above first data is generated (the above first data is generated). After the first blink data is received from the blink detection section 1 2 2 B for the first time), the second data is generated.

When the blink determination unit 1 2 2 C generates the first data or the second data, it sends it to the image processing unit 1 2 2 D.

The image processing unit 1 2 2 D has a function of performing image processing on the normal image data received from the main control unit 1 2 2 A as necessary. The image data processed by the image processing unit 1 2 2 D as necessary is sent to the output unit 1 2 3. 'Image processing unit 1 2 2 D is normal (if the first data is not received, or if the first data is received and then the second data is received and the first data is not received )), The normal image data received from the main control unit 1 2 2 A is sent to the output unit 1 2 3 as it is.

The image processing unit 1 2 2 D receives from the main control unit 1 2 2 A when there is an abnormality (when the second data has not been received after receiving the first data). Normal image data is sent to the output unit 1 2 3 after image processing as will be described later.

The image processing unit 1 2 2 D only needs to be able to perform one type of image processing on normal image data, but this is not necessarily the case in this embodiment. You can select one of multiple types of image processing and perform image processing on normal image data. In the image processing data recording unit 1 2 2 E, a plurality of types of image processing methods are recorded. The image processing unit 1 2 2 D that has received the specific data described above reads the data of the image processing method specified by the specific data from the image processing data recording unit 1 2 2 E, and specifies the data according to the read data. Image processing is performed on the normal image data in a manner specified by the data.

The image processing method that is performed by the image processing unit 1 2 2 D is not necessarily limited to this, but is the following five (A) to (E). Therefore, the above-described specific data in this embodiment specifies any of the following (A) to (E).

Each of the image processing methods (A) to (E) will be described. [For (A)]

In this case, the image processing unit 1 2 2 D is assumed to change the image power displayed on the display device 20 so that at least a part of the brightness is lower than the part of the normal image. As usual, image processing is performed on normal image data.

For example, the image processing unit 1 2 2 D designates a predetermined range such as a range of a predetermined width from the four sides of the rectangular normal image, and reduces the brightness of the color assigned to the normal image in that range. The above-described image processing can be realized by performing the above processing.

When the image processing unit 1 2 2 D performs the image processing of (A), the image processing unit 1 2 2 D accepts the second data next to determine the degree of change that is normally given to the image by the image processing. In the meantime, it can be changed dynamically, for example, increasing gradually or stepwise. This is actually the case in this embodiment. The “degree of change” in this case includes both the case where the range of the image to be changed is enlarged and the case where the ratio of the decrease in brightness given to a certain part of the normal image is increased.

When the image processing of (A) is performed, when the image processing unit 1 2 2 D performs this processing on the normal time image to the limit, the display device 20 blackouts. [For (B)]

In this case, the image processing unit 1 2 2 D has the image displayed on the display device 20 changed so that the brightness of at least a part of the image is higher than the part of the normal image. As usual, image processing is performed on the normal image data.

For example, the image processing unit 1 2 2 D designates a predetermined range such as a range of a predetermined width from the four sides of the rectangular normal image, and increases the brightness of the color assigned to the normal image in that range. The above-described image processing can be realized by performing the processing.

When the image processing unit 1 2 2 D performs the image processing of (B), the degree of change given to the normal image by the image processing is the next time the image processing unit 1 2 2 D accepts the second data Can be changed dynamically, for example, increasing incrementally or stepwise. This is actually the case in this embodiment. The “degree of change” in this case includes both the case of increasing the range of the image that gives the change and the case of increasing the rate of increase in brightness given to a certain part of the normal image.

When the image processing of (B) is performed, if the image processing unit 1 2 2 D performs to the normal time image up to this processing limit, the display device 20 is whitened out.

[For (C)]

In this case, the image processing unit 1 2 2 D allows the image displayed on the display device 20 to be changed so that at least a part of the image is distorted. Image processing is performed on normal image data.

For example, the image processing unit 1 2 2 D designates a predetermined range such as a circular range with a predetermined diameter at the center of the normal image, and the normal image of that portion is passed through the lens with respect to the normal image in the range. By performing processing that gives distortion as seen, the above-described image processing can be realized. Alternatively, the image processing unit 1 2 2 D designates a predetermined range such as the entire range of the normal image, and performs image processing on the normal image so that ripples spread from a predetermined position of the normal image. Thus, the above-described image processing can be realized.

When the image processing unit 1 2 2 D performs the image processing of (C), the degree of change given to the normal image by the image processing is the next time the image processing unit 1 2 2 D accepts the second data. Until then, it can be changed dynamically, for example, it can be increased incrementally or stepwise. This is actually the case in this embodiment. The “degree of change” in this case includes both the case where the range of the image to be changed is increased and the case where the degree of distortion applied to a certain range of the normal image is increased. For example, the degree of the virtual lens for seeing the normal image through it is increased with time, or the amplitude of the above ripples transmitted over the normal image with time is increased. Increasing the size or decreasing the wavelength is an example of increasing the degree of distortion of the normal image. [For (D)]

In this case, the image processing unit 1 2 2 D is configured so that at least a part of the image power displayed on the display device 20 is changed so that the part of the normal image is clouded. Image processing is performed on normal image data.

For example, the image processing unit 1 2 2 D designates a predetermined range such as a circular range with a predetermined diameter in the center of the normal image, and performs processing such that the normal image in the range is clouded. Thus, the above-described image processing can be realized. This is an image processing technology that puts an image of an appropriate color in front of the above-mentioned predetermined range of the normal image, and sees the normal image through the image, and displays the image that is V This can be easily realized by generating the product. In this case, processing that weakens the outline of the object included in the normal image may be performed.

When the image processing unit 1 2 2 D performs the image processing of (D), the degree of change given to the normal image by the image processing is the extent to which the image processing unit 1 2 2 D accepts the second data next time. It can be changed dynamically, for example, increasing incrementally or in steps. This is actually the case in this embodiment. The “degree of change” in this case includes both the case where the range of the image to be changed is enlarged and the case where the cloudiness density given to a certain part of the normal image is increased.

[For (E)] In this case, the image processing unit 1 2 2 D displays the image displayed on the display device 20 as an overlay of a predetermined object that hides the normal image on the normal image. As described above, the image processing is performed on the normal image data.

For example, in this case, the object may be an inorganic object such as a circle or a rectangle, a picture imitating a car, a fish, an airplane, or a character such as a cartoon “animation”. The object may be opaque or translucent. The object may be displayed so as to move on the normal image, or at least one of its position, its size, and its shape may change. As described above, the normal-time image data that has been subjected to image processing as needed is sent to the output unit 1 2 3.

The output unit 1 2 3 sends image data displayed on the display device 20 to the display device 20. The output unit 1 2 3 sends the normal-time image data subjected to the image processing as needed received from the image processing unit 1 2 2 D force to the display device 20. The display device 20 that has received this is configured to display an image based on normal-time image data subjected to image processing as necessary.

Next, the flow of processing executed by the computer 10 will be described. In this embodiment, although not necessarily limited to this, when the computer is turned on and the computer 10 is started, the program of the present invention is executed and the start process following the following process is automatically started (S 0 0 1).

Next (although the program start processing (S 0 0 1) does not matter before or after), the normal-time image is displayed on the display device 20 (S 0 0 2). For example, based on data input from the input device 40 via the input unit 1 2 1, the main control unit 1 2 2 A of the information processing unit 1 2 2 generates normal image data. This normal-time image data is sent to the display device 20 through the image processing unit 1 2 2 D and the output unit 1 2 3. As a result, a normal-time image is displayed on the display device 20. In this state, the user specifies the type of image processing at the time of abnormality from the above-described (A) to (E) (S 0 0 3). Specifically, the user operates the input device 40 to Select one of (A) to (E). When the user reaches the main control unit 122A of the information processing unit 122 via the data force input unit 121 generated by the user operating the input device 40, the main control unit 122A generates the above specific data, It is sent to the image processor 122D. The image processing unit 122D that receives the dust stores data, programs, and the like necessary for performing the image processing of any one of (A) to (E) specified by the specific data. Read from E.

Thereafter, the computer 10 receives the face image data from the digital camera 30 and detects the blink of the user from the face image data (SO 04). The blink detection is performed by the eye blink detection unit 122 B of the information processing unit 122 that has received the face image data from the digital camera 30 via the input unit 121 performing image processing on the face image data as described above. Do.

Each time the blink detection unit 122B detects the user's blink, the blink detection unit 122B generates blink data and sends it to the blink determination unit 122C.

The blink determination unit 122C monitors whether or not a predetermined fixed time has elapsed since the receipt of the previous blink data, and the number of user blinks is less than a predetermined reference. Determine continuously (S005).

If the fixed time has not elapsed (S 005: No), the blink determination unit 122 C detects whether or not the force has passed a predetermined fixed time since the previous blink data was received. Continue the process of S005.

When the fixed time has elapsed (S 005: Yes), the blink determination unit 122 C generates the first data described above (SO 06). The first data is sent from the blink determination unit 122C to the image processing unit 122D.

Receiving the first data, the image processing unit 122D performs the type of image processing specified in S003 on the normal-time image data (S007). The normal image data subjected to the image processing is sent from the image processing unit 122 D force to the display device 20 via the output unit 123.

The display device 20 displays a normal-time image after the image processing of any of (A) to (E) described above is performed.

Even in this state, the blink detection unit 122B continues to detect the user's blink. Also, The blink determination unit 1 2 2 C monitors whether or not a new user's blink has occurred, based on whether or not the blink data is received from the blink detection unit 1 2 2 B ( S 0 0 8). Since it is difficult for the user to view the normal-time image that has been subjected to the image processing, the user will actively blink to end the image processing for the normal-time image. If the user recognizes that blinking is necessary to end the image processing for the normal image and make the image displayed on the display device 20 easier to see, the user can blink. It is easy to motivate.

When there is no new blink of the user (S 0 08: No), the image processing unit 1 2 2 D normally continues image processing on the image data. In this case, since the image displayed on the display device 20 is still difficult to see, the state in which it is easy to induce the user's blink is continued. In addition, in this embodiment, in particular, when the image processing of (A) to (D) is being executed, the degree of image processing increases with time, so that the blink given to the user is performed. The motivation for this will continue to grow.

When there is a new blink of the user (S 0 0 8: Y e s), that is, the blink determination unit 1

2 2 C receives blinking data from blink detection part 1 2 2 B.

C generates the second data (S 0 0 9). The second data is sent from the blink determination unit 1 2 2 C force to the image processing unit 1 2 2 D.

The image processing unit 1 2 2 D that has received the second data ends the image processing for the normal-time image data that has been continuously received from the main control unit 1 2 2 A (S 0 1 0). As a result, the image displayed on the display device 20 is returned to the normal image that is easy to view (or in a normal state) that has not been subjected to image processing.

S O after the second data is generated or at the same time as the second data is generated

0 The time elapsed since the reception of the blink data monitored in the process of 5 is reset, and the time when the second data was generated is set as a new starting point for monitoring whether the fixed time has passed (S 0 1 1).

An operation for terminating the program of the present invention, for example, whether the operation of stopping the execution of the program of the present invention or turning off the computer 10 is performed by the input device 40 is always performed. (S 0 1 2) PC 觀 00 ₀₃₄

3 3

When not performed (S 0 12: No), after the above-described processing of S 0 11 is performed, the processing of S 0 04 and subsequent steps is repeated again.

When an operation for terminating the program of the present invention is performed (S 0 1 2: Y e s), all the processes are completed.

The computer 10 in the first modification is basically the same as that in the above-described embodiment.

The only difference between the computer 10 in the modified example 1 and the computer 10 in the above-described embodiment is that the blink determination unit 1 2 2 C does not have the power that the number of blinks of the user is less than a predetermined reference. This is the determination method used when such a determination is made.

The blink determination unit 1 2 2 C in the computer 10 in the modified example 1 is similar to the blink determination unit 1 2 2 C in the computer 10 in the embodiment described above. The blink data is received, and the above-mentioned determination is performed based on the blink data.

However, unlike the case of the above-described embodiment, the blink determination unit 1 2 2 C in the first modification example is configured so that the user receives a predetermined fixed time from the reception of the previous blink data until the present time. Rather than determining that the number of blinks is less than the predetermined standard, this determination is performed based on the following standard. That is, in the first modification, when the next blink data is not received within 20 seconds after the blink data is received, it is determined that the number of blinks of the user is less than a predetermined reference. For example, if the first data has been generated three or more times in the past 3 minutes, if the next blink data is not received within 15 seconds after receiving the blink data. It is determined that the number of blinks of the user is less than the predetermined standard. For example, if the first data has been generated 6 times or more in the past 3 minutes, 10 seconds after the blink data is received. If the next blink data is not received within, the user's blink frequency is determined to be less than the predetermined standard. Receive blink data when The reference time from when it is attached until the next blink data is received is changed. By the way, The change in the reference time as described above is that, as the number of blinks of the user per the latest unit time is smaller, the first data is generated even if the blink interval is shorter. As the number of user blinks per unit time decreases, the image displayed on the display device 20 becomes more difficult to see. This means that if the number of blinks of the user per unit time is small, the user can be motivated to perform blinks more strongly.

As in the case of the first modification, the computer 10 in the second modification also uses the blink determination unit 1 2 2 for determining whether or not the user's blink number is less than a predetermined reference. Only the case of the above-described embodiment is different.

The blink determination unit 1 2 2 C in the computer 10 in Modification 2 is the same as the blink determination unit 1 2 2 C in the computer 10 in the embodiment described above. The blink data is received, and the above determination is made based on the blink data.

Here, the blink determination unit 1 2 2 C in the modified example 2 is not based on the time interval from the user's blink to the blink, but based on the number of blinks per unit time in the latest past. I do. In the second variation, the blink determination unit 1 2 2 C records the data for the most recent unit time regarding the timing at which blink data was received from the blink detection unit 1 2 2 B. . The blink determination unit 1 2 2 C always monitors whether the number of blinks per unit time in the past past has fallen below the number of blinks that is a predetermined reference. The blink determination unit 1 2 2 C determines that if the number of blinks per unit time in the last past is less than the number of blinks that is a predetermined reference, the number of blinks of the user is less than the predetermined reference. It is determined that For example, the blink determination unit 1 2 2 C determines that the number of blinks of the user is less than a predetermined reference when the number of blinks per minute in the past past is less than 20 times. It is supposed to be.

Note that the blink determination unit 1 2 2 C does not always need to monitor whether the number of blinks per unit time in the past past has fallen below the number of blinks that is a predetermined reference. Blink half (J fixed part 1 2 2 C is the number of blinks per unit time for each unit time. It is possible to determine whether or not the number of blinks has fallen below a predetermined reference. For example, the blink half IJ fixed part 1 2 2 C should judge every minute that the number of blinks of the user that occurred in the minute immediately before that was less than 20 times. When it is determined so, it can be determined that the number of blinks of the user is less than the number of blinks that is a predetermined reference.

The computer 10 in the above-described embodiment is a general-purpose computer, and the display device 20 in the above-described embodiment is a display device for a general-purpose computer. The display device 20 can be a television receiver.

The input device 40 in this case can be configured by a known controller provided in the entertainment machine, unlike the case of the above-described embodiment. This will be apparent to those skilled in the art.

When the computer 10 is an entertainment machine, the program in the present invention may be installed in the computer 10 that is the entertainment machine and executed on the computer 10, or the computer 1 It may be recorded in a DVD-ROM or other recording medium for executing a game or other entertainment processing with 0 and executed from the recording medium.

A big problem is that children's visual acuity is especially reduced by games executed using an entertainment machine. According to the present invention, this can be effectively prevented. When the program is executed from a recording medium, it is very useful because an existing entertainment machine that has already been circulated can function as the computer of the present invention.

Further, when the display device 20 is a television receiver, the computer 10 may be incorporated in the display device 20. That the visual acuity of viewers watching TV broadcasts with television receivers, especially children ’s viewers, There is a possibility that it can be effectively prevented by a television receiver with a built-in computer 1.

Note that both the computer 10 and the digital camera 30 may be integrated with the display device 20 as described above. An example of the display device 20 in this case is a television receiver. With such a display device 20, the user simply buys the display device 20, which is a television receiver, and the number of blinks when viewing the display device while escaping from the complexity of wiring and setting. It is possible to enjoy the benefits of the present invention that it is possible to avoid this reduction.

The overall configuration of the display device 20 in this case is shown in FIG. The lens 20 L of the digital camera is seen in front of the display device 20. The display device 20 includes the hardware included in the computer 10 according to the first embodiment as necessary, and is formed inside the computer 10 according to the first embodiment. The function block will be included as necessary, but it will be clear to those skilled in the art what kind of these will be, so the explanation thereof will be omitted. Note that the computer 10 of the first embodiment can also be such, but the display device 20 can have a plurality of users who take images with a digital camera incorporated therein, and The first data is generated when it is determined that blink reduction has occurred in one of the multiple users, and the second data is generated when the user subsequently performs blinking again. It is said to be a eel. By doing so, it is possible to prevent the blinking of multiple users at once.

<< Second Embodiment >>

Next, a second embodiment of the present invention will be described.

The computer 10 of the second embodiment is connected to the display device 20, the digital camera 30, and the input device 40 as in the case of the first embodiment. The hardware configuration of the computer 10, the display device 20, and the input device 40 in the second embodiment is the same as that in the first embodiment. In short, in the second embodiment, the blink detection unit 1 2 2 B, which was supposed to be generated in the computer 10 in the first embodiment, is replaced with the inside of the digital camera 30 in the first embodiment. It has been moved to. The digital camera 30 according to the second embodiment can generate the blink detection unit 1 2 2 B similar to the case of the first embodiment and is generated within the digital camera 30. The blink detection unit 1 2 2 B can perform the same information processing as that performed by the blink detection unit 1 2 2 B in the computer 10 of the first embodiment. In other words, the digital camera 30 is intelligent in this sense.

The digital camera 30 in the second embodiment includes the same CPU, ROM, RAM, interface, and bus as those included in the computer 10. When the CPU executes the program recorded in the ROM, the blink detection unit 1 2 2 B is generated in the digital camera 30.

Note that the blink detection unit 1 2 2 B does not necessarily exist in the digital camera 30, and may exist in β other than the digital camera 30 and the computer 10. . In this case, a combination of the digital camera 30 and the other device is the blink detection device in the second invention.

FIG. 5 schematically shows functional blocks generated in the digital camera 30 and the computer 10.

In the digital camera 30, as shown in FIG. 5, the blink detection 咅 1 2 2 Β and the output unit 1 3 1 are generated. The output unit 1 3 1 has a function of sending the blink data generated by the blink detection unit 1 2 2 に to the computer 10.

The function block generated inside the computer 10 is the function block generated inside the computer 10 according to the first embodiment except for the blink detection unit 1 2 2 Β. The functions of the function blocks generated inside the computer 10 of the second embodiment are the same as the functions of the function blocks (same names) generated inside the computer 10 of the first embodiment. If there is a difference, the data received by the input unit 1 2 1 from the digital camera is not the face image data but the blink data.

Next, the flow of processing executed by the computer 10 of the second embodiment will be described. Light up.

In the second embodiment, the present invention is not necessarily limited to this, but when the computer is turned on and the computer 10 is started, the program of the present invention is executed and the start process is automatically started.

Next, the normal image is displayed on the display device 20. The display device 20 displays a normal-time image based on the normal-time image data generated by the main control unit 1 2 2 A of the information processing unit 1 2 2.

In this state, the user specifies the type of image processing at the time of abnormality from the above-mentioned (A) to (E).

Thereafter, the blink detection unit 1 2 2 B of the digital camera 30 receives face image data from the image sensor of the digital camera 30. The blink detection unit 1 2 2 B always determines the presence or absence of the user's blink from the face image data. The blink detection unit 1 2 2 B according to the second embodiment may perform the same blink detection method as in the first embodiment. Blink detection unit 1 2 2 When B generates blink data, the blink data is sent to the input unit 1 2 1 of the computer 10 via the output unit 1 3 1.

The blink data received via the computer 1 0 force input unit 1 2 1 is sent to the blink determination unit 1 2 2 C of the information processing unit 1 2 2. The computer 10 uses the blink data to continuously determine whether the number of blinks of the user is less than a predetermined standard. This determination may be performed by the method described in the first embodiment and its modifications.

Blink determination unit 1 2 2 When the C determines that the number of blinks of the user is less than the predetermined reference (for example, when a fixed time has elapsed), the blink determination unit 1 2 2 C generates first data similar to that in the first embodiment. The first data is sent from the blinking half IJ fixed part 1 2 2 to the image processing part 1 2 2 D.

The image processing unit 1 2 2 D that has received the first data performs the type of image processing specified by the user on the normal-time image data. The normal-time image data subjected to the image processing is sent from the image processing unit 1 2 2 D to the display device 20 through the output unit 1 2 3. The display device 20 displays a normal-time image after any of the image processing (A) to (E) is performed. Even in this state, the blink detection unit 1 2 2 B in the digital camera 30 continues to detect the user's blink. The blink data generated due to the new blink continues to be supplied to the blink determination unit 1 2 2 C via the output unit 1 3 1 and the input unit 1 2 1. . When the blink determination unit 1 2 2 C receives blink data generated by the user performing a new blink while the image processing is being performed on the normal image data, the blink determination unit 1 2 2 C generates second data. The second data is sent to the blink determination unit 1 2 2 C force, the image processing unit 1 2 2 D. The image processing unit 1 2 2 D that has received the second data ends the image processing for the normal-time image data that has been continuously received from the main control unit 1 2 2 A. As a result, the image displayed on the display device 20 returns to the normal image that has not undergone image processing.

The subsequent processing is the same as the processing after (S 0 1 1) in the first embodiment.

In the second embodiment, the digital force lens 30 provided with the function of detecting blinks functions as the blink detection device in the present application.

The digital camera 30 as the blink detection device can be, for example, as shown in FIG.

In Modification 4, the user's blink is detected by a spectacle-shaped blink detector 300 as shown in FIG.

The blink detector 3100 includes a main body 310 having a frame shape of glasses as a whole. The main body 3 10 may be provided with a frame, a temple, a bridge, a lens (with or without a degree), a nose pad, and the like, as in normal glasses. By putting the temple of the main body 3 10 on the user's ear, the user can wear the blink detector 3 0 0 in the state of glasses.

A detection sensor 3 2 0 is provided inside the frame corresponding to one of the left and right eyes of the main body 3 10 (the side facing the face of the user wearing the blink detector 3 0 0). The detection sensor 3 2 0 is a sensor that detects a physical change caused by the user blinking. Details of the detection sensor 3 20 will be described later. The main body 3 1 0 includes a control circuit 3 3 0. The control circuit 3 3 0 is connected to the detection sensor 3 2 0 via a connection line 3 2 1. The control circuit 3 3 0 is not limited to this force. In the fourth modification, the control circuit 3 30 is embedded in a temple that is a part of the main body 3 10. The hardware configuration of the control circuit 3 30 is the same as that of the digital camera 30 according to the second embodiment. In the control circuit 3 3 0, the CPU of the control circuit 3 3 0 executes the program recorded in the control circuit 3 3: ROM, for example, as in the second embodiment. Function blocks (this includes the output unit 1 3 1 and the blink detection unit 1 2 2 B) are formed. The blink detection unit 1 2 2 B detects blinks of the user based on the data received from the detection sensor 3 2 0 via the connection line 3 2 1 and generates blink data. ing. The generated blink data is sent to the computer 10 by the wireless communication device included in the control circuit 3 30, for example. Note that the data sent to the computer 10 by the blink detector 3 0 0 does not necessarily indicate that the blink has been detected, but is necessary for the computer 1 0 to detect the blink. The actual data itself may be used. In this case, the blink detection unit 1 2 2 B of the second embodiment is generated inside the computer 10, not the blink detector 3 0 0.

The detection sensor 3 20 can include, for example, two electrodes 3 11 as shown in FIG. In this case, an appropriate potential difference is given to the two electrodes 3 1 1. The two electrodes 3 1 1 are provided such that the user's eyelids cross the electric lines of force D formed between the two electrodes 3 1 1 when the user blinks. When the user blinks, the capacitance between the two electrodes 3 1 1 increases due to the presence of soot on the electric field lines D between the two electrodes 3 1 1. In this case, the blink detection unit 1 2 2 B monitors the capacitance between the two electrodes 3 1 1 and the capacitance between the two electrodes 3 1 1 exceeds a certain threshold. It is determined that the user has blinked, and blink data is generated.

The detection sensor 3 20 can be a combination of an infrared sensor and an infrared light source. In this case, the infrared light source irradiates infrared rays around the user's eyes. Infrared sensors measure the intensity or amount of infrared light reflected around the user's eyes _(the user does not feel it because it is invisible. It is well absorbed by the black eye. Therefore, when the user is not blinking, the amount of infrared rays captured by the infrared sensor is small. On the other hand, when the user blinks, the amount of infrared light from the infrared light source reflected by the eyelid covering the user's eyes increases, so the amount of infrared light captured by the infrared sensor increases. In this case, the blink detection unit 1 2 2 B monitors the amount of infrared light captured by the infrared sensor, and if the amount of infrared light captured by the infrared sensor exceeds a certain threshold, the user blinks. Judgment is made and blink data is generated.

It should be noted that the main body 3 10 in Modification 4 can be existing glasses. In this case, in the configuration of the blink detector 3 0 0 in the modified example 4, the part other than the main body 3 1 0 which is the eyelid mirror is preferably retrofitted to the main body 3 1 0 which is the spectacles. Blink detection option 3 0 Can be configured as OX. The glasses functioning as the main body 3 1 0 are owned by many of the users, but if the blink detection option 3 0 0 X as described above is used, the existing glasses owned by the user can be used. This is convenient because it is made to function as the blink detector 3 0 0 as described in the fourth modification. Blink detection option 3 0 0 X is a force that can be integrated as a whole In such a case, the blink detection option 3 0 OX glasses (main body 3 1 0) can be attached to the glasses once. It will be made to function as the blink detector 3 0 0.

Figure 20 shows the blink detection option 3 0 0 X attached to the main body 3 1 0 which is glasses.

The blink detection option 3 0 0 X is equipped with the option body 3 1 0 X. The option main body 3 1 0 X is configured to be detachably fixed to the main body 3 10 which is the spectacles. The optional body 3 1 O X may be fixed to the body 3 10 using an appropriate technique such as clamping with a clip, adsorption with a magnet, or adhesion with an adhesive. In this embodiment, the optional main body 3 1 0 X has a clip (not shown), and can be fixed to the main body 3 1 0 by sandwiching a part of the frame of the main body 3 1 0 with a lip. Yes.

The optional body 3 1 0 X is provided with the same detection sensor 3 2 0 as that provided by the blink detector 3 0 0, and the blink detector 3 0 0 was provided A similar control circuit 330 (not shown) is incorporated. << Third Embodiment >>

Next, a third embodiment of the present invention will be described.

The computer 10 of the third embodiment is connected to the display device 20, the digital camera 30, and the input device 40 as in the case of the second embodiment. The hardware configuration of the computer 10, the display device 20, and the input device 40 in the third embodiment is the same as that in the first embodiment.

In short, the third embodiment includes a blink detection unit 1 2 2 B and a blink determination unit 1 2 2 C that are supposed to be generated in the computer 10 in the first embodiment. The digital camera 30 is moved into the embodiment. The digital camera 30 according to the third embodiment can generate the blink detection unit 1 2 2 B and the blink determination unit 1 2 2 C as in the case of the first embodiment. Blink detection unit 1 2 2 B and blink determination unit 1 2 2 generated in camera 30. In the computer according to the first embodiment, the same information processing as that performed by the blink detection unit 1 2 2 B and the blink determination unit 1 2 2 C can be executed. . In other words, the digital force mela 30 according to the third embodiment is intelligent in this sense, like the digital force mela 30 according to the second embodiment.

Note that the blink detection unit 1 2 2 B and the blink determination unit 1 2 2 C or the blink determination unit 1 2 2 C do not necessarily exist in the digital camera 30, and the digital camera 30 It may exist in other devices than the computer 10. In this case, the combination of the digital camera 30 and the other device is the blink detection device in the third invention.

The digital camera 30 according to the third embodiment includes the same CPU, ROM, RAM, interface, and bus as the digital camera 30 according to the second embodiment. When the CPU executes the program recorded in the ROM, the blink detection section 1 2 2 B and the blink half IJ fixed section 1 2 2 C are generated in the digital camera 30. .

FIG. 8 schematically shows functional blocks generated in the digital camera 30 and the computer 10. In the digital camera 30, as shown in FIG. 8, a blink detection unit 1 2 2 B, a blink determination unit 1 2 2 C, and an output unit 1 3 1 are generated. The output unit 1 3 1 has a function of sending the first data and the second data generated by the blink determination unit 1 2 2 C to the computer 10.

The function block generated inside the computer 10 excludes the blink detection unit 1 2 2 B and the blink determination unit 1 2 2 C from the function block generated inside the computer 10 of the first embodiment. It is a thing. The function block function generated in the computer 10 of the third embodiment is the same as the function of the function block (same name) generated in the computer 10 of the first embodiment. If there is a difference, the data received by the input unit 1 2 1 from the digital power camera 30 is not the face image data but the first data and the second data.

Next, the flow of processing executed by the computer 10 of the third embodiment will be described.

Even in the third embodiment, the power supply is turned on and the computer 10 is started up, so that the program of the present invention is executed and the start process is automatically started.

Thereafter, the blink detection unit 1 2 2 B of the digital camera 30 receives face image data from the image sensor of the digital camera 30. The blink detection unit 1 2 2 B always determines the presence or absence of the user's blink from the face image data. The blink detection unit 1 2 2 B according to the third embodiment may detect the blinks in the same manner as in the first embodiment. Blink detection unit 1 2 2 When B generates blink data, blink data is sent to the blink determination unit 1 2 2 C.

The blink determination unit 1 2 2 C determines, based on the blink data, whether or not the number of blinks of the user is less than a predetermined reference. How to make a strong decision It can be made the same as in the case of the embodiment and its modification. Blink determination unit 1 2 2 When C determines that the number of blinks of the user is less than the predetermined reference (for example, when a fixed time has elapsed), the blink determination unit 1 2 2 C generates the same first data as in the first embodiment. The first data is sent to the output unit 1 3 1 from the blink determination unit 1 2 2 C force and to the computer 10. The computer 10 receives this via the input unit 1 2 1. The input unit 1 2 1 sends the first data to the image processing unit 1 2 2 D of the information processing unit 1 2 2.

Upon receiving the first data, the image processing unit 1 2 2 D performs the image processing of the type specified by the user on the normal time image data. The normal-time image data subjected to the image processing is sent from the image processing unit 1 2 2 D to the display device 20 through the output unit 1 2 3. The display device 20 displays a normal-time image after any of the image processing (A) to (E) is performed.

Even in this state, the blink detection unit 1 2 2 B in the digital camera 30 continues to detect the user's blink. Then, the blink data generated by the new blink has been supplied to the blink determination section 1 2 2 C. When the blink data generated by the user performing a new blink is received by the blink determination unit 1 2 2 C while the image processing is being performed on the normal image data, the blink determination unit 1 2 2 C generates second data. The second data is sent to the image processing unit 1 2 2 D of the information processing unit 1 2 2 via the output unit 1 3 1 and the input unit 1 2 1. The image processing unit 1 2 2 D that has received the second data ends the image processing for the normal-time image data that is being received from the main control unit 1 2 2 Α. As a result, the image displayed on the display device 20 returns to the normal image without image processing.

Note that the digital camera of the third embodiment can be replaced with the same blink detector 300 as described in the fourth modification of the second embodiment.

<< Fourth Embodiment >>

Hereinafter, the fourth embodiment will be described. In the fourth embodiment, the present invention is applied to a head mount display. -The head-mounted display of this embodiment is an attachment type HMD used by attaching to the glasses 600 having the shape of the glasses frame as shown in FIG. In this embodiment, the head mounted display device 500 is attached to the back of the glasses 600. In use, the head mounted display device 500 is positioned in a space between the user's face and the glasses 600. For this reason, it is difficult for non-users to understand the existence of the head-mounted display device 500.

The spectacles 600 have the same configuration as normal spectacles in which a spectacle lens 60 2 is fitted in a spectacle frame 6 0 1. The glasses 600 may be sold on the market. The spectacle lens 6 0 2 may or may not have a degree, and may be colorless and transparent or colored and transparent. The eyeglass frame 6 0 1 includes left and right vines 60 3, left and right rims 6 0 4, and a bridge 6 0 5 that connects the left and right rims 6 0 4. The left and right vines 6 0 3 are hinged to the left and right rims 60 4, respectively, so that the vine 6 0 3 can be folded in a direction parallel to the rim 6 0 4. The force to lock the tips of the vines 6 0 3 to the user's both ears, or by holding the user's head between the two vines 6 0 3, the glasses 6 0 0 are fixed to the user's head Is done.

In this embodiment, when the head mounted display device 5 0 0 is attached to the glasses 6 0 0, the attached head mounted display device 5 0 0 is positioned behind the glasses 6 0 0. At that time, since the glasses 600 must move forward from the user's face, the length of the crane 6 0 3 is normal so that the user can put the glasses 6 0 3 on the ear of the user. It is somewhat longer than the glasses frame. In the example shown in FIG. 9, the tip of the vine 60 3 is bent downward so that it can be easily locked to the user's ear, but the tip of the vine 60 3 is straight. Good. That is, the vine 6 0 3 may be a straight temple. When the temple 6 0 3 is a straight temple, the user's sense of the temple 6 0 3 remains constant regardless of whether the head mounted display device 5 0 0 is attached to the glasses 6 0 0 or not. Can be maintained. An example of a vine 60 3 according to a modification example using a straight balance is shown as 60 3 S in FIG. The head-mounted display device 5 0 0 includes a case 5 1 0 having a display inside, and left and right free curved surface prisms 5 2 0 connected to the case 5 1 0 via a movable part 5 1 6, And a nose pad 5 3 0 connected to the case 5 10.

The case 5 10 is not necessarily limited thereto, but in this embodiment, the case 5 10 can be attached to the bridge 6 0 5 of the glasses 6 0 0. The case 5 10 is positioned behind the glasses 6 00 when it is attached to the glasses 600. The free-form curved prism 5 2 0 is connected to the case 5 10 so that it is arranged in the lateral direction of the case 5 1 0 when viewed by the user when the user wears the glasses 6 0. The nose pad 5 3 0 is attached so as to be located further rearward of the case 5 10. The nose pad 5 3 0 prevents the glasses 6 0 0 from coming into contact with the user's nose when the user wears the glasses 6 0 0 to which the head mounted display device 5 0 0 is attached to the head. To do. An image displayed on a display (described later) is enlarged by a free-form surface prism 5 20 at a predetermined magnification, and is output backward from the free-form surface prism 5 20. The image output backward will enter the eye of the user wearing the glasses 600. In this embodiment, the image is output from the area surrounded by the dotted line of the free-form surface prism 5 20 (see FIG. 17).

A detection sensor 3 2 0 is provided on the upper surface of one of the two free-form curved prisms 5 2 0. The detection sensor 3 2 0 can be anything that detects the user's blinks. The detection sensor 3 20 of this embodiment is the same as that described in the second embodiment.

The detection sensor 3 2 0 is connected to an interface described later. The detection sensor 3 2 0 generates data when it detects a change in physical quantity caused by blinking, and sends it to the interface.

The head mounted display device 500 is attached to the glasses 600 as shown in FIG.

In order to make this possible, a first attachment member 6 40 is formed on the bridge 6 0 5 of the glasses 6 0 of this embodiment. The first mounting member 6400 of this embodiment has a first shaft portion 640a and a first shaft portion 6400a whose proximal ends are connected to the bridge 605. The first ball portion 6 4 0 b is provided at the tip. The first mounting member 6 4 0 may be formed integrally with the glasses 6 0 0. When a general-purpose spectacle frame is used for the spectacles 600, the first mounting member 6400 is naturally a separate member from the spectacles 600, and is to be attached to the spectacles 600 later. Become. In this case, the first attachment member 6400 is attached to the glasses 600 with an adhesive, for example.

More specifically, the case 5 1 0 of the head-mounted display device 5 0 0 has a first fitting hole on the surface facing the glasses 6 0 0 when attached to the glasses 6 0 0. 5 1 0 a is formed. When the head mounted display device 500 is attached to the glasses 600, the first ball portion 6 4 Ob of the first attachment member 6 40 0 is fitted into the first fitting hole 5 10 a. These constitute a so-called pole joint.

Further, the second mounting member 5 50 having the same configuration and size as the first mounting member 6 4 0 is provided on the surface of the case 5 1 0 opposite to the surface on which the first fitting hole 5 1 0 a is provided. Is formed. The second mounting member 5 50 of this embodiment has a second shaft portion 5 5 ° a whose base end is connected to the case 5 10 0, and a second shaft portion 5 5 0 a provided at the tip of the second shaft portion 5 50 a. It consists of two ball parts 5 5 0 b. The second attachment member 5 50 may be formed integrally with the case 5 10, but it may be attached to the case 5 10 with an adhesive or the like.

A second fitting hole 5 3 0 a is formed on the side of the nose pad 5 3 0 connected to the case 5 1 0. The second fitting hole 5 30 a is the same size as the first fitting hole 5 10 a. When the nose pad 5 3 0 is attached to the case 5 10, the second pole portion 5 5 of the second attachment member 5 5 0 is fitted into the second fitting hole 5 3 0 a. These constitute a so-called paw / rejoint.

The first mounting member 6 40 and the second mounting member 5 50, the first fitting hole 5 1 0 a and the second fitting hole 5 3 0 a are respectively formed in the same shape and size. Therefore, it is also possible to fit the first pole part 6400b of the first mounting member 640 into the second fitting hole 53Oa. As a result, the case 5 10, the movable part 5 16, and the free-form surface prism 5 2 0 can be removed and only the nose pad 5 30 can be directly attached to the glasses 600. A combination of glasses 600 and nose pads 53 can be used in the same way as normal glasses.

Next, the head mounted display device 500 will be described in detail. FIG. 11 is a view of the head-mounted display device 500 viewed from the upper side in FIG.

Case 5 10 is a substantially rectangular hollow. Case 5 10 is not necessarily so, but is made of resin in this embodiment. A diopter adjustment knob 5 1 2 for adjusting the diopter and a prism position adjustment knob 5 1 3 for adjusting the position of the free curved prism 5 2 0 are provided on the upper surface of the case 5 10. Yes.

The diopter adjustment knob 5 1 2 is operated to move the display inside the case 5 10 forward and backward in the direction of the optical axis of the image. In the present embodiment, two diopter adjustment knobs 5 1 2 are provided so that the diopters of the left and right eyes can be individually adjusted.

The prism position adjustment knob 5 13 is operated to move the position of the free-form surface prism 5 20 relative to the case 5 10 within a predetermined range. A scale is provided in the vicinity of the prism position adjustment knob 5 1 3 so that the amount of movement of the free-form surface prism 5 2 0 relative to the amount of operation of the prism position adjustment knob 5 1 3 can be intuitively understood.

FIG. 12 is a partial cross-sectional view of the case 5 10 viewed from the top, showing the inside of the case 5 10.

Inside the case 5 10 is a diopter adjustment knob 5 1 2, a diopter adjustment plate 5 1 1, a display 5 1 4, a control board 5 1 5, and a diopter adjustment knob 5 1 2 Degree adjustment plate 5 1 1, display 5 1 4 and control board 5 1 5, movable part 5 1 6 that is connected to free curved prism 5 2 0, and pieon part 5 1 7 are provided .

In the present embodiment, it is assumed that two movable parts 5 1 6 and two free-form surface prisms 5 2 0 are provided. However, this is not always necessary, and even if these are one by one. Good. In other words, the head-mounted display device 500 does not necessarily have to be for both eyes, but has a movable part 5 1 6 for the right eye or left eye and a free-form curved prism 5 2 0 only, for the right eye. Alternatively, it may be for the left eye. The display 5 14 is for displaying an image and is not necessarily limited to this, but in this embodiment, it is a rectangular liquid crystal display. The display 5 1 4 has a short side direction viewed from the user when the user wears glasses 600. The vertical direction is inclined with respect to the width direction of the spectacle lens 6202, and an image is incident on one surface of the free-form surface prism 5220 at a predetermined angle. Installed on 5 1 6.

The control board 5 15 controls the image displayed on the display 5 14.

The control board 5 1 5 sends data for displaying an image to the display 5 1 4 to display an appropriate image on the display 5 1 4. This image may prompt the user to blink, as will be described later. The control board 5 15 receives data about the image from an external device (not shown) and displays it on the display 5 14. The control board 5 15 is configured to receive data for an image from an external device (not shown) by wire or wireless. The interface of the control board 5 1 5 has a cable used when the data about the image is received from an external device in a wired manner so that the data about the image can be received, and the cable used for the image and the external device wirelessly. When image data is accepted, it is connected to the antennas installed inside and outside the control board 5 15.

As the external device, for example, a hard disk player, a DVD player, a tuner for television broadcasting, a personal computer, a mobile phone, a game device for executing a computer game, an MP 3 player having an image processing function, or the like is used. be able to. Although not shown, the control board 5 15 includes the same CPU, ROM, RAM, interface as described in the first embodiment, and a path for connecting them. These form a function block similar to the case of the first embodiment by the program recorded in the ROM.

The difference between the case of the fourth embodiment and the case of the first embodiment is that the blink detection unit 1 2 2 B in the fourth embodiment is similar to the case of the modified example 4 in that the detection sensors 3 2 0 The blink data is generated based on the data received through the input unit 1 2 1, and the image processing data recording unit 1 2 2 E in the fourth embodiment is (in the case of the first embodiment ( A) to (E) data power for the five types of image processing methods Only one of them is recorded, and the image processing unit 1 2 2 D There is only one kind of image processing method for this.

On the movable part 5 1 6, the image light from the image displayed on the display 5 1 4 and the free-form surface prism 5 2 0 force display 5 1 4 is imaged at a constant angle on one surface of the free-form surface prism 5 2 0 It is installed in such a state as to Alt.

A rack portion 5 1 6 a is formed on the movable portion 5 1 6 so as to come into contact with the pinion portion 5 1 7. Each rack portion 5 1 6 a has teeth formed on the surface facing the pinion portion 5 1 7.

The pinion part 5 1 7 is connected to the prism position adjusting knob 5 1 3, and when the prism position adjusting knob 5 1 3 is rotated, the pinion part 5 1 7 is rotated accordingly. . The pinion portion 5 1 7 has a cylindrical shape, and teeth parallel to the axial direction of the cylinder are formed on the side surface. The teeth of the pieon part 5 1 7 and the teeth of the rack part 5 1 6 a are designed to squeeze together. When the pion portion 5 1 7 rotates, the rack portion 5 1 6 a moves along the length direction of the rack portion 5 1 6 a according to the amount and direction of the rotation.

As shown in Figure 1 3, when the prism position adjustment knob 5 1 3 is rotated counterclockwise, the base end of the rack part 5 1 6 a moves away from the pinion part 5 1 7 and the two movable parts 5 1 Slide 6 away. Conversely, when the prism position adjustment knob 5 1 3 is rotated to the right, the base end of the rack part 5 1 6 a moves in a direction approaching the pinion part 5 1 7 and the two movable parts 5 1 6 Slide toward you. Since the movable part 5 1 6 and the free curved surface prism 5 2 0 are connected, the free curved surface prism 5 2 0 slides in the same manner as the movable part 5 1 6 slides. In this way, by rotating the prism position adjustment knob 5 1 3, the free curved surface prism 5 2 0 attached to the movable part 5 1 6 can be bridged even after the case 5 1 0 is attached to the glasses 6 0 0. It can be slid between 6 0 5 and the 6 0 0 wisdom. As the free-form surface prism 5 20 slides, the position of the image output from the free-form surface prism 5 20 also translates in the left-right direction. Thereby, the position where the image is output can be matched with the position of the user's eye. In this embodiment, the movement of the two free-form surface prisms 5 2 0 (light guiding means) is symmetrically and simultaneously performed by the operation of one prism position adjustment knob 5 1 3 by the mechanism described above. It can be done. It is convenient to move the light guide means symmetrically at the same time according to the eye width, any force that can be realized without using the mechanism described above. Note that the pinion portion 5 1 7 may be configured integrally with the prism position adjustment knob 5 1 3.

The diopter adjustment knob 5 1 2 and the diopter adjustment plate 5 1 1 included in the movable part 5 1 6 are used to change the distance from the display 5 1 4 to the free-form surface prism 5 2 0 to the user's visual acuity An adjustment mechanism for providing an image tailored to the above is configured. FIG. 14 is a diagram for explaining the adjustment mechanism in detail by enlarging the movable portion 5 16. FIG. 15 is a diagram for explaining the operation of the adjusting mechanism.

The diopter adjustment knob 5 1 2 has a groove formed in the head portion protruding to the outside of the case 5 10, and has a crank portion 5 1 2 a bent in a crank shape at the middle. When a flat plate is inserted into the groove in the head and rotated, the crank part 5 1 2 a rotates around the center of rotation.

The diopter adjustment plate 5 1 1 is connected to the control board 5 15 and has a chamfered rectangular shape in which a long side is provided in the extending direction of the one side in the vicinity of the side facing the one side. Adjustment holes 5 1 1 a are provided. The crank hole 5 1 2 a of the diopter adjustment knob 5 1 2 is provided in the adjustment hole 5 1 1 a. The short side of the adjustment hole 5 1 1 a is formed with a length corresponding to the size of the crank portion 5 1 2 a.

When the diopter adjustment knob 5 1 2 is rotated in the state of Fig. 1 5, the crank part 5 1 2 a rotates around the center of rotation. The adjustment hole 5 1 1 a is penetrated by the crank part 5 1 2 a. Therefore, when the crank part 5 1 2 a rotates, the adjustment hole 5 1 1 a moves in the direction of the control board 5 1 5 according to its movement. To be energized. As a result, the diopter adjustment plate 5 11 moves in the direction in which the control substrate 5 15 is urged. When the control board 5 15 moves, the display 5 14 moves in a direction approaching the free-form surface prism 5 20. By changing the distance between the display 51 4 and the free-form curved prism 5 20, the diopter of the image can be adjusted according to the visual acuity of the user.

Since the diopter adjustment knob 5 1 2 rotates, the diopter adjustment plate 5 ί 1 moves in a biston shape. For this reason, the display 5 1 4 does not move too much and collides with the free-form surface prism 5 2 °, and each other is not damaged. The user can adjust the diopter adjustment knob 5 By rotating 1 2, the position of display 5 1 4 can be adjusted to the optimal position for the diopter of your own eyes.

FIG. 16 is a diagram for explaining a light guide path by the free-form surface prism 5 20. The free curved prism 5 2 0 guides light from the display 5 1 4 to at least one eye of the user and enlarges an image displayed on the display 5 1 4. The free-form surface prism 5 20 is formed in a substantially triangular cross section having three surfaces, ie, a first surface S 1, a second surface S 2, and a third surface S 3, each of which is a free-form surface.

The first surface S 1 is exposed to the display 5 1 4, and guides the light from the display 5 1 4 for the image displayed on the display 5 1 4 to the inside of the free-form surface prism 5 2 0. . The light from the display 5 14 is refracted when passing through the first surface S 1 and changes so that the image displayed on the display 5 14 is enlarged.

The second surface S 2 reflects the light that has passed through the first surface S 1 (usually total reflection). The light that has passed through the first surface S 1 changes its direction greatly by being reflected by the second surface S 2, and changes so that the image displayed on the display 5 14 is enlarged. The second surface S 2 also allows the light reflected by the third surface S 3 to pass through. This will be described later.

The third surface S 3 reflects the light reflected by the second surface S 2. The light reflected by the second surface S 2 changes its direction greatly by being reflected by the third surface S 3, and also changes so that the image displayed on the display 5 14 is enlarged. . The reflection performed on the third surface S 3 may be total reflection or metal reflection. When the reflection performed on the third surface S3 is total reflection, the incident angle when the light reflected on the second surface S2 reaches the third surface S3 is set so that the incident angle is less than or equal to the total reflection angle. 3 surface S 3 curved surface is designed. When the reflection performed on the third surface S3 is a reflection by a metal, the metal is attached to the outside of the third surface S3, for example, by vapor deposition. A dielectric multilayer film can be formed instead of attaching metal to the outside of the third surface S3. The reflection in this case is made by a dielectric multilayer film.

As described above, the light reflected by the third surface S 3 turns toward the second surface S 2 and passes through the second surface S 2. The light passing through the second surface S2 is refracted when passing through the second surface S2. The display 5 1 4 changes to enlarge the image displayed. The image displayed on the display 5 14 is displayed on the dotted line portion of the free-form surface prism 5 2 0 as shown in FIG.

When the case 5 10 is attached to the glasses 6 0 0, at least a part of the free curved prism 5 2 0 as described above is at least one of the eyes of the user when using the head mounted display device 5 0 0. Is connected to the case 5 10 so that the light from the display 5 14 is emitted to the user's eyes.

The free-form curved prism 5 20 is not connected to the case 5 10 in the vertical direction when viewed from the user wearing the glasses 60 but is connected in the horizontal direction. That is, the overall shape of the head-mounted display device 500 is a shape extending in the lateral direction.

FIGS. 18 a and 18 b are views showing a state in which the glasses 600 with the head-mounted display device 500 are viewed from the front. The glasses 600 in FIG. 18 b are different from those described so far, and are of the type in which the left and right lenses 60 2 are connected.

As shown in these drawings, when the glasses 6 00 with the head-mounted display device 500 attached thereto are viewed from the front, the head-mounted display device 5 0 0 is connected to the glasses lens 6 0 2. It becomes almost hidden behind.

The head-mounted display device 5 0 0 of this embodiment is connected to the main body 1 0 and the free-form curved prism 5 2 0 so that they are arranged in the horizontal direction. When attached, it is possible to prevent most of the head mounted display device 500 from being seen from the front of the eye mirror 600. In other words, the amount of protrusion of the head mounted display device 500 from the glasses 600 can be reduced as much as possible, and design characteristics are not impaired.

Further, since the head mounted display device 500 according to the present embodiment does not block the user's vertical field of view, the image displayed on the free-form curved prism 5 20 is viewed. However, the surroundings of the free-form surface prism 5 2 0 are in a state that can be seen though somewhat blurred. Therefore, a simple operation can be performed even when the line of sight is directed to the free-form surface prism 5 20, which is convenient. In addition, the line of sight You can see your feet and walk even when facing the prism 5 2 0. Furthermore, if the line of sight is removed from the free-form surface prism 5 20, the surroundings can be seen better.

Next, a method of using the head mounted display device 500 will be described.

In order to use the head mounted display device 5 0 0, the glasses 6 0 0 with the head mounted display device 5 0 0 attached thereto are fixed to the user's head. The head mounted display device 5 0 0 is attached to the glasses 6 0 0 by attaching the glasses 6 0 to the first fitting holes 5 1 0 a provided in the case 5 1 0 of the head mount display device 5 0 0. This is done by fitting the first pole portion 6 4 0 b of the first mounting member 6 4 0 attached to 0. In addition, as described above, the glasses 6 00 with the head-mounted display device 500 attached to the user's head are fixed to the user's ears 6 Or by holding the user's head with the vine 6 0 3 of the glasses 600.

Before fixing the glasses 600 to the user's head, a nose pad 53 0 is attached to the head mount display device 500. The nose pad 5 3 0 is attached to the head mounted display device 5 0 0 by attaching the head mount display device 5 0 0 to the second fitting hole 5 3 0 a provided in the nose pad 5 3 0. This is performed by fitting the second ball portion 5 5 0 b of the case 5 10.

In this state, the user operates the above-described external device to input data about an image to be displayed on the head mounted display device 500 to the head mounted display device 500. The control board 5 1 5 displays an image on the display 5 1 4 according to data about the image.

The light of the image displayed on the display 5 1 4 exits from the display 5 1 4 and is input to the first surface S 1 of the free-form surface prism 5 20. In the free-form surface prism 5 20, light is emitted from the second surface S 2 as shown in FIG. The emitted light allows the user to see an appropriately sized image with both eyes.

If necessary, the user does not change the incident angle of the light from the display 5 1 4 to the free-form surface prism 5 2 0 by operating the diopter adjustment knob 5 1 2. In the meantime, the display 5 1 4 can be moved closer to or away from the free-form surface prism 5 2 0. In other words, the display 5 14 can be moved back and forth in the light emission direction (optical axis direction) from the display 5 14. As a result, it is possible to adjust so that an image suitable for the eyesight of the user can be displayed.

In addition, the user operates the prism position adjustment knob 5 1 3 to move the position of the free curved surface and prism 5 2 0 to an appropriate position according to the user's eye width. Can be adjusted to a position where the user can easily see the image. In addition, the user can listen to the sound matched to the image by wearing an earphone (not shown) on the ear.

While the head mounted display device 5◦ 0 is in use, the blink detection unit 1 2 2 B uses the data from the detection sensor 3 2 0 to generate blink data every time the user blinks. Generate. The blink determination unit 1 2 2 C receives the blink data generated by the blink detection unit 1 2 2 B from the blink detection unit 1 2 2 B force and monitors the user's blink state. Then, the blink determination unit 1 2 2 C generates the first data and the second data based on the same standard as in the first embodiment, and sends it to the image processing unit 1 2 2 D. ,

The image processing unit 1 2 2 D displays the image data sent from the external device (normal image data) via the output unit 1 2 3 as it is until the first data is received. Send to. This allows the user to view the normal image. The image processing unit 1 2 2 D also receives the first data and continues until the second data is received based on the data recorded in the image processing data recording unit 1 2 2 E. Image processing is performed on the data. At this time, an image subjected to image processing is displayed on the display 5 14. This image usually makes it difficult to see the image, and gives the user the motivation to blink. When the user performs blinking and the second data is generated, the image processing unit 1 2 2 D that receives the second data stops the image processing. After that, until the first image data is received by the image processing unit 1 2 2 D, the normal image is displayed on the display 5 14.

When the user stops using the head-mounted display device 5 0 0, the user removes the head-mounted display device 5 0 0 from the glasses 6 0 0. Also eye 34

Attach the noise pad 5 3 0 removed from the head mount display device 5 0 0 removed from the mirror 6 0 0 to the eyelid mirror 6 0 0. Thereby, the user can use the eyelid mirror 600 as normal glasses.

The nose pad 5 3 0 is attached to the glasses 6 0 0 by attaching the first ball portion 6 4 0 b of the first mounting member 6 4 0 attached to the glasses 6 0 0 to the nose pad 5 3 0. This is performed by fitting in the second fitting hole 5 30 a provided in the.

The head mount display device 500 described above is detachable with respect to the glasses 600. The head mounted display device 5 0 0 attached to the glasses 600 or the head mounted display device 5 0 0 fixed so as not to be removed from the head mount device such as glasses 6 The headma of the present invention, which is provided with a headmount means as a whole,

Claims

The scope of the claims

1. It is used in combination with an imaging device that captures a facial image that is a moving image of a user's face and generates facial image data that is data of the facial image, and a display device that displays the image. A computer comprising an input means for receiving the bag image data from an imaging device; and a display control means for controlling an image displayed on the display device,

Detecting means for detecting a user's blink by performing image processing on the eyelid image data received by the input means;

When it is determined that the number of blinks of the user is less than a predetermined reference based on the blink of the user detected by the detection unit, the image displayed on the display device at the normal time until then First control means for generating first control data for causing the display control means to perform processing for making the display device display the above-mentioned display device more difficult to see than before,

According to the first control data, when the detection unit detects a blink of the user when the display on the display device is more difficult to see than before, an image is displayed on the display device in a normal state. Second control means adapted to generate second control data for causing the display control means to perform processing to be displayed, and

The display control means that has received the first control data and the second control data can display an image based on the first control data and the second control data on the display device. Yes,

Computer.

2. The first control means determines that the number of blinks of the user is less than a predetermined reference when the detection means does not detect the blink of the user for a certain period of time. Has become,

A computer according to claim 1.

3. The first control means is configured such that when the detection means does not detect a blink of the user for a predetermined reference time, the number of blinks of the user is less than a predetermined reference. Is supposed to be judged,

A computer according to claim 1.

4. The first control means determines that the number of blinks of the user is predetermined when the number of blinks of the user detected by the detection means falls below a predetermined number of blinks per unit time. It is judged that it is less than the standard of

A computer according to claim 1.

5. When the display control means receives the first control data, a state in which at least a part of the image to be displayed on the display device is changed so as to lower the brightness than normal. To be displayed on the display device.

A computer according to claim 1.

6. When the display control unit receives the first control data, the display control unit changes the image to be displayed on the display device in a state where at least a part of the image is changed so as to increase the brightness than normal. Display on the display device,

A computer according to claim 1.

7. When the display control unit receives the first control data, the display control unit is configured to change an image to be displayed on the display device so that at least a part of the image is distorted in a normal image. It will be displayed on the display device in the

A computer according to claim 1.

8. When the display control unit receives the first control data, the display control unit changes the image to be displayed on the display device so that at least a part of the image is clouded with a normal image. To be displayed on the display device in a state where

A computer according to claim 1.

9. The display control means is configured to execute a process of increasing the degree of change between the time when the first control data is received and the time when the second control data is received. The computer according to any one of claims 5 to 8.

1 0. The display control means is configured to execute a process of gradually increasing the degree of change between the time when the first control data is received and the time when the second control data is received.

The computer according to claim 9.

1 1. The display control means executes a process of gradually increasing the degree of change between the time when the first control data is received and the time when the second control data is received.

The computer according to claim 9.

1 2. When the display control means receives the first control data, an image to be displayed on the display device is overlapped with a predetermined object for hiding the normal image on the normal image. Are supposed to be displayed as things,

A computer according to claim 1.

1 3. The display control means is adapted to display the object as moving on a normal image.

The computer according to claim 12.

14. The display control means is adapted to display the object on the normal image as at least one of its position, its size, and its shape changes.

The computer according to claim 13.

1 5. It is used in combination with an imaging device that captures a face image that is a moving image of a user's face and generates face image data that is the data of the face image, and a display device that displays the image. A computer-implemented method comprising: input means for receiving the face image data from the imaging device; display control means for controlling an image displayed on the display device; and control means for performing information processing. The control means is

A process of detecting a user's blink by performing image processing on the face image data received by the input means;

The user based on the user's blink detected in the process of detecting the user's blink When it is determined that the number of blinks is less than a predetermined reference, the image displayed on the display device at the time of normal operation is displayed on the display device so that it is more difficult to see than before. Generating first control data for causing the display control means to perform processing

When the first control data detects the blink of the user as a result of performing image processing on the face image data received by the input means when the display on the display device is more difficult to see. Generating second control data for causing the display control means to perform processing for displaying an image in a normal state on the display device;

Contains

The display control means that has received the first control data and the second control data enables the display device to display an image based on the first control data and the second control data.

Method.

1 6. It is used in combination with an imaging device that captures a face image that is a moving image of a user's face and generates face image data that is the data of the face image, and a display device that displays the image. An input unit that receives the face image data from the imaging device; a display control unit that controls an image displayed on the display device; and a control unit that performs information processing.

When it is determined that the number of blinks of the user is less than a predetermined reference based on the blink of the user detected in the process of detecting the blink of the user, Generating first control data for causing the display control means to perform a process of making the display device display the image that has been displayed more difficult to see than before;

When the first control data detects the blink of the user as a result of performing image processing on the face image data received by the input means when the display on the display device is more difficult to see. Normal image on the display device Generating second control data for causing the display control means to perform processing to be displayed in the state of:

By running

In order for the display control means that has received the first control data and the second control data to display an image based on the first control data and the second control data on the display device. of,

program.

1 7. A combination of a blink detection unit that detects blinks of a user and generates blink data, a unit that outputs the blink data, and a display unit that displays an image. A computer comprising: input means for receiving the blink data from the blink detection device; and display control means for controlling an image displayed on the display device,

When it is determined that the number of blinks of the user is less than a predetermined reference based on the blink of the user indicated by the blink data received by the input means, the display is displayed at a normal time until then. First control data for generating the first control data for causing the display control means to perform a process of making the display device display the image displayed on the device more difficult to see than before. And when the blink data is received via the input means when the display on the display device is more difficult to see than the first control data, an image is normally displayed on the display device. Second control means adapted to generate second control data for causing the display control means to perform processing to be displayed in the state of time, and

Computer. -

1 8. A combination of a blink detection means for detecting blinks of a user and generating blink data, a means for outputting the blink data, a blink detection apparatus having a display device, and a display apparatus for displaying an image Are used together, and the blink detection device detects the blink data from the blink detection device. A computer-implemented method comprising: input means for receiving data; display control means for controlling an image displayed on the display device; and control means for performing information processing,

The control means is

When it is determined that the number of blinks of the user is less than a predetermined reference based on the blink of the user indicated by the blink data received by the input means, the display is normally performed until then. Generating first control data for causing the display control means to perform processing for making the display device display an image that has been displayed on the device more difficult to see than before.

When the blink data is received via the input means when the display on the display device is more difficult to see than the first control data, an image is displayed on the display device in a normal state. Generating the second control data for causing the display control means to perform the process to be displayed in the step,

Contains

The display control means force that has received the first control data and the second control data, the first control data, and an image based on the second control data are displayed on the display device.

Method.

1 9. A combination of a blink detection means for detecting blinks of a user and generating blink data, a means for outputting the blink data, a blink detection apparatus having a display, and a display apparatus for displaying an image An input unit that receives the blink data from the blink detection device, a display control unit that controls an image displayed on the display device, and a control unit that performs information processing; In the control means of the computer equipped with

When it is determined that the number of blinks of the user is less than a predetermined reference based on the blink of the user indicated by the blink data received by the input means, the display is displayed at a normal time until then. Generating first control data for causing the display control means to perform processing for making the display device display an image that has been displayed on the device more difficult to see than before. When the blink data is received via the input means when the display of the display device is more difficult to see by the first control data, an image is displayed on the display device in a normal state. Generating a second control data for causing the display control means to perform the process of displaying in step (b),

The display control means that has received the first control data and the second control data causes the display device to display an image based on the first control data and the second control data. To be displayed,

program.

A blink detection device used in combination with the computer according to claim 17,

Blink detection means for detecting blinks of the user and generating blink data;

Means for outputting the blink data to the computer;

A blink detection device having

2 1. The blink detection means includes a detection unit capable of measuring a change in a predetermined physical quantity caused by the user performing blinks,

A fixing means capable of detachably fixing at least the detection part of the blink detection means to the glasses;

The blink detection device according to claim 20.

2 2. A computer used in combination with a display device for displaying an image, comprising a display control means for controlling an image displayed on the display device,

Blink detection means for detecting blinks of the user and generating blink data; and if the number of blinks of the user is less than a predetermined reference based on the blinks of the user indicated by the blink data. A first control for causing the display control means to perform a process of making the display device display an image that has been displayed on the display device at a normal time until it is harder to see than the previous state. A first control means configured to generate data, and when the blink data is first received after the first control data is generated, an image is displayed on the display device in a normal state. Second control means configured to generate second control data for causing the display control means to perform processing to be performed; output means for outputting the first control data and the second control data to the computer; In addition, it is used in combination with a blink detection device having

Comprising input means for receiving the first control data and the second control data from the blink detection device;

When the display control unit receives the first control data or the second control data, the display control unit can display an image based on the first control data or the second control data on the display device. Has been,

Computer.

2 3. A computer that is used in combination with a display device that displays an image, and that includes display control means for controlling an image displayed on the display device, and control means for executing information processing. ,

Blink detection means for detecting blinks of the user and generating blink data; and if the number of blinks of the user is less than a predetermined reference based on the blinks of the user indicated by the blink data. A first control for causing the display control means to perform a process of making the display device display an image that has been displayed on the display device at a normal time until it is harder to see than the previous state. A first control means configured to generate data, and when the blink data is first received after the first control data is generated, an image is displayed on the display device in a normal state. Second control means for generating second control data for causing the display control means to perform processing to output the first control data and the second control data to the computer. And a blink detection device having: a means for receiving the first control data from the blink detection device; and the second control data for the blink detection device. Means for receiving from the eye detection device, and a method to be executed,

The control means is

Receiving the first control data from the blink detection device via the means for receiving the first control data from the blink detection device; Receiving the second control data from the blink detection device through the means for receiving the second control data from the blink detection device;

A step of causing the display control means to display an image based on the first control data or the second control data on the display device when the first control data or the second control data is received;

Including methods.

2 4. A computer that is used in combination with a display device that displays an image, and includes a display control unit that controls an image displayed on the display device, and a control unit that executes information processing. ,

Blink detection means for detecting blinks of the user and generating blink data; and if the number of blinks of the user is less than a predetermined reference based on the blinks of the user indicated by the blink data. A first control for causing the display control means to perform a process of making the display device display an image that has been displayed on the display device at a normal time until it is harder to see than the previous state. A first control means configured to generate data, and when the blink data is first received after the first control data is generated, an image is displayed on the display device in a normal state. Second control means for generating second control data for causing the display control means to perform processing to output the first control data and the second control data to the computer. And a blink detection device having: a means for receiving the first control data from the blink detection device; and the second control data for the blink detection device. The control means is provided with means for receiving from the eye detection device,

Receiving the first control data from the blink detection device via the means for receiving the first control data from the blink detection device;

The process of receiving the second control data from the blink detection device through the means for receiving the second control data from the blink detection device,

A step of causing the display device to display an image based on the first control data or the second control data on the display device when the first control data or the second control data is received; A program for running

2 5. A blink detection device used in combination with the computer described in claim 2 2,

When it is determined that the number of blinks of the user is less than a predetermined standard based on the blink of the user indicated by the blink data, the image displayed on the display device at the normal time until then First control means for generating first control data for causing the display control means to perform a process of making the display device display the image on the display device more difficult to see than before.

Second control for causing the display control means to perform processing for displaying an image in a normal state on the display device when the blink data is first received after the generation of the first control data. Second control means adapted to generate data; output means for outputting the first control data and the second control data to the computer;

A blink detection device having

2 6. A display device for displaying an image, a display control means for controlling an image displayed on the display device,

Second control for causing the display control means to perform processing for displaying an image in a normal state on the display device when the blink data is first received after the generation of the first control data. A second control means adapted to generate data, and

The display control means includes the first control data from the first control means when the first control means generates the first control data, and the second control means to the second control data. 6 7

When the control data is generated, the second control data is received from the second control means, and when the first control data or the second control data is received, An image based on the first control data or the second control data can be displayed on the display device,

And the display device and the blink detection means are provided with a head mount means attached to a user's head,

Head mounted display.

2 7. A display device for displaying an image, a display control means for controlling an image displayed on the display device,

Control means for performing information processing;

The display device and the blink detection means are attached, and a head mount means attached to a user's head;

A method implemented by the control means of a head mounted display comprising:

A process of determining the force with which the number of blinks of the user is less than a predetermined standard based on the blink of the user indicated by the blink data;

When it is determined that the number of blinks of the user is less than a predetermined reference, the image displayed on the display device at the normal time is more difficult to see than the previous state and is displayed on the display device. Generating first control data for causing the display control means to perform a process of displaying;

Second control for causing the display control means to perform processing for displaying an image in a normal state on the display device when the blink data is first received after the generation of the first control data. The process of generating data,

Outputting the first control data to the display control means when the first control data is generated, and outputting the second control data to the display control means;

Contains

The display control means that has received the first control data or the second control data is configured to display an image based on the first control data or the second control data on the display. To be displayed on the device,

Method.

2 8. A display device for displaying an image, a display control means for controlling an image displayed on the display device,

When it is determined that the number of blinks of the user is less than a predetermined standard based on the blink of the user indicated by the blink data, the display is displayed on the display device at a normal time until then. First control means for generating first control data for causing the display control means to perform processing for making the display device display the image on the display device more difficult to see than the previous state;

The display control means generates the first control data from the first control means when the first control means generates the first control data, and the second control means generates the second control data. In this case, the second control data is received from the second control means, and when the first control data or the second control data is received, the first control data, Alternatively, an image based on the second control data can be displayed on the display device,

And the display device and the blink detection means are provided with fixing means attached to the glasses worn by the user.

Head mounted display.

2 9. A display device for displaying an image, a display control means for controlling an image displayed on the display device,

Control means for performing information processing;

The display device and the blink detection means are attached, and fixing means attached to glasses worn by a user; A method for controlling the head mount display comprising:

A process of determining the force that the number of blinks of the user is less than a predetermined standard based on the blink of the user indicated by the blink data,

When it is determined that the number of blinks of the user is less than a predetermined reference, it is difficult to see the image displayed on the display device at the normal time until then, and the display device is displayed on the display device. Generating first control data for causing the display control means to perform a process of displaying;

Contains

The display control means that has received the first control data or the second control data allows the display device to display an image based on the first control data or the second control data.

Method.

30. Detection means for detecting a blink of a user and generating blink data, a display for displaying an image, a display control means for controlling an image displayed on the display, and a control means for performing information processing And a display device comprising:

Input means for receiving the blink data from the detection means;

When it is determined that the number of blinks of the user is less than a predetermined reference based on the blink of the user indicated by the blink data received by the input means, the display is displayed at a normal time until then. First control means for generating first control data for causing the display control means to perform processing for making the display displayed on the display more difficult to see the image displayed on the display than before. When,

The first control data makes the display on the display more difficult to see. When the blink data is received via the input means when the display control device is configured, the display control means generates second control data for causing the display control means to perform processing for displaying an image in a normal state. A second control means adapted to: and

The display control means that receives the first control data and the second control data is configured to display an image based on the first control data and the second control data on the display.

Display device.

3 1. Detection means for detecting a blink of a user and generating blink data, a display for displaying an image, a display control means for controlling an image displayed on the display, and a device for performing information processing. A control means having input means for receiving the blink data from the detection means, and a method executed on a display comprising:

When it is determined that the number of blinks of the user is less than a predetermined reference based on the blink of the user indicated by the blink data received by the input means, the display is displayed at a normal time until then. Generating first control data for causing the display control means to perform processing for making the display displayed on the display more difficult to see the image displayed on the display than before.

A process for displaying an image on the display in a normal state when the blink data is received via the input means when the display of the display is more difficult to see than before according to the first control data. Generating second control data for causing the display control means to perform,

Contains

The display control means that has received the first control data and the second control data allows the display to display an image based on the first control data and the second control data.

Method.