JPH07288754A - Head mounted type display device - Google Patents

Abstract

PURPOSE:To enable a night-blind person to recognize his peripheral condition even in a dark place by constituting the device so that me can visually recognize the picture or a photographing means of high sensitivity, which is put on his head, by picture display. CONSTITUTION:This head mounted type display device (HMD) can be vertically turned around the position where a picture display part 2 is fixed to a supporting body part 4. When the picture display part 2 is turned to the front of eyes of the night-blind person, power supply to a camera part 1, the display part 2, and a control unit part 3 is turned on. The ambient illuminance is detected from the picture signal outputted from the camera part 1; and if it is lower than a prescribed threshold, this picture is displayed on the display part 2. When the detected illuminance is equal to or higher than the threshold, a message indicating this state is displayed on the display part 2. Then, he turns the display part 2 upward to confirm his peripheral condition with his naked eyes without putting off the HMD.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a head-mounted display device which is suitable for use when looking at things or enlarging a book in a dark environment.

[0002]

[Prior Art] Currently, only in Japan, people with night blindness
It is said that there are hundreds of thousands of people. A person with night blindness has a decreased visual function in a dark environment such as in the evening or later, and is in a situation where it is difficult to see things. That is, a person with night blindness is in a state close to a blind person in a dark environment, and is forced to use a white cane or the like, and his / her activity (activity) is restricted.

Therefore, in order for such a person with night blindness (hereinafter referred to as a night blindness patient) to be able to act relatively freely in a dark environment, for example, "science of vision", Ukai, Vol. 14, No. .4, 1993 and the like disclose a head-mounted display device (head-mounted display device) (hereinafter, appropriately referred to as HMD (Head Mounted Display)) incorporating a color video camera.

In this apparatus, a dark field of view (a subject in a dark environment) is photographed by a video camera, which is brightened and displayed on a screen fixed in front of the eyes.

[0005]

[Problems to be Solved by the Invention] However, the HMD
When shooting with a color video camera currently in practical use, which is of a scale that can be incorporated into, the illuminance of several lux (subject illuminance) is required for the subject (the minimum required for this subject). The illuminance (subject illuminance) that is performed is hereinafter referred to as the minimum illuminance of the subject).

[0006] On the other hand, it is generally said that a sighted person can confirm a subject if the illuminance is on the order of 0.1 lux. Therefore, patients with night blindness, even with the device described above, are
As with sighted people, it was difficult to act in the dark, such as walking at night.

[0007] Further, when a night blind person reads a book, for example, a so-called magnifying reader is used. In the magnifying reader, the book is magnified and displayed on the screen of, for example, a television receiver.

Therefore, a patient with night blindness must purchase an expanded reader for reading and, when the above-mentioned device is put into practical use, purchase the device for acting in the dark. And the financial burden becomes excessive.

The present invention has been made in view of such a situation, and makes it possible for a night blind person to act like a sighted person without incurring an excessive financial burden. .

[0010]

A head-mounted display device according to claim 1, which is a head-mounted display device mounted on a user's head, and which displays means for displaying an image (for example, ,
1), fixing means for fixing the display means in front of the user's eyes (for example, the support portion 4 shown in FIG. 1), and a height for photographing an image to be displayed on the display means. Sensitivity photographing means (for example, the camera unit 1 shown in FIG. 1)
And is provided.

The head-mounted display device according to claim 2 is
The photographing means is characterized by photographing the image displayed on the display means in black and white.

A head mounted display device according to a third aspect is
The photographing means is the fixing means, the display means, the part of the user's hand,
Alternatively, it is characterized in that it is detachably attached to a predetermined support.

The head-mounted display device according to claim 4 is
It is characterized in that the display means is rotatable about a portion fixed to the fixing means.

The head-mounted display device according to claim 5 is
When the display means is rotated and moved from the front of the user's eyes, at least the supply of power to the photographing means and the display means is stopped.

The head-mounted display device according to claim 6 is
When the illuminance detected by the detection unit (for example, the illuminance detection unit 35 shown in FIG. 5) that detects the ambient illuminance from the image signal output from the image capturing unit is equal to or greater than a predetermined threshold value Is further provided with a notifying means (for example, the voicing section 41 shown in FIG. 5) for notifying that effect.

A head mounted display device according to a seventh aspect is
It is characterized by further comprising setting means (for example, the image processing / control switch section 34 shown in FIG. 5) for setting a predetermined threshold value.

A head-mounted display device according to claim 8 is
A storage unit (for example, the primary memory 36 shown in FIG. 5) that stores the illuminance detected by the detection unit is further provided.
The predetermined threshold value is updated based on the illuminance stored in the storage means, which is detected by the detection means when the display means is rotated and moved from the front of the user.

The head mounted display device according to claim 9 is
The photographing means is characterized by having an adjusting means (for example, the diaphragm 11 shown in FIG. 5) for adjusting the amount of light incident on itself.

In the head-mounted display device according to the tenth aspect, the photographing means includes an adjusting means (for example, the diaphragm 11 shown in FIG. 5) for adjusting the amount of light incident on itself, and the detecting means. It is characterized by further including a control unit (for example, the camera control unit 33 shown in FIG. 5) for controlling the adjusting unit based on the illuminance detected by.

The head-mounted display device according to the eleventh aspect of the present invention is an image processing means (for example, the image processing shown in FIG. 5 which increases the brightness of the image signal output from the photographing means and supplies it to the display means. (Section 32 etc.) is further provided.

A head-mounted display device according to a twelfth aspect of the present invention is characterized by further comprising contour enhancing means for enhancing a contour in an image signal output from the photographing means.

A head-mounted display device according to a thirteenth aspect of the invention is further characterized by further comprising binarization means for binarizing the image signal output from the photographing means.

A head-mounted display device according to a fourteenth aspect is characterized in that the predetermined support has a light source.

In the head-mounted display device according to the fifteenth aspect, the predetermined support has a switch means for turning on / off the power source of the light source in response to attachment / detachment of the photographing means (for example, FIG. 7).
And a lid 64) shown in FIG.

In the head-mounted display device according to the sixteenth aspect, the predetermined support has a magnifying means (for example, the lens system 62 shown in FIG. 7) for magnifying an image photographed by the photographing means. Characterize.

A head-mounted display device according to a seventeenth aspect is characterized by further comprising output means (for example, an output terminal shown in FIG. 1) for outputting the image signal output from the photographing means to the outside. And

[0027]

In the head mounted display device according to the first aspect of the present invention, a high-sensitivity image pickup means is provided as an image pickup means for picking up an image displayed on the display means. Therefore, a subject with low illuminance can be photographed.

In the head-mounted display device according to the second aspect, as a photographing means for photographing an image displayed on the display means, a high-sensitivity one for photographing in black and white is provided. Therefore, the device can be constructed at low cost.

In the head-mounted display device according to a third aspect of the present invention, the photographing means is configured to be attachable to and detachable from the fixing means, the display means, the user's hand part, or a predetermined support. . Therefore, this device can be used as a so-called walking aid or the like when the photographing means is attached to, for example, the fixing means or the display means, and the photographing means is
For example, when it is attached to a user's fingertip or a hand portion such as the back of a hand, or a predetermined support, it can be used as a so-called reading magnifier.

In the head mounted display device according to the fourth aspect, the display means is rotatable about the portion fixed to the fixing means. Therefore, the display means
Since it can be moved from the front of the user's eyes, for example, in a bright place, the surroundings can be seen with the naked eyes while wearing the device.

In the head mounted display device according to the fifth aspect, when the display means is rotated and moved from the front of the user's eyes, at least the power supply to the photographing means and the display means is stopped. It Therefore, when, for example, a battery or a battery is used as the power source of the device, the consumption thereof can be reduced.

In the head-mounted display device according to the sixth aspect, the ambient illuminance is detected from the image signal output from the photographing means, and when the illuminance is equal to or higher than a predetermined threshold value, To that effect. Therefore, it is possible to inform the user that the surroundings are sufficiently bright.

In the head-mounted display device according to the seventh aspect, there is provided setting means for setting a predetermined threshold value. Therefore, the user can freely set the ambient brightness notified by the notification means.

In the head-mounted display device according to the eighth aspect, when the display means is rotated and moved in front of the user's eyes, a predetermined threshold value is determined based on the illuminance detected by the detection means. Will be updated. Therefore, the ambient brightness notified by the notification means can be set to an appropriate value for the user, for example.

In the head-mounted display device according to the ninth aspect, the amount of light incident on the photographing means can be adjusted, so that an image having the brightness desired by the user can be provided.

In the head mounted display device according to the tenth aspect, based on the illuminance detected by the detection means,
The adjusting means for adjusting the amount of light incident on the photographing means is controlled. Therefore, the user does not have to adjust the adjusting means, and it is possible to prevent the user from feeling annoyed.

In the head-mounted display device according to the eleventh aspect, the brightness of the image signal output from the photographing means is increased and supplied to the display means. Therefore, to the user,
A bright image can be provided.

In the head-mounted display device according to the twelfth aspect, the contour in the image signal output from the photographing means is emphasized. Therefore, for example, it is possible to provide an image in which the contour of an object having the same brightness is defined.

In the head-mounted display device according to the thirteenth aspect, the image signal output from the photographing means is binarized. Therefore, for example, it is possible to provide an image in which the contour of an object having the same brightness is defined.

In the head-mounted display device according to the fourteenth aspect, since the predetermined support has a light source, when the support is equipped with a photographing means, it is possible to provide a high-contrast image. You can

In the head-mounted display device according to the fifteenth aspect, the power source of the light source of the predetermined support is turned on / off in response to attachment / detachment of the photographing means. Therefore, when using a predetermined support, turn on / off the power of the light source.
Since no operation is required, it is possible to prevent the user from feeling annoyed. Furthermore, the power consumption can be reduced.

In the head mounted display device according to the sixteenth aspect, since the image taken by the image taking means is enlarged,
Enlarged images can be provided.

In the head mounted display device according to the seventeenth aspect, the image signal output from the photographing means is output to the outside. Therefore, the image signal can be displayed on a large monitor or the like for viewing.

[0044]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 shows the configuration of an embodiment of an HMD (head mounted display device) to which the present invention is applied. The support part 4 is adapted to be attached to the head of a user (night blindness patient), and the camera part 1 has an upper part of the support part 4 via the free platform 6 shown in FIG. It is fixed to (a portion which is above the user's head when the user wears the support portion 4). The camera platform 1 can be moved up, down, left and right by the free pan head 6, so that the shooting (imaging) direction of the camera unit 1 can be adjusted. In this way, in the support body portion 4,
When the camera unit 1 is fixed, the weight of the device is balanced when the user wears the device, and the wearing feeling can be improved.

The camera unit 1 includes an image pickup system (for example, a lens system or a CCD (Ch
arge Coupled Device) etc.) and the like. Then, the subject is photographed in black and white according to the angle of view (field of view) of a human (user), and the monochrome image signal of the photographed subject is output to the control unit section 3 via a cable. There is.

Here, a small one of the image pickup systems of the high-sensitivity monochrome video cameras currently on the market is capable of photographing an object with an illuminance on the order of 0.1 lux. It is almost the same as the minimum illuminance of the subject. Therefore, by configuring the camera unit 1 with such an imaging system for a high-sensitivity black-and-white video camera, it is possible to photograph a subject with an illuminance that can be recognized by a sighted person. That is,
According to the camera unit 1, it is possible to photograph an object that is almost the same as a person who can see (recognize) a sighted person. Further, in this case, since the camera unit 1 is configured by a commercially available image pickup system, the cost of the device can be reduced.

If the camera unit 1 is a small-sized color imaging system in the future and the sensitivity of the camera unit 1 is similar to that of the above-described monochrome video camera, it may be used.

Further, the camera section 1 is not the support section 4 but the image display section 2 (for example, P of the image display section 2 in the figure).
It is also possible to fix (attach) to the part indicated by. That is, the camera unit 1 is configured to be removable.
When the camera unit 1 is fixed to the image display unit 2, the camera unit 1 comes to be located at approximately the midpoint of both eyes of the user, so that the work line (when the user actually works) The orientation of the user's body) and the line of sight thereof can be substantially matched. As a result, the angle and position of the subject photographed by the camera unit 1 become substantially the same as when actually viewed with the naked eye, and the work efficiency can be improved.

The control unit section 3 includes the camera section 1
The image signal output from the image display unit 2 is supplied to the image display unit 2 with its brightness increased. In the image display section 2, the image is taken by the camera section 1, and the control unit section 3
Thus, an image whose brightness is increased is displayed.

The HMD constructed as described above is used as a walking aid for a user with night blindness, as shown in FIG. 3, for example. That is, a night-blind patient wears the support portion 4 on his / her head and attaches the control unit section 3 to his / her lumbar region (for example, when the night-blind patient has a belt, the belt portion). Mounting. The high-sensitivity camera unit 1 captures an image of the surrounding environment, and outputs a black and white image signal, which is the image capture result, to the control unit unit 3. In the control unit section 3, the brightness of the image signal from the camera section 1 is increased and output to the image display section 2. The image display unit 2 displays an image with high brightness.

Therefore, the night blindness patient, who is the user, can see the image displayed on the image display unit 2 even in a dark place, and can grasp the surrounding condition like a sighted person. As a result, night blind patients can behave in the dark as if they were sighted.

In addition, even when a night blind person wears an HMD and goes out, in order to confirm the feet, etc.,
Since a white cane is required as in the conventional case, it is desirable to avoid operating a device by a night blind patient who holds the cane in his hand and operates. Therefore, the diaphragm of the camera unit 1 is an automatic diaphragm as shown in FIG. 2 (auto iris is used) so that it is not necessary for the night blind patient to adjust each time the ambient brightness changes. Details will be described later).

By the way, even in the evening or night, a place illuminated by, for example, an outside light may be bright as in the daytime. In such a place, the night-blind patient may be able to fully recognize the situation by not looking at the image displayed on the image display unit 2 of the HMD but looking around with the naked eye. Further, there are cases where the night blindness patient himself desires to see the surroundings with the naked eye instead of seeing the image displayed on the image display unit 2 of the HMD.

Therefore, in this HMD, as shown in FIG. 4 (b), the image display section 2 is adapted to rotate upward around the portion fixed to the support section 4.
As a result, the night blind patient can confirm the surroundings with the naked eye without removing the HMD that he is wearing.

Further, when the image display unit 2 is moved upward from the eyes of the night blind patient in this way, the night blind patient should see the image displayed on the image display unit 2. Therefore, in this case, it is not necessary to display an image on the image display unit 2, and further, it is not necessary to photograph a subject with the camera unit 1. That is, it is not necessary to operate the HMD.

Therefore, in this HMD, when the image display section 2 is rotated upward as shown in FIG. 4B, the camera section 1, the display section 2 and the control unit section 3 (however, H of the control unit section 3
The power supply to the MD, which controls ON / OFF of the power supply of the MD (excluding the image processing unit 32 of FIG. 5 described later, etc.)
It is set to F (stopped). Then, when the image display unit 2 is rotated downward from the state shown in FIG. 4B and moved to the front of the night blind patient, power is supplied to the camera unit 1, the display unit 2, and the control unit unit 3. Is turned on (started).

Therefore, when the HMD is designed to operate using, for example, a battery or a battery as a power source, it is possible to prevent the HMD from being wasted.

By the way, as described above, it is forcing the night blind patient to operate the night blind patient by raising and lowering the image display unit 2 and confirming whether or not the subject can be recognized by the naked eye. It is not preferable.

Therefore, in this HMD, the ambient illuminance is detected from the image signal output from the camera unit 1, and this illuminance is determined by a predetermined threshold value (a night blindness patient does not use the HMD). If the illuminance is equal to or higher than the illuminance that can be recognized, a message expressing that effect is displayed on the image display unit 2 or is output as a voice as described below, which allows a night blind patient to see with naked eyes. It is designed to let you know that you can recognize your surroundings.

Therefore, in this case, the night-blind patient can recognize whether he can see the surroundings with the naked eye without operating the image display unit 2.

Next, FIG. 5 shows a detailed structure of the HMD shown in FIG. The camera unit 1 includes a diaphragm unit 11, a lens system 12, and a CCD 13. Aperture part 1
The control unit 1 is controlled by a camera control unit 33, which will be described later, of the control unit unit 3 to adjust the amount of light incident on the camera unit 1. The lens system 12 is
Light incident through the diaphragm 11 is focused on the CCD 13. The CCD 13 is the lens system 12
The light imaged by is photoelectrically converted, and a black and white image signal which is an electric signal obtained as a result is output to the image input unit 31.

The control unit section 3 includes an image input section 31, an image processing section 32, a camera control section 33, an image processing / control switch section 34, an illuminance detecting section 35, a primary memory 36, a secondary memory 37, and an illuminance calculating section. 38, an image output unit 39, a warning unit 40, a vocalization unit 41, and a power supply unit 51.

The image input section 31 is an interface between the CCD 13 and the image processing section 32, and supplies the image signal from the CCD 13 to the image processing section 32.
The image processing unit 32 receives the CCD 13 via the image input unit 31.
The image signal supplied from the device is subjected to a predetermined process such as increasing its brightness, and is output to the image output unit 39. Further, the image processing unit 32 outputs the input image signal to the illuminance detection unit 35 to detect the illuminance of the subject corresponding to the image signal. Then, the camera control unit 33 is controlled based on the illuminance.

Further, the image processing section 32 includes an illuminance detecting section 35.
It is determined whether or not the illuminance detected by the image processing / control switch unit 34 or the illuminance calculation unit 38 is equal to or more than the predetermined threshold value stored as described below, and the illuminance detection unit 35 determines. If the detected illuminance is greater than or equal to a predetermined threshold value, a message expressing that effect is displayed by the warning unit 4
It is designed to output to 0.

Further, the image processing section 32 includes the image display section 2
On the basis of a control signal from the switch unit 23 constituting the image display unit 2 that detects that the image has been rotated as shown in FIG. 4A or FIG. 4B.
From the power supply to each block that makes up the HMD
It is designed to control N / OFF.

The camera control unit 33 is controlled by the image processing unit 32 and controls the diaphragm unit 11 so that the amount of light incident on the lens system 12 becomes a predetermined constant amount (amount within a predetermined range).
Is designed to be adjusted. The image processing / control switch unit 34 is operated when setting the above-mentioned predetermined threshold value, and the set predetermined threshold value is stored in a memory (not shown) built in the image processing / control switch unit 34. Has been done.

The illuminance detection unit 35 detects the illuminance of the subject currently photographed by the camera unit 1 from the image signal (for example, its size) supplied from the image processing unit 32,
The data is output to the image processing unit 32 and the primary memory 36. The primary memory 36 sequentially stores the illuminance of the subject photographed by the camera 1 detected by the illuminance detection unit 35, and a predetermined one of them (details will be described later).
Is output to the secondary memory 37. The secondary memory 37 stores the illuminance output from the primary memory 36.

The illuminance calculation unit 38 calculates (estimates) the above-mentioned predetermined threshold value from the illuminance stored in the secondary memory 36 according to a predetermined method, and stores it in a built-in memory (not shown). ing.

The image output unit 39 is an interface between the image processing unit 32 or the warning unit 40 and the LDC display unit 21 of the image display unit 2, and the image processing unit 32 or the warning unit 4 is provided.
The image signal from 0 is output to the LCD display unit 21. The warning unit 40 outputs a message that is supplied from the image processing unit 32 and indicates that the illuminance detected by the illuminance detection unit 35, that is, the illuminance of the subject imaged by the camera unit 1 is equal to or greater than a predetermined threshold value. , An image signal or an audio signal, and the image output unit 39 or the voicing unit 41.
It is designed to output to each. Vocal section 41
Is, for example, a speaker, from which the warning unit 40
It is designed to output a voice signal from.

The power supply unit 51 is composed of, for example, a battery or a battery, and supplies power to each block constituting the HMD.

The image display section 2 is composed of an LCD display section 21 and a switch section 23. LCD display unit 21
Is composed of an LCD 22L and an LCD 22R, and an image signal supplied from the image processing section 40 or the warning section 40 via the image output section 39 is displayed on each of them. The switch unit 23 detects that the image display unit 2 has been rotated, and as a result, whether the image display unit 2 is in the state shown in FIG. 4A or FIG. The indicated control signal is output to the image processing section 32 of the control unit section 3.

Next, the operation will be described. When the image display unit 2 is lowered from the state shown in FIG. 4B so as to be positioned in front of the eyes of the patient with night blindness as shown in FIG. 4A, the image is displayed from the switch unit 23. Processing unit 3
A control signal is output to 2 (hereinafter, in this case, the control signal output from the switch unit 23 is referred to as a power ON control signal).

Upon receiving the power-on control signal from the switch unit 23, the image processing unit 32 controls each block of the apparatus so that the power source unit 51 supplies the power.

After that, photographing of the object by the camera unit 1 is started, and a black and white image signal obtained as a result is output to the image processing unit 32 via the image input unit 31. In the image processing unit 32, the brightness of the image signal from the camera unit 1 is increased, and is output to the LCDs 22L and 22R of the LDC display unit 21 via the image output unit 39 to be displayed.

Here, the image processing unit 32 increases the brightness of the image signal, and when the user sees the image displayed by the LCDs 22L and 22R and actually sees the subject corresponding to the image, the user Image processing is performed so that the (night blindness patient) recognizes the sense of distance to the subject. The sense of distance can be adjusted by the optical system (lens system 12) in the camera unit 1.

Further, in the image processing section 32, the image signal from the camera section 1 is binarized, the edge is emphasized, etc., and the processed image signal is processed through the image output section 39 for easy identification. It is also possible to output and display on the LCDs 22L and 22R. For example, a subject in which a plurality of objects of similar brightness (illuminance) are adjacent to each other, a subject in which the brightness (illuminance) is gradually changing, or the brightness (illuminance) of any of a plurality of objects
However, in an image obtained by photographing a very bright subject or the like as compared to other objects, the contour of the object may be difficult to identify. In such a case, the image signal from the camera unit 1 is Quantize and emphasize contours, and use this for LCD 22L and 22
By displaying it on R, the displayed image is
The outline of the object is simplified, so to speak, so that the object can be accurately recognized.

However, the threshold (brightness level for dividing the image signal into H level and L level) when the image signal is binarized, for example, is set to a low value when recognizing the contour of an object having low illuminance. Also, when trying to recognize the contour of an object with high illuminance, it is necessary to set a high value. It is possible to switch the level of the threshold value by operating a predetermined operation unit (not shown), for example. Further, in this case, not only two types of threshold values, a high value and a low value, but also three or more types including an intermediate value thereof can be provided.

The contour enhancement can be performed as follows, for example. That is, each pixel forming one screen of the image signal from the camera unit 1 is compared with a pixel in the vicinity of the pixel (hereinafter, referred to as a neighboring pixel), and based on the difference in brightness (or change rate), Detect image contours. Then, the brightness of the pixels (including the vicinity) of the contour portion is made extremely high or low, for example, and the enhancement is performed.

Even if the night blind person who is the user sees the images displayed on the LCDs 22L and 22R as described above, even if he / she goes out in the evening or at night, for example, the movements of the people around or the presence / absence of an intersection, It is possible to recognize (understand) the state of medium and long distance environment, such as how the road is curved, which cannot be obtained by a white cane. Further, even if the illumination is insufficient in the room, it is possible to recognize an object and perform a predetermined work. That is, it is possible to act like a sighted person.

Next, in the image processing section 32, the brightness of the image signal from the camera section 1 is increased or binarized, and the image signal is output to the image output section 39 and is also supplied to the illuminance detection section 35 as it is. To be done. In the illuminance detection unit 35, the camera unit 1
The illuminance of the subject photographed by the camera unit 1 is detected (calculated) from the image signal from and is output to the image processing unit 32.

The illuminance detected by the illuminance detecting section 35 is output not only to the image processing section 32 but also to the primary memory 35. In the primary memory 35, the illuminance detecting section 35 outputs the illuminance. The output illuminance is sequentially stored (details will be described later).

The image processing section 32 controls the camera control section 33 based on the illuminance from the illuminance detecting section 35. The camera control unit 33 controls the diaphragm unit 11 under the control of the image processing unit 32, so that the amount of light incident from the diaphragm unit 11 to the CCD 13 via the lens system 12 is limited to a predetermined amount. To be done.

Further, in the image processing section 32, the illuminance from the illuminance detecting section 35 is compared with the predetermined threshold value stored in the image processing / control switch section 34.

Here, the image processing / control switch unit 34 is operated in advance, and as a predetermined threshold value, the illuminance (for example, the illuminance that allows the night blind patient to recognize the object without using the HMD). 10 lux, etc.) is set and stored.

The illuminance from the illuminance detector 35 is used for image processing.
When it is equal to or higher than the predetermined threshold value stored in the control switch unit 34, the image processing unit 32 expresses that the ambient illuminance is such that the night blindness patient can recognize the object without using the HMD. Message is generated and output to the warning unit 40. In the warning unit 40, the image processing unit 32
Is converted into an image signal, and the image output unit 3
It is output to and displayed on the LCDs 22L and 22R via 9 (this display image is hereinafter referred to as a warning image).

The warning section 40 can convert the message from the image processing section 32 into an audio signal instead of an image signal. In this case,
The voice signal is supplied to the voice producing unit 41 and is output (this output voice is hereinafter referred to as a warning voice).

By outputting the warning image or the warning sound as described above, the night-blind patient can know that the illuminance is such that the surroundings can be grasped with the naked eyes.

When the night-blind patient recognizes that the illuminance is such that the surroundings can be grasped with the naked eyes, the image display unit 2 is displayed so that the surroundings can be seen with the naked eyes.
The state shown in FIG. 4A is changed to the raised state as shown in FIG. In this case, the switch unit 23 detects that the image display unit 2 has been rotated upward and outputs a control signal to the image processing unit 32 (hereinafter, in this case, the control signal output from the switch unit 23). Is referred to as a power OFF control signal).

Upon receiving the power-off control signal from the switch unit 23, the image processing unit 32 controls the power supply unit 51 to turn off the power supply to each block of the apparatus.

By the way, the degree of night blindness in patients with night blindness is
It varies from person to person, so even if a night blind person can perceive the surroundings with the naked eye, in the environment of that brightness, other night blind patients can perceive the surroundings with the naked eye. Not always possible. Moreover, it is difficult for the night blind person who is the user of this device to recognize in advance the brightness with which the surroundings can be recognized by the naked eye.

Therefore, the above-mentioned predetermined threshold value, which is the ambient illuminance when the warning image or the warning sound is output,
Even if the value is set and stored in the image processing / control switch unit 34, it is considered that the value is not suitable or not suitable for the night blindness patient who is the user of this apparatus.

Therefore, in this apparatus, the image display unit 2 is rotated upward as shown in FIG. 4B by the user who is a night blindness patient, and the state is kept for a predetermined time (for example, 5). If it continues (for seconds, etc.), it is determined that the night blind person has started to look around with the naked eye (the night blind person,
It is judged that it is not necessary to use the device and that it is preferable to use the naked eye), and the warning image or the warning sound is output based on the ambient illuminance when the image display unit 2 is rotated upward. The predetermined threshold value of can be updated.

That is, when the image display section 2 is rotated upward as shown in FIG. 4B, the switch section 23 outputs a power OFF control signal to the image processing section 32.

In this case, even if the image processing unit 32 receives the power-off control signal, the power supply of the power supply unit 51 is not immediately stopped, but the image display unit 2 is turned on. After the state of being rotated to the predetermined time continues for a predetermined time, that is, after the power OFF control signal is continuously received for a predetermined time from the switch unit 23, after the processing described below is completed, The power supply by the power supply unit 51 is controlled to be stopped.

Therefore, in this case, in the image processing unit 32,
Even if the power-off control signal is received, the power supply to each block is not immediately stopped, and therefore the image signal supplied from the camera unit 1 via the image input unit 31 is
It is directly output to the illuminance detection unit 35. Illuminance detector 35
Then, as described above, the ambient illuminance is sequentially detected from the image signals sequentially output from the image processing unit 32, and the result is output to the primary memory 36. In the primary memory 36, the illuminance output from the illuminance detection unit 35 is sequentially stored.

Here, the primary memory 36 includes the illuminance detecting section 3
It is composed of a ring buffer or the like having a storage capacity capable of storing the illuminance output by 5 for a predetermined time, for example. Therefore, in the primary memory 36, the illuminance output from the illuminance detection unit 35 is stored during a time that is a predetermined time before the current time.

When a predetermined time elapses after the image display unit 2 is turned up, the illuminance output from the illuminance detection unit 35 stored in the primary memory 36 a predetermined time before the current time. That is, the ambient illuminance when the image display unit 2 is rotated upward is read out, output to the secondary memory 37 and stored.

In the secondary memory 37, as described above,
The illuminance output in the past from the primary memory 36 (hereinafter referred to as the past illuminance) is stored. Then, in the illuminance calculation unit 38, when the ambient illuminance is newly stored in the secondary memory 37, for example, an average value of the illuminance and all the past illuminances is calculated. It is stored in the built-in memory.

Therefore, in this case, the predetermined threshold value can be precisely adapted to the night blind patient who is the user of the device.

In the above-mentioned case, the illuminance calculation unit 38 and the ambient illuminance newly stored in the secondary memory 37 (hereinafter referred to as new illuminance) are the same as the secondary memory 37.
Although the average value with all the past illuminances stored in is calculated and set as the predetermined threshold value, the present invention is not limited to this.

That is, the median of all the new illuminance and the past illuminance (median) (the value of the center (middle) when all the new illuminance and the past illuminance are arranged in order of size), The most frequent value (mode) (the most appearing value of all new illuminance and past illuminance) and the like can be obtained and used as a predetermined threshold.

Further, in addition to the statistical variables such as the average value, the median value, and the mode value, all the new illuminance and the past illuminance are processed by using, for example, a fuzzy theory or a neural network, and the result is obtained. It is also possible to set the value to be a predetermined threshold value.

By the way, in patients with night blindness, for example, people with retinitis pigmentosa, not only visual acuity in a dark place but also narrowing of the visual field and visual acuity in a relatively bright place are seen. Therefore, it is difficult for such a night-blind patient to read a newspaper or magazine without using a magnifying reader to magnify and display the newspaper or magazine on a monitor when reading.

Therefore, a patient with night blindness must purchase an expanded reader for reading and further purchase a device as a walking aid as described above in order to go out in the evening or at night. , Its financial burden becomes excessive.

Therefore, the HMD shown in FIG. 1 (FIG. 5) is
In addition to walking aids, it can also be used as an enlarged reader. That is, as described with reference to FIG. 1, the camera unit 1 fixed to the support member 4 (or, as described above, when the camera unit 1 is fixed to the image display unit 2, the image display unit The camera unit 1) fixed to 2 can be detached from the support unit 4 (it is configured to be removable).

The camera unit 1 removed from the support member 4 can be attached to a fingertip support or the like of the finger of a patient with night blindness who is the user of the apparatus, as shown in FIG. 6, for example. It is designed so that it can be attached to and detached from a finger of a night blind person.

The image processing unit 32 shown in FIG. 5 not only raises the brightness of the image from the camera unit 1 but also enlarges the image from the camera unit 1 and the LCD 22 via the image output unit 39.
L and 22R can be output and displayed.

Therefore, the camera section 1 is removed from the support section 4 and fixed to the fingertip (attached to the fingertip support (FIG. 6)).
The magnified image is displayed on the image display unit 2 by directing the camera unit 1 fixed to the fingertip toward a printed character such as a newspaper or a magazine. That is, the device operates as a magnifying reader. Therefore, by purchasing this device, a night-blind patient does not have to purchase the device as the walking aid and the expansion reading device, which can reduce the economic burden on the night-blind patient.

The camera section 1 can be attached to the back of the hand of a patient with night blindness by using other supports in addition to the fingertips.

Next, the camera section 1 removed from the support section 4
In addition to being mounted on the fingertip support (FIG. 6), it can also be mounted on the scanner mount 61 as shown in FIG. 7 (removably configured).
Inside this pedestal 61, a lens system 62 and an illumination 63 are provided.
Is provided. Further, a lid 64 is provided on a portion of the gantry 61 on which the camera unit 1 is mounted.
As shown in FIG. 7, the camera is rotated by mounting the camera unit 1 on the mount 61. When the camera unit 1 is removed from the gantry 61, the lid 64 is rotated upward so as to form the bottom surface of the gantry 61 by an elastic body such as a leaf spring or a spring (not shown). Has been done.

When the camera unit 1 is mounted on the frame 61, it is used as an enlarged reader as shown in FIG. 8, for example. That is, the one of the gantry 61 facing the one on which the camera unit 1 is mounted is placed on a book such as a newspaper or a magazine. Then, in the camera unit 1, via the lens system 62,
The printed characters on the book on which the frame 61 is placed are photographed. Since the printed characters (including photographs and drawings) on the book are magnified by the lens system 62, the magnified image of the printed characters is output to the image display section 2 via the control unit section 3 and displayed. . Therefore, also in this case, the device can be used as a magnifying reader, and the economic burden on the night blinded patient can be reduced.

The illumination 6 provided inside the pedestal 61
By turning on 3 and allowing the camera unit 1 to take a picture, the contrast of the printed image (contrast ratio)
Can be increased, and an image that is easier for the night blind patient to see can be provided.

As described above, according to this apparatus, it is possible to provide an enlarged print type without using a large monitor or the like unlike the conventional enlargement reader. That is, it is possible to provide a magnifying reader which is small and has excellent portability.

In this case, since the characters are enlarged by the lens system 62 and photographed by the camera unit 1, the image processing unit 32 displays the image as it is without enlarging the image from the camera unit 1. It can be output to the section 2.

The power supply to the illumination 63 is performed by the pedestal 6
1, a power source may be provided and the power source may be used. Alternatively, the control unit 3 (FIG. 5) and the pedestal 6 may be used.
1 may be connected by a cable or the like, and may be performed by the power supply section 51 of the control unit section 3. Further, the lighting 63 is turned on / off by, for example, the pedestal 6
1 may be provided with a power switch, or it may be controlled by the control box unit 3. Further, the illumination 63 can be turned on / off by using the lid 64 as a power switch, for example. That is, the illumination 63 can be turned on only when the camera unit 1 is mounted on the pedestal 61 and the lid 64 is rotated downward as shown in FIG.

Further, in the pedestal 61, ambient light (for example, sunlight or light of indoor fluorescent lamps) is used instead of the illumination 63.
May be provided with, for example, a hole or the like for entering the inside.

The camera unit 1 mounted on the pedestal 61 or the lens system 62 provided on the pedestal 61 can be moved in the vertical direction in FIG. In this case, the distance from the camera unit 1 to the lens system 61 can be changed, and therefore, the enlargement ratio of the print type image of the book photographed by the camera unit 1 can be set to a value desired by the night blind patient who is the user. You can

Furthermore, the portion of the pedestal 61 that contacts the book (the lower portion of the pedestal 61) may be made of a material having a small friction coefficient. In this case, stand 6
Since a large frictional force is not generated between 1 and the book, the frame 61 placed on the book can be easily moved.

Further, a mechanism for moving the gantry 61 in a predetermined fixed direction (for example,
Tires, etc.) can be provided. Also in this case, the stand 61 placed on the book can be easily moved.

Further, when the device is used as a magnifying reader, it is expected that the device is often used indoors. Therefore, the device is powered by the power supply unit 51 shown in FIG. It is possible to take it from an outlet (AC100V) in the.

In this embodiment, the image processing unit 32
Although the processing for increasing the brightness of the image signal from the camera unit 1 is performed, if the brightness of the image signal is sufficient,
This process may not be performed.

Further, since some night blind patients can use only one eye for observation, when such a night blind patient uses the device, LCDs 22L and 22L are used.
It is possible to provide only the necessary one of the two, not both of R, in the device. In this case, the weight and cost of the device can be reduced.

In this embodiment, the image taken by the camera section 1 is output to the image display section 2 for display. However, as shown in FIG. 1, for example, as shown in FIG. An output terminal 5 may be provided, and an image taken by the camera unit 1 may be output from the output terminal 5. In this case, the image output from the image output terminal 5 is
For example, by displaying on a television receiver or the like having a normal size, the night blind patient can see the image from the camera unit 1 without wearing the device on his / her head.

[0124]

According to the head-mounted display device of the first aspect, the high-sensitivity photographing means is provided as the photographing means for photographing the image displayed on the display means. Therefore, a subject with low illuminance can be photographed.

According to the head-mounted display device of the second aspect, the high-sensitivity one for photographing in black and white is provided as the photographing means for photographing the image displayed on the display means. Therefore, the device can be constructed at low cost.

According to the head-mounted display device of the third aspect, the photographing means is configured to be attachable to and detachable from the fixing means, the display means, the part of the user's hand, or a predetermined support. There is. Therefore, this device can be used as a so-called walking aid or the like when the photographing means is attached to, for example, the fixing means or the display means, and the photographing means is used, for example, the user's fingertip or a predetermined support. When attached to
It can be used as a so-called reading magnifier.

According to the head mounted display device of the fourth aspect, the display means is rotatable about the portion fixed to the fixing means. Therefore, the display means can be moved from the front of the eyes of the user, so that, for example, in a bright place, the surroundings can be seen with the naked eyes while the device is worn.

According to the head mounted display device of the fifth aspect, when the display means is rotated and moved in front of the user's eyes, at least the supply of power to the photographing means and the display means is stopped. To be done. Therefore, when, for example, a battery or a battery is used as the power source of the device, the consumption thereof can be reduced.

According to the head-mounted display device of the sixth aspect, the ambient illuminance is detected from the image signal output from the photographing means, and when the illuminance is equal to or more than a predetermined threshold value, The fact is notified. Therefore, it is possible to inform the user that the surroundings are sufficiently bright.

According to the head-mounted display device of the seventh aspect, the setting means for setting a predetermined threshold value is provided. Therefore, the user can freely set the ambient brightness notified by the notification means.

According to the head-mounted display device of the eighth aspect, when the display means is rotated and moved in front of the user's eyes, a predetermined value is determined based on the illuminance detected by the detection means. The threshold is updated. Therefore, the ambient brightness notified by the notification means can be set to an appropriate value for the user, for example.

According to the head-mounted display device of the ninth aspect, the amount of light incident on the photographing means can be adjusted, so that an image having the brightness desired by the user can be provided. .

According to the head mounted display device of the tenth aspect, the adjusting means for controlling the amount of light incident on the photographing means is controlled based on the illuminance detected by the detecting means. Therefore, the user does not have to adjust the adjusting means, and it is possible to prevent the user from feeling annoyed.

According to the head-mounted display device of the eleventh aspect, the brightness of the image signal output from the photographing means is increased and supplied to the display means. Therefore, a bright image can be provided to the user.

According to the head-mounted display device of the twelfth aspect, the contour in the image signal output from the photographing means is emphasized. Therefore, for example, it is possible to provide an image in which the contour of an object having the same brightness is defined.

According to the head mounted display device of the thirteenth aspect, the image signal output from the photographing means is binarized. Therefore, for example, it is possible to provide an image in which the contour of an object having the same brightness is defined.

According to the head mounted display device of the fourteenth aspect, since the predetermined support has the light source, when the image pickup means is attached to the support, a high-contrast image is provided. be able to.

According to the head-mounted display device of the fifteenth aspect, the power source of the light source of the predetermined support is turned on / off in response to attachment / detachment of the photographing means. Therefore, when the predetermined support is used, it is not necessary to turn on / off the power source of the light source, and it is possible to prevent the user from feeling annoyed. Furthermore, the power consumption can be reduced.

According to the head-mounted display device of the sixteenth aspect, the image captured by the image capturing means is enlarged, so that the enlarged image can be provided.

According to the head-mounted display device of the seventeenth aspect, the image signal output from the photographing means is output to the outside. Therefore, the image signal can be displayed on a large monitor or the like for viewing.

[Brief description of drawings]

FIG. 1 is a diagram showing a configuration of an embodiment of a head mounted display device to which the present invention is applied.

FIG. 2 is a diagram showing a state in which a camera unit 1 is fixed to a free cloud No. 6;

FIG. 3 is a diagram showing a use state in which the head-mounted display device of FIG. 1 is used as a walking aid.

FIG. 4 is a diagram showing how the image display unit 2 rotates.

5 is a block diagram showing a detailed configuration of the embodiment of FIG.

FIG. 6 is a diagram showing how the camera unit 1 is mounted on a fingertip support.

FIG. 7 is a diagram showing a state in which the camera unit 1 is mounted on a frame 61.

FIG. 8 is a diagram showing a usage state in which the head-mounted display device of FIG. 1 is used as an enlarged reader.

[Explanation of symbols]

 1 camera section 2 image display section 3 control unit section 4 support section 5 image output terminal 6 free pan head 11 diaphragm section 12 lens system 13 CCD 21 LCD display section 22L, 22R LCD 23 switch section 31 image input section 32 image processing section 33 camera control unit 34 image processing / control switch unit 35 illuminance detection unit 36 primary memory 37 secondary memory 38 illuminance calculation unit 39 image output unit 40 warning unit 41 voicing unit 51 power supply unit 61 scanner mount 62 lens system 63 illumination 64 lid

Claims (17)

[Claims] 1. A head mounted display device mounted on a head of a user, comprising: a display unit for displaying an image; a fixing unit for fixing the display unit in front of the user's eyes; A head-mounted display device, comprising: a high-sensitivity photographing means for photographing an image to be displayed on the display means. 2. The image capturing unit captures an image displayed on the display unit in black and white.
The head-mounted display device described in. 3. The image pickup means is configured to be attachable / detachable to / from the fixing means, the display means, the part of the user's hand, or a predetermined support. The head-mounted display device described. 4. The head mounted display device according to claim 1, wherein the display means is rotatable about a portion fixed to the fixing means. . 5. The power supply to at least the photographing means and the display means is stopped when the display means is rotated and moved from the front of the user's eyes. Head mounted display device. 6. A detection means for detecting ambient illuminance from an image signal output from the photographing means, and when the illuminance detected by the detection means is equal to or more than a predetermined threshold value, a notification to that effect is given. 6. The head mounted display device according to claim 1, further comprising: 7. The head mounted display device according to claim 6, further comprising setting means for setting the predetermined threshold value. 8. A detector that detects ambient illuminance from an image signal output from the imager, and if the illuminance detected by the detector is equal to or greater than a predetermined threshold, the fact is notified. Further comprising a notification means for storing the illuminance detected by the detection means, and the illuminance stored in the storage means, the display means is rotated and moved from in front of the user's eyes. The head-mounted display device according to claim 4 or 5, wherein the predetermined threshold value is updated based on what is detected by the detection means at the time. 9. The photographing means has an adjusting means for adjusting the amount of light incident on the photographing means.
9. The head-mounted display device according to any one of 8 to 8. 10. The photographing means includes adjusting means for adjusting the amount of light incident on itself, and further comprises control means for controlling the adjusting means based on the illuminance detected by the detecting means. The head mounted display device according to claim 6, wherein the head mounted display device is provided. 11. The head according to claim 1, further comprising image processing means for increasing the brightness of an image signal output from the photographing means and supplying it to the display means. Part-mounted display device. 12. The head-mounted display device according to claim 1, further comprising a contour enhancement unit that enhances a contour in the image signal output from the image capturing unit. 13. The head-mounted display device according to claim 1, further comprising a binarizing unit that binarizes an image signal output from the photographing unit. 14. The head mounted display device according to claim 3, wherein the predetermined support has a light source. 15. The predetermined support further comprises switch means for turning on / off the power source of the light source in response to attachment / detachment of the photographing means.
The head-mounted display device described in. 16. The head-mounted display device according to claim 3, 14 or 15, wherein the predetermined support includes an enlargement unit that enlarges an image captured by the image capturing unit. 17. The head mounted display device according to claim 1, further comprising an output unit that outputs the image signal output from the photographing unit to the outside.