JP2021124520A - Image display device, program for image display, and image display method - Google Patents

Abstract

To appropriately display an image corresponding to a visual state of a weak-sighted person or the like, even when a user wearing an image display device quickly moves the user's face.SOLUTION: An image display device 1 displays an image on a screen in a state of being worn by a user U. The image display device 1 includes: a data acquisition section 141 that acquires first image data corresponding to a range larger than a range displayed on the screen from a storage medium; and a display control section 142 that extracts different image data from the first image data as display image data to be displayed on the screen with a change in a direction of the image display device 1 or a direction of a line of sight of the user U and displays the extracted display image data on the screen. The display control section 142, in a predetermined area of the screen, overlaps second image data having density higher than density of at least a part of an area of the display image data displayed on the screen with the display image data and displays it on the screen.SELECTED DRAWING: Figure 2

Description

The present invention relates to an image display device for displaying an image, an image display program, and an image display method.

Conventionally, a user wearing a head-mounted display by displaying an image showing a state in which an elderly person, a visually impaired person, or a visually impaired person (hereinafter, referred to as "visually impaired person") visually recognizes indoors or outdoors on the head-mounted display. A technique is known that allows U to experience a simulated visual state of a visually impaired person or the like (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2001-175158

In the conventional technique, the image data taken by the camera provided on the head-mounted display is corrected by using the correction data created in advance, so that a visually impaired person or the like visually recognizes the indoor or outdoor state in a pseudo manner. Image data showing various images was created. When such a technique is used, when a user wearing a head-mounted display moves his / her face quickly, there is a problem that the image processing for correction may not be in time and an appropriate image may not be displayed. ..

Therefore, the present invention has been made in view of these points, and even when a user wearing an image display device moves his / her face quickly, an image corresponding to a visual state such as a visually impaired person can be appropriately displayed. The purpose is to do so.

The image display device according to the first aspect of the present invention is an image display device that displays an image on a screen while being worn by a user, and is a first image corresponding to a range larger than the range displayed on the screen. Display image data for displaying different image data among the first image data on the screen according to a change in the direction of the image display device or the direction of the user's line of sight with the data acquisition unit that acquires data from the storage medium. The display control unit has a display control unit for displaying the extracted display image data on the screen, and the display control unit displays the display image data displayed on the screen in a predetermined area of the screen. The second image data having a density higher than the density of at least a part of the region is superimposed on the display image data and displayed on the screen.

The display control unit displays the second image data on the screen in which the density of the predetermined region of the circle or ellipse including the center position of the screen is higher than the density of at least a part of the display image data. You may let me.

The display control unit may display the second image data, which has a higher density as it is closer to the center of the predetermined region, on the screen.

The display control unit may increase the density of the second image data as time elapses. Further, the display control unit may increase the area of the predetermined area in which the second image data is displayed as time elapses.

The display control unit displays only the first image data without displaying the second image data for a predetermined period after the user starts using the image display device, and the predetermined period is After that, the display of the second image data may be started.

The display control unit may display the second image data at a predetermined position on the screen regardless of the orientation of the image display device.

At the first timing after starting the display of the first image data, the display control unit reduces the brightness in a range wider than the predetermined region on the screen or increases the density, and the first timing At the second timing after that, the density of the predetermined region of the second image data may be increased.

The image display device further includes a line-of-sight detection unit that detects the direction of the user's line of sight, and the display control unit is said to be in the predetermined region determined based on the direction of the line of sight detected by the line-of-sight detection unit. The second image data may be superimposed on the display image data and displayed on the screen.

The display control unit may change the density, size, shape, or rate of change of the density of the second image data based on the information indicating the state of the user.

In the image display program according to the second aspect of the present invention, the processor included in the image display device for displaying an image on the screen displays the first image data corresponding to a range larger than the range displayed on the screen from the storage medium. A display image for displaying different image data among the first image data on the screen according to a change in the direction of the data acquisition unit to be acquired and the direction of the image display device or the direction of the line of sight of the user who uses the image display device. The display image data extracted as data and displayed on the screen is made to function as a display control unit, and the display control unit displays the display image data displayed on the screen in a predetermined area of the screen. The second image data having a density higher than the density of at least a part of the region is superimposed on the display image data and displayed on the screen.

The image display method according to the third aspect of the present invention is an image display method executed by an image display device that displays an image on a screen while being worn by a user, and has a range larger than the range displayed on the screen. Of the first image data, as the data acquisition step of acquiring the first image data corresponding to the above and the direction of the image display device or the direction of the line of sight of the user using the image display device change. It has a step of extracting different image data as display image data to be displayed on the screen and a display control step of displaying the extracted display image data on the screen. In the display control step, a predetermined screen is specified. In the region, the second image data having a density higher than the density of at least a part of the display image data displayed on the screen is superimposed on the display image data and displayed on the screen.

According to the present invention, even when a user wearing an image display device moves his / her face quickly, it is possible to appropriately display an image corresponding to a visual state such as a visually impaired person.

It is an external view of the image display device which concerns on this embodiment. It is a figure which shows the internal structure of an image display device. It is a figure for demonstrating the 1st image data. It is a figure for demonstrating display image data. It is a figure which shows the state which the display control part displayed the 2nd image data on the display part.

[Overview of image display device 1]
FIG. 1 is an external view of the image display device 1 according to the present embodiment. The image display device 1 is a device that displays an image on the screen while being attached to the user U. The image display device 1 displays a virtual reality image around the user U, which is visually recognized by the user U when the user U is in a virtual space. The image displayed by the image display device 1 may be a still image or a moving image.

The image display device 1 has, for example, the form of goggles or eyeglasses. The image display device 1 has a housing 10 and a display unit 11 provided inside the housing (the side that the user U sees). The user U of the image display device 1 can view the image content displayed on the display unit 11 by holding the image display device 1 by hand or fixing it to the head.

The image content includes a virtual reality image around the user U that the user U sees when the user U is in a virtual space. The image content is composed of image data that virtually indicates an image of the surroundings that the user U visually recognizes while the user U suffers from a disease that affects the visual sense. The diseased state is, for example, a state in which the vicinity of the center of the visual field becomes dark or obscured. By viewing such image contents, the user U can experience a simulated visual state of a visually impaired person or the like. As a result, the user U can raise the consciousness of trying not to suffer from a disease by browsing the image content.

In order for the user U to obtain a sense of presence, it is desirable that the virtual reality image visually recognized by the user U changes to an image corresponding to the orientation of the face in response to the user U changing the orientation of the face. On the other hand, the area indicating the visual state of the visually impaired or the like (hereinafter, referred to as “pseudo-disease area”) must be displayed at the same position on the screen of the display unit 11.

In order to display such an image on the display unit 11, the pixel value of the display image data, which is the portion of the virtual reality image data displayed on the display unit 11, is changed by applying the conventional technique. It is possible to darken or obscure the pseudo-disease area. However, when the user U moves the face direction quickly, the image display device 1 needs to switch the display image data displayed by the display unit 11 at high speed. In such a case, there arises a problem that the image processing for changing the pixel value of the display image data is not in time and the image display device 1 cannot appropriately reproduce the state of the image in the pseudo-disease region.

Therefore, the image display device 1 is characterized in that the image content to be displayed on the display unit 11 is composed of the first image data corresponding to the surrounding image and the second image data corresponding to the state of suffering from a disease. There is. The image display device 1 corrects the pixel value of each pixel of the first image data to a pixel value indicating a state of suffering from a disease by superimposing the second image data on the first image data and displaying the second image data on the display unit 11. It is possible to make the user U feel as if the state of the first image data has changed while the user U is visually recognizing the first image data without performing the image processing.

[Internal configuration of image display device 1]
FIG. 2 is a diagram showing an internal configuration of the image display device 1. The image display device 1 includes a display unit 11, a communication unit 12, a storage unit 13, and a control unit 14. The control unit 14 includes a data acquisition unit 141 and a display control unit 142.

The display unit 11 is a display for displaying image data. The display unit 11 displays the image content under the control of the display control unit 142.

The communication unit 12 includes a communication interface for transmitting and receiving data to and from an external device. The communication unit 12 receives the image content from the external server, for example, based on the instruction of the data acquisition unit 141. The communication unit 12 inputs the received image content to the data acquisition unit 141. The communication unit 12 may store the received image content in the storage unit 13.

The storage unit 13 has a storage medium such as a ROM (Read Only Memory) and a RAM (Random Access Memory), and stores the image content displayed on the display unit 11. The storage unit 13 may temporarily store the image content received from the server by the communication unit 12 based on the operation of the user U, or may store the image content in advance. Further, the storage unit 13 stores an image display program executed by the control unit 14.

The control unit 14 is, for example, a processor (CPU), and functions as a data acquisition unit 141 and a display control unit 142 by executing a program stored in the storage unit 13.

The data acquisition unit 141 acquires the first image data corresponding to a range larger than the range displayed on the screen of the display unit 11 from an external server or a storage medium such as the storage unit 13. The range larger than the range displayed on the screen is, for example, a range corresponding to the inner surface of the spherical pseudo space or a range corresponding to the inner surface of the cylindrical pseudo space. The data acquisition unit 141 inputs the acquired first image data to the display control unit 142.

The display control unit 142 extracts different image data of the first image data as display image data to be displayed on the screen according to the change in the direction of the image display device 1 or the direction of the line of sight of the user U, and the extracted display image. Display the data on the screen. The display control unit 142 can specify, for example, a change in the orientation of the image display device 1 based on a signal output from the acceleration sensor of the image display device 1. Further, the display control unit 142 can specify the change in the direction of the line of sight of the user U by the line-of-sight detection unit (not shown) provided in the image display device 1. The line-of-sight detection unit has, for example, a camera, and detects the direction of the line of sight based on the position of the pupil of the user U in the image captured by the camera.

FIG. 3 is a diagram for explaining the first image data. FIG. 3A is a diagram showing a state in which the virtual space indicated by the first image data is visually recognized from above. In FIG. 3A, eight objects A to H exist around the user U. Here, a case where these objects are cylindrical objects will be illustrated. FIG. 3B is first image data that can be visually recognized when the user U at the position shown in FIG. 3A rotates the face direction 360 degrees.

The center position of the first image data shown in FIG. 3B corresponds to the position of the line of sight when the user U faces the front. The leftmost position and the rightmost position of the first image data shown in FIG. 3B correspond to the position of the line of sight when the user U faces the rear (180 degree position). When the image display device 1 starts displaying the first image data, the display control unit 142 displays the display image data in a range corresponding to the field of view of the user U when the user U faces the front.

FIG. 4 is a diagram for explaining display image data. FIG. 4A shows display image data displayed on the display unit 11 with the user U facing the front. The display image data includes images of objects H, A, and B existing near the center in the first image data shown in FIG. 3 (b). FIG. 4B shows display image data displayed on the display unit 11 with the user U facing to the left. The display image data includes images of objects F, G, and H existing on the left side in the first image data shown in FIG. 3 (b).

The display control unit 142 sequentially switches the display image data as the direction of the face of the user U (that is, the direction of the image display device 1) changes, so that the user U feels as if he / she is actually looking at the surroundings. be able to.

In order to enable the user U who is visually recognizing such display image data to experience a simulated state when a visual disorder occurs in which the vicinity of the center of the visual field becomes dark and difficult to see, the display control unit 142 In the predetermined area including the center position of the screen of the display unit 11, the second image data having a density higher than the density of at least a part of the display image data displayed on the screen is used as the display image data. Overlay and display on the screen.

FIG. 5 is a diagram showing a state in which the display control unit 142 displays the second image data on the display unit 11. FIG. 5A shows display image data and second image data (reference numeral R in FIG. 5) displayed on the display unit 11 with the user U facing the front. The display control unit 142 causes the screen to display the second image data in which the density of a predetermined region having a substantially circular or elliptical shape is higher than the density of at least a part of the display image data. As a result, it is difficult to see the displayed image data in the area where the second image data is displayed.

At this time, the display control unit 142 may display the second image data having a higher density on the screen as it is closer to the center of the predetermined region. The display control unit 142, for example, changes the transparency (alpha value) of the second image data when superimposing the second image data on the display image data according to the distance from the center of the predetermined region, thereby causing the center. The closer to, the higher the density of the second image data (that is, the darker the image) can be displayed on the screen. The display control unit 142 superimposes such second image data on the display image data, so that the image display device 1 effectively reproduces a disease with a visual angle in which the visual acuity decreases as it is closer to the center. Can be done.

FIG. 5B shows the display image data and the second image data displayed on the display unit 11 with the user U facing to the left. In FIG. 5 (b), the content of the displayed image data has changed from FIG. 5 (a), but the position and size of the second image data have not changed. In this way, the display control unit 142 changes the pixel value of the displayed image data by displaying the second image data in the area in the screen corresponding to the pseudo-disease area regardless of the orientation of the image display device 1. No need. As a result, even when the user U moves his / her face quickly, the predetermined area visually recognized by the user U becomes a disease state, so that the user U can experience the visual state of the visually impaired or the like without discomfort. Can be done.

The display control unit 142 may increase the density of the second image data as time elapses. The display control unit 142 may increase the density of the second image data by decreasing the transparency of the second image data as time elapses, and may increase the density of the second image data by changing the pixel value of the second image data. The density of the image data may be increased. The display control unit 142 may increase the area of a predetermined region (that is, a pseudo-disease region) in which the concentration is higher than that of the surroundings as time passes. By operating the display control unit 142 in this way, the user U can effectively experience how the disease worsens over time.

The display control unit 142 receives input of information indicating the user U's state such as the user U's lifestyle or the drug intake status, and based on the received information, the display control unit 142 receives the input of the density, size, or shape of the second image data. Or the rate at which the concentration changes over time may be changed.

For example, when the display control unit 142 receives an input of information indicating a bad lifestyle, the density of the second image data is increased, the area for displaying the second image data is increased, or the density is increased. Increase the speed. On the contrary, when the display control unit 142 receives the input of the information indicating a good lifestyle, the density of the second image data is lowered, the area for displaying the second image data is reduced, or the density is high. To slow down the speed. By operating the display control unit 142 in this way, the user U is likely to be motivated to improve the lifestyle.

By the way, if the second image data is displayed immediately after the user U starts using the image display device 1, it is difficult for the user U to realize the inconvenience when a visual disorder occurs. Therefore, the display control unit 142 does not display the second image data but displays only the first image data for a predetermined period after the user U starts using the image display device 1. Then, the display control unit 142 starts displaying the second image data after a predetermined period has elapsed. Further, after the display control unit 142 starts displaying the second image data, the display control unit 142 gradually increases the density near the center of the second image data. By operating the display control unit 142 in this way, the user U can more effectively realize the inconvenience when a visual disorder occurs.

Further, at the first timing after starting the display of the first image data, the display control unit 142 has a brightness in a wider range (for example, the entire screen) than a predetermined region in which the density of the second image data is increased on the screen. You may darken the screen a little by lowering or increasing the density. In this case, the display control unit 142 may change the brightness or density of the display image data, or may change the brightness or density of the second image data. By operating the display control unit 142 in this way, it becomes easy to attract the consciousness of the user U to the screen.

In the second timing after the first timing, the display control unit 142 lowers the density of the region other than the predetermined region in the second image data and further increases the density of the predetermined region. The time difference between the first timing and the second timing is a time that can attract the attention of the user U, for example, 1 second. At the second timing, the display control unit 142 may increase the density of the predetermined region without lowering the density of the region other than the predetermined region in the second image data.

The display control unit 142 waits for a predetermined time (for example, 1 second) after returning the brightness of the entire screen to the state before the first timing at the second timing, and then obtains the density of a part of the region by the second image data. May be higher. By operating the display control unit 142 in this way, it becomes easy to attract the attention of the user U and to realize the inconvenience when a visual disorder occurs.

[First modification]
In the above description, the case where the display control unit 142 displays a region having a higher density than the surroundings near the center of the screen has been illustrated, but the position of the region having a high density is not limited to the vicinity of the center of the screen. For example, the display control unit 142 superimposes the second image data on the display image data and displays it on the screen in a predetermined area determined based on the direction of the line of sight detected by the line-of-sight detection unit that detects the direction of the line of sight of the user U. The density of the predetermined region may be higher than the density of at least a part of the display image data.

When the display control unit 142 determines the area to be increased in density based on the direction of the line of sight, for example, while the user U is looking at the upper right, the density in the upper right area of the screen is higher than the other areas. While the user U is looking at the lower left, the density of the lower left area of the screen is higher than that of the other areas. By operating the display control unit 142 in this way, the image display device 1 can reproduce the state of the visual disorder with higher accuracy.

[Second modification]
In the above description, the case where the image display device 1 is a device in which the housing 10 and the display unit 11 are integrated has been illustrated, but the form of the image display device 1 is not limited to this. The display unit 11 is composed of an information terminal such as a smartphone or a tablet, and the information terminal may function as an image display device.

[Third variant]
In the above description, the case where the first image data is an augmented reality image has been illustrated, but the first image data may be a real-time image taken by a camera provided in the image display device 1.

[Fourth variant]
In the above description, the case where the image display device 1 displays the second image data that can be seen by the user U so that the vicinity of the center of the field of view becomes dark is illustrated, but the mode in which the second image data is displayed is arbitrary. .. The image display device 1 may display the second image data according to the state of the disease that the user U wants to visually recognize by superimposing the second image data on the first image data. For example, the display control unit 142 may display the type of the disease on the display unit 11 and display the second image data of the mode corresponding to the disease selected by the user U on the display unit 11.

[Effect of image display device 1]
As described above, in the image display device 1, the display control unit 142 has a density higher than that of at least a part of the display image data displayed on the screen in a predetermined area including the center position of the screen. The second image data having the density is superimposed on the display image data and displayed on the screen. By operating the display control unit 142 in this way, the image display device 1 appropriately displays an image showing a visual state such as a visually impaired person even when the user U wearing the image display device 1 moves his / her face quickly. Can be displayed on.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes can be made within the scope of the gist thereof. be. For example, all or a part of the device can be functionally or physically distributed / integrated in any unit. Also included in the embodiments of the present invention are new embodiments resulting from any combination of the plurality of embodiments. The effect of the new embodiment produced by the combination also has the effect of the original embodiment.

1 Image display device 10 Housing 11 Display unit 12 Communication unit 13 Storage unit 14 Control unit 141 Data acquisition unit 142 Display control unit

Claims (12)

An image display device that displays an image on the screen while it is attached to the user.
A data acquisition unit that acquires the first image data corresponding to a range larger than the range displayed on the screen from the storage medium, and a data acquisition unit.
With the change in the direction of the image display device or the direction of the line of sight of the user, different image data from the first image data is extracted as display image data to be displayed on the screen, and the extracted display image data is described as described above. The display control unit to be displayed on the screen and
Have,
The display control unit converts the second image data having a density higher than the density of at least a part of the display image data displayed on the screen into the display image data in a predetermined area of the screen. Overlay and display on the screen,
Image display device. The display control unit displays the second image data on the screen in which the density of the predetermined region of the circle or ellipse including the center position of the screen is higher than the density of at least a part of the display image data. Let,
The image display device according to claim 1. The display control unit displays the second image data, which has a higher density as it is closer to the center of the predetermined region, on the screen.
The image display device according to claim 1 or 2. The display control unit increases the density of the second image data as time elapses.
The image display device according to any one of claims 1 to 3. The display control unit increases the area of the predetermined area on which the second image data is displayed as time elapses.
The image display device according to any one of claims 1 to 4. The display control unit displays only the first image data without displaying the second image data for a predetermined period after the user starts using the image display device, and the predetermined period is After that, the display of the second image data is started.
The image display device according to any one of claims 1 to 5. The display control unit displays the second image data at a predetermined position on the screen regardless of the orientation of the image display device.
The image display device according to any one of claims 1 to 6. At the first timing after starting the display of the first image data, the display control unit reduces the brightness in a range wider than the predetermined region on the screen or increases the density, and the first timing In the second timing after that, the density of the predetermined region of the second image data is increased.
The image display device according to any one of claims 1 to 7. It also has a line-of-sight detection unit that detects the direction of the user's line of sight.
The display control unit superimposes the second image data on the display image data and displays it on the screen in the predetermined area determined based on the direction of the line of sight detected by the line-of-sight detection unit.
The image display device according to any one of claims 1 to 8. The display control unit changes the density, size, shape, or rate of change of the density of the second image data based on the information indicating the state of the user.
The image display device according to any one of claims 1 to 9. The processor of the image display device that displays the image on the screen,
A data acquisition unit that acquires first image data corresponding to a range larger than the range displayed on the screen, and a change in the orientation of the image display device or the direction of the line of sight of a user who uses the image display device. A display control unit that extracts different image data from the first image data as display image data to be displayed on the screen and displays the extracted display image data on the screen.
To function as
The display control unit converts the second image data having a density higher than the density of at least a part of the display image data displayed on the screen into the display image data in a predetermined area of the screen. Overlay and display on the screen,
Image display program. It is an image display method executed by an image display device that displays an image on the screen while it is attached to the user.
A data acquisition step of acquiring the first image data corresponding to a range larger than the range displayed on the screen from the storage medium, and
A step of extracting different image data from the first image data as display image data to be displayed on the screen according to a change in the direction of the image display device or the direction of the line of sight of a user who uses the image display device.
A display control step for displaying the extracted display image data on the screen, and
Have,
In the display control step, the display image data is the second image data having a density higher than the density of at least a part of the display image data displayed on the screen in a predetermined area of the screen. And display it on the screen.
Image display method.

Images