JP2023090721A - Image display device, program for image display, and image display method - Google Patents

Abstract

To appropriately display an image corresponding to a visual state of a weak-sighted person or the like, even when a user wearing an image display device quickly moves the user's face.SOLUTION: An image display device 1 displays an image on a screen in a state of being worn by a user U. The image display device 1 includes: a data acquisition section 141 that acquires first image data corresponding to a range larger than a range displayed on the screen from a storage medium; and a display control section 142 that extracts different image data from the first image data as display image data to be displayed on the screen with a change in a direction of the image display device 1 or a direction of a line of sight of the user U and displays the extracted display image data on the screen. The display control section 142, in a predetermined area of the screen, overlaps second image data having density higher than density of at least a part of an area of the display image data displayed on the screen with the display image data and displays it on the screen.SELECTED DRAWING: Figure 2

Description

Applied for application of Article 30, Paragraph 2 of the Patent Law Distributed the image display device. (Distribution date: after February 1, 2019)

The present invention relates to an image display device that displays an image, an image display program, and an image display method.

Conventionally, the elderly, the visually impaired, or the visually impaired (hereinafter referred to as "the visually impaired, etc.") are displayed on the head-mounted display an image showing the state in which the room or the outside is visually recognized, so that the user wearing the head-mounted display A technology is known that enables U to experience a virtual visual state of a visually impaired person (see, for example, Patent Document 1).

Japanese Patent Application Laid-Open No. 2001-175158

In the conventional technology, by correcting the image data captured by the camera provided in the head-mounted display using the correction data created in advance, a pseudo-visual image that is close to the state in which the visually impaired or the like visually recognizes the interior and exterior of the room. created image data showing an image of When such a technique is used, when the user wearing the head-mounted display moves his or her face quickly, there is a problem that the image processing for correction cannot be done in time and an appropriate image cannot be displayed. .

Therefore, the present invention has been made in view of these points, and even when the user wearing the image display device moves his/her face rapidly, it is possible to appropriately display an image corresponding to the visual condition of the visually impaired. The purpose is to

An image display device according to a first aspect of the present invention is an image display device that displays an image on a screen while being worn by a user, wherein the first image corresponds to a range larger than the range displayed on the screen. a data acquisition unit that acquires data from a storage medium; and display image data that causes different image data among the first image data to be displayed on the screen according to changes in the orientation of the image display device or the orientation of the user's line of sight. and displaying the extracted display image data on the screen, wherein the display control unit controls the display image data displayed on the screen in a predetermined area of the screen. second image data having a density higher than the density of at least a part of the area is superimposed on the display image data and displayed on the screen.

The display control unit displays on the screen the second image data in which the density of the predetermined circular or elliptical area including the center position of the screen is higher than the density of at least a part of the display image data. You may let

The display control unit may cause the screen to display the second image data having a higher density closer to the center of the predetermined area.

The display control unit may increase the density of the second image data as time elapses. In addition, the display control section may increase the area of the predetermined area where the second image data is displayed as time elapses.

The display control unit displays only the first image data without displaying the second image data for a predetermined period after the user starts using the image display device, and the predetermined period is The display of the second image data may be started after the time has elapsed.

The display control unit may display the second image data at a predetermined position on the screen regardless of the orientation of the image display device.

The display control unit reduces luminance or increases density in a range wider than the predetermined area on the screen at a first timing after starting display of the first image data, At a second timing after , the density of the predetermined area of the second image data may be increased.

The image display device further includes a line-of-sight detection unit that detects a line-of-sight direction of the user. The second image data may be superimposed on the display image data and displayed on the screen.

The display control unit may change the speed at which the density, size, shape, or density of the second image data changes, based on the information indicating the state of the user.

According to a second aspect of the present invention, there is provided an image display program that causes a processor included in an image display device for displaying an image on a screen to store first image data corresponding to a range larger than the range displayed on the screen from a storage medium. and a display image for displaying different image data out of the first image data on the screen according to a change in the orientation of the image display device or the direction of the line of sight of the user using the image display device. functioning as a display control unit for extracting the display image data as data and displaying the extracted display image data on the screen, wherein the display control unit controls the display image data displayed on the screen in a predetermined area of the screen; second image data having a density higher than the density of at least a part of the area is superimposed on the display image data and displayed on the screen.

An image display method according to a third aspect of the present invention is an image display method executed by an image display device that displays an image on a screen while being worn by a user, and has a range larger than the range displayed on the screen. and a data acquisition step of acquiring from a storage medium the first image data corresponding to the first image data corresponding to a step of extracting different image data as display image data to be displayed on the screen; and a display control step of displaying the extracted display image data on the screen. In the area of (2), second image data having a density higher than the density of at least a part of the display image data displayed on the screen is superimposed on the display image data and displayed on the screen.

According to the present invention, it is possible to appropriately display an image corresponding to the visual condition of a visually impaired person even when the user wearing the image display device moves his or her face rapidly.

1 is an external view of an image display device according to this embodiment; FIG. It is a figure which shows the internal structure of an image display apparatus. It is a figure for demonstrating 1st image data. FIG. 4 is a diagram for explaining display image data; FIG. It is a figure which shows the state which the display control part displayed the 2nd image data on a display part.

[Overview of image display device 1]
FIG. 1 is an external view of an image display device 1 according to this embodiment. The image display device 1 is a device that displays an image on a screen while being worn by the user U. As shown in FIG. The image display device 1 displays a virtual reality image around the user U, which the user U sees when the user U is in a virtual space. The image displayed by the image display device 1 may be a still image or a moving image.

The image display device 1 has the form of goggles or glasses, for example. The image display device 1 includes a housing 10 and a display unit 11 provided inside the housing (the side viewed by the user U). A user U of the image display device 1 can view image content displayed on the display unit 11 by holding the image display device 1 in hand or by fixing it to the head.

The image content includes a virtual reality image around the user U that the user U sees when the user U is in the virtual space. The image content is composed of image data virtually showing surrounding images visually recognized by the user U when the user U suffers from a disease that affects vision. A diseased state is, for example, a state in which the vicinity of the center of the visual field becomes dark or unclear. By viewing such image content, the user U can simulate the visual state of a visually impaired person or the like. As a result, the user U can increase his or her awareness of trying not to get sick by viewing the image content.

In order for the user U to have a sense of realism, it is desirable that the virtual reality image visually recognized by the user U changes to an image corresponding to the face orientation when the user U changes the orientation of the face. On the other hand, the area indicating the visual condition of the visually impaired (hereinafter referred to as “pseudo disease area”) must be displayed at the same position on the screen of the display unit 11 .

In order to display such an image on the display unit 11, a conventional technique is applied to change the pixel values of the display image data, which is the portion displayed on the display unit 11 of the virtual reality image data. Darkening or obscuring the suspected diseased area is contemplated. However, when the user U moves the direction of the face quickly, the image display device 1 needs to switch the display image data displayed by the display unit 11 at high speed. In such a case, the image processing for changing the pixel values of the display image data is not done in time, and the image display apparatus 1 cannot appropriately reproduce the state of the image of the pseudo-disease region.

Therefore, the image display device 1 is characterized in that the image content to be displayed on the display unit 11 is composed of the first image data corresponding to the surrounding image and the second image data corresponding to the diseased state. there is The image display device 1 causes the display unit 11 to display the second image data superimposed on the first image data, thereby correcting the pixel value of each pixel of the first image data to a pixel value indicating a diseased state. It is possible to make the user U feel as if the state of the first image data has changed while the user U is visually recognizing the first image data without performing the image processing.

[Internal configuration of image display device 1]
FIG. 2 is a diagram showing the internal configuration of the image display device 1. As shown in FIG. The image display device 1 has a display section 11 , a communication section 12 , a storage section 13 and a control section 14 . The control unit 14 has a data acquisition unit 141 and a display control unit 142 .

The display unit 11 is a display that displays image data. The display unit 11 displays image content under the control of the display control unit 142 .

The communication unit 12 includes a communication interface for transmitting/receiving data to/from an external device. The communication unit 12 receives image content from an external server based on an instruction from the data acquisition unit 141, for example. The communication unit 12 inputs the received image content to the data acquisition unit 141 . The communication unit 12 may cause the storage unit 13 to store the received image content.

The storage unit 13 has a storage medium such as ROM (Read Only Memory) and RAM (Random Access Memory), and stores image content displayed on the display unit 11 . The storage unit 13 may temporarily store the image content received from the server by the communication unit 12 based on the operation of the user U, or may store the image content in advance. The storage unit 13 also stores an image display program executed by the control unit 14 .

The control unit 14 is, for example, a processor (CPU), and functions as a data acquisition unit 141 and a display control unit 142 by executing programs stored in the storage unit 13 .

The data acquisition unit 141 acquires first image data corresponding to a range larger than the range displayed on the screen of the display unit 11 from an external server or a storage medium such as the storage unit 13 . A range larger than the range displayed on the screen is, for example, a range corresponding to the inner surface of a spherical pseudo space or a range corresponding to the inner surface of a cylindrical pseudo space. The data acquisition unit 141 inputs the acquired first image data to the display control unit 142 .

The display control unit 142 extracts different image data from the first image data as display image data to be displayed on the screen according to a change in the orientation of the image display device 1 or the orientation of the line of sight of the user U, and extracts the extracted display image. display the data on the screen. The display control unit 142 can specify a change in orientation of the image display device 1 based on a signal output from an acceleration sensor included in the image display device 1, for example. Further, the display control unit 142 can identify a change in the direction of the user U's line of sight using a line-of-sight detection unit (not shown) provided in the image display device 1 . The line-of-sight detection unit has, for example, a camera, and detects the line-of-sight direction from the position of the pupil of the user U in the image captured by the camera.

FIG. 3 is a diagram for explaining the first image data. FIG. 3(a) is a diagram showing a state in which the virtual space represented by the first image data is viewed from above. In FIG. 3A, there are eight objects A to H around the user U. In FIG. Here, a case where these objects are columnar objects is exemplified. FIG. 3B shows first image data that can be visually recognized when the user U in the position shown in FIG.

The center position of the first image data shown in FIG. 3B corresponds to the position of the line of sight when the user U faces the front. The position of the left end and the position of the right end of the first image data shown in FIG. 3(b) correspond to the position of the line of sight when the user U is looking backward (position of 180 degrees). When the image display device 1 starts displaying the first image data, the display control unit 142 displays the display image data within a range corresponding to the field of view of the user U when the user U is facing forward.

FIG. 4 is a diagram for explaining display image data. FIG. 4A shows display image data displayed on the display unit 11 when the user U is facing forward. The display image data includes images of objects H, A, and B present near the center of the first image data shown in FIG. 3(b). FIG. 4B shows display image data displayed on the display unit 11 with the user U facing left. The display image data includes images of objects F, G, and H present on the left side of the first image data shown in FIG. 3(b).

The display control unit 142 sequentially switches the display image data according to the change in the orientation of the face of the user U (that is, the orientation of the image display device 1), so that the user U feels as if he or she is actually looking around. be able to.

The display control unit 142 is configured so that the user U viewing such display image data can simulate a state in which the vicinity of the center of the visual field becomes dark and the visual field becomes difficult to see. second image data having a density higher than the density of at least a part of the display image data displayed on the screen in a predetermined area including the center position of the screen of the display unit 11 as the display image data. display it on the screen.

FIG. 5 is a diagram showing a state in which the display control unit 142 causes the display unit 11 to display the second image data. FIG. 5(a) shows the display image data and the second image data (symbol R in FIG. 5) displayed on the display unit 11 when the user U is facing forward. The display control unit 142 displays on the screen the second image data in which the density of a predetermined substantially circular or elliptical area is higher than the density of at least a part of the display image data. As a result, it is difficult to see the display image data in the area where the second image data is displayed.

At this time, the display control unit 142 may cause the screen to display the second image data having a higher density closer to the center of the predetermined area. For example, the display control unit 142 changes the transparency (alpha value) of the second image data when the second image data is superimposed on the display image data according to the distance from the center of the predetermined area. , the second image data can be displayed on the screen in such a manner that the density appears higher (that is, the second image data appears darker). By superimposing such second image data on the display image data by the display control unit 142, the image display device 1 can effectively reproduce a visual angle disease such that visual acuity deteriorates closer to the center. can be done.

FIG. 5B shows display image data and second image data displayed on the display unit 11 when the user U is facing left. In FIG. 5(b), the content of the display image data has changed from that in FIG. 5(a), but the position and size of the second image data have not changed. In this manner, the display control unit 142 displays the second image data in a region within the screen corresponding to the pseudo-disease region regardless of the orientation of the image display device 1, thereby changing the pixel value of the display image data. No need. As a result, even if the user U moves his/her face quickly, the predetermined area visually recognized by the user U becomes a diseased state, so that the user U can simulate the visual state of a visually impaired person without discomfort. can be done.

The display control unit 142 may increase the density of the second image data as time elapses. The display control unit 142 may increase the density of the second image data by decreasing the transparency of the second image data as time elapses, or change the pixel values of the second image data to increase the density of the second image data. The density of image data may be increased. The display control unit 142 may increase the area of a predetermined region (that is, the pseudo-disease region) whose density is darker than its surroundings as time elapses. By operating the display control unit 142 in this manner, the user U can effectively experience a simulated experience of how the disease worsens over time.

The display control unit 142 receives input of information indicating the state of the user U, such as the lifestyle habits of the user U or the state of taking medicine, and adjusts the density, size, or shape of the second image data based on the received information. , or the speed at which the concentration changes over time.

For example, when receiving input of information indicating bad lifestyle habits, the display control unit 142 increases the density of the second image data, increases the area for displaying the second image data, or increases the density. speed up. Conversely, when receiving input of information indicating good lifestyle habits, the display control unit 142 reduces the density of the second image data, reduces the area where the second image data is displayed, or increases the density. or slow down the speed. With the display control unit 142 operating in this way, the user U is more likely to be motivated to improve his or her lifestyle.

By the way, if the second image data is displayed immediately after the user U starts using the image display device 1, it is difficult for the user U to feel the inconvenience caused by a visual disorder. Therefore, the display control unit 142 displays only the first image data without displaying the second image data for a predetermined period after the user U starts using the image display device 1 . Then, the display control unit 142 starts displaying the second image data after a predetermined period of time has passed. Furthermore, after starting to display the second image data, the display control unit 142 gradually increases the density near the center of the second image data. By operating the display control unit 142 in this way, it is possible to more effectively make the user U feel the inconvenience caused by a visual disorder.

In addition, the display control unit 142 controls the luminance of a range (for example, the entire screen) wider than a predetermined region in which the density is increased in the second image data on the screen at the first timing after the display of the first image data is started. You can make the screen a little darker by lowering or increasing the density. In this case, the display control unit 142 may change the brightness or density of the display image data, or may change the brightness or density of the second image data. By operating the display control unit 142 in this way, it becomes easier to attract the attention of the user U to the screen.

At a second timing after the first timing, the display control unit 142 reduces the density of regions other than the predetermined region in the second image data, and further increases the density of the predetermined region. The time difference between the first timing and the second timing is the time during which the attention of the user U can be drawn, and is one second, for example. At the second timing, the display control unit 142 may increase the density of the predetermined area without decreasing the density of the area other than the predetermined area in the second image data.

At the second timing, the display control unit 142 restores the brightness of the entire screen to the state before the first timing, waits for a predetermined time (for example, 1 second), and then changes the density of a part of the screen using the second image data. can be increased. By operating the display control unit 142 in this manner, it is possible to attract the attention of the user U and make the user feel the inconvenience caused by a visual disorder.

[First modification]
In the above description, the display control unit 142 displays a region with a higher density than the surroundings near the center of the screen, but the position of the region with a higher density is not limited to near the center of the screen. For example, the display control unit 142 displays the second image data superimposed on the display image data on the screen in a predetermined area determined based on the direction of the line of sight detected by the line-of-sight detection unit that detects the direction of the line of sight of the user U. and the density of the predetermined area may be higher than the density of at least a part of the display image data.

When the display control unit 142 determines an area to increase the density based on the direction of the line of sight, for example, while the user U is looking at the upper right, the density of the upper right area of the screen is higher than other areas. While the user U is looking at the lower left, the density of the lower left area of the screen is higher than the other areas. By operating the display control unit 142 in this manner, the image display device 1 can reproduce the state of the visual disease with higher accuracy.

[Second modification]
In the above description, the case where the image display device 1 is a device in which the housing 10 and the display unit 11 are integrated has been exemplified, but the form of the image display device 1 is not limited to this. The display unit 11 may be configured by an information terminal such as a smart phone or a tablet, and the information terminal may function as an image display device.

[Third Modification]
In the above description, the first image data is an augmented reality image, but the first image data may be a real-time image captured by a camera provided in the image display device 1 .

[Fourth Modification]
In the above description, the image display device 1 displays the second image data so that the vicinity of the center of the field of view is dark, but the manner in which the second image data is displayed is arbitrary. . The image display device 1 may display the second image data corresponding to the state of the disease to be visually recognized by the user U so as to be superimposed on the first image data. For example, the display control unit 142 may cause the display unit 11 to display the type of disease, and may cause the display unit 11 to display the second image data corresponding to the disease selected by the user U.

[Effect of image display device 1]
As described above, in the image display device 1, the display control unit 142 causes the display image data displayed on the screen to have a density higher than that of at least a part of a predetermined area including the center position of the screen. The second image data having density is superimposed on the display image data and displayed on the screen. With the display control unit 142 operating in this way, the image display device 1 can appropriately display the image indicating the visual state of the visually impaired even when the user U wearing the image display device 1 moves his/her face quickly. can be displayed in

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist thereof. be. For example, all or part of the device can be functionally or physically distributed and integrated in arbitrary units. In addition, new embodiments resulting from arbitrary combinations of multiple embodiments are also included in the embodiments of the present invention. The effect of the new embodiment caused by the combination has the effect of the original embodiment.

1 image display device 10 housing 11 display unit 12 communication unit 13 storage unit 14 control unit 141 data acquisition unit 142 display control unit

Claims (12)

An image display device that displays an image on a screen while being worn by a user,
a data acquisition unit that acquires from a storage medium first image data corresponding to a range larger than the range displayed on the screen;
Different image data among the first image data is extracted as display image data to be displayed on the screen according to a change in the orientation of the image display device or the orientation of the line of sight of the user, and the extracted display image data is used as the display image data. a display control unit for displaying on a screen;
has
The display control unit applies second image data having a density higher than a density of at least a part of the display image data displayed on the screen to the display image data in a predetermined area of the screen. superimposed on the screen,
Image display device. The display control unit displays on the screen the second image data in which the density of the predetermined circular or elliptical area including the center position of the screen is higher than the density of at least a part of the display image data. let
The image display device according to claim 1. The display control unit causes the screen to display the second image data having a higher density closer to the center of the predetermined area.
The image display device according to claim 1 or 2. The display control unit increases the density of the second image data as time elapses.
The image display device according to any one of claims 1 to 3. The display control unit increases the area of the predetermined area where the second image data is displayed as time elapses.
The image display device according to any one of claims 1 to 4. The display control unit displays only the first image data without displaying the second image data for a predetermined period after the user starts using the image display device, and the predetermined period is starting to display the second image data after the elapse;
The image display device according to any one of claims 1 to 5. The display control unit displays the second image data at a predetermined position on the screen regardless of the orientation of the image display device.
The image display device according to any one of claims 1 to 6. The display control unit reduces luminance or increases density in a range wider than the predetermined area on the screen at a first timing after starting display of the first image data, increasing the density of the predetermined region of the second image data at a second timing after
The image display device according to any one of claims 1 to 7. further comprising a line-of-sight detection unit that detects the direction of the user's line of sight;
The display control unit causes the second image data to be superimposed on the display image data and displayed on the screen in the predetermined area determined based on the direction of the line of sight detected by the line-of-sight detection unit.
The image display device according to any one of claims 1 to 8. The display control unit changes the speed at which the density, size, shape, or density of the second image data changes based on the information indicating the state of the user.
The image display device according to any one of claims 1 to 9. a processor of an image display device that displays an image on a screen,
a data acquisition unit that acquires from a storage medium first image data corresponding to a range larger than the range displayed on the screen; a display control unit for extracting different image data from among the first image data as display image data to be displayed on the screen, and for displaying the extracted display image data on the screen;
function as
The display control unit applies second image data having a density higher than a density of at least a part of the display image data displayed on the screen to the display image data in a predetermined area of the screen. superimposed on the screen,
Image display program. An image display method executed by an image display device that displays an image on a screen while being worn by a user,
a data acquisition step of acquiring from a storage medium first image data corresponding to a range larger than the range displayed on the screen;
a step of extracting different image data out of the first image data as display image data to be displayed on the screen as the orientation of the image display device or the orientation of the line of sight of the user using the image display device changes;
a display control step of displaying the extracted display image data on the screen;
has
In the display control step, in a predetermined area of the screen, second image data having a density higher than the density of at least a part of the display image data displayed on the screen is displayed on the display image data. displayed on the screen superimposed on
Image display method.

Images