JP2004086604A - Image display unit - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To adjust dynamically changing brightness in an appreciation visual field in an always appropriate state, and to display an image in the visual field. <P>SOLUTION: This image display unit for displaying an image to be appreciated which is arranged in a visual field along a visual line direction from a visual point position in a virtual space, and lighted by a light source is configured to adjust brightness in the virtual space so that the brightness of the object to be appreciated in the visual field can be made proper for appreciating the object. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an image display device that displays an image in a virtual space using a virtual reality (VR) technology.
[0002]
[Prior art]
2. Description of the Related Art In recent years, a system in which a human can enter a virtual space including a three-dimensional image and perform various simulated experiences, a so-called virtual reality system, has been developed and put into practical use.
[0003]
Here, the virtual space is assumed to be a space represented by three axes of X, Y and Z in the memory of the computer as shown in FIG. 10, and various viewing objects (objects) 1 are stored in this space. The light source 2 is set while being arranged. Then, an image in the state of being illuminated by the light source 2 of the viewing object 1 that is within the field of view 4 of the camera 3 placed in the same space is generated by a computer processing process, and as shown in FIG. , Etc., and is presented to the operator as a virtual space image.
[0004]
In the virtual reality system, the operator operates, for example, an input device for operation to change the position of the camera 3, that is, the viewpoint position of a human who has entered the virtual space, and the direction of the camera 3, that is, the human Line of sight direction can be controlled. When the position and orientation of the camera 3 are controlled, the computer immediately generates a new virtual space image and updates the screen 5 accordingly. Thus, the operator can enter the virtual space created in the computer and view the viewing object from a favorite angle as if he were in the real world.
[0005]
By the way, recent remarkable performance improvement of hardware has enabled utilization of various lighting effects in a virtual reality system. For example, assuming an infinite light source such as sunlight as a light source, assuming that all surfaces in the same direction of all viewing objects in the visual field have the same brightness, or as a light source, a point light source such as an incandescent light bulb is assumed. However, since the light intensity decreases in proportion to the square of the distance from the light source, the surface far from the light source can be made to darken rapidly. The infinite light source is set, for example, as a light source that illuminates the outside of the virtual space, and the point light source is set, for example, as a light source that illuminates the indoor space of the virtual space.
[0006]
[Problems to be solved by the invention]
However, conventionally, the type of light source, the illuminance, and the like have been set at the time of content production so that an optimal video expression can be obtained when a specific viewing target is viewed from a predetermined specific viewpoint position. For this reason, in the case of a virtual reality system, a viewer (for example, an operator) can freely move in a virtual space, and in many cases, the viewer views the viewing target from a position other than a specific position. There is a possibility that an optimal video expression cannot be obtained.
[0007]
For example, if the conditions of the light source are set so that the optimal image expression is obtained when viewing the viewing object under the direct sunlight outdoors from the inside, the viewing object may be too bright when viewed from outside. is there. Similarly, if the conditions of the light source are set so that an optimal image expression can be obtained when the viewing object is outdoors from the outdoors, the viewing object may be too dark when viewed indoors.
[0008]
The present invention has been made based on such circumstances, and the purpose of the present invention is to always adjust the brightness in the dynamically changing viewing field to an appropriate state, and to change the image in the field of view. It is intended to provide an image display device capable of displaying.
[0009]
[Means for Solving the Problems]
The present invention solves this problem, and an invention corresponding to claim 1 is an appreciation that is arranged in a visual field along a line of sight from a viewpoint position in a virtual space and illuminated by a light source based on an input signal. In an image display apparatus for displaying an image of a target, the image display device includes a brightness adjustment unit that adjusts the brightness in the virtual space such that the brightness of the viewing target in the field of view becomes a brightness suitable for viewing the target. It is a thing.
[0010]
In the invention corresponding to claim 1, when the visual field along the direction of the line of sight changes from the viewpoint position in the virtual space based on the input signal, the brightness of the viewing target in the visual field changes even if the target is viewed. The brightness in the virtual space is automatically adjusted so that the brightness becomes appropriate.
[0011]
According to a second aspect of the present invention, there is provided an image display apparatus which displays an image to be viewed which is arranged in a visual field along a line of sight from a viewpoint position in a virtual space and illuminated by a light source based on an input signal. And a brightness adjusting means for adjusting the illuminance of the light source so that the brightness of the viewing target in the field of view is a brightness suitable for viewing the target.
[0012]
In the invention corresponding to claim 2, when the visual field along the direction of the line of sight changes from the viewpoint position in the virtual space based on the input signal, the brightness of the viewing target in the visual field changes even if the target is viewed. The illuminance of the light source is automatically adjusted so that the brightness becomes appropriate.
[0013]
The invention corresponding to claim 3 of the present invention is the invention according to claim 1 or 2, wherein the brightness adjusting means adjusts the illuminance of the light source using the brightness of a specific area in the visual field as an index. is there.
[0014]
In the invention corresponding to claim 3, when the visual field along the line of sight changes from the viewpoint position in the virtual space based on the input signal, the brightness of a specific viewing target in the visual field views the target. The illuminance of the light source is automatically adjusted so that the brightness suitable for the light source is obtained.
[0015]
The invention corresponding to claim 4 of the present invention is the invention according to claim 1 or 2, wherein the brightness adjusting means is arranged in the field of view, and the brightness of the viewing target specified by a predetermined input signal. The illuminance of the light source is adjusted using the index as an index.
[0016]
In the invention corresponding to claim 4, when an object to be viewed in the virtual space is designated by a predetermined input signal, the brightness of the object to be viewed becomes a brightness suitable for viewing the object. The illuminance of the light source is automatically adjusted.
[0017]
The invention corresponding to claim 5 of the present invention is an image to be viewed which is arranged in a visual field along a line of sight from a viewpoint position in a virtual space and is illuminated by a light source or is a light source based on an input signal. In the image display device that displays the visual field, a visual field luminance setting table that sets the brightness suitable for viewing the viewing object in the visual field for each visual field, and the viewpoint position or the line-of-sight direction in the virtual space is determined by a predetermined input signal. When it changes, the optimal brightness deriving means for deriving the optimal brightness in the visual field along the line of sight from the viewpoint position from the visual field luminance setting table, and the light source so as to obtain the optimal brightness derived by the optimal luminance deriving means And a brightness adjusting means for adjusting the illuminance.
[0018]
In the invention corresponding to claim 5, when the visual field along the line of sight changes from the visual point position in the virtual space based on the input signal, the optimal brightness in the visual field is derived from the visual field luminance setting table. . Then, the illuminance of the light source is automatically adjusted so as to have the optimum brightness derived from the field-of-view brightness setting table.
[0019]
According to a sixth aspect of the present invention, there is provided an image display apparatus for displaying an image to be viewed, which is arranged in a visual field along a line of sight from a viewpoint position in a virtual space and illuminated by a light source based on an input signal. In, a target brightness setting table in which the brightness suitable for viewing the target is set for each viewing target, and when a viewing target in the field of view is designated by a predetermined input signal, the optimum brightness of the viewing target is set. From the target luminance setting table, and brightness adjusting means for adjusting the illuminance of the light source so as to obtain the optimum brightness derived by the optimal luminance deriving means.
[0020]
In the invention according to claim 6, when a viewing target in the virtual space is designated by a predetermined input signal, an optimum brightness of the viewing target is derived from the target brightness setting table. Then, the illuminance of the light source is automatically adjusted so as to have the optimal brightness derived from the target brightness setting table.
[0021]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
In this embodiment, as shown in FIG. 1, an image of a virtual space composed of a three-dimensional image that can be stereoscopically viewed by three projectors 11, 12, and 13 is projected on a screen 20, and the interior of the virtual space is displayed. The present invention is applied to a virtual reality system in which a human can enter and perform various simulated experiences, and the operation content of the portable small input device 30 is converted into a virtual space image on the screen 20 via the computer 40. It is reflected in real time.
[0022]
As shown in FIG. 2, the input device 30 has a size such that the operator can hold it with both hands, similarly to the operation switch of a home-use TV game machine. It has a shape direction key 31 and four buttons a, b, c, d that can be operated with the right hand. The direction keys 31 include a key U indicating an upward direction, a key L indicating a leftward direction, a key D indicating a downward direction, and a key R indicating a rightward direction. Each of the keys U, L, D, R or Various signals are supplied to the computer 40 by pressing the buttons a, b, c, d individually or in combination. Note that the direction key 31 may be composed of eight direction keys to which four upper left, lower left, lower right, and upper right directions are further added. However, for convenience of explanation, the four direction keys 31 are used here as an example. Cite.
[0023]
As shown in FIG. 2, the computer 40 includes an input signal conversion unit 50, an image generation operation unit 60, three frame memories 71, 72, 73, and three D / A (digital / analog) converters 81, 82, 83. It has. Note that the frame memories 71, 72, 73, the D / A converters 81, 82, 83, and the projectors 11, 12, 13 have the same signal system in which the ones of the code are the same.
[0024]
The input signal conversion unit 50 has an interface function of converting various signals input from the input device 30 into input commands having corresponding contents, and inputting the input commands to the image generation calculation unit 60. is there.
[0025]
Based on the input command input from the input signal conversion unit 50, the image generation calculation unit 60 arranges the viewing target arranged in the visual field along the line of sight from the viewpoint position in the virtual space and illuminated by the light source into a three-dimensional shape. To generate a virtual space image, and divide the image data representing the generated virtual space image into three regions, that is, a left region, a central region, and a right region, while overlapping the boundaries with each other. It has a function of sending out to the frame memories 41 to 43.
[0026]
More specifically, the image generation calculation unit 60 includes a basic writing unit (not shown) for generating and displaying a virtual space image, a trial writing memory 61, a visual field luminance setting table 62, and a target luminance setting table 63. , A viewing field brightness adjustment unit 64 and a viewing object brightness adjustment unit 65.
[0027]
The basic function unit has a content memory for storing data such as the shape and position of various viewing objects constituting the contents of one virtual space, other attributes, and the position and attributes of a light source. A well-known virtual space image generation technique for generating a virtual space image by executing a virtual space image generation operation using a world coordinate system, a body coordinate system, a viewpoint coordinate system, and a screen coordinate system based on a command is implemented. It was done. It should be noted that there are two types of viewing objects, one illuminated by a light source and the other itself.
[0028]
The trial writing memory 61 is a memory area in which a virtual space image is trial-written by the operation of the viewing field brightness adjustment unit 64 and the viewing object brightness adjustment unit 65, and as shown in FIG. It is composed of a number of pixels arranged in a matrix from (x0, y0) to the lower right pixel (xm, yn).
[0029]
The visual field luminance setting table 62 sets, for each visual field that can be visually recognized from an arbitrary viewpoint position in the virtual space, a brightness (luminance) suitable for viewing the viewing object in the visual field. It comprises a pattern setting table 621 and an adjustment pattern data table 622.
[0030]
As shown in FIG. 4, the adjustment pattern setting table 621 is a table in which a line-of-sight direction and an adjustment pattern number Pn of adjustment pattern data described later are set for each arbitrary viewpoint position in the virtual space. Note that the viewpoint position is set in a world coordinate system of a virtual space represented by three axes of X, Y, and Z. The line of sight directions are set in six directions of the X-axis direction, the Y-axis direction, the Z-axis direction, the -X-axis direction, the -Y-axis direction, and the -Z-axis direction of the world coordinate system.
[0031]
As shown in FIG. 5, the adjustment pattern data table 622 is a table in which a plurality of adjustment pattern data including a combination of a plurality of patterns of sampling pixel data and the optimum average luminance data L0 is set for each adjustment pattern number Pn. The sampling pixel data is data for designating a pixel to be sampled for brightness adjustment among all the pixels (x0, y0),..., (Xm, yn) constituting the test writing memory 61. Then, as shown in FIG. 7A, the data SD1 for sampling all the pixels (x0, y0),..., (Xm, yn) of the trial writing memory 61, and as shown in FIG. , (Xj, yj), the data SD2 to be sampled, and the lower half pixels (xk, yk),... As shown in FIG. .., (Xm, yn) have three patterns of data SD3 to be sampled. Further, the optimum average luminance data L0 is data for setting the optimum average luminance of the pixel specified by the corresponding sampling pixel data. In this case, data L01, data L02, and data L03 (L01>L02> L03). Kind of optimal average luminance data is set.
[0032]
The target brightness setting table 63 is a table in which brightness (luminance) suitable for viewing the target is set for each viewing target. As shown in FIG. The optimum luminance data L2 is set for each target ID. In the target brightness setting table 63, the optimum brightness data L2 may be set for all viewing targets constituting the content of one virtual space, or may be set for some viewing targets requiring brightness adjustment. The optimum luminance data L2 may be selectively set.
[0033]
The viewing field brightness adjustment unit 64 can read the field brightness setting table 62 (the adjustment pattern setting table 621 and the adjustment pattern data table 622), and executes the processing shown in the flowchart of FIG. Is configured to adjust the illuminance of the light source so as to have a brightness suitable for viewing the object.
[0034]
That is, the viewing field brightness adjustment unit 64 waits for an instruction to change the viewpoint position or line-of-sight direction in the virtual space by an input command received from the input signal conversion unit 50 as ST (step) 1. Then, when a change in the viewpoint position or the line-of-sight direction is instructed, the viewing field brightness adjustment unit 64 determines the changed viewpoint position (X, Y, Z) and the line-of-sight direction (X, Y, Z, ST) in ST2. -X, -Y, -Z).
[0035]
Next, the viewing field brightness adjustment unit 64 searches the adjustment pattern setting table 621 as ST3, and changes the viewpoint position (X, Y, Z) and line-of-sight direction (X, Y, Z, -X, -X). −Y, −Z) is obtained. Then, the viewing field brightness adjustment unit 64 determines in ST4 that the current adjustment pattern number Pn corresponds to the immediately preceding viewpoint position (X, Y, Z) and viewing direction (X, Y, Z, -X, -Y, -Z). It is determined whether or not it matches the corresponding adjustment pattern number Pn '. The immediately preceding adjustment pattern number Pn 'is held in a data holding buffer (not shown).
[0036]
If the current adjustment pattern number Pn does not match the immediately preceding adjustment pattern number Pn ′, the viewing field brightness adjustment unit 64 operates the basic function unit as ST5, and changes the viewpoint position (X, Y, Z), a virtual space image in the visual field along the line-of-sight direction (X, Y, Z, -X, -Y, -Z) is obtained by setting the illuminance of a light source that illuminates the viewing object in the visual field in an initial setting. It is generated with the illuminance set to E0 and drawn in the trial writing memory 61. As the initial illuminance E0, for example, an illuminance corresponding to outdoor environmental light in the daytime on a cloudy day is set in a memory in advance.
[0037]
Further, the viewing field brightness adjustment unit 64 acquires the sampling pixel data corresponding to the current adjustment pattern number Pn and the optimum average luminance data L0 from the adjustment pattern data table 622 in ST6. Then, the viewing field brightness adjustment unit 64 calculates the brightness of the data drawn for each pixel of the trial writing memory 61 specified by the sampling pixel data acquired from the adjustment pattern data table 622 in ST7, and calculates the average value thereof. Is calculated as the average luminance L.
[0038]
After calculating the average luminance L of each pixel corresponding to the sampling pixel data, the viewing field brightness adjustment unit 64 next calculates the initial illuminance E0 of the light source, the optimal average luminance L0, and the average luminance of each pixel in ST8. Using L, an illuminance E of an optimal light source for expressing a virtual space image in the visual field is calculated by the following equation (1) (optimum luminance deriving means).
[0039]
E = E0 × (L0 / L) (1)
Then, the viewing field brightness adjustment unit 64 stores and holds the current adjustment pattern number Pn and the optimum illuminance E of the light source in the data holding buffer in ST9.
[0040]
After that, the viewing field brightness adjustment unit 64 operates the basic function unit again in ST10, and changes the viewpoint position (X, Y, Z) to the viewing direction (X, Y, Z, -X, -Y, -Z) is generated by setting the illuminance of the light source for illuminating the viewing object in the visual field to the optimal illuminance E, and generating a virtual space image in the left area, the center area, and the right area. The borders are divided into approximately three parts while overlapping, and individually drawn on three frame memories 41 to 43 (brightness adjusting means).
[0041]
If the current adjustment pattern number Pn matches the immediately preceding adjustment pattern number Pn 'in the processing of ST4, the viewing field brightness adjustment unit 64 proceeds to the processing of ST10. Then, the viewing field brightness adjustment unit 64 operates the basic function unit to change the viewpoint position (X, Y, Z) from the changed viewpoint direction (X, Y, Z, -X, -Y, -Z). Is generated by setting the illuminance of the light source that illuminates the viewing object within the visual field to the optimum illuminance E held in the data holding buffer, along the left area, the center area, and the right area. The three regions are roughly divided into three regions with overlapping boundaries, and are individually drawn on three frame memories 41 to 43.
[0042]
Thereafter, the viewing field brightness adjustment unit 64 ends the current process, and waits for an instruction to change the viewpoint position or the line of sight in the virtual space again.
[0043]
The viewing target brightness adjustment unit 65 can read the target brightness setting table 63, and executes the processing shown in the flowchart of FIG. 9 so that the brightness of the viewing target becomes a brightness suitable for viewing the target. Thus, the illuminance of the light source is adjusted.
[0044]
That is, the viewing target brightness adjustment unit 65 waits for any viewing target in the currently displayed virtual space image to be noticed by the input command received from the input signal conversion unit 50 in ST11. I have. When the viewing target is instructed to pay attention, the viewing object brightness adjustment unit 65 searches the target brightness setting table 63 in ST12, and determines whether or not the target ID of the viewing target instructed to pay attention is set. to decide. Here, in the case where the target ID of the viewing target instructed to pay attention is not set in the target brightness setting table 63, the viewing target instructed to pay attention does not need the brightness adjustment. Is completed. Then, it waits for one of the viewing targets in the currently displayed virtual space image to be noticed again.
[0045]
On the other hand, in ST12, when the target ID of the viewing target indicated by the attention is set in the target brightness setting table 63, the viewing target brightness adjustment unit 65 determines from the target brightness setting table 63 as ST13. The optimal brightness data L2 set corresponding to the ID is acquired. In addition, the appreciation object brightness adjustment unit 65 operates the basic function unit in ST <b> 14, generates the currently displayed virtual space image with the current illuminance E, and draws the virtual space image in the trial writing memory 61. Then, the viewing object brightness adjustment unit 65 obtains all the pixels in which the image data of the viewing object indicated in the attention is drawn from all the pixels of the trial writing memory 61 in ST15, and obtains the data of the data drawn in the pixels. The luminance is obtained, and the average value is calculated as the average luminance L.
[0046]
After calculating the average luminance L of all pixels on which the image data to be viewed has been drawn, the viewing object brightness adjustment unit 65 then proceeds to ST16 where the current illuminance E of the light source, the optimum luminance L2, and the And the average luminance L of the light source is used to calculate the optimal illuminance E of the light source for expressing the viewing target indicated by the following expression (2) (optimum luminance deriving means).
[0047]
Then, the appreciation object brightness adjustment unit 65 operates the basic function unit again in ST17, and changes the line-of-sight direction (X, Y, Z, -X, -Y,-) from the current viewpoint position (X, Y, Z). A virtual space image in the visual field along Z) is generated by setting the illuminance of the light source that illuminates the viewing object in the visual field to the optimum illuminance E, and is bounded by three regions of a left region, a central region, and a right region Are divided into approximately three parts while overlapping, and are individually drawn in three frame memories 41 to 43 (brightness adjusting means). After that, the viewing object brightness adjustment unit 65 ends the current processing, and waits again for any one of the viewing objects in the currently displayed virtual space image to be noticed.
[0048]
In the present embodiment configured as described above, the operator (which may be a viewer himself or a person other than the viewer) operates the input device 30 to operate the viewpoint position or the line of sight in the virtual space. When the direction is changed, the computer 40 generates a virtual space image in which a viewing object arranged in the visual field along the line of sight from the changed viewpoint position and illuminated by the light source is drawn in a three-dimensional shape. Then, the data of the virtual space image is divided into approximately three parts while overlapping boundaries with each other in three areas of a left area, a central area, and a right area, and supplied to three projectors 11, 12, and 13. A virtual space image composed of a three-dimensional image that can be viewed stereoscopically is displayed on the screen 20 by the screen 13. At this time, in the image generation calculation unit 60 in the computer 40, the viewing field brightness adjustment unit 64 functions so that the brightness of the viewing target in the field of view becomes a brightness suitable for viewing the target. The illuminance of the light source is automatically adjusted.
[0049]
For example, it is assumed that the data shown in FIGS. 4 and 5 are set in the adjustment pattern setting table 621 and the adjustment pattern data table 622, respectively. In this case, when the changed viewpoint is located within the range of coordinates (X1, Y1, Z1) to (X2, Y2, Z2) and the line of sight is a direction that can be approximated to the X-axis direction, adjustment is performed. The adjustment pattern data (sampling pixel data SD1, optimal average luminance L01) of the pattern number P1 is selected. Then, [E0 × (L01 / L)] is calculated as the optimum illuminance E of the light source from the average luminance L of all the pixels of the virtual space image when the viewing object arranged in the field of view is irradiated with the initial illuminance E0 by the light source. The illuminance of the light source is adjusted from the initial illuminance E0 to the optimal illuminance E. Therefore, the illuminance of the light source is adjusted so that almost the entire area in the viewing field has the optimum luminance, a virtual space image is generated, and displayed on the screen 20.
[0050]
If the changed viewpoint is located within the range of coordinates (X1, Y1, Z1) to (X2, Y2, Z2) and the line of sight is a direction that can be approximated to the Z-axis direction, the adjustment pattern number The adjustment pattern data of P5 (sampling pixel data SD2, optimal average luminance L02) is selected. Then, the optimum illuminance E of the light source is [E0 × (L02 / L) based on the average luminance L of the pixel in the substantially central part of the virtual space image when the viewing object arranged in the field of view is irradiated with the initial illuminance E0 by the light source. ] Is calculated, and the illuminance of the light source is adjusted from the initial illuminance E0 to the optimal illuminance E. Therefore, the illuminance of the light source is adjusted so that the approximate center of the viewing field has the optimum luminance, a virtual space image is generated, and displayed on the screen 20.
[0051]
When the changed viewpoint is located within the range of coordinates (X3, Y3, Z3) to (X4, Y4, Z4) and the line of sight is a direction that can be approximated to the Y-axis direction, the adjustment pattern number The adjustment pattern data of P8 (sampling pixel data SD3, optimal average luminance L02) is selected. Then, the optimal illuminance E of the light source is [E0 × (L02 / L) based on the average luminance L of the substantially lower half pixel in the virtual space image when the viewing object arranged in the field of view is irradiated with the initial illuminance E0 by the light source. ] Is calculated, and the illuminance of the light source is adjusted from the initial illuminance E0 to the optimal illuminance E. Therefore, the illuminance of the light source is adjusted so that the lower half of the viewing field has the optimum brightness, and a virtual space image is generated and displayed on the screen 20.
[0052]
As described above, according to the present embodiment, it is possible to always adjust the brightness in the dynamically changing viewing field to an appropriate state and display the virtual space image in the viewing field on the screen 20. It is possible to always present an optimal image with less discomfort to the viewer.
[0053]
In addition, since the illuminance of the light source is adjusted using the brightness of the specific area in the viewing field as an index, a virtual space image in which the viewing object occupying an important position in the image expression has the optimum brightness is presented to the viewer. Is also possible.
[0054]
Further, in the present embodiment, when the operator operates the input device 30 to pay attention to a specific viewing target in the virtual space, the viewing target brightness adjustment unit 65 in the computer 40 functions to provide the target instruction. The illuminance of the light source is automatically adjusted so that the brightness of the viewed object becomes a brightness suitable for viewing the object.
[0055]
For example, it is assumed that the data shown in FIG. 6 is set in the target luminance setting table 63 now. In this case, when the viewing target identified by the target ID “ID1” is instructed to pay attention, the illuminance of the plateau is automatically adjusted so that the viewing target is illuminated with the optimum luminance L21. Therefore, it is possible to display on the screen 20 a virtual space image in which the viewing object to which the viewer pays attention is expressed with optimal brightness.
[0056]
Note that the present invention is not limited to this embodiment.
For example, in the above-described embodiment, the initial illuminance E0 of the light source is set in advance, and the virtual space image when the viewing object is illuminated with the initial illuminance is drawn in the trial writing memory 61 which is a non-display area, and the brightness thereof is increased. However, the brightness may be evaluated by drawing on the frame memories 71 to 73, which are display areas, and the illuminance of the light source in the subsequent virtual space image may be automatically adjusted. By doing so, there is an advantage that the processing for drawing in the trial writing memory 61 can be omitted, so that the processing time can be shortened and the trial writing memory 61 can be eliminated.
[0057]
Further, in the above-described embodiment, the sampling distribution data has the three patterns shown in FIG. 7. However, for example, another pattern for calculating the average luminance using substantially the upper half pixel as the pixel of interest may be combined. Also, the present invention includes a case where two types of patterns are used or an average luminance is calculated by sampling using only one of the patterns.
[0058]
Further, when calculating the average luminance, the average luminance may be calculated, for example, by a weighted average with emphasis on the pixel at the substantially central portion, instead of the simple average. When a display system of a plurality of bands such as an RGB display system is used, a more natural adjustment can be made by changing the weight for each band.
[0059]
Also, when calculating the optimum luminance E, instead of multiplying by L0 / L or L2 / L, nonlinear correction is performed by using the square root of L0 / L or L2 / L, so that the darkness and darkness of the original scene can be improved. Brightness can be left.
[0060]
Further, besides taking sampling distribution data from the drawn result, the brightness in the visual field may be estimated from the reflectance and coordinates of the drawing object in the visual field.
[0061]
Also, as a method of adjusting the brightness in the virtual space, other than adjusting the illuminance of the light source, a method of adjusting the brightness by multiplying the pixel value by a coefficient after drawing, changing the reflection coefficient of the object A method of adjusting the brightness, a method of adjusting the brightness by applying a gray filter for dimming, and the like can be considered. In the present invention, these methods can also be realized as means for adjusting the brightness.
[0062]
【The invention's effect】
As described above in detail, according to the invention corresponding to claim 1, it is possible to always adjust the brightness in the dynamically changing viewing field to an appropriate state and display an image in the viewing field. An image display device can be provided.
[0063]
Further, according to the invention corresponding to claim 2, the brightness in the dynamically changing viewing field is always adjusted to an appropriate state by adjusting the illuminance of the light source, and the image in the viewing field is displayed. It is possible to provide an image display device that can be operated.
[0064]
According to the third and fifth aspects of the present invention, it is possible to always adjust the brightness of a specific area in a dynamically changing viewing field to an appropriate state and display an image in the viewing field. An image display device can be provided.
[0065]
According to the invention corresponding to claims 4 and 6, the brightness of the designated viewing target in the dynamically changing viewing field is always adjusted to an appropriate state, and the image in the viewing field is displayed. An image display device capable of performing the above can be provided.
[Brief description of the drawings]
FIG. 1 is an external view of a virtual reality system to which an embodiment of the present invention is applied.
FIG. 2 is a block diagram showing a main configuration of the virtual reality system.
FIG. 3 is a schematic diagram showing a configuration of a trial writing memory according to the embodiment;
FIG. 4 is a schematic diagram showing a configuration of an adjustment pattern setting table in the embodiment.
FIG. 5 is a schematic diagram showing a configuration of an adjustment pattern data table in the embodiment.
FIG. 6 is a schematic diagram showing a configuration of a target luminance setting table in the embodiment.
FIG. 7 is a schematic diagram used for describing sampling pixel data in the embodiment.
FIG. 8 is a flowchart showing a main processing procedure of a viewing field brightness adjustment unit in the embodiment.
FIG. 9 is a flowchart showing a main processing procedure of a viewing object brightness adjustment unit in the embodiment.
FIG. 10 is a schematic diagram for explaining a general virtual space.
FIG. 11 is a view showing a display example of a general virtual space image.
[Explanation of symbols]
11, 12, 13 ... Projector
20 ... Screen
30 ... input device
40 ... Computer
50 ... Input signal converter
60 ... Image generation operation unit
61: Memory for trial writing
62: Field of view luminance setting table
621: Adjustment pattern setting table
622: Adjustment pattern data table
63: Target luminance setting table
64: Appreciation field brightness adjustment unit
65 ... Brightness adjustment unit for viewing

Claims (6)

Based on the input signal, in an image display device that displays an image of a viewing target that is arranged in a visual field along a line of sight from a viewpoint position in a virtual space and is illuminated by a light source,
An image display device comprising: a brightness adjustment unit that adjusts brightness in a virtual space so that the brightness of an object to be viewed in the field of view is a brightness suitable for viewing the object. Based on the input signal, in an image display device that displays an image of a viewing target that is arranged in a visual field along a line of sight from a viewpoint position in a virtual space and is illuminated by a light source,
An image display device comprising: a brightness adjustment unit that adjusts illuminance of the light source so that the brightness of the viewing target in the field of view is a brightness suitable for viewing the target. The image display device according to claim 1, wherein the brightness adjustment unit adjusts illuminance of the light source using brightness of a specific area in the visual field as an index. 3. The brightness adjustment unit according to claim 1, wherein the brightness adjustment unit is arranged in the field of view, and adjusts the illuminance of the light source using the brightness of the viewing target designated by a predetermined input signal as an index. 4. Image display device. Based on the input signal, in an image display device that displays an image of a viewing target that is arranged in a visual field along a line-of-sight direction from a viewpoint position in a virtual space or is illuminated by a light source or displays itself as a light source
A field-of-view luminance setting table that sets brightness suitable for appreciating an object to be viewed in the field of view for each field of view,
When a viewpoint position or a line-of-sight direction in the virtual space is changed by a predetermined input signal, an optimal luminance deriving unit that derives an optimal brightness in a visual field along a line-of-sight direction from the viewpoint position from the visual field luminance setting table,
An image display device comprising: a brightness adjusting unit that adjusts the illuminance of the light source so as to have an optimal brightness derived by the optimal brightness deriving unit. Based on the input signal, in an image display device that displays an image of a viewing target that is arranged in a visual field along a line of sight from a viewpoint position in a virtual space and is illuminated by a light source,
A target brightness setting table in which the brightness suitable for viewing the target is set for each viewing target,
When a viewing target in the visual field is specified by a predetermined input signal, an optimum brightness deriving unit that derives an optimum brightness of the viewing target from the target brightness setting table,
An image display device comprising: a brightness adjusting unit that adjusts the illuminance of the light source so as to have an optimal brightness derived by the optimal brightness deriving unit.

Images