JP2003288608A - 3dcg image generation method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a 3DCG image generation method which can generate an image having a depth of field from line-of-sight analyzing data and Z- information data. <P>SOLUTION: A detector 10 detects movement of eyes and the movement is detected as a line of sight at a line-of-sight detecting part 11. Time series of the line-of-sight data detected by the line-of-sight detecting part 11 are accumulated in a data accumulation part 12. At a time series data analyzing part 13, an orbit change analyzing part 14, a speed change analyzing part 15, a frequency of gaze analyzing part 16, and a gaze analyzing part 17 in which a rotational spectrum method is applied analyze the time series data respectively, and results of the analyses are sent to a analyzing result display part 18 to be displayed. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a 3DCG image generating method, and more particularly to a 3DCG image generating method using line-of-sight analysis data and Z information-added data (depth information).

[0002]

2. Description of the Related Art There is known a line-of-sight analysis apparatus that senses where the user is looking on a screen by a device attached to glasses or the like. It has been analyzed by a line-of-sight analysis device that a human moves his or her line of sight so as to trace the contour of an object, or moves his or her line of sight so as to trace a cornered portion repeatedly.

As a means for line-of-sight analysis, light rays are projected from the light attached to the eyeglasses such as a device for checking where the driver is looking to analyze the location of the reflected light. There are known devices that analyze where you are looking. Conventionally, an image with a depth of field to which a more realistic blurring process is added is not generated by simply generating an image.

Further, an image that tends to be in focus regardless of where it is seen lacks in reality. Further, even if an image with a depth of field is generated irrespective of the part viewed by a human, an image unrelated to the adjustment of eyes on the human side is shown, which may be a physiologically burdening factor.

In addition, VR (Virtual Real) at the beginning
The (ity) image is an image that is in focus with the images of all objects, and the image that the maker intentionally focused on was sometimes used as the VR image, but the user wanted it. There was no mechanism to adjust the focus on the object in real time.

[0006]

In the conventional image generation, there is only an image with a low depth of field without performing blurring processing, etc., and the focus is not on the object of interest, resulting in an image lacking in reality. There was a problem of being lost. Also, even if an image with a depth of field is generated regardless of the part viewed by a human, an image that is unrelated to the adjustment of eyes on the human side can be seen, which may be a physiologically burdensome factor. There was a problem. The present invention has been made in view of the above problem, and an object of the present invention is to provide a 3DCG image generation method for generating an image with a depth of field from line-of-sight analysis data and Z information data.

[0007]

3. A 3DCG according to claim 1
The image generation method is an image generation method for generating an image with a depth of field to which blurring processing with a higher degree of reality is added, and visual information with a depth of field is obtained using line-of-sight analysis data and Z information data (depth information). It is characterized by having an image generating means for generating an image from the.

The invention according to claim 2 is characterized in that the blurring processing is performed at a high speed so that a portion other than the line-of-sight portion (a circular portion centering on the portion being viewed) is applied to the end of the circle. .

According to the third aspect of the present invention, the thickness of the crystalline lens is measured in order to realize a more realistic visual environment by sensing and blurring the focal length data of the eye in addition to the Z information data and the line-of-sight analysis data. It is characterized by having a detection means for detecting the distance.

The invention according to claim 4 is characterized in that it has three types of data (near view, middle view, and distant view) in advance and has a high-speed response means by using the three types of data.

According to a fifth aspect of the present invention, in addition to the Z information data and the line-of-sight analysis data, the focal length data of the eyes is sensed and a blurring process is performed to realize a realistic visual environment, thereby achieving real-time depth of field. It is characterized by having an image generation means for generating an image with consideration of.

The invention according to claim 6 is characterized in that the same reaction as in the real world is returned to alleviate the shock to the human body and reduce the influence on the human body.

According to a seventh aspect of the invention, the position information of the head is sensed, and even if the head moves, an image having a depth of field can be displayed in the same manner.

In order to obtain a realistic image when generating a dark image according to claim 8, the saturation of the bright portion is
The feature is that the processing is added so as to reduce the saturation of the dark portion as it is.

According to a ninth aspect of the present invention, when a person who sees a light having a high luminous intensity in a large number of dark areas sees a star flare that can be perceived by the corneal cell tissue, an image captured by a camera or CG. The feature is that the image is also simulated and added.

The invention according to claim 10 is characterized in that the saturation of a dark portion is reduced and star flare processing is performed.

[0017]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described. FIG. 1 is a diagram showing an embodiment of a line-of-sight analysis apparatus of the present invention. The visual line analysis device shown in FIG. 1 includes a detector 10, a visual line detection unit 11, a data storage unit 12, and a time series data analysis unit 1.
3, trajectory change analysis unit 14, speed change analysis unit 15, gaze occurrence frequency analysis unit 16, rotation spectrum method application gaze analysis unit 1
7 and an analysis result display section 18. Detector 1
0 detects the movement of the eyeball, and the visual line detection unit 11 detects the movement as the visual line. The time series data regarding the line of sight detected by the line-of-sight detection unit 11 is stored in the data storage unit 12.
In the time-series data analysis unit 13, the time-series data is analyzed by the trajectory change analysis unit 14, the speed change analysis unit 15, the gaze occurrence frequency analysis unit 16, and the rotation spectrum method application gaze analysis unit 17, respectively, and displayed on the analysis result display unit 18. Send the analyzed data and display the analysis result. FIG. 2 is a diagram shown by rendering. FIGS. 3 and 4 are diagrams when a realistic image of only a target object is obtained by adding eye focal length data to the line-of-sight analysis data and Z information data.

When displaying a townscape on an HMD (head mounted display), a 3D display is used.
It is used when generating and displaying a CG landscape.
The image of the range which can be seen without moving the head is shown. You may use the real image already recorded. Cameras that can record Z information data at the same time have been developed, so they will be used. You may use the real image already recorded. Cameras that can record Z information data at the same time have been developed, so they will be used.

Objects displayed on 3DCG (building,
Since the system side already knows the positional relationship of mountains, power poles, etc., it is possible to decipher where you are looking from the information of the line-of-sight analysis, so you can focus on the object you are looking at based on the position information of the object you are looking at. A combined image can be generated. That is, it is possible to perform blurring processing or the like depending on the degree of being away from the focus. The detection of the focal length of the eye is possible by measuring the thickness of the crystalline lens of the eye with infrared rays from two points of the glasses which are put on the camera so as to be in the automatic focus.

The brightness of the display is limited and does not correspond to the brightness of the real world, but by adding flare processing to the image when a bright object is seen, the visual environment in the real world is improved. It can be corrected to some extent by displaying a close image.

When the dark image is generated, the saturation of only the dark portion is reduced, so that an image with higher reality can be generated. Specifically, after setting the overall tone (here, brightness) to the desired brightness, a monotone image is created based on that image, and saturation processing is performed using that image as a processing mask (portions near black). Try to get closer to monochrome).

If there is a high-luminance part in the dark image, after making the entire tone (here, brightness) the target brightness, a monotone image is created based on that image and processed. Flare processing is performed as a mask for.
(The star flare process should be applied to the part close to white with high brightness.)

FIG. 5 is an image showing the distance of an object by using Z information and gray scale. Z
As a specific example of the information data, an image in which a gray scale corresponding to the distance from the camera (eyes) is mapped to an object (when the distance is 0 is white, and the long distance is black) is viewed when the image is generated. An image with a depth of field can be generated by performing a blurring process in proportion to the degree of distance of an existing object based on the gray scale.

[0024]

According to the 3DCG image generation method of the first aspect, it is possible to generate an image having a depth of field by using the line-of-sight analysis data and the Z information data.

The invention according to claim 2 is the 3D according to claim 1.
In the CG image generation method, the image generation can be performed at high speed by performing the blurring process on a portion other than the line-of-sight portion (the circular portion centering on the viewed portion).

The invention according to claim 3 is the 3D according to claim 1.
In the CG image generation method, it is possible to realize a more realistic visual environment by performing blurring processing using the eye focal length data in addition to the line-of-sight analysis data and Z information data.

The invention according to claim 4 is the 3D according to claim 1.
Since the CG image generation method has three types of data (near view, middle view, and distant view), high-speed response can be realized.

The invention according to claim 5 is the 3D according to claim 3.
In the CG image generation method, a realistic visual environment can be realized from the line-of-sight analysis data, the Z information data, and the focal length data of the eyes, and an image in which the depth of field is taken into consideration can be generated in real time.

The invention according to claim 6 can reduce the shock to the human body by returning the same reaction as in the real world.

According to the seventh aspect of the present invention, the position information of the head is sensed, and even if the head is moved, an image having the same depth of field can be displayed.

According to the eighth aspect of the present invention, it is possible to generate a realistic image by reducing the saturation of the dark portion of the image.

According to the ninth aspect of the present invention, a realistic image can be generated by performing star flare processing on an image captured by a camera or a CG image.

According to the tenth aspect of the present invention, it is possible to generate a realistic image by reducing the saturation of the dark portion and performing the star flare processing.

[Brief description of drawings]

FIG. 1 is a diagram showing an embodiment of a visual line analysis device of the present invention.

FIG. 2 is a diagram shown by rendering.

FIG. 3 is a diagram showing an image focused on a car.

FIG. 4 is a diagram showing an image focused on a tricycle.

FIG. 5 is a diagram showing an image in which Z information data is added and a gray scale corresponding to a distance from a camera is mapped to an object.

[Explanation of symbols]

10 detector 11 Line-of-sight detection unit 12 Data storage section 13 Time series data analysis section 14 Orbit change analysis section 15 Speed change analysis section 16 Gaze frequency analysis unit 17 Rotational spectrum method applied gaze analysis section 18 Analysis result display

Claims (10)

[Claims] 1. An image generation method for generating an image with a depth of field, which is subjected to a more realistic blurring process and the like, wherein a visual image with a depth of field is obtained using line-of-sight analysis data and Z information data (depth information). A 3DCG image generation method comprising an image generation means for generating an image from information. 2. The image generating means performs a blurring process so that a portion other than a line-of-sight portion (a circular portion centering on a portion being viewed) is closer to a circular end, thereby performing high-speed processing. 3DCG image generation method. 3. The image generating means senses the focal length data of the eye in addition to the Z information data and the line-of-sight analysis data to perform blurring processing, and measures the thickness of the crystalline lens in order to realize a more realistic visual environment. The 3DCG image generation method according to claim 1, further comprising a detection unit that detects the distance. 4. The image generation means has three types of data (near view, middle view, and distant view) in advance, and has a high-speed response means by using the three types of data. The described 3DCG image generation method. 5. In addition to the Z information data and the line-of-sight analysis data, the focal length data of the eye is sensed to perform blurring processing to realize a realistic visual environment,
4. The 3D according to claim 3, further comprising image generation means for generating an image in consideration of a depth of field in real time.
CG image generation method. 6. A 3DCG image generation method, characterized in that by returning a reaction similar to that in a real world, a shock to a human body is softened and an influence on the human body is reduced. 7. A 3DCG image generation method, which is capable of displaying an image having a depth of field even when the head moves, by sensing position information of the head. 8. A 3DCG image generating method, wherein in order to obtain a realistic image when a dark image is generated, the saturation of the bright portion is processed so as to reduce the saturation of the dark portion as it is. 9. A star flare that can be perceived by corneal cell tissue when seeing a light with high light intensity in a lot of dark areas is captured by a camera or C
A 3DCG image generation method characterized in that it is simulated and added to a G image. 10. The 3DCG image generating method according to claim 8, wherein the saturation of the dark portion is reduced and the star flare processing is performed.