JP2000200131A - Three-dimensional image generation system and three- dimensional image generation method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily recognize the perspective of a three-dimensionally displayed object and to easily refer to the contents of the object. SOLUTION: This system is provided with a three-dimensional rendering accelerator 6 for generating image data so as to three-dimensionally display the plural objects, a display device 7 for displaying images based on the generated image data, a three-dimensional pointing device 5 for indicating the three- dimensional space position of the displayed image and a focus range change button 50 for changing and setting a focus range in a depth direction based on the indicated space position. In this case, the three-dimensional rendering accelerator 6 generates the image data so as to display the object in the focus range in a focus state and to display the object outside the focus range in a non-focus state.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional image generation system and a three-dimensional image generation method.
A three-dimensional image generation system that generates an image of an object in a focused state or an unfocused state, so that a distance in a depth direction of an object such as a window, which is present in the three-dimensional image, is easily identified. The present invention relates to a three-dimensional image generation method.

[0002]

2. Description of the Related Art Conventionally, for example, a workstation,
On a screen display on a personal computer (hereinafter, referred to as a personal computer), two-dimensional windows are displayed in an overlapping manner.

FIG. 8 shows an example of a screen of this conventional personal computer. A large number of windows (102,
103, 104, and 105) are displayed overlapping each other. The window 102 is a window currently used by the operator, and the window 102 has a darker color and other windows 10 so that the window 102 can be distinguished.
3, 104 and 105 are displayed in lighter colors. In this state, if the operator wants to use the window 103, he moves the cursor 106 over the window 103 using a mouse (not shown), and presses a mouse button here, as shown in FIG. The window 103 is displayed on the foreground, the color of the window 103 is dark, and the color of the window 102 is light.

By the way, with the recent development of computer technology, three-dimensional display can be easily performed on a personal computer. Utilizing this technology, windows and mouse cursors can now be arranged and used in three dimensions.

FIG. 10 shows an example of a three-dimensional display screen. Since the screen shows the same window as FIG. 8, the same numbers as in FIG. 8 are assigned. FIG. 11 is a diagram viewed from an oblique direction in order to easily display the three-dimensional arrangement state of the screen.
Since the operator is currently using the window 102,
The window 102 is displayed in a dark color, and the other windows 103, 104, and 105 are displayed in a lighter color. Next, when the operator attempts to switch the window to be used to 103, a pointing device such as a three-dimensional mouse capable of indicating three-dimensional coordinates (not shown) is used.
In FIG. 10, the cursor 106 on the screen 101 is moved to the window 103. Move the cursor at the moved position to 1.
06 '. In this state, the operator looks as if the cursor 106 ′ is pointing at the window 103. Nevertheless, as can be seen from FIG. 11, since the cursor 106 'is far away from the window 103 in the depth direction, even if the button of the three-dimensional mouse is pressed, the window 1
03 could not be selected. This is a problem that occurs because the display on the screen 101 in the depth direction is difficult for the operator to understand even though the windows are arranged three-dimensionally.

On the other hand, Japanese Patent Application Laid-Open No. 6-266330 proposes a method of displaying windows arranged three-dimensionally in accordance with the rules of the perspective projection method. In this method, windows far away from each other are displayed in a small size, so that there is an advantage that the context of the windows can be easily understood.

Japanese Patent Application Laid-Open No. 6-215092 proposes a method for generating a blurred image based on depth information from a gaze point. In this method, windows far away from each other are displayed in a blurred manner, so that there is an advantage that the context of the windows can be easily understood.

[0008]

However, considering the actual use situation, the operator sometimes wants to refer to the display contents even in a window which is located far away. At this time, in the method disclosed in Japanese Patent Application Laid-Open No. H6-266330, since the window far away is displayed in a small size, there is a problem that the characters in the middle become small and difficult to read, and in some cases, the characters are crushed and cannot be read. .

In the method disclosed in Japanese Patent Application Laid-Open No. Hei 6-215092, there is a problem that the distant window is displayed blurred, so that the characters inside are blurred and cannot be read.

The present invention has been made in view of the above problems, and an object of the present application is to express a sense of distance in the depth direction of a screen on a screen for displaying an object such as a three-dimensional window. Another object of the present invention is to make it easy for an operator to understand the distance relationship between the front and rear windows and to easily refer to the display contents even in a distant window.

[0011]

In order to achieve the above object,
A three-dimensional image generation system according to the present invention includes an image generation unit that generates image data so that a plurality of objects are displayed three-dimensionally, and displays an image based on the image data generated by the image generation unit. Display means; instruction means for instructing a three-dimensional spatial position of an image displayed on the display means; and changing and setting of a focus range in the depth direction based on the spatial position instructed by the instruction means. Focusing range changing means for performing, the image generating means,
Image data is displayed so that an object existing in the focusing range set by the focusing range changing unit is displayed in a focused state, and an object existing outside the focusing range is displayed in an out-of-focus state. Generate

Further, the three-dimensional image generating method according to the present invention includes a position obtaining step of obtaining a spatial position in the three-dimensional image specified from the outside, and setting a focus range in the depth direction of the three-dimensional image. Focusing range setting step, the spatial position acquired in the position acquiring step, and the focusing range set in the focusing range setting step, based on the object existing in the focusing range in a focused state. An image generating step of generating image data of a three-dimensional image to be displayed and displayed in an out-of-focus state so that an object existing outside the in-focus range may be displayed on the image data generated in the image generating step. And displaying a three-dimensional image based on the three-dimensional image.

According to the above arrangement, the focus range can be changed, so that the focus range is narrowed as necessary, and an object such as a window located at a position distant in the depth direction is displayed in a blurred manner. In this way, the perspective can be easily understood, and the focusing range can be changed as needed to display the object such as a window located at a position distant in the depth direction in a focused state. The contents of the object can be easily referred to.

According to a preferred aspect of the present invention, in the image generating means and the image generating step, a depth direction from the designated spatial position to an object existing outside the focusing range is defined. The image data of the object is generated such that the degree of out-of-focus is increased in accordance with the increase in the distance. Also, preferably, in response to an increase at every fixed distance in the depth direction up to the object existing outside the focusing range, the image of the object is increased stepwise so as to increase the degree of defocus. Generate data.

[0015] More preferably, in the focusing range changing means and the focusing range setting step, the focusing range is changed and set around the designated spatial position.

Preferably, the object is a window image.

Preferably, in the image generating means and the image generating step, image data of a cursor indicating a designated three-dimensional spatial position is generated.

[0018]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram showing a system configuration according to an embodiment of the present invention.

An arithmetic and control unit 1 such as a CPU performs various arithmetic operations and controls the entire system. Here, the CPU does not mean a chip of a processor, but means a main body of a computer.
Reference numeral 2 denotes a storage device such as a hard disk which holds software for calculation and control performed by the CPU 1 and various data. Reference numeral 3 denotes a character input device such as a keyboard, from which information input is sent to the CPU 1.

Reference numeral 4 denotes an output device such as a printer.
It is used when the result calculated in U1 is output to a recording medium such as paper. Reference numeral 5 denotes a three-dimensional pointing device. The three-dimensional coordinate position designated by the three-dimensional pointing device 5 is taken into the CPU 1, and a three-dimensional display cursor is displayed on a display device 7, which will be described later. The three-dimensional pointing device 5 is provided with a focus range change button 50 described later. Reference numeral 50 denotes a focus range change button attached to the three-dimensional pointing device 5. The information on the focus range changed by the focus range change button 50 is sent to the CPU 1, and a three-dimensional image whose focus range has been changed by the three-dimensional rendering accelerator 6 described later is generated.

Reference numeral 6 denotes a three-dimensional rendering accelerator, which receives three-dimensional modeling information and focus range information changed by the focus range change button 50 from the CPU 1, and generates a three-dimensional image. Further, it also generates a three-dimensional cursor image displayed at the three-dimensional coordinate position designated by the three-dimensional pointing device 5. Note that CP
When the computational capability of U1 is very high, the CPU 1 can also perform all three-dimensional image generation and three-dimensional cursor image generation without using the three-dimensional rendering accelerator 6.

A display device 7 such as a monitor receives and displays the three-dimensional image and the three-dimensional cursor image generated by the three-dimensional rendering accelerator 6. 8
Is a three-dimensional sound generation device that generates a three-dimensional sound that enhances the display effect of a three-dimensional image generated by the three-dimensional rendering accelerator 6, and sends this sound to speakers 9a and 9b described later.

Reference numerals 9a and 9b denote two or more speakers for reproducing the three-dimensional sound sent from the three-dimensional sound generator 8. These speakers 9a and 9b
Are generally placed on both sides of the display device 7 or, when the number is large, arranged so as to surround the operator.
Further, it may be a headphone worn on the operator's head.

Since this system can operate the same software as a general personal computer, the description of each operation is omitted, and only the characteristic portions of the present invention will be described below.

FIG. 2 is a diagram showing an example of the configuration of the three-dimensional pointing device 5. The function of the three-dimensional pointing device 5 will be described with reference to FIG. In the figure, the same components as those in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted.

Reference numerals 51, 52, and 53 denote three ultrasonic sensors mounted on the side of the screen of the display device 7. This 3
The two ultrasonic sensors 51, 52, 53 are arranged so as not to be on the same straight line, and receive an ultrasonic wave from a three-dimensional mouse 54 described later. A three-dimensional mouse 54 corresponds to the three-dimensional pointing device 5 in FIG. An ultrasonic oscillator is attached to the three-dimensional mouse 54, and ultrasonic sensors 51, 52, 53
Ultrasound is oscillating toward. Reference numeral 55 denotes a button mounted on the three-dimensional mouse 54. When the operator presses the button 55, information indicating that the button has been clicked is transmitted to the CPU 1.
To be sent to Reference numeral 56 denotes data of the reception intensity of the ultrasonic wave and the distance corresponding to the reception intensity, which are measured in advance and stored in the storage device 2. The focus range change button 50 attached to the three-dimensional mouse 54 is one set of two buttons. When one button is pressed, information for expanding the focus range is sent to the CPU 1, and when the other button is pressed, the focus range change button 50 is pressed. Information for narrowing the focus range is sent to the CPU 1.

Next, a procedure in which the three-dimensional pointing device 5 detects a three-dimensional position will be described.

When the operator holds the three-dimensional mouse 54 and moves it in front of the display device 7, the ultrasonic waves generated by the three-dimensional mouse 54 are transmitted by the ultrasonic sensors 51, 52, 53.
Detection is performed at an intensity corresponding to the position of the three-dimensional mouse 54. The ultrasonic sensors 51, 52 and 53 send the detected ultrasonic intensity information to the CPU 1. The CPU 1 obtains the distance to the three-dimensional mouse 54 from the intensity of the received ultrasonic wave using the corresponding data 56 of the reception intensity of the ultrasonic wave and the distance at that time stored in the storage device 2. In general, the intensity of an ultrasonic wave decreases in inverse proportion to the square of the distance, so if the intensity P0 of the ultrasonic wave at a specific distance L0 is measured and held as the corresponding data 56, the ultrasonic wave The distance L when the intensity is P can be obtained by L = SQRT (P0 / P) × L0 (1). Note that in equation (1), SQR
T () means square root. If the correspondence data 56 is created in advance in the form of a correspondence table in which the intensities of the ultrasonic waves are measured for a large number of distances, the distance can be obtained from this correspondence table.

Thus, the ultrasonic sensors 51, 5
Each distance L from 2,53 to the three-dimensional mouse 54
When 51, L52 and L53 are obtained, the ultrasonic sensor 5
Since the relative positions of 1, 52 and 53 are already known, three-dimensional coordinate values can be obtained from this. For example,
The position of the ultrasonic sensor 51 is set as the coordinate origin, the direction from the ultrasonic sensor 51 to the ultrasonic sensor 52 is the X axis, and the direction from the ultrasonic sensor 51 to the ultrasonic sensor 53 is Y.
Axis, a direction perpendicular to the display device 7 from the ultrasonic sensor 51 is defined as a Z axis, and the ultrasonic sensor 51 and the ultrasonic sensor
Is the distance of x, the ultrasonic sensor 51 and the ultrasonic sensor 53
Is defined as y. The three-dimensional spatial position obtained at this time is determined on the spherical surface having a radius of L51 around the coordinate value (0, 0, 0) at a certain coordinate value of the ultrasonic sensor 51 and the ultrasonic sensor 5
2 has a radius of L5 around a certain coordinate value (x, 0, 0).
That is, the ultrasonic sensor 53 is located on the spherical surface of L53 centered on a certain coordinate value (0, y, 0). Such coordinate values are calculated by the display device 7.
Are present at symmetrical positions with respect to the screen, but the coordinate values existing on the near side of the display device 7 are the coordinate values to be obtained.

Next, with reference to FIGS. 7A and 7B, the theory that the focusing range changes in the optical apparatus will be described.

FIG. 7A is a sectional view of the optical axis of the lens.

Reference numeral 201 denotes a lens. Here, for the sake of simplicity, it is depicted as a single convex lens, but it is actually composed of a combination of a plurality of lenses. The focal length of this lens 201 is f.

Reference numeral 202 denotes an aperture, which is incorporated in a lens 201 composed of a plurality of lenses. FIG.
In (a), the aperture diameter is F.

In this state, a subject A is assumed at a position at a distance L from the lens 201. At this time, light emitted from the subject A in parallel with the optical axis of the lens 201 with the aperture diameter F is
The light is refracted by the lens 201 and crosses the optical axis at the position of the focal length f. Further, a light ray directed from the same position of the subject A to the center of the lens 201 is a light ray that is not refracted at all by the lens 201 and goes straight. A perfectly focused image a of the subject A is formed at the position where these two rays intersect.

However, in practice, even if it is not the intersection of the two rays, if the two rays are sufficiently close to each other near the intersection, the amount of blur is very small.
The human eye appears to be in focus. Assuming that the limit value of the difference between the two light beams to make it appear that the image is in focus is δ, in FIG. 7A, the focus is set in the range from the image a ′ before and after the image a to the image a ″. If the subject at the position corresponding to the image a ′ and the subject at the position corresponding to the image a ″ are A ″ and the object at the position corresponding to the image a ″ is A ″, the lens 201 Distance L
Is focused on the front of the subject A within the range of the distance df to the position of the subject A ′, and on the back of the subject A, within the range of the distance db to the position of the subject A ″. The range from the position of the subject A ′ to the position of the subject A ″ is the focusing range in the case of the aperture F.

Now, consider the case where the aperture diameter is reduced to F 'in radius as shown in FIG. 7B. At this time,
Light emitted from the subject A in parallel with the optical axis of the lens 201 with the size of the aperture diameter F ′ is refracted by the lens 201 and becomes a light beam that crosses the optical axis at the position of the focal length f. Also, subject A
From the same position toward the center of the lens 201 is a light ray that is not refracted at all by the lens 201 and goes straight. This 2
A perfectly focused image a of the subject A is formed at the position where the two rays intersect.

At this time, the angle between these two light rays is smaller than that in the case of FIG. Therefore, assuming that the allowable limit value δ of the blur amount is the same, the distance from the focused image a ′ to the image a ″ becomes wider than in the case of FIG. The distance d'f between the subject A 'and the subject A is also longer than df in FIG. 7A, and the distance d'b between the subject A "and the subject A corresponding to the image a" is also larger than db in FIG. 7A. become longer.

As described above, by narrowing the aperture, the area in focus (depth of field) before and after the subject can be widened.

In the present embodiment, the concept of the depth of field of the optical apparatus described above is applied to the generation of a three-dimensional image by a computer.

Accordingly, if an effect such that the aperture of the optical device is changed is obtained by operating the focus range change button 50, the three-dimensional rendering accelerator 6 of FIG. The in-focus range is determined based on the in-focus range setting value (= aperture diameter), and a three-dimensional image can be generated. Note that the focus range setting value and the blur amount are set in the CPU 1 in advance, and the CPU 1 uses the ultrasonic sensors 51 and 5 as described above.
Based on the three-dimensional pointing position on the display screen of the three-dimensional mouse 54 obtained from the information of the ultrasonic waves detected by the ultrasonic sensors 2 and 53, the in-focus range used in the image generation and the blur amount in the area outside the in-focus range are calculated. Set.

The theoretical blur amount gradually increases as the distance from the position of the subject A increases. However, in order to reduce the additional calculation of the three-dimensional rendering accelerator 6, as described above, the allowable blur amount is limited. Since the range up to the limit value δ looks in focus to human eyes, it is sufficient to generate a three-dimensional image in a perfect focus state in this range, and furthermore, a range exceeding the allowable limit value δ of the blur amount However, it is also possible to generate a three-dimensional image by increasing the level of blur in a distance unit in a certain depth direction and by giving a window having a fixed amount of blur in each distance unit.

Further, three-dimensional rendering accelerator 6
In order to reduce the calculation load of the above, it is theoretically set that db is larger in the front focus range df and the rear focus range db for the subject A, but is simply the same. It is also possible to perform the calculation. Further, according to the distance L to the subject A, the front focusing range df and the rear focusing range d
Although b changes, it is also possible to perform a calculation by setting a constant focusing range regardless of the distance L.

Next, the concept of a method for generating a three-dimensional image will be described with reference to FIG. FIG. 3 is the same three-dimensional space as FIG. 11, but for simplicity, windows 102,
It is assumed that only the window 103 and the three-dimensional cursor 106 exist. Here, word processing software is activated in the window 102, and spreadsheet software is activated in the window 103.

The operator is working with a word processor while watching the window 102 from the position of the viewpoint 1000. Also, the three-dimensional cursor 106 is moved to the window 10.
2 exists in the vicinity. The window 103 is located on the right rear of the window 102. It is also assumed that the focus range change button 50 has set the range of the front side df and the rear side db of the three-dimensional cursor 106 to the focus range. At this time, an object out of the focus range appears to be out of focus, but in the three-dimensional arrangement shown in FIG.
2 is in the focusing range because it is near the three-dimensional cursor 106, and the window 103 exists outside the focusing range according to the current setting value of the focusing range change button 50.

Here, a screen 1001 corresponding to the screen of the display device 7 is set between the operator's viewpoint 1000 and the windows 102 and 103, and the screen 1001 is divided by a grid corresponding to the pixel arrangement of the display device 7. Then, an image viewed through each grid is an image displayed on each pixel of the display device 7.

For example, an image viewed through the grid 1002 is an image of the area 1002 ′ of the window 102. At this time, since the window 102 is in focus, the image in the area 1002 ′ is
Will be displayed. On the other hand, for example, an image viewed through the grid 1003 is an image of an area 1003 ′ of the window 103. However, since the window 103 is an image outside the focusing range, an image in a range 1003 ″ of a wider area corresponding to the blur amount than the range of the grid 1003 ′ is displayed at the grid point 1003. To be precise, each pixel in the range of 1003 ″ is a color having a value obtained by multiplying a coefficient that is larger at the center and smaller at the periphery.

Next, using the flowchart of FIG.
The processing procedure of the three-dimensional image generation will be described.

When the process of generating a three-dimensional image is started, it is determined in step S31 whether or not the focus range has been changed by the focus range change button 50. If it has been changed, a new focus range is acquired in step S32. At the same time, the amount of blur in an area outside the focusing range is acquired, and step S
Go to 33. If no change has been made, the process directly proceeds to step S33 in order to use the in-focus range and the blur amount used in the previous image generation processing as they are.

In step S33, it is determined whether or not movement of the cursor position has been instructed. If so, a new cursor position is obtained in step S34, and the in-focus range and the blur amount are set in the new position. The shift is performed according to the cursor position, and the process proceeds to step S41. If the cursor position has not been moved, the process directly proceeds to step S41 in order to use the in-focus range and the blur amount used in the previous image generation processing as they are.

In step S41, a pixel that has not been processed yet (1 of the screen 1001 in FIG. 3) of the display device 7 in FIG.
(Corresponding to two grids). After this pixel selection,
Proceed to step S42.

In step S42, the viewpoint 1000 in FIG.
From step S41, the window and the cursor visible when viewed through the pixel position selected in step S41 are determined. Of course, in this case, if there is no window or cursor corresponding to the pixel, the background may be visible. Upon completion of this determination, the flow advances to step S43.

In step S43, it is determined whether the content of the determined area is the background. If the content of the determined area is the background, the process proceeds to step S44. In step S44, a predetermined background color is set for the pixel selected in step S41, and the process proceeds to step S48. Step S
If the content of the area determined in step 43 is not the background, the process proceeds to step S45.

In step S45, it is determined whether or not this area is within the current focusing range. If this area is within the focus range according to the current cursor position and the setting of the focus range change button 50, step S
Go to 46 and if this area is not within the focus range,
Proceed to step S47.

Step S46 is a step performed when the area is within the focusing range in step S45. The pixel value of this area is set as the value of the pixel selected in step S41. Thereafter, the process proceeds to step S48.

Step S47 is performed when the area is out of the focusing range in step S45. For each pixel in a wide area corresponding to the amount of blur, a weight coefficient that is larger at the center and smaller at the periphery is used. Is set as the value of the pixel selected in step S41. After this, step S
Go to 48.

Step S48 includes steps S45 and S4
This is performed after setting the color of one area in any one of S6 and S47, and it is determined whether or not the processing for all the pixels is completed. If the processing for all the pixels has been completed, the process proceeds to step S49. If the processing for all the pixels has not been completed, the process returns to step S41 to perform the processing on the next unprocessed pixel.

Step S49 is performed when the processing for all the pixels has been completed.
To the display device 7 to display a three-dimensional screen, and terminate the process.

FIG. 5 is a screen example of a three-dimensional image generated through such a processing procedure. In FIG. 5, an in-focus image is indicated by a solid line, and an out-of-focus image is indicated by a dotted line for convenience. Window 102 and cursor 1
06 is in focus, but it is easy to see that the window 103 is out of focus. Therefore, the operator moves the cursor 106 in the depth direction of the screen with the window 103 positioned in the depth direction of the window 102. Otherwise, it can be easily determined that the window 103 cannot be selected.

This time, in this state, a change is made to widen the focus range using the focus range change button 50. In FIG. 3, the front side of the three-dimensional cursor 106 is d'f, and the rear side is d'b.
It is assumed that the focus is changed so that the window 103 is within the range of d'b and the focus is within the range of focus.

In this state, in the image viewed through the grid 1003 in FIG. 3, the window 103 is determined to be within the focus area in step S45 of the flow in FIG. 4, and the pixel value itself of the grid 1003 ′ is changed to the grid in step S46. 10
It is generated by an operation set as the pixel value of 03.

FIG. 6 shows the focus range change button 5
FIG. 9 is a screen example of a three-dimensional image generated in a state where the focus range is widened using 0, and includes a window 102 and a cursor 106.
In addition, since the window 103 is also focused, the operator can easily refer to the contents of the window 103.

In this embodiment, the focus range change button 50 is provided on the mouse 54, and the focus range is changed by pressing the button. However, the present invention is not limited to this. Any configuration that can issue a range change instruction may be used. For example, a method of displaying a window for changing the focus range on the display device 7 of FIG. 1 and selecting the window with the mouse 54 may be used.

[0064]

Another embodiment of the present invention is to provide a storage medium storing a program code of software for realizing the functions of the above-described embodiments to a system or apparatus, and to provide a computer (or CPU or MPU) of the system or apparatus. Needless to say, this can also be achieved by reading and executing the program code stored in the storage medium.

In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention.

As a storage medium for supplying the program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD
-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiment are realized, but also the OS (Operating System) running on the computer based on the instruction of the program code. ) May perform some or all of the actual processing, and the processing may realize the functions of the above-described embodiments.

Further, after the program code read from the storage medium is written into a memory provided on a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instructions of the program code, It goes without saying that the CPU included in the function expansion board or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

When the present invention is applied to the storage medium, the storage medium stores program codes corresponding to the above-described flowcharts. Each module shown will be stored in a storage medium. That is, at least a spatial position acquisition module, a focusing range setting module,
What is necessary is just to store the program code of each module of the image generation module and the image display module in the storage medium.

[0070]

As described above, according to the present invention,
By providing a configuration for changing the focus range, the focus range is changed to be narrower as necessary, and a target such as a window at a position distant in the depth direction is displayed in a blurred manner so that the perspective can be easily understood. Or by changing the focusing range widely as needed, and displaying the object in focus, such as a window at a position distant in the depth direction, so that the contents of the window can be easily referred to. Become.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a system configuration according to an embodiment of the present invention.

FIG. 2 is a diagram illustrating a configuration example of a three-dimensional pointing device.

FIG. 3 is a diagram illustrating the concept of a method for generating a three-dimensional image according to the embodiment of the present invention.

FIG. 4 is a flowchart illustrating a processing procedure for generating a three-dimensional image according to the embodiment of the present invention.

FIG. 5 is a diagram illustrating a screen example of a generated three-dimensional image according to the embodiment of the present invention.

FIG. 6 is a diagram illustrating a screen example of a generated three-dimensional image according to the embodiment of the present invention.

FIG. 7 is a diagram illustrating a change in a focusing range according to the embodiment of the present invention.

FIG. 8 is a diagram showing an example of a screen of a conventional personal computer.

FIG. 9 is a diagram showing an example of a screen of a conventional personal computer.

FIG. 10 is a diagram showing an example of a conventional three-dimensional display screen.

FIG. 11 is a diagram showing an example of a conventional three-dimensional display screen.

FIG. 12 is a memory map diagram of a program code used for generating a three-dimensional image according to the present invention.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 CPU 2 Storage device 3 Character input device 4 Output device 5 3D pointing device 6 3D rendering accelerator 7 Display device 8 3D sound generation device 9a, 9b Speaker 50 Focusing range change button 51, 52, 53 Ultrasonic sensor 54 Mouse 55 Button 56 Ultrasonic reception intensity and distance data corresponding to the reception intensity 1001 Screen 1002, 1003 Grid

Claims (13)

[Claims] An image generating unit configured to generate image data so that a plurality of objects are displayed in three dimensions; a display unit configured to display an image based on the image data generated by the image generating unit; Instruction means for instructing a three-dimensional spatial position of an image displayed on the display means; and focus for changing and setting a focus range in the depth direction based on the spatial position instructed by the instruction means. A range changing unit, wherein the image generating unit displays an object existing in the focusing range set by the focusing range changing unit in a focused state, and displays the object existing outside the focusing range. A three-dimensional image generation system, which generates image data so that is displayed in an out-of-focus state. 2. An image forming apparatus according to claim 1, wherein said image generating unit performs an out-of-focus operation in response to an increase in a depth direction distance from a spatial position indicated by said indicating unit to an object existing outside said focusing range. The three-dimensional image generation system according to claim 1, wherein image data of the object is generated so as to increase the degree. 3. The image generation unit according to an increase in a constant distance in the depth direction from a spatial position designated by the designation unit to an object existing outside the focusing range,
The three-dimensional image generation system according to claim 2, wherein the image data of the object is generated such that the degree of out-of-focus is gradually increased. 4. The focus range changing unit according to claim 1, wherein the focus range changing unit changes and sets a focus range around a spatial position designated by the designating unit. 3D image generation system. 5. The three-dimensional image generation system according to claim 1, wherein the object is a window image. 6. The three-dimensional image processing apparatus according to claim 1, wherein said image generating means generates image data of a cursor indicating a three-dimensional spatial position designated by said designating means. Image generation system. 7. A position acquisition step of acquiring a spatial position in a three-dimensional image instructed from outside, a focus range setting step of setting a focus range in a depth direction of the three-dimensional image, and the position Based on the spatial position acquired in the acquiring step and the focusing range set in the focusing range setting step, an object existing in the focusing range is displayed in a focused state, and is present outside the focusing range. Object to be displayed out of focus,
A three-dimensional image generation method, comprising: an image generation step of generating image data of a three-dimensional image; and a display step of displaying a three-dimensional image based on the image data generated in the image generation step. 8. In the image generation step, an out-of-focus state is set in response to an increase in a depth direction distance from the spatial position acquired in the position acquisition step to an object existing outside the focusing range. The three-dimensional image generation method according to claim 7, wherein image data of the object is generated so as to increase the degree. 9. In the image generating step, in response to an increase at every fixed distance in a depth direction from the spatial position acquired in the position acquiring step to an object existing outside the focusing range,
9. The three-dimensional image generation method according to claim 8, wherein the image data of the object is generated such that the degree of out-of-focus is gradually increased. 10. The tertiary image according to claim 7, wherein in the focusing range setting step, a focusing range centering on the spatial position acquired in the position acquiring step is set. Original image generation method. 11. The method according to claim 7, wherein the object is a window image. 12. The three-dimensional image according to claim 7, wherein in the image generation step, image data of a cursor indicating a three-dimensional spatial position acquired in the position acquisition step is generated. Image generation method. 13. A storage medium storing a program code for realizing the three-dimensional image generation method according to claim 7. Description: