JP4230051B2 - Image generation method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image generation method for generating a two-dimensional image obtained when an object arranged in a virtual three-dimensional space is viewed from a predetermined viewpoint position.
[0002]
[Prior art]
Recently, using a personal computer or the like, an object which is a three-dimensional object (hereinafter referred to as “3D model”) arranged in a virtual three-dimensional space (hereinafter referred to as “object space”) is determined in advance. A computer graphics (hereinafter referred to as “CG”) method for generating a two-dimensional image obtained when viewed from a viewpoint position is widely used.
[0003]
A specific CG image is generated as follows. First, in the modeling process, the 3D model arranged in the object space is specified. For example, after the shape of the 3D model is set, the attribute of the surface of each 3D model is set. Next, in the layout process, the position of each 3D model, the position of the light source, and the viewpoint position in the object space are set. Thereafter, rendering processing is performed, and a CG image as a two-dimensional image obtained when the 3D model is viewed from a desired viewpoint position is generated.
[0004]
The CG image described above is usually output in a rectangular shape in many cases, but a part of the CG image is cut into an arbitrary shape and used depending on the application. For example, in a poster or the like, when a separate CG image is associated with each of a plurality of windows surrounded by an arbitrary closed curve, or on each page of a comic magazine, a page shape of each page is combined as a whole by combining areas of arbitrary shapes This is the case where frame allocation is performed so as to fit within the frame, and different CG images are associated with each frame.
[0005]
FIG. 8 is a flowchart showing an operation procedure in the case where a frame division including a plurality of non-rectangular areas is performed on each page of a comic magazine and the like and a CG image corresponding to each non-rectangular area is fitted. For example, when there is one or a plurality of 3D models arranged in one object space, each CG image generated by setting a plurality of viewpoint positions in the object space is made to correspond to a different non-rectangular region. The operation when fitting is shown. It is assumed that a modeling process for setting the shape and surface attribute of each 3D model in the object space and a part of the layout process for setting the arrangement and light source position of each 3D model in the object space are already performed.
[0006]
First, a frame division operation for setting a plurality of areas included in a page of paper is performed in accordance with a previously created storyboard (step 500). Next, a layout work that is expected to be appropriate is performed for each area (step 501). In this layout work, a viewpoint position is set for each area in accordance with a user instruction. After the rest of the layout process is completed in this way, rendering processing for each area is performed (step 502). In this way, a CG image corresponding to each area is generated. Each CG image is formed in a rectangular shape having a predetermined aspect ratio.
[0007]
Next, each CG image is cut out into a shape corresponding to each area (step 503), and then the contents of the CG image generated corresponding to each area match what the user intended. It is determined whether or not (step 504). If the user does not intend, the process returns to step 501 described above and the layout work is repeated. Further, when the CG image intended by the user is generated, an image for one page obtained by combining the cut out CG images is generated (step 505).
[0008]
Thereafter, it is determined whether or not the entire image for one page matches what the user intended (step 506). If the image is not intended by the user, the process returns to step 501 described above. The layout work is repeated again. If the entire image for one page is what the user intended, the series of image generation operations ends.
[0009]
[Problems to be solved by the invention]
By the way, in general rendering processing, since many calculations such as the distance between the viewpoint position and the 3D model and the brightness of the surface of the 3D model by lighting are performed, the processing load at the time of CG image generation is large. Therefore, it is desirable to reduce the processing load by reducing unnecessary rendering processing. In particular, in the rendering processing by the ray tracing method (ray tracing method), pixel values are calculated for all the pixels constituting the CG image, and the calculation amount is enormous. Therefore, unnecessary rendering processing is minimized. Is desirable.
[0010]
However, in the above-described procedure for generating an image for one page, a rectangular CG image having a constant aspect ratio is generated, and then these CG images are cut out according to the shape of each area included in one page and used. For this reason, a portion that is not used as a result of this cut-out operation has undergone a completely useless rendering process. Also, when a rectangular CG image with a constant aspect ratio is generated, and when an image for one page is generated after the CG image is cut out into a non-rectangular shape, the image matches the user's intention. Therefore, when an image that is not intended by the user is generated, the rendering process is performed again, resulting in a great waste.
[0011]
The present invention was created in view of the above points, and an object of the present invention is to generate an image that can reduce the processing load by reducing waste when a CG image is cut into an arbitrary shape and combined. To provide a method.
[0012]
[Means for Solving the Problems]
In order to solve the above-described problems, according to the image generation method of the present invention, the outer edge shape of each of a plurality of regions included in a predetermined output medium is set by a region shape setting unit, and the arrangement state of the plurality of regions is set to a region. A two-dimensional image obtained by viewing a display object arranged in a virtual three-dimensional space from a predetermined viewpoint position for each of the areas set by the arrangement setting means and having these various settings. After being generated by the image generating means, a two-dimensional image corresponding to each region is synthesized by the image synthesizing means. Since the outer edge shape of each area is set before generating the 2D image, it is wasteful to generate the 2D image corresponding to the removed part compared to cutting out only the necessary part after generating the 2D image. Can be omitted, and the processing burden can be reduced.
[0013]
In particular, it is desirable that the above-described two-dimensional image generation unit generates a two-dimensional image included in the outer edge shape set by the region shape setting unit by rendering processing. The rendering process is performed using various methods such as the ray tracing method and the scan line method. However, since a lot of calculation is required for each pixel constituting the image, if the portion to be discarded later is included in the processing range, , A lot of waste arises. For this reason, it is possible to reduce the processing load by performing the rendering process only in the region used in the subsequent image composition.
[0014]
In addition, it is desirable that a viewpoint position setting unit is provided to set a viewpoint position necessary for generating a two-dimensional image so as to correspond to each of the plurality of regions. Since the viewpoint position can be individually set for each region, it is easy to generate a plurality of two-dimensional images viewed from different viewpoint positions. Accordingly, when a two-dimensional image is generated by rendering processing or the like, only one viewpoint position can be set, and the above-described composite image is generated by alternately repeating the viewpoint position setting and the two-dimensional image generation processing. In comparison, the labor of the entire image generation process can be greatly reduced.
[0015]
In addition, it is desirable to include a plurality of viewpoint positions set by the viewpoint position setting means described above in the same three-dimensional space. For example, in a comic magazine, images that look at the same display object from different angles may be required. By setting multiple viewpoint positions in the same three-dimensional space, these images can be easily displayed. Can be generated by simple operations.
[0016]
Further, prior to the two-dimensional image generation operation by the two-dimensional image generation means, a simple image corresponding to each region is generated by the simple image generation means, and the generated simple image is displayed by the simple image display means. desirable. As described above, the process of generating a two-dimensional image corresponding to each region by rendering processing or the like is a heavy burden, and the final composite image content does not conform to the intention of the producer (user) In addition, if various processes are performed again from the beginning each time, a great amount of labor and processing time are required. On the other hand, when a simple image corresponding to each area is generated and displayed by the simple image generation means and the simple image display means, the processing amount is smaller than the enormous processing performed to obtain the final composite image. It is possible to determine to a certain extent whether the final image is in line with the creator's intention by simply displaying a simple image, and the amount of processing required to obtain an appropriate composite image Can be reduced.
[0017]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, an image generation apparatus according to an embodiment to which the present invention is applied will be described in detail with reference to the drawings.
[0018]
FIG. 1 is a diagram illustrating a configuration of an image generation apparatus 100 according to the present embodiment. The image generation apparatus 100 shown in the figure includes a 3D data storage unit 10, a CG processing unit 20, an operation unit 30, a reading unit 32, a 2D data storage unit 40, a display control unit 42, and a display device 44. .
[0019]
The 3D data storage unit 10 includes data necessary for specifying a 3D model as a display object to be arranged in the object space (shape data of each 3D model, data on surface attributes, etc.), background data thereof, and Stores the position of each 3D model, the position of the light source, and the viewpoint position in the object space. In addition to the case where these various data are stored in the 3D data storage unit 10 in advance, they may be input each time a CG image is generated. For example, in the present embodiment, when generating a CG image, these data are input each time and stored in the 3D data storage unit 10.
[0020]
The CG processing unit 20 sets a plurality of areas in which at least a part of the outer edge shape is formed into a non-rectangular shape, and generates a CG image having an outer edge shape corresponding to the shape of each of these areas. The model setting unit 21, 3D layout setting unit 22, region setting unit 23, region layout setting unit 24, viewpoint position setting unit 25, preview image creation unit 26, rendering processing unit 27, and image composition unit 28 are configured. .
[0021]
The 3D model setting unit 21 sets various data necessary for specifying each 3D model arranged in the object space. For example, this data includes shape data that specifies the shape of each 3D model and surface attribute data that specifies the attributes of the surface of each 3D model. The surface attribute data includes the surface brightness, saturation, hue, and texture (materials such as reflectance and transmittance, and patterns of the materials themselves) of each 3D model. Note that one or a plurality of 3D models specified here may be arranged in two or more different object spaces in addition to the case where they are arranged in one common object space. Good.
[0022]
The 3D layout setting unit 22 sets the position (arrangement) in the object space for each 3D model whose shape and surface attributes are set by the 3D model setting unit 21. The 3D layout setting unit 22 identifies the position and type of the light source arranged in the object space. For example, in addition to the simplest point light source, a parallel light source, a spot light source, and a cone light source can be specified as the light source type.
[0023]
The region setting unit 23 sets a plurality of regions corresponding to different CG images and the outer edge shape of each region. Outer edge shapes of at least some of the plurality of regions are formed in a non-rectangular shape. The area layout setting unit 24 sets an arrangement state in the output medium for each of the plurality of areas whose outer edge shapes are set by the area setting unit 23.
[0024]
FIG. 2 is a diagram illustrating a specific example of the outer edge shape and the arrangement state of each region set by the region setting unit 23 and the region layout setting unit 24. As shown in FIG. 2, it is assumed that one page of a comic magazine or the like is considered as an output medium, and seven areas (frames) included therein are set. The region setting unit 23 sets the outer edge shape of each of the seven regions. The area layout setting unit 24 sets how to arrange each of the seven areas on a page of paper as an output medium. The setting of the outer edge shape and the arrangement state of each of these regions is performed based on a user instruction.
[0025]
The viewpoint position setting unit 25 sets the viewpoint position in the object space. In the image generation apparatus 100 according to the present embodiment, since a different CG image can be associated with each of the plurality of areas set by the area setting unit 23 described above, the viewpoint position is set for each area. . Further, as described above, when the 3D model is arranged in each of two or more different object spaces, the viewpoint position is set in each of the different object spaces.
[0026]
The preview image creation unit 26 generates, for each of the plurality of regions set by the region setting unit 23, a preview image that is a simple image when the 3D model is viewed from the corresponding viewpoint position. A combined image for one page is generated by combining according to the arrangement state of each area set by the area layout unit 24. Note that the preview image (CG image) generated here is used to grasp the outline of the content, so there is no need to reproduce the exact color and shape of the 3D model, and each atmosphere can be used by the user. Just touch.
[0027]
The rendering processing unit 27 includes detailed data of each 3D model set by the 3D model setting unit 21, the arrangement state of each 3D model set by the 3D layout setting unit 22, the light source position in the object space, and the viewpoint position setting unit. Rendering processing is performed based on the viewpoint position for each region set by 25. For example, as representative rendering processing methods, various methods such as a ray tracing method, a scan line method, or a partial ray tracing method obtained by further developing these methods are known. This rendering process is performed so as to correspond to the outer edge shape set in advance for each area, and a CG image matching the outer edge shape of each area is generated.
[0028]
The image composition unit 28 synthesizes a plurality of CG images generated by the rendering processing unit 27 according to the outer edge shape of each region so as to correspond to the arrangement state of each region set by the region layout setting unit 24. .
[0029]
The operation unit 30 is for inputting various operation instructions by the user, and includes a keyboard for inputting characters and numbers, a mouse as a pointing device, and the like. The user operates the operation unit 30 while looking at various operation screens displayed on the display device 44, and the shape and surface attribute of the 3D model, the position in the object space, the light source position, the viewpoint position, and each area. An outer edge shape or the like can be arbitrarily designated. The reading unit 32 is for optically reading information on the outer edge shape of each region drawn on the paper medium. For example, a complicated outer edge shape is drawn on a sheet of paper, and this is optically read, so that it is possible to reduce the trouble of inputting using the mouse of the operation unit 30 or the like.
[0030]
The 2D data storage unit 40 stores the CG image data generated by the CG processing unit 20. The CG image data is sent to the display control unit 42 and displayed on the screen of the display device 44.
[0031]
The above-described area setting unit 23 is an area shape setting unit, an area layout setting unit 24 is an area arrangement setting unit, a viewpoint position setting unit 25 is a viewpoint position setting unit, and a preview image creation unit 26 is a simple image generation unit. The processing unit 27 corresponds to the two-dimensional image generation unit, the image synthesis unit 28 corresponds to the image synthesis unit, and the 2D data storage unit 40, the display control unit 42, and the display device 44 correspond to the simple image display unit.
[0032]
The image processing apparatus 100 of the present embodiment has such a configuration, and the operation thereof will be described next.
[0033]
FIG. 3 is a diagram illustrating an operation procedure of the image processing apparatus 100 that generates a CG image corresponding to a plurality of areas arranged in one page as an output medium. For example, CG images obtained by viewing a plurality of 3D models arranged in a common object space from a plurality of viewpoint positions are fitted in each region. Further, it is assumed that a modeling process for setting the shape and surface attribute of these 3D models and a part of the layout process for setting the arrangement and light source position of the 3D model in the object space have already been performed.
[0034]
First, a frame division operation for setting a plurality of areas included in the paper for one page is performed in accordance with a previously created storyboard (step 100). This work includes setting the outer edge shape of each area and setting the arrangement state of each area. The region setting unit 23 sets the outer edge shape of each of the seven regions 1 to 7 illustrated in FIG. 2 in accordance with a user instruction performed by operating the operation unit 30. For example, the setting of the outer edge shape of each area can be performed by clicking or dragging the mouse of the operation unit 30 while looking at the screen of the display device 44. 32 may be optically read. In addition, the area layout setting unit 24 sets the arrangement state of the seven areas so as to be arranged as shown in FIG. 2 in accordance with a user instruction performed by operating the operation unit 30. For example, in the setting of the arrangement state of each area, seven areas having the outer edge shape set by the area setting unit 23 are displayed on the screen of the display device 44, and each of these displayed areas is displayed by the user. Can be performed by dragging on the screen and moving it arbitrarily.
[0035]
Next, for each of the seven areas in which the outer edge shape and the arrangement state are set, and the whole of these areas, the viewpoint position setting process, which is the remaining layout process, is performed in parallel with the preview screen display process. (Step 101).
[0036]
FIG. 4 is a diagram illustrating an example of a preview screen in an initial state before the layout process is performed for each region. As shown in FIG. 4, first, a preview screen in which no image is included in each area is displayed on the screen of the display device 44. In this state, when the user operates the mouse of the operation unit 30 to point to any area, the layout setting of the pointed area becomes valid.
[0037]
For example, as described above, when the specification and arrangement of each 3D model existing in the object space and the setting of the light source position have been completed, the viewpoint position setting unit 25 specifies the specific setting in which the layout setting is valid. A viewpoint position required when performing rendering processing corresponding to an area is set. When the viewpoint position corresponding to one of the areas is set and the layout setting for this area is completed, the preview image creating unit 26 3D arranged in this object space from the set viewpoint position for this area. A schematic CG image (preview image) when the model is viewed is created and stored in the 2D data storage unit 40. The preview image stored in the 2D data storage unit 40 is read by the display control unit 42, and a preview screen including the created preview image in a partial area is displayed on the display device 44. Note that the above-described preview image creation processing by the preview image creation unit 26 is performed for the purpose of obtaining a schematic screen. Therefore, it is not necessary to perform a normal rendering process to generate a fine CG image, and by reducing the number of pixels to be processed and reducing the number of gradations of each pixel, the processing speed can be increased. It is planned.
[0038]
FIG. 5 is a diagram illustrating an example of a preview screen on which a preview image corresponding to the region 3 illustrated in FIG. 2 is displayed. When only region 3 is selected, a preview image that matches the outer edge shape of region 3 is generated and displayed. Thereafter, in the same manner, when the preview screen including the preview image corresponding to the region 3 is displayed, the user operates the mouse of the operation unit 30 to point to any other region. After the layout setting of the indicated area is enabled and the viewpoint position corresponding to this area is set, a preview screen with a new preview image added is displayed.
[0039]
In this way, these processes are repeated until the layout setting process and the preview image creation process are completed for all regions. When a new area for which no preview image has been generated is selected, the first viewpoint position setting process and the preview image creating process are performed for this area, but the preview image has already been created and displayed. Can also be selected. In this case, the viewpoint position is set again for this area and the preview image is created, and a series of processes from selection of this area to display of the preview image is performed until the preview image intended by the user is displayed. The process is repeated.
[0040]
FIG. 6 is a diagram illustrating an example of a preview screen on which preview images corresponding to all regions are created and displayed. If the user determines that each preview image matches the one intended by the user and that the impression received from the entire preview screen shown in FIG. 6 also matches the one intended by the user, the preview image is included at the bottom of the preview screen. Point to the button labeled “Yes”.
[0041]
When the setting of the viewpoint position for each area is completed while viewing the preview screen, the rendering processor 27 next performs a predetermined rendering process for each area (step 102). In the rendering process corresponding to each region, since the shape of each region has already been set, a CG image corresponding to only a portion included in the outer edge shape of each region is generated.
[0042]
When the generation processing of the CG image corresponding to each of all the regions is completed in this way, the image composition unit 28 synthesizes each of the generated CG images to generate one page as shown in FIG. A composite image is generated (step 103), and a series of image generation processing ends. In FIG. 7, the 3D model is hatched to indicate a final CG image. However, a high-definition CG image with a predetermined coloring is actually obtained.
[0043]
The composite image for one page generated in this way is stored in the 2D data storage unit 40, read by the display control unit 42, and displayed on the screen of the display device 44. You may make it print on.
[0044]
As described above, in the image generation apparatus 100 according to the present embodiment, the outer edge shape of a plurality of areas included in the output medium and the arrangement state of each area are set in advance, and viewpoint position setting processing and preview display processing are performed for each area. It is carried out. Therefore, the producer (user) of the CG image can perform the layout work while looking at the preview image of each area, and the viewpoint position corresponding to each area is intended after all processing is completed as in the past. Therefore, the waste of redoing a series of processes from the beginning can be reduced. In addition, since the last rendering process is performed only on the inside of each region in which the outer edge shape is set, it is possible to prevent unnecessary calculations (parts to be discarded later) from being subjected to unnecessary calculations. Can reduce the burden of processing.
[0045]
In addition, this invention is not limited to the said embodiment, A various deformation | transformation implementation is possible within the range of the summary of this invention. For example, in the embodiment described above, the modeling process and a part of the layout process (3D model arrangement and light source position setting) are completed before setting the outer edge shape and arrangement state of each region. These processes or the update process of each process may be performed in step 101 shown in FIG. For example, an optimal CG image can be generated without wasteful processing by adjusting the arrangement, light source position, and the like of each 3D model while viewing a preview image generated corresponding to each region.
[0046]
In the above-described embodiment, a case has been described in which a 3D model included in a common object space is generated by associating each region with a CG image viewed from different viewpoint positions. However, a 3D model existing in a different object space is described. A plurality of generated CG images may correspond to each region. In addition, the CG image corresponding to each region does not necessarily have to be generated by rendering processing, and a simple planar two-dimensional image may be used for a part thereof.
[0047]
【The invention's effect】
As described above, according to the present invention, since the outer edge shape of each region is set before generating a two-dimensional image, it is removed as compared with a case where only a necessary part is cut out after generating a two-dimensional image. It is possible to eliminate the waste of generating a two-dimensional image corresponding to the portion, and to reduce the processing burden.
[Brief description of the drawings]
FIG. 1 is a diagram illustrating a configuration of an image generation apparatus according to an embodiment.
FIG. 2 is a diagram illustrating a specific example of an outer edge shape and an arrangement state of each region set by a region setting unit and a region layout setting unit.
FIG. 3 is a diagram illustrating an operation procedure of the image processing apparatus according to the present embodiment.
FIG. 4 is a diagram illustrating a specific example of a preview screen in an initial state before layout setting is performed for each region.
FIG. 5 is a diagram showing a specific example of a preview screen on which preview images corresponding to some areas are displayed.
FIG. 6 is a diagram showing a specific example of a preview screen on which preview images corresponding to all areas are created and displayed.
FIG. 7 is a diagram illustrating an entire image obtained by synthesizing a CG image of each region obtained by rendering processing.
FIG. 8 is a flowchart showing an operation procedure when performing frame division including a plurality of areas on each page of a comic magazine or the like and inserting a CG image corresponding to each area.
[Explanation of symbols]
10 3D data storage
20 CG processing unit
21 3D model setting section
22 3D layout setting section
23 Area setting section
24 area layout setting section
25 Viewpoint position setting section
26 Preview image generator
27 Rendering processor
28 Image composition part
30 Operation unit
32 Reading unit
40 2D data storage
42 Display controller
44 Display device

Claims (4)

Area shape setting means for setting the outer edge shape of each of a plurality of areas included in a predetermined output medium;
Area arrangement setting means for setting the arrangement state of the plurality of areas in the output medium;
For each of the plurality of regions, a two-dimensional image obtained by viewing a display object arranged in a virtual three-dimensional space from a predetermined viewpoint position has an outer edge shape set by the region shape setting unit. Two-dimensional image generation means for generating;
Image synthesizing means for synthesizing a two-dimensional image corresponding to each of the plurality of areas generated by the two-dimensional image generating means according to the arrangement state set by the area arrangement setting means;
Prior to the operation of generating the two-dimensional image by the two-dimensional image generating unit, a simplified image generating unit that generates a simplified image corresponding to each of the plurality of regions;
Simplified image display means for displaying the simplified image corresponding to each of the plurality of regions;
An operation unit operated by a user;
An instruction indicating that the display content is intended by the user by operating the operation unit with respect to the content generated and displayed for the simplified image corresponding to all of the plurality of regions. after the image generation method according to claim Rukoto generation is performed in the two-dimensional image by the two-dimensional image generation means for all of said plurality of regions. In claim 1,
The two-dimensional image generation means generates the two-dimensional image included in the outer edge shape set by the region shape setting means by rendering processing. In claim 1 or 2,
An image generation method, further comprising viewpoint position setting means for setting the viewpoint position corresponding to each of the plurality of regions. In claim 3,
A plurality of the viewpoint positions set by the viewpoint position setting means are included in the same three-dimensional space.

Images