JP2006311080A - Texture image generation method, image processor, program, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a texture image generation method of generating, by repeating a prescribed pattern based on a partial image, a texture image where the ends of the partial images are smoothly connected to each other and of complementing the texture image, and to provide a device therefor etc. <P>SOLUTION: An input partial image is divided to generate a left divided image L and a right divided image R, a width tw of a texture image and an ideal overlap width D are set, and the number (n) of times of repetition of a composite partial image Q is calculated based upon the ideal overlap width D and the width Tw of the texture image. An actual overlap width C is calculated by using the width pw of a partial image P, the width tw of the texture image T, and the number (n) of times of repetition, the composite partial image Q is generated by using the left divided image L, right divided image R and the actual overlap width C and performing such overlap composition that the positions of divided images L and R are replaced with each other, and the composite partial image Q is arranged as many times as the number (n) of times of repetition to generate the texture image T, which is complemented. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a texture image generation method and apparatus for generating a texture image that uses a partial image to repeat a predetermined pattern and smoothly connect ends thereof.

  Conventionally, a texture mapping technique of drawing an image representing a color or pattern on the surface of a three-dimensional model is extremely widely used as a technique for improving the quality of a three-dimensional computer graphics (CG) image. . There are many 3D models that can be expressed using texture mapping, such as the ground and cloth, which can be regarded as being formed by repeating a part of the entire surface pattern. If an arbitrary image is repeatedly arranged on the object surface having such a repeating pattern and texture mapping is performed, the connected part of the images from the state of color change, etc. may receive a noticeable unnatural impression. is there.

As a method of avoiding such a phenomenon, a method of introducing a mirror image or a combination of a plurality of images instead of simple repetition (for example, see Patent Document 1 and Patent Document 2), or a texture that smoothly connects the edges of an image There are methods using images (see, for example, Patent Document 3 and Patent Document 4). In particular, if a texture image that is smoothly connected as in the latter case is obtained, application to various technologies based on the premise can be expected.
As a method of obtaining a smoothly connected texture image, a method of extracting a portion having periodicity from a given image (see, for example, Patent Document 5 and Patent Document 6), or an application of a computer drawing technique ( For example, see Patent Document 7).

Japanese Patent Laid-Open No. 11-045347 JP 2002-342882 A JP 2004-171168 A JP 2000-076424 A JP-A-11-120380 Japanese Patent Application Laid-Open No. 07-105401 JP 2002-216150 A

  However, many of the conventional techniques are based on the premise that a given image has a periodicity as a whole, and are methods for extracting a portion corresponding to one period from the image. Further, in accordance with this premise, it is assumed that the partial images extracted using these methods are repeatedly pasted on the target shape as a texture image. However, among the entire problems of generating texture images, there are some that cannot be solved properly by the conventional technology using such an implicit premise. One of them is a problem with the following conditions.

  First, the size of the texture image that is finally output is determined in advance and cannot be changed. Secondly, it is assumed that the partial image that can be used to generate the texture image has only a feature that its size is smaller than the final texture image. Thirdly, it is assumed that the output texture image is formed by repeating a certain pattern, and the ends of the texture image as a whole can be smoothly connected. However, as for the connection condition of the edge of the texture image, there are cases where both the left and right ends and the upper and lower ends need to be connected, or only one of them can be connected.

As a case where a problem with such a condition is seen, for example, three-dimensional shape data using photograph data obtained by photographing an object, three-dimensional shape data representing only the shape of the object, and camera information such as a photographing angle. When a texture image to be assigned to the surface is extracted from photo data, there is a case where an invalid area on the texture image corresponding to a portion not shown in the photo is to be complemented.
Since the assignment of texture coordinates and the size of the texture image are required at the stage of extracting the texture image, they are already determined when trying to complement the extracted texture image and cannot be changed.
In addition, the pattern on the surface of the three-dimensional shape is not generally a periodic pattern, but it is not particularly inappropriate to use the assumption that it is a pattern of a periodic pattern in order to complement the invalid area. In many cases, periodicity is not recognized in the texture image extracted in this way, so it cannot be said that the method for searching a partial image having periodicity using the conventional technique is very effective. A simpler method that uses the effective area as widely as possible is considered effective. Therefore, a partial image that does not satisfy the periodicity as it is is used for complementing the invalid area. Furthermore, especially when assuming periodicity for complementation, a method of connecting edges of texture images is often used as a texture coordinate assignment method.

  The present invention has been made in view of the above points, and a texture image generation method and apparatus for generating and complementing a texture image that repeats a predetermined pattern and smoothly connects ends thereof based on a partial image. The purpose is to provide.

  In order to achieve the above-described object, the first invention is a texture image generation method for generating a texture image that repeats a predetermined pattern based on a partial image and smoothly connects the ends thereof, and generates the texture. A condition setting step for setting the size of the image and a partial image smaller than the size of the texture image, an image division step for appropriately dividing the partial image into two to generate a divided image, and the width of the divided image A superimposing ideal value setting step for setting an ideal superimposing width as a reference for obtaining a smaller actual superimposing width, the ideal superimposing width, the size of the texture image, and the partial image Based on the width, the repetition number calculation step of calculating the repetition number of the composite partial image, the width of the partial image, the width of the texture image, and the repetition Using the number of times, a superposition actual value calculation step of calculating an actual superposition width, and superimposing and synthesizing the subdivision image using the subdivision image and the real superposition width to generate a composite partial image There is provided a texture image generation method comprising: an overlay synthesis step; and an image repetition arrangement step in which the synthesized partial images are arranged and arranged by the number of repetitions to generate a texture image.

In the image overlay synthesis step, it is desirable that the divided divided images are replaced and synthesized.
In addition, it is desirable to perform a combination of processing steps for the horizontal component of the texture image and processing steps for the vertical component.

  The texture image generation method according to the first invention sets the size of a texture image to be generated and a partial image smaller than the size of the texture image, and divides the partial image into two as appropriate to generate a divided image. Set the ideal overlay width that is the basis for finding the actual overlay width that is smaller than the width of the split image, and combine the ideal overlay width, texture image width, and partial image width. The number of repetitions of the partial image is calculated, and the actual overlap width is calculated using the width of the partial image, the width of the texture image, and the number of repetitions. Using the divided images and the actual overlapping width, the divided images are superimposed and combined to generate a combined partial image, and the combined partial images are arranged by the number of repetitions to generate a texture image.

The “texture image” is image data representing a color or pattern to be pasted (mapped) on the shape data of the object. “Shape data” is three-dimensional shape data, and consists of vertex information constituting the object and surface information defined using these vertex information.
The “partial image” is a texture image used for generating and complementing a texture image, for example, sampled and extracted from photographic data or the like, and is an image having an arbitrary size smaller than the size of the finally generated texture image.
“Size of texture image” is the size information of the texture image to be finally generated. The width of the texture image in the horizontal direction component and the vertical width of the vertical component are w pixels (horizontal direction) × It has h pixels (vertical direction).
The “synthesized partial image” is an image obtained by superposing and combining the divided images obtained by dividing the partial image into two.
“Viewpoint information” is information such as a camera viewpoint, a gazing point, and an upward vector.

In the first invention, a texture image having a predetermined size, in which a certain pattern is repeated and ends thereof are smoothly connected, is a partial image having an arbitrary size smaller than the size. It is possible to provide a texture image generation method that complements and generates using.
Since the image overlay synthesis process does not depend on the number of repetitions and is executed only once for the entire algorithm, even if a relatively heavy processing load is used as the synthesis process performed after the overlay, the processing time of the entire algorithm is not much. High-speed processing can be realized without affecting.

  A second invention is an image processing apparatus comprising a computer, wherein an acquisition means for acquiring a size of a texture image to be generated and a partial image smaller than the size of the texture image, and a predetermined value based on the partial image The texture image generation means for generating a texture image of the size of the texture image in which the edges are smoothly connected, the generated texture image, the shape data, and the input viewpoint information Image generating means for generating, the texture image generating means, condition setting means for setting the size of the texture image and a partial image smaller than the size of the texture image, and two of the partial images as appropriate. An image dividing means for generating a divided image and an actual overlapping width smaller than the width of the divided image. Based on the ideal overlap value setting means for setting an ideal overlap width serving as a reference for the above, the ideal overlap width, the width of the texture image, and the width of the partial image, A repetition number calculating means for calculating the number of repetitions, a superimposed real value calculating means for calculating an actual overlapping width using the width of the partial image, the width of the texture image, and the number of repetitions, and the division Using the image and the actual overlap width, overlay synthesis of the divided images is performed, and a superposition synthesis unit that generates a composite partial image and the composite partial image are arranged side by side for the number of repetitions to generate a texture image An image processing apparatus comprising: an image repetitive arrangement unit configured to perform image repetitive arrangement.

  The second invention is an invention related to an image processing apparatus that generates an image based on a texture image generated using the texture image generation method of the first invention, its shape data, and viewpoint information.

A third invention is a program for executing the texture image generation method of the first invention.
A fourth invention is a recording medium on which a program for causing a computer to execute the texture image generation method of the first invention is recorded.

A fifth invention is a program for causing a computer to function as the image processing apparatus of the second invention.
A sixth invention is a recording medium on which a program for causing a computer to function as the image processing apparatus of the second invention is recorded.

  The above-described program may be distributed by being stored in a recording medium such as a CD-ROM, or the program can be transmitted and received via a communication line.

  The present invention can provide a texture image generation method and apparatus for generating and complementing a texture image in which a predetermined pattern is repeated based on a partial image and ends thereof are smoothly connected.

  Exemplary embodiments of a texture image generation method and an image processing apparatus for executing the texture image generation method according to the present invention will be described below in detail with reference to the accompanying drawings. In the following description and the accompanying drawings, the same reference numerals are given to components having substantially the same functional configuration, and redundant description is omitted.

  First, an image processing apparatus configuration for executing the texture image generation method according to the present invention will be described with reference to FIG. FIG. 1 is a block diagram showing a configuration of an image processing apparatus 100 according to the present embodiment.

FIG. 1 shows an example of an image processing apparatus. As shown in FIG. 1, the image processing apparatus 100 is realized by a personal computer or the like.
The image processing apparatus 100 includes a parameter input unit 101, a partial image acquisition unit 102, a texture image generation unit 103, an image drawing unit 104, and the like.

  The parameter input unit 101 inputs parameters from an input unit 205 such as a mouse or a keyboard. As a parameter, the texture image size 10 to be created is set. It is also possible to give a selection instruction regarding a partial image. In this embodiment, the input unit 205 inputs and sets, but it may be automatically calculated and set.

  The partial image acquisition unit 102 acquires a partial image P used for generating and complementing the texture image T to be created.

  The texture image generating unit 103 repeats a predetermined pattern using the texture image size 10 and the partial image P acquired by the parameter input unit 101, the partial image acquiring unit 102, etc., and the edges are connected smoothly. A texture image T having a size is generated and complemented.

  The texture image generating unit 103 includes a condition setting unit 1000, an image dividing unit 1001, an overlapping ideal value setting unit 1002, a repetition number calculation unit 1003, an overlapping actual value calculation unit 1004, an image overlapping composition unit 1005, and an image repetition arrangement unit. 1006 etc.

  The condition setting unit 1000 sets a texture image size 10 to be generated and a partial image P used for complementing the texture image. Each processing unit such as an image dividing unit 1001, an ideal superimposition value setting unit 1002, a repetition number calculation unit 1003, a superimposition actual value calculation unit 1004, an image superposition synthesis unit 1005, an image repetitive arrangement unit 1006, and the like is a condition setting unit 1000. Thus, the set texture image size 10 and partial image P can be freely used.

The image dividing unit 1001 divides the partial image P with a predetermined division ratio to generate two divided images.
The ideal overlap value setting unit 1002 sets an ideal overlap width D that serves as a reference for obtaining the actual overlap width C. The ideal overlapping width D may be arbitrarily set within a range that satisfies the condition that it is smaller than either width of the divided image obtained by the image dividing unit 1001. Depending on the embodiment, a fixed value may be used in the system, or may be dynamically calculated according to the situation of the image. The ideal overlap width D is used by the repetition count calculation unit 1003. The ideal overlap width D will be described in detail later.
The repetition count calculation unit 1003 calculates the repetition count n of the combined partial image Q using the set ideal overlap width D and the texture image size 10.
The superposition actual value calculation unit 1004 calculates the actual superposition width C by using the size of the partial image P, the texture image size 10, and the number of repetitions n.
The image overlay synthesis unit 1005 performs overlay synthesis of the divided images using the divided images and the actual overlay width C, and creates a composite partial image Q.
The image repeating arrangement unit 1006 generates and complements a texture image T in which the created combined partial images Q are arranged and arranged n times.

  The image drawing unit 104 pastes the texture image T generated by the texture image generation unit 103 on the shape data 32 of the object, and renders and outputs the image in consideration of viewpoint information, light source information, and the like.

  Next, the hardware configuration of the image processing apparatus 100 will be described. FIG. 2 is a hardware configuration diagram of the image processing apparatus 100.

  As shown in FIG. 2, the image processing apparatus 100 includes a control unit 201, a storage unit 202, a media input / output unit 203, a communication control unit 204, an input unit 205, a display unit 206, a printing unit 207, and the like. Connected and configured.

  The control unit 201 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like.

The CPU calls and executes a program stored in the storage unit 202, ROM, recording medium, or the like to a work memory area on the RAM, executes driving control of each device connected via the system bus 209, and the image processing apparatus 100. Implements various processes (see FIGS. 4 and 5) described later.
The ROM is a non-volatile memory and permanently holds a computer boot program, a program such as BIOS, data, and the like.
The RAM is a volatile memory, and temporarily stores a program, data, and the like loaded from the storage unit 202, ROM, recording medium, and the like, and includes a work area used by the control unit 201 for performing various processes.

The storage unit 202 is an HDD (hard disk drive), and stores a program executed by the control unit 201, data necessary for program execution, an OS (operating system), and the like. As for programs, a control program 391 corresponding to an OS (operating system), an application program 392 corresponding to processing to be described later performed by the image processing apparatus 100 to which the present computer is applied, and the like are stored.
Each of these program codes is read by the control unit 201 as necessary, transferred to the RAM, read by the CPU, and executed as various means.

  The media input / output unit 203 (drive device) performs data input / output, for example, floppy disk drive, PD drive, CD drive (-ROM, -R, -RW, etc.), DVD drive (-ROM, -R, etc.) -RW etc.) and media input / output devices such as MO drives.

  The communication control unit 204 includes a communication control device, a communication port, and the like, and is a communication interface that mediates communication between the image processing device 100 and the network 109. The image processing device 100 and other computers are connected via the network 109. Control communication between the two.

The input unit 205 inputs data and includes, for example, a keyboard, a pointing device such as a mouse, and an input device such as a numeric keypad.
An operation instruction, an operation instruction, data input, and the like can be performed on the image processing apparatus 100 via the input unit 205.

  The display unit 206 includes a display device such as a CRT monitor and a liquid crystal panel, and a logic circuit (such as a video adapter) for realizing a video function of the computer in cooperation with the display device.

  A printing unit 207 is a printer and performs print output processing of the generated image.

  The system bus 209 is a path that mediates transmission / reception of control signals, data signals, and the like between the devices.

  Next, information stored in the storage unit 202 of the image processing apparatus 100 will be described with reference to FIG. FIG. 3 is a diagram illustrating information stored in the storage unit 202.

  A plurality of photographic images 31, input / output information 41, a control program 391, an application program 392, and the like are stored in the storage unit 202.

The photographic image 31 is two-dimensional image data, and is photographic data of an object (for example, ceramics) taken by a camera, a digital camera, or the like. In this embodiment, a photographic image is used. However, the present invention is not limited to this.
The input / output information 41 is a texture image size 10, a partial image P, a texture image T, and the like.
The texture image size 10 is size information of the texture image T to be generated, which is input to the texture image generation unit 103, and has w pixels (horizontal direction) × h pixels (vertical direction).
The partial image P is a partial image having a size arbitrarily smaller than the size of the texture image T used for generating and complementing the texture image T input to the texture image generating unit 103.
The texture image T is a texture image generated and output by the texture image generation unit 103.

The control program 391 is a program that drives and controls each component of the computer that is the image processing apparatus 100, and corresponds to an OS (operating system).
The application program 392 is an executable program corresponding to the later-described processing (see FIGS. 4 and 5) performed by the image processing apparatus 100, and includes parameter input means 101, partial image acquisition means 102, texture image generation means 103, image drawing. This is a program corresponding to the means 104 and the like.

  Next, the processing operation of the image processing apparatus 100 will be described with reference to FIG. FIG. 4 is a flowchart showing an outline of processing of the image processing apparatus 100.

  An execution program corresponding to the parameter input unit 101, the partial image acquisition unit 102, the texture image generation unit 103, the image drawing unit 104, and the like, which are application programs 392, is installed in the storage unit 202 of the image processing apparatus 100. The following processing of the image processing apparatus 100 is performed by the control unit 201 of the image processing apparatus 100 according to the control of the execution program.

  The control unit 201 of the image processing apparatus 100 inputs parameters from the input unit 205 such as a mouse or a keyboard, and holds the parameters in the storage unit 202 (step S401). As a parameter, the texture image size 10 to be created is set. The texture image size 10 is size information of the texture image T to be generated, and has w pixels (horizontal direction) × h pixels (vertical direction).

The control unit 201 acquires the partial image P and stores it in the storage unit 202 (step S402).
For example, a photographic image 31 that is two-dimensional image data of an object is stored in advance in the storage unit 202, and shape data is extracted from the selected photographic image 31. A texture image is sampled based on the photographic image 31 and its shape data 32, and a partial image P arbitrarily smaller than the size of the texture image T to be finally generated is acquired.

Note that the extraction method of the shape data 32 is a matter widely performed in the field of computer graphics, and is not defined in the present invention. For example, Japanese Patent Application No. 2005-095040 includes a rotating body. Based on one two-dimensional image obtained by photographing an object (ceramics, etc.), using the characteristic inherent to the rotating body (characteristic that a circle appears everywhere in the three-dimensional shape), Method of restoring 3D information-Based on the input 2D image and information indicating the distance between the viewpoint and the projection plane as one of the shooting conditions, the projection condition is determined and the contour line on one side of the object image is extracted. 3D information (shape data) is created.
If there is already created shape data, it may be taken in.
Furthermore, in the present embodiment, texture sampling is performed from the photographic image 31 and the partial image P is extracted and acquired. However, the present invention is not limited to this. For example, created texture material data may be used.

  The control unit 201 repeats a predetermined pattern using the acquired partial image P, and performs a texture image generation process for generating and complementing a texture image T in which ends are smoothly connected (step S403).

  The control unit 201 pastes the generated texture image T on the shape data 32, generates an image in consideration of viewpoint information and light source information, and displays the image on the display unit 206 (step S404).

  Next, the processing procedure of the texture image generation process in step S403, which is an algorithm for executing the texture image generation method that is a feature point of the present application, will be described in detail with reference to FIGS. FIG. 5 is a flowchart showing the processing procedure of the texture image generation processing. FIG. 6 is a diagram illustrating texture image generation for the horizontal component of the texture image.

  The following texture image generation process (step S403) explains the process for the horizontal component of the texture image T. Similar processing is performed for the vertical component. Further, when combining the vertical direction and the horizontal direction, the vertical direction may be processed and then the horizontal direction may be processed, or vice versa.

  As a condition setting process corresponding to the condition setting unit 1000, the control unit 201 sets the texture width tw and the partial image P with the horizontal width of the texture image size 10 to be generated from the input / output information 41 (step S501). ).

  As an image division process corresponding to the image dividing unit 1001, the control unit 201 divides the partial image P set by the condition setting unit 1000 left and right at a predetermined division ratio, and generates a left divided image L and a right divided image R. (Step S502). The division ratio is not specified by the algorithm in the present application, but in the simplest case, it may be simply divided into two equal parts. Further, the widths lw and rw of the left divided image L and the right divided image R are used by the superposition ideal value setting unit 1002, and the left divided image L and the right divided image R are used by the image superposition synthesis unit 1005. The division ratio may be calculated and set accordingly.

  The left divided image L and the right divided image R are replaced with each other in the image superimposing / combining unit 1005, and the combined partial image Q is generated by superimposing and combining the calculated overlapping width C. In the generated divided divided image Q, the left end (left side) of the right divided image R appears at the left end, and the right end (right side) of the left divided image L appears at the right end. Since the left end (left side) of the right divided image R and the right end (right side) of the left divided image L at the right end correspond to the cut portions obtained by dividing the original partial image P, the composite partial images Q are arranged in the horizontal direction. If this happens, make sure that the connection is smooth. In order to have such a property, the partial image P is divided into left and right.

The control unit 201 sets an ideal overlap width D as a reference for obtaining the actual overlap width C as the overlap ideal value setting process corresponding to the overlap ideal value setting unit 1002 (step S503). The ideal overlapping width D may be arbitrarily determined within a range that satisfies the condition that it is smaller than the widths lw and rw of the left divided image L and the right divided image R obtained by the image dividing unit 1001. It is desirable to determine in consideration of the properties to be shown.
The larger the ideal overlap width D is set, the more the combined partial image Q, which is the result of overlapping and combining the left divided image L and the right divided image R, loses the characteristics of the original partial image P. The overlapping part of the left divided image L and the right divided image R becomes smooth and the boundary becomes inconspicuous. In contrast, the smaller the ideal overlap width D is set, the more the composite partial image Q that is the result of superposing and combining the left divided image L and the right divided image R maintains the characteristics of the original partial image P. However, the overlapping portion of the left divided image L and the right divided image R is not smooth and the boundary becomes conspicuous.
Further, as will be described later, the method according to the present invention has a property that among the appropriate overlap width candidates, the minimum overlap width of the ideal overlap width D is the actual overlap width C. Therefore, the ideal overlap width D may be specified as a width at which the left divided image L and the right divided image R should be overlapped at a minimum. Although depending on the method used for overlay synthesis, a balanced result can be obtained by specifying a value of about 5% to 10% of the width pw of the partial image P as the ideal overlay width D.

  Here, the actual overlap width C cannot be directly specified due to the nature of the problem to be solved by the above-described method of the present invention. When an appropriate value is not given as the actual overlapping width C, the generated texture image is not matched with the width tw, which is the width of the normal texture image T, even if the synthesized partial images Q are arranged by an arbitrary number of repetitions n. The left and right ends of T cannot be connected smoothly. Therefore, by designating the ideal overlap width D, the width tw of the texture image T that is close to the ideal overlap width D and that is finally generated by repeating the natural number of times can be filled. An appropriate actual overlap width C is obtained.

The control unit 201 uses the ideal overlap width D and the texture width tw of the final texture image T as the repetition number calculation process corresponding to the repetition number calculation unit 1003, and finally outputs the combined partial images Q. The number of repetitions n of the combined partial image Q for filling the texture image T to be filled is calculated (step S504).
The texture width Tw of the texture image T, the width pw of the partial image P, and the ideal overlay width D
Number of repetitions: n = Ceil (tw / (pw−D)) (1)
However, Ceil (X) is a function that returns the smallest integer equal to or greater than the real number X.

  The control unit 201 uses the repetition number n, the width pw of the partial image P, and the width tw of the texture image T as the superposition actual value calculation processing corresponding to the superposition actual value calculation unit 1004. The width C is calculated (step S505).

When the synthesized partial image Q having the width (pw−D) obtained by performing the overlay synthesis using the ideal overlay width D is repeated n times, it extends over the width of n * (pw−D) −tw. Thus, a part of the synthesized partial image Q protrudes outside the texture image T. Here, if the width of the composite partial image Q is slightly reduced, that is, if the overlapping width is slightly increased, the texture width Tw can be matched with the texture image T when it is repeated n times. Since the expected width of the composite partial image Q is tw / n, the actual overlap width C for obtaining this width is calculated using Equation (2).
The number of repetitions n, the width pw of the partial image P, the texture width tw of the texture image T,
Actual overlay width: C = pw−tw / n (2)

The control unit 201 uses the actual overlap width C, the left divided image L obtained by dividing the partial image P, and the right divided image R as an image overlay combining process corresponding to the image overlay combining unit 1005. A composite partial image Q for performing is generated (step S506). In superimposing the images, the positions of the left divided image L and the right divided image R are exchanged, and the images are superimposed toward the center. As described in the image division processing in step S502, the superimposed partial image Q is superimposed on either the left or right side, as described in the image division processing in step S502, where the positions of the left divided image L and the right divided image R are switched. Connect smoothly.
Note that the overlay synthesis process is executed only once for the entire algorithm regardless of the number of repetitions n. Therefore, even if a relatively heavy processing load is used as the synthesis process performed after the overlay, the processing time of the entire algorithm is reduced. There is an effect of not having much influence.

  As for the composition processing after superimposition, the colors of both the left divided image L and the right divided image R may be mixed in half, or the left divided image L and the right divided image R may be overlapped at the end on the overlapping side. The mixing ratio may be changed according to the distance from the position, and is not specified by the algorithm in the present invention. This kind of composition processing is a widely performed matter in the field of computer graphics. For example, “Image Processing <Image Processing Standard Textbook>, Foundation for Image Information Education Promotion, First Print Issue; February 25, 1997, P214 to 218” includes a processing of a mosaic that connects adjacent images. For two adjacent images, (1) density correction, (2) division image alignment and coordinate system unification, (3) density conversion (color matching), (4) should be joined Searching for a point (joint point) that is most likely to be joined in the cross section in the horizontal direction, and (5) performing a synthesis process by smoothing the concentration around the joint point.

The control unit 201 generates a final texture image T by using the combined partial image Q that is superimposed and combined and the number of repetitions n as an image repetition arrangement process corresponding to the image repetition arrangement unit 1006 (step S507). .
In addition, when the original partial image P is cut out from the inside of the incomplete texture image, by adjusting and repeating the start position, the obtained texture image T and the original incomplete texture image are The deviation can be reduced. When the start position is adjusted and repeated, if a part of the composite partial image Q is carried over at the end of the texture image T, the carry-over part is placed at the opposite end of the texture image T and the processing is continued. Thus, when it is arranged n times, it is possible to completely fill up to the repeated start position.

  Next, image processing for complementing an invalid area on a texture image corresponding to a portion not shown in a photograph will be described using a ceramic photo image 31 which is an example of an embodiment of the image processing apparatus 100. . FIG. 7 is a diagram illustrating a transition of a processed image in a case where an invalid area on a texture image corresponding to a portion not shown in a photograph is complemented using a ceramic photograph image.

As shown in FIG. 7, for example, in the case of complementing the invalid area 35 on the texture image corresponding to the portion not shown in the photograph using the ceramic photograph image 31, the control unit 201 preliminarily displays the object as a camera, A plurality of photographic images 31 photographed by a digital camera or the like are stored in the storage unit 202, the shape data 32 is extracted from the selected photographic image 31, and the texture image is based on the photographic image 31 and the shape data 32. Are sampled to generate a sampled image 33. The texture sampling image 33 includes an effective area 34 corresponding to a portion of the ceramic front and the like, and an invalid area 35 corresponding to a portion of the ceramic back and not the photo. The control unit 201 extracts a partial image P that is arbitrarily smaller than the size of the texture image to be generated from the effective area 34 of the sampling image 33 of the texture image.
The control unit 201 uses the texture image generation unit 103 to generate and complement the texture image T using the acquired ceramic partial image P. For example, a plurality of various texture images T such as a lip, a trunk, a waist, and a hill, which are components of ceramics, are generated and complemented.
The control unit 201 pastes the generated texture image T on the shape data 32, renders it in consideration of viewpoint information, light source information, and the like, and generates a ceramic image 36. The user can view the ceramic image 36 as a three-dimensional image while moving the viewpoint to the back or inside of the ceramic.

  As described above, according to the embodiment of the present invention, the image processing apparatus 100 that executes the texture image generation method performs the texture width of the texture image T to be generated in the processing on the horizontal component of the texture image T. The condition setting unit 1000 that acquires tw and the partial image P smaller than the size of the texture image T, and the partial image P are divided into two at a predetermined division ratio to generate a left divided image L and a right divided image R An image dividing unit 1001 to perform, a width lw of the left divided image L, a width rw of the right divided image R, an ideal overlapping value setting unit 1002 that sets an ideal overlapping width D smaller than both, and an ideal overlapping width D, a repeat count calculation unit 1003 for calculating the repeat count n of the composite partial image Q based on the texture width tw of the texture image T and the width pw of the partial image P; A superimposed real value calculation unit 1004 that calculates an actual overlapping width C using the width pw of the image P, the texture width tw of the texture image T, and the number of repetitions n, the left divided image L, and the right divided image R And an actual superposition width C, and superimposing and synthesizing the divided images to generate a composite partial image Q, and the composite partial image Q is arranged side by side by the number of repetitions n, and the texture image An image repetitive arrangement unit 1006 for generating and complementing T is provided, a predetermined pattern is repeated, and a texture image T that smoothly connects ends thereof is generated. Based on the generated texture image T and its shape data, rendering is performed in consideration of viewpoint information, light source information, etc., and an image is generated and displayed.

As a result, even if the extracted texture image has no periodicity, such as when trying to supplement the invalid area on the texture image corresponding to the part not shown in the photograph using the photographic image, the texture Using a partial image that does not satisfy the periodicity extracted from the effective area portion of the image, a texture image of a predetermined size in which a certain pattern is repeated and ends thereof are smoothly connected It can be created and complemented.
Since the image overlay synthesis process does not depend on the number of repetitions and is executed only once for the entire algorithm, even if a relatively heavy processing load is used as the synthesis process performed after the overlay, the processing time of the entire algorithm is not much. There is an effect that high-speed processing can be realized without affecting.
The combination of the number of repetitions calculated by the repetition number calculation unit 1003 and the actual overlap width calculated by the overlap actual value calculation unit 1004 is less than the ideal overlap width given by the overlap ideal value setting unit 1002. In addition, under the condition that the edges of the obtained texture image T are smoothly connected to each other, it becomes closer to the ideal overlap width than any other combination of the number of repetitions and the overlap width.

In this embodiment, texture sampling is performed from a photographic image, and a partial image is extracted and acquired. However, the present invention is not limited to this. For example, created texture material data may be used.
In the present embodiment, the size of the texture image is input and set from the input unit 205, but may be automatically calculated and set.
Further, in the present embodiment, the texture image generation process describes the process for the horizontal component of the texture image. Similar processing is performed for the vertical component. For the component in the vertical direction, the partial image P is divided using the width th that is the vertical width of the texture image size 10 to be generated and the partial image P, and is replaced and combined. Good. Further, when combining the vertical direction and the horizontal direction, the vertical direction may be processed and then the horizontal direction may be processed, or vice versa.

  Note that the program for performing the processing shown in FIGS. 4 and 5 may be distributed on a recording medium such as a CD-ROM, or the program may be transmitted and received via a communication line.

  The preferred embodiments of the ceramic production system and the like according to the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to such examples. It will be apparent to those skilled in the art that various changes or modifications can be conceived within the scope of the technical idea disclosed in the present application, and these are naturally within the technical scope of the present invention. Understood.

A block diagram showing a configuration of an image processing apparatus 100 according to the present embodiment Hardware configuration diagram of the image processing apparatus 100 The figure which shows the information which the memory | storage part 202 hold | maintains A flowchart showing an outline of processing of the image processing apparatus 100 Flowchart showing the processing procedure of texture image generation processing The figure which shows the texture image generation with respect to the component of the horizontal direction of the texture image T The figure which shows the transition of the process image in the case of complementing the invalid area | region on the texture image equivalent to the part which is not reflected in the photograph using the ceramic photo image 31

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ......... Image processing apparatus 101 ......... Parameter input means 102 ......... Partial image acquisition means 103 ......... Texture image generation means 104 ......... Image drawing means 1000 ......... Condition setting unit 1001 ......... Image division Numeral 1002... Superimposing ideal value setting unit 1003... Repeat number calculation unit 1004... Superimposing actual value calculation unit 1005. Control unit 202... Storage unit 205 ... Input unit 206 ... Display unit 31 ... Photo image 41 ... Input / output information 10 ... Texture image size T T ... Texture image tw ... Texture width of texture image T P ......... Partial image L ......... Left split image lw ......... Left split image width R ......... Right split image rw ......... Right split Width of image Q ......... Composite partial image qw ......... Width of composite partial image C ......... Actual overlay width D ......... Ideal overlay width n ......... Number of repetitions

Claims (13)

A texture image generation method for generating a texture image that repeats a predetermined pattern based on a partial image and smoothly connects the ends thereof,
A condition setting step for setting a size of the texture image to be generated and a partial image smaller than the size of the texture image;
An image dividing step of appropriately dividing the partial image into two and generating a divided image;
A superimposing ideal value setting step for setting an ideal superimposing width which is a reference for obtaining an actual superimposing width smaller than the width of the divided image;
Based on the ideal overlap width, the width of the texture image, and the width of the partial image, a repetition number calculation step of calculating the number of repetitions of the combined partial image,
Using the width of the partial image, the width of the texture image, and the number of repetitions to calculate an actual overlap width;
Using the divided image and the actual overlapping width, an overlapping composition step of performing overlay composition of the divided image and generating a composite partial image;
An image repeating arrangement step of arranging the combined partial images by the number of repetitions and generating a texture image; and
A texture image generation method comprising: 2. The texture image generation method according to claim 1, wherein the size includes a horizontal width for a horizontal component and a vertical width for a vertical component. The texture image generation method according to claim 1, wherein in the image superimposing and synthesizing step, the divided divided images are replaced and synthesized. 2. The texture image generation method according to claim 1, wherein a processing step for a horizontal component of the texture image and a processing step for a vertical component are performed in combination. An image processing apparatus comprising a computer,
Obtaining means for obtaining a size of the texture image to be generated and a partial image smaller than the size of the texture image;
A texture image generating means for generating a texture image of the size of the texture image in which a predetermined pattern is repeated based on the partial image and the ends thereof are smoothly connected;
An image generating means for generating an image based on the generated texture image, shape data, and input viewpoint information;
With
The texture image generating means
Condition setting means for setting the size of the texture image and a partial image smaller than the size of the texture image;
Image dividing means for appropriately dividing the partial image into two and generating a divided image;
A superimposing ideal value setting means for setting an ideal superimposing width which is a reference for obtaining an actual superimposing width smaller than the width of the divided image;
Based on the ideal overlap width, the width of the texture image, and the width of the partial image, a repetition number calculating means for calculating the repetition number of the combined partial image,
A superimposed real value calculating means for calculating an actual overlapping width using the width of the partial image, the width of the texture image, and the number of repetitions;
Using the divided image and the actual overlapping width, an overlapping composition unit for performing composition of the divided image and generating a combined partial image;
Image repeated arrangement means for arranging the combined partial images by the number of repetitions and generating a texture image;
An image processing apparatus comprising: The acquisition means includes
6. The image processing apparatus according to claim 5, wherein the partial image is acquired by sampling a texture image from two-dimensional image data and shape data thereof. 6. The image processing apparatus according to claim 5, wherein the image superimposing and synthesizing unit replaces the divided divided images and superimposes and synthesizes them. The image processing apparatus according to claim 5, wherein the sizes are a horizontal width for a horizontal component and a vertical width for a vertical component. The texture image generating means
6. The image processing apparatus according to claim 5, wherein the processing for the horizontal component of the texture image is combined with the processing for the vertical component.   The program for making a computer perform the texture image generation method in any one of Claims 1-4.   A recording medium on which a program for causing a computer to execute the texture image generation method according to claim 1 is recorded. A program that causes a computer to function as the image processing apparatus according to any one of claims 5 to 9. A recording medium storing a program that causes a computer to function as the image processing apparatus according to claim 4.

Images