JP2005229189A - Stereoscopic image data generation method and apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily form a stereoscopic image with a high stereoscopic expression effect including a degree of elevation in accordance with a feature quantity such as a hue of an original image. <P>SOLUTION: A stereoscopic instruction section 21 designates a hue range of a stereoscopic print object by using a start position, an end position and an angle assigning direction on a hue circle. A feature quantity extract section 22 extracts hue data corresponding to a hue within a hue range designated by the stereoscopic instruction section 21 from original image data received from an image input apparatus 10. A stereoscopic image data generating section 23 generates stereoscopic image data (including height information corresponding to the hue data) for forming a stereoscopic image corresponding to the original image data on the basis of the hue data extracted by the feature quantity extract section 22. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a stereoscopic image data generation method and apparatus for generating stereoscopic image data for forming a stereoscopic image corresponding to original image data. More specifically, the present invention extracts feature amounts including at least hue information from original image data. The present invention also relates to a stereoscopic image data generation method and apparatus for creating stereoscopic image data for forming the stereoscopic image based on the extracted feature amount.

  Printed materials obtained by forming an image of a non-stereoscopic image extending in a two-dimensional direction on a medium such as recording paper are widely used in various everyday situations.

  In addition, there is a printed matter in which a three-dimensional shape is physically formed in a non-stereoscopic image, and such a printed matter provides, for example, the following added value.

・ Recognize objects represented by non-stereoscopic images as stereoscopic objects.
・ Unique textures such as oil paintings can be expressed.
・ Characters and patterns can be partly projected and emphasized, and the printed matter can be given a high-class feel.
・ It is possible to provide universal prints that can be used not only by vision but also by tactile senses and can be used by visually impaired people.

  By the way, as a method for forming such a three-dimensional shape, for example, data indicating the three-dimensional shape is created, and a photocurable resin is irradiated with light based on this information to form a plate, and a medium such as recording paper There is a method of forming a three-dimensional shape by pressing against the surface.

  However, in this method, since a three-dimensional sample corresponding to the image is created and the surface shape of the three-dimensional sample is measured and processed, the data indicating the three-dimensional shape is designed from the beginning. It was costly.

  In addition, as a publicly known example other than the above, for example, in Japanese Laid-Open Patent Publication No. 7-175201 (Patent Document 1), light that has passed through a photographic film is exposed to a heat-sensitive resin and developed, and according to the density of image data. A method of manufacturing a three-dimensional plate is disclosed.

Japanese Laid-Open Patent Publication No. 6-320855 (Patent Document 2) discloses a method of forming an ultraviolet curable transparent resin layer on a non-stereo image at a height corresponding to the color image density of the non-stereo image. Yes.
JP-A-7-175201 JP-A-6-320855

  However, in the method described in Patent Document 1, height information directly writes information indicating the height according to the amount of light that has passed through the film (thermal type), so it is necessary to prepare a photographic film or the like, It could not be widely used in other systems.

  In addition, in the method described in Patent Document 2, an image portion such as a shadow of an object that is not originally expressed by a convex portion is created in a convex shape because of its high density. The effect was not always obtained.

  Further, since a non-stereoscopic image is observed through a three-dimensional transparent resin layer, there is a problem that the image looks distorted due to a lens effect or the like.

  In addition, when a stereoscopic image is formed from an original image having areas with similar hues, such as maps and clothes patterns, the problem is that the areas with similar hues have the same height and the stereoscopic expression effect is low. There was a point.

  The present invention solves the above-described problems and provides a method and apparatus for generating stereoscopic image data that can easily form a stereoscopic image having a high stereoscopic effect and having a height difference corresponding to a feature amount such as hue of the original image. Objective.

  In order to achieve the above object, according to the first aspect of the present invention, a feature quantity including at least hue information is extracted from original image data, and a stereoscopic image corresponding to the original image data is formed based on the extracted feature quantity. Generating stereoscopic image data for the purpose.

  According to a second aspect of the present invention, in the first aspect of the invention, the stereoscopic image data includes height information corresponding to each pixel, and the height information includes at least a hue of each pixel of the original image data. It is characterized by being set corresponding to

  The invention according to claim 3 is the invention according to claim 2, wherein the height information is set corresponding to a region included in a specified hue range of the original image data. .

  According to a fourth aspect of the present invention, in the third aspect of the present invention, the hue range is specified by a start position, an end position, and an angle allocation direction on the hue circle.

  The invention according to claim 5 is the invention according to claim 3, wherein a change pattern of the height information in an area included in the specified hue range is specified, and the area is determined according to the specified change pattern. The height information at is set.

  According to a sixth aspect of the present invention, in the second aspect of the present invention, the stereoscopic image is formed by transferring a heat-foamable toner onto a sheet and performing a heat treatment, and the height information is the heat-foamable property. The transfer density of the toner is indicated.

  According to a seventh aspect of the present invention, there is provided a feature quantity extracting means for extracting a feature quantity including at least hue information from original image data, and a stereoscopic image corresponding to the original image data based on the feature quantity extracted by the feature quantity extracting means. 3D image data generating means for generating 3D image data to be formed.

  The invention according to claim 8 is the invention according to claim 7, wherein the stereoscopic image data includes height information corresponding to each pixel, and the stereoscopic image data generation means converts the height information into the original image. It is characterized in that it is set corresponding to at least the hue of each pixel of data.

  The invention according to claim 9 is the invention according to claim 8, wherein the feature amount extraction means is designated by a first designation means for designating a hue range of the original image data and the first designation means. Region extraction means for extracting a region included in the hue range of the original image data, wherein the stereoscopic image data generation means corresponds to the region where the height information is extracted by the region extraction means. It is characterized by setting.

  According to a tenth aspect of the present invention, in the ninth aspect of the invention, the first designation means designates a hue range of the original image data based on a start position, an end position, and an angle assignment direction on the hue circle. It is characterized by that.

  The invention described in claim 11 further comprises second specifying means for specifying a change pattern of the height information in an area included in the specified hue range in the invention described in claim 9 above, The height information in the area extracted by the area extracting means is set according to the change pattern set by the second specifying means.

  The invention according to claim 12 is the invention according to claim 8, wherein the three-dimensional image is formed by transferring a heat-foamable toner onto a sheet and performing a heat treatment, and the height information is the heat-foamable property. The transfer density of the toner is indicated.

  According to the present invention, a feature quantity including at least hue information is extracted from original image data, and based on the extracted feature quantity, stereoscopic image data for forming a stereoscopic image corresponding to the original image data is created. In response to a request for expressing a height difference according to a feature amount such as hue in image data, a stereoscopic image having a high stereo effect with a height difference corresponding to the feature amount can be easily formed.

  In the present invention, there is a designation means for designating the hue range of the original image data, and the height information is set by extracting an area included in the hue range of the original image data designated by the designation means. In order to generate stereoscopic image data, the user only needs to specify the hue range using the setting unit when forming a stereoscopic image having a high stereoscopic effect with a height difference corresponding to the hue. The instruction operation is extremely simple.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

  FIG. 1 is a schematic block diagram showing an example of a configuration of an image forming system 50 to which a stereoscopic image data generation method according to the present invention is applied.

  The system 50 includes an image input device 10 that inputs image data of a non-stereo image (an image extending in a two-dimensional direction), such as a scanner, a reader that reads image data from a recording medium of a digital camera, or a host computer that prints image information. An image processing device that processes image data (original image data) input from the image input device 10 to generate stereoscopic image data having height direction data or non-stereo image data not having height direction data 20, an image forming apparatus 30 that forms an image on a recording medium based on stereoscopic image data and non-stereoscopic image data generated by the image processing apparatus 20.

  The image processing apparatus 20 includes a three-dimensional instruction unit 21 that is a user interface (UI) for instructing (three-dimensional instruction) to perform a process of forming a three-dimensional image based on a feature amount such as hue in the original image data, a three-dimensional instruction Based on the three-dimensional instruction from the unit 21, the feature quantity extraction unit 22 that extracts the feature quantity such as the specified hue from the original image data, and the feature quantity extracted by the feature quantity extraction unit 22, the original source that is the extraction source Stereo image data generator 23 for generating stereo image data for forming a stereo image corresponding to the image data, color image data generator 24 for generating color image data from color information of the original image data, stereo image data, and color An output tone correction unit 25 for correcting the output tone of the image data is provided.

  Here, the image forming apparatus 30 forms a color image on a recording medium (recording paper) using toner of each color such as Y (yellow), M (magenta), C (cyan), and K (black). An image forming unit (non-stereoscopic image forming unit), and, for example, a thermally foamable toner (hereinafter, foamed toner) that is composed of a binder resin and a foaming agent and expands in volume by heat when fixing each color toner on a recording medium. ), And an apparatus such as an electrophotographic forming apparatus having a stereoscopic image forming unit that forms a stereoscopic image.

  In this system 50, an original image such as a printed matter is input as original image data by an image input device 10 such as a scanner, and is transmitted to the image processing device 20 as color data composed of R, G, B or monochrome digital data. The

  In the image processing device 20, the feature amount extraction unit 22 is sent from the image input device 10 when the stereoscopic instruction unit 21 gives a stereoscopic instruction to form a stereoscopic image based on a certain feature amount. The feature amount is extracted from the original image data and input to the stereoscopic image data generation unit 23.

  The stereoscopic image data generation unit 23 generates stereoscopic image data for forming a stereoscopic image corresponding to the original image data based on the feature amount extracted by the feature amount extraction unit 22, and sends it to the output tone correction unit 25. Send it out.

  Here, the stereoscopic image data has height information (H) corresponding to each pixel, and this height information (H) is the feature amount of each pixel of the original image data in the stereoscopic image generation unit 23. It is set corresponding to (instructed in advance from the three-dimensional instruction unit 21 and extracted by the feature amount extraction unit 22).

  In the stereoscopic image data generation unit 23, the height information (H) is handled as a gradation value for each pixel, as in normal image formation (non-stereoscopic image formation).

  This gradation value is a foamed toner image obtained by developing an electrostatic latent image formed corresponding to each pixel with foamed toner at the time of image formation in the stereoscopic image forming unit of the image forming apparatus 30 described in detail later. This is reflected in the transfer density (toner amount) to the recording medium.

  The transfer density (toner amount) of the foamed toner image determines the height of the foamed toner (the higher the toner amount, the higher the three-dimensional shape). As height information (H) to be added to the image data, the transfer density of the foamed toner is instructed.

  When the gradation value of each pixel of the stereoscopic image data is maximum (for example, 100), it indicates the maximum height of the stereoscopic image that can be formed by the image forming apparatus 30, and when the gradation value is minimum (for example, 0), Indicates the minimum height of a stereoscopic image.

  On the other hand, the color image data generating unit 24 uses the original image data sent in R, G, B, or monochrome to form a recording material (toner) used in the image forming unit 30 in order to form an image of a non-stereo image. The color is converted in accordance with the color () and sent to the output tone correction unit 25.

  The output tone correction unit 25 corrects the output tone of the stereo image data input from the stereo image data generation unit 23 and the color image data input from the color image data generation unit 24, and then the stereo image data And color image data are superimposed, for example, and the superimposed image data obtained thereby is sent to the image forming apparatus 30.

  Here, the superimposition may be a simple synthesis of stereoscopic image data and color image data. Further, the color image data and the color image data may be sent to the image forming apparatus 30 without superimposing the stereo image data and the color image data.

  The image forming apparatus 30 forms a superimposed image on which a color image and a three-dimensional image are superimposed on a recording medium based on, for example, superimposed image data input from the output gradation correction unit 25.

  When the stereoscopic image data and the color image data are received, a stereoscopic image and a color image are formed on the recording medium based on the respective image data.

  Next, stereoscopic image data generation processing in the image processing apparatus 20 will be described with reference to the flowchart shown in FIG.

  As shown in FIG. 2, in this system 50, in the image processing device 20 to which the original image data is input from the image input device 10, first, whether the stereoscopic image area for forming the stereoscopic image is specified by the stereoscopic instruction unit 21. It is determined whether or not (step S100).

  If it is determined that the stereoscopic image area is designated (YES in step S100), the image in the designated area is cut out (step S101), and the image information (feature amount: at least hue) designated from the stereoscopic instruction unit 21 is also used. ) Is extracted by the feature amount extraction unit 22 (step S102).

  If it is determined that the stereoscopic image area is not designated (NO in step S100), the feature amount extraction unit 22 extracts the feature amount from the image data of the entire region (step S102).

  Then, the image type of the non-stereo image designated by the user (for example, oil painting / wallpaper, print / design image, diagram / tactile drawing, photograph / natural image, etc.), or hue / lightness (characteristic amount used at the time of conversion) B), saturation (S), edge (E) indicating the contour of the image, image density (C) (including negative / positive designation), height information corresponding to the image type or feature amount ( Image data processing for generating stereoscopic image data for forming a stereoscopic image is performed (step S103).

  When the feature quantity to be extracted is directly designated from the stereoscopic instruction unit 21, the image type is determined from the feature quantity and the stereoscopic image data generation process is performed with the gradation reversed as necessary.

  Thereafter, the output gradation of the generated stereoscopic image data is corrected by the output gradation correction unit 25 (step S104), and the stereoscopic image data is completed (step S105).

  Here, the correction of the output gradation (transfer density of the foamed toner) is performed according to the conditions designated by the user from the stereoscopic instruction unit 21 such as the height of the stereoscopic image and the stereoscopic shape.

  For example, since the upper and lower limits of the height of the stereoscopic image that is actually formed are determined by the performance and settings of the image forming apparatus 30, a specific height designation or a stage designation such as high, medium, low, etc. The gradation is corrected according to the above.

  In addition, if there is a specification to sharpen the 3D shape of the 3D image, the gradation curve should be corrected by increasing the gradient with respect to the gradation, and if it is specified to be mild, it will be made gentler. By performing, it becomes possible to control the shape according to preference.

  Next, an image forming operation of the image forming apparatus 30 will be described.

  The image forming apparatus 30 includes stereoscopic image data [having a height (H) component] generated from the image processing apparatus 20 through image processing as shown in FIG. 2 and color image data (non-stereo image data: Y , M, C, and K components), a stereoscopic image forming unit that forms a stereoscopic image using the foamed toner (H) based on these image data, and each color component of Y, M, C, and K An image forming process by an electrophotographic process is performed by a corresponding image forming unit.

  First, regarding the stereoscopic image data, the above-described stereoscopic image forming unit performs exposure scanning using the gradation data (height information = density information) of the height component included in the stereoscopic image data, thereby performing the scanning on the photoconductor. Then, an electrostatic latent image is formed, and then the electrostatic latent image is developed using foamed toner to form a foamed toner image, and this foamed toner image is further transferred to a recording medium.

  For color image data, each of the image forming units performs exposure scanning using gradation data of components (Y component, M component, C component, K component) corresponding to each of the color image data. To form an electrostatic latent image on the photosensitive member, and then developing the electrostatic latent image using toner of each color component to form a toner image of each color component. Multiple transfer to a recording medium.

  When the transfer process is completed, the image area corresponding to the above-described stereoscopic image data is in a state where the toner images of the respective colors are multiplex-transferred onto the foamed toner image.

  The recording medium after completion of the transfer process is then sent to the fixing unit, where the toner image is fixed. At this time, the image area corresponding to the stereoscopic image data is a stereoscopic image in which the lowermost foamed toner image is foamed by the heat at the time of fixing to form a three-dimensional image, and a multi-color mixed image by each color toner image is fixed thereon. It is formed on a recording medium.

  In the fixing step, the height of the stereoscopic image when the foamed toner image is heated and foamed to form a stereoscopic image is the height information (gray scale) set for the corresponding pixel of the stereoscopic image data forming the stereoscopic image. Value = density information).

  As described above, according to the image processing apparatus 20 of the present invention having a processing function (see FIG. 2) for extracting feature amounts from original image data and generating stereoscopic image data, for example, extraction from the stereoscopic instruction unit 21 A three-dimensional image in which a hue is designated as a feature amount to be extracted, the designated hue is extracted from original image data input from the image input device 10, and height information is set for each pixel having the hue based on the extracted hue. Operation such as generation of image data is possible.

  In order to realize this operation, the three-dimensional instruction unit 21 has a three-dimensional instruction function for performing three-dimensional printing using a hue as a key and instructing a three-dimensional target region (hue range).

  FIG. 3 is a diagram illustrating an example of a UI screen (stereoscopic output designation screen) 210 that realizes a stereoscopic instruction function using the hue in the stereoscopic instruction unit 21 as a key.

  In particular, the three-dimensional output designation screen 210 holds the data of a hue circle having a hue arrangement according to a certain rule on the image processing apparatus 20 side, and instructs the hue to be extracted from the hue arrangement in the hue circle. It is applied when doing.

  Prior to the detailed description of the three-dimensional output designation screen 210, the hue circle used in the system 50 of the present invention will be described first.

  In the present invention, the image processing apparatus 20 holds, for example, Munsell hue ring data as the above-described hue ring.

  FIG. 4 is a diagram showing the Munsell hue circle. As shown in the figure, in the Munsell's hue circle, first, the hues are basically R (red), YR (yellow red), Y (yellow), GY (yellowish green), G (green), BG (blue). Green), B (blue), PB (blue purple), P (purple), and RP (red purple) are divided into 10 types. The hue is arranged in a ring shape.

  In this hue ring, for example, in the case of R, 5R indicates the color that is the center of R, and the smaller the number is, the closer the hue is to RP, and the larger the number is, the closer the hue is to YR.

  When the Munsell hue ring shown in FIG. 4 is used, for example, as shown in FIG. 5, by specifying a certain hue as a start point and another hue as an end point, an angle range between the start and end points The hue within can be selected.

  In this case, the angle range from the start point to the end point is both clockwise and counterclockwise, and the hue to be selected is completely different depending on whether the range is clockwise or counterclockwise.

  Therefore, when specifying the selection range of the hue by specifying the start point and the end point as shown in FIG. 5, the angle of measuring the ring clockwise or counterclockwise as shown in FIG. It is necessary to further specify the allocation direction.

  The three-dimensional output designation screen 210 in FIG. 3 is a range of hues to be three-dimensionally printed by designating the start and end points on the Munsell hue ring and the direction of angle assignment, as described with reference to FIG. (Stereoscopic target range) is designated, and further, a height is designated corresponding to an area included in the designated hue range.

  The 3D output instruction screen 210 is first provided with a tool 211 for instructing whether or not to perform 3D printing (“3D printing”). With this tool 211, it is possible to instruct whether or not to perform stereoscopic printing depending on whether or not the corresponding check box is checked.

  Also, on the 3D output instruction screen 210, there is a tool 212 for designating the “maximum height value” in the 3D object range designated using the “height allocation designation by hue ring” function section described later on this screen. Provided. In this tool 212, a desired numerical value can be designated as the maximum height (unit = mm) by inputting a desired numerical value in the corresponding input box.

  Further, the three-dimensional output instruction screen 210 uses the Munsell hue ring shown in FIG. 4 and designates the hue of the three-dimensional object range by the method shown in FIG. 5 (“designation of height allocation by hue ring”). Parts are provided.

  The function unit first selects the hue value (10Y in this example) corresponding to the start point shown in FIG. 5 in the Munsell's hue ring from the corresponding selection box, thereby starting the position of the hue in the stereoscopic target range. ("Specify start position") tool 213, and the hue value (5G) corresponding to the end point of FIG. 5 in the same hue circle from the corresponding selection box, the hue of the three-dimensional object range is selected. A tool 214 for designating an end position (“designation of end position”) is provided.

  In addition, the function unit is provided with a tool 215 for designating the “angle assignment direction” described in FIG. 5 in the Munsell hue circle. With this tool 215, the angle assignment direction can be designated by selecting “clockwise” or “counterclockwise” using the corresponding selection box.

  In addition, the function unit is provided with a tool 216 for designating a “height change method” for a hue within the range between the start position and the end position designated using the tools 213 and 214.

  FIG. 6 shows an example of the height change method (height change pattern) that can be specified by this tool 216. FIG. 6A shows the height corresponding to the hue between the start point and the end point. Shows a pattern (waveform) that changes into a wave shape with the intermediate point as the maximum value, and FIG. 8B shows a linear shape so that the height gradually increases from the start point to the end point. A changing pattern (linear type) is shown.

  In this tool 216, by selecting a wave type change pattern [see FIG. 6 (a)] or a linear type change pattern (see FIG. 6 (b)) from the corresponding selection box, the height change pattern is selected. Can be specified.

  In addition, for example, the number of waves when the “height change method = wave type” is designated by the tool 216 or the height when the “height change method = linear type” is designated by the tool 216. A tool 217 for specifying the height change pattern more finely such as gradually increasing or decreasing is provided.

  In particular, in this example, in response to the designation of “height change method = wave type” by the tool 216, an example is given in which “number of waves = ½” is designated by the tool 217.

  In addition, the function unit is provided with a display area 218 that displays the specified content of the three-dimensional object range specified by the tools 213 to 217 and the hue height change pattern in the range in an image.

  In this example, regarding the stereoscopic target range, an image in which the stereoscopic target range is set clockwise is displayed with 10Y as the start position and 5G as the end position corresponding to the designation from the tools 213, 214, and 215 ( Display 1).

  As for the height change method, an image in which a height change pattern is set (corresponding to the designation from the tools 216 and 217) and is a wave shape and the number of waves is ½ is displayed (displayed). 2) has been done.

  Further, on this three-dimensional output designation screen 210, an “OK” button 219 for instructing to start printing under the setting conditions designated by the above tools in this screen, and “Cancel” for instructing to cancel the setting. ”Button 220 and a“ return to standard ”button 221 for instructing to return the setting to the standard setting.

  Now, using the stereoscopic output designation screen 210 for a certain original image data, for example, the contents “start position = 10Y, end position = 5G, angle assignment direction = clockwise, height as shown in FIG. When a three-dimensional output designation is made with “change method = wave type, number of waves = 1/2, maximum height = 3 mm”, and an instruction to start printing (“OK” button pressed) is given, this system 50 In accordance with the flowchart shown in FIG. 7, a stereoscopic image data generation process by hue extraction is performed.

  In starting the stereoscopic image data generation process, the image processing apparatus 20 determines whether or not the stereoscopic output designation (stereoscopic output designation of the designated content illustrated in FIG. 3 + print start instruction) is performed on the stereoscopic output designation screen 210. Monitoring is performed (step S200).

  Here, when the above three-dimensional printing is designated (YES in step S200), the feature amount extraction unit 22 starts, ends, and angles on the hue circle designated by the tools 213, 214, and 215 on the three-dimensional output designation screen 210. The range of hues to be extracted is specified from the allocation direction, and the hue data corresponding to the hues of the specified hue range is extracted from the original image data input from the image input device 10 (step S201).

  Next, the stereoscopic image data generation unit 23 generates stereoscopic image data for forming a stereoscopic image corresponding to the original image data based on the hue data extracted by the feature amount extraction unit 22 (step S202).

  As a specific process of step S202, the stereoscopic image data generation unit 23 refers to the height change method and the specific height change pattern specified by the tools 216 and 17 on the stereoscopic output designation screen 210. For the pixel corresponding to each hue data extracted by the feature amount extraction unit 22, processing for setting height information corresponding to each hue is performed according to the height change pattern.

  By this processing, the stereoscopic image data generation unit 23 sets the height information (H) for the region (pixel) included in the hue range designated on the stereoscopic print designation screen 210 in the original image data. In addition, stereoscopic image data in which the height information has a value corresponding to the change pattern of the color relative height information designated in accordance with the range of the hue of the stereoscopic target on the stereoscopic printing designation screen 210 is generated.

  FIG. 8 is a conceptual diagram showing a stereoscopic image data generation image based on hue extraction from original image data in the stereoscopic image data generation unit 23.

  In FIG. 8, the upper row shows the three-dimensional target hue range designated on the three-dimensional output designation screen 210, and here, the Munsell hue ring (see FIG. 4) corresponding to the three-dimensional output designation content illustrated in FIG. 3. ) In the range of 10Y to 5G.

  The middle part of FIG. 8 shows the structure of the document information to be stereoscopically printed, and the document information includes 10Y, 4GY, and 8GY in the stereoscopic target hue range designated on the stereoscopic output designation screen 210 this time. , 2G, and 5G are included in each of the objects a1, a2, a3, a4, and a5.

  The lower part of FIG. 8 shows the height of the stereoscopic image data generated based on the hue extracted according to the designation of the stereoscopic target hue range in the upper part of FIG. 8 from the original image data of the document information shown in the middle part of FIG. FIG. 9 shows the structure of information as a cross-sectional image taken along line AA of the document information in the middle of FIG.

  In the lower part of FIG. 8, the left side is a waveform when a waveform change pattern as shown in FIG. 6A is set as the height change pattern corresponding to the hue in the stereoscopic target hue range in the upper part of FIG. 8. The right side shows the cross-sectional image configuration of the height information, and the right side shows the cross-sectional image configuration of the height information when the linear change pattern as shown in FIG. 6B is set as the height change pattern. Show.

  As can be seen from FIG. 8, in this system 50, when the original image data corresponding to the document information in the middle part of FIG. 8 is three-dimensionally printed, the three-dimensional target hue range in the upper part of FIG. When the waveform (see FIG. 6A) is designated as the change pattern, the pixel corresponding to the object a1 having the hue 10Y corresponding to the start position of the three-dimensional object range, and the end, as shown on the left side of the lower part of FIG. The minimum height h01 is set for each of the pixels corresponding to the object a5 having the hue 5G corresponding to the position, and the maximum height is set to the pixel corresponding to the object a3 having the hue 8GY corresponding to the substantially middle position of the stereoscopic target range. h18 is set, and the pixels corresponding to the objects a2 and a4 having the hues 4GY and 2G that are intermediate between the start position, the end position, and the intermediate position are set. Respectively, minimum height h01 and maximum height h08 intermediate height h14 is set.

  At this time, the height relationship set for the objects a1 to a5 having the hues of the three-dimensional print designation area has a shape corresponding to the height change pattern designated from the three-dimensional output designation screen 210, that is, a wave shape. .

  Further, in this system 50, when the original image data corresponding to the document information in the middle of FIG. 8 is three-dimensionally printed, the three-dimensional target hue range in the upper part of FIG. 8 is designated, and a linear type [ 6 (b)] is designated, the pixel corresponding to the object a1 having the hue 10Y corresponding to the start position of the three-dimensional object range and the three-dimensional object range as viewed from the start position, as shown on the right side of FIG. The pixel corresponding to the object a2 having the hue 4GY corresponding to the position of approximately 1/4, the pixel corresponding to the object a3 having the hue 8GY corresponding to approximately the middle position between the start position and the end position, and the three-dimensional object range as viewed from the start position. An object having a pixel corresponding to the object a4 having a hue 2G corresponding to the position of approximately 3/4, and a hue 5G corresponding to the end position of the stereoscopic target range Against 5, are sequentially height h20 that takes a large value, h24, h28, H211, H215 is set.

  At this time, the relationship between the heights set for the objects a1 to a5 having the hues of the three-dimensional print designation area is a shape corresponding to the height change pattern designated from the three-dimensional output designation screen 210, that is, a linear type (from the start position). Gradually increased to the end position).

  The stereoscopic image data generated by the stereoscopic image data generation unit 23 by the above process (see step S202 in FIG. 7 and FIG. 8) [including height information (H) corresponding to the hue specified as the stereoscopic target range] Is output together with the color image data (not including height information) generated by the color image data generation unit 24 after output gradation correction in the output gradation unit 25 and then to the image forming apparatus 30.

  In the image forming apparatus 30, as described above, from the image processing apparatus 20, stereoscopic image data (having a height (H) component) and color image data (non-stereoscopic image data: Y, M, C, K components) Based on these image data, a stereoscopic image forming unit that forms a stereoscopic image using the foamed toner (H), and an image forming unit corresponding to each color component of Y, M, C, and K, An image forming process is performed by an electrophotographic process.

  In particular, with respect to stereoscopic image data, the stereoscopic image forming unit performs exposure scanning using the gradation data (H: height information = density information) of the height component included in the stereoscopic image data, so Then, an electrostatic latent image is formed, and then the electrostatic latent image is developed using foamed toner to form a foamed toner image, and this foamed toner image is further transferred to a recording medium.

  The recording medium onto which the foamed toner image has been transferred (the toner images of the respective colors formed based on the color image data are also transferred in a multiple manner) is then sent to the fixing unit to fix the toner image. The image area corresponding to the three-dimensional image data is formed on the recording medium as a three-dimensional image in which the lowermost foamed toner image is foamed by the heat at the time of fixing to form a three-dimensional image, and a multi-color mixed image of each color toner image is fixed thereon. Formed.

  In the fixing step, the height of the stereoscopic image when the foamed toner image is heated and foamed to form a stereoscopic image is the height information (gray scale) set for the corresponding pixel of the stereoscopic image data forming the stereoscopic image. Value = density information).

  In the system 50 of the present invention, as an example of processing for setting the height information for each pixel constituting the stereoscopic image data, the range of hues to be extracted from the stereoscopic output designation screen 210 and the hues in the range are supported. The height change pattern is designated, and the image processing apparatus 20 extracts the hue in the designated range from the original image data, and outputs the three-dimensional output for each pixel having the hue based on the extracted hue. Height information (foaming toner density information) corresponding to the height change pattern designated from the designation screen 210 is set.

  As a result, when performing the stereoscopic image forming process based on the stereoscopic image data with the image forming image value 30, a stereoscopic image using the foamed toner having the density corresponding to the height information set in the stereoscopic image data is obtained. It is formed.

  Here, since the density of the foamed toner changes corresponding to the height change pattern set in advance from the three-dimensional output designation screen 210 corresponding to the hue of the pixel, the density of the foamed toner is increased after the heat foaming formed on the recording medium. The height of the three-dimensional image changes in height corresponding to the hue of the pixel in the three-dimensional image area (a height difference corresponding to the height information value (h) shown in the lower part of FIG. 8 is added). It becomes.

  As a result, in the system 50 of the present invention, even when performing stereoscopic printing using original image data having image portions with similar hues, the hue range of the stereoscopic object and the height change pattern corresponding to the hue of the range. Depending on the designation of the three-dimensional image, it is possible to obtain a three-dimensional image in which the image portions of these hues are clearly different in elevation.

  Therefore, the present invention can also be applied to a case where a stereoscopic image is formed from original image data having image portions with similar hues, such as map data and clothes pattern data. A three-dimensional image expressed by the difference can be formed, and the added value of the three-dimensional printed material based on this type of data can be further increased.

  Further, in the present invention, as a UI for instructing the stereoscopic printing of this kind of data, a stereoscopic output for designating a hue range to be extracted by designating a start position, an end position, and an angle allocation direction on the hue circle Since the designation screen 210 is provided, the three-dimensional output designation operation in the case of forming a three-dimensional image by extracting the hue as the feature amount for the above-described map data or the like is extremely simple.

  In the present invention, stereoscopic image data including height information (H) corresponding to a certain feature amount (including at least hue) included in the data is obtained from the two-dimensional image data (original image data) of the non-stereo image. Since the data is generated, the data generation time required so far can be greatly shortened.

  In addition, since the stereoscopic output designation screen 210 has a function for designating a height change pattern corresponding to the hue in the designated range together with the extraction target hue range, the stereoscopic image height is associated with the hue. It can be changed into a wave shape or a straight line with a simple instruction operation.

  In the above embodiment, the height change pattern specified from the three-dimensional output specification screen 210 is a pattern in which the height changes in a wave shape with the intermediate position between the start position and the end position as the maximum value [FIG. 6 (a). (See FIG. 6 (b)) in which the height increases with a constant change amount from the start position to the end position. (Number of waves = 1, 1/4,...), Any height change pattern, such as changing the height change in the linear type (for example, the height decreases with a constant change amount from the start position to the end position). Can be specified.

  Further, the basic shape of the height change pattern is not limited to the wave shape and the linear shape, and various shapes such as a triangular shape can be adopted.

  In the above embodiment, an example (see FIG. 3) in which one range is specified as the hue range of the three-dimensional object from the three-dimensional output designation screen 210 has been described. However, as a configuration in which a plurality of hue ranges can be specified from the screen 210. Also good.

  In the above-described embodiment, the stereoscopic target hue range is specified using the Munsell hue ring. However, the present invention is not limited to this, and the stereoscopic target hue range is specified using another hue ring or another color expression tool. You may do it.

  For example, as this type of color expression tool, Munsell's color solid diagram that combines three elements of hue, lightness, and saturation to represent the color in three dimensions (lightness is the vertical axis, hue is centered on the vertical axis) The outer circumference and saturation are represented by the radius of the circle), the hue and saturation are represented by the coordinates of x (small x) and y (small y), and the brightness Y (large Y) is the reflectance at that point. Yxy color system expressed in% (percent), L * (Elster) represents lightness, a * (Aster), b * (Biester) is a color space with a certain L * value An L * a * b * color system that represents the position on the plane of time (two-dimensional) can be used.

  When such a color expression tool is used, for example, the height assignment designation function unit (corresponding to “height assignment designation by the hue circle” in the example of FIG. 3) on the three-dimensional output designation screen 210 conforms to the color expression method. Needless to say, it is necessary to change as appropriate.

  As described above, the image processing apparatus 20 according to the present invention extracts feature amounts from original image data, and generates stereoscopic image data for forming a stereoscopic image corresponding to the original image data based on the extracted feature amounts. Although it has a processing function to be generated (see FIG. 2), for example, brightness, saturation, contour, density, and the like other than the above-described hue as a feature quantity to be extracted, and a stereoscopic image based on these extracted feature quantities It can also be set as the structure which produces | generates data.

  FIG. 9 is a flowchart showing a flow of processing in the image processing apparatus 20 for extracting feature quantities such as brightness, saturation, contour, density, and the like from original image data.

  As shown in FIG. 9, in the image processing apparatus 20, when original image data that is R, G, B, or monochrome image information is input, the feature amount extraction unit 22 targets the original image data to brightness. Then, color conversion based on the HSB model expressed by saturation and hue is performed (step S300), and brightness (B) and saturation data (S) are extracted (step S301).

  At this time, the lightness takes values in the range of 0 (black) to 100 (%) (white), and the saturation takes the range of 0 (gray) to 100% (pure color), and this value is used as multivalued data.

  Then, an edge of the image is detected from the brightness (B) and the saturation data (S) (step S302), and contour data (E) having a specific peripheral pixel in the edge direction as an outline is generated (step S303).

  Here, as the edge detection means, for example, there is a method of calculating an average pixel value (brightness or average value of saturation) within a certain pixel unit, performing a differentiation process on these, and detecting an edge and an edge direction. Can be mentioned. Further, the contour data is generated with the contour portion being 100 and the values of other regions being 0.

  On the other hand, as processing for extracting image density image information from original image data, first, a non-stereo image is divided into image density extraction regions each having a certain number of unit pixels (step S304).

  Here, the image density extraction region is larger than the resolution of an image input device such as a CCD or a scanner, and has a size that is difficult to distinguish visually, and for a non-stereo image such as a digital camera that is a digital image, The resolution should be larger than the resolution set at the time of image creation and difficult to distinguish visually.

  Then, the average density of each image density extraction region is calculated from image data which is R, G, B or monochrome image information (step S305), and image density data is generated from the average image density of each image density extraction region ( Step S306).

  The average density is expressed as a ratio of an area where an image is formed in a certain unit area, and takes a value of 0 to 100 (%).

  In this way, the brightness (B), saturation (S), edge (E), and image density (C), which are the feature quantities of the non-stereo image (original image data), are extracted from the image data to 0-100. Four types of image information (features) having values up to are generated.

  Under the functional configuration for generating these four types of image information, for example, depending on whether brightness, saturation, edge, or image density is specified as the feature quantity to be extracted, By selecting the designated image information and setting the image information in association with the height information, it is possible to generate stereoscopic image data.

  Here, as a method for designating the feature quantity to be extracted, for example, a UI screen different from the three-dimensional output designation screen 210 shown in FIG. 3 is prepared, and a user should extract a desired UI screen using the UI screen. There is a method for specifying a feature value.

  In such a configuration, for example, when brightness is specified as a feature value to be extracted from the UI screen, the stereoscopic image data generation unit 23 performs processing according to the flowchart shown in FIG. 10 on the original image data. Stereoscopic image data is generated.

  First, the stereoscopic image data generation unit 23 selects lightness information indicating the lightness of the original image data from the four types of image information generated by the processing procedure shown in FIG. 9 based on the original image data ( Step S400).

  Then, the gradation (lightness) is inverted (step S401), and height information (H) corresponding to the inverted gradation (lightness) value (0 to 100) is set for each corresponding pixel. Thus, stereoscopic image data by brightness extraction is generated (step S402).

  As described above, a method for specifying brightness as a feature amount to be extracted and generating stereoscopic image data based on the brightness information extracted from the original image data according to the specification is, for example, a stereoscopic image of an original image such as an oil painting or wallpaper. Applicable when printing.

  In oil paintings and wallpaper, the original image has a fine three-dimensional shape, and has a unique texture different from the design.

  Then, due to illumination at the time of reading with a CCD or photographing with a digital camera, the convex portion having a height shines brighter than the surroundings by reflected light, and the color is captured as a vivid image.

  On the other hand, since the shadow of the convex portion is generated in the concave portion, even if the concave portion is drawn with the recording material of the same color, it is darker than the convex portion, and the saturation is captured as reduced data.

  Therefore, in such an image, the brightness and saturation values have a correlation with the actual shape height.

  In FIG. 10, the method of using the brightness when the stereoscopic image data is generated from the original image data such as an oil painting or wallpaper has been described. However, either the brightness or the saturation can be used, and both A value obtained by performing multiplication, addition processing, or the like may be used.

  When the original image such as an oil painting or wallpaper having the above-described features is three-dimensionally printed, brightness (or saturation) is designated as a feature amount to be extracted, and brightness information (or saturation extracted from the original image data in accordance with the designation). By generating stereoscopic image data based on the degree information (see FIG. 10), it is possible to reproduce the unique texture of the stereoscopic image that the original image has in the stereoscopic print output result.

  In the above configuration, for example, when an image density is designated as a feature quantity to be extracted from the UI screen, the stereoscopic image data generation unit 23 performs processing according to the flowchart shown in FIG. 11 for the original image data. 3D image data is generated.

  First, the stereoscopic image data generation unit 23 selects image density information indicating the image density of the original image data from the four types of image information generated by the processing procedure shown in FIG. 9 based on the original image data. (Step S500).

  Then, by replacing the area of 100% density with 100 and the area of 50% with 50, and setting the height information (H) corresponding to the replaced value for each corresponding pixel, the image density Stereo image data by extraction is generated (step S501).

  In this way, a method for designating image density as a feature quantity to be extracted and generating stereoscopic image data based on image density information extracted from original image data in accordance with the designation is, for example, an original such as a print or a design image. It can be applied to 3D printing of images.

  Prints and design images are intended for shapes whose shapes are expressed by the presence or absence of colors, and form a three-dimensional shape in the colored region.

  When an original image such as a print or design image having such characteristics is three-dimensionally printed, an image density (lightness is acceptable) is specified as a feature amount to be extracted, and image density information (lightness) extracted from the original image data according to the specification By generating stereoscopic image data based on the information (see FIG. 11), it is possible to emphasize the design and form an impact image in the stereoscopic print output result, and to create a higher quality printed matter Can do.

  In the above configuration, for example, when a contour is designated as a feature value to be extracted from the UI screen, the stereoscopic image data generation unit 23 performs processing according to the flowchart shown in FIG. 12 for the original image data. Then, stereoscopic image data is generated.

  First, the stereoscopic image data generation unit 23 selects edge information indicating the contour of the original image data from the four types of image information generated by the processing procedure shown in FIG. 9 based on the original image data ( Step S600).

  Then, based on the selected edge information, the height information is set for each pixel corresponding to the edge information, thereby generating stereoscopic image data by contour extraction (step S601).

  As described above, a method for specifying a contour as a feature amount to be extracted and generating stereoscopic image data based on edge information extracted from the original image data according to the specification is, for example, an original image such as a diagram or a tactile diagram. It can be applied during 3D printing.

  Line diagrams are intended for images in which the outline of an object is drawn with lines, and tactile diagrams for visually impaired people have a convex shape with sufficient height along the outline of the pattern. Then, it is possible to recognize the shape with a finger.

  At the time of stereoscopic printing of an original image such as a diagram or tactile diagram having such features, a contour is designated as a feature amount to be extracted, and stereoscopic image data is generated based on edge information extracted from the original image data according to the designation. (See FIG. 12) By this, in the three-dimensional print output result, it is possible to project the contour corresponding to the edge, highlight a specific pattern, and create a universal printed matter that can be recognized by the visually impaired be able to.

  In the above configuration, for example, when brightness and saturation are designated as feature quantities to be extracted from the UI screen, the stereoscopic image data generation unit 23 follows the flowchart shown in FIG. 13 for the original image data. Stereo image data is generated through the above processing. However, this figure is an example of processing when the user designates a region to be converted into a stereoscopic image.

  In this case, the stereoscopic image data generation unit 23 cuts out a stereoscopic image region that forms a stereoscopic image from the original image data (step S700).

  Next, brightness information indicating the brightness of the stereoscopic image area of the original image data is selected from the four types of image information generated by the processing procedure shown in FIG. 9 based on the original image data (step S701). Then, the gradation of the brightness is inverted (step S702).

  In addition, the saturation information indicating the saturation of the stereoscopic image area of the original image data is selected from the above four types of image information, and the saturation information is multiplied by the brightness information obtained by inverting the gradation at an appropriate ratio. Then, the brightness is converted (step S703), and the height information corresponding to the converted value is set for each corresponding pixel to generate stereoscopic image data (step S704).

  As described above, the method for generating the stereoscopic image data based on the brightness information and the saturation information extracted from the original image data in accordance with the specification is specified as, for example, a photograph or the like. It can be applied to 3D printing of original images such as natural images.

  In many cases, the quality of a picture or a natural image is determined by the subject, the object to be drawn, and the lighting conditions at the time of shooting / drawing.

  When the original image of a photograph or natural image having such features is three-dimensionally printed, brightness and saturation are designated as feature quantities to be extracted, and three-dimensional printing is performed based on the lightness information and saturation information extracted from the original image data according to the designation. By generating image data (see FIG. 13), appropriate three-dimensional image data can be generated by correcting the lightness gradient generated by the direction in which the subject receives light at the time of shooting using saturation. In the three-dimensional print output result, a three-dimensional object can be reproduced in a pseudo manner, or an image in which the three-dimensional effect of the image is further enhanced can be formed.

  In the description of the processing in FIG. 9, the case has been described in which the image processing apparatus 20 unconditionally generates four types of image information (features) from original image data. However, the user uses an appropriate UI screen. Specified original image type (for example, oil painting / wallpaper, print / design painting, line / touch graphic, photograph / natural image, etc.) or feature (brightness, saturation, contour, image density, etc.): negative Only necessary image information (feature amount) can be extracted from the original image data each time in accordance with (including positive designation).

  As described above, in the present invention, a feature amount including at least hue information is extracted from original image data (two-dimensional image data), and a stereoscopic image corresponding to the original image data is formed based on the extracted feature amount. Therefore, it is possible to greatly reduce the data creation time required so far.

  In addition, since stereoscopic image data can be handled in the same manner as commonly used color / monochrome image data, it is excellent in versatility and can be widely used for creating printed materials having various stereoscopic shapes.

  Here, the stereoscopic image data may have height information (H) in the same format as the density information of the non-stereo image data. If the density information is high, the amount of the three-dimensional material such as the foamed toner per unit area increases, and a higher three-dimensional image is formed. On the other hand, if the density information is low, the amount of the three-dimensional material placed on a unit area is reduced, and a lower three-dimensional image is formed.

  Furthermore, since it is possible to generate stereoscopic image data using an optimum feature amount according to the type and application of the original image, it is possible to provide a printed material with high designability in line with the user's intention.

  In addition, according to the user's intention and preference, a three-dimensional shape, a height, and a region for forming a three-dimensional object can be designated, and a printed matter with high design can be created.

  Further, by using it in an electrophotographic image forming apparatus capable of forming an image using a three-dimensional shape such as a foamed toner, it is possible to meet demands for a small quantity and a wide variety of products.

  Furthermore, since a three-dimensional image can be created with a simple operability equivalent to that of a conventional electrophotographic apparatus, it is possible to provide a three-dimensional image forming apparatus that can be easily used by end users.

  In addition, the present invention is not limited to the embodiment described above and shown in the drawings, and can be implemented by being appropriately modified within a range not changing the gist thereof.

  For example, in FIG. 1, the image forming system 50 includes the image input device 10, the image processing device 20, and the image forming device 30, and the image forming system according to the present invention includes the image input device 10, It can also be realized by an apparatus configuration in which functional units corresponding to the image processing apparatus 20 and the image forming apparatus 30 are integrated.

  INDUSTRIAL APPLICABILITY The present invention can be applied to an electrophotographic image forming apparatus for extracting a feature amount including at least a hue from two-dimensional original image data and forming a stereoscopic image corresponding to the original image data based on the feature amount. By having the function of generating stereoscopic image data, it is possible to easily form a stereoscopic image according to the user's intention.

1 is a schematic block diagram illustrating a configuration example of an image forming system according to the present invention. The flowchart which shows the production | generation process of the stereo image data in an image processing apparatus. The figure which shows an example of the solid output designation | designated screen which implement | achieves the solid instruction | indication function of a solid instruction | indication part. The figure which shows the hue ring of Munsell. The figure which shows the three-dimensional instruction | indication method using the Munsell's hue ring. The figure which shows the example of the height change pattern which can be designated using a solid output designation | designated screen. The flowchart which shows the stereo image data generation process by hue extraction. The conceptual diagram which shows the stereo image data production | generation image based on hue extraction. The flowchart which shows the feature-value extraction processes, such as brightness, saturation, an outline, and a density. The flowchart which shows the stereo image data generation process by brightness extraction. The flowchart which shows the stereo image data generation process by image density extraction. The flowchart which shows the stereo image data generation process by outline extraction. The flowchart which shows the stereo image data generation process by lightness and saturation extraction.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Image input device, 20 ... Image processing apparatus, 21 ... Solid indication part, 210 ... Solid output designation | designated screen, 211, 212, 213, 214, 215, 216, 217 ... Each tool used for solid indication, 218 ... Display area 219: “OK” button, 220: “Cancel” button, 221: “Return to standard” button, 22: Feature amount extraction unit, 23: Stereo image data generation unit, 24: Color image data generation unit, 25: Output Tone correction unit, 30 ... image forming apparatus, 50 ... image forming system

Claims (12)

Extract feature values including at least hue information from the original image data,
Stereo image data generation method for generating stereo image data for forming a stereo image corresponding to the original image data based on the extracted feature amount. The stereoscopic image data includes height information corresponding to each pixel,
The method for generating stereoscopic image data according to claim 1, wherein the height information is set corresponding to at least a hue of each pixel of the original image data. The stereoscopic image data generation method according to claim 2, wherein the height information is set corresponding to a region included in a specified hue range of the original image data. The stereoscopic image data generation method according to claim 3, wherein the hue range is specified by a start position, an end position, and an angle assignment direction on the hue circle. Specify the change pattern of the height information in the area included in the specified hue range,
The method for generating stereoscopic image data according to claim 3, wherein height information in the region is set according to the designated change pattern. The three-dimensional image is formed by transferring heat-foamable toner to paper and performing a heat treatment,
The three-dimensional image data generation method according to claim 2, wherein the height information indicates a transfer density of the thermally foamable toner. Feature amount extraction means for extracting feature amounts including at least hue information from original image data;
3D image data generation comprising: 3D image data generation means for generating 3D image data for forming a 3D image corresponding to the original image data based on the feature amount extracted by the feature amount extraction means apparatus. The stereoscopic image data is
Contains height information corresponding to each pixel,
The stereoscopic image data generation means includes
The stereoscopic image data generation apparatus according to claim 7, wherein the height information is set corresponding to at least a hue of each pixel of the original image data. The feature amount extraction means includes:
First designation means for designating a hue range of the original image data;
Area extracting means for extracting an area included in the hue range of the original image data designated by the first designation means,
The stereoscopic image data generation means includes
The stereoscopic image data generation apparatus according to claim 8, wherein the height information is set corresponding to the region extracted by the region extraction means. The first specifying means includes:
The stereoscopic image data generation apparatus according to claim 9, wherein a hue range of the original image data is designated by a start position, an end position, and an angle assignment direction on a hue circle. A second designating unit for designating a change pattern of the height information in a region included in the designated hue range;
The stereoscopic image data generation device according to claim 9, wherein height information in an area extracted by the area extraction unit is set according to a change pattern set by the second specifying unit. The three-dimensional image is formed by transferring heat-foamable toner to paper and performing a heat treatment,
The stereoscopic image data generation apparatus according to claim 8, wherein the height information indicates a transfer density of the thermally foamable toner.

Images