JP2017033318A - Architectural material uneven pattern image processing system, method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display an image of an uneven pattern according to a change of observation environment or a change of orientation of an architectural material to enable a simulated experience of a texture or appearance of the uneven pattern.SOLUTION: Conversion means converts information on a depth or hight by each pixel of an uneven pattern of an architectural material into information on an orientation of each pixel. Rendering means renders display data of the uneven pattern, on the basis of illumination information, information on the orientation of each pixel, and a relative positional relation of illumination, a surface of display means and an observer. The display means uses the display data to display an image of the uneven pattern.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a building material uneven pattern image processing system, method, and program, and more particularly, to a building material uneven pattern image processing system, method, and program for displaying an image of the texture of a building material of a building.

  Conventionally, a decorative board printed and processed by a printing technique is used as a building material of a building (for example, a face material used for a floor, a wall, and a ceiling). For example, various building materials (decorative materials) in which a pigment ink is applied to the surface of a base material (plywood, fiberboard, etc.) to form a pattern (pattern and / or color) and the surface is embossed (unevenness processing) Or, the surface of the base material can be decorated with a decorative sheet (thin paper, urethane-coated paper, reinforced paper, titanium paper) or a resin-made decorative sheet, and the surface can be embossed (uneven) Building materials (decorative materials) are used. When adjusting the gloss effect in whole or in part, materials (sheet, varnish, etc.) that increase / decrease gloss are laminated. Conventionally, an embossed plate for embossing has been manufactured by repeating trial production. As the number of trial productions increases, the cost of producing the embossed plate also increases.

  Patent Document 1 discloses a technique for computer-simulating the finish of an embossed plate (the finish of an uneven pattern). With the technique disclosed in Patent Document 1, it is possible to reduce the repetition of the prototype of the embossed plate.

JP 2011-103097 A

Berthold K.P Horn et al., “The variational approach to shape from shading,” COMPUTER VISION, GRAPHICS, AND IMAGE PROCESSING 33, 174-208 (1986). Klette, R. et al., “Height data from gradient fields,” Proc. SPIE 2908, Machine Vision Applications, Architectures and Systems Integration, vol. 5, pp. 204-215 (1996)

  However, the texture and appearance of the uneven pattern change according to changes in the observation environment and the orientation of the building material. Therefore, it is desirable to provide a technology that enables confirmation of texture and appearance according to changes in the observation environment and changes in the orientation of the building material.

  The present invention has been made in view of such a problem, and the object of the present invention is to display an image of an uneven pattern according to a change in the observation environment and a change in the direction of the building material, An object of the present invention is to provide a building material uneven pattern image processing system, method, and program that enable a simulated experience of texture and appearance.

  In order to achieve such an object, a first aspect of the present invention is a building material uneven pattern image processing system for processing an image of an uneven pattern of a building material. The building material uneven pattern image processing system converts display means for displaying an uneven pattern image and depth or height information for each pixel of the uneven pattern of the construction material into information on the orientation of each pixel. The rendering means is configured to render the display data of the uneven pattern based on the illumination information, the information on the orientation of each pixel, and the relative positional relationship between the illumination, the display surface of the display means and the viewer. Rendering means for displaying an image of the uneven pattern by display means using display data.

  In one embodiment, the building material concavo-convex pattern image processing system further includes editing means configured to edit information on the orientation of each pixel.

  In one embodiment, the building material uneven pattern image processing system further comprises editing means configured to edit depth or height information for each pixel of the uneven pattern of the construction material.

  In one embodiment, the building material uneven pattern image processing system is configured to store information on the orientation of each pixel edited by the editing means or information on the depth or height of each pixel of the uneven pattern. Result storage means is further provided.

  In one embodiment, the conversion means is further configured to convert the information on the orientation of each pixel edited by the editing means into information on the depth or height of each pixel of the uneven pattern. Information on the depth or height of each pixel of the uneven pattern converted from the information on the orientation of each pixel is output to the outside.

  In one embodiment, the building material concavo-convex pattern image processing system further includes an inclination detection unit configured to detect the orientation of the display surface of the display unit, and the rendering unit includes illumination information and information on the orientation of each pixel. The display data of the uneven pattern is rendered based on the orientation of the display surface of the display means.

  In one embodiment, the building material uneven pattern image processing system further includes ambient illumination information acquisition means configured to acquire ambient illumination information of the display means, and is used when display data of the uneven pattern is rendered. The illumination information to be obtained is ambient illumination information acquired by the ambient illumination information acquisition means.

  In one embodiment, the building material concavo-convex pattern image processing system further comprises spectator detection means configured to detect the orientation of the spectator of the concavo-convex pattern image, and the rendering means includes illumination information, each pixel The display data of the uneven pattern is rendered based on the orientation information, the orientation of the display surface of the display means, and the orientation of the viewer of the image of the uneven pattern.

  The 2nd aspect of this invention is a building material uneven | corrugated pattern image processing method performed by the said building material uneven | corrugated pattern image processing system.

  The third aspect of the present invention is a program that causes a computer to execute the above-described building material uneven pattern image processing method.

  As described above, according to the present invention, it is possible to provide a building material uneven pattern image processing system, method, and program for displaying an image of a material in accordance with a change in observation environment or a change in material direction. .

It is a functional block diagram of the building material uneven | corrugated pattern image processing system concerning one Embodiment of this invention. BRIEF DESCRIPTION OF THE DRAWINGS It is a figure for describing one Embodiment of this invention, (a) is a gray image which shows the information of the uneven | corrugated pattern of an embossed plate, (b) and (c) are shapes from the information of the uneven | corrugated pattern. It is a figure for demonstrating conversion to a characteristic, (d) is a figure which shows the correspondence of a gray image and the depth of an unevenness | corrugation. It is a figure for demonstrating one Embodiment of this invention. It is a figure for demonstrating one Embodiment of this invention. It is a figure for demonstrating one Embodiment of this invention. It is a figure for demonstrating one Embodiment of this invention. It is a flowchart of the image processing method which concerns on one Embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The building material uneven pattern image processing system, method, and program described below relate to a building material uneven pattern image processing system, method, and program for displaying an image of the texture of a building material of a building. According to the architectural material uneven pattern image processing system, method, and program of the present embodiment, an image or pattern (pattern and / or pattern) of the uneven surface of the building material corresponding to a change in the observation environment or a change in the direction of the building material. It is possible to check the texture by displaying an image of a building material that combines a color) and an uneven pattern. Therefore, it is possible to reduce the number of times of repeating the trial production of the embossed plate or the production of the material combining the pattern (pattern and / or color) and the uneven pattern.

  Although not limited, building materials for buildings (hereinafter also simply referred to as materials) are, for example, flooring materials, wall materials, outer wall materials, ceiling materials, joinery construction materials, roof materials, and makeup as wall storage materials. It is a material.

  FIG. 1 is a functional block diagram of a portable terminal which is an embodiment of a building material uneven pattern image processing system according to the present invention. The portable terminal 100 in FIG. 1 is a tablet terminal, for example, and includes a display, a processor, a memory, and various sensors. The portable terminal 100 may include a communication device, a keyboard, a pointing device including a computer mouse, and an input device such as a microphone. The input device constitutes the input unit 112.

  The display device may be any display device suitable for displaying an image, and is not limited to this, but an electromagnetic induction type, capacitance type or pressure sensitive type touch display device is preferable. The display device constitutes the display unit 102. The electromagnetic induction type, capacitance type, or pressure sensitive touch display device constitutes the display unit 102 and the input unit 112.

  The processor may include a GPU and a coprocessor in addition to the CPU. The processor generates display data corresponding to an image displayed on the display unit. The processor constitutes a rendering unit (display data generation unit) 104, a conversion unit 120, and an editing unit 122.

  The memory may be either a magnetic drive such as an HDD or a semiconductor drive such as an SSD. The memory may be internal or external. The memory constitutes an illumination information storage unit 106, a material information storage unit 116, and an editing result storage unit 123. The memory can also store information on the tilt (the orientation of the display surface) of the tablet terminal detected by the tilt detection unit 110.

  Various sensors are devices suitable for acquiring lighting information around the tablet terminal (ambient lighting information) (hereinafter referred to as ambient lighting information acquisition device) and devices suitable for detecting the tilt of the tablet terminal (tilt detection device). I just need it. For example, the ambient illumination information acquisition device can be one or more of a photometric device, an illuminance sensor, and a camera. The ambient lighting information acquisition device may be a built-in type or an external type. Further, for example, the tilt detection device can be one or more of a gyro sensor, an acceleration sensor, and a magnetic sensor. The ambient lighting information acquisition device constitutes the ambient lighting information acquisition unit 108 together with the processor or alone. The tilt detection device constitutes the tilt detection unit 110 together with the processor or alone. Further, the various sensors may include a device suitable for detecting the position of the viewer (for example, the viewer's eyes). Such a device can be one or more of an infrared sensor and a camera.

  For example, the camera as the ambient lighting information acquisition device can be a surrounding omnidirectional image camera or an omnidirectional camera, and an omnidirectional camera of the omnidirectional image obtained by photographing the entire periphery of the tablet terminal with such a camera. Color and brightness can be used as illumination information (ambient illumination information) in a real environment. Or, you can combine a reference image taken with a built-in or external camera with the camera placed on a horizontal surface, and an image of the entire periphery of the tablet device taken in multiple shots by changing the orientation of the camera. An all-around image can be generated (connected), and the color and brightness of the generated all-around image can be used as illumination information (ambient illumination information) in the real environment. If the dynamic range (latitude) of the image sensor included in the camera is narrower than the brightness range of the actual environment brightness distribution around the tablet device, a photographic technique (High Dynamic Range synthesis (high dynamic range imaging: HDR) may be used.

  For example, the position of the face (eyes) of the operator (viewer) of the tablet terminal is determined from an image taken by the built-in camera of the tablet terminal (or an external camera whose relative positional relationship with the tablet terminal is known). By specifying, the relative positional relationship between the display surface of the tablet terminal and the viewer can be specified. The relative positional relationship between the display surface of the tablet terminal and the viewer can be specified in real time by repeating shooting and specifying the position of the viewer's face (eyes) at short time intervals.

  The communication device may be one or more of a bus (for example, USB (Universal Serial Bus)) interface, a network interface card (NIC) for wired communication, and a wireless device for wireless communication for connection to an external device. The communication device constitutes the communication unit 114. The tablet terminal 100 can also acquire illumination information (illumination information modeled with respect to a virtual space (space illumination information)) and material information from the outside (another computer or server) via the communication unit 114. The illumination information acquired from the outside can be used as an alternative to the ambient illumination information (real space illumination information). The tablet terminal 100 can also use material information acquired from the outside (another computer or server) via the communication unit 114 as an alternative to the material information acquired by conversion by the conversion unit 120.

  The conversion unit 120 converts the pattern (pattern and / or color) information of the material, the information on the uneven pattern of the embossed plate, and the information of reflection stored in the input unit 112, the communication unit 114, or the memory in advance into the material information.

  The material information is information regarding the texture of the material. The material information is information indicating the direction of the surface of the pixel in the normal information (shape characteristic: equipment (floor material, wall material, ceiling material)) for each pixel (pixel). For example, the normal vector information of the pixel Included). The material information also includes RGB information (color characteristics: information indicating the color of each layer constituting the material, such as the background of the material and the coat layer) for each pixel. The material information also includes gloss information for each pixel (reflection characteristics: information indicating the gloss of the surface constituting the material, such as a coat layer provided on the surface of the material). As the gloss information that is the reflection characteristic, for example, information that is modeled by reflection using a bidirectional reflectance distribution function (BRDF) or a bidirectional scattering surface reflectance distribution function (BSSRDF) can be used. The modeled gloss information includes, for example, information composed of gloss intensity information and gloss sharpness information. At this time, the gloss information can further include gloss direction information in addition to gloss intensity information and gloss sharpness information. The texture of the material having anisotropic reflection can be expressed by the information on the direction of gloss. The gloss intensity information may be information on the intensity of each pixel for each RGB. Display data is generated based on ambient illumination information (or spatial illumination information acquired from the outside) and material information. As a result, in addition to the color of the material, the texture of the material (glossiness, roughness, unevenness) is displayed as an image.

  For example, a decorative material as a building material is information for printing a pattern (pattern and / or color) formed on the surface of a base material (plywood, fiberboard, etc.) at the design stage (color information for each pixel). Reflection that shows information on depth (height) for each pixel of the embossed plate that embosses the surface (unevenness processing), and distribution of material (sheet, varnish, etc.) that increases or decreases the added gloss for each pixel Stipulated in the information.

  For example, the information on the pattern (pattern and / or color) of the material is CMYK information for each pixel for printing. The conversion unit 120 converts CMYK information for each pixel into RGB information (color characteristics) for image display. The conversion unit 120 can also reversely convert RGB information into CMYK information for each pixel. Conversion between CMYK information and RBG information can be implemented by a program process using an ICC (International Color Consortium) profile.

  For example, the information on the uneven pattern of the embossed plate is information including a value representing the depth (or height) of the unevenness of each pixel in 256 gradations and a value D indicating the maximum depth (or height). . For example, the information on the uneven pattern of the embossed plate is given as a gray image as shown in FIG. As illustrated in FIGS. 2B and 2C, the conversion unit 120 includes two adjacent pixels sandwiching the target pixel in each of the horizontal direction (x-axis direction) and the vertical direction (y-axis direction) of the target pixel. The difference in pixel depth (Δz_x and Δz_y) is calculated. Also, using the relationship between the resolution of the image or the number of pixels of the image and the size of the embossed plate, the horizontal direction (x-axis direction) and the vertical direction (y-axis direction) between two adjacent pixels across the target pixel ) To calculate the slope in the left-right direction (x-axis direction) of the pixel of interest from Δz_x and Δx, and the slope of the pixel of interest in the vertical direction (y-axis direction) from Δz_y and Δy. Furthermore, the conversion unit 120 calculates the normal vector (shape characteristic) of the target pixel from the inclination in the left-right direction (x-axis direction) and the vertical direction (y-axis direction) of the target pixel. In this way, the conversion unit 120 converts the information on the uneven pattern of the embossed plate (information on the depth (or height) of each pixel and the value D indicating the maximum depth (or height)) into a shape. Convert to characteristic (pixel normal vector). The conversion unit 120 can also inversely convert the normal vector (shape characteristic) of the pixel to the depth of the adjacent position. The transformation between the depth (or height) of the unevenness of each pixel and the normal vector can be realized by any technique including a known technique. (For example, see Non-Patent Documents 1 and 2)

  For example, for the reflection information, when the gloss characteristic is a uniform gloss distribution over the entire surface, the uniform distribution function (formula) and the maximum and minimum values of the gloss intensity and gloss sharpness parameters are specified. The For example, the value from the minimum value to the maximum value can be 256 gradations. The conversion unit 120 can convert the reflection information specified by the equation and the parameter into values of gloss intensity and gloss sharpness for each pixel according to the equation (probability of uniform distribution function). According to the uniform distribution function, the distribution of the gloss intensity and the gloss sharpness value of each pixel is a distribution in which values between the specified maximum value and the minimum value occur with the same probability. If the same value is specified for the minimum and maximum values, the gloss will be completely uniform across the entire surface. In addition, if different values are specified for the minimum value and the maximum value, in-plane unevenness caused in manufacturing can be reflected. The mathematical formula is not limited to the uniform distribution function, and for example, a normal distribution function, and the gloss intensity, the average value of the gloss sharpness, and the standard deviation as parameters may be designated. Alternatively, the reflection information is designated as an image when the glossiness differs for each pixel. For example, using the RGB image format, the intensity of gloss and the sharpness of gloss are each represented by 256 gradations (0 is the minimum value, 255 is the maximum value), and are designated as the R channel and G channel (B channel is used) Not) Alternatively, the reflection information is designated as a kind of surface coating material (varnish) used for each pixel on the surface of the decorative material or a mixing ratio of two or more kinds of surface coating materials. For example, the conversion unit 120 measures in advance a relationship between a kind of surface coating material (varnish) or a mixture of two or more kinds of surface coating materials in various mixing ratios, and a value of gloss strength and gloss sharpness. With reference to the stored database, the specified kind of surface coating material or the mixing ratio of two or more kinds of surface coating materials can be converted into the values of gloss intensity and gloss sharpness for each pixel. Further, the conversion unit 120 may refer to the database and reversely convert the gloss strength and the sharpness value of each pixel into a kind of surface coating material or a mixing ratio of two or more surface coating materials. it can. For example, the mixing ratio of two or more surface coating materials can be a mixing ratio of a matte varnish with a low glossiness and a gloss varnish with a high glossiness. The gloss strength and gloss sharpness value of one surface coating material (varnish) or a mixture of a plurality of surface coating materials are values obtained by using a calibration curve or approximate model formula as an alternative to the values previously measured and stored in the database. May be used. The database may be provided in the portable terminal 100, or may be a database provided in another computer or server accessible via the communication unit 114.

  The illumination information storage unit 106 stores the ambient illumination information acquired by the ambient illumination information acquisition unit 108 or the spatial illumination information acquired from the outside via the communication unit 114.

  The material information storage unit 116 stores the material information converted by the conversion unit 120 or the material information acquired from the outside via the communication unit 114.

  The tablet terminal 100 includes a UI providing unit (not shown) that provides a user interface (UI) for interaction with the viewer. The viewer can select a material to be displayed via the UI. That is, the tablet terminal 100 can receive selection of a material from the viewer via the UI and display the material on the display. The UI may include a hierarchical category menu (material category) that allows the viewer to select a material that the user wants to display. For example, the materials may be classified into categories such as wall materials, floor materials, and ceiling materials so that the viewer can select the materials according to the category hierarchy. In the sub-category, thumbnails of a plurality of materials may be presented, and the materials that the viewer wants to display may be selected. In addition, the viewer selects part or all of the displayed material via the UI and edits material information (color characteristics, shape characteristics, reflection characteristics) (material information (color characteristics, shape characteristics). Instructing to change the reflection characteristics).

  The editing unit 122 receives an instruction from the viewer via the UI and changes material information (color characteristics, shape characteristics, reflection characteristics). For example, the editing unit 122 changes, rotates, enlarges, or changes the color (RGB value) for some or all of the pixels of the selected pattern (pattern and / or color) in accordance with an instruction from the viewer. It can be reduced and / or translated. Further, the editing unit 122 changes the intensity of the gloss and the sharpness of the gloss for some or all of the pixels selected from the gloss distribution by the viewer according to the instruction from the viewer, and rotates the position. The range can be enlarged or reduced, and / or translated. Further, the editing unit 122, for some or all selected pixels, in accordance with an instruction from the viewer, the gradation value of the corresponding pixel in the gray image or the value D representing the maximum depth or the corresponding pixel. Changing the depth (or height) of the embossed plate unevenness, changing the maximum depth D, and rotating the uneven pattern by manipulating the shape characteristics (pixel normal vector) The uneven pattern can be enlarged or reduced, and / or the uneven pattern can be translated. When the editing unit 122 directly operates the gradation value or the value D representing the maximum depth of the corresponding pixel in the gray image with respect to some or all of the selected pixels, the conversion unit 120 122. A value representing the depth (or height) of the unevenness of each pixel of the gray image operated by 122 in gradation and a value D representing the maximum depth (or height) are obtained by using shape characteristics (normal vector of the pixel). ).

  The editing result storage unit 123 stores material information (color characteristics, shape characteristics, reflection characteristics) changed by the editing unit 122. Only the changed characteristics of the material information (color characteristics, shape characteristics, reflection characteristics) may be stored. At least a part of the material information (color characteristics, shape characteristics, reflection characteristics) stored in the editing result storage unit 123 may be output to the outside as manufacturing information for manufacturing the material. For example, the portable terminal 100 displays the shape characteristic (pixel normal vector) of the material information stored in the editing result storage unit 123 and the depth (or height) of the unevenness of each pixel of the gray image in gradation. It may be configured to transmit the value to the outside via the communication unit 114 after the conversion unit 120 performs reverse conversion to the value D indicating the value to be expressed and the maximum depth (or height).

  FIG. 3 shows a space in which ambient lighting information is acquired by the ambient lighting information acquisition unit 108. In FIG. 6, the x axis and the y axis are axes orthogonal to each other in the horizontal plane, and the z axis is an axis orthogonal to the horizontal plane. In the space of FIG. 3, a total of three light sources including two lamps 202 and 204 and the sun 206 are shown. With the intersection of the x-axis, y-axis, and z-axis as the position of the ambient illumination information acquisition unit 108, light from the two light sources 202 and 204 and the sun 206 is observed, and the direction of the light observed for each light source The color component and intensity (luminance) are acquired as ambient illumination information in the space. The number of light sources is not limited to three. The light source is not limited to a light emitter, and may be a reflector that reflects light toward the ambient illumination information acquisition unit 108. Ambient illumination information (light direction, color component and intensity) of all light sources observed in the space may be acquired. The acquired ambient illumination information is stored in the illumination information storage unit 106.

  As an alternative to ambient lighting information, spatial lighting information can be acquired from the outside via the communication unit 114. Spatial lighting information and ambient lighting information are simply referred to as lighting information. Spatial lighting information includes information about lighting in a modeled space, such as a room with a south-facing window (a window through which sunlight is inserted) and four downlights, or a bedroom without a window and one electric lamp (externally in advance) Lighting information stored in a virtual space image processing apparatus or a server). The modeled space may be one or more spaces in the model room floor plan of a building being sold / constructed.

  FIG. 4 shows a state in which the tablet terminal 100 is arranged in the space shown in FIG. FIG. 4 also shows the viewer's eyes 208 of the image displayed by the tablet terminal 100. The tablet terminal 100 is arranged at the intersection of the x-axis, the y-axis, and the z-axis so that the display surface faces upward and the display surface is parallel to the xy plane. The orientation of the eyes 208 may be the orientation relative to the normal of the display surface detected by the viewer detection unit 118, or may be the orientation predetermined for the normal of the display surface (not detected by the viewer detection unit 118). Good.

  In the state shown in FIG. 4, the rendering unit 104 generates material display data as if the surface of the material is superimposed on the display surface. When the generated display data is displayed on the display device, the viewer who has the tablet terminal 100 can observe the texture of the material as if he / she had the material with his / her hand. .

  The rendering unit 104 receives material information (normal information (shape characteristics), RGB information (color characteristics), RGB strength information, gloss sharpness information) for each material to be rendered from the material information storage unit 116. Read, read illumination information (direction of light from one or more light sources, color component and intensity (brightness)) from the illumination information storage unit 106, and reflect color component and intensity (brightness) reflected in the direction of the viewer in each pixel ) To generate display data. The generated display data is used, and an image is displayed on the display unit. In the state shown in FIG. 7, the color component and intensity (luminance) of light incident on the surface of the material from three light sources (two lamps 202 and 204 and the sun 206) and reflected in the direction of the eye 208 are calculated. .

  In the state shown in FIG. 5, the display surface of the tablet terminal 100 is inclined from the horizontal plane (xy plane). This inclination is such an inclination that the light from the electric lamp 202 does not enter the display surface. The inclination detection unit 110 detects this inclination, and the rendering unit 104 considers it when generating display data. That is, the rendering unit 104 calculates the display data by calculating the color component and intensity (luminance) of light incident on the surface of the material from two light sources (one lamp 204 and the sun 206) and reflected in the direction of the eye 208. Generate.

  Furthermore, in the state illustrated in FIG. 6, the display surface of the tablet terminal 100 is disposed in parallel to the z axis. This arrangement is an arrangement in which the lights of the two lamps 202 and 204 do not enter the display surface. The tilt detection unit 110 detects the tilt of the tablet terminal 100 at this time, and the rendering unit 104 considers it when generating display data. That is, the rendering unit 104 generates display data by calculating the color component and intensity (luminance) of light incident on the surface of the material from only one light source (sun 206) and reflected in the direction of the eye 208.

  As described with reference to FIGS. 4 to 6, the display data generated by the rendering unit 104 reflects the tilt (the orientation of the display surface) and the eye position (the orientation) of the tablet terminal 100. Therefore, the viewer who has the tablet terminal 100 can feel the texture of the material by tilting the tablet terminal 100 or changing the position (orientation) of the eyes, as when observing the actual material. Can be observed.

  The rendering unit 104 can also implement a zoom function. As described above, the rendering unit 104 generates material display data as if the surface of the material is superimposed on the display surface. The distance between the display surface and the viewer holding the tablet terminal 100 is approximately the length of the viewer's arm and does not change significantly. Therefore, in response to a zoom-in instruction from the viewer received through the user interface (UI), the display data of the material is displayed as if the material is placed between the display surface and the viewer. Whether the display surface is placed between the material and the viewer (the material is placed behind the display surface) in response to a zoom-out indication that is generated or received via the UI As described above, it is useful to mount the zoom function for generating the display data of the material in the rendering unit 104. For example, the viewer holds the tablet terminal so that the display surface is perpendicular to the horizontal plane, and uses the zoom-out function to make the wall material 2 to 3 m away when making the material of the wall material. Assuming that it is possible to observe the texture of the material.

  As described above, the rendering unit 104 is based on material information (color characteristics, reflection characteristics, and shape characteristics) regarding the texture of the material, illumination information, and the relative positional relationship between the display surface of the bullet terminal 100 and the viewer. The display data of construction materials can be rendered. In addition, the rendering unit 104 has unevenness formed on the construction material based on the shape characteristics in the material information regarding the texture of the construction material, the lighting information, and the relative positional relationship between the display surface of the bullet terminal 100 and the viewer. The display data of the pattern can be rendered. The display data of the uneven pattern can be a luminance distribution of a predetermined color.

  FIG. 7 is a flowchart of the process of the building material uneven pattern image processing system, and is an example of the process flow executed by the portable terminal 100 described above. The processing flow in FIG. 7 illustrates a flow in which the portable terminal 100 renders uneven pattern display data corresponding to a change in observation environment or a change in the direction of a building material, and displays an uneven pattern image. .

  In step S601, the portable terminal 100 (the conversion unit 120) converts the depth or height information for each pixel of the uneven pattern of the embossed plate into the shape characteristics of each pixel. For example, the shape characteristic is normal vector information of each pixel of the uneven pattern. The information on the depth or height of the embossed pattern of the embossed plate input via the input unit 112 and the communication unit 114 (or input and stored in the material information storage unit 116) is converted into shape characteristics. The converted shape characteristic is stored in the material information storage unit 116.

  In step S603, the portable terminal 100 (rendering unit 104) acquires ambient lighting information. The illumination information acquired by the ambient illumination information acquisition unit 108 or the illumination information stored in the ambient illumination information storage unit 106 in the real environment where the portable terminal is arranged is acquired. Alternatively, the external illumination information in the modeled space acquired via the communication unit 114 or the external illumination information acquired via the communication unit 114 and stored in the ambient illumination information storage unit 106 is acquired.

  In step S605, the portable terminal 100 (rendering unit 104) specifies the relative positional relationship between the illumination, the display surface, and the viewer. The portable terminal 100 (rendering unit 104) determines the relative positional relationship between the illumination, the display surface, and the viewer, the orientation of light included in the illumination information, at least one of the orientation of the display surface and the orientation of the viewer's eyes. It can specify by calculating using. The tilt of the portable terminal and the orientation of the viewer's eyes are detected by the tilt detection unit 110 and the viewer detection unit 118, respectively, and are held in a memory or the like so that the rendering unit 104 can access them.

  In step S607, the portable terminal 100 (rendering unit 104) displays the uneven pattern display data based on the acquired illumination information, the calculated relative positional relationship, and the shape characteristics (information on the orientation of each pixel). Render.

  In step S609, the display unit 102 displays (re-displays) the image of the uneven pattern using the display data.

  In step S611, it is determined whether an instruction to edit the uneven pattern displayed on the display unit 102 has been issued.

  When the editing of the uneven pattern is instructed, the shape characteristic (pixel orientation information) is changed in accordance with the instruction in step S613. The changed shape characteristic (pixel orientation information) is stored in the editing result storage unit 123.

  If it is not instructed to edit the uneven pattern in step 611, or after step S613, it is determined in step S615 whether the end of the program has been instructed. If the program is instructed to end, the process flow ends. If the end of the program is not instructed, the process returns to step S603. If the shape characteristic is changed in step S613, in step 607, the display data of the uneven pattern is rendered based on the changed shape characteristic. Thereby, the texture of the edited uneven pattern can be confirmed.

  Note that if the end of the program is not instructed, the process may return from step S615 to S605. In step S603, when the illumination information modeled about the virtual space (spatial illumination information) is acquired, there is no need to acquire it again.

  The portable terminal 100 may be configured to output at least a part of material information (color characteristics, shape characteristics, reflection characteristics) stored in the editing result storage unit 123. For example, the portable terminal 100 may be configured to transmit the shape characteristics of the material information stored in the editing result storage unit 123 to the outside via the communication unit 114 after reverse conversion by the conversion unit 120. . The processing flow described with reference to FIG. 7 is a step of transmitting the shape characteristics of the material information stored in the editing result storage unit 123 to the outside through the communication unit 114 after reverse conversion by the conversion unit 120. May be included.

  As described above, according to the present invention, an image of a concavo-convex pattern corresponding to a change in observation environment or a change in material direction is displayed, and a concavo-convex pattern image of a building material that enables a simulated experience of texture and appearance. Processing systems, methods, and programs can be provided.

100 portable terminal 102 display unit (pressure-sensitive display)
104 Rendering unit (display data generation unit)
106 Illumination information storage unit 108 Ambient illumination information acquisition unit (photometric device, illuminance sensor, camera)
110 Tilt detection unit (gyro sensor, acceleration sensor, magnetic sensor)
112 Input section (keyboard, keypad, mouse, pointing device, microphone)
114 Communication unit (network IF card (NIC), wireless device)
116 Material information storage unit 118 Audience detection unit (infrared sensor, camera)
120 Conversion unit 122 Editing unit 123 Editing result storage unit 202, 204 Electric light 206 Sun 208

Claims (17)

A building material uneven pattern image processing system that processes an image of uneven patterns of construction materials,
Display means for displaying an image of the uneven pattern;
Conversion means configured to convert the information on the depth or height of each pixel of the uneven pattern of the construction material into information on the orientation of each pixel;
Rendering means configured to render display data of the concavo-convex pattern based on illumination information, information on the orientation of each pixel, and the relative positional relationship between illumination, the display surface of the display means, and the viewer A building material uneven pattern image processing system comprising: the rendering means for displaying an image of the uneven pattern by the display means using the display data.   The building material uneven pattern image processing system according to claim 1, further comprising an editing unit configured to edit information on the orientation of each pixel.   The building material uneven pattern image processing system according to claim 1, further comprising an editing unit configured to edit depth or height information for each pixel of the uneven pattern.   The editing result storage unit configured to store information on the orientation of each pixel edited by the editing unit or information on the depth or height of each pixel of the uneven pattern. Or the building material uneven | corrugated pattern image processing system in any one of 3.   The conversion means is further configured to convert the information on the orientation of each pixel edited by the editing means into information on the depth or height of each pixel of the uneven pattern, and the orientation of each pixel The building material uneven pattern image processing system according to claim 2, wherein the depth or height information for each pixel of the uneven pattern converted from information is output to the outside. Further comprising tilt detection means configured to detect the orientation of the display surface of the display means;
The rendering means is configured to render display data of the uneven pattern based on illumination information, information on the orientation of each pixel, and the orientation of the display surface of the display means. The building material uneven pattern image processing system according to any one of the above.   An ambient illumination information acquisition unit configured to acquire ambient illumination information of the display unit is further provided, and the illumination information used when display data of the uneven pattern is rendered is the ambient illumination information acquisition unit The building material uneven pattern image processing system according to any one of claims 1 to 6, which is the ambient lighting information acquired by the method. Further comprising viewer detection means configured to detect the orientation of the viewer of the image of the uneven pattern,
The rendering means renders the uneven pattern display data based on the illumination information, the orientation information of each pixel, the orientation of the display surface of the display means and the orientation of the viewer of the uneven pattern image. The building material uneven | corrugated pattern image processing system in any one of Claims 1 thru | or 7 comprised so that it may do. A building material uneven pattern image processing method in a building material uneven pattern image processing system comprising display means configured to display an image of an uneven pattern of a construction material, a conversion means, and a rendering means,
The converting means converts the depth or height information for each pixel of the uneven pattern of the construction material into information on the orientation of each pixel;
The rendering means renders the display data of the uneven pattern based on illumination information, information on the orientation of each pixel, and illumination, the display surface of the display means and the relative positional relationship of the viewer;
The building material concavo-convex pattern image processing method including: the display means displaying an image of the concavo-convex pattern using the display data. The building material uneven pattern image processing system further comprises editing means, and the building material uneven pattern image processing method comprises:
The architectural material uneven pattern image processing method according to claim 9, further comprising editing the orientation information of each pixel. The building material uneven pattern image processing system further comprises editing means, and the building material uneven pattern image processing method comprises:
The architectural material uneven pattern image processing method according to claim 9, further comprising editing the depth or height information for each pixel of the uneven pattern. The building material uneven pattern image processing system further includes an editing result storage means, and the building material uneven pattern image processing method includes:
The information on the orientation of each pixel edited by the editing unit or the information on the depth or height of each pixel of the uneven pattern is further stored in the editing result storage unit. The method for processing an uneven pattern image according to claim 1. The converting means converts the orientation information of each pixel edited by the editing means into depth or height information for each pixel of the uneven pattern;
The method according to claim 11, further comprising: outputting information on a depth or a height of each pixel of the uneven pattern converted from information on the orientation of each pixel to the outside. . The building material uneven pattern image processing system further comprises detection means, and the building material uneven pattern image processing method includes:
The detection means detects the orientation of the display surface of the display means;
Rendering the uneven pattern display data means that the rendering means renders the uneven pattern display data based on illumination information, information on the orientation of each pixel, and the orientation of the display surface of the display means. The building material uneven | corrugated pattern image processing method in any one of Claims 9 thru | or 13 including doing. The building material uneven pattern image processing system further comprises ambient lighting information acquisition means, and the building material uneven pattern image processing method includes:
The ambient lighting information acquisition means further includes acquiring ambient lighting information of the display means;
The building material uneven pattern image processing according to claim 9, wherein the illumination information used when rendering display data of the uneven pattern is the ambient illumination information acquired by the ambient illumination information acquisition unit. Method. The building material concavo-convex pattern image processing system further comprises spectator detection means for detecting the azimuth of the viewer of the concavo-convex pattern image,
Rendering the uneven pattern display data means that the rendering means includes the illumination information, the orientation information of each pixel, the orientation of the display surface of the display means, and the orientation of the viewer of the image of the uneven pattern. The building material uneven pattern image processing method according to claim 9, comprising rendering the display data of the uneven pattern based on the method.   A program for causing a computer system to execute the building material uneven pattern image processing method according to any one of claims 9 to 16.