JP2020034711A - View point dependent image display system, view point dependent image display object and program - Google Patents

Abstract

To provide a view point dependent image display object capable of performing at real time, generation and reproduction of an object surface comprising glossiness according to a visual line direction, using a computer graphic.SOLUTION: A view point dependent image display object comprises a three-dimensional structure 10 comprising a plurality of open holes whose arrangement directions are different each other. The open holes comprise: a first opening part 11 which is linear and is formed on a surface 10a of the three-dimensional structure; and a second opening part 12 which is opened to a back surface 10b. A light entering from the second opening of the open hole where the visual line direction and the arrangement direction viewed from the surface side match each other, can be visually recognized from the first opening part, a light entering from the second opening part of the open hole where the visual line direction and the arrangement direction do not match each other, cannot be visually recognized from the first opening part. The first opening part of the open hole whose arrangement direction matches the visual line direction is arranged so that an image which is visible on the surface from the visual line direction is arranged, therefore the image viewed from an optional visual line direction is displayed on the surface.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a viewpoint-dependent image display system, a viewpoint-dependent image display object, and a program.

  In order to realistically reproduce an object in the real world in a virtual space in a computer, the expression of a glossy object surface is key. For example, when a glossy object is illuminated, highlights generated by the light source itself are generated on the object surface depending on the angle between the viewpoint and the object. In order to realistically reproduce an object in the real world in a computer, a method for calculating a highlight that changes according to the viewpoint position at high speed using graphics hardware is required.

  For example, in the conventional method using the rendering technology of computer graphics, the material properties and the reflection properties of the object surface are given to the created three-dimensional model, and at the same time, the information of the light source is set in advance to give a gloss. Generates and reproduces the object surface.

  However, in the above-described conventional method, it is necessary to obtain in advance information on the position and type of each material constituting the object and the light source, and it is enormous to obtain such information for all the objects in the real space. There is a problem that a long working time is required. In particular, there is a problem that it is extremely difficult to specify the positions and types of all light sources in the real world.

  On the other hand, as one method for displaying an image that changes depending on the viewpoint, for example, all images obtained by photographing the object surface from all angles are stored, and when displaying an image, the viewpoint position is determined from these image stocks. There is a technique for selecting and switching an image corresponding to each frame. However, performing this processing on all surfaces of all objects is problematic in terms of speed, and is not suitable for real-time display.

  The above-described problems are described as being independent from each other, and the present invention does not necessarily need to be able to solve all of the described problems, and it is sufficient that at least one problem can be solved. In addition, it has the intention to acquire the right by itself for divisional application, amendment, etc. for the configuration for solving this problem.

  (1) In order to solve the above-described problem, a viewpoint-dependent image display object of the present invention includes an object having a large number of through-holes having different arrangement directions, and the through-hole is linear and formed on the surface of the object. A first opening to be provided, and a second opening that opens to a surface other than the surface, and enters from the second opening of the through-hole in which the arrangement direction matches the line of sight viewed from the surface side. The light is visible from the first opening, and the light entering from the second opening of the through hole in which the disposition directions do not match is configured to be invisible from the first opening, and the light matches the line-of-sight direction. The first opening of the through-hole in the arrangement direction is arranged so as to form an image which can be seen on the surface of the object from the line of sight.

  According to the present invention, image information when viewed from various viewpoints is embedded in an object having one three-dimensional structure, and the first opening of the through hole in the arrangement direction that matches the line of sight viewed from various viewpoints Only shines and an image is formed on the surface of the object. Therefore, various images corresponding to the direction of the line of sight of the object are formed on the surface of the object as an aggregate of granular light. By arranging a large number of through holes three-dimensionally, an image projected on the surface of the object changes according to the direction of the line of sight looking at the object.

  The object may exist in a virtual space like computer graphics, for example, or may be a real structure existing in a real space. In the case where the object exists in the virtual space, for example, when the line-of-sight direction changes, light passes through the through-hole in the arrangement direction corresponding to the line-of-sight direction, and the position of the first opening of the passed through hole emits light. Since the processing may be performed so as to be seen, real-time processing using existing graphics hardware becomes possible. The object corresponds to the three-dimensional structure 10 in the embodiment.

  (2) The first opening and / or the second opening of the through hole is formed at the same position as the first opening and / or the second opening of another through hole, and the plurality of the through holes are formed. It is good to constitute so that it may also be used. With this configuration, the space such as the surface of the object can be used effectively and efficiently, and the image formed on the surface can be made detailed.

  (3) The second openings of the plurality of through holes may be configured to receive light of a predetermined color, and the predetermined color may be different depending on the position of the second opening. In this case, since each of the plurality of second openings emits light in an appropriate color, the color is generated at the first opening connected to the second opening by the through hole. Therefore, the image formed on the surface is appropriately colored, so that the expression that is more palatable and more interesting can be provided.

  (4) The object has a plurality of layers inside along the direction in which the through holes are arranged, and the plurality of layers have holes in portions intersecting with the direction in which the through holes are arranged, The through holes may be formed by the holes formed in a plurality of layers. In this way, for example, an object can be composed of a plurality of layers, and processing in computer graphics can be performed easily and easily.

  (5) It is preferable that the plurality of through holes have different internal dimensions. In this case, since the size of the light particles seen through the through hole is proportional to the inner size of the through hole, a more complicated image can be formed.

  (6) A viewpoint-dependent image display system according to the present invention includes the viewpoint-dependent image display object according to any one of (1) to (5), and matches a viewing direction viewed from a surface side of the object. The first opening of the through hole in the arrangement direction may be processed so as to emit light, and a function of displaying an image viewed from the line of sight on the surface may be provided. In this way, specular can be realistically reproduced from a large number of images of the real world without using information on the constituent materials of the object and the light source.

  (7) The program according to the present invention may be a program for causing a computer to realize the functions used in the viewpoint-dependent image display system according to (6).

  According to the present invention, an image corresponding to the line of sight direction can be formed on the surface of an object. For example, it is possible to generate and reproduce a glossy object surface using computer graphics in real time.

FIG. 1 is a diagram showing a preferred embodiment of a viewpoint-dependent image display system and a viewpoint-dependent image display object according to the present invention. It is a figure which shows the relationship between a through-hole and a line of sight. It is a figure explaining another form of a through-hole. It is a figure showing an example of the pattern of the hole formed in each layer. FIG. 7 is a diagram illustrating an example of an image displayed on a front surface when viewed from different viewing directions. It is a figure showing a modification. It is a figure showing a modification. It is a figure showing an example of a formation system of a three-dimensional structure. It is a figure showing an example of a formation system of a three-dimensional structure.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. The present invention is not construed as being limited thereto, and various changes, modifications, and improvements can be made based on the knowledge of those skilled in the art without departing from the scope of the present invention.

  FIG. 1 shows a three-dimensional structure 10 used in a viewpoint-dependent image display system according to the present invention and an operation principle of the present system. The three-dimensional structure 10 is, for example, a data structure processed by a computer that generates and displays computer graphics, a virtual three-dimensional structure, and a 3D object. It may be a structure.

  The three-dimensional structure 10 has a predetermined thickness t. In the illustrated example, the three-dimensional structure 10 is formed of a rectangular parallelepiped, and the front surface 10a and the back surface 10b are both arranged in parallel in a plane. Inside the three-dimensional structure 10, there are a large number of through holes 13a, 13b, 13c ... penetrating from the front surface 10a toward the back surface 10b. Each of the through holes 13a, 13b, 13c,... Has a first opening 11 and a second opening 12 at both ends. The through holes 13a, 13b, 13c,... May be fine holes, and the angles to the surface 10a may be appropriately changed. Specifically, as shown in FIGS. 1 and 2, for example, the through hole 13 a is formed so as to extend in a direction orthogonal to the front surface 10 a and the back surface 10 b, and the through holes 13 b and 13 c are respectively formed. It is formed so as to extend in a direction inclined at a predetermined angle and a predetermined direction. The through hole 13b is formed to extend diagonally to the lower right in the state shown in FIG. Moreover, the inclination directions and angles of the through holes 13a, 13b, 13c...

  Light enters from the back surface 10b and enters the through holes 13a, 13b, 13c,... Through the second openings 12, 12a, 12b,. The light may be set so as to uniformly enter each second opening 12 from an infinity point or the like, such as sunlight or natural light, in a virtual space processed by a computer. When the setting is made such that light is incident uniformly, a pattern formed by each through hole is formed on the surface 10a.

  When the three-dimensional structure 10 is configured as described above, for example, when viewed from a direction orthogonal to the surface 10a such as the viewpoint A, the depth of the through hole 13a orthogonal to the surface 10a that matches the line of sight is The light incident from the second opening 12 can be seen, and the other through-holes 13b, 13c,... Cannot be seen from behind, so that the light cannot be seen. Therefore, of the many first openings 11 formed on the surface 10a, a portion connected to the through hole 13a becomes bright, and a portion to which the through hole 13a is not connected becomes dark. As a result, a predetermined pattern image such as a predetermined character or picture, for example, a character "A" appears on the front surface 10a, as shown in FIG.

  Similarly, for example, when viewed from a direction inclined at a predetermined angle with respect to the surface 10a such as the viewpoint B, the through-hole 13b inclined at a predetermined angle with respect to the surface 10a with which the line of sight coincides is visible, and The light incident from the opening 12 can be visually recognized, and the other through holes 13a, 13c,... Are invisible and the closed state, and the light cannot be visually recognized. Therefore, of the many first openings 11 formed on the surface 10a, a portion connected to the through hole 13b becomes bright, and a portion to which the through hole 13b is not connected becomes dark. As a result, a predetermined pattern image such as a predetermined character or picture different from that at the viewpoint A, for example, a character "B" appears on the front surface 10a as shown in FIG.

  Further, when viewed from a direction inclined at a predetermined angle different from the viewpoint B with respect to the surface 10a like the viewpoint C, among the many first openings 11 formed in the surface 10a, the through-hole 13c whose line of sight coincides. The connected portion becomes bright, and the portion to which the through hole 13c is not connected becomes dark. These relationships also hold for lines of sight at various other angles. Therefore, various images according to the direction of the line of sight to look at the object are formed on the surface 10a of the three-dimensional structure 10 as aggregates of granular light. That is, by arranging a large number of fine through holes three-dimensionally, an image projected on the surface of the object changes according to the direction of the line of sight of the object.

  The light emitted from the first opening 11 is incident on the back surface 10b and is visible through the through hole. The light incident from the back surface 10b may be a light source that emits light by itself, or may be a light source that does not emit light by itself, such as a white wall on the back side. Then, for example, when viewed with a line of sight perpendicular to the surface 10a, such as the viewpoint A, the light is viewed from the front, and the object surface in a state where the light is perpendicular to the surface 10a It is a state of reflected light. Further, when viewed with a line of sight inclined with respect to the surface 10a as in the viewpoints B and C, the light is viewed obliquely, and the surface of the object in a state where the light is obliquely incident on the surface 10a. It is a state of reflected light. The reflected light on the object surface, which changes depending on the viewing angle, can be easily reproduced.

  Each of the through holes 13a, 13b, 13c,... Has a one-to-one relationship with the rear second opening 12 connected to the front opening 11, that is, both ends of each of the through holes 13a, 13b, 13c,. The first opening 11 and the second opening 12 are formed independently of each other, and also serve as the first opening 11 or the second opening 12 of the other through holes 13a, 13b, 13c (formed at the same position). ), But a one-to-many configuration in which the first opening 11 is also used by a plurality of through holes, or a multi-pair in which the second opening 12 is also used by a plurality of through holes, as in the present embodiment. It is more preferable to adopt one configuration. In the case of a one-to-one configuration, only one corresponding through-hole whose line of sight matches can be seen, and it does not shine when viewed from another place. Therefore, when viewed from a specific line of sight, the granular form formed on the surface 10a There are fewer sites where light can exist. Therefore, it is impossible to produce a detailed image that can be expressed. On the other hand, if the number is one-to-many, even with the same first opening 11, it can be made to shine at a plurality of different lines of sight. Sometimes you can see the light. Therefore, it is preferable to use one-to-many or many-to-one as described above because a limited space can be used efficiently and a more detailed image can be displayed on the surface 10a.

  In the embodiment described above, each of the through holes 13a, 13b, 13c,... Is cylindrical, but the shape is arbitrary, and can be a square tube or any other shape. In the case of the rectangular tube shape, pictures and characters such as a dot pattern can be expressed.

  In the above-described embodiment, the through holes 13a, 13b, 13c... Are continuous holes having the same inner diameter. However, the present invention is not limited to this. For example, as shown in FIG. A plurality of layers (six layers in the illustrated example: first layer 15a, second layer 15b, third layer 15c, fourth layer 15d, fifth layer 15e, and sixth layer 15f) are provided so as to overlap with each other. The same effect may be obtained by forming holes at predetermined positions of the layers and laying out the holes of the respective layers so that they are connected and overlapped, for example, when viewed from a surface side with a predetermined line of sight.

  For example, FIG. 4 shows a pattern of holes 16 formed in the first layer 15a, the second layer 15b, the third layer 15c, the fourth layer 15d, the fifth layer 15e, and the sixth layer 15f. In the figure, the portion painted black is the portion forming the hole 16, and the white portion is the portion 17 having no hole and blocking light. In the present embodiment, the three-dimensional structure 10 is formed in a virtual space in computer graphics. Therefore, even in the structure in which the holes 16 forming the plurality of through-holes are connected in the pattern in each layer, and a portion 17 that blocks light is present inside, it can be formed.

  The computer control device applies the six patterns shown in FIG. 4 to each of the first layer 15a, the second layer 15b, the third layer 15c, the fourth layer 15d, the fifth layer 15e, and the sixth layer 15f in FIG. The arranged three-dimensional structure 10 is formed and stored. Then, when viewing the three-dimensional structure 10 with a line of sight orthogonal to the surface, such as the viewpoint A, the control device performs, for example, a process of blocking light other than light passing through the through-hole. Thereby, it appears that the portion of the surface 10a where the holes 16 exist in all six layers in the direction of the line of sight emits light. For example, a pattern as shown in FIG. 5A is generated and displayed on the display device. Further, for example, when viewed with a line of sight inclined at a predetermined angle with respect to the surface, such as the viewpoint B, the control device performs the same processing to generate a pattern as shown in FIG. Display on the device.

  In the above-described embodiment, the light incident on the back surface 10b side of the three-dimensional structure 10 is assumed to be uniformly irradiated with the same color as a whole, for example, like natural light. 0/1 control such as “visible / invisible” on the back side is performed through the first opening 11 of the present invention. However, the present invention is not limited to this. For example, as shown in FIG. On the back surface 10b side, for example, a member such as the liquid crystal display 20 that can appropriately change the emission color is disposed, and by changing the color at the end of each line of sight appropriately, the pattern and color seen in the direction of each line of sight are changed. You may want to change it. When the three-dimensional structure 10 is a real object, the liquid crystal display 20 is also a substantial device, and when the three-dimensional structure 10 is in a virtual space like computer graphics, for example, a desired The display may be a virtual display or the like that emits the color of.

  In this case, since each of the plurality of second openings 12 emits light in an appropriate color, the color is transmitted to the first openings 11 connected to the second openings 12 through the through holes, and the lines of sight match. In this case, the first opening develops the color. Therefore, the image formed on the front surface 10a is appropriately colored, and can be expressed in a more palatable and interesting manner.

  Further, the inside dimensions and shapes of the through holes 13a, 13b, 13c... In the example shown in FIG. 1, the through-holes 13a, 13b, 13c,... Are all cylindrical, but may be rectangular cylinders or other arbitrary shapes, and the dimensions (in this example, the inner diameter) are all the same. However, for example, as shown in FIG. 7, a through hole including a first opening 11a and a second opening 12a having a small diameter and a first opening 11b and a second opening 12c having a large diameter may be provided. . Since the size of the light particles seen through the through hole is proportional to the diameter of the through hole, a more complicated image can be formed by employing a drawing method such as a mosaic image. Furthermore, by individually adjusting the position, size, and angle of the through-hole, the amount of light reaching the eye from the opposite side of the three-dimensional structure 10 through the through-hole can be adjusted, so that shading can be expressed.

  Furthermore, the image to be reproduced on the surface is not limited to the planar pattern shape as illustrated, and it is preferable that a three-dimensional shape can be seen. For example, a three-dimensional object such as a human face changes its appearance depending on the viewing angle. For example, the image seen through the hole when viewed from the front should be the same as the one actually seen from the front, and the image seen through the hole when viewed from the angle changed direction should be gradually changed. By changing the direction of the line of sight, you can see three-dimensionally.

  The three-dimensional structure 10 is designed and formed, for example, by the control device 21 of the computer shown in FIG. (1) The control device 21 of the computer selects the line-of-sight direction Li. The selection of the line-of-sight direction Li is performed, for example, in response to an input instruction from the input device 24 of the computer operated by the user, or the control device 21 itself automatically selects an appropriate angle sequentially.

  (2) Select an image of the object surface viewed from the line of sight Li, that is, a stippled light image Vi. This selection is made, for example, by storing a plurality of stippling images in the storage device 22 in advance and, for example, by inputting from the input device 24 of a computer operated by the user with a list of the plurality of stippling images displayed on the display device 23. Upon receiving the input instruction, the corresponding pointillistic image is read out and set as a processing target. In addition, for example, when storing in the storage device 22, information on the line-of-sight direction is also stored in association with the stippled image, and the control device 21 automatically selects the stippled image corresponding to the line-of-sight direction Li selected in (1). Then, it may be read and set as a processing target.

  (3) The control device 21 generates the through-hole 13 in the direction of the line of sight Li in accordance with each point (point to be the first opening) of the pointillized image Vi to be processed. In the case where the through-hole 13 formed in the three-dimensional structure has a discontinuous configuration in which holes are formed in each of a plurality of layers, holes are formed at intersections of straight lines extending in the line-of-sight direction Li and respective layers.

  (4) The control device 21 repeats the above operations (1) to (3) for all viewing directions. As a result, a three-dimensional structure 10 with through-holes formed by computer graphics is formed. When the three-dimensional structure is a real object in the real space, the control device 21 creates 3D data and other design information for manufacturing the three-dimensional structure. For example, a 3D printer may be used to manufacture a three-dimensional structure including an object in a real space. In this case, the control device 21 creates 3D data and sends the created 3D data to the 3D printer. . Thereby, a desired three-dimensional structure is manufactured.

  When the three-dimensional structure is an object in the real space manufactured as described above, for example, it may be applied to an ornamental object or an information display object.

  Further, there is no limitation on the shape of the three-dimensional structure, but if the depth in the line-of-sight direction is insufficient, the through-hole in the line-of-sight direction Li is seen from another line-of-sight direction Lj, and the image of the object surface is disturbed. For example, when the thickness t is set to infinity, the disturbance is completely eliminated, but the thickness cannot be set to infinity at least for an object in the real space. Therefore, it is practically preferable that the thickness be as thin as possible without disturbing the image. Therefore, it is preferable that the thickness t of the three-dimensional structure 10 is set to a thickness at which these effects are obtained. In addition, although there may be a cavity inside the object, it is preferable that the light passing through the through hole in another direction is not seen in all the viewing directions, and that the image on the object surface is not disturbed. .

  As described above, various aspects of the present invention have been described using the embodiments and the modified examples. However, these embodiments and the description are not intended to limit the scope of the present invention, and are not intended to limit the scope of the present invention. Please note that it was provided to contribute. The scope of the present invention is not limited to the configurations and manufacturing methods explicitly described in the specification, but also includes combinations of various aspects of the present invention disclosed in the specification. Of the present invention, the structure for which a patent is sought is specified in the appended claims. However, even if the present invention is not specified in the claims, it is disclosed in the present specification. It is worth noting that this configuration may be claimed in the future.

10: three-dimensional structure 10a: front surface 10b: back surface 11: first opening 11a: first opening 11b: first opening 12: second opening 12a: second opening 12b: second opening 12c: second Opening 13a: Through hole 13b: Through hole 13c: Through hole 15a: First layer 15b: Second layer 15c: Third layer 15d: Fourth layer 15e: Fifth layer 15f: Sixth layer 16: Hole 20: Liquid crystal Display 21: Control device 22: Storage device 23: Display device 24: Input device

Claims (7)

With an object having a large number of through holes with different arrangement directions,
The through-hole includes a first opening formed in a surface of the object in a straight line, and a second opening that opens in a surface other than the surface,
The light entering from the second opening of the through hole, in which the line-of-sight direction seen from the front side and the arrangement direction match, can be visually recognized from the first opening, and the second of the through-hole in which the arrangement direction does not match. Light entering from the opening is configured to be invisible from the first opening,
The viewpoint-dependent image display, wherein the first opening of the through-hole in the disposition direction coinciding with the line-of-sight direction is arranged to form an image visible on the surface of the object from the line-of-sight direction. object.   The first opening and / or the second opening of the through hole is formed at the same position as the first opening and / or the second opening of another through hole, and is also used by a plurality of the through holes. The viewpoint-dependent image display object according to claim 1, wherein the object is configured as follows. The second openings of the plurality of through holes are configured so that light of a predetermined color is incident thereon,
The viewpoint-dependent image display object according to claim 1, wherein the predetermined color is different depending on a position of the second opening. The object has a plurality of layers inside along the arrangement direction of the through holes,
The plurality of layers have holes at portions intersecting with the arrangement direction of the through holes,
The viewpoint-dependent image display according to claim 1, wherein the through-hole is formed by the holes formed in the plurality of layers.   5. The viewpoint-dependent image display object according to claim 1, wherein the plurality of through-holes have different internal dimensions. 5. A viewpoint-dependent image display object according to any one of claims 1 to 5,
A function of processing the first opening of the through hole in the disposition direction corresponding to the line of sight viewed from the surface side of the object so as to emit light, and displaying an image viewed from the line of sight on the surface. A viewpoint-dependent image display system comprising:   A program for causing a computer to realize functions used in the viewpoint-dependent image display system according to claim 6.

Images