JP7328651B2 - Generation device, generation method and generation program - Google Patents

Description

TECHNICAL FIELD Embodiments of the present invention relate to a generation device, a generation method, and a generation program.

2. Description of the Related Art Conventionally, there is a technique for displaying a virtual image that virtually shows a lighting environment in order to evaluate the glare of light. For this type of virtual image, there is a technique for expressing lighting effects such as brightness of an illuminated object based on luminance information of a lighting device.

Japanese Patent No. 6272687

However, the above-described technique targets the lighting effect of the object illuminated by the lighting device, and does not consider displaying the light-emitting surface of the lighting device. Therefore, a virtual image in which the light-emitting surface is not displayed may lack reality as an illumination environment.

An object of the present invention is to provide a generation device, generation method, and generation program capable of providing a more realistic lighting environment.

A generation device according to an embodiment includes a setting unit and a generation unit. The setting unit sets a reflecting surface that reflects the light from the light source at a position farther from the light source of the lighting device than the virtual viewpoint. The generation unit generates a virtual image displaying reflected light from the reflection surface set by the setting unit as a light emission surface of the light source.

FIG. 1 is a diagram showing an example of a virtual image according to the embodiment. FIG. 2 is a diagram showing an overview of the generation method according to the embodiment. FIG. 3 is a diagram illustrating a configuration example of a display system according to the embodiment; FIG. 4 is a diagram showing the processing contents of the control unit. FIG. 5 is a diagram showing the processing contents of the control unit. FIG. 6 is a diagram showing the processing contents of the control unit. FIG. 7 is a diagram showing the processing contents of the control unit. FIG. 8 is a diagram showing the processing contents of the control unit. FIG. 9 is a diagram showing the processing contents of the control unit. 10 is a flowchart illustrating a procedure of processing executed by the generation device according to the embodiment; FIG. FIG. 11 is a diagram showing a method of setting a light emitting surface according to a modification.

A generation device 1 according to an embodiment described below includes a setting unit 31 and a generation unit 32 . The setting unit 31 sets a reflecting surface that reflects the light from the light source at a position corresponding to the positional relationship between the light source of the lighting device and the virtual viewpoint. The generator 32 generates a virtual image that displays the light reflected by the reflecting surface set by the setting unit 31 as the light emitting surface of the light source.

The setting unit 31 according to the embodiment described below sets the reflecting surface at a position farther than the light source with respect to the virtual viewpoint.

The generation unit 32 according to the embodiment described below generates a virtual image in which the light source is hidden.

A generation unit 32 according to an embodiment described below generates a virtual image in which the light emitting surface is set to have a luminance corresponding to an angle with respect to the reflecting surface or the light source.

The setting unit 31 according to the embodiment described below sets the reflecting surface to be larger than the light source.

The generation unit 32 according to the embodiments described below generates a virtual image in which at least one of the luminance distribution, color distribution, and spectral distribution of the light emitting surface is changed.

(embodiment)
First, the outline of the generation method according to the embodiment will be described with reference to FIGS. 1 and 2. FIG. FIG. 1 is a diagram showing an example of a virtual image according to the embodiment. FIG. 2 is a diagram showing an overview of the generation method according to the embodiment. The example shown in FIG. 1 shows a case where a virtual image IM11 generated by the generation device 1 (see FIG. 3) is displayed on the display unit 11 of the display device 10 . Although FIG. 1 shows a tablet-type display device 10, the display device 10 may be various display devices such as a notebook computer, a mobile computer, a smart phone, a head-mounted display, and a large screen.

To give a more specific example, for example, the display device 10 is implemented by a liquid crystal display, an organic EL (Electro-Luminescence) display, or the like. The display device 10 may be a display device configured with a single screen, or may be a display device configured with a plurality of screens. For example, the display device 10 may be a display device that reproduces a large screen by arranging a plurality of liquid crystal displays. In contrast, a device capable of providing a three-dimensional virtual space image may be used. Further, the display device 10 may be, for example, a stereoscopic display capable of stereoscopic viewing with the naked eye. Moreover, the display device 10 may provide not only a still image but also a moving image as an image, and may provide a three-dimensional image. In other words, the “image” in the following description is not limited to a still image, but can be any content that can be visually recognized by the user, such as a moving image or a three-dimensional image.

The virtual image IM11 is an image that virtually shows a predetermined environment such as a lighting environment, and is an image that expresses a virtual space such as so-called augmented reality (AR) or virtual reality (VR). . Specifically, the virtual image IM11 as augmented reality is a virtual image in which the observer superimposes an image showing a virtual light emitting surface on a camera image of the actually installed illumination device IL. In addition, the virtual image IM11 as virtual reality is generated by activating a predetermined application in response to a predetermined operation of the display device 10 by the observer. It is a virtual image that reproduces the image of

The virtual image IM11 shown in FIG. 1 shows a lighting environment including lighting devices IL11 and IL12 (hereinafter sometimes simply referred to as lighting device IL) and an outdoor stadium illuminated by the lighting devices IL11 and IL12. there is In FIG. 1, the illumination device IL11 indicates an illumination state in which the light source is lit, and the illumination device IL12 indicates an illumination state in which the light source is not illuminated.

In the virtual image IM11 of FIG. 1, an outdoor stadium is used as an example, but an indoor stadium may be used. It may be the place where the device is installed or a specific point. In addition, sports include ball games (for example, baseball, tennis, soft tennis, softball, table tennis, badminton, soccer, basketball, volleyball, rugby, American football, golf, water polo, handball, hockey, etc.), track and field, gymnastics, and swimming. It may be any competition such as a competition, a rowing competition, or the like. Further, when the virtual image IM11 shows the outdoors, the brightness of the lighting device IL (light emitting surface described later) may be changed according to the weather, time, and latitude and longitude.

In the virtual image IM11 shown in FIG. 1, the light emitting surfaces LF11 and LF12 (hereinafter sometimes simply referred to as light emitting surfaces) of the light sources of the illumination devices IL11 and IL12 are reproduced. Specifically, the light emitting surface LF11 indicates an illumination state in which the light source is lit, and the light emitting surface LF12 indicates an illumination state in which the light source is not illuminated.

Here, a conventional virtual image will be described. A conventional virtual image expresses lighting effects such as brightness and darkness of an illuminated object based on the luminance information of the lighting device. There was no consideration of what to do. Therefore, a virtual image in which the light-emitting surface is not displayed may lack reality as an illumination environment.

Therefore, the generation device 1 according to the embodiment generates a virtual image IM11 in which the light emitting surface is visualized by computer graphics processing. FIG. 2 shows an overview of the generation method according to the embodiment.

FIG. 2 schematically shows processing for visualizing the light emitting surface by computer graphics. FIG. 2 also shows a virtual viewpoint VP in the virtual image IM11. In other words, an observer viewing the display device 10 sees the light emitting surface (or the virtual image IM11) from the virtual viewpoint VP. It should be noted that the virtual viewpoint VP is not limited to the viewpoint of a person, and may be a viewpoint seen from a moving object such as a drone or a stationary object, for example. FIG. 2 also shows a light source 50 set by computer graphics and an object 60 having a reflecting surface 61 that reflects the light from the light source 50 . These light sources 50 and objects 60 are set based on three-dimensional data regarding the structure of the illumination device IL. That is, the observer sees the reflective surface 61 of the object 60 in the virtual space and the light reflected by the reflective surface 61 as the light emitting surface of the pseudo light source 50 rather than the light source 50 itself in the virtual space.

In the generation method according to the embodiment, first, the reflecting surface 61 is set at a position corresponding to the positional relationship between the light source 50 of the illumination device IL and the virtual viewpoint VP (step S1). Then, in the generation method according to the embodiment, a virtual image IM11 is generated in which the light reflected by the set reflecting surface 61 (broken line arrow in FIG. 2) is displayed as the light emitting surface of the light source 50 (step S2). For example, the reflectivity of the reflecting surface 61 is set to 100%.

That is, in the generation method according to the embodiment, the reflected light from the reflecting surface 61 is alternatively displayed as the light emitting surface of the light source 50 . Thereby, the light-emitting surface can be displayed to the observer viewing the virtual image IM11. Therefore, according to the generation method according to the embodiment, by generating the virtual image IM11 in which the light emitting surface of the light source 50 is virtually displayed, it is possible to provide a more realistic lighting environment.

In addition, in the generation method according to the embodiment, a predetermined effect may be set on the light emitting surface displayed in the virtual image to add movement to the appearance of the light emitting surface. Here, the effect may be not only an effect applied to an image after rendering but also an effect applied to an object or the like to be rendered before rendering. For example, an effect is a concept that includes not only effects applied to an image after rendering, such as lens flare, but also effects applied before rendering, such as changing the shape of the light source 50 and the object 60 . Setting of such motion will be described later.

Next, a display system S including the generation device 1 according to the embodiment will be described using FIG. FIG. 3 is a diagram showing a configuration example of the display system S according to the embodiment. As shown in FIG. 3, the display system S according to the embodiment includes a generation device 1 and a display device 10. FIG. For example, the generation device 1 is connected to the display device 10 via a predetermined network N so as to be communicable. The display system S may include multiple display devices 10 and multiple generation devices 1 . Note that the generation device 1 and the display device 10 may be integrated. For example, the generation device 1 may have the functionality of the display device 10 . In this case, the generation device 1 may have the same configuration as the display unit 11 of the display device 10 .

Further, the display system S has data necessary for realizing a virtual lighting environment space in the display device 10 (hereinafter sometimes referred to as "lighting environment information"), and provides virtual lighting. It is assumed that the environment is configured so that it can be realized within the display device 10 . The light environment information here includes, for example, various light information of the light emitting surface of the illumination device IL. For example, the light environment information includes various information such as luminance, luminous intensity, light distribution, luminous flux divergence, chromaticity, and color rendering properties of the light emitting surface of the illumination device IL. Further, for example, the optical environment information includes information on at least one of all information calculated from the relative/absolute spectral distribution of the light emitting surface of the illumination device IL, and data on the structure of the illumination device IL (three-dimensional CAD (Computer-Aided Design) data, etc.). Further, for example, the optical environment information includes information such as data (three-dimensional CAD data, etc.) relating to the facilities of a building (for example, an outdoor stadium) in which the lighting device IL is installed, and the structure of the facility. This optical environment information may be stored in either the display device 10 or the generation device 1, or may be stored in another external device.

The display device 10 has a display section 11 . The display unit 11 is, for example, a liquid crystal display or the like, and displays various information. For example, the display unit 11 displays image information including the virtual image IM11. For example, the display unit 11 can reproduce luminance of several hundred to several thousand cd/m ² .

Next, the configuration of the generation device 1 will be described. The generation device 1 has a communication unit 2 , a control unit 3 and a storage unit 4 . Note that the generation device 1 has an input unit (for example, a keyboard, a mouse, etc.) that receives various operations from an administrator of the generation device 1, etc., and a display unit (for example, a liquid crystal display, etc.) for displaying various information. may

The communication unit 2 is implemented by, for example, a NIC (Network Interface Card). The communication unit 2 is connected to the network N by wire or wirelessly. The communication unit 2 transmits and receives information to and from the display device 10 and the like via the network N. FIG. For example, the communication unit 2 communicates image information with the display device 10 .

Here, the generation device 1 includes, for example, a computer having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk drive (HDD), an input/output port, and various circuits. .

The CPU of the computer functions as the setting unit 31 and the generation unit 32 of the control unit 3 by reading and executing programs stored in the ROM, for example.

At least one or all of the setting unit 31 and the generation unit 32 of the control unit 3 can be configured by hardware such as ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array).

Also, the storage unit 4 corresponds to, for example, a RAM or an HDD. The RAM and HDD can store information of various programs. Note that the generation device 1 may acquire the above-described programs and various types of information via another computer or portable recording medium connected via a wired or wireless network.

The control unit 3 of the generation device 1 generates the virtual image IM11 and the like by appropriately using techniques such as a three-dimensional image processing technique and a drawing technique, for example. For example, the control unit 3 may generate the virtual image IM11 or the like by appropriately using various techniques related to rendering. For example, the control unit 3 may generate the virtual image IM11 or the like using various visual effect techniques. For example, the control unit 3 may generate a virtual image IM11 or the like that gives the observer an impression of glare by drawing corresponding to a phenomenon such as lens flare.

The setting unit 31 sets a reflecting surface 61 (object 60) that reflects the light from the light source 50 at a position corresponding to the positional relationship between the light source 50 of the illumination device IL and the virtual viewpoint VP. For example, the setting unit 31 sets the distance from the reflective surface 61 to the light source 50, the distance from the reflective surface 61 to the virtual viewpoint VP, the size of the reflective surface 61, and the like. do.

The setting unit 31 also sets the reflectance of the reflecting surface 61 . Preferably, the reflectance is, for example, 100%. Note that the setting unit 31 may set the reflectance so as to reproduce the light distribution according to the angle between the object 60 or the light source 50 and the virtual viewpoint VP. That is, the setting unit 31 may set the reflectance so as to change at least one of the luminance distribution, color distribution, and spectral distribution of the light emitting surface. will be described later.

The generator 32 generates a virtual image IM11 that displays the light reflected by the reflecting surface 61 set by the setting unit 31 as the light emitting surface of the light source 50 . For example, the generation unit 32 generates a virtual image IM11 in which a predetermined effect is applied to the reflected light and the light emitting surface is animated. Effects include, for example, an effect that changes the brightness depending on the light distribution angle, an effect that changes the brightness depending on the time (day, night, etc.), an effect that blinks the light emitting surface according to the position of the virtual viewpoint VP, and a lens flare. There are effects to be generated, and these effects will be described later with reference to FIG. In addition, the generating unit 32 generates an effect such that the shape of the light emitting surface changes, such as an effect that changes the shape of the reflecting surface or the shape of the light source, or an effect that changes the shape of the light emitting surface formed by the light reflected by the reflecting surface 61. You may set the effect to change.

Next, the processing contents of the control unit 3 having the setting unit 31 and the generation unit 32 will be specifically described with reference to FIGS. 4 to 9. FIG. 4 to 9 are diagrams showing the processing contents of the control unit 3. FIG.

As shown in FIGS. 4 and 5, the setting unit 31 of the control unit 3 sets the distance D from the reflecting surface 61 to the light source 50, the distance L from the reflecting surface 61 to the virtual viewpoint VP, and the normal line NV of the reflecting surface 61. Set the angle θ of the virtual viewpoint VP. Note that in FIG. 4, the angle θ is assumed to be zero degrees.

As shown in FIGS. 4 and 5, the setting unit 31 makes the distance L from the reflecting surface 61 to the virtual viewpoint VP longer than the distance D from the reflecting surface 61 to the light source 50 . That is, the setting unit 31 sets the reflecting surface 61 at a position farther than the light source 50 with respect to the virtual viewpoint VP. As a result, only the reflected light reflected by the reflecting surface 61 can be seen from the virtual viewpoint VP.

Moreover, as shown in FIGS. 4 and 5, the setting unit 31 sets the reflecting surface 61 to be larger than the light source 50 . Specifically, the setting unit 31 makes the area of the reflective surface 61 larger than the area of the light source 50 (the surface facing the reflective surface 61). As a result, the entire shape of the light source 50 can be reflected on the reflecting surface 61, and the light source 50 can be prevented from being cut off when the angle θ described later is not zero degrees (for example, 30 degrees). Moreover, it is preferable that the shape of the reflecting surface 61 and the shape of the light source 50 of the setting portion 31 are substantially the same. This makes it possible to reproduce the light source 50 with more reality. It should be noted that the light source 50 can be made larger than the reflective surface 61 if there is a change in appearance on the VR or AR when the reflective surface 61 is larger than the light source 50 . That is, if the setting unit 31 sets the reflecting surface 61 larger than the light source 50 and the display mode such as the shape of the light emitting surface in the virtual image IM11 becomes abnormal, the setting unit 31 makes the light source 50 larger than the reflecting surface 61. You may

Further, as shown in FIG. 4, the generation unit 32 generates a virtual image IM11 in which the light source 50 is hidden. For example, the generator 32 sets the transmittance of the light source 50 to 100% (reflectance of 0%) so that the reflected light passes through the light source 50 . As a result, it is possible to prevent the shadow of the light source 50 from appearing on the light emitting surface. , when the light source 50 is included in the field of view, etc., it is possible to prevent the shadow of the light source 50 from appearing.

Also, as shown in FIG. 5, when the angle θ is not zero degrees, that is, when the reflecting surface 61, the light source 50, and the virtual viewpoint VP do not overlap, the generation unit 32 , to generate a virtual image IM11 in which the brightness of the light emitting surface is reduced.

In other words, when the angle θ shown in FIG. 4 is zero degrees, the light emitting surface has the highest luminance, and as the angle θ increases (clockwise or counterclockwise), the luminance decreases. Add effects to light. This is a light distribution effect considering that the lighting device IL has a wave-shaped light distribution characteristic.

In this way, by changing the luminance according to the angle θ of the virtual viewpoint VP, it is possible to display a light-emitting surface that takes into account predetermined light distribution characteristics, so that a more realistic lighting environment can be provided to the observer.

Although the generation unit 32 sets the brightness of the light emitting surface to the highest when the angle θ is zero degrees, for example, when the angle θ is a specific angle other than zero degrees, can be

Further, the light distribution effect of the generation unit 32 is not limited to that based on the light distribution characteristic of the Namida type. For example, in the case of a predetermined angle .theta. may be based on the light distribution characteristics of That is, the generator 32 may generate a virtual image including the light emitting surface so as to reproduce the light distribution according to the angle θ. For example, the generation unit 32 may change the reflectance of the reflecting surface 61 so that the luminance of the light emitting surface corresponds to the angle θ. You can change it. Further, the generation unit 32 may set the luminance of the light emitting surface according to, for example, the angle of the virtual branch VP with respect to the normal line of the light source 50 instead of the angle θ of the virtual viewpoint VP with respect to the normal line NV of the reflecting surface 61. good.

Further, the generation unit 32 may set, as an effect other than the light distribution effect, a lens flare effect that occurs only when the angle θ is zero degrees. Further, the generation unit 32 may set an effect that blinks the outer edge region of the light emitting surface as the angle θ increases.

Furthermore, in addition to the effects described above, the generation unit 32 may set effects associated with the time of the lighting environment. For example, the generation unit 32 may reduce the brightness of the reflected light as a whole during bright hours in the daytime and increase the brightness of the reflected light as a whole during the dark hours of the night.

Further, when the display device 10 is a head-mounted display, the generation unit 32 may set an effect of generating an afterimage of light. Specifically, when the position of the virtual viewpoint VP is changed, the generation unit 32 generates afterimage light similar to the shape of the light emitting surface near the center of the display unit 11 . Such afterimage light is the complementary color of the light emitting surface. Alternatively, the color of the afterimage light may be changed according to the brightness of the light emitting surface.

In the above description, the case where the generation unit 32 applies an effect to reflected light has been described. can be

Alternatively, the effect by the generation unit 32 may be applied not only to the reflected light but also to the background of the virtual image IM11 and the irradiated object (the stadium shown in FIG. 1). For example, when setting an effect for the background of the virtual image IM11, if the light intensity of the illumination device IL is strong and the light intensity of the background is weak, an effect that makes the background difficult to see is set. Specifically, when stars are set in the night sky as the background, stars that are close to the lighting device IL or light distributions that have a light intensity equal to or higher than a predetermined threshold within the light distribution range of the lighting device IL For the stars located in the range, set an effect that makes them difficult to see. On the other hand, for a star that is far from the illumination device IL or a star that is located in a light distribution range in which the light intensity is less than a predetermined threshold within the light distribution range of the illumination device IL, the light intensity of the star is reduced. You may set the effect to strengthen. Further, the generation unit 32 may set an effect for changing the brightness itself or the setting of the object itself (for example, shape, brightness, transparency, texture, etc.).

In addition, as described above, the generating unit 32 is not limited to generating the virtual image IM11 after setting effects on the reflected light, the background, and the irradiated object. The above effect may be set for the virtual image IM11 in the rendered image).

Next, with reference to FIG. 6, the case of irradiating the ground with light will be described. When generating the virtual image IM in which the ground is illuminated with light, the setting unit 31 arranges the light source 50a at a position closer to the virtual viewpoint VP than the reflecting surface 61, and arranges the light source 50b at a position farther from the reflecting surface 61. to place. The distance D to the reflecting surface 61 is the same for the light source 50a and the light source 50b. That is, the light source 50b is arranged facing in the opposite direction to the light source 50a. With such an arrangement, it is possible to irradiate light in the same manner as when it is arranged at the position of the light source 50a.

In addition, as shown in FIG. 7 , the setting unit 31 sets a dark region DR in which the light information of the light source 50 is not reflected on the side opposite to the light source 50 with respect to the reflecting surface 61 . As a result, it is possible to prevent the object 60 from being erroneously recognized as a shield by computer graphics software processing.

Next, the reflecting surface 61 will be specifically described with reference to FIGS. 8 and 9. FIG. FIG. 8 shows a front view of the reflecting surface 61 viewed from the front (light source 50). 9 shows reflected light from the reflecting surface 61 of FIG. 8, that is, the shape of the light emitting surface and the luminance distribution in the radial direction. As shown in FIG. 8, the reflecting surface 61 is, for example, circular. That is, the light source 50, which has the same shape as the reflecting surface 61, also has a circular shape.

As shown in FIG. 8, the setting unit 31 sets, for example, the area of the reflecting surface 61 by dividing it into a high reflectance area and a low reflectance area. Specifically, the setting unit 31 makes the center of the reflecting surface 61 higher in reflectance than the outer edge.

As a result, as shown in FIG. 9, the light-emitting surface is composed of a central area with high luminance and an outer edge area where the luminance gradually decreases. In other words, by partially changing the reflectance as shown in FIG. 8, a more realistic lighting environment can be provided.

In FIGS. 8 and 9, the center of the reflecting surface 61 has a higher reflectance than the outer edge, but the outer edge may have a higher reflectance than the center. In other words, any reflectance may be set according to the illumination characteristics of the illumination device IL.

Alternatively, the circular reflecting surface 61 may be divided into two half-moons, and the reflectance of one half-moon may be increased and the reflectance of the other half-moon may be decreased. That is, the reflectance may be changed at any position, area, or shape on the reflecting surface 61 according to the required characteristics of the light emitting surface.

Further, in FIG. 9, the luminance distribution in the center of the light emitting surface is uniform (straight line), but the luminance distribution in the center may change continuously (wavy shape), for example.

Moreover, although the reflectance of the reflecting surface 61 is changed in FIG. 8, the surface texture of the reflecting surface 61 may be changed, for example. For example, the setting unit 31 may set a texture having fine unevenness on the surface of the reflecting surface 61 .

In other words, since the minute unevenness set on the reflecting surface 61 functions as a prism, the light distribution on the light emitting surface can be changed based on diffused light or spot light (condensed light). Therefore, it is possible to freely change the light distribution characteristics of the light emitting surface.

Although FIG. 9 shows the case where the luminance distribution of the light emitting surface is changed, other distributions such as the color distribution and the spectral distribution of the light emitting surface may be changed. By changing the distribution of the light-emitting surfaces in this way, a more realistic lighting environment can be provided.

Moreover, although FIG. 8 shows the case where the light emitting surface is a perfect circle, the shape of the light emitting surface may be other shapes such as an ellipse and a polygon.

Next, a procedure of processing executed by the generation device 1 according to the embodiment will be described with reference to FIG. 10 . FIG. 10 is a flowchart showing the procedure of processing executed by the generation device 1 according to the embodiment.

As shown in FIG. 10, the setting unit 31 sets the virtual viewpoint VP and the light source 50 (step S101). Subsequently, the setting unit 31 sets the reflecting surface 61 that reflects the light from the light source 50 at a position corresponding to the positional relationship between the light source 50 and the virtual viewpoint VP (step S102).

Subsequently, the generator 32 sets the brightness of the light emitting surface according to the angle θ (step S103). Then, the generation unit 32 generates a virtual image while the light source 50 is set as a non-display target (step S104) (step S106).

As described above, the generation device 1 according to the embodiment includes the setting section 31 and the generation section 32 . The setting unit 31 sets the reflecting surface 61 that reflects the light from the light source 50 at a position corresponding to the positional relationship between the light source 50 of the illumination device IL and the virtual viewpoint VP. The generator 32 generates a virtual image IM11 that displays the light reflected by the reflecting surface 61 set by the setting unit 31 as the light emitting surface of the light source 50 . This makes it possible to provide a more realistic lighting environment.

In the above-described embodiment, one light source 50 and one reflecting surface 61 are set. A plurality of reflective surfaces 61 may reflect one light source 50 .

Alternatively, one reflective surface 61 may be set for each of the plurality of light sources 50 .

Further, in the above-described embodiment, the process of generating an image viewed from the virtual viewpoint VP has been described. Here, the generation device 1 may generate images viewed from a plurality of virtual branch offices VP. For example, the generation device 1 may generate a still image or a moving image for each of the virtual viewpoint at the position corresponding to the left eye and the virtual viewpoint at the position corresponding to the right eye. For example, the generation device 1 may generate an image including light emitting surfaces with different luminances for the image for the left eye and the image for the right eye by considering the light distribution. Such a viewpoint-shifted image can be used to provide a stereoscopic image in a head-mounted display or the like.

In the above-described embodiment, the light source 50 and the reflecting surface 61 represent one light emitting surface. However, for example, one light emitting surface may be represented by mirror-copying part of the light emitting surface. . This point will be described with reference to FIG.

FIG. 11 is a diagram showing a method of setting a light emitting surface according to a modification. The generating device 1 draws a part of the light emitting surface by the light source 50 and the reflecting surface 61, and reproduces the remaining part based on the drawn part of the light emitting surface to display the entire light emitting surface.

For example, in the example shown in FIG. 11, the generating unit 32 first sets the light source 50 and the reflecting surface 61 so that the entire light emitting surface can be displayed during modeling. At the time of rendering, the generation unit 32 renders only the left semicircular light emitting surface of the entire light emitting surface set at the time of modeling. Subsequently, the generating unit 32 mirror-copies the rendered left semicircular light emitting surface to generate a right semicircular light emitting surface. Then, the generating unit 32 synthesizes the rendered left semicircular light emitting surface and the mirror-copied right semicircular light emitting surface to generate the entire circular light emitting surface. That is, the generation unit 32 draws a part of the light emitting surface from the reflecting surface 61 and the light source 50 corresponding to a part of the light emitting surface among the reflecting surface 61 and the light source 50 set on the entire light emitting surface. Based on a portion of the light emitting surface, the remaining portion is duplicated to display the entire light emitting surface. This makes it possible to halve the rendering process compared to rendering the entire circular light-emitting surface. That is, there is no need to perform rendering processing for the light-emitting surface of the right semicircle. Therefore, according to the generation device 1 according to the modification, the processing load for displaying the light-emitting surface can be reduced.

Note that the generation unit 32 sets the light source 50 and the reflecting surface 61 so that the entire light emitting surface can be displayed during modeling. and a reflective surface 61 may be set. In such a case, the generating unit 32 renders the left semicircular light emitting surface using the light source 50 and the reflecting surface 61 set at the time of modeling, and mirror-copy the rendered left semicircular light emitting surface to obtain the right half circular light emitting surface. Generate a semicircular light emitting surface. Then, the generation unit 32 displays the entire circular light emitting surface by synthesizing the left semicircular light emitting surface and the right semicircular light emitting surface. As a result, the processing load of the generator 32 during modeling can be reduced.

Note that FIG. 11 shows a case where mirror copying is performed using a semicircular light-emitting surface as the copy source, but the light-emitting surface as the copy source may be, for example, a 1/4 or 1/6 light-emitting surface. Alternatively, it may be one fan-shaped light emitting surface divided into three or more equal parts.

While embodiments of the invention have been described, the embodiments have been presented by way of example and are not intended to limit the scope of the invention. This embodiment can be implemented in various other forms, and various omissions, replacements, and modifications can be made without departing from the scope of the invention. This embodiment and its modifications are included in the scope and gist of the invention, as well as the scope of the invention described in the claims and its equivalents.

1 generation device 2 communication unit 3 control unit 4 storage unit 10 display device 11 display unit 31 setting unit 32 generation unit 50 light source 60 object 61 reflective surface IL lighting device IM11 virtual image S display system

Claims (9)

a setting unit that sets a reflecting surface that reflects the light from the light source at a position farther from the light source of the lighting device than the virtual viewpoint;
a generator that generates a virtual image that displays the light reflected by the reflecting surface set by the setting unit as the light emitting surface of the light source;
A generating device comprising: The generating unit
2. The generator according to claim 1 , wherein the virtual image is generated with the reflecting surface and the light source hidden. The generating unit
3. The generating device according to claim 1 , wherein the virtual image is generated by setting the brightness of the light emitting surface according to the angle with respect to the reflecting surface or the light source. The setting unit
The generator according to any one of claims 1 to 3 , wherein the reflecting surface is set larger than the light source. The generating unit
The generation device according to any one of claims 1 to 4 , wherein the virtual image is generated by changing at least one of luminance distribution, color distribution and spectral distribution of the light emitting surface. a setting unit that sets a reflecting surface that reflects the light from the light source at a position farther from the light source of the lighting device than the virtual viewpoint;
a generator that generates a virtual image that displays the light reflected by the reflecting surface set by the setting unit as the light emitting surface of the light source;
and
The generating unit
rendering a portion of the light emitting surface by the reflecting surface and the light source, and replicating the remaining portion based on the rendered portion of the light emitting surface to display the entire light emitting surface . Device. The generating unit
Of the reflective surface and the light source set on the entire light emitting surface, a part of the light emitting surface is drawn from the reflecting surface and the light source corresponding to a part of the light emitting surface, and one of the drawn light emitting surfaces 7. The generation device according to claim 6 , wherein the entire light-emitting surface is displayed by duplicating the remainder based on the part. A computer implemented method of generation comprising:
a setting step of setting a reflecting surface that reflects the light of the light source at a position farther from the light source of the lighting device than the virtual viewpoint;
a generating step of generating a virtual image displaying the light reflected by the reflecting surface set in the setting step as a light emitting surface of the light source;
A generation method, comprising: a setting procedure of setting a reflecting surface that reflects the light of the light source at a position farther from the light source of the lighting device than the virtual viewpoint;
a generating step for generating a virtual image displaying the light reflected by the reflecting surface set by the setting step as the light emitting surface of the light source;
A generation program characterized by causing a computer to execute

Images