KR20200089072A - Apparatus and Method for Acquiring Illumination Spatial Information and Method for Evaluating Illumination Environment of Target Space - Google Patents

Abstract

The present invention relates to an apparatus and a method for acquiring illumination spatial information and a method for evaluating illumination environment of a target space. Specifically, the present invention relates to the apparatus for acquiring illumination spatial information comprising: a camera module installed in a surface facing at least one illumination installed in a ceiling surface to acquire an image of a ceiling space of the target space; a distance measurement module emitting a light source with straightness between the ceiling surface and a floor surface to measure height information of the target space; and a calculation module acquiring shape information of the ceiling surface based on the image of the ceiling space, then calculating a stereoscopic space information on the target space by using the shape information of the ceiling surface and the height information of the target space, and calculating an illumination position and an illumination intensity by using the image of the ceiling space to form illumination space information based on the stereoscopic space information.

Description

Apparatus and Method for Acquiring Illumination Spatial Information and Method for Evaluating Illumination Environment of Target Space}

The present invention relates to an apparatus for acquiring illumination space information capable of automatically reconstructing illumination space information by analyzing illumination information existing in the target space, and a method for evaluating the lighting environment of the target space.

Recently, a research has been conducted to generate a 3-dimensional (3-Dimensional, 3D) model of a real scene and to render a result image by including a virtual object in the generated 3D model.

Applications in this field of research include technologies that take advantage of both the realism of photorealistic images and the freedom of computer graphics images by inserting virtual synthetic characters into the space of the screen actually shot in a movie or game. This technique is also referred to as mixed rendering.

However, in order to change the lighting environment of the actual photographed space or to perform distortion-free rendering, it is required to obtain light environment information that affects objects in the actual photographed space.

In the related art, information on the position, direction, and intensity of a light source affecting an object environment is obtained using an omni-directional mirror or a mirrored ball.

1 is an exemplary view for explaining a lighting environment analysis method using a mirror ball according to an embodiment of the prior art.

Referring to FIG. 1, in the lighting environment analysis method using a mirror ball, instead of a method of mounting a plurality of cameras, an image of a precisely processed mirror ball is photographed with a camera to simplify measurement, and then an image of the mirror ball is used. Acquire ambient lighting environment information.

This prior art uses a mirror ball to map the light reflected from the real space to a 3D model to obtain illumination information incident from all directions of the target scene for a 360-degree lighting environment analysis. based) model.

However, in general, determining the position and brightness of the lights existing in the target space requires a considerable amount of time and effort, and yet it is very difficult to obtain a realistic scene. This is because it is difficult to sufficiently consider the effects of complex lighting existing in the real world, such as direct and indirect lighting by light sources, shadows, reflections, and refractions.

In the related art, the lighting environment is limited to constructing an illumination environment in a static situation where the light source and the object do not move, but since several light sources exist in the target space, the radiance distribution of the scene is acquired differently depending on the position of the camera. In order to express various scenes of a virtual object moving in the target space, it is necessary to reconstruct the lighting environment of the entire space. .

In order to solve the above-mentioned problems, the present invention has an object to acquire three-dimensional lighting environment information by using ceiling space images and light distribution information to realistically represent a target space according to an embodiment of the present invention.

However, the technical problem to be achieved by the present embodiment is not limited to the technical problem as described above, and other technical problems may exist.

A lighting space information acquisition device according to an embodiment of the present invention as a technical means for achieving the above-described technical problem is installed on a surface facing at least one or more lights installed on the ceiling surface to obtain a ceiling space image of the target space Camera module; A distance measurement module measuring height information of the target space by irradiating a straight light source between the ceiling surface and the floor surface; And obtaining the shape information of the ceiling surface based on the ceiling space image, calculating stereoscopic space information for the target space using the shape information of the ceiling surface and the height information of the target space, and using the ceiling space image. It is characterized in that it comprises a calculation module for calculating the lighting position and the lighting intensity to configure the lighting space information based on the three-dimensional spatial information.

An apparatus for acquiring lighting space information according to an embodiment of the present invention includes a lighting distribution database for collecting and storing light distribution information for optical data including light distribution characteristics and light directing patterns for a plurality of lights, and the calculation module It is characterized by providing 3D lighting environment information by combining the estimated light intensity through the ceiling space image with basic light distribution information of the light stored in the light distribution database.

The camera module is characterized in that it consists of at least one camera that captures a wide angle image with a high dynamic range (HDR) image, a low dynamic range (LDR) image, a 360 degree (360 degree) image, and an angle of view of 150 degrees or more. do.

The distance measurement module is characterized by using any one of a non-contact sensor including a line laser sensor, a depth sensor, and a displacement sensor.

A method for acquiring lighting space information according to another embodiment of the present invention includes: a) a method for acquiring lighting space information performed by a lighting space information obtaining device for obtaining lighting environment information for a target space, a) installed on a ceiling surface Obtaining a ceiling space image of the target space using a camera module installed on a surface facing at least one light; b) calculating height information of the target space by measuring a distance between the ceiling surface and the floor surface using a non-contact distance measurement method; c) acquiring shape information of the ceiling surface based on the ceiling space image and calculating stereoscopic space information using the shape information of the ceiling surface and the height information of the target space; And d) calculating lighting position and lighting intensity using the ceiling space image and constructing lighting space information based on the three-dimensional spatial information.

The method for acquiring lighting space information may further include e) rendering the stereoscopic space information and lighting space information to provide 3D lighting environment information.

The method for acquiring lighting space information further includes f) collecting light distribution information for optical data including light distribution characteristics and light directing patterns for a plurality of lights and storing the light distribution information in a light distribution database, wherein the step d) comprises: It is characterized in that the lighting environment space is reconstructed by combining the estimated light intensity through the ceiling space image and the basic light distribution information of the light stored in the light distribution database.

When the camera module is composed of at least one camera that shoots a high dynamic range (HDR) image or a 360 degree (360 degree) image, step d) may include a target space through the HDR image for the ceiling space image. It is characterized by calculating the light intensity, the position of the light, and the number of lights.

The step d) is characterized in that the illumination intensity is calculated through the brightness value of the light corresponding to the pixel value of the HDR image.

In step d), the lighting position is calculated by adjusting the exposure value of the ceiling space to a preset low-level threshold.

In step b), a straight light source is irradiated to the ceiling surface using a straight light source having any one of a straight form, a cross shape, or a plurality of dot forms, and the straight light source varies depending on the distance between the straight light source and the ceiling surface. It is characterized in that the height information is calculated using the size information.

According to another embodiment of the present invention, a method for evaluating a lighting environment in a target space includes: a method for evaluating a lighting environment in a target space performed by a lighting space information obtaining apparatus for obtaining lighting environment information for a target space, a ) Obtaining a ceiling space image of the target space using at least one light installed on the ceiling surface and a camera module installed on the opposite surface; b) calculating height information of the target space by measuring a distance between the ceiling surface and the floor surface using a non-contact distance measurement method; c) acquiring shape information of the ceiling surface based on the ceiling space image and calculating stereoscopic space information using the shape information of the ceiling surface and the height information of the target space; d) calculating lighting position and lighting intensity using the ceiling space image and constructing lighting space information based on the three-dimensional spatial information; And e) evaluating lighting energy for the target space based on the lighting space information.

In step e), in connection with a light distribution database including light distribution information for a plurality of lights and light distribution information for optical data including a light directing pattern, output, and price information of a lighting device, the lighting position, the number of lights, It is characterized by calculating the total brightness or power consumption of the target space through the lighting information including the light intensity.

According to the above-described problem solving means of the present invention, in order to realistically represent the target space, the lighting environment modeling can be easily performed using the ceiling space image and the light distribution information, which are HDR images, thereby making it possible for realistic virtual reality. By providing 3D lighting environment information, it is possible to realistically express the influence of lighting according to the position of the character, and to solve the heterogeneity between the character and the background scene.

In addition, the present invention can automatically reconstruct the lighting space through the lighting space information acquisition technology for estimating the camera and lighting position, lighting intensity, etc. without pre-calibrating the camera, and can evaluate and remodel energy for the lighting environment. have.

1 is an exemplary view for explaining a lighting environment analysis method using a mirror ball according to an embodiment of the prior art.
2 is a view for explaining the configuration of the lighting space information acquisition device according to an embodiment of the present invention.
3 is an exemplary view for explaining 3D lighting environment information through a lighting space information acquisition device according to an embodiment of the present invention.
4 is a view illustrating an average beam angle among light distribution information according to an embodiment of the present invention.
5 is a view for explaining a data format for describing 3D illumination distribution of IES according to an embodiment of the present invention.
6 is a flowchart illustrating a method for obtaining illumination space information according to an embodiment of the present invention
FIG. 7 is an exemplary diagram illustrating a process of reparameterizing the ceiling space image of FIG. 6.
8 is a flowchart illustrating a method for evaluating a lighting environment in a target space according to another embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art to which the present invention pertains may easily practice. However, the present invention can be implemented in many different forms and is not limited to the embodiments described herein. In addition, in order to clearly describe the present invention in the drawings, parts irrelevant to the description are omitted, and like reference numerals are assigned to similar parts throughout the specification.

Throughout the specification, when a part is "connected" to another part, this includes not only "directly connected" but also "electrically connected" with other elements in between. . Also, when a part is said to “include” a certain component, it means that the component may further include other components, not exclude other components, unless specifically stated otherwise. However, it should be understood that the existence or addition possibilities of numbers, steps, actions, components, parts or combinations thereof are not excluded in advance.

The following examples are detailed descriptions to aid the understanding of the present invention, and do not limit the scope of the present invention. Therefore, the same scope of the invention performing the same function as the present invention will also belong to the scope of the present invention.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

2 is a view for explaining the configuration of the lighting space information acquisition device according to an embodiment of the present invention, Figure 3 is a three-dimensional lighting environment information through the lighting space information acquisition device according to an embodiment of the present invention An exemplary view, FIG. 4 is a diagram illustrating an average beam angle among light distribution information according to an embodiment of the present invention, and FIG. 5 is a data format for describing 3D lighting distribution of IES according to an embodiment of the present invention It is a figure explaining.

2 to 5, the lighting space information acquisition device 100 includes, but is not limited to, a camera module 110, a distance measurement module 120, a calculation module 130, and a lighting distribution database 140. Does not.

The camera module 110 is installed on a surface facing at least one of the lights 10 installed on the ceiling surface to acquire an image of the ceiling space of the target space. In this case, the ceiling space image may be a 360-degree image as an image of a space including a ceiling.

The camera module 110 may be composed of at least one camera that captures a high dynamic range (HDR) image, a low dynamic range (LDR) image, a 360 degree (360 degree) image, and a wide angle image with an angle of view of 150 degrees or more. Can. A wide-angle image having an angle of view of 150 degrees or more can be photographed using a wide-angle camera having a 180-degree angle of view.

When the camera module 110 is a 360-degree HDR camera, it is possible to accurately measure the dimming of each light, that is, the light intensity. When the camera module 110 is a 360-degree LDR camera, after obtaining a plurality of LDR images having different exposure times, a plurality of LDR images may be merged and merged into one HDR image.

The distance measurement module 120 measures height information of the target space by irradiating a straight light source between the ceiling surface and the floor surface, and may use any one of a non-contact sensor including a line laser sensor, a depth sensor, and a displacement sensor. The distance measurement module 120 may determine the height of the ceiling using this size information because the size or shape of the straight light source irradiated to the ceiling surface varies depending on the distance between the straight light source and the ceiling surface. At this time, the distance measurement module 120 may use a straight light source in a straight line, a cross shape, an anisotropic form having different lengths, or a plurality of dot forms depending on the shape or length of the ceiling surface.

The calculation module 130 configures the lighting space information 302 by calculating the lighting position and the light intensity using the ceiling space image, and after obtaining the shape information 301 of the ceiling surface based on the ceiling space image, the ceiling surface 3D lighting environment information 303 is provided by performing a rendering operation on the shape information 301, the height information of the target space, and the lighting space information 302. As such, the calculation module 130 controls the entire process of providing the lighting space information acquisition method. Each step performed by the calculation module 130 will be described later with reference to FIG. 5.

Here, the operation module 130 may include all kinds of devices capable of processing data, such as a processor. Here, the'processor (processor)', for example, may mean a data processing device embedded in hardware having physically structured circuits to perform functions represented by codes or instructions included in a program. As an example of such a data processing device embedded in hardware, a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, and an application-specific integrated ASIC circuit, a field programmable gate array (FPGA), and the like, but the scope of the present invention is not limited thereto.

The light distribution database 140 collects and stores light distribution information (for example, an IES file) for optical data including light distribution characteristics and light directing patterns for a plurality of lights. The lighting distribution database 140 includes light distribution, output, efficiency, light speed, and price information of lighting equipment.

As illustrated in FIGS. 4 and 5, the light distribution information may use an IES file, which is a data format for describing 3D light distribution in the IES (Illuminating Engineering Society), as light distribution information.

Accordingly, the calculation module 130 may reconstruct the lighting space information by mapping the light distribution information corresponding to the lighting space information in cooperation with the lighting distribution database 140.

In addition, the lighting space information acquisition device 100 may further include a communication module 150 and a memory 160.

At this time, the communication module 150 transmits three-dimensional lighting environment information to an external terminal through a communication network, and provides a communication interface necessary to provide transmission and reception signals between the camera module 110 and the distance measurement module 120 in the form of packet data. to provide. In addition, the communication module 150 may serve to receive a control command from an external terminal and transmit data in response thereto.

Here, the communication module 150 may be a device including hardware and software necessary for transmitting and receiving a signal such as a control signal or a data signal through a wired or wireless connection with another network device.

In the memory 160, a program for performing a method for obtaining illumination space information is recorded. In addition, it performs a function of temporarily or permanently storing data processed by the operation module 130. Here, the memory 160 may include volatile storage media or non-volatile storage media, but the scope of the present invention is not limited thereto.

6 is a flowchart illustrating a method for acquiring lighting space information according to an embodiment of the present invention, and FIG. 7 is an exemplary diagram illustrating a process of re-parameterizing a ceiling space image of FIG. 6.

Referring to FIG. 6, in the method for acquiring lighting space information, an image of a ceiling space in a target space is obtained using a camera module installed on a surface opposite to at least one light installed on the ceiling surface (S11 ).

And the calculation module calculates the height information of the target space by measuring the distance between the ceiling surface and the floor surface using a distance measurement module (S12).

After calculating the shape information of the ceiling surface based on the ceiling space image, the calculation module calculates the three-dimensional space information using the shape information of the ceiling surface and the height information of the target space (S13, S14).

The calculation module extracts the edge of the ceiling surface based on the ceiling space image to calculate shape information, and performs a reparameterization process to correct the 360-degree distortion image for the ceiling space image (S15).

The calculation module calculates the lighting position, the number of lights, and the light intensity using the ceiling space image, and then configures the lighting space information based on the three-dimensional spatial information (S16). When the ceiling spatial image is an omni-directional (360-degree) LDR multiple exposure image, the arithmetic module generates an HDR image using multiple ceiling spatial images. At this time, when the camera module is a device capable of simultaneously acquiring multiple images with different exposure times, the calculation module may receive multiple omni-directional multiple exposure images from the camera module and grasp the illumination position by adjusting the direction vector or exposure value.

At this time, when the calculation module sets the ceiling surface with predefined shape information (for example, a rectangular shape), the lighting location can be easily determined using the predefined shape information.

The calculation module calculates the light intensity, the lighting position, and the number of lights in the target space through the HDR image of the ceiling space image. If the ceiling space image is an LDR image, the operation module acquires a plurality of LDR images having different exposure times, merges the plurality of LDR images into a single HDR image, and then generates the intensity of illumination in the target space through the HDR image. , Lighting position and number of lights can be calculated.

In addition, the calculation module gradually lowers the exposure value for the ceiling space image to a predetermined low level threshold and calculates the lighting position using the intensity image of the light remaining in the image, and the ceiling space image ceiling space image After gradually increasing the exposure value for, and upwardly adjusting to a predetermined high level threshold, the intensity of the light can be measured by using the light intensity image remaining in the corresponding image.

The calculation module calculates the brightness of the light using any one of the HDR image obtained by the HDR camera or the image obtained by combining multiple LDR images with different exposure values into one HDR image, but the brightness of the light corresponds to the pixel value of the HDR image. It can be calculated through the brightness value of the illumination.

The calculation module reconstructs the lighting space information by mapping the light distribution information corresponding to the lighting space information from the lighting distribution database (S17, S18), and coordinates the lighting space to distribute the light using the light intensity of the coordinates where each light is located. Information can be computed. On the other hand, the calculation module may set the priority for each light distribution information for a lighting fixture that is commonly used in the indoor space, and may reconfigure the lighting space information by matching the lighting space information with the IES file for each priority according to the set priority. have.

The calculation module may configure the lighting environment space by combining the intensity of light estimated through the HDR image, that is, the intensity of light and basic light distribution information of the light stored in the light distribution database. At this time, the lighting distribution database maps representative light distribution information of flat panel lighting when the lighting form is flat through the ceiling space image, and maps representative light distribution information of downlight lighting when the lighting form of the ceiling space image is circular. Make up the lighting environment space.

In addition, the operation module reconstructs the lighting space information by classifying it into global lighting having a large influence in the target space and local lighting having a directional effect that is limited to some areas.

The arithmetic module may provide 3D lighting environment information by performing rendering work on the 3D spatial information and the lighting space information, and use the 3D lighting environment information according to the position of the character by using the lighting simulation, AR character synthesis, etc. It can be expressed realistically by reflecting the influence of lighting, and it can solve the heterogeneity between the character and the background scene.

Meanwhile, steps S11 to S18 of FIG. 7 may be divided into additional steps or combined into fewer steps according to an embodiment of the present invention. In addition, some steps may be omitted if necessary, and the order between the steps may be changed.

8 is a flowchart illustrating a method for evaluating a lighting environment in a target space according to another embodiment of the present invention.

Referring to FIG. 8, in the lighting environment evaluation method of the target space, when the calculation module configures and stores the lighting space information for the target space through the lighting space information acquisition method shown in FIG. 6, read the lighting space information Calculate the lighting information for the target space including the coordinate values of the light in the target space, the intensity of each light, the number of lights, and the light distribution information, and use the lighting information to optically include the light distribution characteristics and the light directing pattern for a plurality of lights In connection with a light distribution database including light distribution information for data, output, and price information of a lighting fixture, it is possible to calculate the total brightness and power consumption of the target space (S21, S22).

Therefore, the user can evaluate the lighting energy for the total brightness and power consumption of the target space, and perform lighting control, energy saving, etc. (S23).

The method for acquiring lighting space information according to an embodiment of the present invention described above may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by a computer. Such recording media include computer readable media, which can be any available media that can be accessed by a computer, and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer readable media includes computer storage media, which are volatile and nonvolatile implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. , Removable and non-removable media.

The above description of the present invention is for illustration only, and those skilled in the art to which the present invention pertains can understand that the present invention can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the above detailed description, and it should be interpreted that all changes or modified forms derived from the meaning and scope of the claims and equivalent concepts thereof are included in the scope of the present invention. do.

100: lighting space information acquisition device
110: camera module
120: distance measurement module
130: operation module
140: lighting distribution database
150: communication module
160: memory

Claims (13)

A camera module installed on a surface opposite to at least one light installed on a ceiling surface to acquire a ceiling space image of a target space;
A distance measurement module measuring height information of the target space by irradiating a straight light source between the ceiling surface and the floor surface; And
After obtaining the shape information of the ceiling surface based on the ceiling space image, three-dimensional space information for the target space is calculated using the shape information of the ceiling surface and the height information of the target space, and the ceiling space image is used. And a calculation module configured to calculate illumination position and illumination intensity and configure illumination space information based on the three-dimensional spatial information. According to claim 1,
It includes a light distribution database that collects and stores light distribution information for optical data including light distribution characteristics and light directing patterns for a plurality of lights,
The calculation module is a lighting space information acquisition apparatus characterized in that it combines the light intensity estimated through the ceiling space image and the basic light distribution information of the light stored in the light distribution database to provide 3D lighting environment information. According to claim 1,
The camera module is characterized by consisting of at least one camera that captures a high dynamic range (HDR) image, a low dynamic range (LDR) image, a 360 degree (360 degree) image, and a wide angle image with an angle of view of 150 degrees or more. Lighting space information acquisition device. According to claim 1,
The distance measurement module, lighting space information acquisition device, characterized in that using any one of a non-contact sensor including a line laser sensor, a depth sensor, a displacement sensor. In the lighting space information acquisition method performed by the lighting space information acquisition device for obtaining the lighting environment information for the target space,
a) acquiring a ceiling space image of a target space by using at least one light installed on a ceiling surface and a camera module installed on a surface facing the surface;
b) calculating height information of the target space by measuring a distance between the ceiling surface and the floor surface using a non-contact distance measurement method;
c) acquiring shape information of the ceiling surface based on the ceiling space image and calculating stereoscopic space information using the shape information of the ceiling surface and the height information of the target space; And
d) calculating lighting position and lighting intensity using the ceiling space image and constructing lighting space information based on the three-dimensional spatial information. The method of claim 5,
e) a method of obtaining lighting space information, further comprising rendering 3D spatial information and lighting space information to provide 3D lighting environment information. The method of claim 5,
f) further comprising collecting light distribution information for optical data including light distribution characteristics and light directing patterns for a plurality of lights and storing the light distribution information in a light distribution database,
In the step d), the lighting space information acquisition method is characterized in that the lighting environment estimated by the ceiling space image is combined with the basic light distribution information of the light stored in the lighting distribution database to reconstruct the lighting environment space. The method of claim 5,
When the camera module is composed of at least one camera that shoots a high dynamic range (HDR) image or a 360 degree (360 degree) image,
In the step d), the lighting space information acquisition method is characterized in that the lighting intensity on the target space, the lighting position, and the number of lights are calculated through the HDR image of the ceiling space image. The method of claim 8,
The step d), the illumination space information acquisition method characterized in that the illumination intensity is calculated through the brightness value of the light corresponding to the pixel value of the HDR image. The method of claim 5,
In step d), lighting space information is obtained by adjusting the exposure value of the ceiling space image to a predetermined low level threshold to calculate the lighting position. The method of claim 5,
In step b), a straight light source is irradiated to the ceiling surface using a straight light source having any one of a straight line shape, a cross shape, or a plurality of dot shapes. A method of obtaining lighting space information, characterized in that height information is calculated using size information. In the lighting environment evaluation method of the target space performed by the lighting space information acquisition device for obtaining the lighting environment information for the target space,
a) acquiring a ceiling space image of a target space by using at least one light installed on a ceiling surface and a camera module installed on a surface facing the surface;
b) calculating height information of the target space by measuring a distance between the ceiling surface and the floor surface using a non-contact distance measurement method;
c) acquiring shape information of the ceiling surface based on the ceiling space image and calculating stereoscopic space information using the shape information of the ceiling surface and the height information of the target space;
d) calculating lighting position and lighting intensity using the ceiling space image and constructing lighting space information based on the three-dimensional spatial information; And
e) evaluating a lighting environment for the target space based on the lighting space information. The method of claim 12,
Step e),
The lighting position, number of lights, and lighting in connection with a light distribution database including light distribution, output, efficiency, light speed, and price information of a lighting device for optical data including light distribution characteristics and light directing patterns for a plurality of lights A method for evaluating a lighting environment in a target space, wherein the total brightness or power consumption of the target space is calculated through lighting information including intensity.

Images