KR20190133373A - Auto producting system and method for 3d interior space image based on the information of reflrction image cloud - Google Patents

Abstract

The present invention relates to a system and method for automatically generating a 3D indoor space image based on a video image information cloud, which can automatically generate and store a 3D indoor space image to enable search and utilization. The system comprises an indoor space information management server and a video control device. The indoor space information management server includes: a collection information DB storing reference images, video images, and SIFT descriptor data collected by photographing an indoor space by at least one camera device; an image collection module which photographs the indoor space according to a photographing angle of the camera device to collect the reference image, sets the video image, collected by re-photographing the indoor space by the camera device, according to the reference image, and stores the image in the collection information DB; a video matching processing module, which analyzes the video image, sets the SIFT descriptor data for each section in the video image according to an SIFT algorithm to store the same in the collection information DB, generates the indoor space image by matching the plurality of video images based on the SIFT descriptor data shared in neighboring video images, and stores the same in the collection information DB; and a monitoring module monitoring the processing state of the video matching processing module. The video control device includes: a search module searching for necessary information by searching the collection information DB; a data processing module controlling the execution of the image collection module, the image matching processing module and the monitoring module; and a space video editing module executing a dashboard for a control information input and a control state output of the data processing module.

Description

AUTOMATIC PRODUCTION SYSTEM AND METHOD FOR 3D INTERIOR SPACE IMAGE BASED ON THE INFORMATION OF REFLRCTION IMAGE CLOUD}

The present invention relates to a 3D indoor space image automatic generation system and a method for automatically generating a 3D indoor space image based on an image image information cloud that enables to automatically generate, store, search and use.

In addition to the general real estate relay site, various services and professional companies and institutions (hereinafter referred to as service providers) that provide other indoor structures and shapes, such as 'service providers', can take pictures of the indoors directly and photograph them to check the indoor structure and shapes. It was provided to the user as a photographed image, or a 2D or 3D screen was constructed and provided to the user using a CAD drawing of a building.

However, in order to construct the indoor structure data by the CAD method in the above-described manner, since additional data such as CAD drawings related to the design of the building must be used, it is difficult to generate indoor structure data for a building that does not have a CAD drawing. . Moreover, since the CAD drawings include not only the interior structure of the building but also the details of various pipes and wirings built into the building, there is a limitation that the landlord does not easily disclose it to the outside. Therefore, it was difficult to construct indoor structural data in CAD way.

Therefore, in the related art, a general service provider prepares a planar image in 2D format rather than a CAD method and provides it to the user as shown in FIG. However, in the conventional technology, since the user cannot directly identify and grasp the actual internal environment and the interior space form, there is a limit to visit the indoor space of the target building in order to specifically identify and grasp the actual internal environment.

In order to solve such a problem, the conventional service provider collects the indoor image and provides it to the user by photographing the actual indoor space as shown in FIG. 1 (b), rather than the CAD method and the 2D image method. However, since indoor images through photography are provided to the user with limited indoor sections according to the subjective decision of the service provider who is the photographer, the user cannot check the entire indoor space, and the user cannot arbitrarily select the desired indoor section. there was.

In order to compensate for this, conventionally, Korean Patent Laid-Open Publication No. 10-2013-0123041 (hereinafter referred to as "prior art") has proposed a technique of directly scanning a room using a LiDAR apparatus.

However, the prior art only has a technique for the operator to scan while simply moving the lidar device, and edit the image using the conventional lidar technology, there is no specific description of the lidar device, and the scanning method is not specified at all. Did

Moreover, since the lidar device utilized in the prior art is relatively expensive equipment, there was an economic burden for the service provider to rent or purchase the lidar device. Since the current location of the device has to be understood, the inconvenience and trouble of using it was also a lot.

Prior Art Document 1. Patent Publication No. 10-2013-0123041 (published Nov. 12, 2013)

Accordingly, the present invention has been invented to solve the above problems, and can be easily and cheaply generated and data three-dimensional indoor space image, the user can specify or enlarge or grasp the indoor section that you want to check, such as virtual space 3D indoor space image automatic generation system based on the image image information cloud, which enables the storage provider to store and manage the image information based on the cloud method, so that not only the service provider but also the user can easily search for and provide the necessary image information to the user. The problem to be solved is to provide a generation method.

In order to achieve the above object, the present invention,

A collection information DB for storing reference images, video images, and SIFT descriptor data collected by capturing indoor spaces by at least one camera device; An image acquisition module for capturing an indoor space according to a photographing angle of the camera device to collect a reference image, and setting the image image collected by the camera apparatus to re-photograph the indoor space according to the reference image and storing the image in a collection information DB; Analyzing the video image and setting the SIFT descriptor data for each section in the video image according to the SIFT algorithm and storing it in the collection information DB, and matching a plurality of video images based on the SIFT descriptor data shared by neighboring video images. An image matching processing module for generating an indoor space image and storing it in a collection information DB; An indoor spatial information management server comprising: a monitoring module for monitoring a processing state of the image matching processing module;

A search module for searching for the necessary information by searching the collection information DB; A data processing module for controlling execution of the image collection module, the image registration processing module, and the monitoring module; And a spatial image editing module executing a dashboard for outputting control status and inputting control information of the data processing module.

3D indoor space image automatic generation system based on the image image information cloud including a.

In order to achieve the above technical problem, the present invention,

A reference image collecting step comprising: photographing the indoor space at various shooting angles by at least one camera installed in the indoor space; and storing, by the image collecting module, a reference image collected by the camera in a collection information DB;

An image image collecting step of collecting image images by the camera capturing an indoor space according to a corresponding photographing angle in the reference image collecting step;

Comparing the image image collected in the image image collecting step with the reference image by the image matching processing module; and when the image image is determined to be inconsistent with the reference image, the image matching processing of the photographing angle information of the mismatched image image. A video image correction step of correcting the module according to the photographing angle of the reference image;

The image matching processing module analyzes the image image and sets the SIFT descriptor data for each section in the image image according to the SIFT algorithm and stores it in the collection information DB, and the image matching processing module is shared with each other in the neighboring image image An image image matching step comprising generating an indoor space image by matching the image image based on the SIFT descriptor data; And

A result file formatting step of formatting the indoor spatial image and storing it in a collection information DB;

Automatic image generation method based on the image image information cloud-based 3D indoor space.

According to the present invention, a three-dimensional indoor space image can be easily and inexpensively generated and dataized, and a user can enlarge or grasp an indoor section that he / she wants to check, such as a virtual space, and use the cloud method for image information. Based on the storage management, the service provider as well as the user can easily search for the necessary image information and provide it to the user.

1 is an indoor space image generated by a conventional indoor space image generation system,
2 is a block diagram showing an embodiment of an indoor space image generation system according to the present invention;
3 is a perspective view illustrating an embodiment of a camera device installed in an indoor space according to the present invention;
FIG. 4 is a block diagram illustrating an embodiment of components constituting the camera apparatus of FIG. 3.
5 is a flowchart sequentially illustrating a method of generating an indoor space image according to the present invention;
6 is a plan view schematically showing an arrangement of a camera installed in an indoor space for implementing an indoor space image generating method according to the present invention;
7 is a side view schematically showing the installation of the reference stage installed in the indoor space for the implementation of the indoor space image generation method according to the present invention,
8 is a view schematically illustrating a change in position of an indoor space and a reference table according to a photographing angle of the camera device.
FIG. 9 is a diagram schematically illustrating a state in which a matching target image image is classified by checking an intersection section of an indoor space according to the photographing angle.
FIG. 10 is a view schematically showing a state in which a matched image image is generated as an indoor space image according to the indoor space image generation method according to the present invention;
11 is an image showing an example of an indoor space image that is matched and completed according to the indoor space image generating method according to the present invention.

The above-described features and effects of the present invention will be apparent from the following detailed description with reference to the accompanying drawings, whereby those skilled in the art can easily implement the technical idea of the present invention. There will be. As the inventive concept allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the text. However, this is not intended to limit the present invention to a specific disclosure, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

2 is a block diagram illustrating an embodiment of an indoor space image generation system according to the present invention.

The indoor space image generation system of the present embodiment includes an indoor space information management server 100 that installs one or more camera devices 300 in the indoor space S to generate a 3D indoor space image and cloud the related information. It is connected to the spatial information management server 100 includes an image control device (200, 200 ') to process the clouding information of the indoor spatial information management server 100 in accordance with a control signal according to the operator's operation.

The indoor space information management server 100 generates, stores, and manages the indoor space image based on data collected from the camera device 300 and the other sensors 500, and thus controls the image of the worker who produces the indoor space image. In addition to the devices 200 and 200 ′, the device 200 and 200 ′ may communicate with the user's terminal 400 to retrieve and utilize the completed indoor space image. For reference, the user's terminal 400 is connected to the indoor spatial information management server 100 through online network communication, and the operator's image control apparatus 200, 200 '(hereinafter referred to as' 200') is indoor spatial information management. The server 100 may be directly connected, or may be connected through online network communication as the terminal 400 of the user.

For reference, the indoor spatial information management server 100 of the present embodiment further includes a web page processing module 160 for generating and executing a web page for searching and outputting data stored in the collection information DB 110. It is possible to construct a website that is easy to access and use, and through this, not only the operator's control devices 200 and 200 'but also the user's terminal 400 can be connected via online network communication via the communication module 170. Can be.

The indoor spatial information management server 100 of the present embodiment is a collection information DB 110 for storing reference images, video images, and SIFT descriptor data collected by at least one camera device 300 installed in an indoor space. ; Shooting point of the video image collected by re-shooting the indoor space (S, S ') according to the shooting angle of each location of the camera device 300, S, S'; An image collection module 130 for setting the reference image to store in the collection information DB 110; Analyzing the video image and setting the SIFT descriptor data for each section in the video image according to the SIFT algorithm and storing it in the collection information DB 110, and matching the cross sections of neighboring video images based on the SIFT descriptor data and indoors. An image matching processing module 140 for generating a spatial image and storing it in the collection information DB 110; And a monitoring module 150 for monitoring the processing status of the image registration processing module 140.

On the other hand, the image control device 200 of the present embodiment, the search module 210 to search the collection information DB (110) to retrieve the necessary information; A data processing module 220 for controlling execution of the image collection module 130, the image registration processing module 140, and the monitoring module 150; And a spatial image editing module 230 for executing a dashboard for outputting control status and inputting control information of the data processing module 220.

For reference, since the monitoring module 150 checks the processing status of the image registration processing module 140 in real time and transmits the data to the data processing module 220, the operator may perform an image according to the dashboard of the spatial image editing module 230. It allows you to identify and control image matching processes and process images.

The interworking form and processing of the indoor spatial information management server 100 and the image control apparatus 200 described above will be described in more detail below.

3 is a perspective view showing an embodiment of a camera device installed in an indoor space according to the present invention, Figure 4 is a block diagram showing an embodiment of the components constituting the camera device of FIG.

The camera device 300 of the present embodiment is installed at a designated position in the indoor spaces S and S 'to photograph the indoor spaces S and S'. At this time, since the camera device 300 should be able to collect all of the indoor spaces (S, S ') to collect images, it is preferable that a plurality of cameras be installed in the indoor spaces (S, S'). It is preferable to be installed on the upper portion of the indoor space (S, S ') to photograph the bottom surface of the indoor space (S, S') included in.

On the other hand, the camera device 300 should be able to shoot the interior space (S, S ') at various shooting angles from the installation position, for this purpose, the camera device 300 of the present embodiment, the camera 310 and the camera 310 ) Is rotatably supported by a first hanger 320, a first drive motor 330 driving the camera 310 to rotate on the first hanger 320, and a first hanger 320 rotatably. Rotation of the second hanger 340 supporting, the second drive motor 350 driving the first hanger 320 to rotate in the second hanger 340, the camera 310 and the first hanger 320 It includes a rotation angle sensor 360 for sensing each angle.

The camera 310, the first driving motor 330, the second driving motor 350, and the rotation angle sensor 360 of the camera device 300 are configured with operation means such as buttons for operator's operation, respectively. However, since the plurality of camera apparatuses 300 are installed in the indoor spaces S and S ', the operator moves directly to each point where the camera apparatuses 300 are installed, so that the camera 310 and the first driving motor 330 and the first driving motors 330 and the first driving motors 330 and the first apparatus are installed. The operation means of the two driving motor 350 and the rotation angle sensor 360 should be operated one by one. Accordingly, the camera device 300 and the camera 310 and the first driving motor 330, the second driving motor 350, and the rotation angle sensor 360 may be operated by a worker even at a remote location. The control unit 380 may further include a remote controller 380 for transmitting a control signal according to an operation signal for controlling one or more operations selected from the first driving motor 330, the second driving motor 350, and the rotation angle sensor 360. .

Here, the camera 310 of the camera device 300, the first driving motor 330, the second driving motor 350 and the rotation angle sensor 360, the operation signal from the remote control 380 through the communication module 370 When receiving, the camera 310 operates according to a set process, and the camera 310 is placed at an initial position, and the reference image and the image image are collected by streaming while sequentially moving to a designated shooting angle. As a result, the plurality of camera apparatuses 300 photograph the indoor spaces S and S 'while driving according to the operation signal of the remote controller 380.

In the camera apparatus 300 of the present embodiment, the first hanger 320 is installed so that the camera 310 rotates up and down, and the second hanger 340 is installed so that the first hanger 320 rotates horizontally. The first hanger may be installed to rotate the camera 310 horizontally, and the second hanger may be installed to rotate the first hanger up and down.

As a result, the camera device 300 may capture the indoor spaces S and S ′ at various photographing angles and collect the reference image and the image image.

Unexplained reference numeral '351' is a 'bracket' for installing the second driving motor 350 on the ceiling or wall surface of the indoor space (S, S ').

5 is a flowchart sequentially illustrating a method of generating an indoor space image according to the present invention, and FIG. 6 is a plan view schematically illustrating an arrangement of a camera installed in an indoor space for implementing the method of generating an indoor space image according to the present invention. FIG. 7 is a side view schematically illustrating an installation of a reference table installed in an indoor space for implementing an indoor space image generating method according to the present invention, and FIG. 8 illustrates a location of an indoor space and a reference table according to a photographing angle of the camera device. A diagram schematically illustrating the change pattern.

Hereinafter, an operation process of the indoor space image generation method of the present invention will be described with reference to the above drawings.

S10; Baseline Image Acquisition Step

At least one camera 310 installed in the indoor spaces (S, S ') photographing the indoor spaces (S, S') at various shooting angles, and collecting the reference image collected by the camera (310). And storing in 110.

In the present embodiment, the interior spaces S and S 'are separated into two based on one partition P. The separated indoor spaces S and S 'constitute a quadrangular planar space as shown in FIG. 6, and four cameras 310a to 310h are installed at each corner of the indoor spaces S and S'.

In addition, as shown in FIG. 7 of the present embodiment, the cameras 310a and 310d are disposed on the ceiling of the indoor space S, so that both the bottom surface and the sidewall of the indoor space S can be efficiently photographed. Although not shown in the drawing, the cameras 310e to 310h are installed in the other indoor space S 'separated by the partition P, so that both the bottom surface and the sidewall of the indoor space S' can be efficiently photographed. I made it.

For reference, the fixing between the camera 310 and the wall surface is made by a pan / tilt fixing means, through which the camera 310 can photograph the indoor spaces S and S 'at various shooting angles. have.

Since the structure of the pan tilt fixing the camera 310 has been described above, the description thereof is omitted here.

Subsequently, in the indoor space image generation method of the present embodiment, the image collection module 130 may classify the target object into a reference image in the image captured by the camera 310 as a target image. However, in order to grasp the shooting angle and other positions of the camera 310 with respect to the indoor spaces S and S ', the present embodiment of the reference image has a reference point SP on the bottom surface of the indoor spaces S and S'. The reference table B at the reference point SP. The height H of the reference table B is measured in advance and included in the reference information, and the horizontal distance D between the camera 310 and the reference table B is also included in the reference information. For reference, in the present embodiment, the position of the reference point SP is disposed at the same horizontal distance as that of the plurality of cameras 310 in consideration of image image registration, but is not limited thereto.

As described above, when both the installation of the reference table (B) and other reference information are collected, the camera 310 continuously shoots the indoor spaces (S, S ') in a streaming manner while moving at various shooting angles, and the image collection module ( 130 generates a collection image that is a captured image of the indoor space as shown in FIG.

As can be seen in FIG. 8, the collected images have different positions of the indoor space S and the reference table B according to the photographing angle of the camera 310, and also have different heights. Therefore, the photographing angle of the camera 310 is checked according to the position and the height H of the reference table B positioned in the reference image and set as the reference value.

Furthermore, the sensing value processing module 150 collects distance measurement information from the sensor 500 moving along the photographing angle of the camera 310 and measuring a distance to an arbitrary target, and collecting the distance measurement information to the collection information DB 110. It is formatted to be linked to each stored reference image and video image and stored in the collection information DB 110. That is, the image collection module 130 designates an arbitrary target in the collected reference image, and formats the distance measurement information between the target and the corresponding camera 310 through the sensor 500 and links the reference image. . This is used when applying the SIFT algorithm described later.

S20; Image Acquisition Step

The camera 131 photographs the indoor spaces S and S 'according to the corresponding photographing angle in the reference image collecting step S10 to collect image images. In this case, the reference table B is removed from the indoor spaces S and S ', and the camera 131 accurately photographs only the indoor spaces S and S' according to the photographing angles performed in the reference image collection step.

The image collection module 130 stores the video image photographed by the camera 310 in the collection information DB 110.

S30; Image Image Correction Step

The image matching processing module 140 compares the image image collected in the image image collecting step S20 with the reference image, and when the image image is found to be inconsistent with the reference image, the image matching processing module 140 Correct the shooting angle information of the mismatched video image according to the shooting angle of the reference image.

More specifically, since the camera 310 captures and collects the collected image and the image image at the same shooting angle, the collected image and the image image should capture the same section in the indoor space (S, S '). . However, the first hanger 320, the second hanger 340, the first drive motor 330, and the second drive motor 350, which are components of the pan tilt supporting the camera 310, have an error in the driving process. May occur. Therefore, even if the shooting is taken at the same shooting angle, the actual collected image and the image image is somewhat different.

Therefore, the image matching processing module 140 compares the collected images and the image images of the same photographing angle with each other to determine whether there is an error, and when the error is confirmed, adjusts the photographing price information of the corresponding image image to the photographing angle information of the collected image.

The image matching processing module 140 stores the corrected video image in the collection information DB 110.

FIG. 9 is a diagram schematically illustrating a classification of matched target image images by checking the cross section of the indoor space according to the photographing angle, and FIG. 10 is a matched image image according to the indoor space image generation method according to the present invention. Is a view schematically showing a state of generating an indoor space image, and FIG. 11 is an image showing an example of an indoor space image that is matched and completed according to the indoor space image generating method according to the present invention.

S40; Image Matching Step

The image matching processing module 140 analyzes the image image and sets the SIFT descriptor data for each section in the image image according to the SIFT algorithm and stores it in the collection information DB 110, and the image matching processing module 140 neighbors each other. And generating an indoor space image by matching the cross section of the video image based on the SIFT descriptor data.

More specifically, the image registration will be described. Since the plurality of cameras 310 photograph the indoor spaces S and S 'at various photographing angles as shown in FIGS. 9A and 9B, data processing is performed. Under the control of the module 220, the image matching processing module 140 selects only a specific section R1, R1 ′, R2, R2 ′ from numerous video images 1, 2, and connects neighboring video images 1, 2 with each other. Should proceed.

To this end, the image matching processing module 140 analyzes the image images 1 and 2 linked to the corresponding photographing angles, and finds and connects a section that is a reference in neighboring photographing angles. For this registration, a specific target that can be a matching reference is required for the image images 1 and 2, and the image matching processing module 140 checks the image of the specific target and matches and edits the image images 1 and 2 with each other.

The image matching processing module 140 of the present embodiment classifies and sets specific targets by analyzing the image images 1 and 2 based on the SIFT algorithm.

SIFT of the SIFT algorithm is an abbreviation of Scale-Invariant Feature Transform and is a basic solution for matching a plurality of video images to each other. The image matching processing module 140 performs the location pixel value and the distance measurement information of the feature point through 3D interpolation, which is an Extrema localization process, in the sections R1, R1 ', R2, and R2' that can be targeted according to the SIFT algorithm. Figure out the basics.

In the present embodiment, the target may be a part or the whole and the surrounding area of the frame attached to the wall surfaces W1 and W2 of the indoor space, a part or the whole and the surrounding area of the interior decoration displayed on the cabinet, or other unique electronic products. It may be a part or whole of the object having an appearance and the surrounding area.

Subsequently, the image matching processing module 140 searches for a locally splashing portion in the image of the object (Scale-space extrema detection). In other words, it is to find the characteristic part (the part appearing prominently) in the image image 1, 2, which is classified as the feature point of the object.

Subsequently, the image matching processing module 140 selects a key point that is a reliable final feature point among the feature points identified above. To this end, the image matching processing module 140 first selects the final feature point based on the pixel value (Intensity) of the corresponding feature points, the position or size of the corner of the object among the feature points, and then selects the keys of the corresponding image images 1 and 2. Set to point.

Subsequently, the image matching processing module 140 obtains the inclination of the peripheral area of the key point and obtains the direction indicated by the pixel values of the peripheral area as a whole. That is, since the feature point set as the key point corresponds to a corner of the object image, one or more side images are included in the periphery of the feature point, and pixel values of the side image are formed toward pixels of the key point.

Thereafter, the image matching processing module 140 rotates the pixel direction of the peripheral area to 0 degrees, sets the part corresponding to the peripheral area as SIFT descriptor data and stores it in the collection information DB 110. As a result, one or more SIFT descriptor data are configured in the image images 1 and 2. Therefore, even if there is a change in the appearance of the image images 1 and 2 according to the shooting angle, the image matching processing module 140 recognizes the surrounding area set as SIFT descriptor data as the same section.

For reference, SIFT descriptor data includes pixel values of a peripheral area of a key point, and histogram information based on direction information of pixel values of a peripheral area based on the key point. Therefore, the SIFT descriptor data identifies, by the image matching processing module 140, targets representing the same sections RC1 and RC2 in the image images 1 and 2 changed according to the photographing angle as shown in FIG. 9C. It is possible to accurately match neighboring video images 1 and 2. In general, since the Histogram Dimension recommended in the SIFT algorithm is 128-dimension, the image images 1 and 2 including the same sections RC1 and RC2 are included by the image matching processing module 140 regardless of the photographing price of the camera 310. By extracting the same section (RC1, RC2) correctly, match the image image 1, 2 based on the SIFT descriptor data shared with each other in the image image 1, 2 adjacent to each other as shown in Fig. 9 (c), As shown in FIG. 10, the interior surface image F is generated by combining the wall surfaces W1 and W2 or other necessary sections within the corresponding image images 1 and 2.

FIG. 11 is an image showing an example of an interior space image that is matched and completed according to the indoor space image generating method according to the present invention, and has been completed as a three-dimensional indoor space image through image image combination according to the above-described method.

In another embodiment of the present invention, the image matching processing module 140 may utilize existing template data of the indoor space image to be completed in the image image matching process. To this end, the indoor spatial information management server 100 of the present embodiment further includes an existing information DB 120 for storing existing image images and template data for the same indoor space; The image matching processing module 140 searches for the existing image image of the corresponding indoor space in the existing information DB 120 under the control of the search module 210, and based on the template data, the new image image according to the SIFT algorithm. Performs matching processing.

That is, if an indoor space image of the same indoor space exists previously, the image matching processing module 140 searches for the existing template data of the corresponding indoor space image in the existing information DB 120, and based on the template data, the image. It is easier to combine the images. Since the template data includes information such as the size of the side wall and the interior space structure, the image matching processing module 140 edits the size of the side wall in the image images based on the configuration information of the template data, and updates them by matching each other. The interior space image can be completed.

S50; Formatting the result file, S60; Indoor image output stage

The image matching processing module 140 formats and stores the indoor space image F generated according to the above-described process and stored in the collection information DB 110.

Formatting is connected to each other and the image space is completed, the interior space image (F) is connected to each other and converted into a designated format, through which the operator to control the indoor space image (F) output as shown in Figure 11 the image control device (200, 200) ') Or the user's terminal 400 can be searched and output by means.

For reference, when the indoor space image F is formatted and generated and stored as one independent data, the environment information of the corresponding indoor spaces S and S 'may be linked together and provided to the user. In general, the indoor space image generation technology of the present embodiment has a purpose to provide the user with the image of a specific indoor space (S, S '), not only the appearance of the indoor space (S, S'), but also the interior space It is also necessary to provide environmental information of (S, S ').

Therefore, the sensor 500 is configured to detect the temperature and humidity of the indoor spaces (S, S ') and other noise conditions, and the indoor space information management server 100 is configured to determine the space of the indoor spaces (S, S'). It further includes a sensing value processing module 150 for collecting and formatting the sensing information from the sensor 500 for sensing a variety of environmental information to store in the collection information DB (110).

Of course, the image matching processing module 140 links the sensing information to the indoor space image F generated by the image image matching, and if the worker or the user searches for and outputs the indoor space image F, the sensing information is also included. To be retrieved and provided to the user.

In the detailed description of the present invention described above with reference to the preferred embodiments of the present invention, those skilled in the art or those skilled in the art having ordinary skill in the art will be described in the claims to be described later And it will be understood that various modifications and changes of the present invention can be made without departing from the scope of the art.

100; Indoor spatial information management server 200, 200 '; Video control device
300; Camera device 310; camera
320; First holder 330; 1st drive motor
340; Second holder 350; 2nd drive motor
B; Baseline D; Horizontal distance
F; Indoor space image H; Height
R1, R2; Interval RC1, RC2; Same section
W1, W2; Wall panel

Claims (8)

A collection information DB for storing reference images, video images, and SIFT descriptor data collected by capturing indoor spaces by at least one camera device; An image acquisition module for capturing an indoor space according to a photographing angle of the camera device to collect a reference image, and setting the image image collected by the camera apparatus to re-photograph the indoor space according to the reference image and storing the image in a collection information DB; Analyzing the video image and setting the SIFT descriptor data for each section in the video image according to the SIFT algorithm and storing it in the collection information DB, and matching a plurality of video images based on the SIFT descriptor data shared by neighboring video images. An image matching processing module for generating an indoor space image and storing it in a collection information DB; An indoor spatial information management server comprising: a monitoring module for monitoring a processing state of the image matching processing module;
A search module for searching for the necessary information by searching the collection information DB; A data processing module for controlling execution of the image collection module, the image registration processing module, and the monitoring module; And a spatial image editing module executing a dashboard for outputting control status and inputting control information of the data processing module.
3D indoor space image automatic generation system based on the image image information cloud, characterized in that it comprises a. The method of claim 1,
The indoor spatial information management server further includes an existing information DB for storing the existing video image and template data for the same indoor space;
The image matching processing module may search for the existing image image of the corresponding indoor space in the existing information DB, and perform matching processing of the new image image according to the SIFT algorithm based on the template data of the retrieved existing image image. ;
Video image information cloud-based 3D indoor space image automatic generation system characterized in that the. The method of claim 1,
The camera device includes a camera, a first hanger rotatably supporting the camera, a first drive motor driving the camera to rotate in the first hanger, and a second hanger rotatably supporting the first hanger. A hanger, a second driving motor for driving the first hanger to rotate in the second hanger, and a rotation angle sensor for sensing rotation angles of the camera and the first hanger, respectively;
Video image information cloud-based 3D indoor space image automatic generation system characterized in that the. The method of claim 3, wherein
The camera device further comprises a remote controller for transmitting a corresponding control signal according to an operation signal for controlling at least one operation selected from the camera, the first driving motor, the second driving motor and the rotation angle sensor;
Video image information cloud-based 3D indoor space image automatic generation system characterized in that the. The method of claim 1,
The indoor spatial information management server further includes a web page processing module for generating and executing a web page for searching and outputting data stored in the collection information DB;
The control device communicating with an indoor spatial information management server according to an online network communication scheme;
Video image information cloud-based 3D indoor space image automatic generation system characterized in that the. The method of claim 1,
The indoor spatial information management server further includes a sensing value processing module for collecting and formatting sensing information from a sensor for sensing various environmental information of the indoor space and storing the information in a collection information DB;
The image matching processing module may include: linking sensing information corresponding to the indoor spatial image generated by image image matching;
Video image information cloud-based 3D indoor space image automatic generation system characterized in that the. The method of claim 1,
The indoor spatial information management server collects distance measurement information from a sensor measuring a distance to an arbitrary target and moving along the photographing angle of the camera, and formatting the link information by linking the corresponding reference image and image image. It further comprises a sensing value processing module for storing in the DB;
The image matching processing module may be configured to set an image image of an indoor space according to a photographing angle of each camera position according to a reference image based on distance measurement information;
Video image information cloud-based 3D indoor space image automatic generation system characterized in that the. A reference image collecting step comprising: photographing the indoor space at various shooting angles by at least one camera installed in the indoor space; and storing, by the image collecting module, a reference image collected by the camera in a collection information DB;
An image image collecting step of collecting image images by the camera capturing an indoor space according to a corresponding photographing angle in the reference image collecting step;
Comparing the image image collected in the image image collecting step with the reference image by the image matching processing module; and when the image image is determined to be inconsistent with the reference image, the image matching processing of the photographing angle information of the mismatched image image. A video image correction step of correcting the module according to the photographing angle of the reference image;
The image matching processing module analyzes the image image and sets the SIFT descriptor data for each section in the image image according to the SIFT algorithm and stores it in the collection information DB, and the image matching processing module is shared with each other in the neighboring image image An image image matching step comprising generating an indoor space image by matching the image image based on the SIFT descriptor data; And
A result file formatting step of formatting the indoor spatial image and storing it in a collection information DB;
3D indoor space image automatic generation method based on the image image information cloud, characterized in that it comprises a.

Images