KR20230076241A - Method and apparatus for creating object in virtual reality - Google Patents

Abstract

Disclosed are a method for creating an object in a virtual space and a device thereof. According to the present invention, a device for creating a virtual object performs the operations of: distinguishing a first background area and a first object area in an image frame obtained by shooting a certain space with a depth camera; distinguishing a second background area and a second object area in a measurement frame obtained by measuring the certain space with LIDAR; arranging a pixel of the first object area according to depth values in a first grid space including a grid of a predefined size; arranging a point of the second object area according to distance values in a second grid space including a grid of a predefined size; correcting the depth value of the pixel in the first grid space based on the distance value of the point in the second grid space; and creating a virtual object with surface information based on the pixel whose depth values are corrected. Accordingly, the object in a virtual space can be created with little error from an object in the real world.

Description

Method and apparatus for creating object in virtual space {Method and apparatus for creating object in virtual reality}

An embodiment of the present invention relates to a method and apparatus for generating a virtual world object with respect to a real world object.

Digital twin technology, which implements objects such as machines, equipment, and objects in the real world into a virtual world in a computer, is used in various fields such as architecture, energy, aviation, healthcare, automobiles, and national defense. For example, by measuring the tolerance range of BIM (Building Information Modeling) made with drawings and digital twins at construction sites or industrial sites, errors occurring in the design phase, process/construction phase, and quality phase can be reduced.

However, depth cameras, which are often used when real world objects are implemented as objects in the virtual world, have errors due to lens distortion, and it is very difficult to overcome them only with software algorithms. In the field of architecture, errors in digital twins cause errors in design or process/construction stages, which are closely related to the safety of buildings, so it is necessary to implement objects in the virtual world that exactly resemble objects in the real world.

A technical problem to be achieved by an embodiment of the present invention is to create an object in a virtual space using a depth camera and LiDAR (Light Detection and Ranging) so that an error between an object in the real world and an object in the virtual world is minimized. It is to provide a method and an apparatus therefor.

An example of a method for creating objects in virtual space according to an embodiment of the present invention for achieving the above technical problem is to distinguish a first background area and a first object area from an image frame obtained by photographing a certain space with a depth camera. doing; Separating a second background area and a second object area in a measurement frame obtained by measuring the predetermined space with LIDAR; arranging pixels of the first object area according to depth values in a first grid space including a grid having a predefined size; arranging points of the second object area according to distance values in a second grid space including a grid having a predefined size; correcting a depth value of a pixel in the first grid space based on a distance value of a point in the second grid space; and generating a virtual object having surface information based on a pixel whose depth value is corrected.

An example of a virtual object generating device according to an embodiment of the present invention for achieving the above technical problem is a first background area and a first object area in an image frame obtained by photographing a certain space with a depth camera. 1 object extraction unit; a second object extraction unit dividing a second background area and a second object area in a measurement frame obtained by measuring the predetermined space with LIDAR; a first grid arranging unit for arranging pixels of the first object area according to depth values in a first grid space including a grid having a predefined size; a second grid arranging unit for arranging points of the second object area according to distance values in a second grid space including a grid having a predefined size; a correction unit for correcting a depth value of a pixel in the first grid space based on a distance value of a point in the second grid space; and an object generator for generating a virtual object having surface information based on pixels whose depth values are corrected.

According to an embodiment of the present invention, an object in a virtual space having little error with an object in the real world may be created by correcting lens distortion of a depth camera through LIDAR.

1 is a diagram showing an example of a schematic configuration of a system for creating objects in a virtual space according to an embodiment of the present invention;
2 is a view showing an example of a photographing method of a photographing device according to an embodiment of the present invention;
3 is a flowchart illustrating an example of a method for generating an object in a virtual space according to an embodiment of the present invention;
4 is a diagram showing an example of a method for distinguishing a background and an object of a video frame and a measurement frame according to an embodiment of the present invention;
5 is a diagram showing an example of a lattice space according to an embodiment of the present invention;
6 is a view showing an example of displaying objects classified in a video frame in a grid space according to an embodiment of the present invention;
7 is a diagram showing an example of a method of correcting a depth value of a pixel of an object according to an embodiment of the present invention;
8 is a diagram showing an example of a method for generating a 3D virtual object according to an embodiment of the present invention;
9 is a diagram showing an example of extracting a point cloud for generating a 3D virtual object according to an embodiment of the present invention;
10 is a diagram showing an example of generating a 3D virtual object according to an embodiment of the present invention;
11 is a diagram showing the configuration of an example of a virtual object generating device according to an embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings, a method and apparatus for creating an object in a virtual space according to an embodiment of the present invention will be described in detail.

1 is a diagram showing an example of a schematic configuration of a system for creating objects in a virtual space according to an embodiment of the present invention.

Referring to FIG. 1 , a photographing apparatus 100 includes a depth camera 102 and a LIDAR 104 . The depth camera 102 is a camera that captures a certain space in which the object 130 exists and provides a depth value of each pixel together. In this embodiment, the object 130 means an object to be created in a virtual space. For example, the object 130 may be diverse, such as various structures of a building (eg, sewer pipes, columns, walls, etc.) or various objects (closets, sinks, chairs, shoes, etc.) or animals and plants, and is limited to specific types. it is not going to be The depth camera 102 itself is a well-known technology, and various types of conventional depth cameras 102 may be used in this embodiment. In this embodiment, the depth camera 102 may capture still images or moving images. However, hereinafter, for convenience of description, a case in which a video is captured by a depth camera will be mainly described. Photo data including a depth value of each pixel obtained by photographing with the depth camera 102 is hereinafter referred to as an image frame. That is, a video is composed of a certain number of video frames per second.

The LIDAR 104 emits a laser into a certain space, measures a signal returned from each point in the space (ie, a reflection point), and outputs distance values for a plurality of points in the certain space. Hereinafter, data composed of distance values for a plurality of points measured by the LIDAR 104 in a certain space at a certain point in time is referred to as a measurement frame. A plurality of points measured by the lidar 104, that is, the resolution of the measurement frame may be different depending on the lidar 104. LiDAR 104 itself is already widely known technology, and various conventional lidar 104 may be used in this embodiment.

The photographing apparatus 100 simultaneously drives the depth camera 102 and the LIDAR 104 to photograph and measure an object 130 in a certain space. Hereinafter, the expression 'photographing' of the photographing device 100 or 'measurement' of the photographing device may be interpreted as capturing the depth camera 102 and measuring the LIDAR 104 at the same time. The number of video frames generated per second by the depth camera 102 and the number of measurement frames generated per second by the LIDAR 104 may be the same or different depending on embodiments. Also, the resolution of the video frame and the resolution of the measurement frame may be the same or different depending on the embodiment. However, since the depth camera 102 and the lidar 104 are driven simultaneously to generate an image frame and a measurement frame for a certain space, they can be synchronized by being mapped to the same time axis.

The virtual object generating device 110 uses a video frame obtained by photographing with the depth camera 102 and a measurement frame obtained by measuring with the LIDAR 104 together to create an object in the virtual space for the object 130 in the real world (that is, , digital twin). The virtual object generating device 110 may be connected to the photographing device 100 through a wired or wireless communication network (eg, WebRTC, etc.) to receive image frames and measurement frames generated by the photographing device 100 in real time. As another embodiment, the virtual object generating device 110 captures the image frame and measurement frame generated by the photographing device 100 for a certain period of time and measures them, and then captures the storage medium (eg, Universal Serial Bus (USB)). It may be received through a wired or wireless communication network (for example, a local area network, etc.) with the photographing device 100 after completion of shooting. It can be provided to the user terminal 120 so that it can be checked.

As another embodiment, the photographing device 100 and the virtual object generating device 110 may be implemented as one device. For example, the photographing device 110 and the virtual object device 110 may be implemented as part of various devices that display augmented reality or virtual reality, such as AR (augumented reality) glasses, HMD (Head Mounded Display), or wearable devices. . As another embodiment, the photographing apparatus 100 is implemented as a part of AR glasses, HMD, or a wearable device, and the photographing apparatus 100 is a virtual object generating device that connects real-time photographing and measured image frames and measurement frames to a wired or wireless communication network. 110, the AR glasses, HMD, etc. implemented with the photographing device may receive the virtual object from the virtual object generating device 110 and display the virtual object in augmented reality or virtual reality. The user can immediately check the virtual object created in real time through augmented reality or virtual reality. A detailed method of generating an object in a virtual space will be reviewed again below in FIG. 2 .

2 is a diagram illustrating an example of a photographing method of a photographing device according to an embodiment of the present invention.

Referring to FIGS. 1 and 2 , the photographing apparatus 100 may continuously photograph one object 200 or continuously photograph a plurality of objects 200 and 210 . Alternatively, the photographing apparatus 100 may continuously photograph objects of the same type or different types located in various spaces. That is, at least one object 200 or 210 desired by the user may exist at various points in time on the basis of the time axis in the image frame and the measurement frame obtained by capturing the image by the photographing apparatus 100 . This embodiment shows an example of an image frame for convenience of description.

For example, suppose that a user travels around various parts of a building and takes pictures of a sewer pipe during construction. In this case, the user may photograph the sewer pipe in space A of the building with the photographing device 100 and move to space B to photograph the sewer pipe. When moving to space A and space B, the photographing device may continue to be maintained in a photographing state or may be turned off during movement. The same type of object, the sewage pipe, exists in the video frames and measurement frames captured in space A and space B.

As another example, a plurality of objects 200 and 210 may be captured together in an image frame and a measurement frame captured in each space. Object a and object b may exist in the video frame and measurement frame captured in space A, and object a and object c may exist in the video frame and measurement frame captured in space B.

The virtual object generating device 110 may classify the image frame and the measurement frame in units of objects. The virtual object generating apparatus 110 may assign the same identification information (or index) to a video frame and a measurement frame in which the same object exists in the video frame and the measurement frame. For example, first identification information (or first index, hereinafter referred to as identification information) is assigned to all of the plurality of image frames 220 , 222 , and 224 in which the first object 200 exists, and the second object 210 exists. Second identification information may be assigned to the plurality of image frames 230 , 232 , and 234 to be used. No identification information may be assigned to the image frames 240 and 242 in which no object exists, or third identification information may be assigned. In this embodiment, the image frames arranged along the time axis can be divided into three groups: A (250), B (260), and C (270). In another embodiment, if a plurality of objects exist in the video frame and the measurement frame, identification information corresponding to each object may be assigned to one video frame and the measurement frame. That is, a plurality of pieces of identification information may be assigned to one image frame and one measurement frame.

In another embodiment, since the photographing device 100 simultaneously drives the depth camera 102 and the lidar 104 to take pictures, the video frame generated by the depth camera 102 and the measurement frame measured by the lidar are synchronized in time. It can be. Therefore, the virtual object generating device 110 determines whether the same object exists only in the video frame, determines the time period of the video frame in which the same object exists, and assigns the same identification information to the video frame during that time period. The same identification information may be assigned by considering the measurement frame generated during the time period identified for the frame as a period in which the same object exists.

The virtual object generating device 110 may determine whether the objects existing in the image frame are identical using various conventional image recognition algorithms. For example, the virtual object generating device 110 may use an artificial intelligence model as an example of an image recognition algorithm. Since the method itself for determining whether objects in an image are the same is a well-known technique, a detailed description thereof will be omitted.

3 is a flowchart illustrating an example of a method of generating an object in a virtual space according to an embodiment of the present invention.

Referring to FIG. 3 , the virtual object generating apparatus 110 divides a first background area and a first object area from an image frame obtained by photographing a certain space with a depth camera (S300). The virtual object generating apparatus 110 may distinguish a background and an object from a plurality of image frames in which the same object is photographed. For example, as shown in FIG. 2 , at least one or more image frames (eg, group A of 220, 222, and 224) in which the same object exists may be distinguished from the background, respectively. As another embodiment, when a plurality of objects exist in an image frame, the virtual object generator may distinguish the background and the plurality of objects, respectively. An example of a method of distinguishing a background and an object in an image frame will be reviewed again in FIG. 4 .

The virtual object generating device 110 distinguishes a second background area and a second object area from a measurement frame obtained by measuring a certain space with lidar (S310). The virtual object generating apparatus 110 may distinguish a background and an object for a plurality of measurement frames in which the same object is measured. For example, as shown in FIG. 2 , a background and an object may be distinguished for a plurality of measurement frames to which the same identification information is assigned. As another embodiment, when a plurality of objects exist in the measurement frame, the virtual object generator may distinguish the background and the plurality of objects, respectively. An example of a method for distinguishing a background and an object in a measurement frame is shown in FIG. 4 .

As shown in FIG. 1 , the depth camera 102 and the LIDAR 104 are spaced apart from each other by a predetermined distance within the photographing apparatus 100, and therefore, the photographing angles of the image frame and the measurement frame are different from each other. In addition, since the resolutions of the video frame and the measurement frame may be different from each other, the positions of each pixel of the video frame and each point of the measurement frame may not be mapped on a one-to-one (1:1, scale) basis. In order to map an image frame and a measurement frame having such a difference, this embodiment uses a grid space.

Specifically, the virtual object generator 110 arranges the pixels of the first object area divided from the image frame according to the depth value in the first grid space including the grid of the predefined size (S320), and also The points of the second object area divided in the measurement frame are arranged according to the distance values in the second lattice space including the lattice of the same size (S330). Since the image frame and the measurement frame are data obtained by photographing the same space, objects existing in the first object area and the second object area are the same object. The first lattice space and the second lattice space are spaces having grids of the same size in the virtual space. An example of a grid space is shown in FIG. 5 .

The virtual object generator 110 corrects the depth value of the pixel in the first grid space based on the distance value of the point in the second grid space (S330). Since the pixels of the first object area and the points of the second object area exist in the grid space of the same size, if the position, direction, size, etc. of the first grid space and the second grid space match each other, each point of the second grid space and each pixel of the first lattice space may be mapped. A detailed method of correcting a depth value of a pixel in a grid unit of a grid space using a distance value of a point will be reviewed again in FIG. 7 .

The virtual object generating apparatus 110 creates an object (ie, a virtual object) in a virtual space having surface information based on a pixel whose depth value is corrected (S340). The virtual object generating apparatus 110 corrects the pixel depth value of an object existing in a plurality of image frames to which the same identification information is assigned to the point distance value of an object existing in a plurality of measurement frames to which the same identification information is assigned, and then generates a plurality of A virtual object can be created using the corrected pixels of the image frame of . That is, a virtual object may be created by correcting a pixel depth value of an image frame of an object photographed at various angles and positions.

The virtual object generating device 110 may generate a 3D virtual object using various types of 3D modeling algorithms. For example, the virtual object generating apparatus 110 may generate a 3D object having surface information as an artificial intelligence model by using a pixel having a depth value. As another embodiment, when 3D modeling is performed using all pixels, since there is a disadvantage in that the amount of computation is large, the virtual object generating device 110 is a point cloud representing corners and vertices among pixels constituting an object. A virtual object can be created by extracting and inputting the point cloud to a 3D modeling algorithm. An example of generating a virtual object using a point cloud will be reviewed again in FIG. 8 . A virtual object can be created based on the distance value of each point of the measurement frame, but generally the resolution of the measurement frame is lower than the resolution of the video frame. In this embodiment, a virtual object is created using a distance value of a pixel of an image frame having a relatively high resolution.

4 is a diagram illustrating an example of a method of distinguishing a background and an object of a video frame and a measurement frame according to an embodiment of the present invention.

Referring to FIG. 4 , there is a first artificial intelligence model 400 that distinguishes the background and object of an image frame and a second artificial intelligence model 410 that distinguishes the background and object of a measurement frame. Each of the artificial intelligence models 400 and 410 is a trained model using pre-constructed learning data and may be implemented as a Convolutional Neural Network (CNN) or the like. Since the process of learning and generating an artificial intelligence model itself is already a well-known technology, a description thereof will be omitted.

The first artificial intelligence model 400 is a model generated through machine learning to distinguish a background and an object in an image frame when an image frame is input. For example, if the first artificial intelligence model 400 is an artificial intelligence model learned to recognize a chair, the first artificial intelligence model 400 is an area where a chair exists in an image frame (ie, a region of a chair area in an image frame). pixels) can be distinguished.

The second artificial intelligence model 410 is a model generated through machine learning to distinguish a background and an object in a measurement frame when a measurement frame is input. For example, if the first artificial intelligence model 400 is an artificial intelligence model trained to recognize a chair, the second artificial intelligence model 410 corresponds to an area where a chair exists in the measurement frame (that is, corresponds to a chair within the measurement frame). points) can be distinguished.

5 is a diagram showing an example of a lattice space according to an embodiment of the present invention.

Referring to FIG. 5 , the grid space 500 is a space in which an area in the virtual space is divided into unit cells 510 of a predetermined size. For example, the grid space 500 may be a space composed of unit cells 510 having width, length, and height of d1, d2, and d3, respectively. Depending on the embodiment, d1, d2, and d3 may all have the same size (eg, 1 mm) or different sizes.

6 is a diagram illustrating an example of displaying objects classified in a video frame in a grid space according to an embodiment of the present invention.

Referring to FIG. 6 , the virtual object generating apparatus 110 may display pixels of an object area divided in an image frame in the grid space 600 using the depth values. In this embodiment, pixels are schematically illustrated for ease of understanding.

The virtual object generating apparatus 110 may determine the 3D coordinate value (or vector value of the pixel, etc.) of each pixel in the grid space by mapping the pixels of the object in the image frame to the grid space 600 . That is, a 3D coordinate value of each pixel of the object may be generated using a predefined point in the lattice space as a reference point (0,0,0 or X,Y,Z).

In this way, the virtual object generating apparatus 110 may map points representing objects in the measurement frame to the lattice space. If the point of the object in the measurement frame is displayed in the grid space, it can also be displayed in a shape similar to that of FIG.

7 is a diagram illustrating an example of a method of correcting a depth value of a pixel of an object according to an embodiment of the present invention.

Referring to FIG. 7, a position corresponding to one of the first grids 700 in the first grid space to which the objects of the image frame are mapped and the first grid 700 in the second grid space to which the objects of the measurement frame are mapped denotes the second grating 710, respectively. In this embodiment, it is assumed that the first lattice space in which the pixels of the object in the image frame are mapped and the second lattice space in which the points of the object in the measurement frame are mapped are first matched in position, direction, size, etc. In addition, this embodiment shows an example in which one pixel 702 and one point 712 are present in the first grid 700 and the second grid 710, respectively, for convenience of description, but one grid 700 and 710 respectively. ) may have a plurality of pixels or a plurality of points. Also, the number of pixels and points present in the first grid 700 and the second grid 710 may be the same or different.

The virtual object generator 110 corrects the depth value of the pixel 702 of the first grid 700 based on the distance value of the point 712 of the second grid 710 . Since the distance value of the point measured by lidar is more accurate, the virtual object generator 110 corrects the depth value of the pixel based on the distance value of the point. For example, if the coordinate values of the pixels 702 of the first grid 700 in the grid space and the coordinate values of the points of the second grid 710 are different from each other, the virtual object generator 110 operates the first grid The pixel 702 of (700) is corrected (720) according to the coordinate values of the points of the second grid (710).

Since the image frame and the measurement frame may have different resolutions, positions indicated by pixels of the first grid 700 and points of the second grid 710 may not be mapped one-to-one. Therefore, by using a plurality of points that exist in the second grid 710 or a plurality of points that exist in the surrounding grids that exist on the top, bottom, left, right, etc. of the second grid 710, the values existing between each point are interpolated, etc. Through this, it is possible to determine the distance value of the coordinate value of the point corresponding to the coordinate value of the pixel. In addition, coordinate values of pixels of the first grid 700 may be corrected using distance values of points generated through interpolation.

8 is a diagram illustrating an example of a method of generating a 3D virtual object according to an embodiment of the present invention.

Referring to FIG. 8 , the virtual object generating apparatus 110 may generate a 3D virtual object 820 including surface information by inputting a point cloud 810 into a 3D modeling algorithm 800 . A point cloud can be composed of points representing key points that can define an object, such as vertices and edges of an object. Various conventional methods of extracting a point cloud from an image frame captured by a depth camera may be applied to this embodiment. Since the method of extracting a point cloud itself is a well-known technique, an additional description thereof will be omitted.

The virtual object generating apparatus 110 maps objects extracted from the image frame to the grid space, and corrects the distance value (or coordinate value) of each pixel mapped to the grid space in the same manner as shown in FIG. 7 . Then, a point cloud to be used for generating a 3D virtual object is extracted from the corrected distance value (or coordinate value) of each pixel. An example of extracting a point cloud for the object of FIG. 6 is shown in FIG. 9 . The virtual object generating device 110 may use an artificial intelligence model such as machine learning as a 3D modeling algorithm 800 . Various conventional algorithms for generating a 3D object based on a point cloud may be applied to this embodiment. Since the method of generating a 3D object using a point cloud itself is a well-known technology, a detailed description thereof will be omitted.

9 is a diagram illustrating an example of extracting a point cloud for generating a 3D virtual object according to an embodiment of the present invention. Referring to FIG. 9 , an example of extracting a point cloud 910 for a chair is shown. Various conventional methods of extracting a point cloud may be applied to this embodiment. As another embodiment, a 3D virtual object may be generated by extracting a point cloud after correcting a depth value of a pixel in a plurality of image frames to which the same identification number is assigned, that is, a plurality of image frames in which the same object is photographed.

10 is a diagram illustrating an example of generating a 3D virtual object according to an embodiment of the present invention. Referring to FIG. 10 , the virtual object generator may create a virtual object 1000 including surface information using a point cloud.

11 is a diagram showing the configuration of an example of a virtual object generating device according to an embodiment of the present invention.

Referring to FIG. 11, the virtual object generating device 110 includes a first object extraction unit 1100, a second object extraction unit 1110, a first grid arrangement unit 1120, a second grid arrangement unit 1130, A correction unit 1140 and an object creation unit 1150 are included. As an example, the virtual object generator 110 may be implemented as a computing device including a memory, processor, input/output device, etc., or as a server, cloud system, etc. In this case, each component is implemented in software and loaded into the memory, and then the processor can be performed by

The first object extraction unit 1100 distinguishes a first background area and a first object area from an image frame obtained by photographing a certain space with a depth camera. The second object extraction unit 1110 distinguishes a second background area and a second object area from a measurement frame obtained by measuring the predetermined space with LIDAR. The classification of the background and the object can be performed using an artificial intelligence model, and an example thereof is shown in FIG. 4 .

The first grid arrangement unit 1120 arranges pixels of the first object area according to depth values in a first grid space including a grid having a predefined size. The second grid arranging unit 1130 arranges points of the second object area according to distance values in a second grid space including a grid having a predefined size. An example of the lattice space is shown in FIG. 5, and an example of mapping pixels of an object extracted from an image frame to the lattice space is shown in FIG.

The correction unit 1140 corrects the depth value of the pixel in the first grid space based on the distance value of the point in the second grid space. An example of a method of correcting through comparison of grid spaces is shown in FIG. 7 .

The object generator 1150 creates a virtual object having surface information based on pixels whose depth values are corrected. The object generator 1150 may create an object in a 3D virtual space using all pixels. However, in this case, since the amount of computation increases, the object generator 1150 may create a virtual object by creating a point cloud, examples of which are shown in FIGS. 8 to 10 .

Each embodiment of the present invention can also be implemented as computer readable codes on a computer readable recording medium. A computer-readable recording medium includes all types of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable recording media include ROM, RAM, CD-ROM, SSD, and optical data storage devices. In addition, the computer-readable recording medium may be distributed to computer systems connected through a network to store and execute computer-readable codes in a distributed manner.

So far, the present invention has been looked at mainly with its preferred embodiments. Those skilled in the art to which the present invention pertains will be able to understand that the present invention can be implemented in a modified form without departing from the essential characteristics of the present invention. Therefore, the disclosed embodiments should be considered from a descriptive point of view rather than a limiting point of view. The scope of the present invention is shown in the claims rather than the foregoing description, and all differences within the equivalent scope will be construed as being included in the present invention.

Claims (7)

dividing a first background area and a first object area in an image frame obtained by photographing a certain space with a depth camera;
Separating a second background area and a second object area in a measurement frame obtained by measuring the predetermined space with LIDAR;
arranging pixels of the first object area according to depth values in a first grid space including a grid having a predefined size;
arranging points of the second object area according to distance values in a second grid space including a grid having a predefined size;
correcting a depth value of a pixel in the first grid space based on a distance value of a point in the second grid space; and
A method of creating an object in a virtual space, comprising: generating a virtual object having surface information based on a pixel whose depth value is corrected. According to claim 1,
In the step of dividing the first background area and the first object area,
Dividing a plurality of frames obtained by photographing with the depth camera into a plurality of sections in which the same object exists; and
Dividing a first object area representing the object for each frame of each section;
In the step of dividing the second background area and the second object area,
Dividing a plurality of frames obtained by measuring with the LIDAR into a plurality of sections in which the same object exists; and
A method of creating an object in a virtual space, comprising: dividing a second object area representing the object in a frame of each section. The method of claim 1, wherein the generating of the virtual object comprises:
A method of creating an object in a virtual space, comprising generating a virtual object by using pixels whose depth value of the object is corrected in a plurality of image frames in which the same object exists. The method of claim 1, wherein the correcting step,
generating a point cloud by extracting some of the pixels existing in the first virtual space; and
and correcting the depth value of the point cloud based on the distance value of the second virtual space. The method of claim 4, wherein the generating of the virtual object comprises:
A method for creating an object in a virtual space, comprising: generating a virtual object using deep learning based on the calibrated point cloud. a first object extraction unit dividing a first background area and a first object area in an image frame obtained by photographing a certain space with a depth camera;
a second object extraction unit dividing a second background area and a second object area in a measurement frame obtained by measuring the predetermined space with LIDAR;
a first grid arranging unit for arranging pixels of the first object area according to depth values in a first grid space including a grid having a predefined size;
a second grid arranging unit for arranging points of the second object area according to distance values in a second grid space including a grid having a predefined size;
a correction unit for correcting a depth value of a pixel in the first grid space based on a distance value of a point in the second grid space; and
A virtual object generating device comprising: an object generating unit generating a virtual object having surface information based on a pixel whose depth value is corrected. A computer-readable recording medium recording a computer program for performing the method according to any one of claims 1 to 5.

Images