KR102182314B1 - Management server for integrated space information management platform using virtual reality video and operation method thereof - Google Patents

Abstract

Disclosed is a method of operating an integrated management platform for recording target space information of a management server. A method of operating a platform for integrated management of recording target space information by a management server according to various embodiments of the present invention is a method of operating a platform in which the management server integrates and manages recording target space information. Receiving a VR (Virtual Reality) image and basic data about the recording target space; Analyzing the VR image and performing a masking process on an area within the image including personal information; Transmitting the VR image on which the masking process has been performed to the user terminal, and receiving information on an area to be additionally masked from the user terminal; Extracting data on an object or space recognized in the VR image; Generating integrated spatial data contents for the recording target space using the VR image of the recording target space, the collected data, and the extracted data; And receiving a request for disclosure of a specific business from the user terminal and publishing data necessary for the corresponding business among data included in the integrated spatial data content to a business performer terminal. Provides an integrated management platform operation method.

Description

A management server that operates an integrated management platform for spatial information to be recorded using virtual reality images, and its platform operation method {MANAGEMENT SERVER FOR INTEGRATED SPACE INFORMATION MANAGEMENT PLATFORM USING VIRTUAL REALITY VIDEO AND OPERATION METHOD THEREOF}

Various embodiments of the present invention relate to a spatial information integrated management platform using a virtual reality image and a method of operating the same, and integrated management of various information including VR images on a specific space desired to be recorded by a user of the platform, It is a technology about a platform that can be applied to and how to operate it.

In modern society, one of the most important factors in daily life or business is real estate. Among the three items, food, clothing, and shelter that are required for people to live, the most burdensome item in terms of price and careful selection is the main item, and the location, structure, area, and rent of the office are also in business operation. It is a serious consideration. People sell a lot of products to find a place to move or to find a place to run a new business, and due to a limited time, they are confused with a situation in which they make choices with only limited information. Therefore, in such a situation, what people need is detailed information about each real estate.

In this way, it is important not only those who purchase or lease real estate, but also those who want to sell or lease their own real estate, and disclose information about their real estate to others.

In addition, various businesses related to real estate exist in the market and are doing business. Not only companies directly related to real estate such as real estate agents, but also various companies such as moving companies, interior companies, and furniture sales companies want to obtain accurate and diverse information about real estate.

In addition, there are people who want to record information about the real estate they are currently using and use it in the future. There may be people who want to remember the real estate they used without forgetting, and there may be people who want to compare their past real estate information with current real estate information.

In recent years, various real estate-related applications have been released, and application users register information on real estate, and other users confirm this, helping to conduct business related to the real estate. However, even with such an application, there is a disadvantage that only a specific type of business is performed among various businesses related to real estate. Therefore, there is a need for a platform that can integrate information on real estate and integrate it into various businesses.

In addition, it is not limited to such real estate, and there is a need to perform integrated information management such as real estate for specific spaces that people want to record, such as transportation means such as cars, their own yard, and specific tourist sites.

Domestic registered patent No. 10-1857222

Various embodiments of the present invention have been derived to solve the above problems, and an object thereof is to construct an integrated information management platform for a recording target space.

Another object of the present invention is to provide integrated support for various businesses related to the recording target space through a new platform.

Another object of the present invention is to automatically extract and use data in an image in managing recording target spatial information in the form of a VR image.

Another object of the present invention is to improve security and induce voluntary participation of users in performing information management on a recording target space.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems that are not mentioned will be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, in an embodiment of the present invention, in a method for operating a platform in which a management server integrates information on a recording target space, a virtual reality (VR) image for a recording target space is provided from a user terminal. And receiving basic data on the recording target space. Analyzing the VR image and performing a masking process on an area within the image including personal information; Transmitting the VR image on which the masking process has been performed to the user terminal, and receiving information on an area to be additionally masked from the user terminal; Extracting data on an object or space recognized in the VR image; Generating integrated spatial data contents for the recording target space using the VR image of the recording target space, the collected data, and the extracted data; And receiving a request for disclosure of a specific business from the user terminal and publishing data necessary for the corresponding business among data included in the integrated spatial data content to a business performer terminal. Provides an integrated management platform operation method.

The method of operating the integrated management platform for recording target space information by the management server may further include generating a plan view of the recording target space through the VR image and including it in the integrated space data content.

The method for operating the integrated management platform for recording target spatial information of the management server is characterized in that the VR image received from the user terminal includes a plurality of images photographed in different directions by a plurality of lenses, and stitching a plurality of images It may further include the step of performing (Stiching).

The method of operating the integrated management platform for recording target space information of the management server includes the function of receiving a plurality of VR images for the recording target space from the user terminal, and adjusting the viewpoint position of the VR image through the received plurality of VR images. It may further include the step of including in the integrated spatial data content.

The method of operating the integrated management platform for recording target space information of the management server receives selection information on whether to disclose the recording target space to other users from the user terminal, and when the recording target space is disclosed to other users. It may further include providing a predetermined reward to a user who has selected to disclose the recording target space.

The method of operating the integrated management platform for recording target spatial information of the management server includes receiving additional information given to each object or space recognized in the VR image from the user terminal, and linking it with the object or space to provide the integrated spatial data. Including in the content may further include, and the additional information may be characterized in that it includes at least one of information in the form of text, sound, or video.

The method of operating the integrated management platform for recording target space information of the management server may be characterized in that the data collected through the user terminal and the data extracted through the VR image for the recording target space are managed through blockchain technology. have.

The method of operating the integrated management platform for recording target space information of the management server may be characterized in that the reward according to the disclosure of the recording target space is a cryptocurrency generated through a blockchain technology that manages data on the recording target space.

The method of operating the integrated management platform for recording target spatial information of the management server includes receiving selection information on whether the cost of using the integrated spatial data content is free or paid from the user terminal, and whether to use a partial paid payment model The step of additionally receiving information on whether to insert an advertisement in a specific object or space may be further included.

In order to achieve the above object, another embodiment of the present invention is a management server operating a platform for integrated management of recording target space information, and a VR (Virtual Reality) image of the recording target space and the A recording target space information collection unit for receiving basic data on the recording target space; By analyzing the VR image, a masking process is performed on an area within the image including personal information, and the masked VR image is transmitted to the user terminal, and additional masking processing is performed from the user terminal. A masking processing unit for receiving information on a desired area; A VR object recognition processing unit for extracting data on an object or space recognized in the VR image; An integrated spatial data content generator for generating integrated spatial data content for the recording target space by using the VR image of the recording target space, the collected data, and the extracted data; A floor plan generator for generating a plan view of the recording target space through the VR image and including it in the integrated spatial data content; And a business execution unit that receives a request for disclosure of a specific business from the user terminal and discloses data necessary for a corresponding business among data included in the integrated spatial data content to a business performer terminal.

According to an embodiment of the present invention, there may be an effect of collectively recording and storing various data and VR images on a recording target space.

According to an embodiment of the present invention, data in a VR image may be automatically extracted, and analysis thereof and additional data may be automatically collected.

According to an embodiment of the present invention, a user who registers his or her recording target space on the platform can easily receive products or services related to the corresponding recording target space, and those who conduct business related to the recording target space also You can easily propose products or services that you can provide to users who have registered.

According to an embodiment of the present invention, integrated information management related to the recording target space can be performed using blockchain technology, thereby improving the security of information and using a cryptocurrency using a block chain. You can perform space-related transactions.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a diagram schematically illustrating an environment in which an integrated management platform for recording target space information according to an embodiment of the present invention is operated.
2 is a diagram illustrating a method of operating a VR photographing device according to an embodiment of the present invention.
3 is a diagram for explaining a method of performing stitching for producing a VR image on a management server or a user terminal according to an embodiment of the present invention.
4 is a diagram for explaining a process in which masking is performed according to an embodiment of the present invention.
5 is a diagram illustrating a process in which a management server generates a plan view based on a VR image according to an embodiment of the present invention.
6 is a diagram illustrating a process of extracting data on an object or space existing in a VR image by a management server according to an embodiment of the present invention.
7 is a diagram schematically illustrating a state in which a management server according to an embodiment of the present invention performs a business related to a recording target space through communication with a plurality of business performer terminals.
8 is a block diagram schematically showing the configuration of a management server according to an embodiment of the present invention.
9 is a flowchart illustrating a process of operating the integrated management platform for recording target space information according to an embodiment of the present invention.
10 is a flowchart illustrating a method of using a block chain technology by the integrated management platform for spatial information to be recorded according to an embodiment of the present invention.

The terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used in the specification, “comprises” and/or “comprising” do not exclude the presence or addition of one or more other elements other than the mentioned elements. Throughout the specification, the same reference numerals refer to the same elements, and “and/or” includes each and all combinations of one or more of the mentioned elements. Although “first”, “second”, and the like are used to describe various elements, it goes without saying that these elements are not limited by these terms. These terms are only used to distinguish one component from another component. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical idea of the present invention.

When a part of the specification is said to "include" a certain component, it means that other components may be further included rather than excluding other components unless otherwise stated. In addition, terms such as "... unit" and "module" described in the specification mean units that process at least one function or operation, which may be implemented as hardware or software, or as a combination of hardware and software. .

In this specification, the term'recording target space' is a certain space in which the user wants to shoot with a VR photographing device and record data related to the space when the user uses the integrated management platform for recording target space information. Like parts, it may be real estate, but it may also be a space within a means of transportation such as a car. In addition, it may be an external space such as a courtyard adjacent to the own building, or a space such as a terrace connected to the building. As described above, the recording target space is not limited to a limited space such as real estate or indoor space, and may be a target space itself having a certain volume desired to be recorded by the user.

The management server disclosed in this specification provides users with a platform for integrated management of various information on the recording target space, and users upload images of the recording target space captured by the VR recording device to the management server. It can also register its own recording target space data, and the management server can create integrated spatial data contents based on the VR image, data on the recording target space uploaded by the user, and data extracted from the VR image registered by the user. . The generated integrated spatial data content can be inquired by other users and used for various businesses.

Hereinafter, various embodiments of the present invention will be disclosed with reference to the accompanying drawings.

1 is a diagram schematically illustrating an environment in which an integrated management platform for recording target space information according to an embodiment of the present invention is operated.

Referring to FIG. 1, an integrated management platform for recording target spatial information may be established through communication between a management server 100, a user terminal 200, and a business operator terminal 300. According to an embodiment of the present invention, a block chain technology may be used to integrate and manage the spatial information to be recorded. In this case, a plurality of block chain nodes may include the management server 100, the user terminal 200, and the business It is possible to communicate with each of the performer terminals 300.

According to an embodiment of the present invention, the communication network used by subjects in the integrated management platform for spatial information to be recorded may be configured regardless of the communication mode such as wired or wireless, for example, a local area network (LAN : Local Area Network), Metropolitan Area Network (MAN), Wide Area Network (WAN), etc. can be implemented in various communication networks. Preferably, the communication network according to an embodiment of the present invention may be a known World Wide Web (WWW) or the like.

The user terminal 200 and the business executor terminal 300 according to an embodiment of the present invention are web servers through a network such as a mobile phone, a smart phone, a personal digital assistant (PDA), a portable multimedia player (PMP), a tablet PC, etc. It may include all kinds of handheld-based wireless communication devices that can be connected to, and may use memory means such as personal computers (eg, desktop computers, notebook computers, etc.), workstations, PDAs, web pads, etc. It may be one of digital devices equipped with a microprocessor and capable of computing. The handheld-based wireless communication device may also include a wearable device that is configured in the form of accessories such as a watch or glasses or various clothing and can be worn or worn by a user.

A user who wishes to utilize the integrated management platform for recording target space information transmits the image of the recording target space captured by the VR photographing device to the management server 100 through his user terminal 200 to create a new recording target space. You can register. When registering a new recording target space in the management server 100, the user may transmit basic data on the corresponding recording target space together with the captured VR image to the management server 100. The basic data on the recording target space may include the nature, location, price, area, internal structure, and surrounding infrastructure of the corresponding recording target space. For example, a user who wants to register a household in an apartment he owns, information that the target space to be recorded for the data uploaded by him along with VR images taken inside the apartment is apartment, and where the apartment is located. You can register data such as address, number of buildings, year the apartment was built, how many rooms are inside the apartment, how large is each room, how many toilets are there, and how the structure is.

The management server 100 integrates the VR image received from the user terminal 200 and the recording target space based on the data extracted from the VR image received from the user terminal along with basic data on the recording target space registered by the user. Spatial data content can be created. In this process, the management server 100 may perform masking or stitching on the VR image. Masking means that sensitive data that can be combined with other public information in the video and can serve as a tool to identify an individual is processed so that it cannot be identified. Through this, a specific object or a certain space is Can be processed unidentifiable in For example, objects such as photos or licensed frames attached to the wall of a home may be subject to masking, and the work on the desk accidentally captured at the time of shooting a VR image or the contents displayed on the monitor are also subject to masking. Can be. Most basically, shooting equipment required to shoot VR images can be the target of masking. Stitching refers to the process of combining images captured from multiple photographing lenses when producing VR images. In general, one photographing lens has a limited angle of view, and for this reason, in order to obtain an image for all directions from a time when photographing is performed, a process of combining images obtained from several photographing lenses is required. When the frame of each image captures the same space, stitching is to combine the overlapping parts.

According to an embodiment of the present invention, the management server 100 may extract data on an object or space recognized in a VR image. The management server 100 may perform data conversion by grasping what kind of object recognized in the VR image is, what size and shape, and where it is located in the photographed space. If the object to be recognized is a product on the market, it is also possible to grasp what kind of product it is. The management server 100 can perform data conversion by identifying what type of space the photographed space has through the VR image and how wide it has, and can also create a floor plan for the corresponding recording target space. .

When the management server 100 extracts data on an object or space recognized in the VR image, artificial intelligence may be used. The management server 100 may operate based on machine learning using artificial intelligence. That is, while the management server 100 performs an operation, the artificial intelligence algorithm may be improved while changing based on the acquired data. The management server 100 can not only change the algorithm through data directly acquired in the process of extracting data on objects or spaces recognized in the VR image, but also based on information registered by the user for the extracted data. You can also change the algorithm.

The management server 100 generates integrated spatial data contents for the corresponding recording target space based on the VR image received as described above, basic data on the recording target space registered by the user, and data extracted from the VR image received from the user terminal. I can. Users who have access rights to the generated integrated spatial data content may acquire VR images and data in the corresponding content.

When a user who has registered his or her recording target space has a product or service that he/she wants to purchase for the registered recording object space, the user terminal 200 manages the disclosure request for a specific business that can provide the product or service. It can be registered in the server 100. Users may wish to receive various products or services related to the recording target space in which they own or reside.

For example, a user who plans to move to another house or office wants to lease or purchase the recording target space by accessing the recording target space information registered by other users in order to dispose of his or her home or office first. In this case, it may be necessary to induce them to be able to provide their own recording target space information to a company that conducts an official brokerage business. Also, a user planning to move may want to receive an estimate from the moving center based on the amount of objects currently in the space to be recorded. A user who has registered his or her recording target space may want an estimate from an interior company, or may want to receive recommendations for furniture suitable for his or her recording target space.

In such a situation, the user selects a company that provides the product or service he wants, i.e., a certified brokerage company, a moving company, an interior company, a furniture sales company, etc., and the company performing the corresponding business integrates the space to be recorded. Authorization can be provided to access spatial data content. In detail, when a user transmits a request for disclosure of his or her recording target spatial data for a specific business through the user terminal 200 to the management server 100, the management server 100 performs the business desired by the user. The integrated spatial data content registered by the user may be disclosed to the operator's terminal, that is, the business performer terminal 300. Through this, business operators who perform the business desired by the user who registered the recording target space acquire the recording target space information necessary to conduct the business, and read the conditions and contents of the product or service that they can provide to the business performer terminal ( 300) through the management server 100 may be transmitted. The management server 100 may transmit the condition and contents of the service received from the business performer terminal 300 to the user terminal 200.

According to an embodiment of the present invention, the management server 100 may disclose only some data necessary for performing a specific business among data included in the integrated spatial data content for the recording target space registered by the user.

Recently, as collecting and analyzing big data has emerged as an important issue for large-scale IT companies, companies that want to collect various types of spatial information to be recorded are increasing. Such companies can request data on the recording target space at a desired location to the management server 100 through the business performer terminal 300, and the management server 100 is a user who has registered the recording target space at the corresponding location. Such a request may be transmitted to the user terminal 200 of. Upon receiving such a request, the user can check the compensation that companies can provide according to the disclosure of the spatial data to be recorded, and determine whether to provide the spatial data to be recorded to the company accordingly.

2 is a diagram illustrating a method of operating a VR photographing device according to an embodiment of the present invention.

Referring to FIG. 2, the VR photographing device 10 may include a plurality of lenses. Hereinafter, in the present specification, description will be made on the assumption that the VR photographing device 10 includes the first lens 11 and the second lens 12, but the scope of the present invention is not limited thereto.

The VR photographing device 10 may perform photographing through the included first lens 11 and second lens 12. The first lens 11 and the second lens 12 each have a constant angle of view as indicated in the drawing. According to an embodiment of the present invention, a support portion supporting the VR photographing device 10 may be rotated to change a range in which the first lens 11 and the second lens 12 photograph.

According to an embodiment of the present invention, each image captured by the first lens 11 and the second lens 12 included in the VR photographing device 10 is the VR photographing device 10 or the user terminal 200 It can be combined into one VR image by stitching on the image. According to another embodiment, after each image captured by the first lens 11 and the second lens 12 is transmitted from the user terminal 200 to the management server 100, the two images are transferred from the management server 100 It can also be combined into one VR image by stitching.

3 is a diagram illustrating a method of performing stitching for producing a VR image on the management server 100 or the user terminal 200 according to an embodiment of the present invention.

As described above, stitching refers to a process of producing a VR image covering an all-round 360-degree range by combining images captured from several photographing lenses.

Referring to FIG. 3, a first image 21 photographed by the first lens 11 of the VR photographing device 10 and a second image 22 photographed by the second lens 12 are illustrated. . According to an embodiment, the first lens 11 and the second lens 12 may be composed of a wide-angle lens, and the first image 21 and the second image 22 photographed through the wide-angle lens are each It can appear in a spherical shape.

According to an embodiment of the present invention, each of the first lens 11 and the second lens 12 may be photographed with a field of view of 180 degrees or more in opposite directions to each other. In this case, an overlapping portion may occur in the first image 21 and the second image 22. In FIG. 3, area A of the first image 21 and area A of the second image 22 may represent the same space, and area B of the first image 21 and area B of the second image 22 This can represent the same space. In this case, stitching is performed on two regions A, and similarly, stitching is performed on two regions B, thereby generating a VR image showing 360 degrees. Such stitching may be performed by the VR photographing device 10, the user terminal 200, or the management server 100.

4 is a diagram for explaining a process in which masking is performed according to an embodiment of the present invention.

Referring to FIG. 4, a VR image captured by a user of a user's own recording target space is disclosed. The management server 100 may extract data on an object or space recognized in the VR image registered by the user. When the recognized object contains data such as personal information, masking processing for the object is performed. Can be done so that the object is not identified.

According to an embodiment of the present invention, even if an image related to personal information is not included in the VR image, if stimulating adult content or harmful content is included in the VR image, the management server 100 Masking may be performed on a portion displayed in the image.

Referring to FIG. 4, a picture containing personal information is located in a frame hanging on a wall, and the management server 100 recognizes it and performs masking.

According to an embodiment of the present invention, the management server 100 may perform masking on a specific object, space, or image through analysis of the object or image recognized in the VR image. A user who has uploaded a VR image to the management server 100 may control the degree to which masking is performed through his or her user terminal 200. For example, the management server 100 performs masking on data that can be identified by an individual, and the user sets to mask pictures of himself and his family, but the bookshelf he owns in the VR image Masking can be set not to be performed for the list of books in the library.

According to an embodiment of the present invention, in analyzing an object or image recognized in a VR image, the management server 100 determines how similar the object or image is to an image circulating on the Internet, and the object or image is If it is determined that personal information is not included, masking may not be performed. For example, if the picture inside the frame decorated on the wall in the VR image is a family picture, the management server 100 may mask it, but if the picture inside the frame is a picture of a celebrity Thus, the management server 100 may determine this and not perform masking on the corresponding photo.

According to an embodiment of the present invention, the management server 100 may request a user's confirmation of a VR image that has been primarily masked. Such a user's confirmation request may be a supplementary measure for such a possibility, even though the management server 100 performs masking on the VR image through a masking algorithm, since perfect processing may not have been performed. The management server 100 may transmit the VR image on which the masking process has been performed to the user terminal 200, and receive information on a region to which the masking process is additionally performed from the user terminal 200. The user checks the VR image on which masking has been performed through his/her user terminal 200, selects a specific object or a certain area within the image, and transmits selection information to the management server 100, so that the management server 100 Masking for an additional area can be performed.

5 is a diagram illustrating a process in which the management server 100 generates a plan view based on a VR image according to an embodiment of the present invention.

According to an embodiment of the present invention, the management server 100 may generate a floor plan of a recording target space registered by a user based on at least one VR image and include it in the integrated spatial data content.

Referring to FIG. 5, the management server 100 may receive at least one VR image from the user terminal 200, and in FIG. 5, the number is assumed to be four. The management server 100 may analyze a plurality of images, recognize a portion of each image that photographs the same area, determine the overall appearance of the recording target space registered by the user, and generate a floor plan through the identified portion.

Looking at how the management server 100 generates a floor plan, it recognizes features such as the intersection between the wall and the ground, and the intersection between the wall and the wall from indoor images included in a plurality of VR images, and based on such features, the floor plan Can be created.

The management server 100 according to an embodiment of the present invention may extract various data from source data for an offline space such as a VR image, not only a floor plan of a recording target space registered by a user based on a VR image. have. For example, the management server 100 may extract various survey data from a VR image, which is source data. The survey data may include the length, area, and volume of various objects or spaces displayed in the VR image. In this way, the management server 100 may perform reality virtualization, which is a task of generating new virtual data such as floor plan and survey data from VR images, which are source data recorded offline. As the integrated management platform for recording target spatial information disclosed in the present invention supports real-world virtualization, users can easily manage real-world records in the form of electronic data.

6 is a diagram for explaining a process of extracting data on an object or space existing in a VR image by the management server 100 according to an embodiment of the present invention.

Referring to FIG. 6, one VR image is displayed and various types of objects are displayed in the image. As described above, a specific object or area may be masked. The management server 100 may recognize each object and extract data on the object. Thereafter, the management server 100 may include data for each object in the integrated spatial data content. Data on such an object may be provided to companies that provide business related to the object in the future.

As described above, the management server 100 may check what kind of product the objects recognized in the VR image are commercially available products through data collection using its own database or communication network, and the exact product name specification Even if not, the type of the object can be determined through the shape of the object. On the other hand, for objects that are difficult to be specified by the management server 100, the user can directly input what kind of object the object is, the purpose and size of the object through his user terminal 200. May be.

In addition, the management server 100 operating through machine learning-based artificial intelligence may develop an algorithm for extracting an object or image existing in a VR image as data is accumulated. Such a change in algorithm may be performed by data generated during an extraction process or by data input by a user. For example, when the management server 100 repeatedly recognizes and extracts a specific object as an error, if the user inputs feedback on the object, the algorithm may change in a direction to reduce errors related to the object in the future based on this. .

7 is a diagram schematically showing a state in which the management server 100 according to an embodiment of the present invention performs business related to a recording target space through communication with a plurality of business performer terminals 300.

Referring to FIG. 7, the management server 100 communicates with a plurality of business performer terminals 300 so that various products or services related to the recording target space registered by the user can be provided, and attracts customers to business performers. It can provide an opportunity to do it.

In the example of FIG. 7, it is shown that the management server 100 communicates with business performer terminals 300 used by certified brokers, moving companies, interior companies, furniture stores, and IT companies.

According to an embodiment, a user who registers a recording target space on the management server 100 makes a request to disclose a specific business corresponding to a case where a user wants to receive a specific product or service for the recording target space, the user terminal 200 It can be transmitted to the management server 100 through. After receiving the disclosure request, the management server 100 receives the data required for performing the corresponding business among the contents of the integrated spatial data content generated for the recording target space registered by the user. About 300 can be disclosed. In this process, the user can register the contents of the product or service information that he/she wants to receive for the recording target space, and the business performer who has confirmed this checks the contents registered by the user and You can suggest users to purchase their own products or services by entering the contents and conditions of the service.

For example, when the user wants to perform remodeling on the recording target space registered by the user, the user may enter the scope, direction, and budget of the remodeling desired by the user along with this fact in the management server 100 . The management server 100 provides the right to view the integrated spatial data contents for the recording target space of the user who wants to perform remodeling for the terminals of users registered as interior companies on the server, that is, the business performer terminal 300 can do. In this process, the management server 100 may transmit information such as the scope, direction, and budget of the remodeling registered by the user to the business performer terminal 300, and among the data included in the integrated spatial data content, it is not related to the interior, It is possible to prevent the business performer terminal 300 from obtaining permission to view data that the user does not want to disclose.

According to an embodiment of the present invention, a user who registers his or her recording target space on the management server 100 may disclose the integrated spatial data content generated based on the VR image registered by him to other users or companies. , The user can select whether to disclose each data included in the integrated spatial data content, and select which users or companies to disclose each data to. In addition, the user may obtain an appropriate reward according to the degree of disclosure of his or her integrated spatial data content. That is, the user can transmit to the management server 100 whether or not the user terminal 200 selects whether to disclose the integrated spatial data content for the recording target space to other users, and the recording target space If this is disclosed to other users, a predetermined reward can be obtained. Such compensation may be provided in the form of cryptocurrency to which the blockchain technology, which will be described later, is applied.

8 is a block diagram schematically showing the configuration of the management server 100 according to an embodiment of the present invention.

Referring to FIG. 8, the management server 100 includes a recording target space information collection unit 110, a masking processing unit 120, a stitching processing unit 122, an object recognition processing unit 124, a floor plan generation unit 126, and an integrated space. It may include a data content generation unit 130, a business execution unit 140, a block chain management unit 150, a communication unit 160, and a control unit 170.

The recording target space information collection unit 110 may perform a role of receiving and collecting a VR image of the recording target space and basic data about the recording target space from the user terminal 200. In addition, the recording target space information collection unit 110 may collect information on the recording target space from the Internet or a server of another company based on basic information of the recording target space collected from the user. For example, if the user inputs the exact name and location information of the recording target space, the recording target space information collecting unit 110 collects data that is open on the Internet for the recording target space or You can collect data by connecting to the server holding the information.

The recording target spatial information collection unit 110 also receives from the user terminal 200 additional information about an object or space recognized by the object recognition processing unit 124 to be described later in the VR image and includes it in the integrated spatial data content. I can make it.

The masking processing unit 120 may recognize data, adult content, or harmful content that can be combined with itself or other public information in the VR image to identify an individual and process it through a masking algorithm. In addition to automatically performing masking through an algorithm, the masking processor 120 may perform masking on an object or a specific area in an image selected by the user.

The stitching processing unit 122 may edit the plurality of images into one VR image covering a 360 degree range by recognizing the same part in the plurality of images registered by the user and combining the corresponding parts. As described above, stitching may be performed on the VR photographing device 10 or the user terminal 200 used by the user, but the user manages the image captured by the plurality of lenses included in the VR photographing device 10 as it is. In the case of transmitting to the server 100 and requesting generation of a VR image through it, the stitching processing unit 122 of the management server 100 may combine a plurality of images into one VR image through stitching.

The object recognition processing unit 124 may perform a role of extracting data on an object recognized in the VR image. The object recognition processing unit 124 may connect the business related to the object to the user in the future based on the data on the object, and provide information on the object to other users who use the integrated spatial data content. have. For example, when user A finds interior props he wants in the video while watching VR video of the recording target space owned by B using the integrated spatial data contents registered by user B, user A Information on interior props may be obtained by requesting the management server 100. This may be a possible function because the management server 100 extracts and stores data on the object using the object recognition processing unit 124.

The floor plan generator 126 may play a role of generating a 2D floor plan for a corresponding recording target space based on at least one VR image registered by the user in the management server 100 for a specific recording target space.

The floor plan generator 126 identifies features included in a plurality of VR images, that is, a part where the wall surface and the floor surface are connected, the part where the wall surface and other wall surfaces are connected, and the part where the wall surface and the ceiling are connected, and the like Can be generated. In addition, it is possible to connect portions of a plan view generated through a part commonly included in a plurality of VR images, and through this, an overall 2D plan view of an area appearing in a VR image captured by a user may be generated. The generated floor plan may be included in the integrated spatial data content.

The integrated spatial data content generation unit 130 searches for data extracted and processed by the management server 100 based on the image and data registered by the user, along with the VR image and basic data registered by the user for the recording target space. The integrated spatial data content can be created based on the related data collected through the system.

The generated integrated spatial data content may include at least one VR image of a specific recording target space, and a user viewing the VR image rotates the viewpoint at a fixed position and can watch the state of the recording target space in the form of a video. have. In addition, when VR images taken from multiple locations are included in the integrated spatial data content, a user viewing the VR image manipulates the viewpoint as if he or she moves the location, and can watch the image of the recording target space at a desired viewpoint. May be. That is, when a plurality of VR images for a recording target space are received from the user terminal 200, the management server 100 provides a function of adjusting the viewpoint position of the VR image through the plurality of received VR images in the integrated spatial data content. Can be included. In addition, the integrated spatial data content includes information on the recording target space registered by the user, information collected on the recording target space by the management server 100, and information on various objects and spaces recognized in the VR image. I can. A user viewing a VR image may view information on a specific space or object by selecting a specific space or object in the VR image.

The integrated spatial data content generation unit 130 may also generate statistical data from a VR image and specific spatial-related data and include it in the integrated spatial data content. The statistical data may include a pattern of data registered by a plurality of users when generating integrated spatial data content, a pattern of data extracted from a VR image, etc., and a pattern of users' use of integrated spatial data content.

Users who use the integrated management platform for recording target spatial information may access the management server 100 through their terminal to view integrated spatial data contents for the recording target spaces to which they have access rights. A user who uses the integrated spatial data content can view the data included in the integrated spatial data content within the authority he has.

According to an embodiment of the present invention, a user who has registered the image and data of his or her recording target space may set the public range of the integrated spatial data content generated based on this in the management server 100, and the integrated spatial data content Users can choose whether the price they spend is free or paid. The user can select whether the cost of using the integrated spatial data content is paid or free and transmit the selection information to the management server 100 through the user terminal 200, and a partial paid payment model in the integrated spatial data content The selection information may be transmitted to the management server 100 by selecting whether to use it or not to insert an advertisement in a specific object or space.

For example, the user is free to view most rooms of VR images in the space to be recorded, but may set to pay a predetermined admission fee to view a specific room. It is also possible to set a fee to view data on objects or spaces that exist within. A user may obtain additional income by inserting an advertisement into a specific object or space displayed in the VR image, and may record a message he/she wants on a specific object or space. In addition, a user may access other users' integrated spatial data contents and leave his own memo, sound file, video file, and visit record for a specific object or space.

The business execution unit 140 may perform a role of allowing a user to conveniently receive various services for the recording target space registered by the user.

When a user wants to receive a specific product or service for a business registered by the user, the business execution unit 140 makes a request for disclosure of a specific business, and the business performer terminal 300 provides the corresponding service. The facts can be provided in the form of notifications and users' VR integrated contents can be disclosed.

The business performer checks the VR integrated content disclosed by the user and the content of the product or service that the user wants to be provided, and delivers the content and conditions of the product or service that the user can provide to the user through the management server 100. I can make a suggestion.

According to another embodiment of the present invention, before a user requests a necessary product or service in relation to his or her recording target space, a business performer looks at the integrated spatial data contents published by the user and provides a product or It is also possible to perform a proposal for a service first.

The business execution unit 140 may play a role of connecting a user who has registered the recording target space and a business performer who provides products or services to the recording target space, and in the process, You can adjust the disclosure range of the integrated spatial data content.

The block chain management unit 150 may manage at least a part of data on a recording target space included in the integrated spatial data content through blockchain technology. The data managed by the blockchain management unit 150 through the blockchain technology may include data collected through the user terminal 200 for the recording target space registered by the user and data extracted through a VR image registered by the user. . Blockchain is a technology that simultaneously copies and stores data to numerous computers or servers without storing data in a centralized manner.It is characterized by storing data in blocks and connecting them in a chain form. Blockchain technology is a technology that makes it difficult to forgery or alter data by sharing and collating the information by individual servers that store data, that is, nodes called nodes, whenever data changes occur.

If this is applied to the present invention, the block chain management unit 150 may send the details to all the block chain nodes to update each time information on a specific recording target space is newly registered or modified.

According to an embodiment of the present invention, the block chain management unit 150 manages a part such as a VR image that occupies a large amount of data in the management server 100, and other information related to the recording target space uses a block chain technology. Can be managed. In order to include all of the VR image data and insert it into the blockchain, the capacity of the blockchain is increased and the speed at which the blockchain operates can be significantly reduced, so the application of this technology is possible. For example, a part related to an image is managed by the management server 100, but information related to a recording target space recognized in the corresponding image may be managed within the blockchain.

The blockchain management unit 150 may support transactions of users who use the integrated management platform for spatial information to be recorded by using cryptocurrency generated through such a blockchain technology. According to an embodiment, payments in various transactions supported by the above-described business execution unit 140 may be made through cryptocurrency, and a user who registers the recording target space can transfer his or her integrated space data contents to other users. The rewards that can be obtained by revealing to them can also be cryptocurrency.

The blockchain management unit 150 may allow the user to use the integrated spatial data contents of other users through the cryptocurrency obtained as a reward for the disclosure of the user's integrated spatial data contents. A specific user can freely use the integrated spatial data content released by other users for free, but may have to pay cryptocurrency to view all or part of the integrated spatial data content set for a fee by other users. According to an embodiment, the reward obtained by publishing one's integrated spatial data content may be configured in the form of a coin or token, and a user pays the coin or token that he or she acquired, so that other users You can browse the integrated spatial data contents set for a fee. Coins or tokens can be obtained in various ways, and users will be able to purchase them with real money. Users can receive various additional services provided by the integrated management platform for spatial information to be recorded with coins or tokens purchased or acquired. For example, a user can insert additional functions into his or her integrated spatial data content through purchased or acquired coins, and may use functions that exist inside the integrated spatial data content of other users.

The communication unit 160 enables the management server 100 to perform communication between the user terminal 200 and the business operator terminal 300. Specifically, the management server 100 may perform data communication with the user terminal 200 and the business operator terminal 300 through the communication unit 160 to perform the operation of the above-described recording target spatial information integrated management platform. . As described above, communication between them may be performed through a communication network implemented in various ways. In addition, according to an embodiment, the communication unit 160 may perform a role of allowing the management server 100 to communicate with a plurality of blockchain nodes.

The control unit 170 includes a recording target spatial information collection unit 110, a masking processing unit 120, a stitching processing unit 122, an object recognition processing unit 124, a floor plan generation unit 126, and an integrated spatial data content generation unit 130. , It may perform a function of controlling the data flow between the business execution unit 140, the block chain management unit 150 and the communication unit 160. That is, the control unit 170 according to the present invention includes a recording target spatial information collection unit 110, a masking processing unit 120, a stitching processing unit 122, an object recognition processing unit 124, a floor plan generation unit 126, and integrated spatial data. The content creation unit 130, the business execution unit 140, the block chain management unit 150, and the communication unit 160 may each perform a unique function.

9 is a flowchart illustrating a process of operating the integrated management platform for recording target space information according to an embodiment of the present invention.

Referring to FIG. 9, as a first step of using the integrated management platform for recording target space information, a user shoots a target space that he/she wants to record with the VR photographing device 10, and then records a plurality of captured images as a basis of the corresponding recording target space. It can be uploaded to the management server 100 together with the data (S901).

Thereafter, the management server 100 generates a VR image that covers all 360 degrees through stitching of a plurality of images uploaded by the user, analyzes objects and images in the image, and detects images that the user does not want to disclose or sensitive. Masking can be performed (S903).

After performing stitching and masking on the VR image, the management server 100 recognizes objects and spaces in the VR image, extracts and processes information on the recognized object or space, and collects additional information. Can be (S905). The management server 100 may generate integrated spatial data contents by integrating the processed VR image, data related to the recording target space collected from the user, and additionally extracted or collected data (S907).

After the management server 100 generates the integrated spatial data content, it may be determined whether to disclose/disclose the data in the integrated spatial data content according to the setting of the user who registered the recording target space, and the cost of using the integrated spatial data content Whether is paid or free may also be determined (S909). As described above, the user may set only the part he/she wants in the integrated spatial data content for a fee, and may insert an advertisement in the VR image instead of providing the content for free. In addition to advertisements, users can input various data such as text such as memos and messages, sound files, video files, and visit records so that they are included in the integrated spatial data content. The management server 100 may include data input by the user in the integrated spatial data content in association with a corresponding object or space.

When a user requests a specific product or service related to the recording target space registered by the user to the management server 100, the management server 100 may communicate this fact to business performers who conduct business in the relevant field. (S911). Thereafter, business performers can check the information on the recording target space registered by the user by viewing the integrated space data contents, and manage the details and conditions of products or services that can be provided for the recording target space. It can be delivered to users through If the user agrees to the proposal of a specific business performer, a contract is concluded through the management server 100 and service provision may proceed (S913).

As the integrated management platform for recording target space information is used in this manner, a user can comprehensively manage his/her own recording target space information, and can conveniently receive a product or service desired by the user. In addition, business performers who provide various products and services related to the recording target space may obtain an opportunity to check the user's recording target space information and propose a customized product or service.

10 is a flowchart illustrating a method of using a block chain technology by the integrated management platform for spatial information to be recorded according to an embodiment of the present invention.

Referring to FIG. 10, when a user newly registers data for his or her recording target space or modifies existing data, or when the management server 100 recognizes an object or space from a VR image and extracts data for it, When processing and collection are performed, new data to be stored in the blockchain may occur (S1010). When data to be additionally stored using a block chain is generated as described above, the added data may be stored in the form of a block and then additionally combined with the existing block chain (S1020).

Thereafter, the user may execute a contract with a business performer through the management server 100 in order to receive a specific product or service for the recording target space registered by the user (S1030). When the contract is concluded, the process until the contract is concluded, the terms and contents of the contract, and the future progress can be continuously updated on the blockchain (S1040). Thereafter, when the provision of the product or service is completed, payment of the transaction amount may be performed through the cryptocurrency using the corresponding block chain (S1050). On the other hand, depending on the contents of the contract, some or all of the amount may be paid before the provision of products or services is provided.In addition to the progress of the transaction, the payment situation of the transaction price will continue to be displayed on the blockchain. Can be updated.

Since the transaction details and service provision status are continuously recorded on the blockchain, a user or a business performer may check the transaction at any time, even while the transaction is in progress or after the transaction is terminated (S1060). In addition, when a user additionally photographs and registers a VR image after receiving the product and service, it is possible to easily perform a comparison before and after the product and service are provided.

Meanwhile, each execution unit of the management server 100 according to an embodiment of the present invention may also be implemented as a computer-readable code on a computer-readable recording medium. The computer-readable recording medium includes all types of recording devices that store data that can be read by a computer system.

For example, computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, hard disk, floppy disk, removable storage device, and non-volatile memory. And optical data storage devices.

In addition, the computer-readable recording medium can be distributed to a computer system connected through a computer communication network, and stored and executed as code that can be read in a distributed manner.

In the above, embodiments of the present invention have been described with reference to the accompanying drawings, but those of ordinary skill in the art to which the present invention pertains can be implemented in other specific forms without changing the technical spirit or essential features. You can understand. Therefore, the embodiments described above are illustrative in all respects, and should be understood as non-limiting.

10: VR shooting device
11: first lens
12: second lens
21: first image
22: second image
100: management server
110: recording target space information collection unit
120: masking processing unit
122: stitching processing unit
124: object recognition processing unit
126: floor plan generation unit
130: integrated spatial data content generation unit
140: Business Execution Department
150: Blockchain Management Department
160: communication department
170: control unit
200: user terminal
300: business operator terminal

Claims (12)

In a method for operating a platform in which a management server manages information of a target space to be recorded,
Receiving a VR (Virtual Reality) image of a recording target space and basic data about the recording target space from a user terminal;
Analyzing the VR image and performing a masking process on an area within the image including personal information;
Extracting data on a space recognized in the VR image and an object located in the space;
Generating integrated spatial data contents for the recording target space using the VR image of the recording target space, the collected data, and the extracted data; And
Receiving a disclosure request for a specific business from the user terminal, and releasing only some data necessary for the business among the data included in the integrated spatial data content to a business performer terminal,
The step of performing the masking process,
Further comprising determining whether an object or image recognized in the VR image is similar to an image distributed on the Internet in order to determine whether personal information is included in a specific area in the VR image,
The step of extracting data on a space recognized in the VR image and an object located in the space,
The method further comprising the step of confirming whether the object recognized in the VR image is a commercially available product.
The method of claim 1,
The method of operating a platform for managing recording target space information of a management server further comprising the step of generating a plan view of the recording target space through the VR image and including it in the integrated space data content.
The method of claim 1,
The VR image received from the user terminal is characterized in that it comprises a plurality of images photographed in different directions by a plurality of lenses, and further comprising the step of performing stitching on the plurality of images, management server How to operate the integrated management platform for spatial information to be recorded.
The method of claim 1,
Receiving a plurality of VR images for the recording target space from the user terminal, and including a function of adjusting the viewpoint position of the VR image through the plurality of received VR images in the integrated spatial data content, management How to operate the integrated management platform for the spatial information of the server to be recorded.
The method of claim 1,
Receiving selection information on whether to disclose the recording target space to other users from the user terminal, and providing a predetermined reward to the user who selects to disclose the recording target space when the recording target space is disclosed to other users A method of operating the integrated management platform for recording target space information of the management server, further comprising the step of.
The method of claim 1,
Receiving additional information given to each object or space recognized in the VR image from the user terminal, and including it in the integrated spatial data content in association with the object or space, recording of the management server How to operate the target spatial information integrated management platform.
The method of claim 6,
The additional information comprises at least one of information in the form of text, sound, or video.
The method of claim 1,
A method of operating a platform for integrated management of recording target space information of a management server, characterized in that managing data collected through the user terminal and data extracted through the VR image for the recording target space through a blockchain technology.
The method of claim 5,
The compensation is a cryptocurrency generated through a block chain technology that manages the data on the recording target space, characterized in that the management server's recording target space information integrated management platform operating method.
The method of claim 1,
Information on whether to use a partial paid payment model and whether to insert an advertisement in a specific object or space is received from the user terminal as to whether the cost of using the integrated spatial data content is free or paid Further comprising the step of receiving an additional, recording target space information integrated management platform operating method of the management server.
The method of claim 1,
Receiving a request for information on an object recognized in a VR image from a user who requests an inquiry about the integrated spatial data content; And
A method of operating a recording target space information integrated management platform of a management server, further comprising the step of providing data on an object subject to an information request to a user requesting an inquiry.

In the management server that operates a platform for integrated management of the spatial information to be recorded,
A recording target space information collection unit for receiving a VR (Virtual Reality) image of the recording target space and basic data about the recording target space from a user terminal;
A masking processing unit that analyzes the VR image and performs a masking process on an area within the image including personal information;
An object recognition processing unit that extracts data on a space recognized in the VR image and an object located in the space;
An integrated spatial data content generator for generating integrated spatial data content for the recording target space by using the VR image of the recording target space, the collected data, and the extracted data; And
And a business execution unit that receives a request to disclose a specific business from the user terminal and discloses only some data necessary for the business among data included in the integrated spatial data content to a business performer terminal,
The masking processing unit,
To determine whether personal information is included in a specific area in the VR image, it is determined whether an object or image recognized in the VR image is similar to an image circulated on the Internet,
The object recognition processing unit,
A management server, characterized in that it checks whether or not the object recognized in the VR image is a commercially available product.

Images