KR20200034468A - Integrated space information management platform using virtual reality video and operation method thereof - Google Patents

Abstract

Disclosed is an operating method of an integrated recording target space information management platform of a management server. According to various embodiments of the present invention, the operating method of an integrated recording target space information management platform of a management server allows a management server to operate a platform for managing recording target space information in an integrated manner, and comprises: a step of receiving a virtual reality (VR) image for a recording target space and basic data for the recording target space from a user terminal; a step of analyzing the VR image to perform a masking process on an area in an image including personal information; a step of transmitting a VR image on which a masking process is performed to the user terminal, and receiving information for an area on which a masking process needs to be additionally performed from the user terminal; a step of extracting data for a thing or a space recognized in the VR image; a step of using a VR image for a recording target space, collected data, and extracted data to generate integrated space data content for the recording target space; and a step of receiving an opening request for a specific business from the user terminal, and opening data required for the corresponding business in data included in the integrated space data content to a business performer terminal.

Description

INTEGRATED SPACE INFORMATION MANAGEMENT PLATFORM USING VIRTUAL REALITY VIDEO AND OPERATION METHOD THEREOF}

Various embodiments of the present invention relate to an integrated management platform for spatial information using virtual reality images and a method of operating the same, and manage various information including VR images for a specific space that a user of the platform wants to record, and conduct various business through this. It is a technology about a platform that can be grafted and how to operate it.

One of the most important factors in daily life or business in modern society is real estate. Of the three rituals that are essential for people to buy, the most common is the most burdensome in terms of price, and the item that is the most cautious when choosing, and the location, structure, area, rent, etc. of the office are also in business. It is a serious consideration. People sell a lot of products in order to find a place to move or a place to run a new business, and because of the limited time, they are forced to make choices with limited information. Therefore, in such a situation, what people need is detailed information about each real estate.

It is important that not only the person who purchases or rents the property, but also the person who sells or rents the property he owns, and also discloses information about his property to others.

In addition, various businesses related to real estate exist in the market and perform business. In addition to companies directly related to real estate such as real estate agents, various companies such as companies that manage moving, interior companies, and furniture sellers also want to acquire accurate and diverse information about real estate.

In addition, there are people who record information about the property they are currently using and want to use it later. There may be people who want to remember their real estate without forgetting it, and others who want to compare their past real estate information with current real estate information.

Recently, various applications related to real estate have been released, and application users register information on real estate, and other users check this to help perform a business related to the real estate. However, even when using such an application, only a specific type of business was performed among various businesses related to real estate. Accordingly, there is a need for a platform that can comprehensively manage information on real estate and integrate it into various businesses.

In addition, there is a need to perform integrated information management, such as real estate, not limited to such real estate, but also to specific spaces that people want to keep in the record, such as a vehicle such as a car, their yard, and specific tourist destinations.

Domestic registered patent No. 10-1857222

Various embodiments of the present invention have been derived to solve the above problems, and have an object to establish an integrated information management platform for a recording target space.

Another object of the present invention is to integrally support various businesses related to the recording target space through a new platform.

Another object of the present invention is to automatically extract and use data in an image in managing spatial information to be recorded in the form of a VR image.

Another object of the present invention is to improve security in inducing information management for a recording target space and to induce voluntary participation of users.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, an embodiment of the present invention is a method in which a management server operates a platform for integrally managing space information to be recorded, a VR (Virtual Reality) image of a space to be recorded from a user terminal And receiving basic data for the recording target space. Analyzing the VR image and performing masking processing on an area in the image including personal information; Transmitting the VR image on which the masking process has been performed to the user terminal, and receiving information on an area to be additionally masked from the user terminal; Extracting data about an object or space recognized in the VR image; Generating integrated spatial data content for the recording target space using the VR image, the collected data, and the extracted data for the recording target space; And receiving a request to disclose a specific business from the user terminal and publishing data required for the business among data included in the integrated spatial data content to a business performer terminal. It provides an integrated management platform operation method.

The method of operating the integrated management platform for recording target space information of the management server may further include generating a plan view of the recording target space through the VR image and including it in the integrated spatial data content.

The method of operating the integrated management platform for recording target spatial information of the management server is characterized in that the VR image received from the user terminal includes a plurality of images in which different lenses are photographed in different directions, and stitching for a plurality of images. The step of performing (Stiching) may be further included.

The method of operating the integrated management platform for recording target space information of the management server includes a function of receiving a plurality of VR images for a recording target space from the user terminal and adjusting a viewpoint position of the VR video through the received plurality of VR images. It may further include the step of including in the integrated spatial data content.

The method for operating the integrated management platform for recording target space information of the management server receives selection information on whether to disclose the recording target space to other users from the user terminal, and when the recording target space is disclosed to other users The method may further include providing a predetermined reward to a user who has chosen to disclose the space to be recorded.

The method of operating the integrated management platform for spatial information to be recorded by the management server receives additional information given to each object or space recognized in the VR image from the user terminal and associates it with the object or space to integrate the integrated spatial data It may further include the step of including in the content, the additional information may be characterized in that it includes at least one of text, sound or video type information.

The method of operating the integrated management platform for recording target space information of the management server may be characterized in that the data collected through the user terminal and the data extracted through the VR image are managed through the blockchain technology for the recording target space. have.

The method for operating the integrated management platform for recording target space information of the management server may be characterized in that the compensation according to disclosure of the target space is a cryptocurrency generated through a blockchain technology that manages data for the target space.

The method for operating the integrated management platform for recording target spatial information of the management server receives selection information on whether the cost of using the integrated spatial data content is free or paid from the user terminal, and whether to use a partial payment model. The method may further include receiving information about whether to insert an advertisement in a specific object or space.

In order to achieve the above object, another embodiment of the present invention, in a management server operating a platform to integrally manage recording target spatial information, a VR (Virtual Reality) image of the recording target space from a user terminal and the A recording target space information collecting unit that receives basic data about the recording target space; The VR image is analyzed to perform a masking process for an area in the image containing personal information, the VR image on which the masking process has been performed is transmitted to the user terminal, and additional masking processing must be performed from the user terminal A masking processing unit receiving information on an area to be performed; A VR object recognition processing unit for extracting data on objects or spaces recognized in the VR image; An integrated spatial data content generation unit for generating integrated spatial data content for a recording target space using a VR image, collected data and extracted data for the recording target space; A floor plan generator for generating a floor plan of the recording target space through the VR image and including it in the integrated spatial data content; And a business performing unit that receives a request to disclose a specific business from the user terminal and discloses data required for the corresponding business among data included in the integrated spatial data content to a business performer terminal.

According to an embodiment of the present invention, various data and VR images for a recording target space can be recorded and stored in an integrated manner.

According to an embodiment of the present invention, data in a VR image is automatically extracted and analysis and additional data collection can be automatically enabled.

According to an embodiment of the present invention, a user who registers his / her recording target space on the platform can easily receive a product or service related to the recording target space, and those who perform business related to the recording target space also record the target space It is possible to easily perform a proposal of a product or service that can be provided to a user who has registered.

According to an embodiment of the present invention, integrated information management related to a recording target space may be performed using a blockchain technology, thereby improving the security of information and recording target using a cryptocurrency using a blockchain. You can conduct space-related transactions.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a diagram schematically showing an environment in which an integrated management platform for recording target spatial information according to an embodiment of the present invention is operated.
2 is a diagram illustrating a method of operating a VR photographing device according to an embodiment of the present invention.
3 is a view for explaining a method in which stitching for producing a VR image on a management server or a user terminal according to an embodiment of the present invention is performed.
4 is a view for explaining a process in which masking is performed according to an embodiment of the present invention.
5 is a diagram illustrating a process in which a management server according to an embodiment of the present invention generates a floor plan based on a VR image.
6 is a diagram for explaining a process of extracting data about an object or space existing in a VR image by the management server according to an embodiment of the present invention.
7 is a view schematically showing a state in which a management server according to an embodiment of the present invention performs a business related to a recording target space through communication with a plurality of business attendant terminals.
8 is a block diagram schematically showing the configuration of a management server according to an embodiment of the present invention.
9 is a flow chart for explaining a process of operating the integrated management platform for recording target spatial information according to an embodiment of the present invention.
10 is a flowchart for explaining a method of using a blockchain technology in an integrated management platform for spatial information to be recorded according to an embodiment of the present invention.

The terminology used herein is for describing the embodiments and is not intended to limit the present invention. In this specification, the singular form also includes the plural form unless otherwise specified in the phrase. As used herein, “comprises” and / or “comprising” does not exclude the presence or addition of one or more other components other than the components mentioned. Throughout the specification, the same reference numerals refer to the same components, and “and / or” includes each and every combination of one or more of the mentioned components. Although "first", "second", etc. are used to describe various components, it goes without saying that these components are not limited by these terms. These terms are only used to distinguish one component from another component. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical spirit of the present invention.

When a part of the specification "includes" a certain component, this means that other components may be further included instead of excluding other components unless specifically stated otherwise. In addition, terms such as “... unit” and “module” described in the specification mean a unit that processes at least one function or operation, which may be implemented in hardware or software, or a combination of hardware and software. .

In the present specification, the term 'recording space' is a constant space in which the user wants to record data related to the space and shoot with a VR shooting device when the user uses the integrated management platform for the space to record. It may be a real estate like a part, but it may also be a space in a vehicle such as a car. In addition, it may be an external space such as a yard adjacent to one's own building, or may be a space such as a terrace connected to the building. As described above, the recording target space is not limited to a limited space such as a real estate or indoor space, and may be the target space itself having a constant volume desired by the user to record.

The management server disclosed in the present specification provides users with a platform for comprehensively managing various information on a recording target space, and users upload an image of a recording target space that they have taken through a VR shooting device to a management server. In addition, it is possible to register its own recording target spatial data together, and the management server can generate integrated spatial data content based on VR video, data about the recording target space uploaded by the user, and data extracted from the VR video registered by the user. . The generated integrated spatial data content can be inquired by other users and used for various businesses.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings.

1 is a diagram schematically showing an environment in which an integrated management platform for recording target spatial information according to an embodiment of the present invention is operated.

Referring to FIG. 1, a recording target spatial information integrated management platform may be established through communication between the management server 100, the user terminal 200, and the business attendant terminal 300. According to an embodiment of the present invention, blockchain technology may be used in integrating and managing spatial information to be recorded, and in this case, a plurality of blockchain nodes may include a management server 100, a user terminal 200, and a business. Communication with each of the performer terminals 300 may be performed.

According to an embodiment of the present invention, a communication network used by entities in a recording target spatial information integrated management platform to communicate may be configured regardless of its communication mode, such as wired or wireless, for example, a local area network (LAN : Local Area Network (MAN), Metropolitan Area Network (MAN), and Wide Area Network (WAN). Preferably, the communication network according to an embodiment of the present invention may be a known World Wide Web (WWW).

The user terminal 200 and the business attendant terminal 300 according to an embodiment of the present invention are web servers through a network such as a mobile phone, a smart phone, a personal digital assistant (PDA), a portable multimedia player (PMP), a tablet PC, and the like. It may include any kind of handheld-based wireless communication device that can be connected to, and may include a memory means such as a personal computer (eg, desktop computer, laptop computer, etc.), workstation, PDA, web pad, etc. It may be one of digital devices equipped with a microprocessor and equipped with computing power. The handheld-based wireless communication device may also include a wearable device configured as an accessory such as a watch or glasses or various types of clothing and worn or worn by a user.

A user who wants to utilize the integrated management space for recording target space transmits a video of the recording target space that he or she has taken through the VR shooting device to the management server 100 through his user terminal 200 to create a new recording target space. You can register. When registering a new recording target space in the management server 100, the user can transmit basic data about the recording target space to the management server 100 together with the captured VR image. The basic data for the recording target space may include the nature, location, price, area, internal structure, and surrounding infrastructure of the recording target space. For example, a user who wants to register one generation of an apartment that he or she owns has the VR image taken inside the apartment and information that the recording target space that is the object of the uploaded data is the apartment, where the apartment is located You can register data such as address, Dongho Lake, year in which the apartment was built, how many rooms are in the apartment, how big each room is, how many bathrooms are in it, and how it is structured.

The management server 100 integrates the VR image received from the user terminal 200 and the basic data of the recording target space registered by the user, and the corresponding recording target space based on the data extracted from the VR image received from the user terminal. Spatial data content can be generated. In this process, the management server 100 may perform masking or stitching on the VR image. Masking means that sensitive data that can be used as tools to identify an individual by being combined with other public information in an image is treated as invisible, so that a specific object or a certain space can be identified in a VR image. Can be treated as unidentifiable. For example, objects attached to the walls of a home or objects such as a licensed picture frame can be the masking object, and the work on the desk or a monitor on the monitor that was accidentally captured at the time of shooting a VR video is also a masking object. Can be. Most basically, the shooting equipment necessary for shooting a VR image may be the object of masking. Stitching refers to a process in which VR images need to be merged with images taken from multiple shooting lenses. In general, one imaging lens has a limited angle of view, and thus, in order to obtain an image for all directions from a point in time at which imaging is performed, a process of combining images acquired from multiple imaging lenses is required. Stitching is a combination of overlapping parts when the borders of each image are photographed in the same space.

According to an embodiment of the present invention, the management server 100 may extract data about an object or space recognized in a VR image. The management server 100 may perform dataization by identifying what kind of object is recognized in the VR image, what size and shape it is, and where it is located in the photographed space, etc. If the object to be recognized is a commercially available product, it can also grasp what kind of product it is. The management server 100 may perform dataization by grasping what form the space photographed through the VR image has, and to what extent, etc., and may generate a floor plan for the space to be recorded. .

In the management server 100 extracting data about an object or a space recognized in a VR image, artificial intelligence may be used. The management server 100 may operate based on machine learning using artificial intelligence. That is, in the process of the management server 100 performing an operation, the artificial intelligence algorithm may be improved while changing based on the acquired data. The management server 100 can not only change the algorithm through data obtained directly in the process of extracting data about objects or spaces recognized in the VR image, but also based on information registered by the user for the extracted data. You can also change the algorithm.

The management server 100 may generate integrated spatial data content for the corresponding recording target space based on the VR image received in this way, basic data for the recording target space registered by the user, and data extracted from the VR video received from the user terminal. You can. Users with access to the generated integrated spatial data content can acquire VR images and data in the content.

When a user who has registered his / her recording target space has a product or service that he / she wants to purchase for the registered recording target space, the user terminal 200 manages a disclosure request for a specific business that can provide the product or service. The server 100 can be registered. The user may wish to be provided with various products or services related to the recording target space he or she owns or resides in.

For example, a user who plans to move to another home or office prefers to rent or purchase the space to be recorded by other users by accessing the recorded space information registered in order to dispose of his or her home or office first. In this case, it is possible to provide the space information to be recorded to the company performing the authorized brokerage business. In addition, the user who plans to move may want to receive an estimate of the moving center based on the amount of objects currently present in the recording target space. A user who has registered his space for recording may want an estimate from an interior company, and may want to receive recommendations for furniture suitable for his space.

In such a situation, the user selects a company that provides the product or service he or she wants, that is, an authorized broker, a moving company, an interior company, a furniture sales company, etc., and the company conducting the corresponding business integrates into his or her recording target space. Authorization can be provided to access spatial data content. In detail, when a user sends a request to disclose his / her recording target spatial data for a specific business through the user terminal 200 to the management server 100, the management server 100 performs a corresponding business desired by the user The integrated spatial data contents registered by the user may be disclosed to the operator's terminal, that is, the business attendant terminal 300. Through this, operators who perform the business desired by the user who has registered the recording target space acquire the recording target space information necessary to perform the business, and provide the conditions and contents of products or services that they can provide to the business performer terminal ( 300) can be transmitted to the management server 100. The management server 100 may deliver the conditions and contents of the service received from the business performer terminal 300 to the user terminal 200.

According to an embodiment of the present invention, the management server 100 may disclose only some of the data included in the integrated spatial data content for the recording target space registered by the user, when performing a specific business.

Recently, as the collection and analysis of big data has emerged as an important issue for large-scale IT companies, there are an increasing number of companies that desire to collect various types of spatial information to be recorded. Such companies may request data for a recording target space at a desired location through the business performer terminal 300 to the management server 100, and the management server 100 is a user who registers a recording target space existing in the corresponding location This request can be delivered to the user terminal 200 of the. Upon receiving such a request, the user can check the compensation that the companies can provide according to the disclosure of the spatial data to be recorded, and accordingly determine whether to provide his or her recording target spatial data to the corresponding company.

2 is a diagram illustrating a method of operating a VR photographing device according to an embodiment of the present invention.

Referring to FIG. 2, the VR photographing device 10 may include a plurality of lenses. Hereinafter, in the present specification, it is assumed and described that the VR photographing device 10 includes the first lens 11 and the second lens 12, but the scope of the present invention is not limited to this.

The VR photographing device 10 may perform photographing through the included first lens 11 and second lens 12. Each of the first lens 11 and the second lens 12 has a constant angle of view as indicated on the drawing. According to an embodiment of the present invention, the range in which the first lens 11 and the second lens 12 photographs may be changed by rotating the support portion supporting the VR photographing device 10.

According to an embodiment of the present invention, each of the images captured by the first lens 11 and the second lens 12 included in the VR shooting device 10 is a VR shooting device 10 or a user terminal 200 It can be combined into one VR image by stitching on the image. According to another embodiment, after each of the images captured by the first lens 11 and the second lens 12 is transmitted from the user terminal 200 to the management server 100, the two images in the management server 100 It can also be combined into one VR image by stitching.

3 is a diagram for explaining a method in which stitching for producing a VR image is performed on the management server 100 or the user terminal 200 according to an embodiment of the present invention.

As described above, stitching refers to a process of producing a VR image that covers a 360-degree omnidirectional range by combining images captured from multiple photographing lenses.

Referring to FIG. 3, a first image 21 photographed by the first lens 11 and a second image 22 photographed by the second lens 12 of the VR photographing device 10 are illustrated. . According to one embodiment, the first lens 11 and the second lens 12 may be composed of a wide-angle lens, the first image 21 and the second image 22 photographed through the wide-angle lens are respectively It can appear in the form of a sphere.

According to an embodiment of the present invention, each of the first lens 11 and the second lens 12 may have an angle of view of 180 degrees or more in opposite directions to each other and may perform shooting. In this case, overlapping portions may occur in the first image 21 and the second image 22. In FIG. 3, the A region of the first image 21 and the A region of the second image 22 may represent the same space, and the B region of the first image 21 and the B region of the second image 22 This can represent the same space. In this case, stitching is performed on the two A regions, and similarly, stitching is also performed on the two B regions to generate a VR image showing 360 degrees. Such stitching may be performed by the VR imaging device 10, the user terminal 200, or the management server 100.

4 is a view for explaining a process in which masking is performed according to an embodiment of the present invention.

Referring to FIG. 4, a VR image captured by a user in a recording target space is disclosed. The management server 100 may extract data on an object or a space recognized within a VR image registered by a user, and when the recognized object includes data such as personal information, masking processing of the object By doing so, it is possible to prevent the object from being identified.

According to an embodiment of the present invention, even if an image related to personal information is not included in the VR image, when the stimulating adult content or harmful content is included in the VR image, the management server 100 includes such content A masking process may be performed on a portion displayed in the image.

Referring to FIG. 4, a picture containing personal information is located in a picture frame hanging on the wall, indicating a situation in which the management server 100 recognizes this and performs masking.

According to an embodiment of the present invention, the management server 100 may perform masking on a specific object, space, or image through analysis of an object or image recognized in a VR image, and may The user who uploaded the VR image to the management server 100 can control the degree to which masking is performed through his user terminal 200. For example, the management server 100 performs masking on data that can be identified by an individual, and the user sets to perform masking on pictures of himself and his family, but the bookshelf he holds in the VR image Masking can be set to not be performed on the list of books in the book.

According to an embodiment of the present invention, in analyzing an object or image recognized in a VR image, the management server 100 determines how similar the object or image is to an image distributed on the Internet, and the object or image is If it is determined that it does not contain personal information, masking may not be performed. For example, in the case where a picture inside a frame decorated on a wall in a VR image is a family picture, the management server 100 may perform masking thereon, but when the picture inside the frame is a picture of a celebrity There is, the management server 100 may grasp this and may not perform masking on the corresponding photo.

According to an embodiment of the present invention, the management server 100 may request the user's confirmation of the VR image that is primarily masked. Even if the management server 100 performs the masking of the VR image through the masking algorithm, the user's confirmation request may be a complementary measure for such a possibility, since the complete processing may not have been performed. The management server 100 may transmit the VR image on which the masking process has been performed to the user terminal 200 and receive information on an area to be additionally masked from the user terminal 200. The user checks the VR image on which the masking is performed through his user terminal 200, selects a specific object or a certain area in the image, and transmits selection information to the management server 100, so that the management server 100 Masking for additional areas may be performed.

5 is a diagram illustrating a process in which the management server 100 according to an embodiment of the present invention generates a floor plan based on a VR image.

According to an embodiment of the present invention, the management server 100 may generate a plan view of a recording target space registered by a user based on at least one VR image and include it in the integrated spatial data content.

Referring to FIG. 5, the management server 100 may receive at least one VR image from the user terminal 200, and in FIG. 5, it is assumed that the number is four. The management server 100 may analyze a plurality of images, recognize a portion photographing the same area in each image, grasp the overall shape of the recording target space registered by the user, and generate a floor plan through the identified portion.

Looking at how the management server 100 generates a floor plan, grasps features such as wall and ground intersections, wall and wall intersections, and the like, based on such features in the image of the room included in a plurality of VR images. Can generate

The management server 100 according to an embodiment of the present invention is capable of extracting various data from source data for an offline space such as a VR image, not only generating a floor plan of a recording target space registered by a user based on the VR image. have. For example, the management server 100 may extract various survey data from a VR image that is a source data. The survey data may include the length, width, and volume of various objects or spaces displayed in the VR image. As described above, the management server 100 may perform real virtualization, which is a task of generating new virtual data such as floor plans and survey data from VR images, which are raw data recorded offline. As the integrated spatial information management platform for recording object disclosed by the present invention supports real virtualization, the user can easily manage the record of reality in the form of electronic data.

FIG. 6 is a diagram for explaining a process in which the management server 100 according to an embodiment of the present invention extracts data on an object or space existing in a VR image.

Referring to FIG. 6, one VR image is displayed and various types of objects are displayed in the corresponding image. As described above, the masking process may be performed on a specific object or area. The management server 100 may recognize each object and extract data about the object. Thereafter, the management server 100 may include data for each object in the integrated spatial data content. Data on such objects may be provided to a company providing a business related to the object in the future.

As described above, the management server 100 may check whether a product recognized in a VR image is a commercially available product through data collection using a database or a communication network of its own, which product is identified, and the exact product name is specified. Even if not, the type of the object may be determined through the form of the object. On the other hand, for objects that are difficult to be specified by the management server 100, the user directly enters what kind of object the object is and the purpose and size of the object through the user terminal 200. It might be.

In addition, the management server 100 operating through machine learning-based artificial intelligence may develop an algorithm for extracting an object or an image existing in a VR image as data scales. The change of the algorithm may be performed by data generated in the extraction process, or by data input by the user. For example, when the management server 100 repeatedly recognizes and extracts a specific object as an error, if the user inputs feedback, the algorithm may change in the direction of reducing an error related to the object based on this. .

7 is a diagram schematically showing a state in which a management server 100 according to an embodiment of the present invention performs a business related to a recording target space through communication with a plurality of business attendant terminals 300.

Referring to FIG. 7, the management server 100 performs communication with a plurality of business attendant terminals 300 so that various products or services related to a recording target space registered by a user can be provided, and attracts customers to business performers It can provide an opportunity to do so.

In the example of FIG. 7, it has been shown that the management server 100 communicates with business performer terminals 300 used by authorized brokers, moving companies, interior companies, furniture stores, and IT companies.

According to an embodiment, the user who registers the recording target space on the management server 100 requests the disclosure of a specific business when the user wants to receive a specific product or service for the recording target space. Through the can be transmitted to the management server 100. The management server 100, after receiving such a disclosure request, is a business performer terminal corresponding to data required to perform a corresponding business among contents included in the integrated spatial data content generated for a recording target space registered by a user About 300. In this process, the user can register the content of the product or service information he or she wants to receive for the record target space registered by the management server 100, and the business practitioner who has confirmed it checks the content registered by the user and By entering the contents and conditions of the service, it is possible to propose to the user to purchase their product or service.

For example, when the user wants to perform remodeling on the recording target space registered by the user, the user can input the scope, direction, and budget of the remodeling he / she wants to the management server 100 together with the above facts. . The management server 100 provides the authority to view the integrated spatial data content for the recording target space of the user who wants to remodel the terminal of the users registered as the interior company on the server, that is, the business performer terminal 300. can do. In this process, the management server 100 may transmit information such as the scope, direction, and budget of the remodeling registered by the user to the business performer terminal 300, and among the data included in the integrated spatial data content, there is no interior related, The right to view data that the user does not want to disclose may prevent the business attendant terminal 300 from obtaining it.

According to an embodiment of the present invention, a user who registers his / her recording target space on the management server 100 can disclose integrated spatial data content generated based on the VR image he / she registered to other users or companies. , The user can select whether to disclose for each data included in the integrated spatial data content, and select which users or companies to disclose each data to. In addition, the user may obtain a reward appropriate to the degree of disclosure of his integrated spatial data content. That is, the user can transmit to the management server 100 whether to choose whether to disclose the integrated spatial data content for his recording target space to other users through the user terminal 200, and his recording target space When disclosed to other users, a certain reward can be obtained. Such compensation may be provided in the form of a cryptocurrency to which the blockchain technology to be described later is applied.

8 is a block diagram schematically showing the configuration of the management server 100 according to an embodiment of the present invention.

Referring to FIG. 8, the management server 100 includes a recording target spatial information collection unit 110, a masking processing unit 120, a stitching processing unit 122, an object recognition processing unit 124, a floor plan generation unit 126, and an integrated space It may be configured to include a data content generation unit 130, a business execution unit 140, a blockchain management unit 150, a communication unit 160, and a control unit 170.

 The recording target space information collecting unit 110 may perform a role of receiving and collecting a VR image for a recording target space and basic data for a corresponding recording target space from the user terminal 200. Further, the recording target space information collecting unit 110 may collect the information of the recording target space from the server of the Internet or another company based on the basic information of the recording target space collected from the user. For example, when the user inputs the correct name and location information of the recording target space, the recording target space information collecting unit 110 collects data disclosed on the Internet for the corresponding recording target space or for the corresponding recording target space. Data can be collected by accessing the server that holds the information.

The recording target spatial information collecting unit 110 also receives additional information about the object or space recognized by the object recognition processing unit 124 to be described later in the VR image from the user terminal 200 and includes it in the integrated spatial data content. I can do it.

The masking processing unit 120 may recognize data, adult content, or harmful content that can identify an individual in combination with itself or other public information in a video within a VR video and process it through a masking algorithm. In addition to automatically performing masking through an algorithm, the masking processing unit 120 may also perform masking on an object or a specific area in an image selected by a user.

The stitching processing unit 122 may edit a plurality of images into a single VR image covering a 360 degree range by recognizing the same portion from a plurality of images registered by a user and performing a process of combining the portions. As described above, stitching may be performed on the VR imaging device 10 or the user terminal 200 used by the user, but the user manages the image captured by the plurality of lenses included in the VR imaging device 10 as it is. In the case of transmitting to the server 100 and requesting VR image generation through the same, the stitching processing unit 122 of the management server 100 may combine a plurality of images into a single VR image through stitching.

The object recognition processing unit 124 may serve to extract data on objects recognized in the VR image. The object recognition processing unit 124 may later connect a business related to the object to the user based on the data on the object, or provide information about the object to other users using the integrated spatial data content. have. For example, when a user A sees a VR video of a recording target space owned by B using the integrated spatial data content registered by the user B, user A finds the interior accessory desired in the video. Information on the interior accessory can be obtained by requesting the management server 100. This may be a function that is possible because the management server 100 extracts and stores data about the object using the object recognition processing unit 124.

The floor plan generating unit 126 may serve to generate a 2D floor plan for the corresponding recording target space based on at least one VR image registered by the user in the management server 100 for the specific recording target space.

The floor plan generating unit 126 identifies features included in a plurality of VR images, that is, a portion where a wall surface and a floor surface are connected, a portion where a wall surface and another wall surface are connected, a portion where a wall surface and a ceiling are connected, and the like, based on the floor plan. Can be created. In addition, it is possible to connect the parts of the floor plan generated through a part that is commonly included in a plurality of VR images, and through this, it is possible to generate an overall 2D floor plan for an area appearing in a VR image captured by a user. The generated floor plan may be included in the integrated spatial data content.

The integrated spatial data content generating unit 130 retrieves and extracts and processes the VR image and basic data registered by the user for his or her recording target space, and the processed and extracted data based on the image and data registered by the management server 100 by the user. Through this, it is possible to generate integrated spatial data content based on the related data collected.

The generated integrated spatial data content may include at least one VR image for a specific recording target space, and a user watching the VR video may rotate the viewpoint at a fixed position and watch the state of the recording target space in the form of an image. have. In addition, when VR images photographed from a plurality of locations are included in the integrated spatial data content, a user watching a VR image manipulates a viewpoint as if he or she moves the location and views the space of a recording target at a desired viewpoint. It might be. That is, when a plurality of VR images for a recording target space are received from the user terminal 200, the management server 100 provides a function of adjusting the viewpoint position of the VR images through the received VR images in the integrated spatial data content. Can be included. In addition, the integrated spatial data content may include information on the recording target space registered by the user, information collected on the recording target space in the management server 100, information on various objects and spaces recognized in the VR image, and the like. You can. A user watching a VR image may browse information about the space or object by selecting a specific space or object in the VR image.

The integrated spatial data content generation unit 130 may also generate statistical data from VR images and specific spatial related data and include it in the integrated spatial data content. Statistical data may include patterns of data registered by a plurality of users in generating integrated spatial data content, patterns of data extracted from VR images, and patterns of users using integrated spatial data content.

Users using the integrated management space for recording target information can access the management server 100 through their terminals to access the integrated spatial data contents for the recording target spaces to which they have access. Users using the integrated spatial data content can view the data contained in the integrated spatial data content within their own authority.

According to an embodiment of the present invention, a user who registers the image and data of his / her recording target space can set the public scope of the integrated spatial data content generated based on it in the management server 100, and the integrated spatial data content may be different. Users can choose whether the price they use is free or paid. The user can select whether the cost of using the integrated spatial data content is paid or free, and transmit the selected information to the management server 100 through the user terminal 200, and the partial paid payment model within the integrated spatial data content It is possible to select whether to use and whether to insert an advertisement in a specific object or space and transmit the corresponding selection information to the management server 100.

For example, it is free for a user to view most of the VR videos in his / her recording target space, but it can be set to pay a certain viewing fee to access a specific room, and the entire VR video is free to view, but the space is free. It is also possible to set a fee for viewing data on objects or spaces existing therein. The user may acquire additional income by inserting an advertisement in a specific object or space displayed in the VR image, or may record a message desired by the user in a specific object or space. In addition, the user may leave their own memo, sound file, video file, and visit history for a specific object or space by accessing the integrated spatial data content of another user.

The business execution unit 140 may perform a role of allowing the user to conveniently receive various services for the recording target space registered by the user.

The business execution unit 140, when a user performs a public request for a specific business when he / she wants to receive a specific product or service for the business registered by the user, such as the business performer terminal 300 providing the corresponding service It can provide facts in the form of notifications and disclose users' VR integrated contents.

The business operator confirms the contents of the VR integrated contents disclosed by the user and the products or services the user wants to receive, and delivers the contents and conditions of the products or services that the user can provide to the user through the management server 100 You can make suggestions.

According to another embodiment of the present invention, before a user requests a required product or service in relation to his / her recording target space, a business attendant may look at the integrated spatial data content disclosed by the user and provide a product or product that he or she can provide. You can also make a proposal for the service first.

The business execution unit 140 may connect a user who has registered the recording target space and a business attendant who provides a product or service for the recording target space, and in the process, the user It is possible to adjust the disclosure range of the integrated spatial data content.

The blockchain management unit 150 may manage at least a part of data on the recording target space included in the integrated spatial data content through blockchain technology. The data managed by the blockchain management unit 150 through the blockchain technology may include data collected through the user terminal 200 and the data extracted through the VR image registered by the user for the recording target space registered by the user. . Blockchain is a technology that simultaneously copies and stores data on numerous computers or servers without storing it in a centralized manner.It is characterized by storing data in blocks and connecting them in a chain. Blockchain technology is a technology that makes it difficult to forge or falsify data by sharing and contrasting the information of each participant called a node, that is, an individual server that stores data whenever data changes.

When this is applied to the present invention, the blockchain management unit 150 may update the information on a specific recording target space by sending the corresponding details to all blockchain nodes whenever it is newly registered or modified.

According to an embodiment of the present invention, the blockchain management unit 150 manages a portion, such as a VR image, which occupies a large amount of data, within the management server 100, and other record-related space-related information utilizes blockchain technology. Can be managed. If you want to insert all of the VR video data into the blockchain, the capacity of the blockchain increases, so the speed of operation of the blockchain can be significantly reduced, so it is possible to apply this technology. For example, the portion related to the image is managed by the management server 100, but information related to the recording target space recognized in the image can be managed in the blockchain.

The blockchain management unit 150 can support transactions of users using the integrated management platform for spatial information to be recorded by utilizing cryptocurrency generated through such a blockchain technology. According to an embodiment, payment of payment in various transactions supported by the above-described business execution unit 140 may be performed through cryptocurrency, and a user who registers a recording target space can use his / her integrated spatial data content to other users. Rewards that can be earned by making them public can also be cryptocurrencies.

The blockchain management unit 150 may allow a user to use the integrated spatial data content of another user through a cryptocurrency obtained as a reward for disclosing his integrated spatial data content. Certain users can freely use the integrated spatial data contents that other users have released for free, but they may have to pay cryptocurrency to view all or part of the integrated spatial data contents set by other users for a fee. According to an embodiment, rewards obtained by publishing their integrated spatial data content may be configured in the form of a coin or token, and the user may receive other coins by paying the coin or token obtained by the user. You can browse the integrated spatial data contents set for a fee. Coins or tokens can be obtained in various ways, and users can also purchase them in real money. The user may be provided with various additional services provided by the integrated management platform for spatial information to be recorded with coins purchased or acquired. For example, a user may insert additional functions into his or her integrated spatial data content through purchased or acquired coins, or may use a function existing in the integrated spatial data content of another user.

The communication unit 160 allows the management server 100 to perform communication between the user terminal 200 and the business attendant terminal 300. Specifically, the management server 100 may perform the operation of the above-described spatial information integrated management platform for recording by performing data communication with the user terminal 200 and the business attendant terminal 300 through the communication unit 160. . As described above, communication between them may be achieved through a communication network implemented in various ways. In addition, according to an embodiment, the communication unit 160 may serve to allow the management server 100 to communicate with a plurality of blockchain nodes.

The control unit 170 includes a recording target spatial information collection unit 110, a masking processing unit 120, a stitching processing unit 122, an object recognition processing unit 124, a plan view generation unit 126, and an integrated spatial data content generation unit 130 , It can perform the function of controlling the data flow between the business execution unit 140, the blockchain management unit 150 and the communication unit 160. That is, the control unit 170 according to the present invention includes a spatial information collection unit 110 for recording, a masking processing unit 120, a stitching processing unit 122, an object recognition processing unit 124, a floor plan generation unit 126, and integrated spatial data The content generation unit 130, the business execution unit 140, the blockchain management unit 150, and the communication unit 160 may control each to perform a unique function.

9 is a flow chart for explaining a process of operating the integrated management platform for recording target spatial information according to an embodiment of the present invention.

Referring to FIG. 9, a user first photographs a target space that he or she wants to record with a VR photographing device 10 as a first step using an integrated management platform for recording target space information, and then records a plurality of photographed images as a basis of the corresponding recording target space. The data may be uploaded to the management server 100 together with the data (S901).

Thereafter, the management server 100 generates a VR image covering 360 degrees omnidirectional through stitching on a plurality of images uploaded by a user, analyzes objects and images in the image, and analyzes objects and images in the image to prevent sensitive or sensitive images from being disclosed by the user. The masking may be performed (S903).

After performing the stitching and masking of the VR image, the management server 100 recognizes objects and spaces existing in the VR image, extracts, processes information about the recognized objects or spaces, and collects additional information. You can (S905). The management server 100 may generate integrated spatial data contents by integrating the processed VR image and data related to the recording target space collected from the user, and additionally extracted or collected data (S907).

After the management server 100 generates the integrated spatial data content, whether to disclose / disclose the data in the integrated spatial data content may be determined according to the setting of the user who registered the recording target space, and the cost of using the integrated spatial data content Whether it is paid or free may be determined (S909). As described above, the user may set only a portion of the integrated spatial data content that he or she wants for a fee, and may insert an advertisement in the VR video instead of providing the content for free. The user can input various data such as texts, sound files, video files, and visit records such as memos and messages as well as advertisements so that they are included in the integrated spatial data content. The management server 100 may include data input by the user in the integrated spatial data content in association with a corresponding object or space.

When a user requests a specific product or service related to the recording target space registered by the user to the management server 100, the management server 100 may notify the fact to the business practitioners performing business in the field. (S911). Subsequently, business attendants can check information about the space to be recorded by the user by viewing the integrated spatial data content, and the management server 100 controls the details and conditions of products or services that can be provided for the space to be recorded. Can be delivered to the user. If the user agrees with the offer of a specific business performer, a contract may be established through the management server 100 and service provision may proceed (S913).

As the integrated spatial information management platform for recording targets is used in this way, a user can manage his / her own spatial information for recording, and can conveniently receive the product or service he / she wants. In addition, business practitioners who provide various products and services related to the recording target space may obtain an opportunity to check the user's recording target space information and propose a customized product or service.

10 is a flowchart for explaining a method of using a blockchain technology in an integrated management platform for spatial information to be recorded according to an embodiment of the present invention.

Referring to FIG. 10, when a user newly registers data for his / her recording target space or modifies existing data, or the management server 100 recognizes an object or space from a VR image and extracts data about it, When processing and collection are performed, new data to be stored in the blockchain may occur (S1010). When data to be stored is additionally generated using the blockchain, the added data may be stored in the form of a block, and then additionally coupled to an existing blockchain (S1020).

Thereafter, the user may perform a contract with a business attendant through the management server 100 in order to receive a specific product or service for the space to be recorded by the user (S1030). When the contract is concluded, the process until the contract is concluded, the conditions and contents of the contract, and future progress can be continuously updated on the blockchain (S1040). Thereafter, when the provision of the product or service is completed, payment of the transaction amount may be performed through a cryptocurrency using the corresponding blockchain (S1050). On the contrary, depending on the contents of the contract, some or all of the amount may be paid before the provision of the product or service is provided, and as well as the progress of the transaction, the payment of the transaction price like this continues on the blockchain It can be updated.

Since the transaction history and the service provision status are continuously recorded on the blockchain, the user or the business operator may be able to confirm this at any time even while the transaction is in progress or even after the transaction is terminated (S1060). In addition, when a user additionally shoots and registers a VR video after receiving a product and service, it is possible to easily perform a comparison between before and after the product and service are provided.

Meanwhile, each execution unit of the management server 100 according to an embodiment of the present invention may also be embodied as computer readable codes on a computer readable recording medium. The computer-readable recording medium includes all kinds of recording devices in which data readable by a computer system is stored.

For example, a computer-readable recording medium includes ROM, RAM, CD-ROM, magnetic tape, hard disk, floppy disk, removable storage device, and non-volatile memory (Flash Memory). , Optical data storage, and the like.

In addition, the computer-readable recording medium may be distributed over computer systems connected by a computer communication network, and stored and executed as code readable in a distributed manner.

The embodiments of the present invention have been described above with reference to the accompanying drawings, but a person skilled in the art to which the present invention pertains may implement the present invention in other specific forms without changing its technical spirit or essential features. You will understand. Therefore, it should be understood that the above-described embodiments are illustrative in all respects and not restrictive.

10: VR shooting device
11: first lens
12: second lens
21: first video
22: second video
100: management server
110: spatial information collection unit to be recorded
120: masking processing unit
122: stitching processing unit
124: object recognition processing unit
126: floor plan generator
130: integrated spatial data content generating unit
140: business executive
150: Blockchain management department
160: communication unit
170: control unit
200: user terminal
300: business attendant terminal

Claims (11)

In the method of operating a platform for the management server to collectively manage the space information to be recorded,
Receiving a VR (Virtual Reality) image for a recording target space and basic data for the recording target space from a user terminal;
Analyzing the VR image and performing masking processing on an area in the image including personal information;
Transmitting the VR image on which the masking process has been performed to the user terminal, and receiving information on an area to be additionally masked from the user terminal;
Extracting data about an object or space recognized in the VR image;
Generating integrated spatial data content for the recording target space using the VR image, the collected data, and the extracted data for the recording target space; And
Receiving a request to disclose a specific business from the user terminal and releasing data required for the business among the data included in the integrated spatial data content to a business performer terminal, recording target spatial information integration of the management server How the management platform operates.
According to claim 1,
And generating a plan view of the recording target space through the VR image and including it in the integrated spatial data content.
According to claim 1,
The VR image received from the user terminal is characterized by including a plurality of images in which a plurality of lenses are taken in different directions, and further comprising a step of performing stitching on the plurality of images, the management server How to operate the spatial information integrated management platform for recording targets.
According to claim 1,
The method further includes receiving a plurality of VR images for a space to be recorded from the user terminal and including a function of adjusting a viewpoint position of a VR image through the received plurality of VR images in the integrated spatial data content. How to operate the server's recordable spatial information integrated management platform.
According to claim 1,
Receiving selection information on whether to disclose the space to be recorded to other users from the user terminal, and providing a user with a predetermined reward when the space to be recorded is disclosed to other users The method further comprising the step of operating a management server's recording target spatial information integrated management platform.
According to claim 1,
And receiving additional information given to each object or space recognized in the VR image from the user terminal and including it in the integrated spatial data content in association with the object or space. How to operate the target spatial information integrated management platform.
The method of claim 6,
The additional information includes at least one of information in the form of text, sound, or video, and a method for operating an integrated management platform for recording target spatial information of a management server.
According to claim 1,
A method of operating an integrated management platform for recording target spatial information of a management server, characterized in that the data collected through the user terminal and the data extracted through the VR image are managed through the blockchain technology for the recording target space.
The method of claim 5,
The compensation is a cryptocurrency generated through a blockchain technology that manages data for the space to be recorded, the management server's method of operating the integrated space for recording information in the management server.
According to claim 1,
Information on whether to receive the selection information on whether the cost of using the integrated spatial data content is free or paid from the user terminal, whether to use a partial paid payment model, and whether to insert an advertisement in a specific object or space. The method further comprising the step of receiving additionally, the method for operating the integrated management platform for recording target spatial information of the management server.
In the management server operating a platform for managing the spatial information to be recorded,
A recording target space information collecting unit which receives a VR (Virtual Reality) image of a recording target space and basic data about the recording target space from a user terminal;
The VR image is analyzed to perform a masking process for an area in the image containing personal information, the VR image on which the masking process has been performed is transmitted to the user terminal, and additional masking processing must be performed from the user terminal A masking processing unit receiving information on an area to be performed;
A VR object recognition processing unit for extracting data on objects or spaces recognized in the VR image;
An integrated spatial data content generation unit for generating integrated spatial data content for a recording target space using a VR image, collected data and extracted data for the recording target space;
A floor plan generator for generating a floor plan of the recording target space through the VR image and including it in the integrated spatial data content; And
And a business performing unit that receives a request to disclose a specific business from the user terminal and discloses data required for the corresponding business among data included in the integrated spatial data content to a business performer terminal.

Images