KR102361663B1 - Method for determining purpose of building in a user-participating recognition platform using aritificial intelligence and apparatus therefore - Google Patents

Abstract

Disclosed are a method and apparatus for identifying the use of a building using an aerial photograph and street image analysis based on artificial intelligence object recognition. In accordance with an embodiment of the present invention, there is provided a method for identifying a building use based on artificial intelligence object recognition, the method comprising: analyzing an aerial photograph of a target area and detecting at least one target building included in the aerial photograph; receiving a street image corresponding to the location information based on the detected location information of the target building; analyzing the street image to detect the target building from the street image; and detecting an object attached to the target building, recognizing characters included in the detected object, and confirming the use of each of the target buildings.

Description

A method and device for identifying the use of a building in a user-participatory recognition platform using artificial intelligence

The present invention relates to a technology for identifying the use of a building using aerial photo analysis and street image analysis. It relates to a grasping method and an apparatus therefor.

In general, a geographic information system (GIS) refers to a computer-based system that uses and manages geographic data to solve problems related to space. When GIS was first developed in the early 1960s, GIS was nothing more than a computer-based program for processing map data. However, today, GIS is not only positioned as an important academic research field by itself, but is being actively applied to various sectors of society as it is combined with the latest information technology.

The basic characteristic of GIS is that it can handle attribute information related to the location of objects in spatial, ie, geographic space. Maps are the most efficient way to represent the locations and properties of spatially distributed objects. Therefore, the most basic data in GIS construction is a digital map. Numerical maps can be said to be indexed by interpreting and numerically editing various topographical data obtained from survey maps, aerial photos, and satellite images, unlike classic paper maps.

The numerical map construction process is completed through several processes as follows. First, the paper map is digitized or scanned to form a numerical map, and then various input errors are corrected. Then, after transforming into an actual coordinate system to meet the user's purpose through coordinate transformation, a topological structure is established for understanding the mutual location and correlation between spatial objects. Thereafter, attribute data related to each figure data is input to the numerical map that has undergone the establishment of the topological structure.

Numerical maps produced in this way enable faster and more accurate map search than paper maps, and are superior in information management and usability to support various planning and decision-making more effectively.

Embodiments of the present invention provide a method and apparatus for determining the use of a building that can determine the use of a building by analyzing an aerial photograph and a street image based on artificial intelligence object recognition.

In accordance with an embodiment of the present invention, there is provided a method for identifying a building use based on artificial intelligence object recognition, the method comprising: analyzing an aerial photograph of a target area and detecting at least one target building included in the aerial photograph; receiving a street image corresponding to the location information based on the detected location information of the target building; analyzing the street image to detect the target building from the street image; and detecting an object attached to the target building, recognizing characters included in the detected object, and confirming the use of each of the target buildings.

The step of detecting the target building in the street image includes removing the remaining parts other than the target building and the object from the street image using a preset segmentation technique, and confirming the use of each target building. by recognizing a character included in the detected object using a preset character recognition technique, may identify the use of the target building based on the recognized character.

In the step of confirming the use of each of the target buildings, when the business name is recognized through the recognition of the characters included in the object, the use of the target building is confirmed through the business name, and the call is made through the recognition of the characters included in the object. When the number is recognized, the use of the target building can be confirmed by searching for a business name using the phone number.

Furthermore, the method for determining the use of a building according to an embodiment of the present invention includes at least one of the location information of each of the target buildings, the use of each of the target buildings, the company occupied in the target building, the business name of the company, and the phone number of the company The method may further include providing information on use of each of the target buildings including one.

An apparatus for determining a building use according to an embodiment of the present invention is an apparatus for identifying a building use based on artificial intelligence object recognition, an aerial photograph for analyzing an aerial photograph of a target area to detect at least one target building included in the aerial photograph analysis department; a distance image analyzer configured to receive a street image corresponding to the location information based on the detected location information of the target building, and analyze the street image to detect the target building from the street image; and a use confirmation unit that detects an object attached to the target building, recognizes characters included in the detected object, and confirms the use of each of the target buildings.

The distance image analysis unit removes the remaining parts other than the target building and the object from the street image using a preset segmentation technique, and the usage confirmation unit applies a preset character recognition technique to the detected object. By recognizing the included characters, the use of the target building may be confirmed based on the recognized characters.

The use confirmation unit confirms the use of the target building through the business name when a business name is recognized through recognition of characters included in the object, and when a phone number is recognized through recognition of characters included in the object, the phone number By searching for a business name using a number, the use of the target building can be confirmed.

Furthermore, the device for determining the use of a building according to an embodiment of the present invention includes at least one of the location information of each of the target buildings, the use of each of the target buildings, the company occupied in the target building, the business name of the company, and the phone number of the company It may further include an information providing unit for providing information on the use of each of the target buildings including one.

According to embodiments of the present invention, since the purpose of a building can be determined by analyzing an aerial photograph and a street image based on artificial intelligence object recognition, the actual use of a specific building and a company occupied by the building can be known.

The present invention can be used for various services such as urban planning and real estate commercial area analysis, and the information identified through the present invention can be provided to government offices and specific private companies.

1 is a flowchart illustrating an operation of a method for identifying a building use based on artificial intelligence object recognition according to an embodiment of the present invention.
2 shows an exemplary view for explaining the method of the present invention.
3 is a diagram illustrating a configuration of an apparatus for identifying a building use based on artificial intelligence object recognition according to an embodiment of the present invention.

Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be embodied in various different forms, and only these embodiments allow the disclosure of the present invention to be complete, and common knowledge in the art to which the present invention pertains It is provided to fully inform those who have the scope of the invention, and the present invention is only defined by the scope of the claims.

The terminology used herein is for the purpose of describing the embodiments, and is not intended to limit the present invention. In this specification, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, "comprises" and/or "comprising" refers to the presence of one or more other components, steps, operations and/or elements mentioned. or addition is not excluded.

Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used with the meaning commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless specifically defined explicitly.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the accompanying drawings. The same reference numerals are used for the same components in the drawings, and repeated descriptions of the same components are omitted.

Embodiments of the present invention, based on artificial intelligence object recognition, by analyzing aerial photos and street images to determine the purpose of the building as its gist.

At this time, the present invention detects a target building set by a user or manager through aerial photo analysis by receiving or downloading an aerial photo of the target survey area, and receives a street image corresponding to the location information of the target building to analyze the street image After detecting the target building from the street image through the

Here, the object attached to the target building includes text and a phone number, and may include a signboard, a billboard, an advertisement text, a phone number, and the like. In order to recognize text included in the object, for example, a text recognition technique , an optical character recognition (OCR) technique may be used.

According to the present invention, processes such as aerial photo analysis, distance image analysis, and object recognition can be performed based on artificial intelligence object recognition. That is, the present invention can generate each learning model or an integrated learning model that detects a target building or detects an object attached to each target building by training artificial intelligence using a preset training dataset, The generated learning model may be updated using results derived through aerial photo analysis and distance image analysis, or may be updated using additionally collected training datasets. Artificial intelligence may be implemented by a neural network such as a convolutional neural network (CNN), a deep learning neural network (DNN), and the like, and the detailed description thereof is obvious to those skilled in the art of the present invention. is omitted.

1 is a flowchart showing an operation flow chart for a method for identifying a building use based on artificial intelligence object recognition according to an embodiment of the present invention, and may be performed by an apparatus in which an algorithm for the method of the present invention is installed.

Referring to FIG. 1 , the method for determining the use of a building according to an embodiment of the present invention analyzes an aerial photograph of an area to be investigated to detect a target building included in the aerial photograph (S110).

Here, in step S110, by receiving the latitude and longitude of the coordinates of the investigation target area from the user or the manager, the investigation target area is set, and an aerial photograph of the research target area set in this way is received from the database, and the aerial photograph is an artificial intelligence object. Specific buildings included in the aerial photo, for example, at least one preset target building may be detected by analysis based on recognition.

Here, in step S110, the research target area may be set by dragging the survey target area from the map data displayed on the screen according to an input of a user or an administrator.

In the present invention, the aerial photograph of the survey target area may be an aerial photograph downloaded only the survey target area from a database of a specific server, or an aerial photo corresponding to the survey target area among the aerial photos downloaded and stored in the device providing the method of the present invention in advance. It may be an aerial photo that you searched for.

The target building in step S110 may include a home building, a commercial building, a building of a certain size or more, and the target building may be determined by a business providing this technology or determined through selection of an item that can set the target building. can At this time, step S110 determines whether the building is a target building in the present invention by searching for information about the detected building from a database storing information such as whether the building is for home use or commercial use according to the latitude and longitude of the aerial photograph. It is possible to detect a desired target building through this. Of course, the present invention may detect a target building of a certain size or larger without considering the purpose of such a building depending on circumstances.

Furthermore, step S110 detects preset target buildings by analyzing the aerial photo of the investigation target area, and the remaining parts other than the detected target building, for example, the remaining parts other than buildings including roads, parking lots, rivers, etc. in advance It is removed using a set segmentation technique, and a target building may be detected from an aerial photograph from which this part has been removed.

In this case, in step S110, the target building may be detected from the aerial photograph by recognizing the target building from the aerial photograph of the survey target area using the artificial intelligence of the pre-trained learning model.

When the target building is detected by step S110, based on the detected location information or coordinate information of the target building, a street image corresponding to the location information is searched for and downloaded from a specific server, or a street image corresponding to the location information from the street image stored in the device is downloaded. By searching for a distance image, a distance image corresponding to the location information is received (S120).

In this case, in step S120, location information of the target building, that is, a distance image of a certain range based on latitude and longitude may be received.

When the street image including the target building is received by step S120, the received street image is analyzed to detect the target building from the street image (S130).

Here, in step S130, unnecessary parts such as electric wires and trees included in the street image are removed using a preset segmentation technique to detect the target building in the street image, and each target building is removed from the street image from which the unnecessary part is removed. can be detected. For example, in step S130 , as shown in FIG. 2 , after removing a tree and electric wire covering the target building, each of the target buildings may be detected from the street image in which the trees and wires are removed.

Here, step S130 may detect a target building from the street image using the artificial intelligence of the pre-trained learning model, and may include (or acquire) center coordinate information and vertex coordinate information for the detected target building. .

When a target building is detected from the street image by step S130, an object including a text attached to the detected target building, for example, a signboard, a billboard, an advertisement text, a phone number, etc. is detected, and the text included in the object is detected. Recognizes the use of each target building (S140). At this time, in step S140, by combining the recognized text information and public data, to provide the purpose of the target building or the use for the business in the target building, information may be processed, and the purpose provided in step S140 may be a hotel, a building, a restaurant, etc., and may specifically provide a hotel business name, a building name, a restaurant name, and the like.

For example, as shown in Figure 2, step S140 detects "Angel Kindergarten" attached to the target building on the left as an object, and a car attached to the target building on the right, and signs and phrases attached to each floor of the building. After detecting the object, the character included in each object is recognized by using a character recognition technique, for example, an optical character recognition (OCR) technique, for an object containing a character among the detected objects. get information Here, the acquired character information may include a company name, for example, as shown in FIG. 2 , "Angel Kindergarten", "Golf Zone", "Emart24", "Real Estate", and the like.

Step S140 may include center coordinate information of each detected object and coordinate information of vertices, and when a plurality of objects are detected in the target building, the corresponding object is the target using the coordinate information of the target building and the coordinate information of each object It is possible to determine which floor the building is located on, and thus it is possible to determine on which floor the company corresponding to the object is located, or whether it is located on a higher or lower floor than other companies. For example, as shown in Figure 2, it can be seen that "Golf Zone" is located on a higher floor than "Emart24", and "Eden Music Academy" is located on a higher floor than "Golf Zone". have.

Further, in step S140, the characters included in the object are recognized through character recognition, and when the recognized characters include only a business name or industry, the use of the company, for example, "Angel Kindergarten" shown in FIG. 2, is a kindergarten. After confirming the use, by searching for "Angel Kindergarten" from the database that stores phone numbers or the server that stores phone numbers according to the industry, the phone number of "Angel Kindergarten" corresponding to the location information can also be provided. .

Furthermore, in step S140, the characters included in the object are recognized through character recognition, and when the recognized characters include only a phone number, the database that stores the phone number or the server that stores the phone number according to the industry type By searching for a phone number, you can check the business name or company of the phone number, and through this, you can check the company and industry for the phone number.

Furthermore, in step S140, if the character included in the object is recognized through character recognition, and the recognized character includes both a business name or industry and phone number, for example, in the case of "Goltz Zone" shown in FIG. You can provide both the business type and phone number of the business. At this time, in the present invention, by searching for "golf zone" from a database that stores phone numbers for phone numbers and "golf zones" recognized by character recognition or a server that stores phone numbers according to industry types, the corresponding location After searching for the phone number of the "golf zone" corresponding to the information, and comparing it with the text-recognized phone number, the searched phone number can be provided together if the phone number is the same. If some of the numbers are different, the learning model may be updated gradually in order to improve the accuracy of character recognition by artificial intelligence.

The method of the present invention may provide at least one of location information of each target building identified through the above-described process, the purpose of each target building, a company entering the target building, a business name of the company, and a phone number of the company, It is also possible to determine whether there is any missing company information by comparing the company that has entered the building with the company that has already known about the target building.

Here, the present invention, for each target building, location information of each target building, each use of the target building, a company in the target building, a business name of the company, and a phone number of the company using information including at least one of a specific file It can also be provided in the form.

As such, the method according to an embodiment of the present invention can determine the use of a building by analyzing aerial photos and street images based on artificial intelligence object recognition, so it is possible to know the actual use of a specific building and a company that has entered the building. Also, information on companies that have not been reported can be found.

The present invention can be used for various services such as urban planning and real estate commercial area analysis, and the information identified through the present invention can be provided to government offices and specific private companies.

3 shows the configuration of an apparatus for identifying a building use based on artificial intelligence object recognition according to an embodiment of the present invention, and shows a conceptual configuration of an apparatus for performing the method of FIGS. 1 to 2 .

Referring to FIG. 3 , an apparatus 300 according to an embodiment of the present invention includes a receiving unit 310 , an aerial photo analysis unit 320 , a distance image analysis unit 330 , a usage confirmation unit 340 , and a providing unit ( 350) and a database (DB) 360 .

The DB 360 is a means for storing data for carrying out the present invention, and may store various data such as aerial photos, map data, street images, artificial intelligence object recognition-based algorithms, learning models, character recognition algorithms, and the like. In addition to data, all kinds of data required for carrying out the present invention may be stored.

Here, data stored in the DB 360 may be updated through a wired/wireless network, and the data update period may be determined by a business operator or an individual providing the technology of the present invention.

The receiving unit 310 receives the latitude and longitude of the coordinates of the survey target area from the user or manager, sets the survey target area, and receives an aerial photograph of the survey target area.

Here, the receiving unit 310 may set the survey target area by dragging the survey target area from the map data according to an input of a user or an administrator.

The aerial photograph analysis unit 320 detects buildings included in the aerial photograph, for example, preset target buildings by analyzing the aerial photograph of the survey target area based on artificial intelligence object recognition.

At this time, the aerial photograph analysis unit 320 searches for information on the detected building from the database in which information such as the purpose and use of the building according to the latitude and longitude of the aerial photograph and whether it is for home use or commercial use is stored, and the building is In the present invention, it is possible to determine whether the building is a target, and through this, it is possible to detect a desired target building. In this case, the aerial photo analysis unit 320 may detect a target building included in the selected predetermined area when a target building or a predetermined area including the target building is selected through the user's input.

Depending on the situation, the aerial photo analysis unit 320 removes the parts other than the detected target building, for example, the non-building parts including roads, parking lots, rivers, etc. using a preset segmentation technique, and , it is also possible to detect the target buildings from the aerial photograph from which this part has been removed.

The distance image analysis unit 330 searches for and downloads a street image corresponding to the location information from a specific server on the basis of the location information or coordinate information of the target building detected by the aerial photo analysis unit 320, or the distance stored in the device. By searching for a street image corresponding to the location information in the image, a street image corresponding to the location information is received, and the received street image is analyzed to detect a target building from the street image.

At this time, the distance image analysis unit 330 removes unnecessary parts such as electric wires and trees included in the distance image using a preset segmentation technique, and the center coordinate information of each target building from the distance image from which the unnecessary parts are removed. By acquiring vertex coordinate information, each target building may be detected.

The use confirmation unit 340 detects an object attached to the detected target building, for example, a signboard, a billboard, an advertisement text, a phone number, etc., and recognizes the text included in the object to determine the use of each target building. .

In this case, the usage confirmation unit 340 may acquire character information included in each object by recognizing a character using a character recognition technique, for example, an optical character recognition (OCR) technique.

Furthermore, the use confirmation unit 340 is not limited to identifying only the purpose or industry of the company entering the target building, and when a plurality of objects are detected in the target building, coordinate information of the target building and coordinate information of each object are used. Thus, it is possible to determine on which floor of the target building the corresponding object is located.

The providing unit 350 provides information confirmed by the use confirmation unit 340, for example, location information of each target building, each purpose of the target building, a company entering the target building, a business name of the company, and a phone number of the company. provide at least one.

Although the description is omitted in the apparatus of FIG. 3, each component constituting the FIG. 3 may include all the contents described in the method of FIGS. 1 to 2, which is obvious to those skilled in the art. do.

The device described above may be implemented as a hardware component, a software component, and/or a combination of the hardware component and the software component. For example, devices and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA), It may be implemented using one or more general purpose or special purpose computers, such as a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. A processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For convenience of understanding, although one processing device is sometimes described as being used, one of ordinary skill in the art will recognize that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that can include For example, the processing device may include a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as parallel processors.

Software may comprise a computer program, code, instructions, or a combination of one or more thereof, which configures a processing device to operate as desired or is independently or collectively processed You can command the device. The software and/or data may be any kind of machine, component, physical device, virtual equipment, computer storage medium or apparatus, to be interpreted by or to provide instructions or data to the processing device. may be embodied in The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

As described above, although the embodiments have been described with reference to the limited embodiments and drawings, various modifications and variations are possible from the above description by those skilled in the art. For example, the described techniques are performed in an order different from the described method, and/or the described components of the system, structure, apparatus, circuit, etc. are combined or combined in a different form than the described method, or other components Or substituted or substituted by equivalents may achieve an appropriate result.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims (8)

In the method of identifying the use of a building based on artificial intelligence object recognition,
analyzing an aerial photograph of a target area to detect at least one target building included in the aerial photograph;
receiving a street image corresponding to the location information based on the detected location information of the target building;
analyzing the street image to detect the target building from the street image; and
Detecting an object attached to the target building, and recognizing a character included in the detected object to confirm the use of each target building,
Providing information on the use of each of the target buildings including at least one of location information of each of the target buildings, the purpose of each of the target buildings, a company in the target building, a business name of the company, and a phone number of the company
further comprising,
The step of detecting the target building in the street image is
removing the remaining parts other than the target building and the object from the street image using a preset segmentation technique,
The step of confirming the use of each of the target buildings is
The object attached to the target building is detected, and when a business name is recognized through the recognition of characters included in the object using a preset character recognition technique, the use of the target building is confirmed through the business name, and the object When a phone number is recognized through the recognition of characters included in Way.
delete delete delete In the device for identifying the use of a building based on artificial intelligence object recognition,
An aerial photograph analysis unit for analyzing the aerial photograph of the target area to detect at least one or more target buildings included in the aerial photograph;
a distance image analyzer configured to receive a street image corresponding to the location information based on the detected location information of the target building, and analyze the street image to detect the target building from the street image; and
Detecting an object attached to the target building, and recognizing a character included in the detected object, including a use confirmation unit for confirming the use of each of the target building,
Information providing information on the use of each of the target buildings including at least one of location information of each of the target buildings, the use of each of the target buildings, a company occupied in the target building, a business name of the company, and a phone number of the company provider
further comprising,
The distance image analysis unit
removing the remaining parts other than the target building and the object from the street image using a preset segmentation technique,
The use confirmation unit
The object attached to the target building is detected, and when a business name is recognized through the recognition of characters included in the object using a preset character recognition technique, the use of the target building is confirmed through the business name, and the object When a phone number is recognized through the recognition of characters included in Device.

delete delete delete

Images