KR102058628B1 - Map information displayed monitoring system using Augmented Reality - Google Patents

Abstract

Disclosed are a method of operating an imaging system and a control system. According to the present disclosure, the imaging system may comprise: a photographing device for generating image data of a specific place by photographing the specific place; an augmented reality engine for receiving two-dimensional map data and generating three-dimensional spatial data by performing three-dimensional transformation on at least one object included in the map data based on location information of the photographing device; and a display unit for generating merging data by merging the spatial data with the image data, and displaying a display image corresponding to the generated merged data to a user.

Description

Map information display monitoring system using Augmented Reality {Map information displayed monitoring system using Augmented Reality}

The technical idea of the present disclosure relates to a control system capable of displaying additional information in a closed circuit image transmitted in real time using augmented reality.

Augmented Reality (AR) technology is a technology that combines the virtual world with additional information in real time into the real world that the user sees as a single image. For example, the portable terminal can determine the approximate location using location and direction information, and identify the desired service by comparing the object information such as surrounding building information with the live image information input according to the movement of the camera. Information technology.

This augmented reality technology is a field of virtual reality (VR) technology, and uses a computer graphics technique that synthesizes virtual objects (objects) in a real environment and looks like objects existing in the original environment. However, augmented reality technology has a merit that it can reinforce and provide additional information which is difficult to obtain only by real world by synthesizing virtual objects on the basis of real world, unlike existing virtual reality technology that targets virtual space and objects only. . In addition, such augmented reality technology is currently being used in a variety of fields due to the spread of smart phones, such as a portable terminal.

On the other hand, the control system collects video data from CCTV and the like installed on the main road surface by the traffic control center. The traffic control center can take various measures such as adjusting the traffic light controller at the intersection according to the traffic situation based on the collected data. However, video data collected by CCTVs alone may not be intuitive to the observer where the area of CCTV is photographed, and this phenomenon may be caused by PTZ (Pan-Tilt), which is capable of ultra-high magnification, which is widely used as a current CCTV. This may be more severe when using zoom cameras, omnidirectional cameras that can be rotated 180 or 360 degrees.

One problem to be solved by the technical idea of the present disclosure is to provide a control system for merging map data into a 3D photographed image using augmented reality and a method of operating the same.

The problem to be solved by the technical idea of the present disclosure is to improve the intuition of the CCTV control system, additional information (property and space) by applying augmented reality technology that converts map data managed in two dimensions into three dimensions and merges them into CCTV images. It is to provide various operation methods through the acquisition of information) and the extraction of geographical real coordinates based on CCTV images.

In order to achieve the above object, an imaging system according to an aspect of the present disclosure provides a photographing apparatus for generating image data of a specific place by photographing a specific place, receiving two-dimensional map data, and Merged data by merging the spatial data with the augmented reality engine and the image data to generate three-dimensional spatial data by performing three-dimensional transformation on at least one object included in the map data based on the location information of the photographing apparatus. The display unit may include a display unit configured to generate a and display the displayed image corresponding to the generated merged data to the user.

According to an exemplary embodiment of the present disclosure, the expressed image may include a first layer corresponding to the image data and a second layer corresponding to the spatial data.

According to an exemplary embodiment of the present disclosure, the augmented reality engine may be characterized in that receiving the map data from a map database of a public institution.

According to an exemplary embodiment of the present disclosure, the display unit obtains the map data by receiving a coordinate value included in the location information of the photographing apparatus and outputting the coordinate value to a map database of a public institution. can do.

According to an exemplary embodiment of the present disclosure, the photographing apparatus may serve as a closed circuit television (CCTV) for photographing a road, and the image data may represent an image of the road.

According to an exemplary embodiment of the present disclosure, the photographing apparatus may be any one of a pan-tilt-zoom camera (PTZ camera), an omnidirectional camera, and a thermal infrared camera.

According to an exemplary embodiment of the present disclosure, the augmented reality engine extracts name information about a name of a building or a road and display information about a geographical indication from the map data, and extracts coordinates of the extracted name information and display information from the map data. By converting the data to be included in the spatial data.

According to an exemplary embodiment of the present disclosure, when the user selects an object included in the displayed image, the display unit converts the coordinates of the selected object into coordinates corresponding to the map data, and uses the coordinates of the object. It may be characterized by displaying the attribute information.

According to an exemplary embodiment of the present disclosure, the display unit may receive the image data from the photographing device through a wireless network.

According to another aspect of the present disclosure, a method of operating a control system may include generating image data of a specific place by photographing a specific place, receiving two-dimensional map data, and at least included in the map data. Generating three-dimensional spatial data through three-dimensional transformation of changing coordinates of one object into three-dimensional coordinates; merging data by merging the spatial data with the image data based on the location information of the photographing apparatus; And generating the displayed image corresponding to the merged data.

According to an exemplary embodiment of the present disclosure, receiving a selection signal for an object included in the displayed image, converting three-dimensional coordinates on the displayed image of the object to two-dimensional coordinates corresponding to the map data The method may further include receiving property information of the object based on the two-dimensional coordinates and displaying the received property information.

The control system according to an exemplary embodiment of the present disclosure may display processed map data and image data at once by converting two-dimensional map data stored in a database into three dimensions and merging them into three-dimensional image data. . Accordingly, the user can intuitively grasp by displaying the position coordinates of the real world on the image data (for example, a closed circuit screen).

In addition, the control system according to an embodiment of the present disclosure may convert the three-dimensional user selection coordinates to two-dimensional coordinates, and display the corresponding attribute information to the user. Accordingly, the user can intuitively grasp the position indicated by the image through the displayed image and efficiently check various information.

1 is a diagram illustrating an imaging system according to an exemplary embodiment of the present disclosure.
2 is a block diagram illustrating an imaging system according to an exemplary embodiment of the present disclosure.
3 is a flowchart illustrating a method of operating an imaging system according to an exemplary embodiment of the present disclosure.
4 is a flowchart illustrating a method of operating a control system according to an exemplary embodiment of the present disclosure.
5 is a diagram illustrating an operation of an augmented reality engine according to an exemplary embodiment of the present disclosure.
6 is a diagram illustrating an operation of a display unit according to an exemplary embodiment of the present disclosure.
7 is a flowchart illustrating a method of operating a control system according to an exemplary embodiment of the present disclosure.
8 is a diagram illustrating an displayed image according to an exemplary embodiment of the present disclosure.
9 is a diagram illustrating an operation of a control system according to an exemplary embodiment of the present disclosure.
10 is a flowchart illustrating a method of operating each component of an imaging system according to an exemplary embodiment of the present disclosure.
11 is a diagram illustrating an imaging system according to an exemplary embodiment of the present disclosure.

Hereinafter, with reference to the accompanying drawings will be described in detail an embodiment of the present invention. The embodiments of the present invention are provided to more completely explain the present invention to those skilled in the art. As the inventive concept allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to the specific disclosed form, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. In describing each drawing, like reference numerals are used for like elements. In the accompanying drawings, the dimensions of the structures are shown to be enlarged or reduced than actual for clarity of the invention.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprises" or "consisting" are intended to indicate that there is a feature, number, step, action, component, part, or combination thereof described on the specification, one or more other It should be understood that it does not exclude in advance the possibility of the presence or addition of features or numbers, steps, operations, components, parts or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art, and shall not be construed in ideal or excessively formal meanings, as expressly defined herein. .

1 is a diagram illustrating an imaging system according to an exemplary embodiment of the present disclosure.

Referring to FIG. 1, the imaging system 10 may include a control system 100, a plurality of photographing apparatuses 210 and 220, and a communication network 300. Each of the plurality of photographing apparatuses 210 and 220 may be configured as a closed ciruit television (CCTV) serving as a security camera. In one example, each of the plurality of photographing apparatuses 210 and 220 may include a pan-tilt-zoom (PTZ) camera, an omnidirectional camera, a thermal infrared camera, or the like. A PTZ camera is a camera that provides a pan / tilt / zoom function, and may refer to a camera having a zoom in / out function while following a subject up, down, left, and right. PTZ cameras can monitor large areas with pan / tilt / zoom and provide detailed images through zoom-in.

The photographing apparatuses 210 and 220 may photograph the surrounding area in real time and transmit the image data Data_Vd corresponding to the photographed image to the control network 100 so as to be provided to the control system 100. The photographing apparatuses 210 and 220 may change the photographing region to a specific region (or region) by operating under the control of the control system 100, and when there is a zoom-in command, the image data corresponding to the photographed image having the increased magnification ( Data_Vd) may be provided to the control device 100.

When a predetermined event occurs, the photographing apparatuses 210 and 220 may zoom in the corresponding region and photograph the zoomed-in image. In one example, when it is determined that an incident, an accident or a lot of people gather in the region, the photographing apparatuses 210 and 220 may automatically zoom in and photograph the region. In one embodiment, the predetermined event may be predetermined by the control system 100. In one example, the predetermined event may include a flame, a crowd of people, a collision of a car, and the like.

Shooting according to the event is generated by the control system 100 to detect the occurrence of the event through the image analysis and receiving instructions from the control system 100 in accordance with the detection result the photographing device (210, 220) or the photographing device 210 220 may also operate by detecting the occurrence of the event itself. In one example, when the traffic of the communication network 300 increases, since the data transmission may not be easy, the photographing apparatuses 210 and 220 may perform the above operation by themselves. Alternatively, it is determined whether the photographing apparatuses 210 and 220 perform the zoom-in operation according to the traffic state, and according to the determination result, the control system 100 analyzes the image and the photographing apparatuses 210 and 220 perform the zoom-in operation according to the analysis result. Can be done automatically.

The photographing apparatuses 210 and 220 together with the image data Data_Vd may adjust coordinate values so that the control system 100 may determine whether the photographed image is an image photographed at a certain posture or any position of the photographing apparatuses 210 and 220. It can be provided to the control system (100). The control system 100 may receive map data Data_Mp from the database DB based on the received coordinate values, and implement augmented reality based on the map data Data_Mp. This will be described later in detail.

The communication network 300 may include both wired and wireless communication networks. As the communication network 300, a wired or wireless Internet network may be used or interworked. The wired network includes an Internet network such as a cable network or a public telephone network (PSTN), and the wireless communication network includes CDMA, WCDMA, GSM, Evolved Packet Core (EPC), Long Term Evolution (LTE), Wibro network, and 5G ( 5 ^th Generation) and the like. The communication network 300 is not limited thereto, and may include, for example, a cloud computing network under a cloud computing environment as an access network of a next generation mobile communication system to be implemented.

When the communication network 300 is a wired communication network, an access point in the communication network 300 may be connected to an exchange or the like of a telephone company, and in the case of a wireless communication network, the access point may be connected to an SGSN or a Gateway GPRS Support Node (GGSN) operated by a communication company to process data. Or, it can be connected to various repeaters such as BTS (Base Station Transmission), NodeB, e-NodeB and process data.

The control system (or a system for interlocking the augmented reality data with the image data in association with the imaging device) 100 may be provided in the control center. The control system 100 may include a server and a computer connected to the server. The database DB may store two-dimensional map data Data_Mp for a specific area within the photographing range of the photographing apparatuses 210 and 220, and the control system 100 maps the map data through the database DB. (Data_Mp) may be provided. In one example, the database DB obtains the map data Data_Mp through a server of an administrative institution that provides the map data Data_Mp or through a recording medium such as a CD, and obtains the acquired map data Data_Mp. Can be stored. In another example, the database DB may refer to a database of an administrative institution in which map data Data_Mp is stored. In addition, the map data Data_Mp may include various object information displayed on a map such as building information and road information of a specific region, and the object information may correspond to two-dimensional coordinates.

The control system 100 may receive the map data Data_Mp and convert the map data Data_Mp to match the three-dimensional image data Data_Vd from the photographing apparatuses 210 and 220. In an embodiment, the control system 100 may generate spatial data by converting object information corresponding to the coordinates of the map data Data_Mp to correspond to the coordinates, and generate merged data by merging the spatial data with the image data. have. The control system 100 may simultaneously display the captured image and the object information corresponding thereto to the user based on the merged data.

According to the technical idea of the present disclosure, the control system 100 converts a corresponding 3D photographing image based on the map data Data_Mp, and augments reality to merge the converted various object information into the photographing image. In this way, users such as control personnel can quickly recognize the location and feature that they are currently looking at. If an event occurs in a specific area, the user can quickly check the event occurrence location and Countermeasures can be taken.

In FIG. 1, all of the two imaging apparatuses 210 and 220, the communication network 300, and the control system 100 are illustrated to be included in the imaging system 10, but this is only an example and more or less than two imaging apparatuses are provided. May be included in the imaging system 10, and some components such as the communication network 300 are omitted to configure the imaging system 10 so that the photographing apparatuses 210 and 220 and the control system 100 perform direct communication. Some components, such as control system 100, may be integrated into other components, such as communication network 300, to be a device within communication network 300.

2 is a block diagram illustrating an imaging system according to an exemplary embodiment of the present disclosure. The content overlapping with FIG. 1 is omitted.

Referring to FIG. 2, the imaging system 10 may include a control system 100 and a photographing apparatus 200, and the control system 100 may include a display 110 and an augmented reality engine 120. Can be. The photographing apparatus 200 may output the image data Data_Vd generated as a result of photographing a specific place to the display 110 through the communication network (FIGS. 1 and 300). The image capturing apparatus 200 may transmit the position information Info_p of the image capturing apparatus 200 related to the image capturing apparatus 200 to which the image capturing apparatus 200 is photographed at which posture or at what position, together with the image data Data_Vd. In an embodiment, the location information Info_p may include coordinate values on a map of the photographing apparatus 200.

The display 110 may output the location information Info_p to the database DB, and the database DB may transmit the map data Data_Mp to the augmented reality engine 120 based on the location information Info_p. You can print In an example, the display unit 110 may output coordinate values on the map of the photographing apparatus 200 to the database DB as the location information Info_p, and the database DB may be configured as the location information Info_p. Map data Data_Mp including object information corresponding to coordinate values on the map may be output to the augmented reality engine 120.

The augmented reality engine 120 may generate the spatial data Data_Sp by processing the map data Data_Mp in three dimensions, and may output the generated spatial data Data_Sp to the display 110. In one example, the map data Data_Mp may include a plurality of object information respectively corresponding to the two-dimensional coordinates, and the augmented reality engine 120 based on the position information Info_p based on the coordinates corresponding to the plurality of object information. The spatial data can be generated by changing the coordinates with respect to the viewpoint of the photographing apparatus 200. To this end, in one embodiment, the augmented reality engine 120 may further receive location information Info_P from the display 110. Detailed operations of the augmented reality engine 120 will be described later in detail with reference to FIG. 5.

The display 110 merges the image data Data_Vd received from the photographing apparatus 200 and the spatial data Data_Sp received from the augmented reality engine 120 to generate merged data, and based on the generated merged data. The display image DV may be transmitted to the user. In one embodiment, the displayed image DV may include a first layer based on the image data Data_Vd and a second layer based on the spatial data Data_Sp, and the first layer may have a shape of an actual photographed place. The object information corresponding to a specific place may be transmitted to the user, and may be transmitted to the user in the second layer.

According to the technical idea of the present disclosure, the control system 100 generates three-dimensional spatial data Data_Sp based on the map data Data_Mp received from the database DB, and generates spatial data Data_Sp and image data. By merging (Data_Vd) and transmitting the display image DV to the user, the control system 100 may additionally transmit object information to the captured image to the user without additional primitive generation, and thus, the user may display the display image (DV). Intuitively understand information about DV).

3 is a flowchart illustrating a method of operating an imaging system according to an exemplary embodiment of the present disclosure.

Referring to FIGS. 2 and 3, the photographing apparatus 200 generates image data Data_Vd by photographing a specific place (S10), and the control system 100 records the location information Info_P of the photographing apparatus 200. On the basis of the map data (Data_Mp) based on the two-dimensional coordinates can be obtained (S20). The control system 100 may generate spatial data Data_Sp by performing a transformation on the map data Data_Mp based on the location information Info_P (S30). The control system 100 may generate merged data by merging the spatial data Data_Sp with the image data Data_Vd (S40), and display the display image DV corresponding to the generated merged data to the user (S50). ).

4 is a flowchart illustrating a method of operating a control system according to an exemplary embodiment of the present disclosure.

2 and 4, the control system 100 receives the image data Data_Vd from the photographing apparatus 200 (S110), and the positional information Info_P of the photographing apparatus 200 from the image data Data_Vd. Can be parsed (S120). In another embodiment, the control system 100 may further receive location information Info_P of the photographing apparatus from the photographing apparatus 200.

The control system 100 may obtain map data Data_Mp including object information of two-dimensional coordinates from the database DB by using the parsed location information Info_P (S130). The control system 100 may parse object information of at least some of the map data Data_Mp (S140). At least some object information may include information about a building, information about a road, and the like. The control system 100 may generate three-dimensional spatial data Data_Sp through three-dimensional transformation based on the parsed object information (S150). In an embodiment, the control system 100 may generate spatial data Data_Sp by converting two-dimensional coordinates corresponding to the object information into three-dimensional coordinates based on the location information Info_P of the photographing apparatus 200. .

The control system 100 may generate merged data by merging the spatial data Data_Sp with the image data Data_Vd (S160), and display the expressed image VD corresponding to the merged data to the user (S170). In one example, the displayed image VD may include a first layer corresponding to the image data Data_Vd and a second layer corresponding to the spatial data Data_Sp.

5 is a diagram illustrating an operation of an augmented reality engine according to an exemplary embodiment of the present disclosure.

Referring to FIG. 5, the augmented reality engine may receive map data Data_Mp including a plurality of object information from a database. In one example, the plurality of object information may include name information such as an A intersection, a B building, a C department store, and a D cafe, display information such as a bus-only lane mark, a crosswalk mark, and a road boundary mark.

The augmented reality engine may extract a plurality of object information from the map data Data_Mp. In one example, the augmented reality engine may parse name information and display information from the map data Data_Mp as a plurality of object information. The augmented reality engine may perform three-dimensional transformation on the extracted plurality of object information based on the respective two-dimensional coordinates and the location information of the photographing apparatus. That is, the augmented reality engine may calculate where the coordinates corresponding to the plurality of object information are located in the line of sight of the photographing apparatus, and correspond to each of the plurality of object information to the calculated coordinates, and thus correspond to the three-dimensional coordinates. Spatial data Data_Sp including a plurality of object information may be generated.

In the example of FIG. 5, in the map data Data_Mp, the coordinate corresponding to the intersection of A may be located at a specific coordinate of the spatial data Data_Sp in the line of sight of the photographing apparatus, and the intersection of A corresponding to the specific coordinate is the spatial data ( Data_Sp). Name information such as B building, C department store, and D cafe can also be constructed as spatial data Data_Sp in the same manner. In addition, display information such as bus-only lane markings, road boundary markings, and crossing road markings may also be constructed as spatial data Data_Sp in a similar manner.

According to the technical idea of the present disclosure, since the spatial data Data_Sp may be generated only through the three-dimensional transformation operation on the generated map data Data_Mp without any additional primitive generation operation, augmented reality may be efficiently implemented. The overload of the system can be reduced.

6 is a diagram illustrating an operation of a display unit according to an exemplary embodiment of the present disclosure.

Referring to FIG. 6, the display unit may receive image data Data_Vd from a photographing apparatus and receive spatial data Data_Sp from an augmented reality engine. The display unit may generate the merged data Data_Mg by merging the image data Data_Vd and the spatial data Data_Sp. In an embodiment, the display unit outputs an image corresponding to the image data Data_Vd to the first layer and an image corresponding to the spatial data Data_Sp to the second layer, thereby displaying the image data Data_Vd and the spatial data Data_Sp. ) Can be merged. The display unit may display the displayed image corresponding to the merged data Data_Mg to the user.

According to an embodiment of the present disclosure, the control system displays an expressed image corresponding to the merged data Data_Mg to the user so that the user may add an object of the spatial data Data_Sp to the actual captured image of the specific place corresponding to the image data Data_Vd. Information can be recognized together, and accordingly, the user's understanding of the captured image can be improved.

7 is a flowchart illustrating a method of operating a control system according to an exemplary embodiment of the present disclosure.

Referring to FIG. 7, the user may select an object included in the displayed image (S210). In one embodiment, the object may correspond to any one of the plurality of object information expressed by the spatial data. The control system may convert the 3D coordinates of the selected object into 2D coordinates (S220). The control system may receive attribute information of the object (S230). In one embodiment, the control system may request the object's attribute information from the database based on the coordinates corresponding to the attribute information of the object, and receive the attribute information of the object from the database. The control system may display the generated attribute information to the user (S240).

According to the technical idea of the present disclosure, by converting the three-dimensional coordinates of the object selected by the user to the two-dimensional coordinates and then receive the attribute information based on the parasiticity without having to generate the attribute information corresponding to the separate three-dimensional coordinates The information required by the user can be expressed using the provided attribute information. Accordingly, the overhead of the control system is reduced, and efficient monitoring can be possible.

8 is a diagram illustrating an displayed image according to an exemplary embodiment of the present disclosure. In detail, FIG. 8 illustrates an embodiment in which attribute information is displayed by a user selecting an object.

Referring to FIG. 8, when the user selects the first object Ob_1, the control system may convert the coordinates on the displayed image into coordinates corresponding to the map data. The control system may acquire the attribute information based on the coordinates corresponding to the map data, and display the acquired attribute information to the user. In the example of FIG. 8, when the attribute information corresponding to the first object Ob_1 includes the first item C1 to the fourth item C4, and the user selects the first object Ob_1, the control system The first value Val1 may be displayed as the first item C1, and the second value Val2 may be displayed as the second item C2. In addition, the control system may display the third value Val3 as the third item C3 and display the fourth value Val4 as the fourth item C4.

9 shows a conversion method of projecting three-dimensional coordinates of map information onto a plane (two-dimensionally) with a CCTV screen of a control system.

Referring to FIG. 9, the photographing apparatus may be located at three-dimensional coordinates of (xs, ys, zs), and the map data may have a main point P located at a focal length f that is the shortest distance from the photographing apparatus. have. The linear equations L (x, y, z) to the imaging device and the main point P may be expressed by Equation 1 below.

In addition, the main point P may have coordinates as shown in Equation 2 below.

Based on the coordinates of the main point P and the focal length f, the planar equations F (x, y, z) of the map data may be expressed as in Equation 3 below.

When the user selects A (xi, yi, zi) on the display screen, the control system may calculate the linear equation Li (x, y, z) up to the photographing apparatus and A as shown in Equation 4 below.

The control system uses the calculated linear equations Li (x, y, z) and the plane equations F (x, y, z) of the map data described above, and the intersection point O (xo, yo , zo) can be calculated. Since the intersection point O may be composed of two-dimensional coordinates in the basis of the map data, the control system may output the intersection point O as two-dimensional coordinates in the map data.

10 is a flowchart illustrating a method of operating components of an imaging system according to an exemplary embodiment of the present disclosure.

Referring to FIG. 10, the imaging system may include a photographing apparatus 200, a display 110, and an augmented reality engine 120. The photographing apparatus 200 may output image data of photographing a specific place and location information of the photographing apparatus 200 to the display 110 (T110). The display 110 may output spatial information about the screen area to the database DB based on the location information (T120). The spatial information may include two-dimensional coordinates of the photographing apparatus. The database DB may output map data including spatial information and object information to the augmented reality engine 120 (T130). In one example, the spatial information may represent a geographic appearance that is actually displayed on the map, and the object information may represent information describing the spatial information.

The augmented reality engine 120 may generate three-dimensional spatial data by classifying two-dimensional spatial information and object information and applying the same to a style (T140). The augmented reality engine 120 may output the generated spatial data to the display 110 (T150). The display 110 may generate merged data by merging the image data and the spatial data, and display the expressed image corresponding to the merged data (T160).

If an event occurs in which the user selects an object included in the displayed image while displaying the displayed image (T210), the display 110 may output the coordinates of the selected object to the augmented reality engine 120 (T220). . The augmented reality engine 120 may convert the coordinates of the selected object into coordinates corresponding to the map data and generate attribute information of the object corresponding to the coordinates corresponding to the map data (T230). In one embodiment, the augmented reality engine 120 may extract the attribute information of the object from the map data. The augmented reality engine 120 may output attribute information of the selected object to the display 110 (T240), and the display 110 may display attribute information of the selected object (T250).

11 is a diagram illustrating an imaging system according to an exemplary embodiment of the present disclosure.

Referring to FIG. 11, the imaging system 1000 may include a control system 1100, a CCTV 1120, and a firewall 1300. The control system 110 is a CCTV-AR integrated platform 1110, VMS (Video Management System) 1120, storage 1130, control main server 1140, GIS / AR server 1150, intelligent module server 1160 ) And bus 1170.

The CCTV-AR integration platform 1110 may serve as the display unit and the augmented reality engine described above. That is, the CCTV-AR integration platform 1110 may receive image data from the CCTV 1200 through the bus 1170 and receive map data from the GIS / AR server 1150 through the bus 1170. The CCTV-AR integration platform 1110 may generate spatial data, merge and display the spatial data and the image data by performing 3D transformation on the map data.

The VMS 1120 may collect, store, and distribute CCTV images. The VMS 1120 may be connected to the storage 1130 and store image data received from the CCTV 1200 in the storage 1130.

The control main server 1140 may represent a gastric server for receiving various data for CCTV monitoring, and the GIS / AR server 1150 may indicate a server for receiving two-dimensional map data according to the technical spirit of the present disclosure. Can be. The intelligent module server 1160 may represent a server that performs interworking with various intelligent applications. The CCTV-AR integration platform 1110, the VMS 1120, the control main server 1140, the GIS / AR server 1150, and the intelligent module server 1160 may be connected to each other through the bus 1170.

The CCTV 1200 is a photographing apparatus capable of photographing a specific place. In one example, the CCTV 1200 may be configured as one of a PTZ camera, an omnidirectional camera, a fixed IP (Internet Protocol) camera, and a thermal infrared camera. The CCTV 1200 may generate image data as a result of photographing a specific place and output the image data to the control system 1100 via the firewall 1300. The firewall 1300 is to prevent leakage of the image data to the outside, the security may be increased by the firewall 1300.

As described above, exemplary embodiments have been disclosed in the drawings and the specification. Although embodiments have been described using specific terms in this specification, they are used only for the purpose of describing the technical spirit of the present disclosure and are not used to limit the scope of the present disclosure as defined in the meaning or claims. . Therefore, those skilled in the art will understand that various modifications and equivalent other embodiments are possible therefrom. Therefore, the true technical protection scope of the present disclosure will be defined by the technical spirit of the appended claims.

Claims (11)

A photographing apparatus for generating image data of the specific place by photographing a specific place;
An augmented reality engine configured to receive map data and generate three-dimensional spatial data by performing transformation on at least one object included in the map data based on location information of the photographing apparatus; and
And a display unit configured to generate merged data by merging the spatial data with the image data and to display a display image corresponding to the generated merged data to a user.
When the user selects an object included in the displayed image, the display unit converts the three-dimensional coordinates of the selected object into two-dimensional coordinates corresponding to the map data by using a predetermined formula, and converts the two-dimensional coordinates. And displaying the property information of the object obtained from the map data. The method of claim 1,
The displayed image includes a first layer corresponding to the image data and a second layer corresponding to the spatial data. The method of claim 1,
And said augmented reality engine receives said map data from a map database of a public institution. The method of claim 3,
And the display unit obtains the map data by receiving a coordinate value included in the location information of the photographing apparatus and outputting the coordinate value to a map database of a public institution. The method of claim 1,
The photographing apparatus serves as a closed circuit television (CCTV) for photographing a road, and the image data represents an image of the road. The method of claim 5,
The photographing apparatus is any one of a pan-tilt-zoom camera (PTZ), an omnidirectional camera and a thermal infrared camera. The method of claim 5,
The augmented reality engine extracts display information regarding at least one of name information and geographical indication of a name of a building or a road from the map data, and converts coordinates of the extracted name information and display information according to the image data. Imaging system, characterized in that included in the data. delete The method of claim 1,
And the display unit receives the image data from the photographing apparatus through a wired or wireless network. Generating image data of the specific place by photographing the specific place using a photographing device;
Receiving map data;
Generating spatial data by transforming coordinates of at least one object included in the map data;
Generating merged data by merging the spatial data with the image data based on the location information of the photographing apparatus;
Displaying the displayed image corresponding to the merged data;
Receiving a selection signal for an object included in the displayed image;
Converting three-dimensional coordinates on the displayed image of the object into two-dimensional coordinates corresponding to the map data by using a predetermined formula;
Receiving attribute information of the object from the map data based on the two-dimensional coordinates; and
And displaying the received attribute information. delete

Images