KR102107189B1 - System and method for maintenance history and state management of facilities of subway station onto 3D screen - Google Patents

Abstract

Disclosed are a system and a method for managing a history and a state of facilities in a subway station on a 3D screen. A 3D server for performing 3D control of the subway station, a network video recorder server (NVR server) of a CCTV camera system, and a 3D client interwork with each other. The 3D server places facility objects in a 3D map of the subway station, and stores and manages facility history information, operating state information, and control state information. When searching for a facility by using a point-of-interest (POI) button, a method of grouping same facilities in the subway station to display an entire POI for the facilities with same characteristics on the 3D map, and moving, by a user, to a desired location so as to visit a facility in an area of interest is used. When inquiring required facilities in a facility list, using the POI button to perform the inquiry, or moving with a cursor, the 3D client displays the facility history information and facility state information in a corresponding facility object. The facility history information is displayed when the cursor is located on a POI of the facility, an operating state or a control state is displayed when the POI of the facility is clicked, and a surrounding situation image is provided by simultaneously displaying an image of an adjacent CCTV camera related to the POI of the facility. In addition, an event is displayed on a screen of the 3D map, and histories of related facilities and operating states and control states of the facilities are displayed.

Description

System and method for maintenance history and state management of facilities of subway station onto 3D screen}

The present invention relates to a facility history management and state management system and method of a subway station on a 3D screen.

A CCTV system is a DVR (Digital Video Recorder) or NVR (Network Video Recorder) server that connects multiple cameras that record video, and connects multiple cameras with a UTP cable and compresses the video data of each camera on a hard disk, hard It consists of disk storage and is transmitted to the CCTV control center monitoring server that receives video and audio data of each camera channel through the communication network, and the video data of multiple cameras from the multi-viewer screen on the monitor of the control PC connected to the control center monitoring server. Are monitored.

CCTV cameras are fixed cameras, dome cameras (Dome cameras), PTZ (Pan Tilt Zoom) cameras, infrared dome cameras with infrared LEDs photographed at night, and the like.

The camera includes a lens, a camera, and a power supply, and has a dome or a top cover camera housing that covers it, and is classified into a fixed camera and a rotating camera.

PTZ camera is equipped with PTZ (Pan, Tilt, Zoom) control function, Pan fixes the camera position and moves the camera left and right, Tilt (tilt up, tilt down) moves the camera up and down, Zoom in / out provides a function to reduce / enlarge the video screen by focusing the camera's focal length at short or long distances.

DVR (Digital Video Recorder) encodes and saves images captured by multiple cameras connected by cable within a distance of 1.7 km, and stores them on the hard disk. The device is equipped with a screen changeover switch, a screen divider, a VCR (video player) sensor and an alarm controller.

NVR (Network Video Recorder) server is a dedicated PC server that plays video recording, monitoring, event management, and video data of multiple cameras of video servers of multiple cameras installed on the network, and IP camera It receives and compresses digital image data through and stores it, and as it is an IP-only storage device, there is no need to convert an analog camera image signal to a digital camera image signal, and it replaces the existing digital video recorder (DVR).

1 is a configuration diagram of a DVR system having a conventional CCTV camera and a sensor.

A DVR system having a conventional CCTV camera and a sensor includes at least one camera 710 for capturing CCTV images of a surveillance area; A sensor 712 for detecting heat in the event of a fire; It is connected to the at least one camera 710 and the sensor 712, a device ID is assigned, and is connected to at least one camera for capturing an image of a surveillance area, and it is hard to store image data recorded from the cameras. DVR 720 with a built-in disk; A computer and an HD monitor 723 connected to the DVR 720 and outputting through screen splitters 2x2, 3x3, 4x4, and 5x5 of each CCTV camera in the surveillance area; Control center server that is connected to the DVR 720, monitors the images of the cameras in the surveillance area, generates an alarm on the control PC when an intrusion is detected, and transmits the intrusion alarm to the mobile communication terminal 780 of the set mobile phone number. 740; And a control PC 790 equipped with a DVR card installed with a screen divider client for CMS monitoring of CCTV images recorded from at least one camera in a surveillance area.

The sensor 712 may be any one of a door magnet detector, a human body sensor (PIR sensor), a sound wave detection sensor, a wireless door sensor, and a fire detection sensor.

As related prior art 1, in patent registration number 10-1400168, "3D virtual security control system and method using stereoscopic camera" is registered.

The 3D virtual crime prevention control system and method using a stereoscopic camera converts a 2D unidirectional image captured through a unidirectional camera such as CCTV into a 3D virtual reality image, and converts the omnidirectional image captured through a stereoscopic camera that is an omnidirectional camera into a 3D virtual reality. It converts to an image and displays 3D virtual reality images that are sequentially converted according to the positions of the cameras in the patrol path, thereby providing a 3D virtual security patrol function such as a patrol patrolling an actual crime prevention area.

As related prior art 2, in Patent Registration No. 10-0458718, a traffic signal controller that controls the lighting and extinguishing of traffic lights installed at various intersections and crosswalks, and installation data modification, repair, and inspection work on site traffic facilities The "traffic signal controller and history management system of traffic facilities" provided to the company is registered.

The traffic signal controller and the history management system of the traffic facility include a traffic signal controller and a server storage unit 11 for storing the history information of the traffic facility, a server display unit 13 for displaying the history information stored at the request of the user, A history management server 10 consisting of a server input unit 12 for inputting history information, a server output unit 15 for outputting history information, and a server communication unit 14 for transmitting / receiving history information; The traffic signal controller and a terminal storage unit 31 for carrying and storing history information carried by an operator who modifies, repairs, and checks installation data of a traffic facility, and a terminal display unit 33 for displaying history information stored at the user's request, and A mobile terminal 30 consisting of a terminal input unit 32 for inputting history information and a terminal communication unit 34 for transmitting / receiving history information; It comprises a mobile communication means 20 for transmitting data to the history management server 10 and the mobile terminal 30 to wirelessly transmit / receive history information.

However, the existing CCTV camera system was used for monitoring camera images, but it is linked to the 3D control system and the CCTV camera system and displayed on the 3D client, and the maintenance history and status of historical facilities on the 3D Map screen of the subway station in 3D space. It did not provide the ability to manage information.

Patent registration number 10-1400168 (Registration date May 21, 2014), "3D virtual security control system using stereoscopic camera", Goldstar Security Co., Ltd. Patent registration number 10-0458718 (Registration date November 17, 2004), "Traffic signal controller and history management system of traffic facilities", Sein System Co., Ltd.

The object of the present invention for solving the above problems is to interwork with a 3D server for 3D control of subway stations, an image storage server (NVR server) of CCTV camera systems, and a 3D client, and a facility object in a 3D MAP of subway stations of 3D servers When planting them, and using the POI button to find them, the facility is grouped to display the entire POI for the facilities with the same characteristics on the 3D Map, and the user moves to the desired location to find the facility, and the 3D client After selecting the 'Facility' menu, search for the required facilities as a list of facilities, search with a POI button or POI icon, or move the cursor or place the cursor on the facility's POI to check the operation status, control status, and facility history of the facility object. When displaying 'CCTV connection', the video of the adjacent CCTV camera of the facility of the POI is displayed simultaneously, and the event is displayed on the 3D screen, and the operation status and control status of the facility and the history of the facility are displayed on the 3D screen. Provides facility history management and condition management system for subway stations.

Another object of the present invention is to provide a method for managing and managing the status of facilities in a subway station on a 3D screen.

To achieve the object of the present invention, the facility history management and state management system of the subway station on the 3D screen renders the 3D Map and the POI background and facility objects according to the event for 3D control of the subway station. A 3D server with a 3D renderer; And the 3D server, DB server, and CCTV camera system, and the 3D Map screen that displays the operation status, control status, and facility history of facility objects in the subway station and CCTV camera video area of a predetermined size. Includes a control PC with 3D client to output,
When using the POI button or POI icon to find a specific facility in the subway station, the same facility in the subway station is grouped to display the entire POI for the facility with the same characteristics in the 3D Map, and the user moves to the desired location to the area of interest How to visit the facilities of the
When the cursor is positioned on the POI facility object of the subway station, the 3D server displays facility history information and the state of equipment to the 3D client,
When a POI object of a facility is clicked, the 3D server displays the operation state or control state of the facility to the 3D client,
When 'CCTV Connect' is clicked, the video stream of the adjacent CCTV camera related to the POI facility object is popped up and output,
For each floor of the subway history of the 3D client connected to the 3D server, if an alarm informing of the equipment code / line, status message, occurrence time, and confirmation occurs in the 3D Map screen, a first person mode virtual experience is provided.

The 3D server is a facility object is planted in a 3D Map of the subway station, and the history information, operation state, and control state information of the facility are stored and managed in the DB server.

After the 'Facility' menu is selected, the 3D client searches for facilities with a list of facilities for a specific facility, or searches for facilities with a POI button or POI icon, or moves and controls the facility state of the facility object when moving the cursor. Displays facility history information.

In order to achieve another object of the present invention, a method for managing and managing the status of facilities in a subway station on a 3D screen includes (a) a 3D client interworking with a 3D server, a DB server, and an image storage server of a CCTV camera system, and the 3D The server embeds each facility object in the 3D Map screen of each floor of the subway station, stores facility history information, operation status, and control status, and 3D client renders 3D modeled backgrounds and objects of the region of interest in the subway station by 3D rendering Marking with; (b) After selecting the 'facilities' menu, the 3D client searches for a specific facility as a list of facilities in the subway station, or a POI button or POI icon, or moves the cursor to the operating state and control status of the facility object. Displaying a facility history; And when an alarm informing of the equipment code / line, status message, occurrence time, and confirmation occurs in the 3D Map screen for each floor of the subway history of the 3D client connected to the 3D server, providing a first person mode virtual experience. And
When searching for a specific facility in the subway station using the POI button or the POI icon, the same facility in the subway station is grouped to display the entire POI for the facility having the same characteristics in a 3D Map, and the user moves to a desired location. Use the method to find facilities in the area of interest,
In step (b), when the cursor is positioned on the POI facility object of the subway station, the 3D server displays facility history information and the state of equipment to the 3D client,
The step (b) comprises: (b2) when a POI object of a facility is clicked, the 3D server displays an operation state or a control screen of the facility to the 3D client; And (b3) when selecting 'CCTV connection', outputting a video stream of an adjacent CCTV camera related to the POI object of the facility on a 3D Map screen.

On the 3D screen of the present invention, the facility history management and status management system and method of the subway station are interlocked with the 3D server and DB server for the 3D control of the subway station and the video storage server (NVR server) of the CCTV camera system and the 3D client. In the 3D MAP of the subway station of the 3D server, plant objects are inquired, and the 3D client can search for the required facilities in the facility list, search with the POI button or POI icon, or move the cursor to the operating state and control status of the facility object. Displays the facility history.

When the 3D client searches using the POI button, the facility is grouped to display the entire POI for the facility having the same characteristics on the 3D Map, and the user navigates to the desired location to find the facility.

When the cursor is positioned on the POI of the facility on the 3D Map screen, the facility history information is displayed, and when the POI of the facility is clicked, the operation status or control status is displayed, and when 'CCTV connection' is selected, the adjacent CCTV of the relevant POI facility Simultaneously expressing the video stream of the camera to provide images of the surroundings, it becomes convenient to manage facilities in the 3D virtual space of subway history.

1 is a configuration diagram of a DVR system having a conventional CCTV camera and a sensor.
FIG. 2 is a system configuration diagram of a 3D client interlocked with a 3D server for 3D control of subway history and an image storage server (NVR server) for outputting a 3D control screen of subway history and a camera image of a predetermined size for the present invention.
3 is a facility history management and status management screen of the subway station on the 3D screen according to the present invention.
4 is a photograph showing a facility history management and state management of the subway station on the 3D screen.
5 is a flow chart showing a method for managing the history of facilities and status management of subway stations on a 3D screen according to the present invention.

Hereinafter, with reference to the accompanying drawings, preferred embodiments of the present invention will be described in detail the configuration and operation of the invention.

FIG. 2 is a system configuration diagram of a 3D client interlocked with a 3D server for 3D control of subway history and an image storage server (NVR server) for outputting a 3D control screen of subway history and a camera image of a predetermined size for the present invention.

Subway stations include entrances, station rooms, waiting rooms, toilets, shutters, lights, elevators (EL-01, EL-02, EL-03), escalators (ES-01, ES-02, ES-03, ES-04), CCTV Camera, transportation card issuing machine, deposit refund machine, ticket gate device, SOS emergency call device, firefighting equipment, flashlight and portable emergency lighting and subway safety equipment equipped with masks, drainage equipment, electric equipment, HVAC (Main Line Fan, History Fan, Air Conditioner) , Cooler cooling tower), lifting facilities, Platform Screen Door (PSD), platform, tunnel.

The smart station management system of the present invention was developed for the first time in the world by a smart subway station management system using computer graphics (CG) and CCTV camera technology.

The smart station management system stores 3D modeled data of major subway facility objects in the database of the 3D server and DB server in the subway station where the 3D server, DB server, and CCTV system are built, and the facility history of the subway station And status information is managed.

For example, facilities include HVAC fans in the subway station, station fans, air conditioners, cooler cooling towers, fire fighting equipment, drainage equipment, electrical equipment, and elevator equipment-elevators (EL-01, EL-02, EL- 03), Escalators (ES-01, ES-02, ES-03, ES-04) are used.

The 3D server 100 planted facility objects in the 3D map of the subway station, and the operation status (normal / failure) and control status (operation / stop) of the facilities and facility history (equipment name, installer, SW version, name of the person in charge, The phone number, date of facility inspection, name and phone number of the person in charge of facility inspection, inspection items, etc.) are stored.

The subway farm server farm is a 3D server 100; Cameras (C1, C2, C3..Ck) and an image storage server (NVR server) 170; An event collection server 121 that collects events such as a fire detection event from the fire detection sensor, an SOS emergency call event of an SOS emergency telephone and a subway station telephone, and an intrusion detection event; A DB server 110 that stores each event collected from the event collection server 121 and stores management information of the subway station; It has an event distribution server 120 and a storage connected to the 3D server 100.

The 3D client 101 renders and displays the background and objects of each area (POI) in each floor structure of the subway station for 3D control of the subway station and facility history management and operation and control status management on the 3D screen. (100) and DB server 110 that stores and manages facility history information, and a video storage server (NVR server) that stores and distributes image data of multiple cameras (C1, C2, .. Ck) of a CCTV camera system ( 170).

The 3D client 101 is a 3D Map that composes a 3D virtual space of each floor structure of the subway station and a 3D Map screen where the background and objects of the Point of Interest (POI) and objects are 3D modeled / rendered within the screen. Simultaneously, camera video stream data installed in a specific area is output to a CCTV camera video area of a predetermined size.

3D client 101 is for subway station 3D control and camera video monitoring, emergency calls, access management and facility management: all, CCTV, lighting, shutter, PSD, access management, fire fighting, air quality sensor, SOS emergency call, It provides toilet evaluation, equipment, and intrusion detection menus.

3 is a facility history management and status management screen of the subway station on the 3D screen according to the present invention. 4 is a photograph showing a facility history management and state management of the subway station on the 3D screen.

As a method of searching for facilities, a method of finding a list of facilities in a subway station and a method of finding a facility using a POI button (or POI icon) are used.

If you use the list of facilities to find the facility you want in the subway station, you can search by name for the facility you want.

When a specific facility is found in the subway station by using the POI button or the POI icon, the same facility in the subway station is grouped to display the entire POI for the facility having the same characteristics in the 3D Map of the 3D client 101, and the user wants Use the method of going to a location and finding a facility in the POI.

3D client 101, after the 'equipment' menu is selected, inquire by a list of facilities for a specific facility, query with a POI button, or move the cursor to the operation state (normal / failure) and control state of the corresponding facility object (operation) / Stop) and facility history (equipment name, installation company, SW version, name of person in charge, telephone number, date of facility inspection, name and phone number of person in charge of facility inspection, inspection process, etc.).

At this time, the 3D client 101 displays the facility history information when the cursor is positioned on the POI facility object of the region of interest in the subway station on the 3D screen,

When a POI of a facility is clicked, the operation status or control status of the facility is displayed, and when the 'CCTV connection' menu of the facility object is clicked, the video stream of the adjacent CCTV camera of the facility of the POI is simultaneously displayed and the surrounding situation video is output. do.

In addition, the 3D client 101 displays an event on the 3D screen, displays the operation status (normal / failure) and control status (operation / stop) of the facility and the history of the facility, and provides a control screen when necessary.

Facility history includes equipment name, installer, SW version, contact person name, telephone number, facility inspection date, facility inspection person name and telephone number, and inspection process (hardware / software device replacement, parts replacement).

Point of Interest (POI) is an icon or POI button that makes it easy to find information or location of a desired facility object in a 3D virtual space of subway history by placing points of interest or objects of interest on a 3D Map screen of subway history. , Used as a marker.

[Characteristic]

* The 3D client 101 is interlocked with the 3D server 100, the DB server 110, and the video storage server (NVR server) 170 of the CCTV camera system, and the 3D server 100 is within a subway history 3D Map screen. Planting the facility objects, storing the operation state and control state of the facility and the facility history in the DB server 110,

After the 'facilities' menu is selected, the 3D client 101 searches for specific facilities in the subway station as a list of facilities, or inquires with a POI button (or POI icon) or moves the cursor to the operating state and control state of the corresponding facility object. Displays facility history information.

* The 3D client displays an event on the 3D Map screen of the subway station, displays the history of the facility and the operation status (normal / fault) and control status (operation / stop) of the facility, and provides a control screen when control is required .

(1) Function and operation

For each facility in the 3D Map of subway history, 3D server's POI of each facility object inputs and displays the information of the facility, the operation status and control status of the facility, and the facility history, and the relevant facility history (equipment name, installer, SW version , Displays the name of the person in charge, the phone number, the date of the facility inspection, the name and phone number of the person in charge of the inspection, and the check items (hardware / software device replacement, parts replacement), etc.

The 3D client 101 provides facility history management by allowing the facility history information to be displayed when the cursor is positioned on a point of interest (POI) facility object in the subway station.

The 3D client 101 displays the operation status (normal / failure) and control status (operation / stop) of the facility, as well as the history of the facility on the 3D screen, and constitutes a control screen for controlling the facility.

When the cursor is positioned on the POI object of the facility, the 3D screen displays facility history information,

When a POI object of a facility is clicked, the operation status or control status of the facility is displayed. When a 'CCTV connection' is clicked, a video stream of an adjacent CCTV camera related to the POI facility object is popped up and output.

(2) Operation status and control status of facility and facility history screen display

As a method of searching for facilities, a method of finding a facility with a list of facilities in the subway station and a method of finding a facility with a POI button or a POI icon are used.

If you search using a list of facilities, you can search by name for the desired facility in subway history.

When searching using the POI button or the POI icon, the same facility in the subway station is grouped to display the entire POI for the facility with the same characteristics on the 3D map of the 3D client, and the user can navigate to the desired location to find the facility. do.

When the facility is searched and the desired POI facility object is found, the user clicks the corresponding POI facility object, and at this time, the operation state, control state, and facility history information of the corresponding POI facility object are output.

If it is necessary to show both the facility's history information and the operation status, preferentially display the operation status or control status information, and put the sub-menu and click the history information button to additionally output the facility history information, or

Conversely, it is also possible to display facility history information first, and to output information on the operation status and control status of the facility by pressing the sub-menu.

When you want to operate or control a selected facility in a 3D virtual space of subway history, the CCTV camera video associated with the POI facility object is popped up and displayed on the screen.

The subway history 3D control system is composed of a 3D server and a 3D client, and the 3D server and 3D client use computer graphics (CG) technology to create 3D for each layer of local history. Maps, backgrounds, and objects are rendered and displayed with geometric surfaces and polygons modeled with points, lines, and faces, and 3D maps of each floor of subway history and backgrounds of areas of interest (POIs). Construction objects are displayed by 3D modeling / 3D rendering.

Referring to Figure 2, the facility history management and state management system of the subway station on the 3D screen of the present invention

For 3D control of each floor structure of subway station, 3D Map, background and 3D modeled data of facility objects are stored and the background and objects of POI (Point Of Interest) are stored according to the event. 3D server 100 having a 3D renderer for rendering 3D modeled data;

It is connected to the 3D server 100, the DB server 110, and the video storage server (NVR server) 170 of the CCTV camera system, and displays the operating state, control state, and facility history of the facility object in the area of interest in the subway station. It includes a control PC with a 3D map screen and a 3D client 101 for outputting specific camera video stream data to a CCTV camera video area of a predetermined size.
When using the POI button or POI icon to find a specific facility in the subway station, group the same facility in the subway station to display the entire POI for the facility with the same characteristics on the 3D Map screen, and navigate to the desired location by the user How to visit the facilities of the
When the cursor is positioned on the POI facility object of the subway station, the 3D server displays facility history information and the state of equipment to the 3D client,
When a POI object of a facility is clicked, the 3D server 100 displays the operation state or control state of the facility to the 3D client 101,
When 'CCTV Connect' is clicked, the video stream of the adjacent CCTV camera related to the POI facility object is popped up and output,
For each floor of the subway station of the 3D client connected to the 3D server, an alarm informing of the device code / line, status message, occurrence time, and confirmation within the 3D Map screen provides a first person mode virtual experience.

The 3D client 101 is interlocked with the 3D server 100, the DB server 110, and the video storage server (NVR server) 170, and the 3D server 100 planted facility objects in a 3D map of subway history. The operation status and control status of each facility and facility history information are stored and managed in the DB server,

The 3D client 101, after the 'facility' menu is selected, inquires a specific facility as a facility list, or queries with a POI button / or POI icon, or moves and moves the cursor to the corresponding facility object's operation status and control status information and facilities Display history information.

The system is connected to the DB server 110 over the network through the 3D server 100 and the L3 switch, and the DB server 110 and storage for storing the operating status and control status of each facility in the subway station and the history of the facility. It further includes.

The subway farm server farm is a 3D server 100; Cameras (C1, C2, C3..Ck) and an image storage server (NVR server) 170; An event collection server 121 that collects events such as a fire detection event from the fire detection sensor, an SOS emergency call event of an SOS emergency telephone and a subway station telephone, and an intrusion detection event; A DB server 110 that stores each event collected from the event collection server 121 and stores management information of the subway station; It has an event distribution server 120 and a storage connected to the 3D server 100.

The system includes a plurality of cameras installed in each area of the subway station; And a CCTV camera system including an image storage server (NVR server) that stores and distributes image data shot from the multiple cameras.

The image storage server 170 uses a DVR or NVR server that stores and distributes image data of each camera.

In the embodiment, the video storage server 170 used an NVR server.

The image storage server 170 is connected to an image management client 171 that analyzes image data of each camera installed in various regions for each floor of the subway station and manages it.

The 3D client 101 is connected to the 3D server 100, the DB server, and the video storage server (NVR server) 170, and displays specific camera video stream data in the 3D Map screen of the current subway station and the CCTV camera video area. In order to reduce the bandwidth of a specific camera image stream data, low resolution image data of a predetermined size in width x length is played.

In order to view a specific camera video stream data in a CCTV camera video area of a predetermined size in full screen, the 3D client 101 generates a 'double click' or 'moving' event in the CCTV camera video screen area within the 3D Map screen, or the menu. When the [Full Screen] menu button is pressed, the video channel information (the camera's IP address and port number, or device ID, etc.) is transmitted from the 3D client 101 to the video management client 171, and the video storage server The video management client 171 connected to the (NVR server) 170 directly connects the full-screen camera video stream data of the camera where the 'double click' or 'moving' event connected to the display stream pipeline of the corresponding camera is generated to 3D It is transmitted to the client 101 to be reproduced.

The camera's video channel information uses the camera's IP address and port number, or device ID.

The video management client 171 connected to the video storage server (NVR server) 170 receives video channel information (camera IP address and port number, or device ID, etc.) from the 3D client 101 of the control PC. If it is, the specific camera image stream data of the specific camera full screen size (the entire size of the control PC monitor) is directly connected to the 3D client 101 and transmitted, and the specific camera image stream data is sent to the 3D client 101 full screen. (full screen).

When the control PC uses 2 LCD monitors, the 3D Map screen of the control screen is output to the left LCD monitor, and the specific camera of the full screen size of the specific camera (total size of the control PC monitor) is displayed on the entire screen of the LCD monitor on the right. Outputs video stream data.

The 3D client 101 is connected to the 3D server 100, the DB server 110, and the image storage server 170, and the background screen and objects are displayed on the 3D Map screen that constitutes a 3D virtual space for each floor of the subway station. These are displayed in 3D modeling / rendering, and when a CCTV connection menu is selected, a specific camera image stream data is popped up and output to a CCTV camera image area of a predetermined size.

For example, a 3D map screen of a 3D client 101 displays 320 x 240 camera image data in a CCTV camera image area of a predetermined size, and then displays a high-resolution specific camera with a full screen size (1,920 x 1,080) of the LCD monitor of the control PC. It receives the video stream data and outputs it to the full screen.

When the 3D client 101 closes the full screen of the corresponding camera displayed on the CCTV control screen, it returns to the 'original display mode' again, and on the 3D control screen, a 3D Map screen of the area of interest in the subway station and a CCTV camera video of a predetermined size Outputs specific camera video stream data to the area.

5 is a flow chart showing a method for managing the history of facilities and status management of subway stations on a 3D screen according to the present invention.

On the 3D screen of the present invention, the method for managing the history of the facilities and managing the status of the subway station is: (a) 3D client is interlocked with the 3D server, DB server, and the video storage server (NVR server) of the CCTV camera system, and the 3D server is the subway. Plant objects are planted in the 3D Map screen on each floor of the history, and facility history information, operation state, and control state are stored, and 3D modeled backgrounds and objects of the POI in the subway history are converted into 3D clients by 3D rendering. Displaying (S20);

(b) After selecting the 'facilities' menu, the 3D client can search for a specific facility as a list of facilities in the subway station, or use the POI button or POI icon, or move the cursor to move the object's operation state, control state, and facility Displaying a history (S40); And
When an alarm informing of the device code / line, status message, occurrence time, and confirmation occurs in the 3D Map screen for each floor of the subway history of the 3D client connected to the 3D server, providing a first person mode virtual experience. ,
When searching for a specific facility in the subway station using the POI button or the POI icon, the same facility in the subway station is grouped to display the entire POI for the facility having the same characteristics in a 3D Map, and the user moves to a desired location. Use the method to visit the facilities in the area of interest,
In step (b), when the cursor is positioned on the POI facility object of the subway station, the 3D server displays facility history information and the state of equipment to the 3D client,
The step (b) comprises: (b2) when a POI object of a facility is clicked, the 3D server displays an operation state or a control screen of the facility to the 3D client; And (b3) when selecting 'CCTV connection', outputting a video stream of an adjacent CCTV camera related to the POI object of the facility on a 3D screen.

The method further includes the step of simultaneously displaying and outputting a video stream of the surrounding situation of a specific CCTV camera adjacent to the corresponding POI facility object when the 'CCTV connection' menu is selected (S10). In this case, the image data of each camera is received and stored by an image storage server (NVR server) from a plurality of cameras installed in each region of the subway station, and at least one camera image stream data stored in the image storage server is a 3D client. Transfer to.

As a method of searching for facilities, a method of finding a facility with a list of facilities in the subway station and a method of finding a facility with a POI button (or POI icon) are used.

If you want to find the desired facility using the list of facilities, you can find it by name for the desired facility.

When a facility is found using a POI button or a POI icon, the same facilities in the subway station are grouped to display the entire POI for the facilities having the same characteristics on the 3D Map of the 3D client 101, and the user moves to a desired location. Use the method of finding the facility in the area of interest (POI).

In the step (b), when searching using the POI button or the POI icon, the entire facilities of the subway station are grouped to display the entire POI for the facilities having the same characteristics in a 3D Map, and the user moves to a desired location. Use the method to visit the facilities in the area of interest,

For each facility in the 3D Map of subway history, information and facility history of each POI object of the 3D server are displayed / entered, and the corresponding facility history, operation status, and control status are displayed,

The facility history includes equipment name, installation company, SW version, name of person in charge, telephone number, date of facility inspection, name and phone number of person in charge of facility inspection, and inspection process.

The step (b) includes: (b1) when the cursor is positioned on a POI object of a facility in a subway station, the 3D server displaying facility history information to the 3D client; (b2) when a POI object of a facility is clicked, the 3D server displays an operation state or a control screen of the facility to the 3D client; And (b3) when selecting 'CCTV connection', outputting a video stream of an adjacent CCTV camera related to the POI object of the facility on a 3D screen.

After the 'Facility' menu is selected, the 3D client 101 searches for a specific facility by a facility list, inquires with a POI button or a POI icon, or moves the cursor to the operation state (normal / failure) and control of the corresponding facility object. It displays the status (operation / stop) and facility history (equipment name, installer, SW version, name of person in charge, telephone number, date of facility inspection, name and phone number of the person in charge of facility inspection, inspection process, etc.).

At this time, the 3D client 101 displays the facility history information when the cursor is positioned on the POI facility object of the region of interest in the subway station on the 3D screen,

When POI of a facility is clicked, the operation status or control status of the facility is displayed,

When the 'CCTV connection' menu of the corresponding facility object is clicked, the video stream of the adjacent CCTV camera of the facility of the POI is simultaneously displayed and the surrounding situation video is output.

In addition, the method comprises the steps of displaying an event on the 3D Map screen of the 3D client 101 of the subway station, displaying the history of the facility and the operation status and control status of the equipment, and providing a control screen when control is required (S54) ).

The above method is performed by a virtual patrol when an alarm informing of the device code / line, status message, occurrence time, and whether or not confirmation occurs in the 3D Map screen for each floor of the subway station of the 3D client 101 connected to the 3D server 100 1 Further comprising the step of providing a first person mode virtual experience (S30).

The method receives and stores image data of each camera from a plurality of cameras installed in each area of the subway station through an image storage server (NVR server), and 3D at least one camera image stream data stored in the image storage server. Transmitting to the client 101;

The 3D client 101 renders the background and objects of the POI of each floor structure of the 3D modeled subway station and displays them on a 3D Map screen, and a width x height set on the 3D Map screen. ) Further comprising outputting specific camera image data related to the corresponding facility to a CCTV camera image area of a predetermined size.

In the above method, in order to view a specific camera video stream data related to a corresponding facility in a CCTV camera video area of a predetermined size in a full screen, the 3D client 101 may double-click a CCTV camera video screen area in the 3D Map screen or ' When the moving 'event occurs, or when the [Full Screen] menu button is pressed in the menu (S30), the video channel information of the camera (camera IP address and port number, from the 3D client 101 to the video management client 171) Or a device ID, etc.), and the video management client 171 connected to the video storage server (NVR server) 170, the camera in which a 'double click' or 'moving' event connected to the display stream pipeline of the camera occurs And connecting the video stream data of the full screen camera to the 3D client 101 of the control PC and playing the full screen.

The video channel information of the camera uses the camera's IP address and port number, or device ID.

The video management client 171 connected to the video storage server (NVR server) 170 receives video channel information (camera IP address and port number, or device ID, etc.) from the 3D client 101 of the control PC. If it is, the specific camera image stream data of the full screen size of the specific camera (the entire size of the control PC monitor) is directly transmitted to the 3D client 101, and the 3D client 101 is full of the specific camera image stream data of the full screen size. It is played in full screen.

Thereafter, when the 3D client 101 closes the full screen of the corresponding camera displayed on the CCTV control screen, it returns to the 'original display mode' again, and the 3D Map screen of the area of interest in the subway station and the CCTV of a predetermined size on the 3D control screen. Outputs a specific camera image stream data to the camera image area.

In the 3D virtual space of subway history, the background screens and objects on each floor are in a 3D coordinate system (x, y, z, t) depending on the distance from the surrounding objects based on the moving position of the person's first person object. It is displayed in three dimensions by moving spatial coordinates. In the 3D virtual space of subway history, the movement of spatial coordinates with time (t) according to the movement of the camera or a person's first person object is (x1, y1, z1, t1)-> (x2, y2, z2, t2 ), The dimension is changed by the change of the height, width, and length of a polygon composed of polyhedrons and curved surfaces made of points, lines, and faces in the 3D virtual space of subway history, and 3D control The 3D map of each floor of the system's subway history, and the three-dimensional form and shape of the background screen and composition objects are changed to display the 3D map of the subway station, the background screen, and the configuration objects.

The 3D server 100 converts spatial 3D modeled and rendered objects into 3D modeled objects by moving a person's first person object, rotating by a specified angle around a reference axis, and converting the size. , Zoom in / out is applied according to the distance between a person's first person object and surrounding objects.

In the 3D control system, the following technology is used for a person's first person object that can move in a 3D virtual space of subway history.

1) Pan: A person's first person object moves in a 3D virtual space while the cameras distributed in various areas of the subway station are fixed, and the 3D Map of the region of interest and the location of the background and surrounding objects change.

2) Track: 3D Map, background and objects of the area of interest in the subway station are displayed by moving horizontally at the same time depending on the camera's position and shooting angle.

3) Tumble or Orbit: 3D Map and background and surrounding objects of the scene's region of interest corresponding to a camera to which a specific IP address or device ID is assigned while the objects of the subway station are fixed in a 3D virtual space of subway history Are displayed.

4) Dolly: In a 3D virtual space of subway history, a person's first person object moves toward or away from the surrounding objects of subway history by moving the camera in the z-axis vertical direction toward the surrounding objects as they move.

5) Pitch: Rotate the camera around the X axis.

6) Yaw: Rotate the camera around the Y axis.

7) Roll: Rotate the camera around the Z axis.

8) Zoom in / out: Provides a zoom in / out effect of the camera.

9) Depth of Field: The depth of the camera is controlled by the distance between the camera's focus and the object, and the nearest distance and farthest distance values on 3D coordinates (x, y, z, t) over time (t) Adjust.

10) Tilt: The fixed camera moves up and down.

In the 3D virtual space of subway history, the canvas is the part where the background and objects are rendered on the 3D Map, and the objects are objects of the subway history composed in the background screen, and image data is displayed according to the installation position and angle of the camera. The 3D Map of the area of interest in the subway history by location and surrounding objects are displayed based on the person's first person object.

Spatial / visual perception in the 3D virtual space of subway history based on the movement of the camera or first person object as the camera's view or the person's first person object moves in the 3D virtual space of subway history To achieve this, the 3D modeled background and the position coordinates of the objects are transformed into a 3D geometrical surface, and the height, width, and length of the 3D Map, background screen, and surrounding objects that make up the 3D space of the subway area of interest. The dimension is adjusted and displayed by the change of, and the color and texture of the objects whose dimension is changed in the 3D virtual space are expressed and depth information (z-order) can be displayed using color, depth, and alpha blending. have.

The first person mode virtual experience adjusts the height of the z-axis of the eye of a person's first person object in the three-dimensional coordinate system (x, y, z) of subway history, and when the person moves the first person object, a three-dimensional distance from surrounding objects By adjusting the distance / direction / angle to provide the zoom in / out function through geometric rendering, the 3D Map of the area of interest in subway history, the background and objects are displayed as the person's first person object moves through space.

The three-dimensional distance (d) between the center point (A) of a person's first person object and the center point (B) of an object in an area of interest in subway history can be calculated as follows.

식에 의해 계산된다. At time t, if A (a, b, c), B (d, e, f) in the XYZ coordinate system, the center point (A) of the camera or person's first person object and the center point (B) of the object in subway history 3D distance (d) is 3D distance (d)

It is calculated by the equation.

Embodiments according to the present invention may be implemented in the form of program instructions that can be executed through various computer means and can be recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, and data structures alone or in combination. Computer-readable recording media include magnetic media such as storage, hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs, DVDs, and magnetic media such as floptical disks. A hardware device specifically configured to store and execute program instructions, such as magneto-optical media, and ROM, RAM, flash memory, and the like, may be included. Examples of program instructions may include those generated by a compiler and high-level language code executed by a computer using an interpreter as well as machine language code. The hardware device may be configured to operate as one or more software modules to perform the operation of the present invention.

As described above, the method of the present invention is implemented as a program and recorded in a form that can be read using software of a computer (CD-ROM, RAM, ROM, memory card, hard disk, magneto-optical disk, storage device, etc.) ).

Although described with reference to preferred embodiments of the present invention, those skilled in the art variously modify or modify the present invention without departing from the technical spirit and scope of the present invention described in the claims below. It will be understood that it can be carried out.

100: 3D server 101: 3D client
121: event collection server 110: DB server
120: event distribution server 170: video storage server (NVR server)
171: image management client

Claims (13)

A 3D server having a 3D renderer that renders 3D maps, POI backgrounds and facility objects according to events for 3D control of subway history; And
It is connected to the 3D server, DB server, and CCTV camera system, and outputs a specific camera video stream data to a 3D Map screen that displays the operation status, control status, and facility history of facility objects in the subway station and CCTV camera image area of a predetermined size. Includes a control PC with a 3D client installed,
When using the POI button or POI icon to find a specific facility in the subway station, the same facility in the subway station is grouped to display the entire POI for the facility with the same characteristics in the 3D Map, and the user moves to the desired location to the area of interest How to visit the facilities of the
When the cursor is positioned on the POI facility object of the subway station, the 3D server displays facility history information and the state of equipment to the 3D client,
When a POI object of a facility is clicked, the 3D server displays the operation state or control state of the facility to the 3D client,
When 'CCTV Connect' is clicked, the video stream of the adjacent CCTV camera related to the POI facility object is popped up and output,
On each floor of the subway station of the 3D client connected to the 3D server, if an alarm informing the device code / line, status message, occurrence time, or confirmation occurs within the 3D Map screen, on the 3D screen, which provides a virtual experience of the first person mode In the subway history facility history management and condition management system. According to claim 1,
The 3D server is planted with a facility object in a 3D map of the subway station, and the history information, operation state, and control state information of the facility are stored and managed in the DB server, and the 3D client selects a facility, and then selects a specific facility. View the facility with the facility list, or view the facility with the POI button or POI icon, or move the cursor to display the operation status and control status of the facility object and the facility history information on the 3D screen. Facility history management and condition management system. According to claim 1,
Connected to the 3D server, the subway station's facility history management and state management system on a 3D screen further comprising a DB server and storage for storing the operating state and control state of the facilities and facility history. According to claim 1,
Multiple cameras installed in each area of subway history; And
A facility history management and status management system for subway station facilities on a 3D screen further comprising a CCTV camera system having an image storage server that stores and distributes image data shot from the multiple cameras. The method of claim 4,
The video storage server uses a NVR server that stores and distributes the video data of multiple CCTV cameras installed on each floor of the subway station, a facility history management and state management system of the subway station on a 3D screen. delete According to claim 1,
The 3D client displays an event on the 3D Map screen of the subway station, displays the operating state and control state of the facility, and the facility history, and provides a control screen when control is needed. Management and state management system. (a) 3D client is interlocked with 3D server, DB server and video storage server of CCTV camera system, and the 3D server planted each facility object in the 3D Map screen of each floor of subway station, and the facility history information and operation status and The control state is stored, and displaying 3D modeled backgrounds and objects of the region of interest in the subway history as a 3D client by 3D rendering;
(b) After selecting the 'facilities' menu, the 3D client searches for a specific facility as a list of facilities in the subway station, or a POI button or POI icon, or moves the cursor to the operating state and control status of the facility object. Displaying a facility history; And
When an alarm informing of the device code / line, status message, occurrence time, and confirmation occurs in the 3D Map screen for each floor of the subway history of the 3D client connected to the 3D server, providing a first person mode virtual experience. ,
When searching for a specific facility in the subway station using the POI button or the POI icon, the same facility in the subway station is grouped to display the entire POI for the facility having the same characteristics in a 3D Map, and the user moves to a desired location. Use the method to visit the facilities in the area of interest,
In step (b), when the cursor is positioned on the POI facility object of the subway station, the 3D server displays facility history information and the state of equipment to the 3D client,
The step (b) comprises: (b2) when a POI object of a facility is clicked, the 3D server displays an operation state or a control screen of the facility to the 3D client; And (b3) when 'CCTV connection' is selected, popping up and outputting a video stream of an adjacent CCTV camera related to the POI object of the facility on a 3D Map screen, and managing facility history and status management of the subway station on the 3D screen. Way. The method of claim 8,
Step (b) is
When searching using the POI button or the POI icon, group the same facilities in the subway station to display the entire POI for the facilities having the same characteristics on the 3D Map, and move the user to the desired location to find the facility in the area of interest Using
For each facility in the subway history 3D Map, information and facility history of each POI object of the 3D server are displayed / entered, and the corresponding facility history, operation status, and control status are displayed.
The facility history includes the equipment name, installation company, SW version, name of person in charge, telephone number, date of facility inspection, name and phone number of the person in charge of facility inspection, and management of facility history of subway history on a 3D screen. State management methods. delete The method of claim 8,
(c) When the 'CCTV connection' menu of the facility is selected, the history of the facility in the subway station is managed on the 3D screen, which further includes the step of simultaneously displaying and outputting a video stream of the surrounding situation of a specific CCTV camera adjacent to the POI facility object. State management methods. The method of claim 8,
Displaying an event on the 3D Map screen of the subway station, displaying the history of related facilities and equipment status, and providing a control screen when control is required. State management methods. delete

Images