Summary of the invention:
A kind of watch-dog and method that combines with electronic chart by the video calibration that provide is provided, pass through software platform, can realize video content is calibrated and be presented in real time on the electronic chart so that the supervision content of video camera and map location information are combined closely in conjunction with the Internet video access device, the overall situation, show the monitor state that current region is real-time intuitively.
For reaching above-mentioned purpose, the present invention adopts following technical scheme:
A kind of watch-dog that combines with electronic chart by the video calibration, comprise: front-end camera 1 connects video access device 2, video access device 2 interconnection network transmission equipments 6, web-transporting device 6 connects PC server 4, and PC server 4 connects software platform 3 and display device 5.
Front-end camera is web camera 9, and it is directly by the mode access software platform 3 of web-transporting device 6 with network.
A kind of method for supervising that combines with electronic chart by the video calibration may further comprise the steps:
Step 201, with Network Video Surveillance equipment access software platform, software platform and video access device Adoption Network mode communicate;
Step 202, unlatching software platform add the video access device at software platform;
Step 203, calibration: on software platform, the single channel video flowing is carried out frame and extract, some check points and the coordinate points on the electronic chart extracted on the frame are carried out Coordinate Conversion calculating and demarcated, form map and coordinate mapping table one;
Step 204, calibration arrangements: the map and the coordinate mapping table two that map and coordinate mapping table one are obtained all pixels in the middle of the video extraction frame by the calibration algorithm computing;
Step 205, video correction: the video coordinates point is carried out the adjustment of 3 d pose, overlook so that original visual field, side becomes, realize that finally the image of single frame of video carries out correct demonstration at electronic chart;
Step 206, repeating step 203 and step 204 realize calibration and the correction of a plurality of frame of video on map, and a plurality of videos in the guarded region are corrected on the correspondence position of map, present complete, area monitoring state intuitively.
Its software platform comprises:
Video access unit 501 is used for the video image of the rig camera in the access zone, comprises access device searched interpolation, parameter setting, decoding video stream;
Calibration arrangements unit 502, be used for arranging the location point of video content of shooting of video camera and the position on the corresponding map, and set up both mapping tables, according to the location point on the camera video and the position corresponding relation on the map, calculate upper the putting of all pixel place maps of each frame of video in conjunction with calibration algorithm;
Video correction unit 503, be used for the 3 d pose adjustment that the realization video image shows at electronic chart, form the overlook picture consistent with the electronic chart impression, and adjust size to adapt to the demonstration of electronic chart, realize that video shows and consistency and the continuity of electronic chart static images with environmental parameter, such as monitoring blind area road and the seamless connection of monitoring road on map;
Map edit unit 504 for the electronic chart of editor and adjustment region, comprises that importing, terrain feature edit, the video camera overlay area of map set, the related setting of viewing area video;
Electronic chart shows, refresh in real time electronic chart, the video flowing real time calibration is shown to this map, if having, a wide area monitoring zone is connected the rig camera that covers fully, then can realize utilizing the real time correction video image to replace original static electronic chart, realize the wide area real-time dynamic monitoring, be conducive to association analysis and high-efficiency dynamic decision-making commander to motion event in the zones of different;
Base unit 505: the basic software information of login user authority, daily record, look ﹠ feel that is used for arranging software;
Each above-mentioned unit is all in the middle of same software interface.
Described calibration arrangements flow process is:
Step 301: the user logins software platform, enters the calibration arrangements interface;
Step 302: in map display area, set associated images and video overlay area, two field picture in the crawl video flowing, in extracting frame and map display area, two identical letter information points are carried out coordinate and demarcate, repeat to demarcate and form map and coordinate mapping table one;
Step 303: demarcate quantity until reach the required iterative value of programmed algorithm computing---information point number;
Step 304: call calibration algorithm, substitution map and coordinate mapping table one carry out obtaining behind the sequential operation map and the coordinate mapping table two of full figure vegetarian refreshments;
Step 305: can export the video still frame that extracts after frame is proofreaied and correct at electronic chart by relation table two, judge by the user whether its Output rusults meets the requirements, as do not meet and then carry out error correction, again extract the video information point that error departs from the zone and carry out the second-order correction computing, realize the correction to error band;
Step 306: the rear user that meets the requirements preserves configuration information and namely finishes and extract corresponding demonstration on frame and the electronic chart final result.
Described video correction flow process is:
At first extract the picture after the above-mentioned calibration, the calibration picture is carried out the three-dimensional simulation rotation, adjust two dimensional image and realize on the sense organ unanimously with the electronic chart sense organ to three dimensional space coordinate, form final map and coordinate mapping table three; Next utilize the final demonstration of video calibration chart picture on the data formation electronic chart of relation table three; Repeat thus to arrange all control points on the electronic chart, after preserving configuration information, open real-time watching mode, system brings into operation, begin by gathering a frame image data, utilize calibration algorithm and sequential operation multi-frame video stream can be transformed in real time, soon the pixel of frame of video prints to the correspondence position on the electronic chart; System refreshes electronic chart in real time according to video flowing frame speed, namely can observe whole panorama and merges emulating image, is equivalent to a whole guarded region of satellite vertical irradiation; Realize that thus omnibearing video surveillance point is connected and the multidate information demonstration.
Adopt above-mentioned technology, the present invention has following some advantages:
The one, monitoring visual field is wider, can show intuitively the motor behavior relevance between related rig camera.Traditional video wall generally all is made of several display screens, and is similar such as its scenery of a plurality of monitored pictures on the stretch during especially to the supervision of similar scenery, is not easy to distinguish the relevance of adjacent pictures, easily produces long afterwards visual fatigue and just look at.And the employing present technique can be found out the dynamic menu in each outdoor scene zone very intuitively, to the relevance of object of which movement grasp comprehensively, directly perceived.
The 2nd, replace the video wall of a plurality of screens fully, only need a large-screen can realize the dynamic behaviour in the whole guarded region is monitored.Traditional video wall needs a lot of display screens, has objectively wasted certain resource, and present technique adopts the mode of panorama reproduction, has realized the display effect of a plurality of screens with a screen.
The 3rd, early warning is quicker.The mode that adopts panorama to reproduce, after early warning information occurring in the picture, can see that not only the early warning picture can also see the related image on the movement direction of object fast, realize that continuity traces and monitors, be conducive to decision-making commander and fast response, especially be fit to security monitoring.
Embodiment:
Below in conjunction with drawings and Examples the present invention is described in further detail.
Consult Fig. 1-shown in Figure 5, be the embodiment of the invention, as shown in Figure 1, a kind of supervision method system construction drawing that combines with electronic chart by the video calibration in video monitoring that the embodiment of the invention provides the present invention includes: front-end camera 1, video access device 2, software platform 3, PC server 4, display device 5, web-transporting device 6 etc.
Further: the video camera 1 of front end is if analog video camera or optical fiber video camera then must carry out network insertion by built-in hard disk video tape recorder or video encoder (video server) in addition.
Further: video access device 2 can be: the Network Video Surveillance equipment such as industrial control type video recording memory device, built-in hard disk video tape recorder, network video coder, network video server, network memory, Streaming Media forwarding server.Adopt the Streaming Media forwarding server to transmit the mode of video flowing, can realize integral body access and the compatibility of a plurality of distinct devices, a plurality of vendor equipment are shown by middleware software, integrate high definition and SD equipment.
Network video device in the further described system: the PC server 7, video access device 2, web-transporting device 8 (switch, router, gateway etc.), web camera 9, streaming media server 10 etc. that software platform is installed all Adoption Network connect.
As shown in Figure 2, the flow chart of a kind of supervision method that in video monitoring, combines with electronic chart by video calibration of providing of the embodiment of the invention:
Comprise:
Step 201, with Network Video Surveillance equipment access software platform, software platform and video access device Adoption Network mode communicate.
Further: analog video camera adopts built-in hard disk video tape recorder or video encoder to access, and web camera is connected the mode that the video encoder Adoption Network connects and is linked into software platform with built-in hard disk video tape recorder.
Its vision signal of described analog video camera accesses built-in hard disk video tape recorder by coaxial cable, and described video network equipment is the video network equipment with the same communications protocols, and the equipment of different brands needs to adopt in addition middleware module to transform.
Step 202, unlatching software platform add the video access device at software platform: built-in hard disk video tape recorder, video encoder, web camera, Streaming Media forwarding server etc.Realize browsing monitoring image at software.
Further: adopt the mode of Streaming Media forwarding server, can realize integral body access and the compatibility of a plurality of distinct devices, a plurality of vendor equipment are shown by middleware software, comprise high definition and SD equipment.
Further: software platform can carry out modification and management on the parameter to the network video device of access.
Step 203, calibration: on software platform, the single channel video flowing is carried out frame and extract, some check points and the coordinate points on the electronic chart extracted on the frame are carried out Coordinate Conversion calculating and demarcated, form map and coordinate mapping table one.Check point is limit, the angle that obvious boundary is arranged on the electronic chart, such as four jiaos in road boundary line, house etc.
Step 204, calibration arrangements: the map and the coordinate mapping table two that map and coordinate mapping table one are obtained all pixels in the middle of the video extraction frame by the calibration algorithm computing.Display position and the viewing area of single-frame images on electronic chart namely is defined thus.
Step 205, video correction: the video coordinates point is carried out the adjustment of 3 d pose, overlook so that original visual field, side becomes, realize that finally the image of single frame of video carries out correct demonstration at electronic chart.By video correction, can make video pictures be presented on the electronic chart more closing to reality, road such as the taken straight line of a certain camera, because the angle of taking, so that the width of the road of camera near-end is larger, gradually to extending at a distance, it is more and more less that the width of road also becomes, after road is calibrated to electronic chart, obtaining video effect is, the road that diminishes of far-end is stretched, and the road width near-end is consistent to far-end, and the position of the content of video is more consistent with electronic chart.Simultaneously scene is carried out the adjustment of 3 d pose, so that be presented on the impression that the video pictures on the electronic chart is more pressed close to electronic chart---vertically overlook, further realize continuity and consistency on the scenery mark on video camera overlay area and the blind area electronic chart.
Further, live video stream is comprised of some frame of video, by calibration algorithm and map and coordinate mapping table two, live video stream emulation can be shown to electronic chart in real time.
Step 206, repeating step C and step D realize calibration and the correction of a plurality of frame of video on map, and a plurality of videos in the guarded region are corrected on the correspondence position of map, present complete, area monitoring state intuitively.If the interior video camera in zone can realize that seamless zone covers, what then replace electronic chart will be the in real time panoramic video fusion picture of dynamic comprehensive video information of a demonstration, just as the satellite vertical view.
Further, the video pictures after the calibration is supported translation and convergent-divergent.
Further, consult Fig. 5 software platform and comprise following construction unit:
Video access unit 501 is for the video image of the rig camera in the access zone.Comprise access device searched interpolation, parameter setting, decoding video stream etc.
Calibration arrangements unit 502 is used for arranging the location point of video content of shooting of video camera and the position on the corresponding map, and sets up both mapping tables.According to the location point on the camera video and the position corresponding relation on the map, calculate upper the putting of all pixel place maps of each frame of video in conjunction with calibration algorithm.
Video correction unit 503, be used for the 3 d pose adjustment that the realization video image shows at electronic chart, form the overlook picture consistent with the electronic chart impression, and adjust size to adapt to the demonstration of electronic chart, realize that video shows and consistency and the continuity of electronic chart static images with environmental parameter.As monitor the blind area road and monitor the seamless connection of road on map.
Map edit unit 504 is used for the electronic chart of editor and adjustment region, comprises that importing, terrain feature edit, the video camera overlay area of map set, the related setting of viewing area video etc.
Electronic chart shows, refreshes in real time electronic chart, and the video flowing real time calibration is shown to this map.If having, a wide area monitoring zone is connected the rig camera that covers fully, then can realize utilizing the real time correction video image to replace original static electronic chart, realize the wide area real-time dynamic monitoring, be conducive to association analysis and high-efficiency dynamic decision-making commander to motion event in the zones of different.
Base unit 505: for basic software informations such as the login user authority that software is set, daily record, look ﹠ feels.
Each above-mentioned unit is all in the middle of same software interface.
Consult shown in Figure 3ly, further set forth the calibration arrangements flow chart that the embodiment of the invention provides.
Step 301: the user logins software platform, enters the calibration arrangements interface;
Step 302: in map display area, set associated images and video overlay area.The two field picture of crawl in the video flowing carries out coordinate with two identical letter information points and demarcates in extracting frame and map display area.Repeat to demarcate formation map and coordinate mapping table one.
Step 303: demarcate quantity until reach the required iterative value of programmed algorithm computing---information point number.
Step 304: call calibration algorithm, substitution map and coordinate mapping table one carry out obtaining behind the sequential operation map and the coordinate mapping table two of full figure vegetarian refreshments.
Step 305: can export the video still frame that extracts after frame is proofreaied and correct at electronic chart by relation table two, judge by the user whether its Output rusults meets the requirements, as do not meet and then carry out error correction, again extract the video information point that error departs from the zone and carry out the second-order correction computing, realize the correction to error band.
Step 306: the rear user that meets the requirements preserves configuration information and namely finishes and extract corresponding demonstration on frame and the electronic chart final result.
Further consult the video correction flow chart that Fig. 4 embodiment of the invention provides, the video correction flow process is set forth.At first extract the picture after the above-mentioned calibration, the calibration picture is carried out the three-dimensional simulation rotation, adjust two dimensional image and realize on the sense organ unanimously with the electronic chart sense organ to three dimensional space coordinate, form final map and coordinate mapping table three.Next utilize the final demonstration of video calibration chart picture on the data formation electronic chart of relation table three.Repeat thus to arrange all control points on the electronic chart, after preserving configuration information, open real-time watching mode, system brings into operation, begin by gathering a frame image data, utilize calibration algorithm and sequential operation multi-frame video stream can be transformed in real time, soon the pixel of frame of video prints to the correspondence position on the electronic chart.System refreshes electronic chart in real time according to video flowing frame speed, namely can observe whole panorama and merges emulating image, is equivalent to a whole guarded region of satellite vertical irradiation.Realize that thus omnibearing video surveillance point is connected and the multidate information demonstration.
Adopt the present invention to have and be not limited to following some advantages:
The one, monitoring visual field is wider, can show intuitively the motor behavior relevance between related rig camera.Traditional video wall generally all is made of several display screens, and is similar such as its scenery of a plurality of monitored pictures on the stretch during especially to the supervision of similar scenery, is not easy to distinguish the relevance of adjacent pictures, easily produces long afterwards visual fatigue and just look at.And the employing present technique can be found out the dynamic menu in each outdoor scene zone very intuitively, to the relevance of object of which movement grasp comprehensively, directly perceived.
The 2nd, replace the video wall of a plurality of screens fully, only need a large-screen can realize the dynamic behaviour in the whole guarded region is monitored.Traditional video wall needs a lot of display screens, has objectively wasted certain resource, and present technique adopts the mode of panorama reproduction, has realized the display effect of a plurality of screens with a screen.
The 3rd, early warning is quicker.The mode that adopts panorama to reproduce, after early warning information occurring in the picture, can see that not only the early warning picture can also see the related image on the movement direction of object fast, realize that continuity traces and monitors, be conducive to decision-making commander and fast response, especially be fit to security monitoring.
Need to prove, those having ordinary skill in the art will appreciate that all or part of flow process that realizes in above-described embodiment method, to carry out relevant hardware by computer program to finish, described program can install the storage with the PC server on storage medium, change program when carrying out, can comprise the embodiment flow process of said method.
The above is preferred embodiment of the present invention, in all some improvement and the protection range of change distance in right of the present invention carrying out under the prerequisite of the principle of the invention.