CN108521605A - The playback method and play system of remote sensing video - Google Patents
The playback method and play system of remote sensing video Download PDFInfo
- Publication number
- CN108521605A CN108521605A CN201810328624.4A CN201810328624A CN108521605A CN 108521605 A CN108521605 A CN 108521605A CN 201810328624 A CN201810328624 A CN 201810328624A CN 108521605 A CN108521605 A CN 108521605A
- Authority
- CN
- China
- Prior art keywords
- image
- frame
- remote sensing
- coordinates
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 238000001514 detection method Methods 0.000 claims abstract description 16
- 238000004458 analytical method Methods 0.000 claims abstract description 10
- 230000008569 process Effects 0.000 claims description 14
- 238000006243 chemical reaction Methods 0.000 claims description 9
- 241000668842 Lepidosaphes gloverii Species 0.000 claims description 5
- 230000008859 change Effects 0.000 claims description 5
- 238000012935 Averaging Methods 0.000 claims description 4
- 238000009790 rate-determining step (RDS) Methods 0.000 abstract 1
- 238000000605 extraction Methods 0.000 description 5
- 238000002372 labelling Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 108091092878 Microsatellite Proteins 0.000 description 2
- 230000003321 amplification Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 241000282414 Homo sapiens Species 0.000 description 1
- 102100029469 WD repeat and HMG-box DNA-binding protein 1 Human genes 0.000 description 1
- 101710097421 WD repeat and HMG-box DNA-binding protein 1 Proteins 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009432 framing Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 239000004576 sand Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4314—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10032—Satellite or aerial image; Remote sensing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
A kind of playback method and play system of remote sensing video, the playback method include：Video playing and rate-determining steps are used to open remote sensing video and control video playing；And pixel geographical coordinate real-time display step；The wherein described pixel geographical coordinate real-time display step includes：Specific location information (the x in broadcast window is obtained in real times, ys), it is converted into the image coordinate (x of each frame imageI, yI), then it is reconverted into geographical coordinate (xg, yg).The present invention has the functions such as moving target, tracking and analysis concern target in real-time display remote sensing video data geography information, Zoom display part region-of-interest, automatic detection remote sensing video data, is conducive to the comprehensive displaying and analysis of remote sensing video data abundant information.
Description
Technical Field
The invention belongs to the technical field of video processing, and particularly relates to a playing method and a playing system of a remote sensing video.
Background
The remote sensing earth observation technology is one of the important means for acquiring earth space geographic information by human beings at present, and has irreplaceable effects on various aspects such as economic construction, social development, national security, people's life and the like. With the continuous improvement of the microsatellite technology in recent years, the microsatellite on orbit and about to be transmitted generally has extremely strong maneuverability, and can obtain remote sensing video data of a target area through a staring imaging mode.
However, at the present stage, there are no video playing software and technical solution suitable for displaying remote sensing video data, the remote sensing video data can only be played through ordinary video playing software, and the playing process can only achieve conventional video playing effects such as pause and playing speed adjustment, which cannot fully display the rich information contained in the remote sensing video data acquired by the high maneuvering satellite. The following disadvantages exist in playing remote sensing video through common video playing software: (1) the remote sensing video data has the characteristic of large coverage, but the attention target often only exists in a local area, and the target area cannot be highlighted in the conventional video playing process; (2) the remote sensing video data is still a remote sensing observation data in essence, the image of the remote sensing video data has a geographical position attribute, and the common video playing software cannot show the spatial information corresponding to the data; (3) one large application direction of remote sensing video data is observation of dynamic targets, including automatic detection and tracking marking of dynamic targets, which is not provided by existing video playing software.
In a word, the characteristics of remote sensing video data are not considered in the existing video playing and displaying method, rich information contained in the remote sensing data cannot be comprehensively displayed, and a video playing and displaying method oriented to the characteristics of the remote sensing video data is needed.
Disclosure of Invention
In order to solve the problems in the prior art, the invention provides a method and a system suitable for remote sensing video data information display and analysis application.
In order to achieve the above object, in one aspect, the present invention provides a method for playing a remote sensing video, including:
a video playing and controlling step, which is used for opening the remote sensing video and controlling the video playing; and
displaying the geographic coordinates of the pixels in real time;
wherein the step of displaying the geographic coordinates of the pixels in real time comprises the following steps: obtaining specific position information (x) in a play window in real times，ys) Converting it into image coordinates (x) of each frame imageI，yI) Then converted into geographic coordinates (x)g，yg)。
Preferably, when the remote sensing video data has geographic positioning information, the 6-parameter g of positioning is adopted0，...，g5When geometric positioning is carried out, the image coordinate (x)I，yI) Conversion to geographical coordinates (x)g，yg) The formula of (1) is:
xg＝g0+g1*xI+g2*yI
yg＝g3+g4*xI+g5*yI：
when the remote sensing video data has the RPC positioning coefficient, converting the image coordinate into the geographic coordinate according to the RPC coefficient, wherein the conversion model is as follows:
wherein,
NumL(P，L，H)＝a1+a2L+a3P+a4H+a5LP+a6LH+a7PH+a8L2+a9P2+a10H2+a11PLH+a12L3+a13LP2+a14LH2+a15L2P+a16P3+a17PH2+a18L2H+a19P2H+a20H3
Nums(P，L，H)＝c1+c2L+c3P+c4H+c5LP+c6LH+c7PH+c8L2+c9P2+c10H2+c11PLH+c12L3+c13LP2+c14LH2+c15L2P+c16P3+c17PH2+c18L2H+c19P2H+c20H3
DenL(P，L，H)＝b1+b2L+b3P+b4H+b5LP+b6LH+b7PH+b8L2+b9P2+b10H2+b11PLH+b12L3+b13LP2+b14LH2+b15L2P+b16P3+b17PH2+b18L2H+b19P2H+b20H3
Dens(P，L，H)＝d1+d2L+d3P+d4H+d5LP+d6LH+d7PH+d8L2+d9P2+d10H2+d11PLH+d12L3+d13LP2+d14LH2+d15L2P+d16P3+d17PH2+d18L2H+d19P2H+d20H3
wherein, an，bnAnd cnFor the RPC parameters, P, L and H are normalized ground coordinates, and X and Y are normalized image plane coordinates, the relationship between which is shown as:
wherein LAT _ OFF, LAT _ SCALE, LONG _ OFF, LONG _ SCALE, HEIGHT _ OFF, and HEIGHT _ SCALE are regularization parameters of ground coordinates, SAMPLE _ OFF, SAMPLE _ SCALE, LINE _ OFF, and LINE _ SCALE are regularization parameters of image coordinates,
according to image coordinates (x)I，yI) And calculating corresponding geographic coordinates (x) by utilizing a least square principle iteration solutiong，yg)。
Preferably, the playing method further includes a moving target detection step, and the moving target detection step includes:
firstly, reading each frame data of the remote sensing video, adding each frame data and averaging to obtain a background image,
and then, normal video playing is carried out, difference value operation is carried out on each frame data and the reference image in the playing process, pixels with the difference values larger than the threshold value T are marked as moving targets, and the moving targets are displayed in a playing window in real time.
Preferably, the playing method further includes a local area enlarging step for realizing local enlargement of the selected area, where the local area enlarging step includes selecting a target area, recording coordinate information of the target area, obtaining zoom selection frame information Rect, and intercepting the full-window display image Is' frame selection Rect range image dataAnd scaled to the window size N × M for display.
Preferably, the playing method further comprises a target tracking and analyzing step, and the target tracking and analyzing step comprises:
firstly, selecting a frame selection range including a tracking target, and taking out image data of a current frame in the frame selection range as a tracking target ItThe coordinate of the image where the moving object is located is (x)I，yI)nThe geographic coordinate of which is (x)g，yg)nWherein n is the number of the current image frame;
secondly, obtaining a tracking target I in each subsequent frame by using a target tracking algorithmtAt the position in the subsequent frame, the target area detected in each frame data is displayed in a frame selection mode, and the tracking target I is recordedtThe coordinates of the image are (x)I，yI)n+mThe geographic coordinate of which is (x)g，yg)n+mWherein n + m is the number of the current image frame, and preferably, the target tracking algorithm is a meanshift algorithm;
finally, according to the tracking target ItIn the motion process among frames of the remote sensing video, the change information of the geographic coordinates and the acquisition frequency F of the remote sensing video are based0A tracking target I can be obtainedtVelocity v ═ x of movement of (1 ═ d [ (. x) ]g，yg)n+m-(xg，yg)n)*F0*m。
In one aspect, the present invention provides a system for playing a remote sensing video, including:
the video playing and controlling module is used for opening the remote sensing video and controlling the video playing; and
a pixel geographic coordinate real-time display module;
the pixel geographic coordinate real-time display module is used for realizing the following functions: obtaining specific position information (x) in a play window in real times，ys) Convert it intoFor the image coordinates (x) of each frame imageI，yI) Then converted into geographic coordinates (x)g，yg)。
Preferably, when the remote sensing video data has geographic positioning information, the 6-parameter g of positioning is adopted0，...，g5When geometric positioning is carried out, the image coordinate (x)I，yI) Conversion to geographical coordinates (x)g，yg) The formula of (1) is:
xg＝g0+g1*xI+g2*yI
yg＝g3+g4*xI+g5*yI；
when the remote sensing video data has the RPC positioning coefficient, converting the image coordinate into the geographic coordinate according to the RPC coefficient, wherein the conversion model is as follows:
wherein,
NumL(P，L，H)＝a1+a2L+a3P+a4H+a5LP+a6LH+a7PH+a8L2+a9P2+a10H2+a11PLH+a12L3+a13LP2+a14LH2+a15L2P+a16P3+a17PH2+a18L2H+a19P2H+a20H3
Nums(P，L，H)＝c1+c2L+c3P+c4H+c5LP+c6LH+c7PH+c8L2+c9P2+c10H2+c11PLH+c12L3+c13LP2+c14LH2+c15L2P+c16P3+c17PH2+c18L2H+c19P2H+c20H3
DenL(P，L，H)＝b1+b2L+b3P+b4H+b5LP+b6LH+b7PH+b8L2+b9P2+b10H2+b11PLH+b12L3+b13LP2+b14LH2+b15L2P+b16P3+b17PH2+b18L2H+b19P2H+b20H3
Dens(P，L，H)＝d1+d2L+d3P+d4H+d5LP+d6LH+d7PH+d8L2+d9P2+d10H2+d11PLH+d12L3+d13LP2+d14LH2+d15L2P+d16P3+d17PH2+d18L2H+d19P2H+d20H3
wherein, an，bnAnd cnFor the RPC parameters, P, L and H are normalized ground coordinates, and X and Y are normalized image plane coordinates, the relationship between which is shown as:
wherein LAT _ OFF, LAT _ SCALE, LONG _ OFF, LONG _ SCALE, HEIGHT _ OFF, and HEIGHT _ SCALE are regularization parameters of ground coordinates, SAMPLE _ OFF, SAMPLE _ SCALE, LINE _ OFF, and LINE _ SCALE are regularization parameters of image coordinates,
according to image coordinates (x)I，yI) And calculating corresponding geographic coordinates (x) by utilizing a least square principle iteration solutiong，yg)。
Preferably, the playing system further includes a moving target detection module, and the moving target detection module is configured to implement the following functions:
firstly, reading each frame data of the remote sensing video, adding each frame data and averaging to obtain a background image,
and then, normal video playing is carried out, difference value operation is carried out on each frame data and the reference image in the playing process, pixels with the difference values larger than the threshold value T are marked as moving targets, and the moving targets are displayed in a playing window in real time.
Preferably, the playing system further comprises a local area enlargement module for realizing local enlargement of the selected area, and the local area enlargement module is used for realizing the following functions: selecting a target area, recording coordinate information of the target area to obtain zoom selection frame information Rect, and intercepting a full-window display image Is' select the image data in the frame Rect range and zoom to the window size N M for display.
Preferably, the playback system further comprises a target tracking and analyzing module, and the target tracking and analyzing module is configured to implement the following functions:
firstly, selecting a frame selection range including a tracking target, and taking out image data of a current frame in the frame selection range as a tracking target ItThe coordinate of the image where the moving object is located is (x)I，yI)nThe geographic coordinate of which is (x)g，yg)nWherein n is the number of the current image frame;
secondly, obtaining a tracking target I in each subsequent frame by using a target tracking algorithmtAt the position in the subsequent frame, the target area detected in each frame data is displayed in a frame selection mode, and the tracking target I is recordedtThe coordinates of the image are (x)I，yI)n+mThe geographic coordinate of which is (x)g，yg)n+mWherein n + m is the number of the current image frame, and preferably, the target tracking algorithm is a meanshift algorithm;
finally, according to the tracking target ItIn the motion process among frames of the remote sensing video, the change information of the geographic coordinates and the acquisition frequency F of the remote sensing video are based0A tracking target I can be obtainedtVelocity v ═ x of movement of (1 ═ d [ (. x) ]g，yg)n+m-(xg，yg)n)*F0*m。
Compared with the prior art, the invention has the advantages that:
(1) the novel remote sensing video playing method and system applied to moving object display and analysis are provided, the problem that conventional playing software is not suitable for displaying and analyzing remote sensing video data is solved, the functions of displaying geographic information of the remote sensing video data in real time, displaying a local attention area in a zooming mode, automatically detecting a moving object in the remote sensing video data, tracking the attention object and the like are achieved, and all-dimensional display and analysis of rich information of the remote sensing video data are facilitated.
(2) The novel remote sensing video data display and analysis mode comprises a play control area, a spatial information display area, a shortcut key control description area and an image display area, play, pause, moving target detection and the like are controlled through buttons, and functions of local area amplification, initial tracking target selection and the like are achieved through a mode of adding a mouse picture frame to a combined button.
Drawings
FIG. 1 is a display interface of a playback system according to an embodiment of the present invention;
FIG. 2 is a partial area enlargement function display of the playing system in the embodiment of the present invention;
FIG. 3 is a result of manually selecting an attention target of the playing system according to an embodiment of the present invention;
FIG. 4 is a drawing illustrating the result of the automatic tracking of the target of interest and the extraction of motion information of the playing system according to an embodiment of the present invention;
FIG. 5 is a drawing illustrating the result of the automatic tracking of the target of interest and the extraction of motion information by the playback system in the embodiment of the present invention;
fig. 6 is a display result of the automatic tracking of the target of interest and the extraction of motion information of the playing system in the embodiment of the present invention.
Detailed Description
In order that the objects, technical solutions and advantages of the present invention will become more apparent, the present invention will be further described in detail with reference to the accompanying drawings in conjunction with the following specific embodiments.
Aiming at the characteristics of remote sensing video data, the invention provides a remote sensing video data playing method and system applied to moving object display and analysis, and compared with the prior art, the scheme has the advantages that: 1) providing a local zooming function, so that a local area in the concerned remote sensing video data can be conveniently displayed; 2) providing a geographic information real-time display function, and displaying the geographic positioning attribute of the remote sensing video data; 3) providing an automatic moving target detection function, and quickly detecting a target which changes in video data; 4) providing functions of marking and tracking a moving target concerned by a user in real time, and marking the position of the target of interest in real time; 5) and a moving target moving information acquisition function is provided, and information such as moving speed of the moving target is displayed in real time.
The remote sensing video data playing method and system provided by the invention have the following main functions:
1) video playback and related control functions
Firstly: acquiring a path of remote sensing video data from a local machine, and loading a remote sensing video file;
secondly, the method comprises the following steps: reading each frame image I in the remote sensing video during playingsSubscript s is frame number, image IsC, R, obtaining the size N × M of the playing window, and scaling each frame image to the corresponding size of the playing window to obtain a full-window display image I'sPlaying each frame of image according to the set frame frequency F sequence, playing the video in the playing window, and realizing playing the video and pausing the playing;
finally, the playing speed is controlled by adjusting the frame frequency F, so as to realize the accelerated playing and the decelerated playing, as shown in fig. 1.
2) Local area magnification function
Selecting a target area, recording coordinate information of the target area to obtain zoom frame selection information Rect, and intercepting a full-window display image I'sAnd image data in the range of the middle selection frame Rect is zoomed into a window size NxM to be displayed, so that a local area magnification function is realized, the realization process is shown in figure 2, and the dynamic process of airplane landing can be better observed by zooming the lower right corner area of the video data.
3) Real-time display function of pixel geographic coordinates
Obtaining specific position information (x) in a play window in real times，ys) And converted into image coordinates (x) of each frame imageI，yI) And then converted into geographic coordinates (x)g，yg) ① has geographical location information in the remote sensing video data, namely, the location 6 parameter g is adopted0，...，g5When geometric positioning is carried out, the conversion formula is as follows:
xg＝g0+g1*xI+g2*yI
yg＝g3+g4*xI+g5*yI
② when the remote sensing video data has RPC (rational polymeric coeffients) positioning coefficient, converting image coordinate into geographic coordinate according to the RPC coefficient, connecting three-dimensional coordinate (longitude, latitude, elevation) of ground point with image plane coordinate (row, column) by rational Polynomial, regularizing the ground coordinate and the image point coordinate to-1 and-1 by model to enhance parameter solving stability, and making the model as shown below
NumL(P，L，H)＝a1+a2L+a3P+a4H+a5LP+a6LH+a7PH+a8L2+a9P2+a10H2+a11PLH+a12L3+a13LP2+a14LH2+a15L2P+a16P3+a17PH2+a18L2H+a19P2H+a20H3
Nums(P，L，H)＝c1+c2L+c3P+c4H+c5LP+c6LH+c7PH+c8L2+c9P2+c10H2+c11PLH+c12L3+c13LP2+c14LH2+c15L2P+c16P3+c17PH2+c18L2H+c19P2H+c20H3
DenL(P，L，H)＝b1+b2L+b3P+b4H+b5LP+b6LH+b7PH+b8L2+b9P2+b10H2+b11PLH+bi2L3+b13LP2+b14LH2+b15L2P+b16P3+b17PH2+b18L2H+b19P2H+b20H3
Dens(P，L，H)＝d1+d2L+d3P+d4H+d5LP+d6LH+d7PH+d8L2+d9P2+d10H2+d11PLH+d12L3+d13LP2+d14LH2+d15L2P+d16P3+d17PH2+d18L2H+d19P2H+d20H3
Wherein, an，bn，cnFor the RPC parameters, P, L, H are normalized ground coordinates, X, Y are normalized image coordinates, and the relationship between them is shown as follows:
wherein LAT _ OFF, LAT _ SCALE, LONG _ OFF, LONG _ SCALE, HEIGHT _ OFF, HEIGHT _ SCALE are regularization parameters of ground coordinates. SAMPLE _ OFF, SAMPLE _ SCALE, LINE _ OFF, LINE _ SCALE are regularization parameters for the image coordinates.
According to image coordinates (x)I，yI) According to the least square principle, the corresponding geographic coordinate (x) can be calculated by iterationg，yg). As the mouse moves in the display window, the geographic coordinate information corresponding to the position of the mouse is displayed in real time, as shown in fig. 1, the image coordinates and the geographic coordinates of each position of the remote sensing video data are displayed on the main interface in real time "Spatial information display "area.
4) Moving object detection function
When the moving target detection is carried out, firstly, each frame data of the remote sensing video is read, each frame data is added and averaged to obtain a background image, then normal video playing is carried out, difference value operation is carried out on each frame data and a reference image in the playing process, pixels with the difference values larger than a threshold value T are marked as moving targets, and the moving targets are displayed in a playing window in real time.
5) Target tracking and analysis function
Firstly, selecting a frame selection range including a tracking target, and taking out image data of a current frame in the frame selection range as a tracking target ItThe coordinates of the image where the target is located are (x)I，yI)nThe geographic coordinate of which is (x)g，yg)nWherein n is the number of the current image frame;
secondly, according to the tracking target ItObtaining the position of the target in the subsequent frames by using a target tracking algorithm, such as a meanshift algorithm, in the subsequent frames, framing and displaying the target area detected in the data of each frame, and recording the coordinates of the image where the target is located as (x)I，yI)n+mThe geographic coordinate of which is (x)g，yg)n+mWherein n + m is the number of the current image frame;
finally, according to the motion process of the target among the frames of the remote sensing video, based on the change information of the geographic coordinates and the acquisition frequency F of the remote sensing video0The motion v ═ of the target ((x) can be obtainedg，yg)n+m-(xg，yg)n)*F0M. The following effect of the concerned moving target is shown in the figure, wherein fig. 3 is a frame selected target area as a target for subsequent following, fig. 4, fig. 5, and fig. 6 are the following target labeling results obtained by automatic following, respectively.
The remote sensing video data playing method and system provided by the invention have the functions of conventional playing control of the remote sensing video data, local amplification display of an attention area, automatic detection of a moving target, tracking of the moving target, information extraction and the like, and are beneficial to display and analysis of the remote sensing video data.
Furthermore, the above definitions of the methods are not limited to the specific embodiments mentioned in the examples, and those skilled in the art may make simple modifications or substitutions, for example:
(1) the layout arrangement of the display main interface adopts a left side playing control area, a space information display area, a shortcut key control description area and a right side image display area, can also adopt an up-down layout and the like, and belongs to the scope of the invention as long as the remote sensing video playing control function, the remote sensing video positioning information display function and the video playing area are included.
(2) The remote sensing video playing method and the remote sensing video playing system provided by the invention comprise the following and information extraction functions of an attention target, wherein the attention target is selected through a picture frame, then the attention target is detected by adopting a following algorithm, and the detection result is displayed by the picture frame; and extracting the motion speed information of the target through remote sensing information, and marking the motion speed information near the tracking target. The attention target area can also be labeled by labeling information such as target contour, ellipse labeling and the like, and the attention target area only has the functions of manually labeling the attention target, automatically tracking the moving target and extracting the information, and belongs to the scope of the invention.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are only exemplary embodiments of the present invention and are not intended to limit the present invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A method for playing a remote sensing video is characterized by comprising the following steps:
a video playing and controlling step, which is used for opening the remote sensing video and controlling the video playing; and
displaying the geographic coordinates of the pixels in real time;
wherein the step of displaying the geographic coordinates of the pixels in real time comprises the following steps: obtaining specific position information (x) in a play window in real times，ys) Converting it into image coordinates (x) of each frame imageI，yI) And then converted into geographic coordinates (xg，yg)。
2. The playback method as claimed in claim 1, wherein when the remote sensing video data has geographical location information, location 6 parameter g is used0，...，g5When geometric positioning is carried out, the image coordinate (x)I，yI) Conversion to geographical coordinates (x)g，yg) The formula of (1) is:
xg＝g0+g1*xI+g2*yI
yg＝g3+g4*xI+g5*yI；
when the remote sensing video data has the RPC positioning coefficient, converting the image coordinate into the geographic coordinate according to the RPC coefficient, wherein the conversion model is as follows:
wherein,
NumL(P，L，H)＝a1+a2L+a3P+a4H+a5LP+a6LH+a7PH+a8L2+a9P2+a10H2+a11PLH+a12L3+a13LP2+a14LH2+a15L2P+a16P3+a17PH2+a18L2H+a19P2H+a20H3
Nums(P，L，H)＝c1+c2L+c3P+c4H+c5LP+c6LH+c7PH+c8L2+c9P2+c10H2+c11PLH+c12L3+c13LP2+c14LH2+c15L2P+c16P3+c17PH2+c18L2H+c19P2H+c20H3
DenL(P，L，H)＝b1+b2L+b3P+b4H+b5LP+b6LH+b7PH+b8L2+b9P2+b10H2+b11PLH+b12L3+b13LP2+b14LH2+b15L2P+b16P3+b17PH2+b18L2H+b19P2H+b20H3
Dens(P，L，H)＝d1+d2L+d3P+d4H+d5LP+d6LH+d7PH+d8L2+d9P2+d10H2+d11PLH+d12L3+d13LP2+d14LH2+d15L2P+d16P3+d17PH2+d18L2H+d19P2H+d20H3
wherein, an，bnAnd cnFor the RPC parameters, P, L and H are normalized ground coordinates, and X and Y are normalized image plane coordinates, the relationship between which is shown as:
wherein LAT _ OFF, LAT _ SCALE, LONG _ OFF, LONG _ SCALE, HEIGHT _ OFF, and HEIGHT _ SCALE are regularization parameters of ground coordinates, SAMPLE _ OFF, SAMPLE _ SCALE, LINE _ OFF, and LINE _ SCALE are regularization parameters of image coordinates,
according to image coordinates (x)I，yI) And calculating corresponding geographic coordinates (x) by utilizing a least square principle iteration solutiong，yg)。
3. The playback method as claimed in claim 1, wherein the playback method further comprises a partial region enlargement step for achieving partial enlargement of the selected region, the partial region enlargement step comprising: selecting a target area, recording coordinate information of the target area to obtain zoom selection frame information Rect, and intercepting a full-window display image Is' select the image data in the frame Rect range and zoom to the window size N M for display.
4. The playback method as claimed in claim 1, wherein the playback method further comprises a moving object detection step, the moving object detection step comprising:
firstly, reading each frame data of the remote sensing video, adding each frame data and averaging to obtain a background image,
and then, normal video playing is carried out, difference value operation is carried out on each frame data and the reference image in the playing process, pixels with the difference values larger than the threshold value T are marked as moving targets, and the moving targets are displayed in a playing window in real time.
5. The playback method according to claim 1, wherein the playback method further includes a target tracking and analyzing step that includes:
firstly, selecting a frame selection range including a tracking target, and taking out image data of a current frame in the frame selection range as a tracking target ItThe coordinate of the image where the moving object is located is (x)I，yI)nThe geographic coordinate of which is (x)g，yg)nWherein n is the number of the current image frame;
secondly, obtaining a tracking target I in each subsequent frame by using a target tracking algorithmtAt the position in the subsequent frame, the target area detected in each frame data is displayed in a frame selection mode, and the tracking target I is recordedtThe coordinates of the image are (x)I，yI)n+mThe geographic coordinate of which is (x)g，yg)n+mWherein n + m is the number of the current image frame, and preferably, the target tracking algorithm is a meanshift algorithm;
finally, according to the tracking target ItIn the motion process among frames of the remote sensing video, the change information of the geographic coordinates and the acquisition frequency F of the remote sensing video are based0A tracking target I can be obtainedtVelocity v ═ x of movement of (1 ═ d [ (. x) ]g，yg)n+m-(xg，yg)n)*F0*m。
6. A system for playing a remotely sensed video, comprising:
the video playing and controlling module is used for opening the remote sensing video and controlling the video playing; and
a pixel geographic coordinate real-time display module;
the pixel geographic coordinate real-time display module is used for realizing the following functions: obtaining specific position information (x) in a play window in real times，ys) Converting it into image coordinates (x) of each frame imageI，yI) Then converted into geographic coordinates (x)g，yg)。
7. The playback system of claim 6, wherein when the remote sensing video data has geographic location information, location 6 parameter g is used0，...，g5When geometric positioning is carried out, the image coordinate (x)I，yI) Conversion to geographical coordinates (x)g，yg) The formula of (1) is:
xg＝g0+g1*xI+g2*yI
yg＝g3+g4*xI+g5*yI；
when the remote sensing video data has the RPC positioning coefficient, converting the image coordinate into the geographic coordinate according to the RPC coefficient, wherein the conversion model is as follows:
wherein,
NumL(P，L，H)＝a1+a2L+a3P+a4H+a5LP+a6LH+a7PH+a8L2+a9P2+a10H2+a11PLH+a12L3+a13LP2+a14LH2+a15L2P+a16P3+a17PH2+a18L2H+a19P2H+a20H3
Nums(P，L，H)＝c1+c2L+c3P+c4H+c5LP+c6LH+c7PH+c8L2+c9P2+c10H2+c11PLH+c12L3+c13LP2+c14LH2+c15L2P+c16P3+c17PH2+c18L2H+c19P2H+c20H3
DenL(P，L，H)＝b1+b2L+b3P+b4H+b5LP+b6LH+b7PH+b8L2+b9P2+b10H2+b11PLH+b12L3+b13LP2+b14LH2+b15L2P+b16P3+b17PH2+b18L2H+b19P2H+b20H3
Dens(P，L，H)＝d1+d2L+d3P+d4H+d5LP+d6LH+d7PH+d8L2+d9P2+d10H2+d11PLH+d12L3+d13LP2+d14LH2+d15L2P+d16P3+d17PH2+d18L2H+d19P2H+d20H3
wherein, an，bnAnd cnFor the RPC parameters, P, L and H are normalized ground coordinates, and X and Y are normalized image plane coordinates, the relationship between which is shown as:
wherein LAT _ OFF, LAT _ SCALE, LONG _ OFF, LONG _ SCALE, HEIGHT _ OFF, and HEIGHT _ SCALE are regularization parameters of ground coordinates, SAMPLE _ OFF, SAMPLE _ SCALE, LINE _ OFF, and LINE _ SCALE are regularization parameters of image coordinates,
according to image coordinates (x)I，yI) And calculating corresponding geographic coordinates (x) by utilizing a least square principle iteration solutiong，yg)。
8. The playback system of claim 6, wherein the playback system further comprises a local area enlargement module for performing local enlargement of the selected area, the local area enlargement module being configured to perform the following functions: selecting a target area, recording coordinate information of the target area to obtain zoom selection frame information Rect, and intercepting a full-window display image Is' select the image data in the frame Rect range and zoom to the window size N M for display.
9. The playback system of claim 6, wherein the playback system further comprises a moving object detection module, the moving object detection module being configured to:
firstly, reading each frame data of the remote sensing video, adding each frame data and averaging to obtain a background image,
and then, normal video playing is carried out, difference value operation is carried out on each frame data and the reference image in the playing process, pixels with the difference values larger than the threshold value T are marked as moving targets, and the moving targets are displayed in a playing window in real time.
10. The playback system of claim 6, wherein the playback system further comprises a target tracking and analysis module for implementing the following functions:
firstly, selecting a frame selection range including a tracking target, and taking out image data of a current frame in the frame selection range as a tracking target ItThe coordinate of the image where the moving object is located is (x)I，yI)nThe geographic coordinate of which is (x)g，yg)nWherein n is the number of the current image frame;
secondly, obtaining a tracking target I in each subsequent frame by using a target tracking algorithmtAt the position in the subsequent frame, the target area detected in each frame data is displayed in a frame selection mode, and the tracking target I is recordedtThe coordinates of the image are (x)I，yI)n+mThe geographic coordinate of which is (x)g，yg)n+mWherein n + m is the number of the current image frame, and preferably, the target tracking algorithm is a meanshift algorithm;
finally, according to the tracking target ItIn the motion process among frames of the remote sensing video, the change information of the geographic coordinates and the acquisition frequency F of the remote sensing video are based0A tracking target I can be obtainedtVelocity v ═ x of movement of (1 ═ d [ (. x) ]g，yg)n+m-(xg，yg)n)*F0*m。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810328624.4A CN108521605A (en) | 2018-04-12 | 2018-04-12 | The playback method and play system of remote sensing video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810328624.4A CN108521605A (en) | 2018-04-12 | 2018-04-12 | The playback method and play system of remote sensing video |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108521605A true CN108521605A (en) | 2018-09-11 |
Family
ID=63432470
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810328624.4A Pending CN108521605A (en) | 2018-04-12 | 2018-04-12 | The playback method and play system of remote sensing video |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108521605A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109766830A (en) * | 2019-01-09 | 2019-05-17 | 深圳市芯鹏智能信息有限公司 | A kind of ship seakeeping system and method based on artificial intelligence image procossing |
| CN110012341A (en) * | 2019-04-17 | 2019-07-12 | 北京华宇信息技术有限公司 | Video evidence methods of exhibiting shows device and electronic equipment |
| CN111597496A (en) * | 2020-05-18 | 2020-08-28 | 中国科学院空天信息创新研究院 | Rational polynomial coefficient-based single satellite-borne remote sensing image target height calculation method |
| US11284274B2 (en) * | 2020-05-12 | 2022-03-22 | Verizon Patent And Licensing Inc. | Systems and methods for identifying a service qualification of a unit in a multi-unit building |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120233405A1 (en) * | 2011-03-07 | 2012-09-13 | Madhukar Budagavi | Caching Method and System for Video Coding |
| CN106447738A (en) * | 2016-09-30 | 2017-02-22 | 浙江大学 | Method for quickly overlapping and displaying coastlines on remote sensing image by GDAL and SHAELIB |
| CN106920235A (en) * | 2017-02-28 | 2017-07-04 | 中国科学院电子学研究所 | Star-loaded optical remote sensing image automatic correction method based on the matching of vector base map |
| CN107592573A (en) * | 2017-10-31 | 2018-01-16 | 长光卫星技术有限公司 | Suitable for the audio/video player system of large area array meter level high-resolution satellite |
-
2018
- 2018-04-12 CN CN201810328624.4A patent/CN108521605A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120233405A1 (en) * | 2011-03-07 | 2012-09-13 | Madhukar Budagavi | Caching Method and System for Video Coding |
| CN106447738A (en) * | 2016-09-30 | 2017-02-22 | 浙江大学 | Method for quickly overlapping and displaying coastlines on remote sensing image by GDAL and SHAELIB |
| CN106920235A (en) * | 2017-02-28 | 2017-07-04 | 中国科学院电子学研究所 | Star-loaded optical remote sensing image automatic correction method based on the matching of vector base map |
| CN107592573A (en) * | 2017-10-31 | 2018-01-16 | 长光卫星技术有限公司 | Suitable for the audio/video player system of large area array meter level high-resolution satellite |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109766830A (en) * | 2019-01-09 | 2019-05-17 | 深圳市芯鹏智能信息有限公司 | A kind of ship seakeeping system and method based on artificial intelligence image procossing |
| CN109766830B (en) * | 2019-01-09 | 2022-12-27 | 深圳市芯鹏智能信息有限公司 | Ship target identification system and method based on artificial intelligence image processing |
| CN110012341A (en) * | 2019-04-17 | 2019-07-12 | 北京华宇信息技术有限公司 | Video evidence methods of exhibiting shows device and electronic equipment |
| US11284274B2 (en) * | 2020-05-12 | 2022-03-22 | Verizon Patent And Licensing Inc. | Systems and methods for identifying a service qualification of a unit in a multi-unit building |
| US11736955B2 (en) | 2020-05-12 | 2023-08-22 | Verizon Patent And Licensing Inc. | Systems and methods for identifying a service qualification of a unit in a multi-unit building |
| CN111597496A (en) * | 2020-05-18 | 2020-08-28 | 中国科学院空天信息创新研究院 | Rational polynomial coefficient-based single satellite-borne remote sensing image target height calculation method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108521605A (en) | The playback method and play system of remote sensing video | |
| CN110650368B (en) | Video processing method and device and electronic equipment | |
| EP2553924B1 (en) | Effortless navigation across cameras and cooperative control of cameras | |
| CN104285244B (en) | The method and apparatus of view management for the image-driven of mark | |
| US7522186B2 (en) | Method and apparatus for providing immersive surveillance | |
| Senior et al. | Acquiring multi-scale images by pan-tilt-zoom control and automatic multi-camera calibration | |
| JP4758842B2 (en) | Video object trajectory image composition device, video object trajectory image display device, and program thereof | |
| CN107665505B (en) | Method and device for realizing augmented reality based on plane detection | |
| CN105741325B (en) | A kind of method and movable object tracking equipment of tracked mobile target | |
| CN110148223B (en) | Method and system for concentrating and expressing surveillance video target in three-dimensional geographic scene model | |
| US20110102678A1 (en) | Key Generation Through Spatial Detection of Dynamic Objects | |
| CN107665507B (en) | Method and device for realizing augmented reality based on plane detection | |
| EP3296950A1 (en) | Method and device for blurring a virtual object in a video | |
| JP6610535B2 (en) | Image processing apparatus and image processing method | |
| CN102917171A (en) | Small target locating method based on pixel | |
| CN100514359C (en) | DSP based multiple channel mechanical digital display digital gas meter automatic detection device | |
| WO2021217385A1 (en) | Video processing method and apparatus | |
| WO2011024363A1 (en) | Image display control device, image display control method, and integrated circuit | |
| Albrecht et al. | Omnidirectional video stabilisation on a virtual camera using sensor fusion | |
| CN109001674B (en) | WiFi fingerprint information rapid acquisition and positioning method based on continuous video sequence | |
| WO2022040988A1 (en) | Image processing method and apparatus, and movable platform | |
| CN103020982A (en) | Nonparametric moving object detecting method based on tracking and feedback | |
| CN114047505A (en) | Target detection display control method and device supporting photoelectric cross positioning in radar failure scene | |
| Wang et al. | A playback software applied to remote sensing video information display | |
| Bagheri et al. | Temporal mapping of surveillance video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180911 |