CN117250640B - Method and device for batch management and automatic processing of satellite navigation real-time data streams - Google Patents

Method and device for batch management and automatic processing of satellite navigation real-time data streams Download PDF

Info

Publication number
CN117250640B
CN117250640B CN202310969477.XA CN202310969477A CN117250640B CN 117250640 B CN117250640 B CN 117250640B CN 202310969477 A CN202310969477 A CN 202310969477A CN 117250640 B CN117250640 B CN 117250640B
Authority
CN
China
Prior art keywords
file
data
time
rtcm
data stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310969477.XA
Other languages
Chinese (zh)
Other versions
CN117250640A (en
Inventor
王亮亮
王晨旭
李子申
刘炳成
王宁波
汪亮
王志宇
潘军道
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qilu Aerospace Information Research Institute
Aerospace Information Research Institute of CAS
Original Assignee
Qilu Aerospace Information Research Institute
Aerospace Information Research Institute of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qilu Aerospace Information Research Institute, Aerospace Information Research Institute of CAS filed Critical Qilu Aerospace Information Research Institute
Priority to CN202310969477.XA priority Critical patent/CN117250640B/en
Publication of CN117250640A publication Critical patent/CN117250640A/en
Application granted granted Critical
Publication of CN117250640B publication Critical patent/CN117250640B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S19/00—Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
    • G01S19/01—Satellite radio beacon positioning systems transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
    • G01S19/02—Details of the space or ground control segments
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S19/00—Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
    • G01S19/01—Satellite radio beacon positioning systems transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
    • G01S19/03—Cooperating elements; Interaction or communication between different cooperating elements or between cooperating elements and receivers
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S19/00—Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
    • G01S19/01—Satellite radio beacon positioning systems transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
    • G01S19/13—Receivers
    • G01S19/35—Constructional details or hardware or software details of the signal processing chain
    • G01S19/37—Hardware or software details of the signal processing chain
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/56—Provisioning of proxy services
    • H04L67/565—Conversion or adaptation of application format or content

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radio Relay Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

A method and device for batch management and automatic processing of satellite navigation real-time data streams comprises the following steps: step 1, generating user control information; step 2, checking and storing RTCM data access; step 3, executing a timing task; step 4, converting the RTCM data stream into an RI NEX data stream; step 5, merging the repeated files of multiple time periods; and 6, online service of the data file. Aiming at the real-time RTCM data stream conversion requirement of a plurality of sites, the invention can input the data of the sites to carry out batch management and automatic conversion.

Description

Method and device for batch management and automatic processing of satellite navigation real-time data streams
Technical Field
The invention relates to the technical field of Beidou positioning, in particular to a method and a device for batch management and automatic processing of satellite navigation real-time data streams.
Background
The Beidou foundation enhancement station can observe Beidou satellites in real time and generate data streams in an RTCM (Radio Technical Commission for MARITIME SERVICES, navigation radio technical Committee) format, and the data streams are transmitted to a data distribution center through a special line network by a NTRIP (Networked Transport of RTCM VIA INTERNET Protocol, protocol for RTCM network transmission through the Internet) Protocol and are broadcast to users in real time through the Internet. Real-time and post-positioning with high precision can be performed by using real-time data streams of the Beidou foundation enhancement stations, but post-positioning needs to save RTCM data of stations and convert the RTCM data into corresponding RINEX (RECEIVER INDEPENDENT Exchange Format, data Exchange Format irrelevant to a receiver) observation files, and identification processing can be performed in post-processing software such as GAMIT, BERNESE, so that a foundation enhancement station RTCM data stream batch management and Format conversion system is designed, data storage and conversion of a plurality of Beidou foundation enhancement stations are realized, and post-positioning is convenient. The storage and management of site RTCM data streams can be currently performed in three modes, namely, based on a GNSS (Global Navigation SATELLITE SYSTEM ) receiver, based on receiver-related software and based on third party software. For the existing GNSS receiver, the original data storage and RINEX format conversion are carried out by the receiver, but the mode can only store the observation information of the current site, needs to be configured in advance, and is difficult to realize batch management; the storage and conversion of the data stream can be realized for the random software of the GNSS receiver, but the automation degree is low, and the automatic storage and conversion are mainly realized by using a Windows platform, so that the automatic storage and conversion are difficult to be deployed to a Linux server to realize automatic, batch management and safety control; for the existing third party software including RTKLIB, IGGNtrip and the like, batch storage and conversion of data can be realized, but the data is usually in a console form, the data is difficult to be displayed in real time in a visual mode, the management mode is single, and the management and maintenance of single or multiple station data are difficult.
Disclosure of Invention
Aiming at the problems of low automation degree of site batch management and data conversion in the prior art, the invention aims to provide a method and a device for batch management and automatic processing of satellite navigation real-time data streams.
The invention is realized by the following technical scheme:
The first aspect of the invention provides a method for batch management and automatic processing of satellite navigation real-time data streams, which comprises the following steps:
step 1, generating user control information: uploading the converted RINEX file to a cloud processor by a user, and generating related logs and alarm information;
Step 2, checking and storing RTCM data access: real-time data stream access, data stream information verification and RTCM original data stream storage of the RTCM are included;
Step 3, executing timing tasks: monitoring user-defined conversion time and reading an RTCM task list;
Step 4, converting the RTCM data stream into a RINEX data stream: according to user parameter configuration and an RTCM data stream file, converting the data stream, and converting the RTCM data stream into a RINEX data stream;
step 5, merging the repeated files of multiple time periods: automatically identifying observation files of a station in a single day and multiple time periods, and automatically executing combination;
Step 6, online service of the data file: and uploading the converted RINEX file to a cloud processor by the user, and generating related logs and alarm information.
Further, in step 1, the user control information is configured by a configuration file of the program, including configuration of data stream access information, SFTP storage path and push configuration, system operation log configuration, and automatic data conversion configuration.
Further, the configuration of the data stream access information is added in batches in a mode of adding a site access address list row by row, so that data stream access control information is generated;
The SFTP storage path and the pushing configuration are remote pushing catalogs for configuring SFTP;
the system operation log is configured to configure interrupt information of a data stream.
Further, in step 2, the original observation data in RTCM format of the site is accessed and stored locally, and the name of the site and the timestamp are added in the file name, so as to perform subsequent configuration conversion.
Further, in the data access process, the state monitoring of the data flow is performed through the following steps:
When the program runs, INT type parameters of the TCP communication state of each station per second in the station access list are judged through circulation, and one-dimensional arrays of the stations are written;
The state and interruption condition of the data stream are monitored and stored as log file information, so that the checking work of the data integrity is facilitated.
In step 4, the RINEX format conversion is performed one by one to obtain the observation information of each signal frequency point, and the analyzed observation information is written into the format conversion file corresponding to the station point according to the RINEX format standard.
Further, in step 6, the stored RTCM data and the converted RINEX file are stored in a data server, and after the account password is used for verification, the server is accessed to a file database to obtain a required file list, and returns to the user download address; if the requested file does not exist or the data flow is abnormal, generating service early warning information and feeding back the user.
The invention also relates to a satellite navigation real-time data stream batch management and automatic processing device, which comprises:
The user control information generation module is used for uploading the converted RINEX file to the cloud processor for a user and generating related log and alarm information;
the RTCM data access checking and storing module is used for real-time data stream access, data stream information checking and RTCM original data stream storage of the RTCM;
The execution timing task module is used for monitoring user-defined conversion time and reading an RTCM task list;
the data stream conversion module is used for converting the data stream according to user parameter configuration and the RTCM data stream file, and converting the RTCM data stream into a RINEX data stream;
the multi-period repeated file merging module is used for automatically identifying observation files of the station for a plurality of periods in a single day and automatically executing merging;
And the data file online service module is used for uploading the converted RINEX file to the cloud processor for a user and generating related log and alarm information.
The invention also relates to an electronic device comprising:
at least one processor; and
A memory communicatively coupled to the at least one processor; wherein,
The memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method.
The invention also relates to a non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method.
The technical scheme of the invention can realize the following beneficial technical effects:
The method, the device and the electronic equipment for batch management and automatic processing of the satellite navigation real-time data stream support the batch management of the foundation enhancement station RTCM data stream under Windows and Linux systems, and can realize automatic RINEX format conversion and visual control and display. The system has the advantages of strong applicability, good expandability, simple deployment mode and low maintenance cost; the method can be automatically executed according to the configuration files, can realize unmanned and automatic management of the data of a plurality of foundation enhancement sites after one deployment, and can provide basic support for Beidou station network data management and data processing work of mapping departments, related enterprises, scientific research universities and the like.
The system mainly solves the problem of batch conversion of real-time RTCM data streams of stations, supports data access and timing tasks of a plurality of stations, and has the advantages of strong applicability, good expandability, simple deployment mode and low maintenance cost; the method can be automatically executed according to the configuration file, and unmanned and automatic management of the data of a plurality of foundation enhancement sites can be realized after one deployment.
Drawings
FIG. 1 is a flow chart of a method for batch management and automatic processing of satellite navigation real-time data streams according to the present invention;
FIG. 2 is a flow chart of the method for batch management and automatic processing of satellite navigation real-time data streams according to the present invention.
Detailed Description
The objects, technical solutions and advantages of the present invention will become more apparent by the following detailed description of the present invention with reference to the accompanying drawings. It should be understood that the description is only illustrative and is not intended to limit the scope of the invention. In addition, in the following description, descriptions of well-known structures and techniques are omitted so as not to unnecessarily obscure the present invention.
The present invention will be described in detail with reference to the accompanying drawings and examples.
The first aspect of the invention provides a method for batch management and automatic processing of satellite navigation real-time data streams, which comprises the following steps:
And step 1, generating user control information.
Specifically, the method comprises adding NTRIP access IP, port, account number and password of site data stream, RTCM and RINEX file storage pushing path, data stream interrupt information log storage path and RTCM to RIENX data conversion parameter configuration.
And 2, checking and storing RTCM data access.
Specifically, the method comprises real-time data stream access of RTCM, data stream information verification and RTCM original data stream storage.
And step 3, executing a timing task.
Specifically, the user-defined conversion time is monitored, and the RTCM task list is read.
And 4, converting the RTCM data stream into a RINEX data stream.
And converting the data stream according to the user parameter configuration and the RTCM data stream file, and converting the RTCM data stream into a RINEX data stream.
And 5, merging the multi-period repeated files.
Specifically, the observation files of the station in a single day and multiple time periods are automatically identified, and the merging is automatically executed.
And 6, online service of the data file.
Specifically, the converted RINEX file is uploaded to a cloud processor by a user, and related log and alarm information are generated.
In one embodiment of the present invention, assuming that 3 reference station data streams are accessed in real time, the station names are a001, a002, a003 respectively, the specific implementation manner is as follows:
And step 1, generating user control information. The user control information is mainly configured by configuration files of programs, and mainly comprises configuration of A001, A002 and A003 data stream access information, SFTP storage path and push configuration, system operation log configuration and automatic data conversion configuration.
In the configuration of the data stream access information, the data stream access control information can be generated by adding the site access address list in batches, and the format of the site access address list is as follows:
ROVER＝<NAME>,NtripClient,<IP>,<PORT>,<NAME>,<USER>,<PASSWD>；
wherein: NAME is the site NAME, IP is the site data connection address, PORT is the connection PORT, USER is NTRIP account number, PASSWD is the connection password.
The SFTP storage PATH and the pushing configuration mainly configure the remote pushing directory of the SFTP, can set the file directory structure according to the year and the year product day to automatically classify, store and push, and can be directly added with 'SFTP= < PATH >' in the configuration file, wherein PATH is the remote pushing directory of the SFTP.
The system running LOG configuration is mainly used for configuring interrupt information of a data stream, and the configuration mode can be directly added with 'log= < PATH >' in a configuration file, wherein PATH is a LOG storage directory.
The data conversion configuration mainly configures information such as data conversion type and timing start TIME, and the configuration mode can be directly modified or newly increased to configure corresponding to 'RTCM 2 rnx= < VER >' and 'conv_t= < TIME >', wherein VER is a conversion version, optionally 2.1X or 3.0X, TIME is timing conversion TIME, and the format is hhmmss (TIME minutes and seconds).
And 2, checking and storing RTCM data access. The original observation data in the RTCM format of the site is accessed and stored locally by using the RTCM data stream access module, and the name of the site and the timestamp are added into the file name, so that the subsequent conversion configuration is convenient, and the example format of the file name storage is as follows: < NAME > _ YYYYMMDD > _ hhmmss >. Rtcm, where NAME is a site NAME, YYYYMMDD is year, month and day information, hhmmss is time-division second information, for example, a data file NAME of "A001_20220101_000001.Rtcm3" when A001 site 0 minutes 1 seconds at 2022, 1 month, 1 day 0. In the data access process, the state monitoring of the data flow is carried out by the following method:
When the program runs, INT type parameters (0: abnormal connection, 1: normal connection) of TCP communication states of each station in the station access list are judged through circulation, and one-dimensional arrays BREAK [2] = { INT t-1,INTt }, wherein t-1 and t respectively represent the TCP states of the last second and the current moment, and the rule for judging data flow interruption information according to the BREAK data states is as follows:
BREAK [2] = {1,0}: namely, the connection state is from normal to abnormal, and the interruption time is recorded once;
BREAK [2] = {0,0}: namely, the connection state is kept abnormal, and the interruption time is increased by 1 second;
BREAK [2] = {0,1}: i.e. the connection state is abnormal to normal, recording one-time recovery time;
The state and interruption condition of the data stream can be monitored through the rules, and the data stream is stored as log file information, so that the verification of the data integrity is facilitated.
And step 3, executing a timing task. After the program is run, the global running timer is matched with the user-defined conversion time once per second, after the current time is matched with the user configuration time, the RTCM data folder file list in the control information is read, a file name list conforming to RINEX standards is generated, and at the same time, RINEX standard files are generated on the RINEX conversion file path.
And 4, converting the RTCM data stream into a RINEX data stream.
And converting RINEX formats one by utilizing an RTCM-RINEX module, wherein the conversion process comprises two steps of RTCM data analysis and RINEX file writing. And the RTCM analysis process analyzes binary data of the observation message according to an RTCM protocol standard to obtain the observation information such as pseudo range, phase, doppler value and the like of each signal frequency point, and the analyzed observation information is written into a format conversion file corresponding to the station point according to a RINEX format standard.
And 5, merging the multi-period repeated files. For the multiple day or multiple period RTCM data to RINEX file conversion requirement, it is necessary to monitor file name repeatability when writing the file after RINEX conversion, and create multi-period file flags ending with "(2)", "(3)", etc. After conversion, the time period files are checked in turn, if the time period marks are contained, the first file is taken as a reference, and other time period files are combined, wherein the combination rule is as follows:
And sequentially reading the RINEX file with the multi-period file mark suffix by taking the first RINEX file as a reference file, deleting the file header of the multi-period file, only retaining the data information, and then attaching the data information to the file end part of the reference file. It should be noted that when reading the header "TIME OF LAST OBS" information OF the LAST period file, it is necessary to record the end TIME OF the observation period and perform replacement OF the end TIME OF the header observation period in the reference file.
And 6, online service of the data file. The stored RTCM data and the converted RINEX file are stored in a data server, after the user passes the verification by using the account number and the password, the user can access to a file database to obtain a required file list, and the server returns a user download address; if the file requested by the user does not exist or the data flow is abnormal, generating service early warning information and feeding back the user.
The invention also relates to a device for managing and automatically processing satellite navigation real-time data in batches, which comprises a control module, a data stream access module, a data conversion module, a safe and light service module, a display module and a control module, wherein a man-machine interaction interface is provided for a user, so that the user can conveniently carry out site data access information, SFTP files, interrupt log file storage paths and RTCM to RINEX file conversion configuration, and the information after configuration is packaged and sent to the data stream access module; the data stream access module is mainly used for realizing the access, analysis and storage processes of data through a processor and a memory according to the data access and file storage path and conversion information of the control module, and sending the RTCM storage path and conversion parameters to the data conversion module; the data conversion module analyzes the RTCM data through the processor according to the RTCM storage path and the conversion information, and converts the RTCM data into a RINEX file according to the conversion parameters; the safety light service module is mainly used for transmitting data of RTCM and RINEX files and interrupt log information of sites to users through an HTTP network. The device supports Windows and Linux systems, manages foundation enhancement station RTCM data flow in batches, and can realize automatic RINEX format conversion and visual control and display.
The invention also relates to an electronic device comprising:
at least one processor; and
A memory communicatively coupled to the at least one processor; wherein,
The memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method.
The invention also relates to a non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method.
In summary, the present invention provides a method and apparatus for batch management and automatic processing of satellite navigation real-time data streams, including the following steps: step 1, generating user control information; step 2, checking and storing RTCM data access; step 3, executing a timing task; step 4, converting the RTCM data stream into an RI NEX data stream; step 5, merging the repeated files of multiple time periods; and 6, online service of the data file. Aiming at the real-time RTCM data stream conversion requirement of a plurality of sites, the invention can input the data of the sites to carry out batch management and automatic conversion.
It is to be understood that the above-described embodiments of the present invention are merely illustrative of or explanation of the principles of the present invention and are in no way limiting of the invention. Accordingly, any modification, equivalent replacement, improvement, etc. made without departing from the spirit and scope of the present invention should be included in the scope of the present invention. Furthermore, the appended claims are intended to cover all such changes and modifications that fall within the scope and boundary of the appended claims, or equivalents of such scope and boundary.

Claims (5)

1. The method for batch management and automatic processing of satellite navigation real-time data streams is characterized by comprising the following steps:
Step 1, generating user control information, including NTRIP access IP, port, account number and password, RTCM and RINEX file storage pushing path, data stream interrupt information log storage path and RTCM to RIENX data conversion parameter configuration of adding site data stream; the user control information is configured by a configuration file of a program, and comprises configuration of data stream access information, SFTP storage path and push configuration, system running log configuration and automatic data conversion configuration;
In the configuration of the data stream access information, the data stream access control information is generated by adding the site access address list in batches by adding the site access address list line by line, and the format of the site access address list is as follows:
ROVER=<NAME>,Ntrip Client,<IP>,<PORT>,<NAME>,<USER>,<PASSWD>;
Wherein: NAME is the site NAME, IP is the site data connection address, PORT is the connection PORT, USER is NTRIP account number, PASSWD is the connection password;
The SFTP storage PATH and the pushing configuration configure a remote pushing directory of the SFTP, the automatic classified storage pushing is carried out according to the file directory structure of the year and the year product day, and the configuration mode is directly added with 'SFTP= < PATH >' in the configuration file, wherein PATH is the remote pushing directory of the SFTP;
The system operation LOG is configured to configure interrupt information of the data stream, and the configuration mode is directly added with LOG= < PATH > "in the configuration file, wherein PATH is a LOG storage directory;
The data conversion configuration mainly configures the type of data conversion and the timing start TIME, the configuration mode directly modifies or adds configuration files corresponding to 'RTCM 2 RNX= < VER >' and 'CONV_T= < TIME >', wherein VER is a conversion version, 2.1X or 3.0X is selected, TIME is the timing conversion TIME, the format is hhmmss, and the TIME is in TIME of minutes and seconds;
Step 2, checking and storing RTCM data access: real-time data stream access, data stream information verification and RTCM original data stream storage of the RTCM are included;
The original observation data in the RTCM format of the site is accessed and stored locally by using the RTCM data stream access module, and the name of the site and the timestamp are added into the file name, so that the subsequent conversion configuration is convenient, and the example format of the file name storage is as follows: < NAME > _ YYYYMMDD > _ hhmmss >. Rtcm, wherein NAME is a site NAME, YYYYMMDD is year, month and day information, and hhmmss is time-division second information; in the data access process, the state monitoring of the data flow is carried out by the following method:
When the program runs, INT type parameters of the TCP communication state of each station in the station access list every 1 second are judged through circulation, wherein 0 is abnormal connection, 1 is normal connection, and one-dimensional arrays BREAK [2] = { of the stations are written in T-1 and t respectively represent the TCP state of the last second and the current moment, and the rule for judging the interruption information of the data stream according to the BREAK data state is as follows:
BREAK [2] = {1,0}: namely, the connection state is from normal to abnormal, and the interruption time is recorded once;
BREAK [2] = {0,0}: namely, the connection state is kept abnormal, and the interruption time is increased by 1 second;
BREAK [2] = {0,1}: i.e. the connection state is abnormal to normal, recording one-time recovery time;
the state and interruption condition of the data stream can be monitored through the rules, and the data stream is stored as log file information, so that the verification of the data integrity is facilitated;
Step 3, executing timing tasks: monitoring user-defined conversion time and reading an RTCM task list; after the program is run, the global running timer is matched with the user-defined conversion time once per second, after the current time is matched with the user configuration time, the file list of the RTCM data folder in the control information is read, a file name list conforming to RINEX standards is generated, and a RINEX standard file is generated on the RINEX conversion file path;
Step 4, converting the RTCM data stream into a RINEX data stream: according to user parameter configuration and an RTCM data stream file, converting the data stream, and converting the RTCM data stream into a RINEX data stream;
Step 5, merging the repeated files of multiple time periods: automatically identifying observation files of a station in a single day and multiple time periods, and automatically executing combination; aiming at the conversion requirement of RTCM data to RINEX files for a plurality of days or a plurality of time periods, monitoring file name repeatability when writing the files after converting RINEX, and creating a multi-time period file mark; after conversion, the time period files are checked in turn, if the time period marks are contained, the first file is taken as a reference, and other time period files are combined, wherein the combination rule is as follows:
Sequentially reading the RINEX file with the multi-period file mark suffix by taking the first RINEX file as a reference file, deleting the file header of the multi-period file, only keeping data information, and then attaching the data information to the file end part of the reference file; when the file head 'TIME OF LAST OBS' information OF the file in the LAST period is read, recording the end TIME OF the observation period, and replacing the end TIME OF the file head observation period in the reference file;
Step 6, online service of the data file: uploading the converted RINEX file to a cloud processor by a user, and generating related logs and alarm information; the stored RTCM data and the converted RINEX file are stored in a data server, after the user passes the verification by using the account number and the password, the user accesses a file database to obtain a required file list, and the server returns a user download address; if the file requested by the user does not exist or the data flow is abnormal, generating service early warning information and feeding back the user.
2. The method for batch management and automatic processing of satellite navigation real-time data streams according to claim 1, wherein in step 4, the RINEX format conversion is performed one by one to obtain the observation information of each signal frequency point, and the analyzed observation information is written into the format conversion file corresponding to the station point according to the RINEX format standard.
3. A device for batch management and automatic processing of satellite navigation real-time data streams, comprising:
The user control information generation module is used for adding NTRIP access IP, port, account number and password, RTCM and RINEX file storage pushing path, data stream interrupt information log storage path and RTCM to RIENX data conversion parameter configuration of the site data stream;
In the configuration of the data stream access information, the data stream access control information is generated by adding the site access address list in batches by adding the site access address list line by line, and the format of the site access address list is as follows:
ROVER=<NAME>,Ntrip Client,<IP>,<PORT>,<NAME>,<USER>,<PASSWD>;
Wherein: NAME is the site NAME, IP is the site data connection address, PORT is the connection PORT, USER is NTRIP account number, PASSWD is the connection password;
The SFTP storage PATH and the pushing configuration configure a remote pushing directory of the SFTP, the automatic classified storage pushing is carried out according to the file directory structure of the year and the year product day, and the configuration mode is directly added with 'SFTP= < PATH >' in the configuration file, wherein PATH is the remote pushing directory of the SFTP;
The system operation LOG is configured to configure interrupt information of the data stream, and the configuration mode is directly added with LOG= < PATH > "in the configuration file, wherein PATH is a LOG storage directory;
The data conversion configuration mainly configures the type of data conversion and the timing start TIME, the configuration mode directly modifies or adds configuration files corresponding to 'RTCM 2 RNX= < VER >' and 'CONV_T= < TIME >', wherein VER is a conversion version, 2.1X or 3.0X is selected, TIME is the timing conversion TIME, the format is hhmmss, and the TIME is in TIME of minutes and seconds;
The RTCM data access checking and storing module is used for real-time data stream access, data stream information checking and RTCM original data stream storage of the RTCM; the original observation data in the RTCM format of the site is accessed and stored locally by using the RTCM data stream access module, and the name of the site and the timestamp are added into the file name, so that the subsequent conversion configuration is convenient, and the example format of the file name storage is as follows: < NAME > _ YYYYMMDD > _ hhmmss >. Rtcm, wherein NAME is a site NAME, YYYYMMDD is year, month and day information, and hhmmss is time-division second information; in the data access process, the state monitoring of the data flow is carried out by the following method:
When the program runs, INT type parameters of the TCP communication state of each station in the station access list every 1 second are judged through circulation, wherein 0 is abnormal connection, 1 is normal connection, and one-dimensional arrays BREAK [2] = { of the stations are written in T-1 and t respectively represent the TCP state of the last second and the current moment, and the rule for judging the interruption information of the data stream according to the BREAK data state is as follows:
BREAK [2] = {1,0}: namely, the connection state is from normal to abnormal, and the interruption time is recorded once;
BREAK [2] = {0,0}: namely, the connection state is kept abnormal, and the interruption time is increased by 1 second;
BREAK [2] = {0,1}: i.e. the connection state is abnormal to normal, recording one-time recovery time;
the state and interruption condition of the data stream can be monitored through the rules, and the data stream is stored as log file information, so that the verification of the data integrity is facilitated;
The execution timing task module is used for monitoring user-defined conversion time and reading an RTCM task list; after the program is run, the global running timer is matched with the user-defined conversion time once per second, after the current time is matched with the user configuration time, the file list of the RTCM data folder in the control information is read, a file name list conforming to RINEX standards is generated, and a RINEX standard file is generated on the RINEX conversion file path;
the data stream conversion module is used for converting the data stream according to user parameter configuration and the RTCM data stream file, and converting the RTCM data stream into a RINEX data stream;
The multi-period repeated file merging module is used for automatically identifying observation files of the station for a plurality of periods in a single day and automatically executing merging; aiming at the conversion requirement of RTCM data to RINEX files for a plurality of days or a plurality of time periods, monitoring file name repeatability when writing the files after converting RINEX, and creating a multi-time period file mark; after conversion, the time period files are checked in turn, if the time period marks are contained, the first file is taken as a reference, and other time period files are combined, wherein the combination rule is as follows:
Sequentially reading the RINEX file with the multi-period file mark suffix by taking the first RINEX file as a reference file, deleting the file header of the multi-period file, only keeping data information, and then attaching the data information to the file end part of the reference file; when the file head 'TIME OF LAST OBS' information OF the file in the LAST period is read, recording the end TIME OF the observation period, and replacing the end TIME OF the file head observation period in the reference file;
the data file online service module is used for uploading the converted RINEX file to the cloud processor for a user and generating related log and alarm information; the stored RTCM data and the converted RINEX file are stored in a data server, after the user passes the verification by using the account number and the password, the user accesses a file database to obtain a required file list, and the server returns a user download address; if the file requested by the user does not exist or the data flow is abnormal, generating service early warning information and feeding back the user.
4. An electronic device, the electronic device comprising:
at least one processor; and
A memory communicatively coupled to the at least one processor; wherein,
The memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of the preceding claims 1 to 2.
5. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of the preceding claims 1 to 2.
CN202310969477.XA 2023-08-03 2023-08-03 Method and device for batch management and automatic processing of satellite navigation real-time data streams Active CN117250640B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310969477.XA CN117250640B (en) 2023-08-03 2023-08-03 Method and device for batch management and automatic processing of satellite navigation real-time data streams

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310969477.XA CN117250640B (en) 2023-08-03 2023-08-03 Method and device for batch management and automatic processing of satellite navigation real-time data streams

Publications (2)

Publication Number Publication Date
CN117250640A CN117250640A (en) 2023-12-19
CN117250640B true CN117250640B (en) 2024-04-30

Family

ID=89133988

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310969477.XA Active CN117250640B (en) 2023-08-03 2023-08-03 Method and device for batch management and automatic processing of satellite navigation real-time data streams

Country Status (1)

Country Link
CN (1) CN117250640B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106019320A (en) * 2016-05-16 2016-10-12 华东师范大学 Satellite navigation signal recording method based on universal software radio equipment
RU2667599C1 (en) * 2017-10-03 2018-09-21 Акционерное общество "Российская корпорация ракетно-космического приборостроения и информационных систем" (АО "Российские космические системы") National network of high-precision satellite positioning
CN111386477A (en) * 2018-12-28 2020-07-07 深圳市大疆创新科技有限公司 Observation data conversion method, equipment, movable platform and storage medium
CN113253318A (en) * 2021-06-21 2021-08-13 四川中科川信科技有限公司 GNSS data remote super-calculation method
CN114500614A (en) * 2022-04-14 2022-05-13 北京航天驭星科技有限公司 Satellite telemetry data processing method and device, electronic equipment and readable medium
CN116166640A (en) * 2021-11-25 2023-05-26 自然资源部大地测量数据处理中心 Real-time acquisition and management method and system for global navigation satellite observation data

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8436769B2 (en) * 2010-08-19 2013-05-07 Mediatek Inc. Apparatus for performing global navigation satellite system control, and associated methods and storage media
RU2696856C1 (en) * 2018-10-31 2019-08-07 Тримбл Инк. Post-processing position data of global satellite navigation system (gnss) using mirror gnss data

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106019320A (en) * 2016-05-16 2016-10-12 华东师范大学 Satellite navigation signal recording method based on universal software radio equipment
RU2667599C1 (en) * 2017-10-03 2018-09-21 Акционерное общество "Российская корпорация ракетно-космического приборостроения и информационных систем" (АО "Российские космические системы") National network of high-precision satellite positioning
CN111386477A (en) * 2018-12-28 2020-07-07 深圳市大疆创新科技有限公司 Observation data conversion method, equipment, movable platform and storage medium
CN113253318A (en) * 2021-06-21 2021-08-13 四川中科川信科技有限公司 GNSS data remote super-calculation method
CN116166640A (en) * 2021-11-25 2023-05-26 自然资源部大地测量数据处理中心 Real-time acquisition and management method and system for global navigation satellite observation data
CN114500614A (en) * 2022-04-14 2022-05-13 北京航天驭星科技有限公司 Satellite telemetry data processing method and device, electronic equipment and readable medium

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
张喆.国际GNSS监测评估系统数据采集与服务的研究及应用.数据与计算发展前沿.2022,全文. *
李纬.基于实时数据流的 GNSS 综合服务系统数据管理技术研究.中国优秀硕士学位论文全文数据库 (基础科学辑).2005,全文. *
王维.省级基准站网信息化数据管理系统.中国优秀硕士学位论文全文数据库 (基础科学辑).2021,全文. *

Also Published As

Publication number Publication date
CN117250640A (en) 2023-12-19

Similar Documents

Publication Publication Date Title
CN103578154B (en) Based on the implementation method of the power equipment intelligent patrol detection of PDA
CN102136162B (en) A kind of power transmission line polling system
CN107135119B (en) Business response tracking and interface state monitoring development system
CN102684934A (en) Method and system for monitoring property of web application program and web server
CN209297373U (en) Online patrol system based on Cloud Server and bluetooth inspection point device
CN112511218A (en) Satellite ground station monitoring system based on microservice
CN114612019A (en) Multi-satellite task overall planning method and device
Owens et al. The oceans 2.0/3.0 data management and archival system
Harris et al. Oceanids C2: An integrated command, control, and data infrastructure for the over-the-horizon operation of marine autonomous systems
CN112702709A (en) Radio monitoring facility intelligent operation and maintenance system based on distributed mobile terminal
CN117250640B (en) Method and device for batch management and automatic processing of satellite navigation real-time data streams
US8346411B1 (en) Integrated system for providing a journey log display and the automatic reporting thereof
CN113901372A (en) User behavior data warehouse construction system and method
CN103905428A (en) Method and system for collection of visit information in network
CN113348778B (en) Generalized satellite comprehensive test system based on DDS system
Ferrari et al. Experimental characterization of an IoV framework leveraging mobile wireless technologies
CN115544672A (en) Digital twin simulation method, system, device and server
CN106294732A (en) Log collecting method based on ETL instrument
Wolf et al. Best Practices in Data Management at Ocean Networks Canada: a Citizen Scientist case study
CN116859419B (en) Satellite navigation real-time data stream management method based on distributed architecture
CN109862066B (en) Universal metering original record uploading method for QMap serialization marks
CN112311900B (en) Navigation monitoring method and system based on data flow distributed processing
CN117520436B (en) Meteorological service pilot-scale product display method, device, system and medium
US20240104199A1 (en) Systems and methods for robust scan and upload cyber security patch to edge node
Tymchenko et al. An architectural solution for data collection and monitoring system software

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant