CN114465652A - Universal extensible remote sensing satellite data real-time quick-look processing and scheduling system - Google Patents
Universal extensible remote sensing satellite data real-time quick-look processing and scheduling system Download PDFInfo
- Publication number
- CN114465652A CN114465652A CN202111581931.1A CN202111581931A CN114465652A CN 114465652 A CN114465652 A CN 114465652A CN 202111581931 A CN202111581931 A CN 202111581931A CN 114465652 A CN114465652 A CN 114465652A
- Authority
- CN
- China
- Prior art keywords
- module
- data
- sensor
- task
- processing unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000005111 flow chemistry technique Methods 0.000 claims abstract description 19
- 238000000034 method Methods 0.000 claims abstract description 8
- 230000005540 biological transmission Effects 0.000 claims description 5
- 230000006837 decompression Effects 0.000 claims description 5
- 238000007726 management method Methods 0.000 description 6
- HPTJABJPZMULFH-UHFFFAOYSA-N 12-[(Cyclohexylcarbamoyl)amino]dodecanoic acid Chemical compound OC(=O)CCCCCCCCCCCNC(=O)NC1CCCCC1 HPTJABJPZMULFH-UHFFFAOYSA-N 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B7/00—Radio transmission systems, i.e. using radiation field
- H04B7/14—Relay systems
- H04B7/15—Active relay systems
- H04B7/185—Space-based or airborne stations; Stations for satellite systems
- H04B7/1851—Systems using a satellite or space-based relay
Abstract
The invention provides a universal extensible remote sensing satellite data real-time quick-vision processing scheduling system aiming at a quick-vision processing scheduling system, solves the problem that a set of scheduling system needs to be developed for each satellite quick-vision processing in the prior art, and can add support for a new quick-vision processing flow of a new satellite in a platform through template configuration of a scheduling flow and configuration of a satellite sensor. The method comprises the following steps: the system comprises a sensor corresponding relation processing unit, a task flow processing unit and a data flow processing unit; the sensor corresponding relation processing unit comprises a sensor relation model configuration module and a sensor configuration model analysis module; the task flow processing unit comprises a secondary task flow template customizing module and a secondary task flow scheduling module; the data stream processing unit comprises a data stream template customizing module and a data stream managing module.
Description
Technical Field
The invention belongs to the technical field of ground processing of remote sensing satellites, and particularly relates to a universal extensible real-time quick-look processing and scheduling system for data of a remote sensing satellite.
Background
The present remote sensing satellite data real-time quick-vision processing system is generally composed of a quick-vision processing module (decompression, quick-vision processing, quick-vision display, quick-vision data compression, quick-vision data transmission and the like) and a scheduling system. The processing module needs to perform customization processing according to the on-satellite sensor, and the scheduling system performs customization processing according to the processing flow combination of the processing module. Because the satellite-ground interfaces of each satellite are different, the load types are different, the processing flows are different, the sensor processing granularity of decompression and quick vision processing is different, and the prior art mostly adopts a scheme of independently developing a scheduling program for each satellite.
For example, a high code rate remote sensing satellite raw data real-time quick-look method disclosed in patent publication No. CN109872268A completes remote sensing image quick-look by adopting a mode of interoperation of CUDA and OpenGL; the patent with publication number CN103763059A discloses a quick look substitution method for remote sensing satellite data, which judges the error code situation according to the known frame sync word, RS code, virtual channel counter and other information in the original data, and then uses different colors to represent the data error code situation.
Disclosure of Invention
The invention provides a universal extensible remote sensing satellite data real-time quick-vision processing scheduling system aiming at a quick-vision processing scheduling system, solves the problem that a set of scheduling system needs to be developed for each satellite quick-vision processing in the prior art, and can add support for a new quick-vision processing flow of a new satellite in a platform through template configuration of a scheduling flow and configuration of a satellite sensor.
The invention is realized by the following technical scheme.
A general extensible remote sensing satellite data real-time quick-look processing and scheduling system comprises: the system comprises a sensor corresponding relation processing unit, a task flow processing unit and a data flow processing unit;
the sensor corresponding relation processing unit comprises a sensor relation model configuration module and a sensor configuration model analysis module; the sensor relation model configuration module is used for establishing a corresponding relation model of the granularity of the remote control sensor, the decompression sensor and the quick vision processing sensor and customizing each satellite sensor model through configuration; the sensor configuration model analysis module acquires the sensors required to be processed by the task according to the corresponding relation model, and acquires the secondary task flows of the sensors corresponding to the task by combining a secondary task flow template in the task flow processing unit to generate an internal operation list;
the task flow processing unit comprises a secondary task flow template customizing module and a secondary task flow scheduling module; the secondary task flow template customizing module is used for dividing the tasks into secondary tasks, and the secondary task flow scheduling module is used for scheduling the primary tasks and the secondary tasks respectively;
the data flow processing unit comprises a data flow template customizing module and a data flow management module; the data flow template customizing module is used for customizing the flow direction of data between the secondary tasks and between the execution units; and the data flow management module is used for appointing the data flow direction of the starting parameter file of the execution unit according to the data flow direction defined by the data flow template customizing module.
The invention has the beneficial effects that:
according to the method, the configuration expansion support of the quick-view processing flow of the newly added satellite can be realized by configuring the sensor corresponding relation model, the secondary operation flow template and the data flow template, and a set of quick-view processing system does not need to be developed for each satellite.
Drawings
FIG. 1 is a block diagram of the general extensible remote sensing satellite data real-time quick view processing and scheduling system of the present invention.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
As shown in fig. 1, a general extensible remote sensing satellite data real-time quick view processing and scheduling system in this embodiment specifically includes: the system comprises a sensor corresponding relation processing unit, a task flow processing unit and a data flow processing unit;
the sensor corresponding relation processing unit comprises a sensor relation model configuration module and a sensor configuration model analysis module;
the sensor relation model configuration module is used for establishing a corresponding relation model of the granularity of the remote control sensor, the decompression sensor and the quick vision processing sensor and customizing each satellite sensor model through configuration; the sensor configuration model analysis module acquires the sensors required to be processed by the task according to the corresponding relation model, and acquires the secondary task flows of the sensors corresponding to the task by combining a secondary task flow template in the task flow processing unit to generate an internal operation list;
in specific implementation, because the quick-view sensors needed to be done for each task are different, the sensors needed to be processed for the task need to be obtained according to the established sensor corresponding relation model, and a secondary task flow of the corresponding sensor of the task is obtained by combining a secondary task flow template in the task flow processing unit, so as to generate an internal operation list;
the task flow processing unit comprises a secondary task flow template customizing module and a secondary task flow scheduling module; in specific implementation, because each satellite quick-view processing flow is various and complex, in order to facilitate the management of each flow, the secondary task flow template customizing module is used for dividing tasks into secondary tasks, and a complex quick-view task is divided into a plurality of secondary tasks in a secondary template mode;
in this embodiment, the second-level template specifically includes: and taking a data stream as a basic unit, and combining and managing the secondary templates by the primary template to jointly form a real-time quick-look processing task flow of a certain satellite.
And the secondary task flow scheduling module is used for scheduling the primary task and the secondary task respectively.
In this embodiment, the primary task scheduling performs serial and parallel scheduling according to the execution sequence and dependency relationship of the secondary tasks, performs start and stop management on each secondary task, monitors the execution process of the secondary tasks, and obtains the execution result.
In this embodiment, the secondary task scheduling performs serial and parallel scheduling according to the execution sequence and the dependency relationship between the execution units, manages the start and stop of each execution unit, tracks the execution state of the started module in real time, and feeds back the final execution result of each module.
The data flow processing unit comprises a data flow template customizing module and a data flow management module; the data flow template customizing module is used for customizing the flow direction of data between the secondary tasks and between the execution units; the data flow management module is used for appointing the data flow direction of the starting parameter file of the execution unit according to the data flow direction defined by the data flow template customizing module.
In this embodiment, the data stream is divided into a real-time data stream and a non-real-time data stream: the real-time data stream transmits network data frames in a socket mode and is used for data transmission among modules working in parallel; the non-real-time data stream refers to reading and writing of data files and is used for data transmission among modules working in series.
In summary, the above description is only a preferred example of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (5)
1. A general extensible remote sensing satellite data real-time quick-look processing and scheduling system is characterized by comprising: the system comprises a sensor corresponding relation processing unit, a task flow processing unit and a data flow processing unit;
the sensor corresponding relation processing unit comprises a sensor relation model configuration module and a sensor configuration model analysis module; the sensor relation model configuration module is used for establishing a corresponding relation model of the granularity of the remote control sensor, the decompression sensor and the quick vision processing sensor and customizing each satellite sensor model through configuration; the sensor configuration model analysis module acquires the sensors required to be processed by the task according to the corresponding relation model, and acquires the secondary task flows of the sensors corresponding to the task by combining a secondary task flow template in the task flow processing unit to generate an internal operation list;
the task flow processing unit comprises a secondary task flow template customizing module and a secondary task flow scheduling module; the secondary task flow template customizing module is used for dividing the tasks into secondary tasks, and the secondary task flow scheduling module is used for scheduling the primary tasks and the secondary tasks respectively;
the data flow processing unit comprises a data flow template customizing module and a data flow management module; the data flow template customizing module is used for customizing the flow direction of data between the secondary tasks and between the execution units; and the data flow management module is used for appointing the data flow direction of the starting parameter file of the execution unit according to the data flow direction defined by the data flow template customizing module.
2. The system as claimed in claim 1, wherein the secondary task process template uses a data stream as a basic unit, and the primary template performs combined management on the secondary template to jointly form a real-time quick-look processing task process of a certain satellite.
3. The system for universal extensible remote sensing satellite data real-time quick look processing and scheduling of claim 1 or 2, wherein the primary task scheduling is performed in a serial and parallel manner according to the execution sequence and dependency relationship of the secondary tasks, each secondary task is managed to start and stop, the execution process of the secondary tasks is monitored, and the execution result is obtained.
4. The system as claimed in claim 1 or 2, wherein the secondary task scheduling is performed in a serial-parallel manner according to an execution sequence and a dependency relationship between execution units, the start and stop of each execution unit are managed, the execution state of the started module is tracked in real time, and the final execution result of each module is fed back.
5. The system as claimed in claim 1 or 2, wherein the data stream is divided into a real-time data stream and a non-real-time data stream: the real-time data stream transmits network data frames in a socket mode and is used for data transmission among modules working in parallel; the non-real-time data stream refers to reading and writing of data files and is used for data transmission among modules working in series.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111581931.1A CN114465652B (en) | 2021-12-22 | 2021-12-22 | General extensible remote sensing satellite data real-time quick-viewing processing scheduling system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111581931.1A CN114465652B (en) | 2021-12-22 | 2021-12-22 | General extensible remote sensing satellite data real-time quick-viewing processing scheduling system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114465652A true CN114465652A (en) | 2022-05-10 |
| CN114465652B CN114465652B (en) | 2023-11-14 |
Family
ID=81405062
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111581931.1A Active CN114465652B (en) | 2021-12-22 | 2021-12-22 | General extensible remote sensing satellite data real-time quick-viewing processing scheduling system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114465652B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101315424A (en) * | 2008-07-29 | 2008-12-03 | 中国科学院对地观测与数字地球科学中心 | Multi-satellite remote sensing data integrated parallel ground pretreatment system |
| CN102412990A (en) * | 2011-11-18 | 2012-04-11 | 中国科学院对地观测与数字地球科学中心 | Remote sensing satellite raw data recording system with centralized management and real-time transmission functions |
| CN102521687A (en) * | 2011-12-01 | 2012-06-27 | 中国资源卫星应用中心 | Miniaturized universal platform for preprocessing remote-sensing satellite data |
| CN104239143A (en) * | 2014-09-17 | 2014-12-24 | 中国科学院遥感与数字地球研究所 | Satellite data receiving task scheduling system based on OSGI (Open Service Gateway Initiative) and workflow and satellite data receiving task scheduling method based on OSGI and workflow |
| CN106845792A (en) * | 2016-12-27 | 2017-06-13 | 中国电子科技集团公司第五十四研究所 | Mission planning general-purpose platform based on star ground resource model |
| WO2020108303A1 (en) * | 2018-11-30 | 2020-06-04 | 中兴通讯股份有限公司 | Heterogeneous computing-based task processing method and software-hardware framework system |
-
2021
- 2021-12-22 CN CN202111581931.1A patent/CN114465652B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101315424A (en) * | 2008-07-29 | 2008-12-03 | 中国科学院对地观测与数字地球科学中心 | Multi-satellite remote sensing data integrated parallel ground pretreatment system |
| CN102412990A (en) * | 2011-11-18 | 2012-04-11 | 中国科学院对地观测与数字地球科学中心 | Remote sensing satellite raw data recording system with centralized management and real-time transmission functions |
| CN102521687A (en) * | 2011-12-01 | 2012-06-27 | 中国资源卫星应用中心 | Miniaturized universal platform for preprocessing remote-sensing satellite data |
| CN104239143A (en) * | 2014-09-17 | 2014-12-24 | 中国科学院遥感与数字地球研究所 | Satellite data receiving task scheduling system based on OSGI (Open Service Gateway Initiative) and workflow and satellite data receiving task scheduling method based on OSGI and workflow |
| CN106845792A (en) * | 2016-12-27 | 2017-06-13 | 中国电子科技集团公司第五十四研究所 | Mission planning general-purpose platform based on star ground resource model |
| WO2020108303A1 (en) * | 2018-11-30 | 2020-06-04 | 中兴通讯股份有限公司 | Heterogeneous computing-based task processing method and software-hardware framework system |
Non-Patent Citations (11)
| Title |
|---|
| 冯阳等: "基于工作流技术的遥感卫星数据接收调度系统的设计与实现", 《无线电工程》 * |
| 冯阳等: "基于工作流技术的遥感卫星数据接收调度系统的设计与实现", 《无线电工程》, vol. 48, no. 11, 19 October 2018 (2018-10-19), pages 1 - 4 * |
| 向彪等: "高性能遥感卫星地面预处理系统中的任务管理与调度技术研究", 《宇航学报》 * |
| 向彪等: "高性能遥感卫星地面预处理系统中的任务管理与调度技术研究", 《宇航学报》, vol. 29, no. 04, 30 July 2008 (2008-07-30), pages 1 - 3 * |
| 孔庆玲 等: "基于插件的星地资源管理系统的设计与实现", 《信息系统与网络》 * |
| 孔庆玲 等: "基于插件的星地资源管理系统的设计与实现", 《信息系统与网络》, vol. 47, no. 11, 6 November 2017 (2017-11-06) * |
| 宋峣 等: "基于流式计算的遥感卫星数据快视处理方法", 《计算机工程与应用》 * |
| 宋峣 等: "基于流式计算的遥感卫星数据快视处理方法", 《计算机工程与应用》, vol. 55, no. 10, 9 August 2018 (2018-08-09) * |
| 杨仁忠;蔡兴文;杨蕾;石璐;: "通用遥感卫星快视处理系统技术研究", 遥感信息, no. 05 * |
| 赵文波等: "一种支持多星多任务遥感卫星地面系统综合处理的运行控制技术", 《电子与信息学报》 * |
| 赵文波等: "一种支持多星多任务遥感卫星地面系统综合处理的运行控制技术", 《电子与信息学报》, no. 06, 20 June 2005 (2005-06-20) * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114465652B (en) | 2023-11-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109460322B (en) | Disaster recovery switching drilling system and method based on process scheduling engine technology | |
| CN106033476A (en) | Incremental graphic computing method in distributed computing mode under cloud computing environment | |
| CN107508869B (en) | Tracing data acquisition method and client | |
| CN112559475B (en) | Data real-time capturing and transmitting method and system | |
| CN104424048A (en) | Data storage method and equipment | |
| CN113760578B (en) | Method, device, equipment and computer program for cross-process rapid transmission of big data | |
| CN107145350B (en) | A kind of software development methodology and system | |
| CN106095376A (en) | A kind of implementation method of quick configuration monitoring picture | |
| CN104933495A (en) | Work task assessment system on Android-based mobile terminal | |
| CN101650800A (en) | Method and device for updating task content in project task plan system | |
| DE102022122167A1 (en) | PROCEDURE FOR REAL-TIME ECU CRASH REPORTING AND RECOVERY | |
| CN105243499A (en) | Order distribution method and system | |
| CN111427547B (en) | C + + based micro-service development method and system | |
| CN102427411B (en) | Total network signalling tracking method and system for | |
| CN102253837B (en) | Based on the Design of Software Framework method of object tree | |
| WO2019218724A1 (en) | Standardized software module development method and software system development method | |
| CN106547861A (en) | A kind of method and device of the data base of intelligent management machine node | |
| CN114465652A (en) | Universal extensible remote sensing satellite data real-time quick-look processing and scheduling system | |
| CN102541539B (en) | Method for designing intelligent panel of supply chain based on M2M (Machine to Machine) | |
| CN107168748A (en) | A kind of method that multinomial upgrading task is realized by a upgrade file bag | |
| CN104361484A (en) | Office automation system and office automation method capable of achieving multi-platform data interaction | |
| CN103164776B (en) | A kind of medicine traceability system and medicine retroactive method thereof and flow monitoring method | |
| CN106649418A (en) | High-performance method for importing data into distributed database through direct connection of fragments in driver | |
| DE102022122064A1 (en) | SYSTEM AND METHOD FOR IMPROVED ECU FAILURE DETECTION IN FLEET | |
| CN104951346A (en) | Process management method for embedded system as well as system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |