EP4436878A1 - Système et procédé de navigation autonome base vision d'un satellite - Google Patents
Système et procédé de navigation autonome base vision d'un satelliteInfo
- Publication number
- EP4436878A1 EP4436878A1 EP22821442.5A EP22821442A EP4436878A1 EP 4436878 A1 EP4436878 A1 EP 4436878A1 EP 22821442 A EP22821442 A EP 22821442A EP 4436878 A1 EP4436878 A1 EP 4436878A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- satellite
- target object
- images
- distance
- host satellite
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64G—COSMONAUTICS; VEHICLES OR EQUIPMENT THEREFOR
- B64G1/00—Cosmonautic vehicles
- B64G1/22—Parts of, or equipment specially adapted for fitting in or to, cosmonautic vehicles
- B64G1/24—Guiding or controlling apparatus, e.g. for attitude control
- B64G1/244—Spacecraft control systems
- B64G1/247—Advanced control concepts for autonomous, robotic spacecraft, e.g. by using artificial intelligence, neural networks or autonomous agents
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64G—COSMONAUTICS; VEHICLES OR EQUIPMENT THEREFOR
- B64G1/00—Cosmonautic vehicles
- B64G1/10—Artificial satellites; Systems of such satellites; Interplanetary vehicles
- B64G1/1078—Maintenance satellites
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64G—COSMONAUTICS; VEHICLES OR EQUIPMENT THEREFOR
- B64G1/00—Cosmonautic vehicles
- B64G1/22—Parts of, or equipment specially adapted for fitting in or to, cosmonautic vehicles
- B64G1/24—Guiding or controlling apparatus, e.g. for attitude control
- B64G1/242—Orbits and trajectories
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64G—COSMONAUTICS; VEHICLES OR EQUIPMENT THEREFOR
- B64G1/00—Cosmonautic vehicles
- B64G1/22—Parts of, or equipment specially adapted for fitting in or to, cosmonautic vehicles
- B64G1/24—Guiding or controlling apparatus, e.g. for attitude control
- B64G1/36—Guiding or controlling apparatus, e.g. for attitude control using sensors, e.g. sun-sensors, horizon sensors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64G—COSMONAUTICS; VEHICLES OR EQUIPMENT THEREFOR
- B64G1/00—Cosmonautic vehicles
- B64G1/22—Parts of, or equipment specially adapted for fitting in or to, cosmonautic vehicles
- B64G1/24—Guiding or controlling apparatus, e.g. for attitude control
- B64G1/36—Guiding or controlling apparatus, e.g. for attitude control using sensors, e.g. sun-sensors, horizon sensors
- B64G1/369—Guiding or controlling apparatus, e.g. for attitude control using sensors, e.g. sun-sensors, horizon sensors using gyroscopes as attitude sensors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64G—COSMONAUTICS; VEHICLES OR EQUIPMENT THEREFOR
- B64G1/00—Cosmonautic vehicles
- B64G1/22—Parts of, or equipment specially adapted for fitting in or to, cosmonautic vehicles
- B64G1/66—Arrangements or adaptations of apparatus or instruments, not otherwise provided for
- B64G1/68—Arrangements or adaptations of apparatus or instruments, not otherwise provided for of meteoroid or space debris detectors
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/277—Analysis of motion involving stochastic approaches, e.g. using Kalman filters
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/762—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using clustering, e.g. of similar faces in social networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/20—Instruments for performing navigational calculations
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10032—Satellite or aerial image; Remote sensing
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20024—Filtering details
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30244—Camera pose
Definitions
- the invention relates to the autonomous navigation of satellites.
- the invention relates more particularly to a system and method for autonomous navigation of a satellite equipped with at least one image acquisition camera.
- space debris designates a non-functional artificial object in orbit. It can be a bolt, a paint chip, a launcher stage, a “dead” satellite, the remains of a spacecraft explosion, etc.
- space object designates any object in orbit such as space debris or a functional satellite.
- space object or target designates any object in orbit such as space debris or a functional satellite.
- space object or target covers both operational satellites and space debris.
- celestial object designates any non-artificial object such as a star, a comet, a galaxy likely to be present in an acquired image.
- the invention aims to provide an autonomous satellite navigation system and method.
- the invention aims in particular to provide such a system and method which allow autonomous navigation of a satellite from a batch of images, for example monochromatic, acquired by at least one camera on board the satellite.
- the invention also aims to provide, in at least one embodiment, such a system and method which contribute to the movement of the satellite towards a predetermined rendezvous point or towards a non-cooperative spatial target object.
- the invention also aims to provide, in at least one embodiment, such a system and method, which allow an inspection of the environment of the satellite.
- the invention also aims to provide, in at least one embodiment, such a system and method, which allow the determination of the attitude of the satellite.
- the invention also aims to provide, in at least one embodiment, such a system and method, which allow inspection and tracking of a target object.
- the invention also aims to provide, in at least one embodiment, such a system and method, which allow a determination of the pose (attitude and relative position) of a target object.
- the invention also aims to provide, in at least one embodiment, such a system and method, which make it possible to detect space debris and to avoid collisions with surrounding space objects.
- the invention also aims to provide, in at least one embodiment, such a system and method which does not require the embedding of complex sensors such as LiDARs, radars and equivalent equipment.
- the invention also aims to provide, in at least one embodiment, such a system and method which limit the size and weight of the equipment necessary for its implementation.
- the invention also aims to provide, in at least one embodiment, such a system and method which limit the energy necessary for its implementation.
- the invention relates to a satellite equipped with a system according to the invention and implementing a method according to the invention.
- the invention relates to a method for autonomous navigation of a satellite, called a host satellite, equipped with means for moving and orienting said satellite, a control unit for these means, and at least one on-board camera for acquiring images of the environment of said satellite.
- the method according to the invention is characterized in that it comprises the following steps: a step of acquiring a plurality of images by said camera embarked,
- long distance processing configured to detect and identify space objects within said images, calculate their relative orbits and distances from the host satellite, and determine the attitude of the host satellite
- short distance processing configured to estimate the pose of at least one of said detected and identified spatial objects, called target object, during the long distance processing, said short distance step being implemented when said long distance step detects at least one space object located at an estimated distance less than a predetermined threshold distance
- step - a step of developing and transmitting control instructions to said control unit of said means of moving and orienting said satellite according to at least one appointment determined in the previous step.
- the method according to the invention therefore allows completely autonomous navigation of the satellite without human intervention from images of the environment of the satellite acquired by an on-board camera. All of the operations of image acquisition, image processing, calculation and determination of trajectories and flight parameters are carried out on board the host satellite without external intervention.
- the method according to the invention makes it possible to confer on the host satellite a situational awareness in space, that is to say that it can obtain information from its environment and adapt its trajectory and/or orientation according to this information. .
- This information comes exclusively from images acquired by at least one camera on board the satellite.
- the process according to the invention uses no sensor other than image acquisition cameras to ensure the autonomous navigation of the satellite.
- the method according to the invention implements two separate image processing steps according to the distance of the identified target objects, which allows fine navigation of the satellite according to the identified objects.
- the threshold distance is fixed at 250 meters for the typical dimensions of geostationary satellites - of the order of 2 meters in diameter
- the method switches from a long distance processing mode to a short-range processing which makes it possible to estimate the position, the orientation and the speed of the target object in order to maneuver the satellite accordingly (approach or avoidance).
- said long-distance processing step further comprises:
- the initial detection of space and/or celestial objects consists in recognizing groupings (better known under the English name of “clusters”) within the acquired images and in classifying and filtering them in order to remove in particular reflections and points. hot. These steps are implemented for example by a data partitioning algorithm such as that known by the English acronym DBSCAN for “Density-based spatial clustering of applications with noise”.
- said long distance processing step further comprises: a comparison of said detected spatial and celestial objects with a predetermined catalog of celestial objects to identify at least one celestial object among the detected objects, - a determination of attitude of said host satellite from a position of at least one of the celestial objects identified.
- the determination of the attitude of the host satellite is based on the detection and recognition of celestial objects within the acquired images. This is made possible by identifying stars within the images by comparing the detected objects to a reference catalog, for example the Hipparcos-2 catalog. We analyze the angles between the identified potential stars to recognize a configuration similar to a configuration of the aforementioned catalog. This technique based on the angles makes it possible to determine that such celestial object identified within the image corresponds to such celestial object of the reference catalog.
- said attitude determination step comprises the implementation of an extended Kalman filter (EKF) from a first estimate of the angular velocity and attitude of the host satellite and the position of at least one identified celestial object (preferably three identified celestial objects).
- EKF extended Kalman filter
- the determination of the attitude of the host satellite consists in using an extended Kalman filter to which is presented, as input, the position of at least one star (preferably three stars) and a first estimate of the angular velocity of the host satellite, and which outputs an estimate of the attitude of the host satellite.
- said long-distance processing step comprises:
- target object a calculation of the position of at least one spatial object detected and identified within the image, called target object
- the calculation of the relative orbit of each target object consists in using navigation filters based on the angles of the target object.
- the target being located at a distance greater than the predetermined threshold distance and therefore too far from the camera to perceive the angles of the target object, the angles apparent within the field of vision of the camera are used. to determine the relative navigation of the host satellite.
- said short distance processing step comprises:
- the short distance processing step begins with the separation of the target object of interest (target satellite, debris, etc.) from its background.
- a learning neural network model better known as “deep learning”
- YOLO the algorithm known by the acronym YOLO for "You Only Look Once” which makes it possible to detect objects by dividing the image into a grid system in which each cell is processed for the detection of a object.
- the first step thus makes it possible to recognize the region of interest and to provide a first estimate of the position of the target object.
- a second step allows detect points of interest of 1 target object.
- This is achieved by a second neural network trained to perform regressive landmark detection also referred to in the text by the acronym LRN for "Landmark Regressive Network”
- This sub-step can for example implement the architecture known by the English acronym HRNet for “High Resolution Network”.
- a third step makes it possible to estimate the pose of the target object from the points of interest detected in the previous step and by seeking the best possible pose estimate from, for example, a priori knowledge. of the 3D architecture of the target. This can be achieved by implementing the algorithm known by the English acronym EPnP for "Efficient Perspective-n-Point".
- the short-range processing is performed only if a target object detected and identified during the long-range processing step is located at a distance from the target satellite less than a predetermined threshold distance.
- This short distance processing step aims to determine the pose of the target object in order to be able to determine the navigation instructions of the host satellite.
- said step of determining a possible appointment comprises:
- the trajectory estimation is based on a linearized model of the dynamics of the host satellite based, for example, on the Clohessy-Wiltshire equations.
- a collision probability calculation can also be performed in the case of debris to estimate a probability of collision between the host satellite and the debris.
- said step of developing and transmitting control instructions intended for said control unit comprises:
- the last step of the process consists in developing the commands for piloting the satellite to avoid collision in the case of debris or on the contrary to ensure the rendezvous in the case of a satellite to be joined.
- This step is based on the trajectories determined in the previous step and implements a dynamic simulation of the flight of the host satellite and a control model.
- the controls are optimized to minimize various parameters such as the distance to be covered, the consumption of propellant or the number of manoeuvres. This optimization may depend on function constraints of the target objects or the state of the host satellite (propellant reserves, battery state, enhanced safety, etc.).
- this step of determining and transmitting the commands aims to meet the following three objectives: avoid a target object (avoidance maneuver), approach the target object (rendezvous maneuver) or maintain the satellite in the current configuration (no specific maneuver).
- the invention also relates to an autonomous navigation system for a satellite, called a host satellite, equipped with means for moving and orienting said satellite, a control unit for these means, said system being characterized in that it comprises: at least one camera for acquiring a plurality of images of the environment of said host satellite, a default processing module for said acquired images, said long range module, configured to detect and identify space objects within said images, calculate their relative orbits and distances from the host satellite, and determine the attitude of said host satellite,
- short distance module configured to estimate the attitude of at least one of said detected and identified spatial objects, called target object, by said long distance module, said short distance module being put into works when said long distance module has detected at least one space object located at an estimated distance less than a predetermined threshold distance
- the autonomous navigation system according to the invention advantageously implements the autonomous navigation method according to the invention and the autonomous navigation method according to the invention is advantageously implemented by a system according to the invention.
- module means a software element, a subset of a software program, which can be compiled separately, either for independent use, or to be assembled with other modules of a program, or a hardware element, or a combination of a hardware element and a software routine.
- a hardware element may include an integrated circuit specific to an application (better known by the acronym ASIC for the English name Application-Specific Integrated Circuit) or a programmable logic circuit (better known by the acronym FPGA for the English name Field-Programmable Gate Array) or a specialized microprocessor circuit (better known by the acronym DSP for the English name Digital Signal Processor) or any equivalent material or any combination of the aforementioned materials.
- ASIC application-Specific Integrated Circuit
- FPGA field-Programmable Gate Array
- DSP Digital Signal Processor
- the modules of the system according to the invention are preferably implemented by software means, that is to say by a sequence of instructions of a computer program, this sequence of instructions being able to be stored on any type of medium partially or totally readable by a computer or by a microprocessor on board the satellite.
- the system comprises an image acquisition camera intended to supply images to the long-distance processing module and an image acquisition camera intended to supply images to the short-distance processing module.
- the system comprises two separate cameras dedicated respectively to providing images to the long-distance processing module and to the short-distance processing module.
- This variant makes it possible to benefit from a specific camera adapted to the corresponding treatment.
- the invention also relates to a method and system for autonomous navigation of a satellite, characterized in combination by all or some of the characteristics mentioned above or below.
- FIG. 1 is a schematic view of the main steps of the navigation method according to the invention
- FIG. 2 is a schematic view of the autonomous navigation system according to one embodiment of the invention
- FIG. 3 is a functional schematic view of the long-distance image processing steps according to one embodiment of the invention.
- FIG. 4 is a functional schematic view of the short distance image processing steps according to one embodiment of the invention.
- FIG 1 schematically illustrates the main steps of the navigation method according to the invention.
- the first step El of the navigation method according to the invention consists in acquiring a plurality of images of the environment of the host satellite from a camera on board the satellite.
- the shooting characteristics (exposure time, etc.) can be adapted to the operating conditions.
- the raw data is stored in a memory of the on-board computer to be then processed during the following steps.
- the second step E2 of the navigation method according to the invention consists in performing a so-called long-distance processing of the acquired images.
- the main function of this processing is to detect and identify space objects within said images, to calculate the relative orbits and distances of space objects with respect to the host satellite, and to determine the attitude of the host satellite.
- the third step E3 of the navigation method according to the invention consists in carrying out a processing, called short distance, of the images acquired, when at least one target object located at a distance less than a predetermined distance (for example 250 meters) has been detected in the previous step.
- the main function of this processing is to estimate the pose of this target object. This step will be described more precisely in connection with Figure 4.
- the fourth step E4 of the navigation method according to the invention consists in determining a possible rendezvous between the target object and the host satellite, from the various information determined during the previous steps.
- the fifth and last step E5 of the navigation method according to 1 invention is to develop and transmit control instructions to the control unit which controls the means of movement and orientation of the satellite. These commands depend on the appointments determined in the previous step.
- Figure 2 is a schematic view of a navigation system according to one embodiment of the invention implementing the method according to the invention.
- the system includes a 10 image acquisition camera.
- This camera can be a monocular, monochromatic or polychromatic camera.
- This camera is for example a camera capable of acquiring three images per second. It can for example have a field of vision of 11° vertically and 16° horizontally. Of course, other cameras can be used without this calling into question the principle of the invention.
- the camera of the embodiment described makes it possible to detect target objects at a distance of 3000 km for objects 2 m in diameter. For example, a 5400x3600 pixel camera with a 16mm focal length can detect objects 2m in diameter up to 3000 km away. Of course, other types of camera can be used depending on the objectives targeted by the system without calling into question the principle of the invention.
- the system also includes an on-board computer 20 which is equipped with a microprocessor, a storage memory and which houses data analysis and processing modules.
- This on-board computer is, for example, equipped with a card marketed under the reference Q7S Xiphos®, dedicated to space applications.
- modules are preferably implemented in the form of software elements embedded on the electronic card of the on-board computer.
- the on-board computer 20 thus comprises a long-distance processing module 21 which is configured to implement step E2 of the method according to the invention and which will be described in more detail in connection with FIG. 2.
- the on-board computer 20 also includes a short processing module distance 22 which is configured to implement 1 step E3 of the method according to the invention and which will be described in more detail in connection with figure 3.
- the on-board computer 20 also includes a module 23 for determining a possible rendezvous between a target object and the host satellite.
- the on-board computer 20 includes a module for generating commands 24 intended for a control unit which controls the means of displacement and orientation 30 of the host satellite.
- the system according to the invention can also comprise a gyroscope 41, an accelerometer 42 and a flash memory 43.
- the use of the gyroscope 41 makes it possible to reduce the number of variables necessary for the implementation of the Kalman filter (EKF) given that the angular velocity is then known.
- the flash memory 43 makes it possible to store the data and to send them to the ground when a link is made.
- the gyroscope 41 and the accelerometer 42 are intended for the navigation software and can be used to improve the accuracy of the estimates. It should be noted, however, that these sensors are not essential to the implementation of the invention. They nevertheless make it possible to improve the precision of the measurements and/or estimates.
- FIG. 3 schematically illustrates the sub-steps implemented during the long-distance processing step E2 implemented by the long-distance processing module 21.
- an image acquired by camera 10 is processed. This image undergoes thresholding, followed by partitioning of the image (detection of clusters) by an algorithm of the DBSCAN type at step 302 as indicated previously with a view to detecting potential target spatial objects (also designated by the acronym English RSO for “Resident Space Objects”), followed by a calculation in step 303 of the centers of the clusters formed in step 302.
- thresholding followed by partitioning of the image (detection of clusters) by an algorithm of the DBSCAN type at step 302 as indicated previously with a view to detecting potential target spatial objects (also designated by the acronym English RSO for “Resident Space Objects”), followed by a calculation in step 303 of the centers of the clusters formed in step 302.
- the method can determine the attitude of the host satellite in step 307. This attitude determination can for example and as indicated previously be carried out by the use of a Extended Kalman.
- the method calculates the position of this target object at step 309 and calculates the orbital characteristics of this target object from the determination of the attitude of the host satellite and the position of the target object calculated in step 310.
- the details of these calculations which are also implemented in the short distance processing step, are specified below -after in connection with the detailed description of the short distance processing step.
- step E3 If the distance of the object is estimated to be less than the threshold distance, the processing of short-distance images is activated and the method switches to step E3.
- FIG. 4 schematically illustrates the sub-steps implemented during the short-distance processing step E3 implemented by the short-distance processing module 22.
- an image acquired by camera 10 is processed.
- a detection of an area of interest is performed by implementing a first neural network trained to recognize predetermined target objects, as explained above.
- the image is resized to present a format identical to that of the images used to train the neural network.
- this step can implement the algorithm known by the acronym YOLO for “You Only Look Once” which makes it possible to detect objects by dividing the image into a grid system in which each cell is processed for detection. of an object.
- the result of this the first sub-step is the detection of a region of interest comprising the target object.
- the method performs backward landmark detection in the detected area of interest by executing a second neural network trained to perform backward landmark detection as explained above.
- the input data of this second neural network is the image of the region of interest detected in the previous step.
- the image can be resized to present a format identical to that of the images used to train the neural network.
- This sub-step makes it possible to detect the points of interest of the target object present in the region of interest.
- This sub-step can for example implement the architecture known by the English acronym HRNet for (High Resolution Network).
- step 404 the method estimates the pose of the target object from the points of interest detected in the previous step and by seeking the best possible pose estimate from, for example, a priori knowledge of the 3D architecture of the target.
- This can be achieved by implementing the algorithm known by the English acronym EPnP for “Efficient Perspective-n-Point”.
- EPnP for “Efficient Perspective-n-Point”.
- the goal of the algorithm is to find what orientation and distance makes it possible to make the detected points of interest coincide with the a priori knowledge of the 3D architecture of the target object.
- the method can refine the determination of the pose.
- the EPnP method is an explicit formula, solution of a linear problem, allowing a first estimation of the pose of the target.
- This method is thus and preferably refined by iteratively applying a Levenbert-Marquardt method, known by the acronym LMM, which requires initialization with a first estimate.
- LMM Levenbert-Marquardt method
- It is an optimization method aiming to minimize the reprojection error, i.e. to reduce as much as possible the distance between the points of interest and their reprojection from the known or reconstructed architecture, for obtain a better pose estimate.
- This succession of steps which forms the short distance processing step E2 makes it possible to estimate the pose (attitude and distance) of an object from a batch of monocular images, and from a priori knowledge of the 3D architecture of the target object. That being so and as indicated previously, it is possible according to another embodiment to determine the 3D architecture of the object from a photogrammetry technique, which then makes it possible to dispense with a priori knowledge of the 3D architecture. of the target object.
- the method estimates the trajectory of the host satellite from a linearized model of the dynamics of the satellite and calculates a probability of collision with the target object (It should be noted that this step is also implemented during long distance processing as soon as a target object has been identified).
- the trajectory estimation is based on a linearized model of the host satellite dynamics from, for example, the Clohessy-Wiltshire equations (in the simplest case of a Keplerian orbit, circular and without disturbance).
- a collision probability calculation can also be performed in the case of debris to estimate a probability of collision between the host satellite and the debris.
- the azimuth and the elevation of the target are determined from optical measurements. Then, we correct this determination by using a UKF filter:
- the measure function takes into account the non-linear nature of the angle measure and transforms the elements into average elements
- Prediction The transition function takes into account the relative dynamic elements of the two objects as well as other parameters such as solar pressure, gravitational differential, etc.
- the probability of collision is calculated from the relative orbital dynamic elements of the two objects as well as covariances from a navigation filter and by applying Chan's method to determine analyzes the probability density of the collision function.
- the filter can also be used in a decoupled way to refine the estimation of the rotational kinematic elements of the target object.
- the last stage of the process consists in developing and transmitting control instructions to the control unit which controls the means of movement and orientation of the satellite (navigation computer, thrusters and reaction wheels). These commands depend on the appointments determined in the previous step.
- the embodiment of this step is known to those skilled in the art and consists in controlling the satellite control units to achieve the targeted objective.
- this step amounts to solving a problem of minimizing the separation with the target.
- This technique is based on the inclination-eccentricity vector in the radial/Normal plane and the longitudinal separation in the tangential plane.
- the system can comprise two (or more) distinct cameras dedicated respectively to providing images to the long-distance processing module and to the short-distance processing module. This variant makes it possible to benefit from a specific camera adapted to the corresponding treatment.
Landscapes
- Engineering & Computer Science (AREA)
- Remote Sensing (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Aviation & Aerospace Engineering (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Computation (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Radar, Positioning & Navigation (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Multimedia (AREA)
- Automation & Control Theory (AREA)
- Astronomy & Astrophysics (AREA)
- Computing Systems (AREA)
- Databases & Information Systems (AREA)
- Software Systems (AREA)
- Robotics (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| FR2112597A FR3129737B1 (fr) | 2021-11-26 | 2021-11-26 | Systeme et procede de navigation autonome base vision d’un satellite |
| PCT/EP2022/082716 WO2023094347A1 (fr) | 2021-11-26 | 2022-11-22 | Système et procédé de navigation autonome base vision d'un satellite |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4436878A1 true EP4436878A1 (fr) | 2024-10-02 |
Family
ID=80933599
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP22821442.5A Pending EP4436878A1 (fr) | 2021-11-26 | 2022-11-22 | Système et procédé de navigation autonome base vision d'un satellite |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US20250026499A1 (fr) |
| EP (1) | EP4436878A1 (fr) |
| FR (1) | FR3129737B1 (fr) |
| WO (1) | WO2023094347A1 (fr) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US12442642B2 (en) * | 2022-05-06 | 2025-10-14 | Raytheon Company | Star trackers for range determination in rendezvous and proximity operations |
| KR102880945B1 (ko) * | 2022-11-30 | 2025-11-05 | 한국항공우주연구원 | 가상우주공간 구현을 위한 메타버스 플랫폼 운영 방법 및 시스템 |
| CN117647243B (zh) * | 2024-01-30 | 2024-04-16 | 山东星辰卫星技术有限公司 | 一种基于6u立方星的凝视监测方法及系统 |
| CN120183033B (zh) * | 2025-02-05 | 2026-04-14 | 沈阳航空航天大学 | 基于红外传感器和激光传感器的跌倒检测方法与系统 |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1995003215A1 (fr) * | 1993-07-22 | 1995-02-02 | Honeywell Inc. | Methode de creation d'une base de donnees sur les etoiles |
| US7142981B2 (en) * | 2003-08-05 | 2006-11-28 | The Boeing Company | Laser range finder closed-loop pointing technology of relative navigation, attitude determination, pointing and tracking for spacecraft rendezvous |
| FR2955190B1 (fr) * | 2010-01-14 | 2012-09-28 | Astrium Sas | Procede de detection d'une cible dans une image acquise depuis un vehicule survolant un corps celeste |
| US9944412B2 (en) * | 2013-10-04 | 2018-04-17 | Busek Co., Inc. | Spacecraft system for debris disposal and other operations and methods pertaining to the same |
| CN104482934B (zh) * | 2014-12-30 | 2016-10-19 | 华中科技大学 | 一种多传感器融合的超近距离自主导航装置与方法 |
| KR20190021344A (ko) * | 2016-06-20 | 2019-03-05 | 버터플라이 네트워크, 인크. | 초음파 디바이스를 작동하는 사용자를 보조하기 위한 자동화된 영상 취득 |
| DE102017102481A1 (de) * | 2017-02-08 | 2018-08-09 | Klaus Schilling | Formationsfähiger Kleinstsatellit und Formation aus mehreren Kleinstsatelliten |
| IT201900000619A1 (it) * | 2019-01-15 | 2020-07-15 | Arca Dynamics Soc A Responsabilita Limitata Semplificata | Stima dell'assetto e della velocita' angolare di un satellite basata sul solo utilizzo di sensori ottici |
| US11338944B2 (en) * | 2019-05-29 | 2022-05-24 | GM Global Technology Operations LLC | Control system for executing a safing mode sequence in a spacecraft |
| CN112712470B (zh) * | 2019-10-25 | 2024-09-06 | 华为技术有限公司 | 一种图像增强方法及装置 |
| US11745902B1 (en) * | 2019-12-11 | 2023-09-05 | Government Of The United States As Represented By The Secretary Of The Air Force | Systems, methods and apparatus for multifunctional central pattern generator |
| EP4105131B1 (fr) * | 2020-03-31 | 2024-08-21 | Kawasaki Jukogyo Kabushiki Kaisha | Dispositif de commande et programme d'ordinateur |
| US12165439B2 (en) * | 2020-07-15 | 2024-12-10 | Visual Defence Inc. | System and method for interactively reporting of roadway incidents on an AI device |
-
2021
- 2021-11-26 FR FR2112597A patent/FR3129737B1/fr active Active
-
2022
- 2022-11-22 WO PCT/EP2022/082716 patent/WO2023094347A1/fr not_active Ceased
- 2022-11-22 US US18/713,778 patent/US20250026499A1/en active Pending
- 2022-11-22 EP EP22821442.5A patent/EP4436878A1/fr active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| US20250026499A1 (en) | 2025-01-23 |
| FR3129737A1 (fr) | 2023-06-02 |
| WO2023094347A1 (fr) | 2023-06-01 |
| FR3129737B1 (fr) | 2023-11-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP4436878A1 (fr) | Système et procédé de navigation autonome base vision d'un satellite | |
| US10552979B2 (en) | Output of a neural network method for deep odometry assisted by static scene optical flow | |
| US10436884B2 (en) | Calibration of laser and vision sensors | |
| EP2428934B1 (fr) | Procédé d'estimation du mouvement d'un porteur par rapport à un environnement et dispositif de calcul pour système de navigation | |
| EP3388914A1 (fr) | Procédé de suivi de cible par un drone, programme d'ordinateur, système électronique et drone associés | |
| US11036240B1 (en) | Safe landing of aerial vehicles upon loss of navigation | |
| EP2724203B1 (fr) | Génération de données de carte | |
| US20190079535A1 (en) | Training and testing of a neural network method for deep odometry assisted by static scene optical flow | |
| US20190079533A1 (en) | Neural network architecture method for deep odometry assisted by static scene optical flow | |
| US20190080166A1 (en) | Data acquistion and input of neural network method for deep odometry assisted by static scene optical flow | |
| FR3070527A1 (fr) | Procede et dispositif d'evitement d'un objet par detection de son rapprochement d'un aeronef | |
| EP1982144B1 (fr) | Procede de geo-localisation d'une ou plusieurs cibles | |
| FR3005187A1 (fr) | Recalage d'images sar par information mutuelle. | |
| WO2018109384A1 (fr) | Localisation d'un vehicule | |
| WO2016087784A1 (fr) | Procédé d'estimation du mouvement d'un porteur par rapport à un environnement et dispositif de calcul pour système de navigation | |
| EP2517152B1 (fr) | Procede de classification d'objets dans un systeme de veille par imagerie | |
| EP3776471B1 (fr) | Procédé pour la localisation d'une cible à partir d'un contour elliptique | |
| FR3094081A1 (fr) | Procédé d’estimation passive du temps avant collision pour un aéronef ou de tout objet volant pouvant être guidé, procédé de navigation associé | |
| EP4006491B1 (fr) | Système d'aide à la navigation d'un porteur à l'aide d'amers | |
| FR3107388A1 (fr) | Procédé et système d’aide à la navigation pour un aéronef par détection d’objets maritimes en vue d’un vol d’approche, d’une mise en vol stationnaire ou d’un atterrissage | |
| Yang et al. | A Novel Geolocalization Algorithm for UAV Under GNSS-denied Environment using Heading Estimation before Image Matching | |
| WO2025207878A1 (fr) | Procédé et système de construction de carte à l'aide de capteurs de perception et de mouvement | |
| FR3166601A1 (fr) | Procédé et dispositif de contrôle d’un véhicule automatisé circulant dans un environnement routier | |
| FR3162899A1 (fr) | Procédé et dispositif de génération de trajectoire d'un appareil mobile entre un point de départ et un point de destination | |
| WO2026027541A1 (fr) | Procédé de recalage automatique de la navigation d'un système optronique évoluant dans une zone de navigation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20240517 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: B64G 1/10 20060101AFI20250925BHEP Ipc: B64G 1/36 20060101ALI20250925BHEP Ipc: B64G 1/68 20060101ALI20250925BHEP Ipc: G06T 7/73 20170101ALI20250925BHEP Ipc: G06T 7/277 20170101ALI20250925BHEP Ipc: B64G 1/24 20060101ALI20250925BHEP Ipc: G01C 21/20 20060101ALN20250925BHEP |
|
| 17Q | First examination report despatched |
Effective date: 20251006 |
|
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: B64G 1/10 20060101AFI20250929BHEP Ipc: B64G 1/36 20060101ALI20250929BHEP Ipc: B64G 1/68 20060101ALI20250929BHEP Ipc: G06T 7/73 20170101ALI20250929BHEP Ipc: G06T 7/277 20170101ALI20250929BHEP Ipc: B64G 1/24 20060101ALI20250929BHEP Ipc: G01C 21/20 20060101ALN20250929BHEP |