WO2020037610A1 - Motion trajectory prediction method for target object, and monitoring platform - Google Patents

Motion trajectory prediction method for target object, and monitoring platform Download PDF

Info

Publication number
WO2020037610A1
WO2020037610A1 PCT/CN2018/101977 CN2018101977W WO2020037610A1 WO 2020037610 A1 WO2020037610 A1 WO 2020037610A1 CN 2018101977 W CN2018101977 W CN 2018101977W WO 2020037610 A1 WO2020037610 A1 WO 2020037610A1
Authority
WO
WIPO (PCT)
Prior art keywords
target object
state
trajectory
motion
model
Prior art date
Application number
PCT/CN2018/101977
Other languages
French (fr)
Chinese (zh)
Inventor
邬奇峰
李昊南
刘尧
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2018/101977 priority Critical patent/WO2020037610A1/en
Priority to CN201880041186.1A priority patent/CN110785765A/en
Publication of WO2020037610A1 publication Critical patent/WO2020037610A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/10Terrestrial scenes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • G06T7/246Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • G06T7/246Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/251Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving models
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30241Trajectory
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07Target detection

Definitions

  • the present invention relates to the field of monitoring technology, and in particular, to a method and a monitoring platform for predicting a motion trajectory of a target object.
  • the monitoring platform (fixed monitoring platform or mobile monitoring platform) can realize the monitoring of the target object, and some monitoring platforms can further follow the target object.
  • the target object may be blocked by obstacles.
  • the monitoring platform cannot observe the target object because the monitoring platform cannot obtain the motion data or images of the target object, and the target object is in a lost state.
  • the motion trajectory prediction method of the target object in the prior art cannot accurately predict the motion trajectory of the target object in the lost state.
  • the invention provides a method and a monitoring platform for predicting the motion trajectory of a target object to improve the accuracy of prediction of the motion trajectory of the target object.
  • a first aspect of the present invention is to provide a method for predicting a motion trajectory of a target object, which is applied to a monitoring platform and includes:
  • the motion trajectory of the target object in the lost state is predicted according to the updated trajectory model.
  • a second aspect of the present invention is to provide a monitoring platform, including:
  • a processor for running a computer program stored in the memory to implement:
  • the motion trajectory of the target object in the lost state is predicted according to the updated trajectory model.
  • a third aspect of the present invention is to provide a monitoring platform, including:
  • a processing module configured to obtain an expected motion state of a target object when the target object is in a lost state according to a trajectory model, wherein the target object is a monitoring object of the monitoring platform, and the trajectory model includes a model coefficient;
  • An acquisition module configured to acquire an observation position when the target object is in a monitoring state
  • a determining module configured to determine the model coefficient according to the observation position and the expected motion state, and update the trajectory model based on the determined model coefficient
  • the prediction module is configured to predict a motion trajectory of the target object in a lost state according to the updated trajectory model.
  • a fourth aspect of the present invention is to provide a computer-readable storage medium, where the computer-readable storage medium stores program instructions, and the program instructions are used to implement the method for predicting a motion track of a target object according to the first aspect.
  • the method and monitoring platform for predicting the trajectory of a target object determine the model coefficients based on the expected motion state and observation position of the target object, update the trajectory model based on the determined model coefficients, and predict the target object based on the updated trajectory model The trajectory when in a lost state.
  • determining the model coefficients of the trajectory model of the target object through the expected motion state and observation position can effectively improve the accuracy of the determination of the model coefficients, and then obtain a more accurate trajectory model of the target object, which can effectively improve the target.
  • the accuracy of the object's motion trajectory prediction can effectively improve the accuracy of the determination of the model coefficients.
  • FIG. 1 is a schematic flowchart of a method for predicting a motion trajectory of a target object according to an embodiment of the present invention
  • FIG. 2 is a schematic flowchart of determining the model coefficient according to the observation position and an expected motion state according to an embodiment of the present invention
  • FIG. 3 is a first schematic flowchart of obtaining an observation position when the target object is in a monitoring state according to an embodiment of the present invention
  • FIG. 4 is a second schematic flowchart of obtaining an observation position of the target object in a monitoring state according to an embodiment of the present invention
  • FIG. 5 is a schematic flowchart of another method for predicting a motion trajectory of a target object according to an embodiment of the present invention
  • FIG. 6 is a schematic structural diagram of a monitoring platform according to an embodiment of the present invention.
  • FIG. 7 is a schematic structural diagram of another monitoring platform according to an embodiment of the present invention.
  • the target object is the monitoring object of the monitoring platform.
  • the monitoring platform may include a fixed monitoring platform, for example, a monitoring device provided on a fixed object (such as a building or a pole).
  • the monitoring device may be provided on a building.
  • the monitoring platform may include a movable platform, where the movable platform may be a monitoring device that is moved by an external force, such as a handheld gimbal; the movable platform may be a monitoring device that is moved by a power system configured by itself, specifically,
  • the movable platform may include a mobile robot. Further, the mobile robot may include a land mobile robot, an underwater or surface robot, a drone or a space robot, and so on.
  • the target object may be an object having specific characteristics, for example, the target object may include a user, a car, an animal, and the like.
  • the status of the target object can include the monitoring state and the missing state.
  • the monitoring platform can observe the target object, for example, the position of the target object is observed, that is, the observation position P i of the target object is obtained.
  • the monitoring platform cannot observe the target object, for example, the position of the target object cannot be observed.
  • the target object In complex environments (such as woods, indoor environments, etc.), the target object may be blocked by obstacles. Because the monitoring platform cannot observe the target object, the target object is lost. For example, the monitoring platform cannot observe the target object. The monitoring platform cannot obtain the observation position of the target object.
  • the trajectory model of the target object can be used to represent the motion trajectory of the target object.
  • the trajectory model can specifically be a function that uses time as an independent variable to indicate the relationship between the position and time of the target object.
  • the trajectory model may include model coefficients, and the model coefficients may be parameters other than independent variables in the trajectory model.
  • the trajectory model may include a polynomial trajectory model.
  • the model coefficients are polynomial coefficients and constant terms in the polynomial trajectory model.
  • the trajectory model may be other types of models, for example, the trajectory model may be an exponential trajectory model.
  • the trajectory model of the target object can be used to predict the motion trajectory of the target object.
  • the target object is in a lost state, that is, after the target object is lost.
  • the trajectory of the target object can be predicted according to the trajectory model of the target object. For example, by substituting the moment after the target object is lost into the trajectory model of the target object, it can predict the position of the target object when it is lost.
  • a model coefficient in the trajectory model of the target object is determined by running a minimum fitting algorithm on the position constraint of the target object, that is, the motion trajectory of the target object is simulated.
  • the position constraint may be determined according to a position error between the observation position and an expected position corresponding to the observation position, wherein the expected position is determined according to a trajectory model of a target object.
  • a position error between the observation position and an expected position corresponding to the observation position is T (t i ) -p i
  • the position constraint may be: Run a minimization fitting algorithm on the position constraints of the target object To determine the model coefficients in the trajectory model of the target object.
  • the constraint is only imposed on the position dimension, and the motion state of the target object when it is lost is not considered. This results in inaccurate motion trajectories, and the trajectory model determined by the fit cannot reflect that the target objects are lost. State of motion. For example, when the target object in the lost state moves at approximately uniform speed, since the motion state of the target object in the lost state is not taken into account, it can be calculated that the target object in the lost state may have large motion acceleration according to the fitted motion trajectory.
  • FIG. 1 is a schematic flowchart of a method for predicting a motion trajectory of a target object according to an embodiment of the present invention.
  • this embodiment provides a method for predicting a motion trajectory of a target object. Apply to monitoring platform. Specifically, the method includes:
  • S101 Obtain an expected motion state when the target object is in a lost state according to the trajectory model of the target object, where the target object is a monitoring object of the monitoring platform, and the trajectory model includes a model coefficient;
  • the monitoring platform may obtain an expected motion state of the target object according to the trajectory model of the target object.
  • the expected motion state of the target object may include at least one of a speed, an acceleration, and a change amount of the acceleration.
  • those skilled in the art may set it according to specific design requirements and use requirements, and details are not described herein again.
  • the expected motion state is acceleration
  • the acceleration model of the target object can be obtained according to the trajectory model of the target object, and the moment when the target object is in the missing state is substituted into the acceleration model of the target object, that is, the target object can be obtained Lost state acceleration.
  • the monitoring platform can observe the target object.
  • the monitoring platform can obtain the observation position of the target object.
  • the observation position and the expected motion state may be analyzed and processed to determine a model coefficient of the trajectory model, and the trajectory model may be further updated based on the determined model coefficient.
  • the trajectory model of the target object After obtaining the updated trajectory model, the trajectory model of the target object has been determined.
  • S104 Predict the motion trajectory of the target object in a lost state according to the updated trajectory model.
  • the updated trajectory model may be used to predict the motion trajectory of the target object to obtain the motion trajectory when the target object is in a lost state. For example, the time when the target object is in a lost state can be substituted into the updated trajectory model, that is, the position of the target object can be predicted, and then the motion trajectory of the target object in the lost state can be predicted by the predicted position of the target object.
  • the method for predicting the trajectory of a target object determines a model coefficient based on the expected motion state and observation position of the target object, updates the trajectory model based on the determined model coefficient, and can predict that the target object is missing based on the updated trajectory model.
  • the motion trajectory in the state Among them, determining the model coefficients of the trajectory model of the target object through the expected motion state and observation position can effectively improve the accuracy of the determination of the model coefficients, and then obtain a more accurate trajectory model of the target object, which can effectively improve the target. The accuracy of the object's motion trajectory prediction.
  • FIG. 2 is a schematic flowchart of determining a model coefficient according to an observation position and an expected motion state according to an embodiment of the present invention; based on the foregoing embodiment, and referring to FIG. 2, it can be known that the specific determination method of the model coefficient is not performed in this embodiment. By definition, a person skilled in the art may set it according to specific design requirements.
  • determining the model coefficient according to the observation position and the expected motion state may include:
  • S201 Obtain a position error between an observation position and an expected position when the target object is in a monitoring state, and determine a position constraint of the target object according to the position error, where the expected position is a target object corresponding to the observation position determined according to the trajectory model. position;
  • the monitoring platform can obtain the observation position P i when the target object is in the monitoring state, and the monitoring platform can obtain the expected position of the target object corresponding to the observation position according to the trajectory model of the target object as T (t i ). For example, at time t i when the target object is in the monitoring state, the monitoring platform acquires the observation position P i when the target object is in the monitoring state, and can substitute t i into the trajectory model of the target object, that is, it can obtain the observation position The expected position of the corresponding target object. At this time, the expected position of the target object is the expected position where the target object is in a monitoring state.
  • the monitoring platform may obtain a position error between the observed position and the expected position, and the position error may be T (t i ) -p i or p i -T (t i ), and then the target object is determined according to the position error.
  • the position constraint may be:
  • the position constraint is It can be understood that those skilled in the art may also use other methods to determine the position constraint of the target object according to the position error according to the specific usage scenario and design requirements, and details are not described herein again.
  • the motion state constraint of the target object may be determined according to the expected motion state.
  • the specific determination method of the motion state constraint of the target object can be implemented in the following feasible ways:
  • a feasible method is to determine the integral term according to the expected motion state, and perform integral operation on the integral term within a preset time period to obtain the motion state constraint of the target object, wherein the preset time period is when the target object is in a lost state. period.
  • an integral term corresponding to the expected motion state may be determined.
  • the determined integral term corresponding to the expected motion state may be
  • the said Integral term performs integral operation to obtain the motion state constraint of the target object or
  • (t l , t m ) is a preset time period, and the preset time period is a time period when the target object is in a lost state.
  • t l is the initial time when the target object is in the lost state, that is, the time when the monitoring platform determines that the target object is in the lost state
  • t m is the intermediate time when the target object is in the lost state.
  • Another feasible way is to determine a plurality of accumulation terms according to the expected movement state, and perform accumulation operations on the plurality of accumulation terms to obtain a movement state constraint of the target object.
  • the expected motion state of the target object at multiple moments can be obtained, so that multiple accumulation terms can be determined, and accumulation operations are performed on the multiple accumulation terms to obtain the movement state constraints of the target object.
  • the expected motion state is acceleration
  • T (2) (t j ) corresponding to the expected motion state T (2) (t j ) may be obtained.
  • S203 Run a minimization fitting algorithm based on position constraints and motion state constraints to determine model coefficients.
  • a minimization fitting algorithm may be run based on the position constraint and the motion state constraint to determine a model coefficient of the trajectory model.
  • the position constraint is abbreviated as A and the motion state constraint is abbreviated as B.
  • a fitting term may be determined based on the position constraint A and the motion state constraint B, and a minimizing fitting algorithm is run on the fitting term.
  • the fitted term may be (A + ⁇ t B), and a minimization fitting algorithm min (A + ⁇ t B) is run on the fitted term to determine a model coefficient, where ⁇ t may be a prediction Set the coefficient.
  • the expected motion state is acceleration
  • the target object is in a lost state
  • the acceleration of the target object is small, which is approximately uniform motion.
  • the motion state constraint should be as small as possible, that is, the acceleration of the target object in the missing state should be as small as possible.
  • the expected motion state is a change amount of acceleration
  • the change amount of acceleration of the target object is small, which is similar to a uniformly variable motion.
  • the motion state constraint should be as small as possible, that is, the change amount of the acceleration of the target object in the missing state should be as small as possible .
  • the trajectory prediction method provided by the embodiment of the present invention can determine the model coefficients of the trajectory model more accurately by considering both the position constraint and the motion state constraint, thereby obtaining a more accurate trajectory model of the target object. Effectively improve the accuracy of the target's motion trajectory prediction.
  • the method further includes: sending the motion trajectory to the control The terminal so that the control terminal displays the motion track on the interactive interface.
  • the monitoring platform may send the motion trajectory to the control terminal.
  • the control terminal may be a terminal device with a display device, such as one or more of a smart phone, a tablet computer, a laptop computer, a desktop computer, and a wearable device.
  • the control terminal After the control terminal receives the motion track, it controls The display device on the terminal can display the motion trajectory, so that the user can intuitively obtain the motion trajectory of the target object in the lost state.
  • FIG. 3 is a schematic flowchart of acquiring an observation position when a target object is in a monitoring state according to an embodiment of the present invention.
  • the monitoring platform includes a photographing device, and the photographing device may include a camera, a video camera, and so on.
  • the obtaining the observation position of the target object when it is in a monitoring state includes:
  • S301 Acquire an image output by the shooting device
  • S302 Obtain an observation position of a target object according to an image, where the image includes the target object.
  • the processor of the monitoring platform may acquire an image output by the shooting device, where the image includes a target object, and the processor may identify the target object in the image to obtain a position of the target object in the image, and further Ground, the observation position of the target object is acquired according to the position of the target object in the image.
  • the target object when the target object is in an image output by the shooting device, the target object is in a monitoring state, and the monitoring platform can obtain the observation position of the target object through the image.
  • the monitoring platform cannot obtain the observation position of the target object through the image, and the target object is in a lost state.
  • FIG. 4 is a second schematic flowchart of obtaining an observation position of a target object in a monitoring state according to an embodiment of the present invention. Based on the above embodiment, it can be known from continuing to refer to FIG. 4 that acquiring the observation position when the target object is in a monitoring state may include:
  • S401 Acquire motion data sent by a control terminal carried by a target object
  • the target object carries a control terminal, wherein the control terminal is configured with a motion sensor, and the motion sensor can detect the motion data of the target object and output the motion data.
  • the motion data may include at least one of motion position information, speed information, and acceleration information
  • the motion sensor may include a satellite positioning receiver, an inertial measurement unit, a photoelectric code disc, and the like.
  • the control terminal may send the motion data to the monitoring platform. After the monitoring platform obtains the motion data, it may analyze and process the motion data to obtain the observation position of the target object.
  • the monitoring platform can receive the motion data sent by the control terminal, the target object is in a monitoring state, and the monitoring platform can obtain the observation position of the target object through the image.
  • the monitoring platform cannot receive the motion data sent by the control terminal, the monitoring platform cannot obtain the observation position of the target object through the image, and the target object is in a lost state.
  • FIG. 5 is a schematic flowchart of another method for predicting a motion trajectory of a target object according to an embodiment of the present invention. Based on the above embodiments, and referring to FIG. 5 continuously, in order to improve the practicability of the method, the method may further include:
  • the monitoring platform may include a mobile robot, and the target object may be a follower of the mobile robot.
  • the processor of the mobile robot may determine the motion trajectory of the mobile robot according to the observation position of the target object, and control the mobile robot to move according to the motion trajectory to follow the target object.
  • the processor of the mobile robot can determine the motion trajectory of the mobile robot according to the predicted motion trajectory.
  • determining the motion trajectory of the mobile robot according to the motion trajectory may include: determining the motion trajectory as the motion trajectory of the mobile robot.
  • the processor of the mobile robot may determine the predicted motion trajectory of the target object as the motion trajectory of the mobile robot.
  • S502 Control the mobile robot to move according to the motion trajectory.
  • the processor of the mobile robot may control the mobile robot to move according to the determined motion trajectory to follow the target object. Since the motion trajectory is determined according to the predicted motion trajectory of the target object, the mobile robot is When the determined motion trajectory moves, the probability of the mobile robot encountering an obstacle can be effectively reduced, and at the same time, the probability of retrieving and recovering the monitoring after the target object is blocked can be improved, thereby ensuring the success rate of following.
  • FIG. 6 is a schematic structural diagram of a monitoring platform according to an embodiment of the present invention. As can be seen with reference to FIG. 6, this embodiment provides a monitoring platform.
  • the monitoring platform may be a movable platform, and the movable platform may include a mobile platform.
  • Robot; specifically, the monitoring platform may include:
  • the processor 602 is configured to run a computer program stored in the memory 601 to implement: obtaining an expected motion state of the target object when the target object is in a lost state according to a trajectory model, wherein the target object is a monitoring object of the monitoring platform, and the trajectory model includes model coefficients; The observation position of the target object in the monitoring state; the model coefficients are determined according to the observation position and the expected motion state, and the trajectory model is updated based on the determined model coefficients; the motion trajectory of the target object in the lost state is predicted based on the updated trajectory model.
  • the trajectory model may be a polynomial trajectory model; the expected motion state may include: acceleration and / or a change amount of the acceleration.
  • the processor 602 determines the model coefficient according to the observation position and the expected motion state
  • the processor 602 is configured to:
  • a minimization fitting algorithm is run based on position constraints and motion state constraints to determine model coefficients.
  • an implementable manner is that the processor 602 is configured to:
  • the integral term is determined according to the expected motion state, and the integral term is integrated within a preset time period to obtain the motion state constraint of the target object, wherein the preset time period is a time period when the target object is in a lost state.
  • processor 602 is configured to:
  • Multiple accumulation terms are determined according to the expected movement state, and accumulation operations are performed on the multiple accumulation terms to obtain a movement state constraint of the target object.
  • processor 602 is configured to:
  • the motion trajectory is sent to the control terminal so that the control terminal displays the motion trajectory on the interactive interface.
  • an implementable manner is that the monitoring platform includes a photographing device, and the processor 602 is configured to:
  • processor 602 obtains the observation position when the target object is in a monitoring state
  • another implementable manner is that the processor 602 is configured to:
  • processor 602 is configured to:
  • the processor 602 determines the motion trajectory of the mobile robot according to the motion trajectory
  • the processor 602 is configured to:
  • the motion trajectory is determined as the motion trajectory of the mobile robot.
  • the monitoring platform in this embodiment may be used to execute the technical solution of the embodiment shown in FIG. 1-5 in the foregoing method, and the implementation principles and technical effects thereof are similar, and details are not described herein again.
  • FIG. 7 is a schematic structural diagram of another monitoring platform according to an embodiment of the present invention. Referring to FIG. 7, this embodiment provides another monitoring platform.
  • the monitoring platform may include:
  • a processing module 701 is configured to obtain an expected motion state of a target object when the target object is in a lost state according to a trajectory model, where the target object is a monitoring object of a monitoring platform, and the trajectory model includes a model coefficient;
  • An obtaining module 702 configured to obtain an observation position when the target object is in a monitoring state
  • a determining module 703, configured to determine a model coefficient according to the observation position and the expected motion state, and update the trajectory model based on the determined model coefficient;
  • the prediction module 704 is configured to predict a motion trajectory of the target object in a lost state according to the updated trajectory model.
  • the monitoring platform in this embodiment may be used to execute the technical solution of the embodiment shown in FIG. 1-5 in the foregoing method, and the implementation principles and technical effects thereof are similar, and details are not described herein again.
  • Another aspect of this embodiment provides a computer-readable storage medium.
  • the computer-readable storage medium stores program instructions, and the program instructions are used to implement a method for predicting a motion trajectory of a target object in any one of the foregoing embodiments.
  • the related apparatuses and methods disclosed may be implemented in other ways.
  • the device embodiments described above are only schematic.
  • the division of the modules or units is only a logical function division.
  • multiple units or components may be divided.
  • the combination can either be integrated into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, which may be electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objective of the solution of this embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist separately physically, or two or more units may be integrated into one unit.
  • the above integrated unit may be implemented in the form of hardware or in the form of software functional unit.
  • the integrated unit When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable storage medium.
  • the technical solution of the present invention essentially or part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium , Including a number of instructions to cause the computer processor 101 (processor) to perform all or part of the steps of the method described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Analysis (AREA)

Abstract

Disclosed in the present invention are a motion trajectory prediction method for a target object, and a monitoring platform, said method comprising: acquiring, according to a trajectory model, an expected motion state of a target object in a lost state, the target object being an object monitored by a monitoring platform, and the trajectory model comprising model coefficients; acquiring an observation position of the target object in a monitored state; determining the model coefficients according to the observation position and the expected motion state, and updating the trajectory model on the basis of the determined model coefficients; and predicting, according to the updated trajectory model, the motion trajectory of the target object in the lost state. The present invention uses the expected motion state and the observation position to determine the model coefficients of the trajectory model of the target object, effectively improving the accuracy of determination of the model coefficients, obtaining a more accurate trajectory model of the target object, and thereby effectively improving the accuracy of motion trajectory prediction for the target object.

Description

目标对象的运动轨迹预测方法和监控平台Prediction method and monitoring platform of target object's motion trajectory 技术领域Technical field
本发明涉及监控技术领域,尤其涉及一种目标对象的运动轨迹预测方法和监控平台。The present invention relates to the field of monitoring technology, and in particular, to a method and a monitoring platform for predicting a motion trajectory of a target object.
背景技术Background technique
随着科学技术的不断进步,监控平台(固定监控平台或者移动监控平台)可以实现对目标对象的监控,某些监控平台还可以进一步地对目标对象进行跟随。With the continuous progress of science and technology, the monitoring platform (fixed monitoring platform or mobile monitoring platform) can realize the monitoring of the target object, and some monitoring platforms can further follow the target object.
在复杂环境(例如树林、室内环境等)中,目标对象可能被障碍物遮挡,监控平台由于无法获取目标对象的运动数据或者图像而导致监控平台无法观测到目标对象,目标对象处于丢失状态。然而,当目标对象处于丢失状态时,按照现有技术中目标对象的运动轨迹预测方法不能准确地预测出处于丢失状态的目标对象的运动轨迹。In complex environments (such as woods, indoor environments, etc.), the target object may be blocked by obstacles. The monitoring platform cannot observe the target object because the monitoring platform cannot obtain the motion data or images of the target object, and the target object is in a lost state. However, when the target object is in a lost state, the motion trajectory prediction method of the target object in the prior art cannot accurately predict the motion trajectory of the target object in the lost state.
发明内容Summary of the Invention
本发明提供了一种目标对象的运动轨迹预测方法和监控平台,以提高目标对象的运动轨迹预测的准确性。The invention provides a method and a monitoring platform for predicting the motion trajectory of a target object to improve the accuracy of prediction of the motion trajectory of the target object.
本发明的第一方面是为了提供一种目标对象的运动轨迹预测方法,应用于监控平台,包括:A first aspect of the present invention is to provide a method for predicting a motion trajectory of a target object, which is applied to a monitoring platform and includes:
根据轨迹模型获取目标对象处于丢失状态时的预期运动状态,其中,所述目标对象为所述监控平台的监控对象,所述轨迹模型包括模型系数;Obtaining the expected motion state of the target object in a lost state according to a trajectory model, wherein the target object is a monitoring object of the monitoring platform, and the trajectory model includes a model coefficient;
获取所述目标对象处于监控状态时的观测位置;Obtaining an observation position when the target object is in a monitoring state;
根据所述观测位置和预期运动状态确定所述模型系数,并基于所确定的模型系数更新所述轨迹模型;Determining the model coefficient according to the observation position and the expected motion state, and updating the trajectory model based on the determined model coefficient;
根据更新后的轨迹模型预测所述目标对象处于丢失状态时的运动轨迹。The motion trajectory of the target object in the lost state is predicted according to the updated trajectory model.
本发明的第二方面是为了提供一种监控平台,包括:A second aspect of the present invention is to provide a monitoring platform, including:
存储器,用于存储计算机程序;Memory for storing computer programs;
处理器,用于运行所述存储器中存储的计算机程序以实现:A processor for running a computer program stored in the memory to implement:
根据轨迹模型获取目标对象处于丢失状态时的预期运动状态,其中,所述目标对象为所述监控平台的监控对象,所述轨迹模型包括模型系数;Obtaining the expected motion state of the target object in a lost state according to a trajectory model, wherein the target object is a monitoring object of the monitoring platform, and the trajectory model includes a model coefficient;
获取所述目标对象处于监控状态时的观测位置;Obtaining an observation position when the target object is in a monitoring state;
根据所述观测位置和预期运动状态确定所述模型系数,并基于所确定的模型系数更新所述轨迹模型;Determining the model coefficient according to the observation position and the expected motion state, and updating the trajectory model based on the determined model coefficient;
根据更新后的轨迹模型预测所述目标对象处于丢失状态时的运动轨迹。The motion trajectory of the target object in the lost state is predicted according to the updated trajectory model.
本发明的第三方面是为了提供一种监控平台,包括:A third aspect of the present invention is to provide a monitoring platform, including:
处理模块,用于根据轨迹模型获取目标对象处于丢失状态时的预期运动状态,其中,所述目标对象为所述监控平台的监控对象,所述轨迹模型包括模型系数;A processing module configured to obtain an expected motion state of a target object when the target object is in a lost state according to a trajectory model, wherein the target object is a monitoring object of the monitoring platform, and the trajectory model includes a model coefficient;
获取模块,用于获取所述目标对象处于监控状态时的观测位置;An acquisition module, configured to acquire an observation position when the target object is in a monitoring state;
确定模块,用于根据所述观测位置和预期运动状态确定所述模型系数,并基于所确定的模型系数更新所述轨迹模型;A determining module, configured to determine the model coefficient according to the observation position and the expected motion state, and update the trajectory model based on the determined model coefficient;
预测模块,用于根据更新后的轨迹模型预测所述目标对象处于丢失状态时的运动轨迹。The prediction module is configured to predict a motion trajectory of the target object in a lost state according to the updated trajectory model.
本发明的第四方面是为了提供一种计算机可读存储介质,该计算机可读存储介质中存储有程序指令,所述程序指令用于实现第一方面所述的目标对象的运动轨迹预测方法。A fourth aspect of the present invention is to provide a computer-readable storage medium, where the computer-readable storage medium stores program instructions, and the program instructions are used to implement the method for predicting a motion track of a target object according to the first aspect.
本发明提供的目标对象的运动轨迹预测方法和监控平台,通过目标对象的预期运动状态和观测位置确定模型系数,基于所确定的模型系数更新轨迹模型,并可以根据更新后的轨迹模型预测目标对象处于丢失状态时的运动轨迹。其中,通过预期运动状态和观测位置来确定目标对象的轨迹模型的模型系数,可以有效地提高所述模型系数确定的准确性,进而得到更加准确的目标对象的轨迹模型,这样可以有效地提高目标对象的运动轨迹预测的准确性。The method and monitoring platform for predicting the trajectory of a target object provided by the present invention determine the model coefficients based on the expected motion state and observation position of the target object, update the trajectory model based on the determined model coefficients, and predict the target object based on the updated trajectory model The trajectory when in a lost state. Among them, determining the model coefficients of the trajectory model of the target object through the expected motion state and observation position can effectively improve the accuracy of the determination of the model coefficients, and then obtain a more accurate trajectory model of the target object, which can effectively improve the target. The accuracy of the object's motion trajectory prediction.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1为本发明实施例提供的一种目标对象的运动轨迹预测方法的流程示意图;FIG. 1 is a schematic flowchart of a method for predicting a motion trajectory of a target object according to an embodiment of the present invention; FIG.
图2为本发明实施例提供的根据所述观测位置和预期运动状态确定所述模型系数的流程示意图;FIG. 2 is a schematic flowchart of determining the model coefficient according to the observation position and an expected motion state according to an embodiment of the present invention; FIG.
图3为本发明实施例提供的获取所述目标对象处于监控状态时的观测位置的流程示意图一;FIG. 3 is a first schematic flowchart of obtaining an observation position when the target object is in a monitoring state according to an embodiment of the present invention; FIG.
图4为本发明实施例提供的获取所述目标对象处于监控状态时的观测位置的流程示意图二;FIG. 4 is a second schematic flowchart of obtaining an observation position of the target object in a monitoring state according to an embodiment of the present invention; FIG.
图5为本发明实施例提供的另一种目标对象的运动轨迹预测方法的流程示意图;5 is a schematic flowchart of another method for predicting a motion trajectory of a target object according to an embodiment of the present invention;
图6为本发明实施例提供的一种监控平台的结构示意图;6 is a schematic structural diagram of a monitoring platform according to an embodiment of the present invention;
图7为本发明实施例提供的另一种监控平台的结构示意图。FIG. 7 is a schematic structural diagram of another monitoring platform according to an embodiment of the present invention.
具体实施方式detailed description
为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be described clearly and completely in combination with the drawings in the embodiments of the present invention. It is a part of the embodiments of the present invention, but not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
除非另有定义,本文所使用的所有的技术和科学术语与属于本发明的技术领域的技术人员通常理解的含义相同。本文中在本发明的说明书中所使用的术语只是为了描述具体的实施例的目的,不是旨在于限制本发明。Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used herein in the description of the invention is for the purpose of describing particular embodiments only and is not intended to limit the invention.
下面结合附图,对本发明的一些实施方式作详细说明。在各实施例之间不冲突的情况下,下述的实施例及实施例中的特征可以相互组合。Hereinafter, some embodiments of the present invention will be described in detail with reference to the drawings. In the case where there is no conflict between the embodiments, the following embodiments and features in the embodiments can be combined with each other.
目标对象是监控平台的监控对象,监控平台可以包括固定的监控平台,例如:设置在固定物体(例如建筑物、杆体)上的监控设备,举例来说,该监控设备可以为设置在建筑物上的视频监控设备。监控平台可以包括可移动平台,其中,所述可移动平台可以为通过外力移动的监控设备,例如手持云台;所述可移动平台可以为通过自身配置的动力系统移动的监控设备,具体 地,可移动平台可以包括移动机器人,进一步的,移动机器人可以包括:陆地移动机器人、水下或者水面机器人、无人机或空间机器人等等。目标对象可以是具有特定特征的物体,例如,所述目标对象可以包括用户、汽车、动物等等。The target object is the monitoring object of the monitoring platform. The monitoring platform may include a fixed monitoring platform, for example, a monitoring device provided on a fixed object (such as a building or a pole). For example, the monitoring device may be provided on a building. Video surveillance equipment. The monitoring platform may include a movable platform, where the movable platform may be a monitoring device that is moved by an external force, such as a handheld gimbal; the movable platform may be a monitoring device that is moved by a power system configured by itself, specifically, The movable platform may include a mobile robot. Further, the mobile robot may include a land mobile robot, an underwater or surface robot, a drone or a space robot, and so on. The target object may be an object having specific characteristics, for example, the target object may include a user, a car, an animal, and the like.
按照监控平台是否可以监控到目标对象来区分,目标对象的状态可以包括监控状态和丢失状态。According to whether the monitoring platform can monitor the target object, the status of the target object can include the monitoring state and the missing state.
当目标对象处于监控状态时,监控平台可以观测到目标对象,例如观测到目标对象的位置,即获取到目标对象的观测位置P iWhen the target object is in a monitoring state, the monitoring platform can observe the target object, for example, the position of the target object is observed, that is, the observation position P i of the target object is obtained.
当目标对象处于丢失状态时,监控平台观测不到目标对象,例如观测不到目标对象的位置。在复杂环境(例如树林、室内环境等)中,目标对象可能被障碍物遮挡,监控平台由于无法观测到目标对象,目标对象处于丢失状态,举例来说,监控平台无法观测到目标对象,可以为监控平台无法获取目标对象的观测位置。When the target object is lost, the monitoring platform cannot observe the target object, for example, the position of the target object cannot be observed. In complex environments (such as woods, indoor environments, etc.), the target object may be blocked by obstacles. Because the monitoring platform cannot observe the target object, the target object is lost. For example, the monitoring platform cannot observe the target object. The monitoring platform cannot obtain the observation position of the target object.
目标对象的轨迹模型可以用来表示目标对象的运动轨迹,该轨迹模型具体可以是以时间为自变量的函数,用来表示目标对象的位置和时间之间的关系。所述轨迹模型中可以包括模型系数,所述模型系数可以为轨迹模型中除自变量之外的参数。进一步地,所述轨迹模型可以包括多项式轨迹模型,此时,模型系数为多项式轨迹模型中的多项式系数和常数项。例如,以目标对象在X轴上的运动轨迹为例,所述轨迹模型可以为多项式轨迹模型T(t)=p 0+p 1t+p 2t 2+p 3t 3+…+p nt n,其中,所述模型系数可以为p 0、p 1、p 2、p 3...p n。在某些实施例中,所述轨迹模型可以为其他类型的模型,例如所述轨迹模型可以为指数轨迹模型。 The trajectory model of the target object can be used to represent the motion trajectory of the target object. The trajectory model can specifically be a function that uses time as an independent variable to indicate the relationship between the position and time of the target object. The trajectory model may include model coefficients, and the model coefficients may be parameters other than independent variables in the trajectory model. Further, the trajectory model may include a polynomial trajectory model. In this case, the model coefficients are polynomial coefficients and constant terms in the polynomial trajectory model. For example, taking the trajectory of the target object on the X axis as an example, the trajectory model may be a polynomial trajectory model T (t) = p 0 + p 1 t + p 2 t 2 + p 3 t 3 + ... + p n t n , wherein the model coefficients may be p 0 , p 1 , p 2 , p 3 ... p n . In some embodiments, the trajectory model may be other types of models, for example, the trajectory model may be an exponential trajectory model.
当目标对象处于丢失状态时,为了对目标对象进行持续监控,需要对目标对象的运动轨迹进行预测。此时,可以利用目标对象的轨迹模型来对目标对象的运动轨迹进行预测,具体地,当目标对象的轨迹模型中的模型系数已知时,目标对象处于丢失状态时,即目标对象丢失以后的时刻,都可以根据目标对象的轨迹模型来预测目标对象的运动轨迹。例如,将目标对象丢失以后的时刻代入到目标对象的轨迹模型中,即可以预测目标对象处于丢失状态时的位置。When the target object is in a lost state, in order to continuously monitor the target object, it is necessary to predict the motion trajectory of the target object. At this time, the trajectory model of the target object can be used to predict the motion trajectory of the target object. Specifically, when the model coefficients in the trajectory model of the target object are known, the target object is in a lost state, that is, after the target object is lost. At any time, the trajectory of the target object can be predicted according to the trajectory model of the target object. For example, by substituting the moment after the target object is lost into the trajectory model of the target object, it can predict the position of the target object when it is lost.
现有技术中,在对目标对象的运动轨迹进行预测时,通过对目标对象的位置约束运行最小化拟合算法来确定目标对象的轨迹模型中的模型系数,即对目标对象的运动轨迹进行拟合。所述位置约束可以根据所述观测位置和与所述观测位置对应的预期位置之间的位置误差来确定,其中,所述预期位置是根据目标对象的轨迹模型确定的。例如,所述观测位置和与所述观测位置对应的预期位置之间的位置误差为T(t i)-p i,所述位置约束可以为:
Figure PCTCN2018101977-appb-000001
对目标对象的位置约束运行最小化拟合算法
Figure PCTCN2018101977-appb-000002
来确定目标对象的轨迹模型中的模型系数。然而,现有技术中只是在位置维度来做约束,并没有考虑目标对象处于丢失状态时的运动状态,这样导致拟合出的运动轨迹不准确,拟合确定的轨迹模型不能反映目标对象处于丢失状态的运动状态。例如,当处于丢失状态的目标对象近似匀速运动时,由于没有考虑目标对象处于丢失状态的运动状态,根据拟合出的运动轨迹计算出处于丢失状态的目标对象可能有较大的运动加速度。
In the prior art, when predicting the motion trajectory of a target object, a model coefficient in the trajectory model of the target object is determined by running a minimum fitting algorithm on the position constraint of the target object, that is, the motion trajectory of the target object is simulated. Together. The position constraint may be determined according to a position error between the observation position and an expected position corresponding to the observation position, wherein the expected position is determined according to a trajectory model of a target object. For example, a position error between the observation position and an expected position corresponding to the observation position is T (t i ) -p i , and the position constraint may be:
Figure PCTCN2018101977-appb-000001
Run a minimization fitting algorithm on the position constraints of the target object
Figure PCTCN2018101977-appb-000002
To determine the model coefficients in the trajectory model of the target object. However, in the prior art, the constraint is only imposed on the position dimension, and the motion state of the target object when it is lost is not considered. This results in inaccurate motion trajectories, and the trajectory model determined by the fit cannot reflect that the target objects are lost. State of motion. For example, when the target object in the lost state moves at approximately uniform speed, since the motion state of the target object in the lost state is not taken into account, it can be calculated that the target object in the lost state may have large motion acceleration according to the fitted motion trajectory.
为了解决上述技术问题,图1为本发明实施例提供的一种目标对象的运动轨迹预测方法的流程示意图,参考附图1所示,本实施例提供了一种目标对象的运动轨迹预测方法,应用于监控平台。具体的,该方法包括:In order to solve the above technical problems, FIG. 1 is a schematic flowchart of a method for predicting a motion trajectory of a target object according to an embodiment of the present invention. Referring to FIG. 1, this embodiment provides a method for predicting a motion trajectory of a target object. Apply to monitoring platform. Specifically, the method includes:
S101:根据目标对象的轨迹模型获取目标对象处于丢失状态时的预期运动状态,其中,目标对象为监控平台的监控对象,轨迹模型包括模型系数;S101: Obtain an expected motion state when the target object is in a lost state according to the trajectory model of the target object, where the target object is a monitoring object of the monitoring platform, and the trajectory model includes a model coefficient;
具体地,在目标对象处于丢失状态时,监控平台可以根据目标对象的轨迹模型获取目标对象的预期运动状态。其中,目标对象的预期运动状态可以包括速度、加速度和加速度的变化量中的至少一种,具体的,本领域技术人员可以根据具体的设计需求和使用需求来进行设置,在此不再赘述。例如,当所述预期运动状态为加速度时,可以根据目标对象的轨迹模型得到目标对象的加速度模型,并将目标对象处于丢失状态的时刻代入到目标对象的加速度模型中,即可以获取目标对象处于丢失状态的加速度。Specifically, when the target object is in a lost state, the monitoring platform may obtain an expected motion state of the target object according to the trajectory model of the target object. The expected motion state of the target object may include at least one of a speed, an acceleration, and a change amount of the acceleration. Specifically, those skilled in the art may set it according to specific design requirements and use requirements, and details are not described herein again. For example, when the expected motion state is acceleration, the acceleration model of the target object can be obtained according to the trajectory model of the target object, and the moment when the target object is in the missing state is substituted into the acceleration model of the target object, that is, the target object can be obtained Lost state acceleration.
S102:获取目标对象处于监控状态时的观测位置;S102: Obtain an observation position when the target object is in a monitoring state;
具体地,在目标对象处于监控状态时,监控平台可以观测到目标对象。如前所述,监控平台可以获取到目标对象的观测位置。Specifically, when the target object is in a monitoring state, the monitoring platform can observe the target object. As mentioned earlier, the monitoring platform can obtain the observation position of the target object.
S103:根据观测位置和预期运动状态确定模型系数,并基于所确定的模 型系数更新轨迹模型;S103: Determine a model coefficient according to the observation position and the expected motion state, and update the trajectory model based on the determined model coefficient;
具体地,在获取到观测位置和预期运动状态之后,可以对观测位置和预期运动状态进行分析处理,以确定所述轨迹模型的模型系数,进一步可以基于所确定的模型系数更新所述轨迹模型。在获取到更新的轨迹模型之后,目标对象的轨迹模型就已经确定。Specifically, after the observation position and the expected motion state are obtained, the observation position and the expected motion state may be analyzed and processed to determine a model coefficient of the trajectory model, and the trajectory model may be further updated based on the determined model coefficient. After obtaining the updated trajectory model, the trajectory model of the target object has been determined.
S104:根据更新后的轨迹模型预测目标对象处于丢失状态时的运动轨迹。S104: Predict the motion trajectory of the target object in a lost state according to the updated trajectory model.
具体地,在目标对象处于丢失状态时,可以利用更新后的轨迹模型对目标对象的运动轨迹进行预测,得到目标对象处于丢失状态时的运动轨迹。例如,可以将目标对象处于丢失状态的时刻代入到更新后的轨迹模型中,即可以预测目标对象的位置,进而通过预测的目标对象的位置来预测目标对象处于丢失状态时的运动轨迹。Specifically, when the target object is in a lost state, the updated trajectory model may be used to predict the motion trajectory of the target object to obtain the motion trajectory when the target object is in a lost state. For example, the time when the target object is in a lost state can be substituted into the updated trajectory model, that is, the position of the target object can be predicted, and then the motion trajectory of the target object in the lost state can be predicted by the predicted position of the target object.
本实施例提供的目标对象的运动轨迹预测方法,通过目标对象的预期运动状态和观测位置确定模型系数,基于所确定的模型系数更新轨迹模型,并可以根据更新后的轨迹模型预测目标对象处于丢失状态时的运动轨迹。其中,通过预期运动状态和观测位置来确定目标对象的轨迹模型的模型系数,可以有效地提高所述模型系数确定的准确性,进而得到更加准确的目标对象的轨迹模型,这样可以有效地提高目标对象的运动轨迹预测的准确性。The method for predicting the trajectory of a target object provided in this embodiment determines a model coefficient based on the expected motion state and observation position of the target object, updates the trajectory model based on the determined model coefficient, and can predict that the target object is missing based on the updated trajectory model. The motion trajectory in the state. Among them, determining the model coefficients of the trajectory model of the target object through the expected motion state and observation position can effectively improve the accuracy of the determination of the model coefficients, and then obtain a more accurate trajectory model of the target object, which can effectively improve the target. The accuracy of the object's motion trajectory prediction.
图2为本发明实施例提供的根据观测位置和预期运动状态确定模型系数的流程示意图;在上述实施例的基础上,继续参考附图2可知,本实施例对于模型系数的具体确定方式不做限定,本领域技术人员可以根据具体的设计需求进行设置,可选地,本实施例中的根据观测位置和预期运动状态确定模型系数可以包括:FIG. 2 is a schematic flowchart of determining a model coefficient according to an observation position and an expected motion state according to an embodiment of the present invention; based on the foregoing embodiment, and referring to FIG. 2, it can be known that the specific determination method of the model coefficient is not performed in this embodiment. By definition, a person skilled in the art may set it according to specific design requirements. Optionally, in this embodiment, determining the model coefficient according to the observation position and the expected motion state may include:
S201:获取目标对象处于监控状态时的观测位置与预期位置之间的位置误差,根据位置误差确定目标对象的位置约束,其中,预期位置为根据轨迹模型确定出的与观测位置对应的目标对象的位置;S201: Obtain a position error between an observation position and an expected position when the target object is in a monitoring state, and determine a position constraint of the target object according to the position error, where the expected position is a target object corresponding to the observation position determined according to the trajectory model. position;
具体地,监控平台可以获取目标对象处于监控状态时的观测位置为P i,监控平台可以根据目标对象的轨迹模型获取与所述观测位置对应的目标对象的预期位置为T(t i)。例如,监控平台在目标对象处于监控状态的t i时刻, 获取目标对象处于监控状态时的观测位置为P i,可以将t i代入到目标对象的轨迹模型中,即可以获取与所述观测位置对应的目标对象的预期位置,此时,所述目标对象的预期位置为目标对象处于监控状态的预期位置。 Specifically, the monitoring platform can obtain the observation position P i when the target object is in the monitoring state, and the monitoring platform can obtain the expected position of the target object corresponding to the observation position according to the trajectory model of the target object as T (t i ). For example, at time t i when the target object is in the monitoring state, the monitoring platform acquires the observation position P i when the target object is in the monitoring state, and can substitute t i into the trajectory model of the target object, that is, it can obtain the observation position The expected position of the corresponding target object. At this time, the expected position of the target object is the expected position where the target object is in a monitoring state.
进一步地,监控平台可以获取观测位置与预期位置之间的位置误差,所述位置误差可以为T(t i)-p i或者p i-T(t i),进而根据位置误差确定目标对象的位置约束。可选地,所述位置约束可以为:
Figure PCTCN2018101977-appb-000003
可选地,所述位置约束为
Figure PCTCN2018101977-appb-000004
可以理解的是,本领域技术人员还可以根据具体的使用场景和设计需求采用其他的方式来根据所述位置误差确定目标对象的位置约束,在此不再赘述。
Further, the monitoring platform may obtain a position error between the observed position and the expected position, and the position error may be T (t i ) -p i or p i -T (t i ), and then the target object is determined according to the position error. Location constraints. Optionally, the position constraint may be:
Figure PCTCN2018101977-appb-000003
Optionally, the position constraint is
Figure PCTCN2018101977-appb-000004
It can be understood that those skilled in the art may also use other methods to determine the position constraint of the target object according to the position error according to the specific usage scenario and design requirements, and details are not described herein again.
S202:根据预期运动状态确定目标对象的运动状态约束;S202: Determine a motion state constraint of the target object according to the expected motion state;
具体地,为了保证拟合后的运动轨迹更加准确反映目标对象的真实运动状态,可以根据所述预期运动状态确定目标对象的运动状态约束。对于目标对象的运动状态约束的具体确定方式,可以通过如下几种可行方式实现:Specifically, in order to ensure that the fitted motion trajectory more accurately reflects the true motion state of the target object, the motion state constraint of the target object may be determined according to the expected motion state. The specific determination method of the motion state constraint of the target object can be implemented in the following feasible ways:
一种可行的方式为:根据预期运动状态确定积分项,对积分项在预设时间段内进行积分运算以获取目标对象的运动状态约束,其中,预设时间段为目标对象处于丢失状态时的时间段。A feasible method is to determine the integral term according to the expected motion state, and perform integral operation on the integral term within a preset time period to obtain the motion state constraint of the target object, wherein the preset time period is when the target object is in a lost state. period.
具体的,在获取到预期运动状态之后,可以确定与预期运动状态相对应的积分项。例如:当预期运动状态为加速度时,所确定的与预期运动状态相对应的积分项可以为|T (2)(t)|或者|T (2)(t)| 2,然后可以对所述积分项进行积分运算以获取目标对象的运动状态约束
Figure PCTCN2018101977-appb-000005
或者
Figure PCTCN2018101977-appb-000006
其中,(t l,t m)即为预设时间段,所述预设时间段为目标对象处于丢失状态的时间段。可选地,t l为目标对象处于丢失状态时的初始时刻,即监控平台确定目标对象进入丢失状态的时刻,t m为目标对象处于丢失状态时的中间时刻。
Specifically, after the expected motion state is obtained, an integral term corresponding to the expected motion state may be determined. For example: when the expected motion state is acceleration, the determined integral term corresponding to the expected motion state may be | T (2) (t) | or | T (2) (t) | 2 , and then the said Integral term performs integral operation to obtain the motion state constraint of the target object
Figure PCTCN2018101977-appb-000005
or
Figure PCTCN2018101977-appb-000006
Wherein, (t l , t m ) is a preset time period, and the preset time period is a time period when the target object is in a lost state. Optionally, t l is the initial time when the target object is in the lost state, that is, the time when the monitoring platform determines that the target object is in the lost state, and t m is the intermediate time when the target object is in the lost state.
另一种可行的方式为:根据预期运动状态确定多个累加项,对多个累加项进行累加运算以获取目标对象的运动状态约束。Another feasible way is to determine a plurality of accumulation terms according to the expected movement state, and perform accumulation operations on the plurality of accumulation terms to obtain a movement state constraint of the target object.
具体的,可以获取目标对象多个时刻的预期运动状态,从而可以确定多 个累加项,对多个累加项进行累加运算以获取目标对象的运动状态约束。例如,当所述预期运动状态为加速度时,可以获取与预期运动状态T (2)(t j)对应的累加项|T (2)(t j)|或者|T (2)(t j)| 2,并对多个累加项进行累加运算,以获取目标对象的运动状态约束
Figure PCTCN2018101977-appb-000007
或者
Figure PCTCN2018101977-appb-000008
Specifically, the expected motion state of the target object at multiple moments can be obtained, so that multiple accumulation terms can be determined, and accumulation operations are performed on the multiple accumulation terms to obtain the movement state constraints of the target object. For example, when the expected motion state is acceleration, an accumulation term | T (2) (t j ) | or | T (2) (t j ) corresponding to the expected motion state T (2) (t j ) may be obtained. | 2 and perform accumulation operations on multiple accumulation terms to obtain the motion state constraints of the target object
Figure PCTCN2018101977-appb-000007
or
Figure PCTCN2018101977-appb-000008
S203:基于位置约束和运动状态约束运行最小化拟合算法以确定模型系数。S203: Run a minimization fitting algorithm based on position constraints and motion state constraints to determine model coefficients.
具体地,在获取到位置约束和运动状态约束之后,可以基于位置约束和运动状态约束运行最小化拟合算法来确定轨迹模型的模型系数。为了说明方便,所述位置约束简称为A,所述运动状态约束简称为B,可以基于位置约束A和运动状态约束B确定拟合项,并对拟合项运行最小化拟合算法。例如,所述拟合项可以为(A+λ tB),并对所述拟合项运行最小化拟合算法min(A+λ tB)来确定模型系数,其中,λ t可以为预设的系数。 Specifically, after acquiring the position constraint and the motion state constraint, a minimization fitting algorithm may be run based on the position constraint and the motion state constraint to determine a model coefficient of the trajectory model. For convenience of explanation, the position constraint is abbreviated as A and the motion state constraint is abbreviated as B. A fitting term may be determined based on the position constraint A and the motion state constraint B, and a minimizing fitting algorithm is run on the fitting term. For example, the fitted term may be (A + λ t B), and a minimization fitting algorithm min (A + λ t B) is run on the fitted term to determine a model coefficient, where λ t may be a prediction Set the coefficient.
当所述预期运动状态为加速度时,假设目标对象处于丢失状态时,目标对象的加速度很小,近似于匀速运动。运行最小化拟合算法min(A+λ tB)时,要使A+λ tB达到最小,运动状态约束应该尽可能小,即处于丢失状态的目标对象的加速度应该尽可能小。 When the expected motion state is acceleration, it is assumed that when the target object is in a lost state, the acceleration of the target object is small, which is approximately uniform motion. When running the minimization fitting algorithm min (A + λ t B), to minimize A + λ t B, the motion state constraint should be as small as possible, that is, the acceleration of the target object in the missing state should be as small as possible.
当所述预期运动状态为加速度的变化量时,假设目标对象处于丢失状态时,目标对象的加速度的变化量很小,近似于匀变速运动。运行最小化拟合算法min(A+λ tB)时,要使A+λ tB达到最小,运动状态约束应该尽可能小,即处于丢失状态的目标对象的加速度的变化量应该尽可能小。 When the expected motion state is a change amount of acceleration, it is assumed that when the target object is in a lost state, the change amount of acceleration of the target object is small, which is similar to a uniformly variable motion. When running the minimization fitting algorithm min (A + λ t B), to minimize A + λ t B, the motion state constraint should be as small as possible, that is, the change amount of the acceleration of the target object in the missing state should be as small as possible .
与现有技术相比,本发明实施例提供的轨迹预测方法通过同时考虑位置约束和运动状态约束,可以更加准确地确定轨迹模型的模型系数,进而得到更加准确的目标对象的轨迹模型,这样可以有效地提高目标对象的运动轨迹预测的准确性。Compared with the prior art, the trajectory prediction method provided by the embodiment of the present invention can determine the model coefficients of the trajectory model more accurately by considering both the position constraint and the motion state constraint, thereby obtaining a more accurate trajectory model of the target object. Effectively improve the accuracy of the target's motion trajectory prediction.
在上述实施例的基础上,继续参考附图1可知,本实施例中,在根据更新后的轨迹模型预测目标对象处于丢失状态时的运动轨迹之后,该方法还包括:将运动轨迹发送给控制终端以使控制终端在交互界面上显示运动轨迹。Based on the above embodiment and continuing to refer to FIG. 1, in this embodiment, after predicting the motion trajectory of the target object in a lost state according to the updated trajectory model, the method further includes: sending the motion trajectory to the control The terminal so that the control terminal displays the motion track on the interactive interface.
具体的,监控平台在预测得到目标对象的运动轨迹之后,可以将所述运动轨迹发送给控制终端。控制终端可以为带有显示装置的终端设备,例如智能手机、平板电脑、膝上型电脑、台式电脑和穿戴式设备中的一种或多种,控制终端在接收到所述运动轨迹之后,控制终端上的显示装置可以显示所述运动轨迹,这样使得用户可以直观地获取到处于丢失状态的目标对象的运动轨迹。Specifically, after the monitoring platform obtains the motion trajectory of the target object, the monitoring platform may send the motion trajectory to the control terminal. The control terminal may be a terminal device with a display device, such as one or more of a smart phone, a tablet computer, a laptop computer, a desktop computer, and a wearable device. After the control terminal receives the motion track, it controls The display device on the terminal can display the motion trajectory, so that the user can intuitively obtain the motion trajectory of the target object in the lost state.
图3为本发明实施例提供的获取目标对象处于监控状态时的观测位置的流程示意图。在上述实施例的基础上,继续参考附图3可知,监控平台包括拍摄装置,而拍摄装置可以包括:照相机、摄像机等等。其中,所述获取目标对象处于监控状态时的观测位置,包括:FIG. 3 is a schematic flowchart of acquiring an observation position when a target object is in a monitoring state according to an embodiment of the present invention. Based on the above embodiment, it can be known that the monitoring platform includes a photographing device, and the photographing device may include a camera, a video camera, and so on. Wherein, the obtaining the observation position of the target object when it is in a monitoring state includes:
S301:获取拍摄装置输出的图像;S301: Acquire an image output by the shooting device;
S302:根据图像获取目标对象的观测位置,其中,图像中包括目标对象。S302: Obtain an observation position of a target object according to an image, where the image includes the target object.
具体的,监控平台的处理器可以获取拍摄装置输出的图像,其中,所述图像中包括目标对象,处理器可以对图像中的目标对象进行识别以获取目标对象在所述图像中的位置,进一步地,根据目标对象在所述图像中的位置获取目标对象的观测位置。Specifically, the processor of the monitoring platform may acquire an image output by the shooting device, where the image includes a target object, and the processor may identify the target object in the image to obtain a position of the target object in the image, and further Ground, the observation position of the target object is acquired according to the position of the target object in the image.
可以理解的是,当目标对象在拍摄装置输出的图像中时,所述目标对象处于监控状态,监控平台可以通过所述图像获取目标对象的观测位置。当目标对象不在拍摄装置输出的图像中,监控平台不能通过所述图像获取目标对象的观测位置,所述目标对象处于丢失状态。It can be understood that when the target object is in an image output by the shooting device, the target object is in a monitoring state, and the monitoring platform can obtain the observation position of the target object through the image. When the target object is not in the image output by the shooting device, the monitoring platform cannot obtain the observation position of the target object through the image, and the target object is in a lost state.
图4为本发明实施例提供的获取目标对象处于监控状态时的观测位置的流程示意图二。在上述实施例的基础上,继续参考附图4可知,所述获取目标对象处于监控状态时的观测位置可以包括:FIG. 4 is a second schematic flowchart of obtaining an observation position of a target object in a monitoring state according to an embodiment of the present invention. Based on the above embodiment, it can be known from continuing to refer to FIG. 4 that acquiring the observation position when the target object is in a monitoring state may include:
S401:获取目标对象携带的控制终端发送的运动数据;S401: Acquire motion data sent by a control terminal carried by a target object;
S402:根据运动数据获取目标对象的观测位置。S402: Obtain the observation position of the target object according to the motion data.
具体地,目标对象携带有控制终端,其中,控制终端上配置有运动传感器,所述运动传感器可以检测目标对象的运动数据并输出运动数据。其中,所述运动数据可以包括运动位置信息、速度信息和加速度信息中的至少一种,所述运动传感器可以包括卫星定位接收机、惯性测量单元或光电码盘等等。 控制终端可以向监控平台发送所述运动数据,监控平台在获取到运动数据之后,可以对运动数据进行分析处理以获取目标对象的观测位置。Specifically, the target object carries a control terminal, wherein the control terminal is configured with a motion sensor, and the motion sensor can detect the motion data of the target object and output the motion data. Wherein, the motion data may include at least one of motion position information, speed information, and acceleration information, and the motion sensor may include a satellite positioning receiver, an inertial measurement unit, a photoelectric code disc, and the like. The control terminal may send the motion data to the monitoring platform. After the monitoring platform obtains the motion data, it may analyze and process the motion data to obtain the observation position of the target object.
可以理解的是,当监控平台可以接收到控制终端发送的运动数据时,所述目标对象处于监控状态,监控平台可以通过所述图像获取目标对象的观测位置。当监控平台接收不到控制终端发送的运动数据,监控平台不能通过所述图像获取目标对象的观测位置,所述目标对象处于丢失状态。It can be understood that when the monitoring platform can receive the motion data sent by the control terminal, the target object is in a monitoring state, and the monitoring platform can obtain the observation position of the target object through the image. When the monitoring platform cannot receive the motion data sent by the control terminal, the monitoring platform cannot obtain the observation position of the target object through the image, and the target object is in a lost state.
图5为本发明实施例提供的另一种目标对象的运动轨迹预测方法的流程示意图。在上述实施例的基础上,继续参考附图5,为了提高本方法的实用性,该方法还可以包括:FIG. 5 is a schematic flowchart of another method for predicting a motion trajectory of a target object according to an embodiment of the present invention. Based on the above embodiments, and referring to FIG. 5 continuously, in order to improve the practicability of the method, the method may further include:
S501:当目标对象处于丢失状态时,根据运动轨迹确定移动机器人的运动轨迹;S501: When the target object is in a lost state, determine the motion trajectory of the mobile robot according to the motion trajectory;
如前所述,监控平台可以包括移动机器人,目标对象可以为移动机器人的跟随对象。在目标对象处于监控状态时,移动机器人的处理器可以根据目标对象的观测位置来确定移动机器人的运动轨迹,并控制所述移动机器人按照所述运动轨迹移动以对目标对象进行跟随。然而,在目标对象处于丢失状态时,移动机器人观测不到目标对象,在需要对目标对象进行跟随时,移动机器人的处理器可以根据所预测的运动轨迹确定移动机器人的运动轨迹。As mentioned above, the monitoring platform may include a mobile robot, and the target object may be a follower of the mobile robot. When the target object is in a monitoring state, the processor of the mobile robot may determine the motion trajectory of the mobile robot according to the observation position of the target object, and control the mobile robot to move according to the motion trajectory to follow the target object. However, when the target object is in a missing state, the mobile robot cannot observe the target object, and when the target object needs to be followed, the processor of the mobile robot can determine the motion trajectory of the mobile robot according to the predicted motion trajectory.
可选地,根据运动轨迹确定移动机器人的运动轨迹可以包括:将运动轨迹确定为移动机器人的运动轨迹。具体地,移动机器人的处理器可以将所述预测的目标对象的运动轨迹确定为移动机器人的运动轨迹。Optionally, determining the motion trajectory of the mobile robot according to the motion trajectory may include: determining the motion trajectory as the motion trajectory of the mobile robot. Specifically, the processor of the mobile robot may determine the predicted motion trajectory of the target object as the motion trajectory of the mobile robot.
S502:控制移动机器人按照运动轨迹进行移动。S502: Control the mobile robot to move according to the motion trajectory.
移动机器人的处理器可以控制移动机器人按照所述确定的运动轨迹移动以对目标对象进行跟随,由于所述运动轨迹是根据所述预测的目标对象的运动轨迹确定的,因此,可移动机器人在按照所述确定的运动轨迹移动时,可以有效地减小移动机器人遇到障碍物的概率,同时也可以提高目标对象被遮挡后重新找回、恢复监控的概率,保证了跟随的成功率。The processor of the mobile robot may control the mobile robot to move according to the determined motion trajectory to follow the target object. Since the motion trajectory is determined according to the predicted motion trajectory of the target object, the mobile robot is When the determined motion trajectory moves, the probability of the mobile robot encountering an obstacle can be effectively reduced, and at the same time, the probability of retrieving and recovering the monitoring after the target object is blocked can be improved, thereby ensuring the success rate of following.
图6为本发明实施例提供的一种监控平台的结构示意图,参考附图6可知,本实施例提供了一种监控平台,其中,监控平台可以为可移动平台,而 可移动平台可以包括移动机器人;具体的,该监控平台可以包括:FIG. 6 is a schematic structural diagram of a monitoring platform according to an embodiment of the present invention. As can be seen with reference to FIG. 6, this embodiment provides a monitoring platform. The monitoring platform may be a movable platform, and the movable platform may include a mobile platform. Robot; specifically, the monitoring platform may include:
存储器601,用于存储计算机程序;A memory 601, configured to store a computer program;
处理器602,用于运行存储器601中存储的计算机程序以实现:根据轨迹模型获取目标对象处于丢失状态时的预期运动状态,其中,目标对象为监控平台的监控对象,轨迹模型包括模型系数;获取目标对象处于监控状态时的观测位置;根据观测位置和预期运动状态确定模型系数,并基于所确定的模型系数更新轨迹模型;根据更新后的轨迹模型预测目标对象处于丢失状态时的运动轨迹。The processor 602 is configured to run a computer program stored in the memory 601 to implement: obtaining an expected motion state of the target object when the target object is in a lost state according to a trajectory model, wherein the target object is a monitoring object of the monitoring platform, and the trajectory model includes model coefficients; The observation position of the target object in the monitoring state; the model coefficients are determined according to the observation position and the expected motion state, and the trajectory model is updated based on the determined model coefficients; the motion trajectory of the target object in the lost state is predicted based on the updated trajectory model.
其中,轨迹模型可以为多项式轨迹模型;预期运动状态可以包括:加速度和/或加速度的变化量。The trajectory model may be a polynomial trajectory model; the expected motion state may include: acceleration and / or a change amount of the acceleration.
进一步的,在处理器602根据观测位置和预期运动状态确定模型系数时,处理器602被配置为:Further, when the processor 602 determines the model coefficient according to the observation position and the expected motion state, the processor 602 is configured to:
获取目标对象处于监控状态时的观测位置与预期位置之间的位置误差,根据位置误差确定目标对象的位置约束,其中,预期位置为根据轨迹模型确定出的与观测位置对应的目标对象的位置;Obtain a position error between the observation position and the expected position when the target object is in the monitoring state, and determine the position constraint of the target object according to the position error, where the expected position is the position of the target object corresponding to the observation position determined according to the trajectory model;
根据预期运动状态确定目标对象的运动状态约束;Determine the movement state constraints of the target object according to the expected movement state;
基于位置约束和运动状态约束运行最小化拟合算法以确定模型系数。A minimization fitting algorithm is run based on position constraints and motion state constraints to determine model coefficients.
另外,在处理器602根据预期运动状态确定目标对象的运动状态约束时,一种可实现的方式为,处理器602被配置为:In addition, when the processor 602 determines the motion state constraint of the target object according to the expected motion state, an implementable manner is that the processor 602 is configured to:
根据预期运动状态确定积分项,对积分项在预设时间段内进行积分运算以获取目标对象的运动状态约束,其中,预设时间段为目标对象处于丢失状态时的时间段。The integral term is determined according to the expected motion state, and the integral term is integrated within a preset time period to obtain the motion state constraint of the target object, wherein the preset time period is a time period when the target object is in a lost state.
另一种可实现的方式为,处理器602被配置为:Another implementable manner is that the processor 602 is configured to:
根据预期运动状态确定多个累加项,对多个累加项进行累加运算以获取目标对象的运动状态约束。Multiple accumulation terms are determined according to the expected movement state, and accumulation operations are performed on the multiple accumulation terms to obtain a movement state constraint of the target object.
进一步的,处理器602被配置为:Further, the processor 602 is configured to:
在根据更新后的轨迹模型预测目标对象处于丢失状态时的运动轨迹之后,将运动轨迹发送给控制终端以使控制终端在交互界面上显示运动轨迹。After predicting the motion trajectory when the target object is in a lost state according to the updated trajectory model, the motion trajectory is sent to the control terminal so that the control terminal displays the motion trajectory on the interactive interface.
此外,在处理器602获取目标对象处于监控状态时的观测位置时,一种 可实现的方式为,监控平台包括拍摄装置,处理器602被配置为:In addition, when the processor 602 acquires an observation position when the target object is in a monitoring state, an implementable manner is that the monitoring platform includes a photographing device, and the processor 602 is configured to:
获取拍摄装置输出的图像;Obtaining an image output by the shooting device;
根据图像获取目标对象的观测位置,其中,图像中包括目标对象。Obtain the observation position of the target object according to the image, where the image includes the target object.
在处理器602获取目标对象处于监控状态时的观测位置时,另一种可实现的方式为,处理器602被配置为:When the processor 602 obtains the observation position when the target object is in a monitoring state, another implementable manner is that the processor 602 is configured to:
获取目标对象携带的控制终端发送的运动数据;Acquiring motion data sent by a control terminal carried by a target object;
根据运动数据获取目标对象的观测位置。Obtain the observation position of the target object based on the motion data.
进一步的,处理器602被配置为:Further, the processor 602 is configured to:
当目标对象处于丢失状态时,根据运动轨迹确定移动机器人的运动轨迹;When the target object is in a lost state, determine the motion trajectory of the mobile robot according to the motion trajectory;
控制移动机器人按照运动轨迹进行移动。Control the mobile robot to move according to the motion trajectory.
其中,在处理器602根据运动轨迹确定移动机器人的运动轨迹时,处理器602被配置为:Wherein, when the processor 602 determines the motion trajectory of the mobile robot according to the motion trajectory, the processor 602 is configured to:
将运动轨迹确定为移动机器人的运动轨迹。The motion trajectory is determined as the motion trajectory of the mobile robot.
本实施例中的监控平台可用于执行上述方法中图1-5所示实施例的技术方案,其实现原理和技术效果类似,此处不再赘述。The monitoring platform in this embodiment may be used to execute the technical solution of the embodiment shown in FIG. 1-5 in the foregoing method, and the implementation principles and technical effects thereof are similar, and details are not described herein again.
图7为本发明实施例提供的另一种监控平台的结构示意图,参考附图7所示,本实施例提供了另一种监控平台,该监控平台可以包括:FIG. 7 is a schematic structural diagram of another monitoring platform according to an embodiment of the present invention. Referring to FIG. 7, this embodiment provides another monitoring platform. The monitoring platform may include:
处理模块701,用于根据轨迹模型获取目标对象处于丢失状态时的预期运动状态,其中,目标对象为监控平台的监控对象,轨迹模型包括模型系数;A processing module 701 is configured to obtain an expected motion state of a target object when the target object is in a lost state according to a trajectory model, where the target object is a monitoring object of a monitoring platform, and the trajectory model includes a model coefficient;
获取模块702,用于获取目标对象处于监控状态时的观测位置;An obtaining module 702, configured to obtain an observation position when the target object is in a monitoring state;
确定模块703,用于根据观测位置和预期运动状态确定模型系数,并基于所确定的模型系数更新轨迹模型;A determining module 703, configured to determine a model coefficient according to the observation position and the expected motion state, and update the trajectory model based on the determined model coefficient;
预测模块704,用于根据更新后的轨迹模型预测目标对象处于丢失状态时的运动轨迹。The prediction module 704 is configured to predict a motion trajectory of the target object in a lost state according to the updated trajectory model.
本实施例中的监控平台可用于执行上述方法中图1-5所示实施例的技术方案,其实现原理和技术效果类似,此处不再赘述。The monitoring platform in this embodiment may be used to execute the technical solution of the embodiment shown in FIG. 1-5 in the foregoing method, and the implementation principles and technical effects thereof are similar, and details are not described herein again.
本实施例的另一方面提供了一种计算机可读存储介质,该计算机可读存 储介质中存储有程序指令,程序指令用于实现上述任意一个实施例的目标对象的运动轨迹预测方法。Another aspect of this embodiment provides a computer-readable storage medium. The computer-readable storage medium stores program instructions, and the program instructions are used to implement a method for predicting a motion trajectory of a target object in any one of the foregoing embodiments.
以上各个实施例中的技术方案、技术特征在与本相冲突的情况下均可以单独,或者进行组合,只要未超出本领域技术人员的认知范围,均属于本申请保护范围内的等同实施例。The technical solutions and technical features in each of the above embodiments may be singular or combined in the case of conflict with the present, as long as they do not exceed the scope of the knowledge of those skilled in the art, they all belong to the equivalent embodiments within the protection scope of this application .
在本发明所提供的几个实施例中,应该理解到,所揭露的相关装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided by the present invention, it should be understood that the related apparatuses and methods disclosed may be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be another division manner. For example, multiple units or components may be divided. The combination can either be integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, which may be electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objective of the solution of this embodiment.
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist separately physically, or two or more units may be integrated into one unit. The above integrated unit may be implemented in the form of hardware or in the form of software functional unit.
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得计算机处理器101(processor)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁盘或者光盘等各种可以存储程序代码的介质。When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention essentially or part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium , Including a number of instructions to cause the computer processor 101 (processor) to perform all or part of the steps of the method described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and other media that can store program codes.
以上所述仅为本发明的实施例,并非因此限制本发明的专利范围,凡是 利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。The above description is only an embodiment of the present invention, and thus does not limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made by using the description and drawings of the present invention, or directly or indirectly applied to other related technologies The same applies to the fields of patent protection of the present invention.
最后应说明的是:以上各实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述各实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention, but not limited thereto. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: It is still possible to modify the technical solutions described in the foregoing embodiments, or to replace some or all of the technical features equivalently; and these modifications or replacements do not depart from the essence of the corresponding technical solutions of the technical solutions of the embodiments of the present invention. range.

Claims (27)

  1. 一种目标对象的运动轨迹预测方法,应用于监控平台,其特征在于,包括:A method for predicting the trajectory of a target object, which is applied to a monitoring platform, is characterized in that it includes:
    根据轨迹模型获取目标对象处于丢失状态时的预期运动状态,其中,所述目标对象为所述监控平台的监控对象,所述轨迹模型包括模型系数;Obtaining the expected motion state of the target object in a lost state according to a trajectory model, wherein the target object is a monitoring object of the monitoring platform, and the trajectory model includes a model coefficient;
    获取所述目标对象处于监控状态时的观测位置;Obtaining an observation position when the target object is in a monitoring state;
    根据所述观测位置和预期运动状态确定所述模型系数,并基于所确定的模型系数更新所述轨迹模型;Determining the model coefficient according to the observation position and the expected motion state, and updating the trajectory model based on the determined model coefficient;
    根据更新后的轨迹模型预测所述目标对象处于丢失状态时的运动轨迹。The motion trajectory of the target object in the lost state is predicted according to the updated trajectory model.
  2. 根据权利要求1所述的方法,其特征在于,所述预期运动状态包括:加速度和/或加速度的变化量。The method according to claim 1, wherein the expected motion state comprises: acceleration and / or a change amount of acceleration.
  3. 根据权利要求1或2所述的方法,其特征在于,所述根据所述观测位置和预期运动状态确定所述模型系数,包括:The method according to claim 1 or 2, wherein the determining the model coefficient according to the observation position and an expected motion state comprises:
    获取所述目标对象处于监控状态时的观测位置与预期位置之间的位置误差,根据所述位置误差确定所述目标对象的位置约束,其中,所述预期位置为根据所述轨迹模型确定出的与所述观测位置对应的目标对象的位置;Acquiring a position error between an observed position and an expected position of the target object in a monitoring state, and determining a position constraint of the target object according to the position error, wherein the expected position is determined according to the trajectory model A position of a target object corresponding to the observation position;
    根据所述预期运动状态确定所述目标对象的运动状态约束;Determining a movement state constraint of the target object according to the expected movement state;
    基于所述位置约束和所述运动状态约束运行最小化拟合算法以确定所述模型系数。A minimization fitting algorithm is run based on the position constraints and the motion state constraints to determine the model coefficients.
  4. 根据权利要求3所述的方法,其特征在于,根据所述预期运动状态确定所述目标对象的运动状态约束,包括:The method according to claim 3, wherein determining the movement state constraint of the target object according to the expected movement state comprises:
    根据所述预期运动状态确定积分项,对所述积分项在预设时间段内进行积分运算以获取所述目标对象的运动状态约束,其中,所述预设时间段为所述目标对象处于丢失状态时的时间段。An integral term is determined according to the expected movement state, and an integral operation is performed on the integral term within a preset period of time to obtain a movement state constraint of the target object, wherein the preset period of time is that the target object is lost The time period in the state.
  5. 根据权利要求3所述的方法,其特征在于,根据所述预期运动状态确定所述目标对象的运动状态约束,包括:The method according to claim 3, wherein determining the movement state constraint of the target object according to the expected movement state comprises:
    根据所述预期运动状态确定多个累加项,对所述多个累加项进行累加运算以获取所述目标对象的运动状态约束。A plurality of accumulation terms are determined according to the expected movement state, and accumulation operations are performed on the plurality of accumulation terms to obtain a movement state constraint of the target object.
  6. 根据权利要求1-5任意一项所述的方法,其特征在于,在根据更新后 的轨迹模型预测所述目标对象处于丢失状态时的运动轨迹之后,所述方法还包括:The method according to any one of claims 1 to 5, wherein after predicting a motion trajectory when the target object is in a lost state according to an updated trajectory model, the method further comprises:
    将所述运动轨迹发送给控制终端以使所述控制终端在交互界面上显示所述运动轨迹。Sending the motion trajectory to a control terminal so that the control terminal displays the motion trajectory on an interactive interface.
  7. 根据权利要求1-6任意一项所述的方法,其特征在于,所述监控平台包括拍摄装置,所述获取所述目标对象处于监控状态时的观测位置,包括:The method according to any one of claims 1-6, wherein the monitoring platform comprises a photographing device, and the acquiring an observation position when the target object is in a monitoring state comprises:
    获取所述拍摄装置输出的图像;Acquiring an image output by the photographing device;
    根据所述图像获取所述目标对象的观测位置,其中,所述图像中包括所述目标对象。Observing the observation position of the target object according to the image, wherein the image includes the target object.
  8. 根据权利要求1-6任意一项所述方法,其特征在于,所述获取所述目标对象处于监控状态时的观测位置,包括:The method according to any one of claims 1-6, wherein the acquiring an observation position when the target object is in a monitoring state comprises:
    获取所述目标对象携带的控制终端发送的运动数据;Acquiring motion data sent by a control terminal carried by the target object;
    根据所述运动数据获取所述目标对象的观测位置。Obtain an observation position of the target object according to the motion data.
  9. 根据权利要求1-8任意一项所述的方法,其特征在于,所述监控平台为可移动平台。The method according to any one of claims 1-8, wherein the monitoring platform is a movable platform.
  10. 根据权利要求9所述的方法,其特征在于,所述可移动平台包括移动机器人。The method of claim 9, wherein the movable platform comprises a mobile robot.
  11. 根据权利要求10所述的方法,其特征在于,所述方法还包括:The method according to claim 10, further comprising:
    当所述目标对象处于丢失状态时,根据所述预测的运动轨迹确定移动机器人的运动轨迹;Determining the motion trajectory of the mobile robot according to the predicted motion trajectory when the target object is in a lost state;
    控制所述移动机器人按照所述运动轨迹进行移动。Controlling the mobile robot to move according to the motion trajectory.
  12. 根据权利要求11所述的方法,其特征在于,所述根据所述运动轨迹确定移动机器人的运动轨迹,包括:The method according to claim 11, wherein determining the motion trajectory of the mobile robot according to the motion trajectory comprises:
    将所述运动轨迹确定为移动机器人的运动轨迹。The motion trajectory is determined as a motion trajectory of the mobile robot.
  13. 根据权利要求1-12中任意一项所述的方法,其特征在于,所述轨迹模型为多项式轨迹模型。The method according to any one of claims 1-12, wherein the trajectory model is a polynomial trajectory model.
  14. 一种监控平台,其特征在于,包括:A monitoring platform includes:
    存储器,用于存储计算机程序;Memory for storing computer programs;
    处理器,用于运行所述存储器中存储的计算机程序以实现:A processor for running a computer program stored in the memory to implement:
    根据轨迹模型获取目标对象处于丢失状态时的预期运动状态,其中,所述目标对象为所述监控平台的监控对象,所述轨迹模型包括模型系数;Obtaining the expected motion state of the target object in a lost state according to a trajectory model, wherein the target object is a monitoring object of the monitoring platform, and the trajectory model includes a model coefficient;
    获取所述目标对象处于监控状态时的观测位置;Obtaining an observation position when the target object is in a monitoring state;
    根据所述观测位置和预期运动状态确定所述模型系数,并基于所确定的模型系数更新所述轨迹模型;Determining the model coefficient according to the observation position and the expected motion state, and updating the trajectory model based on the determined model coefficient;
    根据更新后的轨迹模型预测所述目标对象处于丢失状态时的运动轨迹。The motion trajectory of the target object in the lost state is predicted according to the updated trajectory model.
  15. 根据权利要求14所述的监控平台,其特征在于,所述预期运动状态包括:加速度和/或加速度的变化量。The monitoring platform according to claim 14, wherein the expected motion state comprises: acceleration and / or a change amount of acceleration.
  16. 根据权利要求14或15所述的监控平台,其特征在于,所述处理器根据所述观测位置和预期运动状态确定所述模型系数时,具体用于:The monitoring platform according to claim 14 or 15, wherein when the processor determines the model coefficient according to the observation position and an expected motion state, the processor is specifically configured to:
    获取所述目标对象处于监控状态时的观测位置与预期位置之间的位置误差,根据所述位置误差确定所述目标对象的位置约束,其中,所述预期位置为根据所述轨迹模型确定出的与所述观测位置对应的目标对象的位置;Acquiring a position error between an observed position and an expected position of the target object in a monitoring state, and determining a position constraint of the target object according to the position error, wherein the expected position is determined according to the trajectory model A position of a target object corresponding to the observation position;
    根据所述预期运动状态确定所述目标对象的运动状态约束;Determining a movement state constraint of the target object according to the expected movement state;
    基于所述位置约束和所述运动状态约束运行最小化拟合算法以确定所述模型系数。A minimization fitting algorithm is run based on the position constraints and the motion state constraints to determine the model coefficients.
  17. 根据权利要求16所述的监控平台,其特征在于,所述处理器根据所述预期运动状态确定所述目标对象的运动状态约束时,具体用于:The monitoring platform according to claim 16, wherein when the processor determines a movement state constraint of the target object according to the expected movement state, the processor is specifically configured to:
    根据所述预期运动状态确定积分项,对所述积分项在预设时间段内进行积分运算以获取所述目标对象的运动状态约束,其中,所述预设时间段为所述目标对象处于丢失状态时的时间段。An integral term is determined according to the expected movement state, and an integral operation is performed on the integral term within a preset period of time to obtain a movement state constraint of the target object, wherein the preset period of time is that the target object is lost The time period in the state.
  18. 根据权利要求16所述的监控平台,其特征在于,所述处理器根据所述预期运动状态确定所述目标对象的运动状态约束时,具体用于:The monitoring platform according to claim 16, wherein when the processor determines a movement state constraint of the target object according to the expected movement state, the processor is specifically configured to:
    根据所述预期运动状态确定多个累加项,对所述多个累加项进行累加运算以获取所述目标对象的运动状态约束。A plurality of accumulation terms are determined according to the expected movement state, and accumulation operations are performed on the plurality of accumulation terms to obtain a movement state constraint of the target object.
  19. 根据权利要求14-18任意一项所述的监控平台,其特征在于,所述处理器还用于:The monitoring platform according to any one of claims 14 to 18, wherein the processor is further configured to:
    在根据更新后的轨迹模型预测所述目标对象处于丢失状态时的运动轨迹之后,将所述运动轨迹发送给控制终端以使所述控制终端在交互界面上显示 所述运动轨迹。After predicting a motion trajectory when the target object is in a lost state according to the updated trajectory model, the motion trajectory is sent to a control terminal so that the control terminal displays the motion trajectory on an interactive interface.
  20. 根据权利要求14-19任意一项所述的监控平台,其特征在于,所述监控平台包括拍摄装置,所述处理器获取所述目标对象处于监控状态时的观测位置时,具体用于:The monitoring platform according to any one of claims 14 to 19, wherein the monitoring platform comprises a photographing device, and the processor acquires an observation position when the target object is in a monitoring state, and is specifically configured to:
    获取所述拍摄装置输出的图像;Acquiring an image output by the photographing device;
    根据所述图像获取所述目标对象的观测位置,其中,所述图像中包括所述目标对象。Observing the observation position of the target object according to the image, wherein the image includes the target object.
  21. 根据权利要求14-19任意一项所述监控平台,其特征在于,所述处理器获取所述目标对象处于监控状态时的观测位置时,具体用于:The monitoring platform according to any one of claims 14 to 19, wherein when the processor obtains an observation position when the target object is in a monitoring state, the processor is specifically configured to:
    获取所述目标对象携带的控制终端发送的运动数据;Acquiring motion data sent by a control terminal carried by the target object;
    根据所述运动数据获取所述目标对象的观测位置。Obtain an observation position of the target object according to the motion data.
  22. 根据权利要求14-21任意一项所述的监控平台,其特征在于,所述监控平台为可移动平台。The monitoring platform according to any one of claims 14-21, wherein the monitoring platform is a movable platform.
  23. 根据权利要求22所述的监控平台,其特征在于,所述可移动平台包括移动机器人。The monitoring platform according to claim 22, wherein the movable platform comprises a mobile robot.
  24. 根据权利要求23所述的监控平台,其特征在于,所述处理器还用于:The monitoring platform according to claim 23, wherein the processor is further configured to:
    当所述目标对象处于丢失状态时,根据所述预测的运动轨迹确定移动机器人的运动轨迹;Determining the motion trajectory of the mobile robot according to the predicted motion trajectory when the target object is in a lost state;
    控制所述移动机器人按照所述运动轨迹进行移动。Controlling the mobile robot to move according to the motion trajectory.
  25. 根据权利要求24所述的监控平台,其特征在于,所述处理器根据所述运动轨迹确定移动机器人的运动轨迹时,具体用于:The monitoring platform according to claim 24, wherein when the processor determines the motion trajectory of the mobile robot according to the motion trajectory, the processor is specifically configured to:
    将所述运动轨迹确定为移动机器人的运动轨迹。The motion trajectory is determined as a motion trajectory of the mobile robot.
  26. 根据权利要求14-25中任意一项所述的监控平台,其特征在于,所述轨迹模型为多项式轨迹模型。The monitoring platform according to any one of claims 14 to 25, wherein the trajectory model is a polynomial trajectory model.
  27. 一种计算机可读存储介质,其特征在于,该计算机可读存储介质中存储有程序指令,所述程序指令用于实现权利要求1-13中任意一项所述的目标对象的运动轨迹预测方法。A computer-readable storage medium, characterized in that the computer-readable storage medium stores program instructions, and the program instructions are used to implement a method for predicting a motion track of a target object according to any one of claims 1-13. .
PCT/CN2018/101977 2018-08-23 2018-08-23 Motion trajectory prediction method for target object, and monitoring platform WO2020037610A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2018/101977 WO2020037610A1 (en) 2018-08-23 2018-08-23 Motion trajectory prediction method for target object, and monitoring platform
CN201880041186.1A CN110785765A (en) 2018-08-23 2018-08-23 Target object motion trajectory prediction method and monitoring platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/101977 WO2020037610A1 (en) 2018-08-23 2018-08-23 Motion trajectory prediction method for target object, and monitoring platform

Publications (1)

Publication Number Publication Date
WO2020037610A1 true WO2020037610A1 (en) 2020-02-27

Family

ID=69383109

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/101977 WO2020037610A1 (en) 2018-08-23 2018-08-23 Motion trajectory prediction method for target object, and monitoring platform

Country Status (2)

Country Link
CN (1) CN110785765A (en)
WO (1) WO2020037610A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112044075A (en) * 2020-09-18 2020-12-08 网易(杭州)网络有限公司 Method and device for generating motion trail
CN113359754A (en) * 2021-06-25 2021-09-07 深圳市海柔创新科技有限公司 Obstacle avoidance method, obstacle avoidance device, electronic device, and storage medium
CN114089748A (en) * 2021-11-09 2022-02-25 浙江工业大学 Formation enclosure method based on track prediction
CN115564803A (en) * 2022-12-06 2023-01-03 腾讯科技(深圳)有限公司 Animation processing method, device, equipment, storage medium and product

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112198541B (en) * 2020-09-27 2023-01-06 上海特金无线技术有限公司 Track determination method, device and equipment of movable platform and storage medium
CN115080551B (en) * 2022-06-15 2024-05-03 苏州轻棹科技有限公司 Target track management method and device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101458325A (en) * 2009-01-08 2009-06-17 华南理工大学 Wireless sensor network tracking method based on self-adapting prediction
CN104677359A (en) * 2015-03-06 2015-06-03 施浒立 Method for predicating and forecasting running track of mobile carrier
CN105469430A (en) * 2015-12-10 2016-04-06 中国石油大学(华东) Anti-shielding tracking method of small target in large-scale scene

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104539909A (en) * 2015-01-15 2015-04-22 安徽大学 Video monitoring method and video monitoring server
CN104660987B (en) * 2015-01-27 2019-04-05 武汉烽火众智数字技术有限责任公司 A kind of method and monitoring system of target trajectory analysis
EP3217884B1 (en) * 2015-12-01 2018-07-18 Brainlab AG Method and apparatus for determining or predicting the position of a target

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101458325A (en) * 2009-01-08 2009-06-17 华南理工大学 Wireless sensor network tracking method based on self-adapting prediction
CN104677359A (en) * 2015-03-06 2015-06-03 施浒立 Method for predicating and forecasting running track of mobile carrier
CN105469430A (en) * 2015-12-10 2016-04-06 中国石油大学(华东) Anti-shielding tracking method of small target in large-scale scene

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112044075A (en) * 2020-09-18 2020-12-08 网易(杭州)网络有限公司 Method and device for generating motion trail
CN113359754A (en) * 2021-06-25 2021-09-07 深圳市海柔创新科技有限公司 Obstacle avoidance method, obstacle avoidance device, electronic device, and storage medium
CN114089748A (en) * 2021-11-09 2022-02-25 浙江工业大学 Formation enclosure method based on track prediction
CN114089748B (en) * 2021-11-09 2024-05-03 浙江工业大学 Formation capturing method based on track prediction
CN115564803A (en) * 2022-12-06 2023-01-03 腾讯科技(深圳)有限公司 Animation processing method, device, equipment, storage medium and product
CN115564803B (en) * 2022-12-06 2023-03-14 腾讯科技(深圳)有限公司 Animation processing method, device, equipment, storage medium and product

Also Published As

Publication number Publication date
CN110785765A (en) 2020-02-11

Similar Documents

Publication Publication Date Title
WO2020037610A1 (en) Motion trajectory prediction method for target object, and monitoring platform
CN113284240B (en) Map construction method and device, electronic equipment and storage medium
CN108335353B (en) Three-dimensional reconstruction method, device and system of dynamic scene, server and medium
CN107990899B (en) Positioning method and system based on SLAM
CN113811920A (en) Distributed pose estimation
CN115631418B (en) Image processing method and device and training method of nerve radiation field
JP5987823B2 (en) Method and system for fusing data originating from image sensors and motion or position sensors
WO2020015498A1 (en) Face tracking method and apparatus, and storage medium
CN110111388B (en) Three-dimensional object pose parameter estimation method and visual equipment
US20100208941A1 (en) Active coordinated tracking for multi-camera systems
CN111325796A (en) Method and apparatus for determining pose of vision device
CN107577451B (en) Multi-Kinect human body skeleton coordinate transformation method, processing equipment and readable storage medium
US10296002B2 (en) Autonomous movement device, autonomous movement method, and non-transitory recording medium
US20200336708A1 (en) Duplicate monitored area prevention
CN111338383A (en) Autonomous flight method and system based on GAAS and storage medium
CN111090688B (en) Smoothing processing method and device for time sequence data
CA3069813C (en) Capturing, connecting and using building interior data from mobile devices
US10889001B2 (en) Service provision system
CN112640419B (en) Following method, movable platform, device and storage medium
WO2022198508A1 (en) Lens abnormality prompt method and apparatus, movable platform, and readable storage medium
CN115213890A (en) Grabbing control method and device, server, electronic equipment and storage medium
CN111699453A (en) Control method, device and equipment of movable platform and storage medium
WO2021217403A1 (en) Method and apparatus for controlling movable platform, and device and storage medium
KR20220143957A (en) Determining traversable space from a single image
US10922825B2 (en) Image data processing method and electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18931004

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18931004

Country of ref document: EP

Kind code of ref document: A1