WO2019090488A1 - Method for generating simulated route, method and device for flight simulation, and storage medium - Google Patents

Method for generating simulated route, method and device for flight simulation, and storage medium Download PDF

Info

Publication number
WO2019090488A1
WO2019090488A1 PCT/CN2017/109783 CN2017109783W WO2019090488A1 WO 2019090488 A1 WO2019090488 A1 WO 2019090488A1 CN 2017109783 W CN2017109783 W CN 2017109783W WO 2019090488 A1 WO2019090488 A1 WO 2019090488A1
Authority
WO
WIPO (PCT)
Prior art keywords
waypoint
dimensional
information
simulated
initial
Prior art date
Application number
PCT/CN2017/109783
Other languages
French (fr)
Chinese (zh)
Inventor
李文林
田艺
林芊芊
贺克俭
王磊
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2017/109783 priority Critical patent/WO2019090488A1/en
Priority to CN201780004905.8A priority patent/CN108521788B/en
Publication of WO2019090488A1 publication Critical patent/WO2019090488A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/20Instruments for performing navigational calculations
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/10Simultaneous control of position or course in three dimensions
    • G05D1/101Simultaneous control of position or course in three dimensions specially adapted for aircraft

Definitions

  • the present application relates to the field of computer technologies, and in particular, to a method for generating a simulated route, a method for simulating flight, a device, a computing device, and a computer readable storage medium.
  • aircraft represented by drones have a wide range of applications, such as professional aerial photography, agricultural irrigation, power line inspection, and public security monitoring.
  • the ground station plans the route for the aircraft.
  • the control system of the aircraft is turned on, the ground station uploads the route to the control system to control the actual flight of the aircraft according to the route.
  • the flight process of the aircraft can be simulated in advance through the ground station simulator to provide a relatively accurate route for the actual flight process of the aircraft.
  • the ground station simulator usually performs route planning based on a two-dimensional plane map, so each of the planned route points has only two-dimensional position information, and the height information of the waypoint can only be set by parameters.
  • the actual flight of the aircraft will be caused due to the difference in the actual altitude of the home point and the relative height.
  • the height is not accurate; correspondingly, since the ground station simulator only supports two-dimensional route planning, it is difficult to carry out flight simulation of the flight process of the aircraft through the ground station simulator, and it is necessary to combine the height information of the actually set waypoints.
  • a reasonable route can be obtained through multiple actual flight operations, so the operation is cumbersome, and because the ground station simulator has a single function, it is difficult to plan a route with precise requirements for the actual flight altitude of the waypoint.
  • the present application provides a method of generating a simulated route, a method of simulating flight, a device, a computing device, and a computer readable storage medium.
  • a method of generating a simulated route comprising:
  • a human-computer interaction interface is output, where the human-computer interaction interface includes a screen window for presenting the rendered three-dimensional image;
  • a simulated route is generated based on the initial three-dimensional information.
  • a method of simulating flight which simulates flight using a simulated route generated by the method for generating a simulated route, the method comprising:
  • the simulated flight picture is output in the picture window of the human-computer interaction interface according to the rendering result.
  • an apparatus for generating a simulated route comprising:
  • a loading unit for loading a three-dimensional model of the target scene
  • a rendering unit configured to invoke a three-dimensional rendering engine to render the three-dimensional model, and output a human-computer interaction interface, where the human-computer interaction interface includes a screen window for presenting the rendered three-dimensional image;
  • An obtaining unit configured to obtain initial three-dimensional information of a waypoint based on the human-computer interaction interface
  • a generating unit configured to generate a simulated route according to the initial three-dimensional information.
  • a device for simulating flight the device applying the simulated route generated by the device for generating a simulated route to perform a simulated flight, including:
  • a setting unit configured to set flight parameters of the aircraft model by a parameter adjustment simulator
  • control unit configured to: after receiving the simulated flight instruction, control the aircraft model to execute the simulated route in a three-dimensional picture according to the flight parameter to obtain simulated flight data;
  • a rendering unit configured to render the simulated flight data by using a three-dimensional rendering engine
  • an output unit configured to output a simulated flight picture in a picture window of the human-computer interaction interface according to the rendering result.
  • a computing device comprising a memory, a processor and an external interface connected by an internal bus,
  • the memory is configured to store machine readable instructions corresponding to control logic for generating an analog route
  • the processor is configured to read machine readable instructions on the memory and execute the instructions to:
  • a human-computer interaction interface is output, where the human-computer interaction interface includes a screen window for presenting the rendered three-dimensional image;
  • a simulated route is generated based on the initial three-dimensional information.
  • a computing device comprising a memory, a processor and an external interface connected by an internal bus,
  • the memory is configured to store machine readable instructions corresponding to the control logic of the simulated flight, and the simulated route corresponding to the control logic of the simulated flight is an analog route generated by the foregoing computing device;
  • the processor is configured to read the machine readable instructions on the memory and execute the instructions to:
  • the simulated flight picture is output in the picture window of the human-computer interaction interface according to the rendering result.
  • a computer readable storage medium having stored thereon a computer program, the program being executed by a processor to:
  • a human-computer interaction interface is output, where the human-computer interaction interface includes a screen window for presenting the rendered three-dimensional image;
  • a simulated route is generated based on the initial three-dimensional information.
  • a computer readable storage medium having stored thereon a computer program, the program being executed by a processor to:
  • the aircraft model After receiving the simulated flight instruction, controlling the aircraft model to execute a simulated route in a three-dimensional picture according to the flight parameter, and obtaining simulated flight data, the simulated route being an analog route generated by executing a program on the computer readable storage medium ;
  • the simulated flight picture is output in the picture window of the human-computer interaction interface according to the rendering result.
  • the present application can calculate the three-dimensional information of the waypoints including the location information and the altitude information, and obtain the three-dimensional information of the waypoints including the location information and the height information. More accurate 3D simulation of the route, and because it can avoid multiple actual flight operations, thus improving the planning efficiency of the simulated route; correspondingly, based on the 3D simulation route for simulation flight, the simulated flight picture can be obtained synchronously, and can be simulated flight The simulation route is adjusted in real time during the process to provide a more accurate basis for the actual flight path of the aircraft.
  • FIG. 1 is a flow chart of an embodiment of a method for generating a simulated route of the present application
  • FIG. 2 is a schematic diagram of a human-machine interaction interface in FIG. 1;
  • FIG. 3 is a flow chart showing an embodiment of obtaining initial three-dimensional information of a waypoint in the embodiment of FIG. 2;
  • FIG. 4 is a flow chart showing another embodiment of obtaining initial three-dimensional information of a waypoint in the embodiment of FIG. 2;
  • Figure 5 is a flow chart showing another embodiment of obtaining initial three-dimensional information of a waypoint in the embodiment of Figure 2;
  • FIG. 6 is a flow chart of an embodiment of a method of simulating flight of the present application.
  • FIG. 7 is a block diagram of an embodiment of an apparatus for generating a simulated route of the present application.
  • Figure 8 is a block diagram of an embodiment of the apparatus for simulating flight of the present application.
  • FIG. 9 is a block diagram of an embodiment of a computing device of the present application.
  • the aircraft ground station is the command center of the aircraft system to control the aircraft to fly according to a preset route.
  • the unmanned aerial platform as an example, which usually includes a remote controller, a terminal device (mobile phone, tablet, PC, etc.) with a video display function, a power supply system, a radio station, and the like.
  • the ground station can plan the route for the aircraft.
  • the control system of the aircraft is turned on, the ground station uploads the route to the control system to control the actual flight of the aircraft according to the route.
  • the flight process of the aircraft can be simulated in advance through the ground station simulator to provide a relatively accurate reference for the actual flight path of the aircraft.
  • the ground station simulator can be installed in a terminal device, such as a mobile phone, a tablet computer, a PC (Personal Computer, a personal computer), and the like.
  • a terminal device such as a mobile phone, a tablet computer, a PC (Personal Computer, a personal computer), and the like.
  • the ground station simulator in the embodiment of the present application can plan a three-dimensional simulation route through the human-machine interaction interface on the basis of loading the three-dimensional model, and can be based on The three-dimensional simulation route is simulated flight.
  • the human-computer interaction interface for planning the three-dimensional simulation route can be entered.
  • the waypoints in the simulated route can be obtained.
  • a flowchart of an embodiment of a method for generating a simulated route according to the present application includes the following steps:
  • Step 101 Load a three-dimensional model of the target scene.
  • the three-dimensional model in this embodiment can be obtained by using an image-based modeling method, that is, after the scene to be modeled is determined, a plurality of two-dimensional images of the scene can be obtained, and then the two-dimensional image is used to establish the scene.
  • the 3D geometry is used to complete the creation of the 3D model.
  • the three-dimensional model of various scenarios may be generated in advance or generated in real time; the three-dimensional model may be generated by a cloud server or generated by a local terminal device.
  • the three-dimensional model of the target scenario is generated by the cloud server
  • the three-dimensional model may be loaded after receiving the three-dimensional model transmitted by the cloud server;
  • the model is generated by the local terminal device, and the three-dimensional model can be loaded locally after the three-dimensional model is generated.
  • Step 102 After calling the three-dimensional rendering engine to render the three-dimensional model, output a human-computer interaction interface, where the human-computer interaction interface includes a picture window for presenting the rendered three-dimensional image.
  • the 3D rendering engine can be called to render the 3D model to obtain a 3D image of the target scene, and output a human-computer interaction interface, wherein the 3D image can be presented in the screen window of the human-computer interaction interface.
  • the human-computer interaction interface may further include: a parameter setting panel for setting various parameters, a preview window for previewing the screen, and the like. 2 is a schematic diagram of a human-computer interaction interface according to an embodiment of the present application.
  • Step 103 Obtain initial three-dimensional information of the waypoint based on the human-computer interaction interface.
  • the initial three-dimensional information of the waypoint may include: location information of the waypoint and altitude information of the waypoint.
  • location information of the waypoint may include: location information of the waypoint and altitude information of the waypoint.
  • Step 301 Receive a mode switching instruction.
  • the mode switching instructions in this step can be triggered in different ways:
  • the user may perform a flip operation on the three-dimensional picture by using an input device such as a mouse or a touch pad, and trigger a corresponding mode switching instruction according to the flip state presented by the detected flip operation.
  • the position editing instruction is triggered, and when the three-dimensional image is flipped to the head-up state, the height editing instruction is triggered; wherein the top view state and the pan view state can be determined according to the tilt angle of the three-dimensional image after the flip operation, for example, for example When the inclination angle of the three-dimensional screen is less than 45 degrees, it is in a plan view state, and when it is not less than 45 degrees, it is in a head-up state.
  • the corresponding mode switching instruction may be triggered according to the user's selection result, for example, when the selection result is the position option, the position editing instruction is triggered, when selecting When the result is a height option, the height edit command is triggered.
  • the position editing mode or the high-edit mode may be directly entered according to the mode switching instruction; or the position editing mode may be entered first by default, and then the high-definition mode is followed according to the mode switching instruction. Switch between and position mode.
  • the embodiments of the present application are not limited.
  • Step 302 Determine the type of the mode switching instruction. If it is a position editing instruction, execute step 303; if it is a height editing instruction, execute step 304.
  • Step 303 Switch to the location editing mode according to the location editing command, and obtain the location information of the waypoint through the human-computer interaction interface. If yes, go to step 305.
  • a plurality of waypoints may be generated based on the user's dot operation on the three-dimensional screen.
  • the user can perform a right-click operation by using an input device such as a mouse or a touchpad.
  • the intersection of the click position and the three-dimensional model is determined, and the intersection is determined as a waypoint;
  • the height of each waypoint is the ground height, and the adjacent waypoints set in sequence are connected by a route.
  • the user can drag the waypoint and determine the target position of the waypoint according to the result of the drag operation; or the user can also set the position parameter in the parameter setting panel.
  • the position parameter corresponds to the target position of the waypoint.
  • the corresponding location information of the target location in the three-dimensional picture may be obtained, and the location information includes latitude and longitude.
  • Step 304 Switch to the height editing mode according to the height editing command, and obtain the height information of the waypoint through the human-machine interaction interface.
  • the waypoint when switching to the height editing mode according to the height editing command, the waypoint can be controlled to perform a preset operation, wherein the preset operation may include the following operations:
  • the user can set the translation height of the waypoint in the parameter setting panel of the human-computer interaction interface, and after obtaining the translation height, can control all the waypoints that have set the position information according to the translation height in the three-dimensional picture.
  • the overall movement in the vertical direction can be set.
  • the user can drag any waypoint through an input device such as a mouse or a touchpad, and control the waypoint to move in the vertical direction according to the drag operation.
  • an input device such as a mouse or a touchpad
  • the height information of the waypoint in the three-dimensional picture may be determined, and the height information may include an absolute height indicating the altitude of the waypoint or a relative height of the waypoint relative to the height of the takeoff point.
  • the projection height of the takeoff point of the aircraft model on the three-dimensional model can be obtained, and the difference between the absolute height of the waypoint and the projected height is calculated, and the relative height of the waypoint is obtained.
  • Step 305 Save initial three-dimensional information of each waypoint, and the initial three-dimensional information includes location information and altitude information of the waypoint.
  • FIG. 4 a process for obtaining initial three-dimensional information by real-time dot-dot during the flight simulation of controlling the aircraft model in a three-dimensional picture is shown:
  • Step 401 Control the aircraft model to start a simulated flight from a take-off point in the three-dimensional picture according to a control command issued by the remote controller.
  • the aircraft model in this embodiment may include a dynamic model for interacting with the three-dimensional model, a control model for controlling the flight attitude of the aircraft model, and a visual system model for providing visual data for the control model.
  • the user can set the takeoff point of the aircraft model in the three-dimensional picture through the analog remote controller or the real remote controller, and then issue a control command to the aircraft model, thereby controlling the aircraft model to start the simulation flight from the takeoff point.
  • Step 402 If the waypoint increase command issued by the controller is received at any flight point during the simulated flight, the flight point is determined to be a waypoint, and the initial three-dimensional information of the waypoint is recorded.
  • the image data when the preview window is included in the human-computer interaction interface, after the image data captured by the simulated image transmission function of the aircraft model during the simulated flight is acquired, the image data may be performed by the three-dimensional rendering engine. Render and render the rendered simulation in the preview window for real-time preview by the user.
  • the waypoint increase command can be issued by operating a designated button on the remote controller, and after receiving the waypoint increase command, The current flight point is determined as a waypoint, and the position information and height information of the flight point in the three-dimensional picture are recorded as the initial three-dimensional information of the newly added waypoint.
  • Step 403 Save initial three-dimensional information of each waypoint, and the initial three-dimensional information includes location information and altitude information of the waypoint.
  • the simulated flight may be interrupted, and the adjusted for the waypoint is obtained.
  • the initial 3D information is then saved to the adjusted initial 3D information of the waypoint.
  • the adjustment may be performed through the parameter setting panel, or the navigation point may be dragged in the three-dimensional image by using an input device such as a mouse or a touchpad, and details are not described herein.
  • a selection instruction of a target waypoint issued by the remote controller may be received, and the target waypoint may be a waypoint set by the dot operation. Any of the waypoints, then control the aircraft model to start from the target waypoint and re-execute the simulated flight in the 3D picture.
  • Step 501 Load a preset route template in the picture window.
  • multiple route templates may be preset, and the initial simulated route corresponding to each route template may have a fixed shape, such as a rectangle, a square, or a triangle, etc., and then the name and route template of each route template may be stored locally. Correspondence. After the user inputs the name of the selected route template, the route template corresponding to the input name may be obtained from the stored correspondence, and the route template may be loaded in the picture window. The route template is also available It is set by the user.
  • Step 502 Generate an initial simulated route according to the route template, where the initial simulated route includes multiple initial waypoints, and the waypoint information of each initial waypoint includes initial three-dimensional information.
  • the take-off point and the landing point of the initial simulated route can be determined by a user's click operation in the three-dimensional picture or a setting operation in the parameter setting panel, and then between the take-off point and the landing point.
  • the initial simulated route is generated according to the fixed shape of the initial simulated route.
  • the takeoff point and length of the initial simulated route may be determined by a user clicking operation in a three-dimensional picture or a setting operation in a parameter setting panel, and then starting from the takeoff point, according to the initial simulation
  • the fixed shape of the route generates an initial simulated route that is consistent with the length of the simulated route.
  • Step 503 Obtain modified initial three-dimensional information for any initial waypoint through the human-computer interaction interface.
  • a plurality of initial waypoints may be set according to a preset interval in the initial simulated route, and the initial three-dimensional information may be determined according to the position of each initial waypoint in the three-dimensional picture.
  • any of the initial waypoints may be adjusted, for example, by dragging to reset the position of any of the initial waypoints, or after selecting any initial waypoints, in the parameters
  • the position of the initial waypoint is set in the setting panel, and then the modified initial three-dimensional information is obtained according to the adjusted initial waypoint position.
  • Step 504 Save the modified initial three-dimensional information of each waypoint, and the initial three-dimensional information includes location information and altitude information.
  • Step 104 Generate a simulated route according to the initial three-dimensional information.
  • the target three-dimensional information of the waypoint may be obtained according to the initial three-dimensional information obtained in step 103, and the simulated route file may be saved correspondingly, and the simulated route file may include: a waypoint order and a waypoint information of each waypoint,
  • the point information includes the target three-dimensional information of the waypoint and the attribute information of the waypoint.
  • the target three-dimensional information of the waypoint may include: location information and altitude information of the waypoint; the attribute information of the waypoint may include: a posture parameter of the pan/tilt when the aircraft flies to the waypoint, a speed parameter of the aircraft, and an attitude parameter of the aircraft. .
  • the takeoff point of the aircraft model can be acquired in three dimensions.
  • the projection height on the model and calculate the difference between the absolute height of each waypoint and the projected height, which is the relative height of each waypoint relative to the takeoff point, which can be determined as the target three-dimensional information. Height information.
  • the three-dimensional information of the waypoint including the position information and the height information can be planned, thereby obtaining a more accurate three-dimensional image.
  • the route is simulated, and the planning efficiency of the simulated route is improved because multiple actual flight operations can be avoided.
  • FIG. 6 is a flowchart of an embodiment of a method for simulating flight according to the present application.
  • the embodiment may apply the simulated route generated by the foregoing embodiment shown in FIG. 2 to perform simulated flight, including the following steps:
  • Step 601 Set flight parameters of the aircraft model by a parameter adjustment simulator.
  • Step 602 After receiving the simulated flight instruction, control the aircraft model to execute the simulated route in the three-dimensional picture according to the flight parameter, and obtain simulated flight data.
  • the simulated route can be adjusted during the execution of the simulated route. If a pause command is received at a certain waypoint, the simulated route can be interrupted and the adjusted for the waypoint can be obtained. The 3D information is then generated based on the adjusted 3D information to generate an updated simulated route. Based on the regenerated analog route, if the selection instruction of the target waypoint is received, the aircraft model can be controlled to start from the target waypoint, and the updated simulated route is executed in the three-dimensional picture, thereby improving the adjustment of the simulated route by adjusting the waypoint in real time. effectiveness.
  • Step 603 Rendering simulated flight data by using a three-dimensional rendering engine.
  • Step 604 Output a simulated flight picture in a picture window of the human-computer interaction interface according to the rendering result.
  • the human-computer interaction interface may further include a preview window, so after acquiring the image data captured by the simulated image transmission function during the execution of the simulated flight path of the aircraft model, the image may be imaged by the three-dimensional rendering engine. The data is rendered, and the rendered simulation image is presented in real time in the preview window for the user to preview the simulated image captured by the aircraft model in real time during flight.
  • the embodiment performs simulation flight based on the three-dimensional simulation route, and the simulated flight picture can be obtained synchronously, and the simulation route can be adjusted in real time during the simulation flight, thereby providing a more accurate basis for the actual flight path of the aircraft.
  • the present application also provides an embodiment of a device for generating a simulated route, a device for simulating flight, and a computing device.
  • FIG. 7 a block diagram of an embodiment of an apparatus for generating a simulated route according to the present application is as follows:
  • the apparatus includes a loading unit 710, a rendering unit 720, an obtaining unit 730, and a generating unit 740.
  • the loading unit 710 is configured to load a three-dimensional model of the target scene.
  • a rendering unit 720 configured to invoke a three-dimensional rendering engine to render the three-dimensional model, and output a human-computer interaction interface, where the human-computer interaction interface includes a screen window for presenting the rendered three-dimensional image;
  • the obtaining unit 730 is configured to obtain initial three-dimensional information of a waypoint based on the human-machine interaction interface
  • the generating unit 740 is configured to generate a simulated route according to the initial three-dimensional information.
  • the loading unit 710 may include at least one of the following units (not shown in FIG. 7):
  • a first loading subunit configured to load the three-dimensional model after receiving the three-dimensional model of the target scene generated by the cloud server
  • a second loading subunit configured to load the three-dimensional model after generating a three-dimensional model of the target scene by the local three-dimensional reconstruction function.
  • the obtaining unit 730 may include (not shown in FIG. 7):
  • a mode switching subunit configured to control the human-machine interaction interface to switch between a position editing mode and a high-edit mode according to a mode switching instruction
  • a location information obtaining subunit configured to obtain location information of a waypoint through the human-machine interaction interface when switching to the location editing mode
  • a height information obtaining subunit configured to obtain height information of a waypoint through the human-machine interaction interface when switching to the height editing mode
  • a first information saving subunit configured to save initial three-dimensional information of each waypoint, the initial three-dimensional information including the location information and the height information.
  • the mode switching subunit may be specifically configured to obtain a mode switching instruction according to the detected inversion state of the three-dimensional picture, and switch to a position editing mode when the three-dimensional picture is flipped to a top view state.
  • the mode is switched to the height editing mode; or, according to the mode switching option provided by the human-machine interaction interface, the mode switching instruction is obtained, and when the position option is selected, the mode is switched to the position editing mode, when the height is When the option is selected, switch to the height edit mode.
  • the location information obtaining subunit may be specifically used to perform based on the three-dimensional picture.
  • Point operation generate a plurality of waypoints; determine a target position after any of the waypoints after the drag operation, or perform a target position after the position parameter setting in the parameter setting panel of the human-computer interaction interface, and obtain the target Corresponding location information in the three-dimensional picture, the location information including latitude and longitude.
  • the height information obtaining sub-unit may be specifically configured to control the waypoint to perform a preset operation, and determine height information in the three-dimensional picture after the waypoint completes the preset operation.
  • the controlling the waypoint to perform the preset operation may include: obtaining a translation height of the waypoint set in the parameter setting panel of the human-machine interaction interface, and controlling the waypoint according to the translation height Move in the vertical direction, or control the waypoint to move in the vertical direction according to the drag operation.
  • the obtaining unit 730 may also include (not shown in FIG. 7):
  • a waypoint increase determination subunit for determining that the flight point is a waypoint if the waypoint increase command issued by the controller is received at any flight point during the simulated flight, and recording the waypoint Initial three-dimensional information
  • the second information saving subunit is configured to save initial three-dimensional information of each waypoint, where the initial three-dimensional information includes location information and altitude information of the waypoint.
  • the human-computer interaction interface may further include a preview window
  • the rendering unit 720 may be further configured to acquire image data captured by the aircraft model during the simulated flight, by using the three-dimensional rendering.
  • the engine renders the image data and renders the rendered simulated picture in the preview window.
  • the simulated flight control subunit may be further configured to interrupt execution of the simulated flight if a pause command is received at a certain waypoint during the simulated flight, obtaining Adjusted initial three-dimensional information of the waypoint;
  • the second information saving subunit may further be configured to save the adjusted initial three-dimensional information of the waypoint
  • the simulated flight control sub-unit may be further configured to receive a selection instruction of a target waypoint, where the target waypoint is any one of the waypoints determined by the waypoint increase command. Controlling the aircraft model from the target waypoint, performing the simulated flight in the three-dimensional picture.
  • the obtaining unit 730 may further include (not shown in FIG. 7):
  • a route template loading subunit configured to load a preset route template in the picture window
  • An initial route generation subunit configured to generate an initial simulated route according to the route template, where the initial simulated route
  • the method includes a plurality of initial waypoints, and the waypoint information of each initial waypoint includes initial three-dimensional information;
  • a three-dimensional information obtaining subunit configured to obtain modified initial three-dimensional information for any initial waypoint through the human-computer interaction interface
  • the third information saving subunit is configured to save the modified three-dimensional information of each waypoint, the initial three-dimensional information including location information and height information.
  • the initial simulated route corresponding to each route template may have a fixed shape; the initial route generation subunit may be specifically configured to determine a takeoff point and a landing point of the initial route, according to the takeoff point and the landing point, Generating an initial simulated route according to the fixed shape of the initial simulated route, or determining a takeoff point and length of the initial simulated route, and generating an initial simulated route according to the fixed shape of the initial simulated route according to the takeoff point and length.
  • the height information may include: an absolute height for indicating an altitude of the waypoint, or a relative height of the waypoint relative to a takeoff point height.
  • the generating unit 740 can include (not shown in FIG. 7):
  • a target information obtaining subunit configured to obtain target three-dimensional information of a waypoint according to the initial three-dimensional information
  • the simulated route save subunit is configured to save the simulated route file, where the simulated route file includes: a waypoint sequence and waypoint information of each waypoint; the waypoint information includes target three-dimensional information of the waypoint, and Attribute information of waypoints;
  • the target three-dimensional information of the waypoint includes: location information and altitude information of the waypoint;
  • the attribute information of the waypoint includes: a posture parameter of the pan/tilt when the aircraft flies to the waypoint, a speed parameter of the aircraft, and a posture of the aircraft.
  • the target information obtaining subunit may be specifically used to acquire a projection of the takeoff point of the aircraft model on the three-dimensional model. Height, the difference between the absolute height of each waypoint and the projected height is determined as the height information of each waypoint.
  • the human-computer interaction interface further includes a preview window.
  • the rendering unit 720 is further configured to: when the waypoint information of any waypoint is determined, acquire the aircraft model based on the three-dimensional image.
  • the image data captured by the waypoint information is rendered by the three-dimensional rendering engine, and the rendered simulated image is presented in the preview window.
  • FIG. 8 a block diagram of an embodiment of a device for simulating flight of the present application can be simulated flight using the simulated route generated by the device shown in FIG. 7:
  • the apparatus includes a setting unit 810, a control unit 820, a rendering unit 830, and an output unit 840.
  • the setting unit 810 is configured to set flight parameters of the aircraft model by using a parameter adjustment simulator
  • the control unit 820 is configured to, after receiving the simulated flight instruction, control the aircraft model to execute the simulated route in a three-dimensional picture according to the flight parameter, to obtain simulated flight data;
  • a rendering unit 830 configured to render the simulated flight data by using a three-dimensional rendering engine
  • the output unit 840 is configured to output a simulated flight picture in a picture window of the human-machine interaction interface according to the rendering result.
  • the apparatus may also include (not shown in FIG. 8):
  • An interruption unit configured to interrupt execution of the simulated route if a pause command is received at a certain waypoint during execution of the simulated route by the aircraft model
  • An obtaining unit configured to obtain adjusted three-dimensional information for the waypoint
  • a generating unit configured to generate an updated simulated route based on the adjusted three-dimensional information.
  • the apparatus may further include (not shown in FIG. 8):
  • a receiving unit configured to receive a selection instruction of a target waypoint after regenerating the simulated route
  • the control unit 820 may be further configured to control the aircraft model to start from the target waypoint, and execute the updated simulated route in the three-dimensional picture.
  • the flight parameters may include: a cloud platform parameter of the aircraft model, a parameter of the aircraft model mounting analog camera, a GPS parameter of the aircraft model, and a posture parameter.
  • the computing device may have the following general structure, including: a memory 920 connected through an internal bus 910, a processor 930, and an external interface 940.
  • the memory 920 can store machine readable instructions corresponding to different control logics. Accordingly, the processor 930 can read machine readable instructions on the memory 920 to perform different operations.
  • the memory 920 is configured to store machine readable instructions corresponding to control logic for obtaining flight simulation data
  • the processor 930 is configured to read the machine readable instructions on the memory 920 and execute the instructions to implement the following operations:
  • a human-computer interaction interface is output, where the human-computer interaction interface includes a screen window for presenting the rendered three-dimensional image;
  • a simulated route is generated based on the initial three-dimensional information.
  • the processor 930 is specifically configured to perform loading the three-dimensional model after receiving the three-dimensional model of the target scene generated by the cloud server; or generating the target scene by using the local three-dimensional reconstruction function. After the 3D model, the 3D model is loaded.
  • the processor 930 is specifically configured to perform, according to the mode switching instruction, controlling the human-machine interaction interface to switch between a position editing mode and a height editing mode; when switching to the position editing mode, Obtaining location information of the waypoint through the human-computer interaction interface; obtaining the height information of the waypoint through the human-machine interaction interface when switching to the high-edit mode; and saving initial three-dimensional information of each waypoint, the initial The three-dimensional information includes the location information and the height information.
  • the processor 930 is specifically configured to: obtain a mode switching instruction according to the detected inversion state of the three-dimensional picture, and switch to position editing when the three-dimensional picture is flipped to a top view state. a mode of switching to a height editing mode when the three-dimensional screen is flipped to a head-up state; or obtaining a mode switching instruction according to a mode switching option provided by the human-machine interaction interface, and switching to a position editing mode when the location option is selected When the height option is selected, switch to the height edit mode.
  • the processor 930 is configured to perform, according to the striking operation on the three-dimensional picture, generate a plurality of waypoints; determine a target position of any waypoint after the drag operation, or Performing a target position after the position parameter setting in the parameter setting panel of the human-computer interaction interface; obtaining position information corresponding to the target position in the three-dimensional picture, the position information including latitude and longitude.
  • the processor 930 is specifically configured to perform control of the waypoint to perform a preset operation; and determine height information in the three-dimensional picture after the waypoint completes the preset operation.
  • the processor 930 is specifically configured to perform obtaining a translation height of the waypoint set in a parameter setting panel of the human-machine interaction interface, and control the waypoint according to the The translation height is moved in the vertical direction; or, the waypoint is controlled to move in the vertical direction according to the drag operation.
  • the processor 930 is specifically configured to execute, according to a control command issued by the remote controller, control the aircraft model to start a simulated flight from a take-off point in the three-dimensional picture; if during the simulated flight Receiving a waypoint increase command issued by the controller at any flight point, determining that the flight point is a waypoint, and recording initial three-dimensional information of the waypoint; and saving initial three-dimensional information of each waypoint
  • the initial three-dimensional information includes location information and altitude information of the waypoint.
  • the processor 930 is specifically configured to perform acquiring image data captured by the aircraft model during the simulated flight; and rendering the image data by using the three-dimensional rendering engine; The rendered simulated picture is rendered in the preview window.
  • the processor 930 is further configured to perform, during the simulated flight, if the pause instruction is received at a certain waypoint, interrupting performing the simulated flight; The adjusted initial three-dimensional information of the waypoint is stored; and the adjusted initial three-dimensional information of the waypoint is saved.
  • the processor 930 is further configured to perform a selection instruction of receiving a target waypoint, where the target waypoint is any one of the waypoints determined by the waypoint increase instruction. Pointing; controlling the aircraft model to start from the target waypoint, performing the simulated flight in the three-dimensional picture.
  • the processor 930 is specifically configured to perform loading a preset route template in the picture window, and generate an initial simulated route according to the route template, where the initial simulated route includes multiple The initial waypoints, the waypoint information of each initial waypoint contains initial three-dimensional information; the modified initial three-dimensional information for any initial waypoint is obtained through the human-computer interaction interface; and the modified each waypoint is saved Initial three-dimensional information, the initial three-dimensional information including location information and height information.
  • the processor 930 is specifically configured to perform a determination of a take-off point and a landing point of an initial simulated route, and generate an initial shape according to the fixed shape of the initial simulated route according to the take-off point and the landing point. Simulating the route; or determining the takeoff point and length of the initial simulated route, and generating an initial simulated route according to the fixed shape of the initial simulated route according to the takeoff point and length.
  • the height information includes an absolute height for indicating an altitude of the waypoint or a relative height of the waypoint relative to a height of the takeoff point.
  • the processor 930 is specifically configured to perform target three-dimensional information for obtaining a waypoint according to the initial three-dimensional information; and save a simulated route file, where the simulated route file includes: a waypoint sequence and Waypoint information of each waypoint; the waypoint information includes target three-dimensional information of the waypoint, and attribute information of the waypoint;
  • the target three-dimensional information of the waypoint includes: location information and altitude information of the waypoint;
  • the attribute information of the waypoint includes: a posture parameter of the pan/tilt when the aircraft flies to the waypoint, a speed parameter of the aircraft, and an attitude parameter of the aircraft.
  • the initial three-dimensional information of the waypoint includes: location information of the waypoint and an absolute height;
  • the processor 930 is specifically configured to perform a high projection of the takeoff point of the acquiring aircraft model on the three-dimensional model Degree; the difference between the absolute height of each waypoint and the projected height is determined as the height information of each waypoint.
  • the human-computer interaction interface further includes a preview window.
  • the processor 930 is further configured to: when the waypoint information of any waypoint is determined, acquire the aircraft model in the three-dimensional image. Image data captured based on the waypoint information; rendering the image data by the three-dimensional rendering engine; presenting the rendered simulated image in the preview window.
  • the memory 920 is configured to store machine readable instructions corresponding to the control logic of the simulated flight, and the simulated route corresponding to the control logic of the simulated flight is an analog route generated by the foregoing computing device;
  • the processor 930 is configured to read the machine readable instructions on the memory and execute the instructions to:
  • the simulated flight picture is output in the picture window of the human-computer interaction interface according to the rendering result.
  • the processor 930 is further configured to perform execution of the simulated route during the execution of the simulated route of the aircraft model, if the suspension instruction is received at a certain waypoint, interrupting execution of the simulated route; The adjusted three-dimensional information of the waypoint; generating an updated simulated route based on the adjusted three-dimensional information.
  • the processor 930 is further configured to perform a selection instruction of receiving a target waypoint after regenerating the simulated route; controlling the aircraft model to start from the target waypoint in the three-dimensional picture The updated simulated route is executed in the middle.
  • the flight parameters include: a pan/tilt parameter of the aircraft model, a parameter of the aircraft model mount analog camera, a GPS parameter of the aircraft model, and a pose parameter.
  • the embodiment of the present application further provides a computer readable storage medium, where a computer program is stored, and when the program is executed, the following operations are implemented:
  • a human-computer interaction interface is output, and the human-computer interaction boundary
  • the facet includes a picture window for rendering the rendered three-dimensional picture
  • a simulated route is generated based on the initial three-dimensional information.
  • the embodiment of the present application further provides another computer readable storage medium, on which a computer program is stored, and when the program is executed, the following operations are implemented:
  • the simulated flight picture is output in the picture window of the human-computer interaction interface according to the rendering result.
  • the device embodiment since it basically corresponds to the method embodiment, reference may be made to the partial description of the method embodiment.
  • the device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without any creative effort.
  • Embodiments of the subject matter and functional operations described in this specification can be implemented in the following: digital electronic circuits, tangible embodied computer software or firmware, computer hardware including the structures disclosed in the specification and their structural equivalents, or One or more combinations.
  • Embodiments of the subject matter described in this specification can be implemented as one or more computer programs, i.e., encoded on a tangible, non-transitory program carrier, to be executed by or controlled by a data processing device.
  • the program instructions may be encoded on an artificially generated propagating signal, such as a machine-generated electrical, optical or electromagnetic signal that is generated to encode and transmit the information to a suitable receiver device for data
  • the processing device executes.
  • the computer storage medium can be a machine readable storage device, a machine readable storage substrate, a random or serial access memory device, or a combination of one or more of them.
  • the processes and logic flows described in this specification can be performed by one or more programmable computers executing one or more computer programs to perform the corresponding functions by operating in accordance with input data and generating an output.
  • the processing and logic flow may also be performed by dedicated logic circuitry, such as an FPGA (Field Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit), and the apparatus may also be implemented as dedicated logic circuitry.
  • FPGA Field Programmable Gate Array
  • ASIC Application Specific Integrated Circuit
  • Computers suitable for the execution of a computer program include, for example, a general purpose and/or special purpose microprocessor, or any other type of central processing unit.
  • the central processing unit will receive instructions and data from a read only memory and/or a random access memory.
  • the basic components of a computer include a central processing unit for implementing or executing instructions and one or more memory devices for storing instructions and data.
  • the computer will also include one or more mass storage devices for storing data, such as a magnetic disk, magneto-optical disk or optical disk, or the like, or the computer will be operatively coupled to the mass storage device for receiving data or It transmits data, or both.
  • the computer does not have to have such a device.
  • the computer can be embedded in another device, such as a mobile phone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a global positioning system (GPS) receiver, or, for example, a universal serial bus (USB) ) Portable storage devices for flash drives, to name a few.
  • PDA personal digital assistant
  • GPS global positioning system
  • USB universal serial bus
  • Computer readable media suitable for storing computer program instructions and data include all forms of nonvolatile memory, media and memory devices including, for example, semiconductor memory devices (eg, EPROM, EEPROM, and flash memory devices), magnetic disks (eg, internal hard drives or Mobile disk), magneto-optical disks, and CD ROM and DVD-ROM disks.
  • semiconductor memory devices eg, EPROM, EEPROM, and flash memory devices
  • magnetic disks eg, internal hard drives or Mobile disk
  • magneto-optical disks e.g, CD ROM and DVD-ROM disks.
  • the processor and memory may be supplemented by, or incorporated in, special purpose logic circuitry.

Abstract

A method for generating a simulated route, a method and device for flight simulation and a storage medium, the method for generating a simulated route comprising: loading a three-dimensional model of a target scene; calling a three-dimensional rendering engine to render the three-dimensional model, and outputting a human-computer interaction interface, the human-computer interaction interface comprising a picture window used for presenting the rendered three-dimensional picture; obtaining initial three-dimensional information of a way point on the basis of the human-computer interaction interface; and generating a simulated route according to the initial three-dimensional information. By applying the embodiments of the present application, three-dimensional information of a way point that comprises position information and height information may be programmed, thereby obtaining a more accurate three-dimensional simulated route and improving the efficiency of programming a simulated route since multiple actual flight operations may be avoided. Correspondingly, performing a simulated flight on the basis of the three-dimensional simulated route may provide a more accurate basis for the actual flight path of an aircraft.

Description

生成模拟航线的方法、模拟飞行的方法、设备及存储介质Method for generating simulated route, method, equipment and storage medium for simulating flight 技术领域Technical field
本申请涉及计算机技术领域,尤其涉及一种生成模拟航线的方法、模拟飞行的方法、装置、计算设备及计算机可读存储介质。The present application relates to the field of computer technologies, and in particular, to a method for generating a simulated route, a method for simulating flight, a device, a computing device, and a computer readable storage medium.
背景技术Background technique
目前以无人机为代表的飞行器有比较广泛的应用,例如,进行专业航拍、农业灌溉、电力巡线、治安监控等。通常飞行器在实际飞行过程中,由地面站为飞行器规划航线,当飞行器的控制系统开机后,地面站将航线上传至控制系统,以控制飞行器根据航线进行实际飞行。为了保证飞行器在实际飞行过程中的精确性,可以预先通过地面站模拟器对飞行器的飞行过程进行模拟仿真,以便为飞行器的实际飞行过程提供相对精确的航线。At present, aircraft represented by drones have a wide range of applications, such as professional aerial photography, agricultural irrigation, power line inspection, and public security monitoring. Usually, during the actual flight, the ground station plans the route for the aircraft. When the control system of the aircraft is turned on, the ground station uploads the route to the control system to control the actual flight of the aircraft according to the route. In order to ensure the accuracy of the aircraft during the actual flight, the flight process of the aircraft can be simulated in advance through the ground station simulator to provide a relatively accurate route for the actual flight process of the aircraft.
相关技术中,地面站模拟器通常基于二维平面地图进行航线规划,因此规划出的模拟航线中每个航点仅具有二维的位置信息,而航点的高度信息仅能通过参数设置,设置为相对于飞行器起飞点(home点)的相对高度,因此当飞行器在不同的home点起飞时,将会由于home点实际海拔高度的不同,而相对高度不变的情况下,导致飞行器的实际飞行高度不准确;相应的,由于地面站模拟器仅支持二维航线规划,因此难以通过地面站模拟器对飞行器的飞行过程进行空间范围内的飞行模拟,需要结合实际设置的航点的高度信息,通过多次实际飞行操作才能获得合理的航线,因此操作繁琐,而且由于地面站模拟器功能单一,也难以规划出对航点的实际飞行高度有精确要求的航线。In the related art, the ground station simulator usually performs route planning based on a two-dimensional plane map, so each of the planned route points has only two-dimensional position information, and the height information of the waypoint can only be set by parameters. In relation to the relative height of the aircraft's take-off point (home point), when the aircraft takes off at different home points, the actual flight of the aircraft will be caused due to the difference in the actual altitude of the home point and the relative height. The height is not accurate; correspondingly, since the ground station simulator only supports two-dimensional route planning, it is difficult to carry out flight simulation of the flight process of the aircraft through the ground station simulator, and it is necessary to combine the height information of the actually set waypoints. A reasonable route can be obtained through multiple actual flight operations, so the operation is cumbersome, and because the ground station simulator has a single function, it is difficult to plan a route with precise requirements for the actual flight altitude of the waypoint.
发明内容Summary of the invention
本申请提供一种生成模拟航线的方法、模拟飞行的方法、装置、计算设备及计算机可读存储介质。The present application provides a method of generating a simulated route, a method of simulating flight, a device, a computing device, and a computer readable storage medium.
依据本申请的第一方面,提供一种生成模拟航线的方法,所述方法包括:According to a first aspect of the present application, a method of generating a simulated route is provided, the method comprising:
加载目标场景的三维模型;Loading a three-dimensional model of the target scene;
调用三维渲染引擎对所述三维模型进行渲染后,输出人机交互界面,所述人机交互界面中包含用于呈现渲染后的三维画面的画面窗口; After the 3D rendering engine is invoked to render the 3D model, a human-computer interaction interface is output, where the human-computer interaction interface includes a screen window for presenting the rendered three-dimensional image;
基于所述人机交互界面获得航点的初始三维信息;Obtaining initial three-dimensional information of a waypoint based on the human-computer interaction interface;
根据所述初始三维信息生成模拟航线。A simulated route is generated based on the initial three-dimensional information.
依据本申请的第二方面,提供一种模拟飞行的方法,所述方法应用前述生成模拟航线的方法所生成的模拟航线进行模拟飞行,所述方法包括:According to a second aspect of the present application, there is provided a method of simulating flight, which simulates flight using a simulated route generated by the method for generating a simulated route, the method comprising:
通过参数调节模拟器设置飞行器模型的飞行参数;Setting the flight parameters of the aircraft model through the parameter adjustment simulator;
在接收到模拟飞行指令后,控制所述飞行器模型按照所述飞行参数在三维画面中执行所述模拟航线,获得模拟飞行数据;After receiving the simulated flight instruction, controlling the aircraft model to execute the simulated route in a three-dimensional picture according to the flight parameter to obtain simulated flight data;
通过三维渲染引擎对所述模拟飞行数据进行渲染;Rendering the simulated flight data by a three-dimensional rendering engine;
根据渲染结果在人机交互界面的画面窗口输出模拟飞行画面。The simulated flight picture is output in the picture window of the human-computer interaction interface according to the rendering result.
依据本申请的第三方面,提供一种生成模拟航线的装置,包括:According to a third aspect of the present application, an apparatus for generating a simulated route is provided, comprising:
加载单元,用于加载目标场景的三维模型;a loading unit for loading a three-dimensional model of the target scene;
渲染单元,用于调用三维渲染引擎对所述三维模型进行渲染后,输出人机交互界面,所述人机交互界面中包含用于呈现渲染后的三维画面的画面窗口;a rendering unit, configured to invoke a three-dimensional rendering engine to render the three-dimensional model, and output a human-computer interaction interface, where the human-computer interaction interface includes a screen window for presenting the rendered three-dimensional image;
获得单元,用于基于所述人机交互界面获得航点的初始三维信息;An obtaining unit, configured to obtain initial three-dimensional information of a waypoint based on the human-computer interaction interface;
生成单元,用于根据所述初始三维信息生成模拟航线。And a generating unit, configured to generate a simulated route according to the initial three-dimensional information.
依据本申请的第四方面,提供一种模拟飞行的装置,所述装置应用前述生成模拟航线的装置所生成的模拟航线进行模拟飞行,包括:According to a fourth aspect of the present application, there is provided a device for simulating flight, the device applying the simulated route generated by the device for generating a simulated route to perform a simulated flight, including:
设置单元,用于通过参数调节模拟器设置飞行器模型的飞行参数;a setting unit configured to set flight parameters of the aircraft model by a parameter adjustment simulator;
控制单元,用于在接收到模拟飞行指令后,控制所述飞行器模型按照所述飞行参数在三维画面中执行所述模拟航线,获得模拟飞行数据;a control unit, configured to: after receiving the simulated flight instruction, control the aircraft model to execute the simulated route in a three-dimensional picture according to the flight parameter to obtain simulated flight data;
渲染单元,用于通过三维渲染引擎对所述模拟飞行数据进行渲染;a rendering unit, configured to render the simulated flight data by using a three-dimensional rendering engine;
输出单元,用于根据渲染结果在人机交互界面的画面窗口输出模拟飞行画面。And an output unit, configured to output a simulated flight picture in a picture window of the human-computer interaction interface according to the rendering result.
依据本申请的第五方面,提供一种计算设备,包括通过内部总线连接的存储器、处理器和外部接口,According to a fifth aspect of the present application, there is provided a computing device comprising a memory, a processor and an external interface connected by an internal bus,
所述存储器,用于存储生成模拟航线的控制逻辑对应的机器可读指令;The memory is configured to store machine readable instructions corresponding to control logic for generating an analog route;
所述处理器,用于读取所述存储器上的机器可读指令,并执行所述指令以实现如下操作: The processor is configured to read machine readable instructions on the memory and execute the instructions to:
加载目标场景的三维模型;Loading a three-dimensional model of the target scene;
调用三维渲染引擎对所述三维模型进行渲染后,输出人机交互界面,所述人机交互界面中包含用于呈现渲染后的三维画面的画面窗口;After the 3D rendering engine is invoked to render the 3D model, a human-computer interaction interface is output, where the human-computer interaction interface includes a screen window for presenting the rendered three-dimensional image;
基于所述人机交互界面获得航点的初始三维信息;Obtaining initial three-dimensional information of a waypoint based on the human-computer interaction interface;
根据所述初始三维信息生成模拟航线。A simulated route is generated based on the initial three-dimensional information.
依据本申请的第六方面,提供一种计算设备,包括通过内部总线连接的存储器、处理器和外部接口,According to a sixth aspect of the present application, there is provided a computing device comprising a memory, a processor and an external interface connected by an internal bus,
所述存储器,用于存储模拟飞行的控制逻辑对应的机器可读指令,所述模拟飞行的控制逻辑对应的模拟航线为前述计算设备生成的模拟航线;The memory is configured to store machine readable instructions corresponding to the control logic of the simulated flight, and the simulated route corresponding to the control logic of the simulated flight is an analog route generated by the foregoing computing device;
所述处理器,用于读取所述存储器上的所述机器可读指令,并执行所述指令以实现如下操作:The processor is configured to read the machine readable instructions on the memory and execute the instructions to:
通过参数调节模拟器设置飞行器模型的飞行参数;Setting the flight parameters of the aircraft model through the parameter adjustment simulator;
在接收到模拟飞行指令后,控制所述飞行器模型按照所述飞行参数在三维画面中执行所述模拟航线,获得模拟飞行数据;After receiving the simulated flight instruction, controlling the aircraft model to execute the simulated route in a three-dimensional picture according to the flight parameter to obtain simulated flight data;
通过三维渲染引擎对所述模拟飞行数据进行渲染;Rendering the simulated flight data by a three-dimensional rendering engine;
根据渲染结果在人机交互界面的画面窗口输出模拟飞行画面。The simulated flight picture is output in the picture window of the human-computer interaction interface according to the rendering result.
依据本申请的第七方面,提供一种计算机可读存储介质,其上存储有计算机程序,所述程序被处理器执行时实现如下操作:According to a seventh aspect of the present application, there is provided a computer readable storage medium having stored thereon a computer program, the program being executed by a processor to:
加载目标场景的三维模型;Loading a three-dimensional model of the target scene;
调用三维渲染引擎对所述三维模型进行渲染后,输出人机交互界面,所述人机交互界面中包含用于呈现渲染后的三维画面的画面窗口;After the 3D rendering engine is invoked to render the 3D model, a human-computer interaction interface is output, where the human-computer interaction interface includes a screen window for presenting the rendered three-dimensional image;
基于所述人机交互界面获得航点的初始三维信息;Obtaining initial three-dimensional information of a waypoint based on the human-computer interaction interface;
根据所述初始三维信息生成模拟航线。A simulated route is generated based on the initial three-dimensional information.
依据本申请的第八方面,提供一种计算机可读存储介质,其上存储有计算机程序,所述程序被处理器执行时实现如下操作:According to an eighth aspect of the present application, there is provided a computer readable storage medium having stored thereon a computer program, the program being executed by a processor to:
通过参数调节模拟器设置飞行器模型的飞行参数; Setting the flight parameters of the aircraft model through the parameter adjustment simulator;
在接收到模拟飞行指令后,控制所述飞行器模型按照所述飞行参数在三维画面中执行模拟航线,获得模拟飞行数据,所述模拟航线为执行前述计算机可读存储介质上的程序生成的模拟航线;After receiving the simulated flight instruction, controlling the aircraft model to execute a simulated route in a three-dimensional picture according to the flight parameter, and obtaining simulated flight data, the simulated route being an analog route generated by executing a program on the computer readable storage medium ;
通过三维渲染引擎对所述模拟飞行数据进行渲染;Rendering the simulated flight data by a three-dimensional rendering engine;
根据渲染结果在人机交互界面的画面窗口输出模拟飞行画面。The simulated flight picture is output in the picture window of the human-computer interaction interface according to the rendering result.
由以上本申请实施例提供的技术方案可见,本申请由于基于三维模型进行模拟航线规划,与现有技术相比,可以规划出包括位置信息和高度信息在内的航点的三维信息,从而获得更为准确的三维模拟航线,并且由于可以避免多次实际飞行操作,因此提升了模拟航线的规划效率;相应的,基于三维模拟航线进行模拟飞行,可以同步获得模拟飞行画面,并可以在模拟飞行过程中实时调整模拟航线,从而为飞行器的实际飞行航线提供更为精确的依据。As can be seen from the technical solutions provided by the embodiments of the present application, the present application can calculate the three-dimensional information of the waypoints including the location information and the altitude information, and obtain the three-dimensional information of the waypoints including the location information and the height information. More accurate 3D simulation of the route, and because it can avoid multiple actual flight operations, thus improving the planning efficiency of the simulated route; correspondingly, based on the 3D simulation route for simulation flight, the simulated flight picture can be obtained synchronously, and can be simulated flight The simulation route is adjusted in real time during the process to provide a more accurate basis for the actual flight path of the aircraft.
附图说明DRAWINGS
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present application. Other drawings may also be obtained from those of ordinary skill in the art in view of the drawings.
图1是本申请生成模拟航线的方法的实施例流程图;1 is a flow chart of an embodiment of a method for generating a simulated route of the present application;
图2是图1中一种人机交互界面的示意图;2 is a schematic diagram of a human-machine interaction interface in FIG. 1;
图3是图2实施例中获得航点的初始三维信息的一个实施例流程图;3 is a flow chart showing an embodiment of obtaining initial three-dimensional information of a waypoint in the embodiment of FIG. 2;
图4是图2实施例中获得航点的初始三维信息的另一个实施例流程图;4 is a flow chart showing another embodiment of obtaining initial three-dimensional information of a waypoint in the embodiment of FIG. 2;
图5是图2实施例中获得航点的初始三维信息的另一个实施例流程图;Figure 5 is a flow chart showing another embodiment of obtaining initial three-dimensional information of a waypoint in the embodiment of Figure 2;
图6是本申请模拟飞行的方法的实施例流程图;6 is a flow chart of an embodiment of a method of simulating flight of the present application;
图7是本申请生成模拟航线的装置的实施例框图;7 is a block diagram of an embodiment of an apparatus for generating a simulated route of the present application;
图8是本申请模拟飞行的装置的实施例框图;Figure 8 is a block diagram of an embodiment of the apparatus for simulating flight of the present application;
图9是本申请计算设备的实施例框图。9 is a block diagram of an embodiment of a computing device of the present application.
具体实施方式Detailed ways
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请 中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。另外,在不冲突的情况下,下述的实施例及实施例中的特征可以相互组合。The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the drawings in the embodiments of the present application. It is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. Based on this application All other embodiments obtained by those skilled in the art without creative efforts are within the scope of the present application. Further, the features of the following embodiments and examples may be combined with each other without conflict.
飞行器地面站是飞行器系统的指挥中心,用以控制飞行器按照预设航线飞行。以无人机地面站为例,其通常包括遥控器、具有视频显示功能的终端设备(手机、平板、PC等)、电源系统,电台等。地面站可以为飞行器规划航线,当飞行器的控制系统开机后,地面站将航线上传至控制系统,以控制飞行器根据航线进行实际飞行。为了保证飞行器在实际飞行过程中的精确性,可以预先通过地面站模拟器对飞行器的飞行过程进行模拟仿真,以便为飞行器的实际飞行航线提供相对精确参考。The aircraft ground station is the command center of the aircraft system to control the aircraft to fly according to a preset route. Take the unmanned aerial platform as an example, which usually includes a remote controller, a terminal device (mobile phone, tablet, PC, etc.) with a video display function, a power supply system, a radio station, and the like. The ground station can plan the route for the aircraft. When the control system of the aircraft is turned on, the ground station uploads the route to the control system to control the actual flight of the aircraft according to the route. In order to ensure the accuracy of the aircraft during the actual flight, the flight process of the aircraft can be simulated in advance through the ground station simulator to provide a relatively accurate reference for the actual flight path of the aircraft.
地面站模拟器作为一种APP(Application,应用),可以安装在终端设备中,例如,手机、平板电脑、PC(Personal Computer,个人电脑)等。与现有地面站模拟器基于二维平面规划二维航线不同,本申请实施例中的地面站模拟器可以在加载三维模型的基础上,通过人机交互界面规划出三维模拟航线,并且可以基于该三维模拟航线进行模拟飞行。在实际应用中,当用户打开地面站模拟器APP,即可进入用于规划三维模拟航线的人机交互界面,此时根据用户在人机交互界面上的各种操作,可以获得模拟航线中航点的三维信息,并生成三维的模拟航线;进一步还可以在终端设备的显示器上呈现飞行器模型的各种预览画面,以此可以在生成模拟航线时,或者在模拟飞行的过程中实时对航线进行调整。因此,应用本申请实施例可以在获得更为准确的模拟航线的同时,提升模拟航线的规划效率,为飞行器的实际飞行提供更为精确的依据。下面结合附图对本申请实施例进行详细描述。As an APP (Application), the ground station simulator can be installed in a terminal device, such as a mobile phone, a tablet computer, a PC (Personal Computer, a personal computer), and the like. Different from the existing ground station simulator based on the two-dimensional plane planning two-dimensional route, the ground station simulator in the embodiment of the present application can plan a three-dimensional simulation route through the human-machine interaction interface on the basis of loading the three-dimensional model, and can be based on The three-dimensional simulation route is simulated flight. In practical applications, when the user opens the ground station simulator APP, the human-computer interaction interface for planning the three-dimensional simulation route can be entered. At this time, according to the various operations of the user on the human-computer interaction interface, the waypoints in the simulated route can be obtained. 3D information and generate 3D simulation routes; further display various preview images of the aircraft model on the display of the terminal device, so that the route can be adjusted in real time during the generation of the simulated route or during the simulated flight . Therefore, the application of the embodiment of the present application can improve the planning efficiency of the simulated route while obtaining a more accurate simulated route, and provide a more accurate basis for the actual flight of the aircraft. The embodiments of the present application are described in detail below with reference to the accompanying drawings.
参见图1,为本申请生成模拟航线的方法的一个实施例流程图,包括下述步骤:Referring to FIG. 1 , a flowchart of an embodiment of a method for generating a simulated route according to the present application includes the following steps:
步骤101:加载目标场景的三维模型。Step 101: Load a three-dimensional model of the target scene.
本实施例中的三维模型可以采用基于图像的建模方式获得,即在确定了待建模的场景后,可以获得该场景的多个二维图像,然后由这些二维图像建立出该场景的三维几何结构,从而完成三维模型的建立。The three-dimensional model in this embodiment can be obtained by using an image-based modeling method, that is, after the scene to be modeled is determined, a plurality of two-dimensional images of the scene can be obtained, and then the two-dimensional image is used to establish the scene. The 3D geometry is used to complete the creation of the 3D model.
在一个可选的实现方式中,各种场景的三维模型可以预先生成,也可以实时生成;三维模型可以由云端服务器生成,也可以由本地终端设备生成。In an optional implementation manner, the three-dimensional model of various scenarios may be generated in advance or generated in real time; the three-dimensional model may be generated by a cloud server or generated by a local terminal device.
本步骤中,当确定了待规划模拟航线的目标场景后,如果目标场景的三维模型由云端服务器生成,则可以在接收到云端服务器传输的三维模型后,加载该三维模型;如果目标场景的三维模型由本地终端设备生成,则可以在生成该三维模型后,在本地加载该三维模型。 In this step, after the target scenario of the simulated route to be planned is determined, if the three-dimensional model of the target scenario is generated by the cloud server, the three-dimensional model may be loaded after receiving the three-dimensional model transmitted by the cloud server; The model is generated by the local terminal device, and the three-dimensional model can be loaded locally after the three-dimensional model is generated.
步骤102:调用三维渲染引擎对三维模型进行渲染后,输出人机交互界面,人机交互界面中包含用于呈现渲染后的三维画面的画面窗口。Step 102: After calling the three-dimensional rendering engine to render the three-dimensional model, output a human-computer interaction interface, where the human-computer interaction interface includes a picture window for presenting the rendered three-dimensional image.
本步骤中,在加载完三维模型后,可以调用三维渲染引擎对三维模型进行渲染后得到目标场景的三维画面,并输出人机交互界面,其中三维画面可以呈现在人机交互界面的画面窗口中,该人机交互界面中还可以包括:用于设置各种参数的参数设置面板,用于预览画面的预览窗口等。参见图2,为本申请实施例的一个人机交互界面的示意图。In this step, after loading the 3D model, the 3D rendering engine can be called to render the 3D model to obtain a 3D image of the target scene, and output a human-computer interaction interface, wherein the 3D image can be presented in the screen window of the human-computer interaction interface. The human-computer interaction interface may further include: a parameter setting panel for setting various parameters, a preview window for previewing the screen, and the like. 2 is a schematic diagram of a human-computer interaction interface according to an embodiment of the present application.
步骤103:基于人机交互界面获得航点的初始三维信息。Step 103: Obtain initial three-dimensional information of the waypoint based on the human-computer interaction interface.
本步骤中,航点的初始三维信息可以包括:航点的位置信息和航点的高度信息。其中,可以采用如下任一实现方式,基于人机交互界面获得航点的初始三维信息:In this step, the initial three-dimensional information of the waypoint may include: location information of the waypoint and altitude information of the waypoint. Wherein, any of the following implementation manners may be adopted to obtain initial three-dimensional information of the waypoint based on the human-computer interaction interface:
在一个可选的实现方式中,参见图3,示出了通过直接在画面窗口中打点的方式获得航点的初始三维信息的过程:In an alternative implementation, referring to FIG. 3, a process for obtaining initial three-dimensional information of a waypoint by means of striking directly in the picture window is shown:
步骤301:接收模式切换指令。Step 301: Receive a mode switching instruction.
本步骤中的模式切换指令可通过不同的方式触发:The mode switching instructions in this step can be triggered in different ways:
在一种实现方式中,针对画面窗口呈现的三维画面,用户可以通过鼠标、触控板等输入设备对该三维画面进行翻转操作,根据检测到的翻转操作呈现的翻转状态触发相应的模式切换指令。比如,当三维画面翻转到俯视状态时,触发位置编辑指令,当三维画面翻转到平视状态时,触发高度编辑指令;其中,俯视状态和平视状态可以根据翻转操作后三维画面的倾斜角度确定,例如,三维画面的倾斜角小于45度时,为俯视状态,不小于45度时,为平视状态。In an implementation manner, for a three-dimensional picture presented by the picture window, the user may perform a flip operation on the three-dimensional picture by using an input device such as a mouse or a touch pad, and trigger a corresponding mode switching instruction according to the flip state presented by the detected flip operation. . For example, when the three-dimensional image is flipped to the top view state, the position editing instruction is triggered, and when the three-dimensional image is flipped to the head-up state, the height editing instruction is triggered; wherein the top view state and the pan view state can be determined according to the tilt angle of the three-dimensional image after the flip operation, for example, for example When the inclination angle of the three-dimensional screen is less than 45 degrees, it is in a plan view state, and when it is not less than 45 degrees, it is in a head-up state.
在另一种实现方式中,针对参数设置面板中提供的模式切换选项,可以根据用户的选择结果触发相应的模式切换指令,比如,当选择结果为位置选项时,则触发位置编辑指令,当选择结果为高度选项时,则触发高度编辑指令。In another implementation manner, for the mode switching option provided in the parameter setting panel, the corresponding mode switching instruction may be triggered according to the user's selection result, for example, when the selection result is the position option, the position editing instruction is triggered, when selecting When the result is a height option, the height edit command is triggered.
需要说明的是,在步骤102输出人机交互界面后,可以直接根据模式切换指令进入位置编辑模式,或者高度编辑模式;也可以先默认进入位置编辑模式,后续再根据模式切换指令在高度编辑模式和位置模式之间进行切换。对此本申请实施例不进行限制。It should be noted that, after the human-computer interaction interface is output in step 102, the position editing mode or the high-edit mode may be directly entered according to the mode switching instruction; or the position editing mode may be entered first by default, and then the high-definition mode is followed according to the mode switching instruction. Switch between and position mode. The embodiments of the present application are not limited.
步骤302:判断模式切换指令的类型,如果是位置编辑指令,则执行步骤303;如果是高度编辑指令,则执行步骤304。Step 302: Determine the type of the mode switching instruction. If it is a position editing instruction, execute step 303; if it is a height editing instruction, execute step 304.
步骤303:根据位置编辑指令切换到位置编辑模式,通过人机交互界面获得航点的位置信 息,执行步骤305。Step 303: Switch to the location editing mode according to the location editing command, and obtain the location information of the waypoint through the human-computer interaction interface. If yes, go to step 305.
本步骤中,当根据位置编辑指令切换到位置编辑模式下时,可以基于用户在三维画面上的打点操作,生成多个航点。其中,用户可以通过鼠标、触控板等输入设备进行右键点击操作,在获得点击操作对应的点击位置后,确定该点击位置与三维模型的交点,将该交点确定为一个航点;在位置编辑模式下,每个航点的高度为地面高度,依次设置的相邻航点之间通过航线连接。In this step, when switching to the position editing mode according to the position editing command, a plurality of waypoints may be generated based on the user's dot operation on the three-dimensional screen. The user can perform a right-click operation by using an input device such as a mouse or a touchpad. After obtaining the click position corresponding to the click operation, the intersection of the click position and the three-dimensional model is determined, and the intersection is determined as a waypoint; In the mode, the height of each waypoint is the ground height, and the adjacent waypoints set in sequence are connected by a route.
在通过打点操作生成任一航点后,用户可以对该航点进行拖动操作,根据拖动操作的结果确定该航点的目标位置;或者,用户也可以在参数设置面板中设置位置参数,该位置参数对应于航点的目标位置。在确定任一航点的目标位置后,可以获得该目标位置在三维画面中对应的位置信息,该位置信息包括纬度和经度。After generating any waypoint by the dot operation, the user can drag the waypoint and determine the target position of the waypoint according to the result of the drag operation; or the user can also set the position parameter in the parameter setting panel. The position parameter corresponds to the target position of the waypoint. After determining the target position of any waypoint, the corresponding location information of the target location in the three-dimensional picture may be obtained, and the location information includes latitude and longitude.
步骤304:根据高度编辑指令切换到高度编辑模式,通过人机交互界面获得航点的高度信息。Step 304: Switch to the height editing mode according to the height editing command, and obtain the height information of the waypoint through the human-machine interaction interface.
本步骤中,当根据高度编辑指令切换到高度编辑模式下时,可以控制航点执行预设操作,其中预设操作可以包括如下操作:In this step, when switching to the height editing mode according to the height editing command, the waypoint can be controlled to perform a preset operation, wherein the preset operation may include the following operations:
在一个实现方式中,用户可以在人机交互界面的参数设置面板中设置航点的平移高度,在获得该平移高度后,可以控制所有已经设置了位置信息的航点按照该平移高度在三维画面的垂直方向上进行整体移动。In an implementation manner, the user can set the translation height of the waypoint in the parameter setting panel of the human-computer interaction interface, and after obtaining the translation height, can control all the waypoints that have set the position information according to the translation height in the three-dimensional picture. The overall movement in the vertical direction.
在另一个实现方式中,用户可以通过鼠标、触控板等输入设备对任一航点进行拖动操作,并控制该航点按照拖动操作在垂直方向上移动。In another implementation manner, the user can drag any waypoint through an input device such as a mouse or a touchpad, and control the waypoint to move in the vertical direction according to the drag operation.
在控制航点完成预设操作后,可以确定航点在三维画面中的高度信息,该高度信息可以包括表示航点的海拔高度的绝对高度,或者表示航点相对于起飞点高度的相对高度。其中,在获得了航点的绝对高度后,可以获取飞行器模型的起飞点在三维模型上的投影高度,计算航点的绝对高度与该投影高度的差值,得到航点的相对高度。After the preset way is completed by controlling the waypoint, the height information of the waypoint in the three-dimensional picture may be determined, and the height information may include an absolute height indicating the altitude of the waypoint or a relative height of the waypoint relative to the height of the takeoff point. After obtaining the absolute height of the waypoint, the projection height of the takeoff point of the aircraft model on the three-dimensional model can be obtained, and the difference between the absolute height of the waypoint and the projected height is calculated, and the relative height of the waypoint is obtained.
步骤305:保存每个航点的初始三维信息,初始三维信息包括航点的位置信息和高度信息。Step 305: Save initial three-dimensional information of each waypoint, and the initial three-dimensional information includes location information and altitude information of the waypoint.
在另一个可选的实现方式中,参见图4,示出了在控制飞行器模型在三维画面中模拟飞行过程中,通过实时打点的方式获得初始三维信息的过程:In another alternative implementation, referring to FIG. 4, a process for obtaining initial three-dimensional information by real-time dot-dot during the flight simulation of controlling the aircraft model in a three-dimensional picture is shown:
步骤401:根据遥控器发出的控制指令,控制飞行器模型从三维画面中的起飞点开始进行模拟飞行。 Step 401: Control the aircraft model to start a simulated flight from a take-off point in the three-dimensional picture according to a control command issued by the remote controller.
本实施例中的飞行器模型可以包括:用于与三维模型进行交互的动力模型,用于控制飞行器模型飞行姿态的控制模型,以及用于为控制模型提供视觉数据的视觉系统模型。本步骤中,用户可以通过模拟遥控器,或者真实遥控器在三维画面中设置飞行器模型的起飞点,然后向飞行器模型发出控制指令,从而控制飞行器模型从起飞点开始进行模拟飞行。The aircraft model in this embodiment may include a dynamic model for interacting with the three-dimensional model, a control model for controlling the flight attitude of the aircraft model, and a visual system model for providing visual data for the control model. In this step, the user can set the takeoff point of the aircraft model in the three-dimensional picture through the analog remote controller or the real remote controller, and then issue a control command to the aircraft model, thereby controlling the aircraft model to start the simulation flight from the takeoff point.
步骤402:如果在模拟飞行过程中的任一飞行点上接收到控制器发出的航点增加指令,则确定该飞行点为航点,并记录该航点的初始三维信息。Step 402: If the waypoint increase command issued by the controller is received at any flight point during the simulated flight, the flight point is determined to be a waypoint, and the initial three-dimensional information of the waypoint is recorded.
在一个可选的实现方式中,当人机交互界面中包括预览窗口时,在获取到飞行器模型在模拟飞行过程中通过模拟图像传输功能拍摄的图像数据后,可以通过三维渲染引擎对图像数据进行渲染,并将渲染后的模拟画面呈现在预览窗口中,供用户进行实时预览。In an optional implementation manner, when the preview window is included in the human-computer interaction interface, after the image data captured by the simulated image transmission function of the aircraft model during the simulated flight is acquired, the image data may be performed by the three-dimensional rendering engine. Render and render the rendered simulation in the preview window for real-time preview by the user.
在飞行器模型模拟飞行过程中,当用户通过预览窗口确定某个飞行点可以作为航点时,可以通过操作遥控器上的指定按键发出航点增加指令,在收到该航点增加指令后,可以将当前飞行点确定为航点,并且记录该飞行点在三维画面中的位置信息和高度信息,作为新增航点的初始三维信息。During the flight simulation of the aircraft model, when the user determines through the preview window that a certain flight point can be used as a waypoint, the waypoint increase command can be issued by operating a designated button on the remote controller, and after receiving the waypoint increase command, The current flight point is determined as a waypoint, and the position information and height information of the flight point in the three-dimensional picture are recorded as the initial three-dimensional information of the newly added waypoint.
步骤403:保存每个航点的初始三维信息,初始三维信息包括航点的位置信息和高度信息。Step 403: Save initial three-dimensional information of each waypoint, and the initial three-dimensional information includes location information and altitude information of the waypoint.
在一个可选的实现方式中,在飞行器模型的模拟飞行的过程中,如果在某个航点接收到遥控器发出的暂停指令,则可以中断执行模拟飞行,并获得针对该航点的调整后的初始三维信息,然后保存该航点的调整后的初始三维信息。其中,在调整航点的初始三维信息时,可以通过参数设置面板进行调整,也可以通过鼠标、触控板等输入设备在三维画面中拖动航点进行调整,在此不再赘述。In an optional implementation manner, during the simulated flight of the aircraft model, if a pause command issued by the remote controller is received at a certain waypoint, the simulated flight may be interrupted, and the adjusted for the waypoint is obtained. The initial 3D information is then saved to the adjusted initial 3D information of the waypoint. In the adjustment of the initial three-dimensional information of the waypoint, the adjustment may be performed through the parameter setting panel, or the navigation point may be dragged in the three-dimensional image by using an input device such as a mouse or a touchpad, and details are not described herein.
在另一个可选的实现方式中,当在通过遥控器进行航点的打点操作过程中,可以接收遥控器发出的目标航点的选择指令,该目标航点可以为通过打点操作设置的航点中的任一航点,然后控制飞行器模型从目标航点开始,在三维画面中重新执行模拟飞行。In another optional implementation manner, when a waypoint operation of a waypoint is performed by using a remote controller, a selection instruction of a target waypoint issued by the remote controller may be received, and the target waypoint may be a waypoint set by the dot operation. Any of the waypoints, then control the aircraft model to start from the target waypoint and re-execute the simulated flight in the 3D picture.
在另一个可选的实现方式中,参见图5,示出了通过预设的航线模板设置航点,并获得航点的初始三维信息的过程:In another optional implementation, referring to FIG. 5, a process of setting a waypoint through a preset route template and obtaining initial three-dimensional information of the waypoint is illustrated:
步骤501:在画面窗口中加载预设的航线模板。Step 501: Load a preset route template in the picture window.
本实施例中,可以预先设置多个航线模板,每个航线模板对应的初始模拟航线可以具有固定形状,比如长方形、正方形、或者三角形等;然后可以在本地存储每个航线模板的名称与航线模板的对应关系。当用户输入所选择的航线模板的名称后,可以从存储的对应关系中获得与输入的名称对应的航线模板,并可以在画面窗口中加载该航线模板。该航线模板也可 以是由用户自定义设置的。In this embodiment, multiple route templates may be preset, and the initial simulated route corresponding to each route template may have a fixed shape, such as a rectangle, a square, or a triangle, etc., and then the name and route template of each route template may be stored locally. Correspondence. After the user inputs the name of the selected route template, the route template corresponding to the input name may be obtained from the stored correspondence, and the route template may be loaded in the picture window. The route template is also available It is set by the user.
步骤502:根据航线模板生成初始模拟航线,初始模拟航线中包含多个初始航点,每个初始航点的航点信息中包含初始三维信息。Step 502: Generate an initial simulated route according to the route template, where the initial simulated route includes multiple initial waypoints, and the waypoint information of each initial waypoint includes initial three-dimensional information.
在一个可选的实现方式中,可以通过用户在三维画面中的点击操作,或者在参数设置面板中的设置操作,确定初始模拟航线的起飞点和降落点,然后在起飞点和降落点之间,按照初始模拟航线的固定形状生成初始模拟航线。In an optional implementation, the take-off point and the landing point of the initial simulated route can be determined by a user's click operation in the three-dimensional picture or a setting operation in the parameter setting panel, and then between the take-off point and the landing point. The initial simulated route is generated according to the fixed shape of the initial simulated route.
在另一个可选的实现方式中,可以通过用户在三维画面中的点击操作,或者在参数设置面板中的设置操作,确定初始模拟航线的起飞点和长度,然后从起飞点开始,按照初始模拟航线的固定形状生成与模拟航线的长度一致的初始模拟航线。In another optional implementation, the takeoff point and length of the initial simulated route may be determined by a user clicking operation in a three-dimensional picture or a setting operation in a parameter setting panel, and then starting from the takeoff point, according to the initial simulation The fixed shape of the route generates an initial simulated route that is consistent with the length of the simulated route.
步骤503:通过人机交互界面获得针对任一初始航点的修改后的初始三维信息。Step 503: Obtain modified initial three-dimensional information for any initial waypoint through the human-computer interaction interface.
在生成初始模拟航线后,该初始模拟航线中可以按照预设间隔设置多个初始航点,根据每个初始航点在三维画面中的位置可以确定其初始三维信息。本步骤中,可以对多个初始航点中的任一初始航点进行调整,例如,通过拖动操作重新设置该任一初始航点的位置,或者在选中任一初始航点后,在参数设置面板中设置该初始航点的位置,然后根据调整后的初始航点的位置,获得其修改后的初始三维信息。After the initial simulation route is generated, a plurality of initial waypoints may be set according to a preset interval in the initial simulated route, and the initial three-dimensional information may be determined according to the position of each initial waypoint in the three-dimensional picture. In this step, any of the initial waypoints may be adjusted, for example, by dragging to reset the position of any of the initial waypoints, or after selecting any initial waypoints, in the parameters The position of the initial waypoint is set in the setting panel, and then the modified initial three-dimensional information is obtained according to the adjusted initial waypoint position.
步骤504:保存每个航点修改后的初始三维信息,初始三维信息包括位置信息和高度信息。Step 504: Save the modified initial three-dimensional information of each waypoint, and the initial three-dimensional information includes location information and altitude information.
至此,完成对基于人机交互界面获得航点的初始三维信息的集中可选方式的描述。So far, the description of the centralized alternative manner of obtaining the initial three-dimensional information of the waypoint based on the human-computer interaction interface is completed.
步骤104:根据初始三维信息生成模拟航线。Step 104: Generate a simulated route according to the initial three-dimensional information.
本步骤中,可以根据步骤103中得到的初始三维信息获得航点的目标三维信息,并相应保存模拟航线文件,该模拟航线文件可以包括:航点顺序和每个航点的航点信息,航点信息包括航点的目标三维信息、以及航点的属性信息。其中,航点的目标三维信息可以包括:航点的位置信息和高度信息;航点的属性信息可以包括:飞行器飞行到航点时的云台的姿态参数、飞行器的速度参数、飞行器的姿态参数。In this step, the target three-dimensional information of the waypoint may be obtained according to the initial three-dimensional information obtained in step 103, and the simulated route file may be saved correspondingly, and the simulated route file may include: a waypoint order and a waypoint information of each waypoint, The point information includes the target three-dimensional information of the waypoint and the attribute information of the waypoint. The target three-dimensional information of the waypoint may include: location information and altitude information of the waypoint; the attribute information of the waypoint may include: a posture parameter of the pan/tilt when the aircraft flies to the waypoint, a speed parameter of the aircraft, and an attitude parameter of the aircraft. .
在一个可选的实现方式中,如果航点的初始三维信息包括航点的位置信息和绝对高度,则在根据初始三维信息获得航点的目标三维信息时,可以获取飞行器模型的起飞点在三维模型上的投影高度,并计算每个航点的绝对高度与投影高度的差值,该差值即为每个航点相对于起飞点的相对高度,可以将该相对高度确定为目标三维信息中的高度信息。 In an optional implementation manner, if the initial three-dimensional information of the waypoint includes the position information and the absolute height of the waypoint, when the target three-dimensional information of the waypoint is obtained according to the initial three-dimensional information, the takeoff point of the aircraft model can be acquired in three dimensions. The projection height on the model, and calculate the difference between the absolute height of each waypoint and the projected height, which is the relative height of each waypoint relative to the takeoff point, which can be determined as the target three-dimensional information. Height information.
由上述实施例可见,该实施例由于基于三维模型进行模拟航线规划,与现有技术相比,可以规划出包括位置信息和高度信息在内的航点的三维信息,从而获得更为准确的三维模拟航线,并且由于可以避免多次实际飞行操作,因此提升了模拟航线的规划效率。It can be seen from the above embodiment that, according to the simulation of the route planning based on the three-dimensional model, compared with the prior art, the three-dimensional information of the waypoint including the position information and the height information can be planned, thereby obtaining a more accurate three-dimensional image. The route is simulated, and the planning efficiency of the simulated route is improved because multiple actual flight operations can be avoided.
参见图6,为本申请模拟飞行的方法的实施例流程图,该实施例可以应用前述图2所示实施例生成的模拟航线进行模拟飞行,包括如下步骤:6 is a flowchart of an embodiment of a method for simulating flight according to the present application. The embodiment may apply the simulated route generated by the foregoing embodiment shown in FIG. 2 to perform simulated flight, including the following steps:
步骤601:通过参数调节模拟器设置飞行器模型的飞行参数。Step 601: Set flight parameters of the aircraft model by a parameter adjustment simulator.
本步骤中,通过参数调节模拟器可以设置飞行器模型的各种飞行参数,这些飞行参数与飞行器实际飞行过程中需要设置的各种飞行参数一致,可以包括:飞行器模型的云台参数、飞行器模型挂载模拟相机的参数、飞行器模型的GPS参数、姿态参数等。In this step, various flight parameters of the aircraft model can be set by the parameter adjustment simulator. These flight parameters are consistent with various flight parameters that need to be set during the actual flight of the aircraft, and may include: the cloud platform parameters of the aircraft model, and the aircraft model hangs. Parameters of the analog camera, GPS parameters of the aircraft model, attitude parameters, etc.
步骤602:在接收到模拟飞行指令后,控制飞行器模型按照飞行参数在三维画面中执行模拟航线,获得模拟飞行数据。Step 602: After receiving the simulated flight instruction, control the aircraft model to execute the simulated route in the three-dimensional picture according to the flight parameter, and obtain simulated flight data.
在一个可选的实现方式中,可以在模拟航线的执行过程中对模拟航线进行调整,如果在某个航点接收到暂停指令,则可以中断执行模拟航线,并获得针对该航点的调整后的三维信息,然后基于调整后的三维信息生成更新后的模拟航线。基于重新生成的模拟航线,如果接收到目标航点的选择指令,则可以控制飞行器模型从目标航点开始,在三维画面中执行更新后的模拟航线,从而通过实时调整航点提高模拟航线的调整效率。In an optional implementation manner, the simulated route can be adjusted during the execution of the simulated route. If a pause command is received at a certain waypoint, the simulated route can be interrupted and the adjusted for the waypoint can be obtained. The 3D information is then generated based on the adjusted 3D information to generate an updated simulated route. Based on the regenerated analog route, if the selection instruction of the target waypoint is received, the aircraft model can be controlled to start from the target waypoint, and the updated simulated route is executed in the three-dimensional picture, thereby improving the adjustment of the simulated route by adjusting the waypoint in real time. effectiveness.
步骤603:通过三维渲染引擎对模拟飞行数据进行渲染。Step 603: Rendering simulated flight data by using a three-dimensional rendering engine.
步骤604:根据渲染结果在人机交互界面的画面窗口输出模拟飞行画面。Step 604: Output a simulated flight picture in a picture window of the human-computer interaction interface according to the rendering result.
在一个可选的实现方式中,人机交互界面中还可以包括预览窗口,因此在获取到飞行器模型在执行模拟航线过程中通过模拟图像传输功能拍摄的图像数据后,可以通过三维渲染引擎对图像数据进行渲染,并将将渲染后的模拟画面实时呈现在预览窗口中,供用户预览飞行器模型在飞行过程中实时拍摄的模拟画面。In an optional implementation manner, the human-computer interaction interface may further include a preview window, so after acquiring the image data captured by the simulated image transmission function during the execution of the simulated flight path of the aircraft model, the image may be imaged by the three-dimensional rendering engine. The data is rendered, and the rendered simulation image is presented in real time in the preview window for the user to preview the simulated image captured by the aircraft model in real time during flight.
由上述实施例可见,该实施例基于三维模拟航线进行模拟飞行,可以同步获得模拟飞行画面,并可以在模拟飞行过程中实时调整模拟航线,从而为飞行器的实际飞行航线提供更为精确的依据。It can be seen from the above embodiment that the embodiment performs simulation flight based on the three-dimensional simulation route, and the simulated flight picture can be obtained synchronously, and the simulation route can be adjusted in real time during the simulation flight, thereby providing a more accurate basis for the actual flight path of the aircraft.
与前述生成模拟航线的方法,以及模拟飞行的方法实施例相对应,本申请还提供了生成模拟航线的装置、模拟飞行的装置、以及计算设备的实施例。Corresponding to the aforementioned method of generating a simulated route, and a method embodiment of a simulated flight, the present application also provides an embodiment of a device for generating a simulated route, a device for simulating flight, and a computing device.
参见图7,为本申请生成模拟航线的装置的实施例框图: Referring to FIG. 7, a block diagram of an embodiment of an apparatus for generating a simulated route according to the present application is as follows:
该装置包括:加载单元710、渲染单元720、获得单元730和生成单元740。The apparatus includes a loading unit 710, a rendering unit 720, an obtaining unit 730, and a generating unit 740.
其中,加载单元710,用于加载目标场景的三维模型;The loading unit 710 is configured to load a three-dimensional model of the target scene.
渲染单元720,用于调用三维渲染引擎对所述三维模型进行渲染后,输出人机交互界面,所述人机交互界面中包含用于呈现渲染后的三维画面的画面窗口;a rendering unit 720, configured to invoke a three-dimensional rendering engine to render the three-dimensional model, and output a human-computer interaction interface, where the human-computer interaction interface includes a screen window for presenting the rendered three-dimensional image;
获得单元730,用于基于所述人机交互界面获得航点的初始三维信息;The obtaining unit 730 is configured to obtain initial three-dimensional information of a waypoint based on the human-machine interaction interface;
生成单元740,用于根据所述初始三维信息生成模拟航线。The generating unit 740 is configured to generate a simulated route according to the initial three-dimensional information.
在一个可选的实现方式中,所述加载单元710可以包括至少一个下述单元(图7中未示出):In an optional implementation, the loading unit 710 may include at least one of the following units (not shown in FIG. 7):
第一加载子单元,用于在接收到云端服务器生成的目标场景的三维模型后,加载所述三维模型;a first loading subunit, configured to load the three-dimensional model after receiving the three-dimensional model of the target scene generated by the cloud server;
第二加载子单元,用于在通过本地三维重建功能生成目标场景的三维模型后,加载所述三维模型。a second loading subunit, configured to load the three-dimensional model after generating a three-dimensional model of the target scene by the local three-dimensional reconstruction function.
在另一个可选的实现方式中,所述获得单元730可以包括(图7中未示出):In another optional implementation, the obtaining unit 730 may include (not shown in FIG. 7):
模式切换子单元,用于根据模式切换指令控制所述人机交互界面在位置编辑模式和高度编辑模式之间切换;a mode switching subunit, configured to control the human-machine interaction interface to switch between a position editing mode and a high-edit mode according to a mode switching instruction;
位置信息获得子单元,用于当切换到位置编辑模式时,通过所述人机交互界面获得航点的位置信息;a location information obtaining subunit, configured to obtain location information of a waypoint through the human-machine interaction interface when switching to the location editing mode;
高度信息获得子单元,用于当切换到高度编辑模式时,通过所述人机交互界面获得航点的高度信息;a height information obtaining subunit, configured to obtain height information of a waypoint through the human-machine interaction interface when switching to the height editing mode;
第一信息保存子单元,用于保存每个航点的初始三维信息,所述初始三维信息包括所述位置信息和所述高度信息。And a first information saving subunit, configured to save initial three-dimensional information of each waypoint, the initial three-dimensional information including the location information and the height information.
在一个例子中,所述模式切换子单元,可以具体用于根据检测到的所述三维画面的翻转状态获得模式切换指令,当所述三维画面翻转到俯视状态时,切换到位置编辑模式,当所述三维画面翻转到平视状态时,切换到高度编辑模式;或者,根据所述人机交互界面提供的模式切换选项获得模式切换指令,当位置选项被选中时,切换到位置编辑模式,当高度选项被选中时,切换到高度编辑模式。In an example, the mode switching subunit may be specifically configured to obtain a mode switching instruction according to the detected inversion state of the three-dimensional picture, and switch to a position editing mode when the three-dimensional picture is flipped to a top view state. When the three-dimensional picture is flipped to the head-up state, the mode is switched to the height editing mode; or, according to the mode switching option provided by the human-machine interaction interface, the mode switching instruction is obtained, and when the position option is selected, the mode is switched to the position editing mode, when the height is When the option is selected, switch to the height edit mode.
在另一个例子中,所述位置信息获得子单元,可以具体用于基于所述三维画面上的打 点操作,生成多个航点;确定任一航点经过拖动操作后的目标位置,或者在所述人机交互界面的参数设置面板中进行位置参数设置后的目标位置,并获得所述目标位置在所述三维画面中对应的位置信息,所述位置信息包括纬度和经度。In another example, the location information obtaining subunit may be specifically used to perform based on the three-dimensional picture. Point operation, generate a plurality of waypoints; determine a target position after any of the waypoints after the drag operation, or perform a target position after the position parameter setting in the parameter setting panel of the human-computer interaction interface, and obtain the target Corresponding location information in the three-dimensional picture, the location information including latitude and longitude.
在另一个例子中,所述高度信息获得子单元,可以具体用于控制所述航点执行预设操作,并确定所述航点完成预设操作后在所述三维画面中的高度信息。其中,所述控制航点执行预设操作,可以包括:获得在所述人机交互界面的参数设置面板中设置的所述航点的平移高度,并控制所述航点按照所述平移高度在垂直方向移动,或者控制所述航点按照拖动操作在垂直方向上移动。In another example, the height information obtaining sub-unit may be specifically configured to control the waypoint to perform a preset operation, and determine height information in the three-dimensional picture after the waypoint completes the preset operation. The controlling the waypoint to perform the preset operation may include: obtaining a translation height of the waypoint set in the parameter setting panel of the human-machine interaction interface, and controlling the waypoint according to the translation height Move in the vertical direction, or control the waypoint to move in the vertical direction according to the drag operation.
在另一个可选的实现方式中,所述获得单元730也可以包括(图7中未示出):In another optional implementation, the obtaining unit 730 may also include (not shown in FIG. 7):
模拟飞行控制子单元,用于根据遥控器发出的控制指令,控制飞行器模型从所述三维画面中的起飞点开始进行模拟飞行;Simulating a flight control subunit for controlling the aircraft model to perform a simulated flight from a takeoff point in the three-dimensional picture according to a control command issued by the remote controller;
航点增加确定子单元,用于如果在模拟飞行过程中的任一飞行点上接收到所述控制器发出的航点增加指令,则确定所述飞行点为航点,并记录所述航点的初始三维信息;a waypoint increase determination subunit for determining that the flight point is a waypoint if the waypoint increase command issued by the controller is received at any flight point during the simulated flight, and recording the waypoint Initial three-dimensional information;
第二信息保存子单元,用于保存每个航点的初始三维信息,所述初始三维信息包括航点的位置信息和高度信息。The second information saving subunit is configured to save initial three-dimensional information of each waypoint, where the initial three-dimensional information includes location information and altitude information of the waypoint.
在一个例子中,所述人机交互界面中还可以包括预览窗口,所述渲染单元720,还可以用于获取所述飞行器模型在所述模拟飞行过程中拍摄的图像数据,通过所述三维渲染引擎对所述图像数据进行渲染,并将渲染后的模拟画面呈现在所述预览窗口。In an example, the human-computer interaction interface may further include a preview window, and the rendering unit 720 may be further configured to acquire image data captured by the aircraft model during the simulated flight, by using the three-dimensional rendering. The engine renders the image data and renders the rendered simulated picture in the preview window.
在另一个例子中,所述模拟飞行控制子单元,还可以用于在所述模拟飞行的过程中,如果在某个航点接收到暂停指令,则中断执行所述模拟飞行,获得针对所述航点的调整后的初始三维信息;In another example, the simulated flight control subunit may be further configured to interrupt execution of the simulated flight if a pause command is received at a certain waypoint during the simulated flight, obtaining Adjusted initial three-dimensional information of the waypoint;
所述第二信息保存子单元,还可以用于保存所述航点的调整后的初始三维信息The second information saving subunit may further be configured to save the adjusted initial three-dimensional information of the waypoint
在另一个例子中,所述模拟飞行控制子单元,还可以用于接收到目标航点的选择指令,所述目标航点为通过所述航点增加指令确定的航点中的任一航点,控制所述飞行器模型从所述目标航点开始,在所述三维画面中执行所述模拟飞行。In another example, the simulated flight control sub-unit may be further configured to receive a selection instruction of a target waypoint, where the target waypoint is any one of the waypoints determined by the waypoint increase command. Controlling the aircraft model from the target waypoint, performing the simulated flight in the three-dimensional picture.
在另一个可选的实现方式中,所述获得单元730还可以包括(图7中未示出):In another optional implementation manner, the obtaining unit 730 may further include (not shown in FIG. 7):
航线模板加载子单元,用于在所述画面窗口中加载预设的航线模板;a route template loading subunit, configured to load a preset route template in the picture window;
初始航线生成子单元,用于根据所述航线模板生成初始模拟航线,所述初始模拟航线 中包含多个初始航点,每个初始航点的航点信息中包含初始三维信息;An initial route generation subunit, configured to generate an initial simulated route according to the route template, where the initial simulated route The method includes a plurality of initial waypoints, and the waypoint information of each initial waypoint includes initial three-dimensional information;
三维信息获得子单元,用于通过所述人机交互界面获得针对任一初始航点的修改后的初始三维信息;a three-dimensional information obtaining subunit, configured to obtain modified initial three-dimensional information for any initial waypoint through the human-computer interaction interface;
第三信息保存子单元,用于保存每个航点修改后的初始三维信息,所述初始三维信息包括位置信息和高度信息。The third information saving subunit is configured to save the modified three-dimensional information of each waypoint, the initial three-dimensional information including location information and height information.
在一个例子中,每个航线模板对应的初始模拟航线可以具有固定形状;所述初始航线生成子单元,可以具体用于确定初始航线的起飞点和降落点,根据所述起飞点和降落点,按照所述初始模拟航线的固定形状生成初始模拟航线,或者确定初始模拟航线的起飞点和长度,根据所述起飞点和长度,按照所述初始模拟航线的固定形状生成初始模拟航线。In an example, the initial simulated route corresponding to each route template may have a fixed shape; the initial route generation subunit may be specifically configured to determine a takeoff point and a landing point of the initial route, according to the takeoff point and the landing point, Generating an initial simulated route according to the fixed shape of the initial simulated route, or determining a takeoff point and length of the initial simulated route, and generating an initial simulated route according to the fixed shape of the initial simulated route according to the takeoff point and length.
在另一个可选的实现方式中,所述高度信息可以包括:用于表示所述航点的海拔高度的绝对高度,或者,用于表示所述航点相对于起飞点高度的相对高度。In another optional implementation manner, the height information may include: an absolute height for indicating an altitude of the waypoint, or a relative height of the waypoint relative to a takeoff point height.
在另一个可选的实现方式中,所述生成单元740可以包括(图7中未示出):In another optional implementation, the generating unit 740 can include (not shown in FIG. 7):
目标信息获得子单元,用于根据所述初始三维信息获得航点的目标三维信息;a target information obtaining subunit, configured to obtain target three-dimensional information of a waypoint according to the initial three-dimensional information;
模拟航线保存子单元,用于保存模拟航线文件,所述模拟航线文件中包括:航点顺序和每个航点的航点信息;所述航点信息包括所述航点的目标三维信息、以及航点的属性信息;The simulated route save subunit is configured to save the simulated route file, where the simulated route file includes: a waypoint sequence and waypoint information of each waypoint; the waypoint information includes target three-dimensional information of the waypoint, and Attribute information of waypoints;
其中,所述航点的目标三维信息包括:所述航点的位置信息和高度信息;The target three-dimensional information of the waypoint includes: location information and altitude information of the waypoint;
所述航点的属性信息包括:飞行器飞行到所述航点时的云台的姿态参数、飞行器的速度参数、飞行器的姿态。The attribute information of the waypoint includes: a posture parameter of the pan/tilt when the aircraft flies to the waypoint, a speed parameter of the aircraft, and a posture of the aircraft.
在一个例子中,如果航点的初始三维信息包括:航点的位置信息和绝对高度;相应的,目标信息获得子单元,可以具体用于获取飞行器模型的起飞点在所述三维模型上的投影高度,将每个航点的绝对高度与所述投影高度的差值,确定为每个航点的高度信息。In an example, if the initial three-dimensional information of the waypoint includes: location information of the waypoint and an absolute height; correspondingly, the target information obtaining subunit may be specifically used to acquire a projection of the takeoff point of the aircraft model on the three-dimensional model. Height, the difference between the absolute height of each waypoint and the projected height is determined as the height information of each waypoint.
在另一个例子中,所述人机交互界面中还包括预览窗口;所述渲染单元720,还可以用于当任一航点的航点信息确定后,获取飞行器模型在三维画面中基于所述航点信息拍摄的图像数据,通过所述三维渲染引擎对所述图像数据进行渲染,并将渲染后的模拟画面呈现在所述预览窗口。In another example, the human-computer interaction interface further includes a preview window. The rendering unit 720 is further configured to: when the waypoint information of any waypoint is determined, acquire the aircraft model based on the three-dimensional image. The image data captured by the waypoint information is rendered by the three-dimensional rendering engine, and the rendered simulated image is presented in the preview window.
参见图8,为本申请模拟飞行的装置的实施例框图,该装置可以应用如图7所示装置生成的模拟航线进行模拟飞行:Referring to FIG. 8, a block diagram of an embodiment of a device for simulating flight of the present application can be simulated flight using the simulated route generated by the device shown in FIG. 7:
该装置包括:设置单元810、控制单元820、渲染单元830和输出单元840。 The apparatus includes a setting unit 810, a control unit 820, a rendering unit 830, and an output unit 840.
其中,所述设置单元810,用于通过参数调节模拟器设置飞行器模型的飞行参数;The setting unit 810 is configured to set flight parameters of the aircraft model by using a parameter adjustment simulator;
控制单元820,用于在接收到模拟飞行指令后,控制所述飞行器模型按照所述飞行参数在三维画面中执行所述模拟航线,获得模拟飞行数据;The control unit 820 is configured to, after receiving the simulated flight instruction, control the aircraft model to execute the simulated route in a three-dimensional picture according to the flight parameter, to obtain simulated flight data;
渲染单元830,用于通过三维渲染引擎对所述模拟飞行数据进行渲染;a rendering unit 830, configured to render the simulated flight data by using a three-dimensional rendering engine;
输出单元840,用于根据渲染结果在人机交互界面的画面窗口输出模拟飞行画面。The output unit 840 is configured to output a simulated flight picture in a picture window of the human-machine interaction interface according to the rendering result.
在一个可选的实现方式中,所述装置还可以包括(图8中未示出):In an alternative implementation, the apparatus may also include (not shown in FIG. 8):
中断单元,用于在所述飞行器模型执行模拟航线的过程中,如果在某个航点接收到暂停指令,则中断执行所述模拟航线;An interruption unit, configured to interrupt execution of the simulated route if a pause command is received at a certain waypoint during execution of the simulated route by the aircraft model;
获得单元,用于获得针对所述航点的调整后的三维信息;An obtaining unit, configured to obtain adjusted three-dimensional information for the waypoint;
生成单元,用于基于调整后的三维信息生成更新后的模拟航线。And a generating unit, configured to generate an updated simulated route based on the adjusted three-dimensional information.
在另一个可选的实现方式中,所述装置还可以包括(图8中未示出):In another optional implementation, the apparatus may further include (not shown in FIG. 8):
接收单元,用于在重新生成模拟航线后,接收到目标航点的选择指令;a receiving unit, configured to receive a selection instruction of a target waypoint after regenerating the simulated route;
所述控制单元820,还可以用于控制所述飞行器模型从所述目标航点开始,在所述三维画面中执行所述更新后的模拟航线。The control unit 820 may be further configured to control the aircraft model to start from the target waypoint, and execute the updated simulated route in the three-dimensional picture.
在另一个可选的实现方式中,所述飞行参数可以包括:飞行器模型的云台参数、飞行器模型挂载模拟相机的参数、飞行器模型的GPS参数、姿态参数。In another optional implementation manner, the flight parameters may include: a cloud platform parameter of the aircraft model, a parameter of the aircraft model mounting analog camera, a GPS parameter of the aircraft model, and a posture parameter.
参见图9,为本申请计算设备的实施例示意图,该计算设备可以具有如下通用结构,包括:通过内部总线910连接的存储器920、处理器930和外部接口940。其中,存储器920上可以存储不同的控制逻辑对应的机器可读指令,相应的,处理器930可以读取存储器920上的机器可读指令,执行不同的操作。9 is a schematic diagram of an embodiment of a computing device of the present application. The computing device may have the following general structure, including: a memory 920 connected through an internal bus 910, a processor 930, and an external interface 940. The memory 920 can store machine readable instructions corresponding to different control logics. Accordingly, the processor 930 can read machine readable instructions on the memory 920 to perform different operations.
在本申请的一个实现方式中:In one implementation of the present application:
所述存储器920,用于存储获得飞行模拟数据的控制逻辑对应的机器可读指令;The memory 920 is configured to store machine readable instructions corresponding to control logic for obtaining flight simulation data;
所述处理器930,用于读取所述存储器920上的所述机器可读指令,并执行所述指令以实现如下操作:The processor 930 is configured to read the machine readable instructions on the memory 920 and execute the instructions to implement the following operations:
加载目标场景的三维模型;Loading a three-dimensional model of the target scene;
调用三维渲染引擎对所述三维模型进行渲染后,输出人机交互界面,所述人机交互界面中包含用于呈现渲染后的三维画面的画面窗口; After the 3D rendering engine is invoked to render the 3D model, a human-computer interaction interface is output, where the human-computer interaction interface includes a screen window for presenting the rendered three-dimensional image;
基于所述人机交互界面获得航点的初始三维信息;Obtaining initial three-dimensional information of a waypoint based on the human-computer interaction interface;
根据所述初始三维信息生成模拟航线。A simulated route is generated based on the initial three-dimensional information.
在一个可选的例子中,所述处理器930,具体用于执行在接收到云端服务器生成的目标场景的三维模型后,加载所述三维模型;或者,在通过本地三维重建功能生成目标场景的三维模型后,加载所述三维模型。In an optional example, the processor 930 is specifically configured to perform loading the three-dimensional model after receiving the three-dimensional model of the target scene generated by the cloud server; or generating the target scene by using the local three-dimensional reconstruction function. After the 3D model, the 3D model is loaded.
在另一个可选的例子中,所述处理器930,具体用于执行根据模式切换指令控制所述人机交互界面在位置编辑模式和高度编辑模式之间切换;当切换到位置编辑模式时,通过所述人机交互界面获得航点的位置信息;当切换到高度编辑模式时,通过所述人机交互界面获得航点的高度信息;并保存每个航点的初始三维信息,所述初始三维信息包括所述位置信息和所述高度信息。In another optional example, the processor 930 is specifically configured to perform, according to the mode switching instruction, controlling the human-machine interaction interface to switch between a position editing mode and a height editing mode; when switching to the position editing mode, Obtaining location information of the waypoint through the human-computer interaction interface; obtaining the height information of the waypoint through the human-machine interaction interface when switching to the high-edit mode; and saving initial three-dimensional information of each waypoint, the initial The three-dimensional information includes the location information and the height information.
在另一个可选的例子中,所述处理器930,具体用于执行根据检测到的所述三维画面的翻转状态获得模式切换指令,当所述三维画面翻转到俯视状态时,切换到位置编辑模式,当所述三维画面翻转到平视状态时,切换到高度编辑模式;或者,根据所述人机交互界面提供的模式切换选项获得模式切换指令,当位置选项被选中时,切换到位置编辑模式,当高度选项被选中时,切换到高度编辑模式。In another optional example, the processor 930 is specifically configured to: obtain a mode switching instruction according to the detected inversion state of the three-dimensional picture, and switch to position editing when the three-dimensional picture is flipped to a top view state. a mode of switching to a height editing mode when the three-dimensional screen is flipped to a head-up state; or obtaining a mode switching instruction according to a mode switching option provided by the human-machine interaction interface, and switching to a position editing mode when the location option is selected When the height option is selected, switch to the height edit mode.
在另一个可选的例子中,所述处理器930,具体用于执行基于所述三维画面上的打点操作,生成多个航点;确定任一航点经过拖动操作后的目标位置,或者在所述人机交互界面的参数设置面板中进行位置参数设置后的目标位置;获得所述目标位置在所述三维画面中对应的位置信息,所述位置信息包括纬度和经度。In another optional example, the processor 930 is configured to perform, according to the striking operation on the three-dimensional picture, generate a plurality of waypoints; determine a target position of any waypoint after the drag operation, or Performing a target position after the position parameter setting in the parameter setting panel of the human-computer interaction interface; obtaining position information corresponding to the target position in the three-dimensional picture, the position information including latitude and longitude.
在另一个可选的例子中,所述处理器930,具体用于执行控制所述航点执行预设操作;确定所述航点完成预设操作后在所述三维画面中的高度信息。In another optional example, the processor 930 is specifically configured to perform control of the waypoint to perform a preset operation; and determine height information in the three-dimensional picture after the waypoint completes the preset operation.
在另一个可选的例子中,所述处理器930,具体用于执行获得在所述人机交互界面的参数设置面板中设置的所述航点的平移高度,并控制所述航点按照所述平移高度在垂直方向移动;或者,控制所述航点按照拖动操作在垂直方向上移动。In another optional example, the processor 930 is specifically configured to perform obtaining a translation height of the waypoint set in a parameter setting panel of the human-machine interaction interface, and control the waypoint according to the The translation height is moved in the vertical direction; or, the waypoint is controlled to move in the vertical direction according to the drag operation.
在另一个可选的例子中,所述处理器930,具体用于执行根据遥控器发出的控制指令,控制飞行器模型从所述三维画面中的起飞点开始进行模拟飞行;如果在模拟飞行过程中的任一飞行点上接收到所述控制器发出的航点增加指令,则确定所述飞行点为航点,并记录所述航点的初始三维信息;并保存每个航点的初始三维信息,所述初始三维信息包括航点的位置信息和高度信息。 In another optional example, the processor 930 is specifically configured to execute, according to a control command issued by the remote controller, control the aircraft model to start a simulated flight from a take-off point in the three-dimensional picture; if during the simulated flight Receiving a waypoint increase command issued by the controller at any flight point, determining that the flight point is a waypoint, and recording initial three-dimensional information of the waypoint; and saving initial three-dimensional information of each waypoint The initial three-dimensional information includes location information and altitude information of the waypoint.
在另一个可选的例子中,所述处理器930,具体用于执行获取所述飞行器模型在所述模拟飞行过程中拍摄的图像数据;通过所述三维渲染引擎对所述图像数据进行渲染;将渲染后的模拟画面呈现在所述预览窗口。In another optional example, the processor 930 is specifically configured to perform acquiring image data captured by the aircraft model during the simulated flight; and rendering the image data by using the three-dimensional rendering engine; The rendered simulated picture is rendered in the preview window.
在另一个可选的例子中,所述处理器930,还用于执行在所述模拟飞行的过程中,如果在某个航点接收到暂停指令,则中断执行所述模拟飞行;获得针对所述航点的调整后的初始三维信息;保存所述航点的调整后的初始三维信息。In another optional example, the processor 930 is further configured to perform, during the simulated flight, if the pause instruction is received at a certain waypoint, interrupting performing the simulated flight; The adjusted initial three-dimensional information of the waypoint is stored; and the adjusted initial three-dimensional information of the waypoint is saved.
在另一个可选的例子中,所述处理器930,还用于执行接收到目标航点的选择指令,所述目标航点为通过所述航点增加指令确定的航点中的任一航点;控制所述飞行器模型从所述目标航点开始,在所述三维画面中执行所述模拟飞行。In another optional example, the processor 930 is further configured to perform a selection instruction of receiving a target waypoint, where the target waypoint is any one of the waypoints determined by the waypoint increase instruction. Pointing; controlling the aircraft model to start from the target waypoint, performing the simulated flight in the three-dimensional picture.
在另一个可选的例子中,所述处理器930,具体用于执行在所述画面窗口中加载预设的航线模板;根据所述航线模板生成初始模拟航线,所述初始模拟航线中包含多个初始航点,每个初始航点的航点信息中包含初始三维信息;通过所述人机交互界面获得针对任一初始航点的修改后的初始三维信息;保存每个航点修改后的初始三维信息,所述初始三维信息包括位置信息和高度信息。In another optional example, the processor 930 is specifically configured to perform loading a preset route template in the picture window, and generate an initial simulated route according to the route template, where the initial simulated route includes multiple The initial waypoints, the waypoint information of each initial waypoint contains initial three-dimensional information; the modified initial three-dimensional information for any initial waypoint is obtained through the human-computer interaction interface; and the modified each waypoint is saved Initial three-dimensional information, the initial three-dimensional information including location information and height information.
在另一个可选的例子中,所述处理器930,具体用于执行确定初始模拟航线的起飞点和降落点,根据所述起飞点和降落点,按照所述初始模拟航线的固定形状生成初始模拟航线;或者,确定初始模拟航线的起飞点和长度,根据所述起飞点和长度,按照所述初始模拟航线的固定形状生成初始模拟航线。In another optional example, the processor 930 is specifically configured to perform a determination of a take-off point and a landing point of an initial simulated route, and generate an initial shape according to the fixed shape of the initial simulated route according to the take-off point and the landing point. Simulating the route; or determining the takeoff point and length of the initial simulated route, and generating an initial simulated route according to the fixed shape of the initial simulated route according to the takeoff point and length.
在另一个可选的例子中,所述高度信息包括:用于表示所述航点的海拔高度的绝对高度,或者,用于表示所述航点相对于起飞点高度的相对高度。In another optional example, the height information includes an absolute height for indicating an altitude of the waypoint or a relative height of the waypoint relative to a height of the takeoff point.
在另一个可选的例子中,所述处理器930,具体用于执行根据所述初始三维信息获得航点的目标三维信息;保存模拟航线文件,所述模拟航线文件中包括:航点顺序和每个航点的航点信息;所述航点信息包括所述航点的目标三维信息、以及航点的属性信息;In another optional example, the processor 930 is specifically configured to perform target three-dimensional information for obtaining a waypoint according to the initial three-dimensional information; and save a simulated route file, where the simulated route file includes: a waypoint sequence and Waypoint information of each waypoint; the waypoint information includes target three-dimensional information of the waypoint, and attribute information of the waypoint;
其中,所述航点的目标三维信息包括:所述航点的位置信息和高度信息;The target three-dimensional information of the waypoint includes: location information and altitude information of the waypoint;
所述航点的属性信息包括:飞行器飞行到所述航点时的云台的姿态参数、飞行器的速度参数、飞行器的姿态参数。The attribute information of the waypoint includes: a posture parameter of the pan/tilt when the aircraft flies to the waypoint, a speed parameter of the aircraft, and an attitude parameter of the aircraft.
在另一个可选的例子中,所述航点的初始三维信息包括:航点的位置信息和绝对高度;In another optional example, the initial three-dimensional information of the waypoint includes: location information of the waypoint and an absolute height;
所述处理器930,具体用于执行获取飞行器模型的起飞点在所述三维模型上的投影高 度;将每个航点的绝对高度与所述投影高度的差值,确定为每个航点的高度信息。The processor 930 is specifically configured to perform a high projection of the takeoff point of the acquiring aircraft model on the three-dimensional model Degree; the difference between the absolute height of each waypoint and the projected height is determined as the height information of each waypoint.
在另一个可选的例子中,所述人机交互界面中还包括预览窗口;所述处理器930,还用于执行当任一航点的航点信息确定后,获取飞行器模型在三维画面中基于所述航点信息拍摄的图像数据;通过所述三维渲染引擎对所述图像数据进行渲染;将渲染后的模拟画面呈现在所述预览窗口。In another optional example, the human-computer interaction interface further includes a preview window. The processor 930 is further configured to: when the waypoint information of any waypoint is determined, acquire the aircraft model in the three-dimensional image. Image data captured based on the waypoint information; rendering the image data by the three-dimensional rendering engine; presenting the rendered simulated image in the preview window.
在本申请的另一个实现方式中:In another implementation of the present application:
所述存储器920,用于存储模拟飞行的控制逻辑对应的机器可读指令,所述模拟飞行的控制逻辑对应的模拟航线为前述计算设备生成的模拟航线;The memory 920 is configured to store machine readable instructions corresponding to the control logic of the simulated flight, and the simulated route corresponding to the control logic of the simulated flight is an analog route generated by the foregoing computing device;
所述处理器930,用于读取所述存储器上的所述机器可读指令,并执行所述指令以实现如下操作:The processor 930 is configured to read the machine readable instructions on the memory and execute the instructions to:
通过参数调节模拟器设置飞行器模型的飞行参数;Setting the flight parameters of the aircraft model through the parameter adjustment simulator;
在接收到模拟飞行指令后,控制所述飞行器模型按照所述飞行参数在三维画面中执行所述模拟航线,获得模拟飞行数据;After receiving the simulated flight instruction, controlling the aircraft model to execute the simulated route in a three-dimensional picture according to the flight parameter to obtain simulated flight data;
通过三维渲染引擎对所述模拟飞行数据进行渲染;Rendering the simulated flight data by a three-dimensional rendering engine;
根据渲染结果在人机交互界面的画面窗口输出模拟飞行画面。The simulated flight picture is output in the picture window of the human-computer interaction interface according to the rendering result.
在一个例子中,所述处理器930,还用于执行在所述飞行器模型执行模拟航线的过程中,如果在某个航点接收到暂停指令,则中断执行所述模拟航线;获得针对所述航点的调整后的三维信息;基于调整后的三维信息生成更新后的模拟航线。In one example, the processor 930 is further configured to perform execution of the simulated route during the execution of the simulated route of the aircraft model, if the suspension instruction is received at a certain waypoint, interrupting execution of the simulated route; The adjusted three-dimensional information of the waypoint; generating an updated simulated route based on the adjusted three-dimensional information.
在另一个例子中,所述处理器930,还用于执行在重新生成模拟航线后,接收到目标航点的选择指令;控制所述飞行器模型从所述目标航点开始,在所述三维画面中执行所述更新后的模拟航线。In another example, the processor 930 is further configured to perform a selection instruction of receiving a target waypoint after regenerating the simulated route; controlling the aircraft model to start from the target waypoint in the three-dimensional picture The updated simulated route is executed in the middle.
在另一个例子中,所述飞行参数包括:飞行器模型的云台参数、飞行器模型挂载模拟相机的参数、飞行器模型的GPS参数、姿态参数。In another example, the flight parameters include: a pan/tilt parameter of the aircraft model, a parameter of the aircraft model mount analog camera, a GPS parameter of the aircraft model, and a pose parameter.
本申请实施例还提供一种计算机可读存储介质,其上存储有计算机程序,所述程序被执行时实现如下操作:The embodiment of the present application further provides a computer readable storage medium, where a computer program is stored, and when the program is executed, the following operations are implemented:
加载目标场景的三维模型;Loading a three-dimensional model of the target scene;
调用三维渲染引擎对所述三维模型进行渲染后,输出人机交互界面,所述人机交互界 面中包含用于呈现渲染后的三维画面的画面窗口;After the 3D rendering engine is called to render the 3D model, a human-computer interaction interface is output, and the human-computer interaction boundary The facet includes a picture window for rendering the rendered three-dimensional picture;
基于所述人机交互界面获得航点的初始三维信息;Obtaining initial three-dimensional information of a waypoint based on the human-computer interaction interface;
根据所述初始三维信息生成模拟航线。A simulated route is generated based on the initial three-dimensional information.
本申请实施例还提供另一种计算机可读存储介质,其上存储有计算机程序,所述程序被执行时实现如下操作:The embodiment of the present application further provides another computer readable storage medium, on which a computer program is stored, and when the program is executed, the following operations are implemented:
通过参数调节模拟器设置飞行器模型的飞行参数;Setting the flight parameters of the aircraft model through the parameter adjustment simulator;
在接收到模拟飞行指令后,控制所述飞行器模型按照所述飞行参数在三维画面中执行模拟航线,获得模拟飞行数据,所述模拟航线为执行如权利要求45所述计算机可读存储介质上的程序生成的模拟航线;After receiving the simulated flight instruction, controlling the aircraft model to perform a simulated flight route in a three-dimensional picture according to the flight parameter, and obtaining simulated flight data, the simulated flight path being performed on the computer readable storage medium according to claim 45 Simulated route generated by the program;
通过三维渲染引擎对所述模拟飞行数据进行渲染;Rendering the simulated flight data by a three-dimensional rendering engine;
根据渲染结果在人机交互界面的画面窗口输出模拟飞行画面。The simulated flight picture is output in the picture window of the human-computer interaction interface according to the rendering result.
对于装置实施例而言,由于其基本对应于方法实施例,所以相关之处参见方法实施例的部分说明即可。以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性劳动的情况下,即可以理解并实施。For the device embodiment, since it basically corresponds to the method embodiment, reference may be made to the partial description of the method embodiment. The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without any creative effort.
需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that, in this context, relational terms such as first and second are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply such entities or operations. There is any such actual relationship or order between them. The terms "including", "comprising" or "comprising" or "comprising" are intended to include a non-exclusive inclusion, such that a process, method, article, or device that comprises a plurality of elements includes not only those elements but also other items not specifically listed Elements, or elements that are inherent to such a process, method, item, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.
本说明书中描述的主题及功能操作的实施例可以在以下中实现:数字电子电路、有形体现的计算机软件或固件、包括本说明书中公开的结构及其结构性等同物的计算机硬件、或者它们中的一个或多个的组合。本说明书中描述的主题的实施例可以实现为一个或多个计算机程序,即编码在有形非暂时性程序载体上以被数据处理装置执行或控制数据处理装置的操 作的计算机程序指令中的一个或多个模块。可替代地或附加地,程序指令可以被编码在人工生成的传播信号上,例如机器生成的电、光或电磁信号,该信号被生成以将信息编码并传输到合适的接收机装置以由数据处理装置执行。计算机存储介质可以是机器可读存储设备、机器可读存储基板、随机或串行存取存储器设备、或它们中的一个或多个的组合。Embodiments of the subject matter and functional operations described in this specification can be implemented in the following: digital electronic circuits, tangible embodied computer software or firmware, computer hardware including the structures disclosed in the specification and their structural equivalents, or One or more combinations. Embodiments of the subject matter described in this specification can be implemented as one or more computer programs, i.e., encoded on a tangible, non-transitory program carrier, to be executed by or controlled by a data processing device. One or more modules in a computer program instruction. Alternatively or additionally, the program instructions may be encoded on an artificially generated propagating signal, such as a machine-generated electrical, optical or electromagnetic signal that is generated to encode and transmit the information to a suitable receiver device for data The processing device executes. The computer storage medium can be a machine readable storage device, a machine readable storage substrate, a random or serial access memory device, or a combination of one or more of them.
本说明书中描述的处理及逻辑流程可以由执行一个或多个计算机程序的一个或多个可编程计算机执行,以通过根据输入数据进行操作并生成输出来执行相应的功能。所述处理及逻辑流程还可以由专用逻辑电路-例如FPGA(现场可编程门阵列)或ASIC(专用集成电路)来执行,并且装置也可以实现为专用逻辑电路。The processes and logic flows described in this specification can be performed by one or more programmable computers executing one or more computer programs to perform the corresponding functions by operating in accordance with input data and generating an output. The processing and logic flow may also be performed by dedicated logic circuitry, such as an FPGA (Field Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit), and the apparatus may also be implemented as dedicated logic circuitry.
适合用于执行计算机程序的计算机包括,例如通用和/或专用微处理器,或任何其他类型的中央处理单元。通常,中央处理单元将从只读存储器和/或随机存取存储器接收指令和数据。计算机的基本组件包括用于实施或执行指令的中央处理单元以及用于存储指令和数据的一个或多个存储器设备。通常,计算机还将包括用于存储数据的一个或多个大容量存储设备,例如磁盘、磁光盘或光盘等,或者计算机将可操作地与此大容量存储设备耦接以从其接收数据或向其传送数据,抑或两种情况兼而有之。然而,计算机不是必须具有这样的设备。此外,计算机可以嵌入在另一设备中,例如移动电话、个人数字助理(PDA)、移动音频或视频播放器、游戏操纵台、全球定位系统(GPS)接收机、或例如通用串行总线(USB)闪存驱动器的便携式存储设备,仅举几例。Computers suitable for the execution of a computer program include, for example, a general purpose and/or special purpose microprocessor, or any other type of central processing unit. Typically, the central processing unit will receive instructions and data from a read only memory and/or a random access memory. The basic components of a computer include a central processing unit for implementing or executing instructions and one or more memory devices for storing instructions and data. Typically, the computer will also include one or more mass storage devices for storing data, such as a magnetic disk, magneto-optical disk or optical disk, or the like, or the computer will be operatively coupled to the mass storage device for receiving data or It transmits data, or both. However, the computer does not have to have such a device. In addition, the computer can be embedded in another device, such as a mobile phone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a global positioning system (GPS) receiver, or, for example, a universal serial bus (USB) ) Portable storage devices for flash drives, to name a few.
适合于存储计算机程序指令和数据的计算机可读介质包括所有形式的非易失性存储器、媒介和存储器设备,例如包括半导体存储器设备(例如EPROM、EEPROM和闪存设备)、磁盘(例如内部硬盘或可移动盘)、磁光盘以及CD ROM和DVD-ROM盘。处理器和存储器可由专用逻辑电路补充或并入专用逻辑电路中。Computer readable media suitable for storing computer program instructions and data include all forms of nonvolatile memory, media and memory devices including, for example, semiconductor memory devices (eg, EPROM, EEPROM, and flash memory devices), magnetic disks (eg, internal hard drives or Mobile disk), magneto-optical disks, and CD ROM and DVD-ROM disks. The processor and memory may be supplemented by, or incorporated in, special purpose logic circuitry.
虽然本说明书包含许多具体实施细节,但是这些不应被解释为限制任何发明的范围或所要求保护的范围,而是主要用于描述特定发明的具体实施例的特征。本说明书内在多个实施例中描述的某些特征也可以在单个实施例中被组合实施。另一方面,在单个实施例中描述的各种特征也可以在多个实施例中分开实施或以任何合适的子组合来实施。此外,虽然特征可以如上所述在某些组合中起作用并且甚至最初如此要求保护,但是来自所要求保护的组合中的一个或多个特征在一些情况下可以从该组合中去除,并且所要求保护的组合可以指向子组合或子组合的变型。The description contains many specific implementation details, which are not intended to limit the scope of the invention or the scope of the claimed invention, but are mainly used to describe the features of the specific embodiments of the invention. Certain features that are described in the various embodiments in this specification can also be implemented in combination in a single embodiment. In another aspect, the various features described in a single embodiment can also be implemented separately in various embodiments or in any suitable sub-combination. Moreover, although features may function in certain combinations as described above and even initially claimed, one or more features from the claimed combination may be removed from the combination in some cases and are required The combination of protections can point to a variant of a sub-combination or sub-combination.
类似地,虽然在附图中以特定顺序描绘了操作,但是这不应被理解为要求这些操作以所示的特定顺序执行或顺次执行、或者要求所有例示的操作被执行,以实现期望的结果。在 某些情况下,多任务和并行处理可能是有利的。此外,上述实施例中的各种系统模块和组件的分离不应被理解为在所有实施例中均需要这样的分离,并且应当理解,所描述的程序组件和系统通常可以一起集成在单个软件产品中,或者封装成多个软件产品。Similarly, although the operations are depicted in a particular order in the drawings, this should not be construed as requiring that the operations are performed in the particular order shown or in the sequence, or that all illustrated operations are performed to achieve the desired. result. In In some cases, multitasking and parallel processing may be advantageous. Moreover, the separation of various system modules and components in the above-described embodiments should not be understood as requiring such separation in all embodiments, and it should be understood that the described program components and systems can generally be integrated together in a single software product. Medium, or packaged into multiple software products.
由此,主题的特定实施例已被描述。其他实施例在所附权利要求书的范围以内。在某些情况下,权利要求书中记载的动作可以以不同的顺序执行并且仍实现期望的结果。此外,附图中描绘的处理并非必需所示的特定顺序或顺次顺序,以实现期望的结果。在某些实现中,多任务和并行处理可能是有利的。Thus, specific embodiments of the subject matter have been described. Other embodiments are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve the desired results. In addition, the processes depicted in the figures are not necessarily in the specific order or order of the order shown in order to achieve the desired results. In some implementations, multitasking and parallel processing may be advantageous.
以上对本申请实施例所提供的方法和装置进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。 The method and apparatus provided in the embodiments of the present application are described in detail. The principles and implementation manners of the application are described in the specific examples. The description of the above embodiments is only used to help understand the method of the present application and At the same time, there will be changes in the specific embodiments and application scopes according to the idea of the present application, and the contents of the present specification should not be construed as limiting the present application. .

Claims (46)

  1. 一种生成模拟航线的方法,其特征在于,所述方法包括:A method of generating a simulated route, the method comprising:
    加载目标场景的三维模型;Loading a three-dimensional model of the target scene;
    调用三维渲染引擎对所述三维模型进行渲染后,输出人机交互界面,所述人机交互界面中包含用于呈现渲染后的三维画面的画面窗口;After the 3D rendering engine is invoked to render the 3D model, a human-computer interaction interface is output, where the human-computer interaction interface includes a screen window for presenting the rendered three-dimensional image;
    基于所述人机交互界面获得航点的初始三维信息;Obtaining initial three-dimensional information of a waypoint based on the human-computer interaction interface;
    根据所述初始三维信息生成模拟航线。A simulated route is generated based on the initial three-dimensional information.
  2. 根据权利要求1所述的方法,其特征在于,所述加载目标场景的三维模型,包括:The method according to claim 1, wherein the loading of the three-dimensional model of the target scene comprises:
    在接收到云端服务器生成的目标场景的三维模型后,加载所述三维模型;或者,After receiving the three-dimensional model of the target scene generated by the cloud server, loading the three-dimensional model; or
    在通过本地三维重建功能生成目标场景的三维模型后,加载所述三维模型。After the three-dimensional model of the target scene is generated by the local three-dimensional reconstruction function, the three-dimensional model is loaded.
  3. 根据权利要求1所述的方法,其特征在于,所述基于所述人机交互界面获得航点的初始三维信息,包括:The method according to claim 1, wherein the obtaining the initial three-dimensional information of the waypoint based on the human-computer interaction interface comprises:
    根据模式切换指令控制所述人机交互界面在位置编辑模式和高度编辑模式之间切换;Controlling the human-machine interaction interface to switch between the position editing mode and the altitude editing mode according to the mode switching instruction;
    当切换到位置编辑模式时,通过所述人机交互界面获得航点的位置信息;Obtaining location information of the waypoint through the human-machine interaction interface when switching to the location editing mode;
    当切换到高度编辑模式时,通过所述人机交互界面获得航点的高度信息;When switching to the high edit mode, obtaining the height information of the waypoint through the human-machine interaction interface;
    保存每个航点的初始三维信息,所述初始三维信息包括所述位置信息和所述高度信息。The initial three-dimensional information of each waypoint is saved, the initial three-dimensional information including the location information and the height information.
  4. 根据权利要求3所述的方法,其特征在于,所述根据模式切换指令控制所述人机交互界面在位置编辑模式和高度编辑模式之间切换,包括:The method according to claim 3, wherein the controlling the human-computer interaction interface to switch between the location editing mode and the high-edit mode according to the mode switching instruction comprises:
    根据检测到的所述三维画面的翻转状态获得模式切换指令,当所述三维画面翻转到俯视状态时,切换到位置编辑模式,当所述三维画面翻转到平视状态时,切换到高度编辑模式;或者,Obtaining a mode switching instruction according to the detected inversion state of the three-dimensional picture, switching to a position editing mode when the three-dimensional picture is flipped to a top view state, and switching to a high-edit mode when the three-dimensional picture is flipped to a head-up state; or,
    根据所述人机交互界面提供的模式切换选项获得模式切换指令,当位置选项被选中时,切换到位置编辑模式,当高度选项被选中时,切换到高度编辑模式。The mode switching instruction is obtained according to the mode switching option provided by the human-computer interaction interface. When the location option is selected, the mode is switched to the location editing mode, and when the height option is selected, the mode is switched to the high editing mode.
  5. 根据权利要求3所述的方法,其特征在于,所述通过人机交互界面获得航点的位置信息,包括:The method according to claim 3, wherein the obtaining the location information of the waypoint through the human-machine interaction interface comprises:
    基于所述三维画面上的打点操作,生成多个航点;Generating a plurality of waypoints based on the striking operation on the three-dimensional screen;
    确定任一航点经过拖动操作后的目标位置,或者在所述人机交互界面的参数设置面板中进行位置参数设置后的目标位置;Determining a target position of any waypoint after the drag operation, or setting a target position after the position parameter setting in the parameter setting panel of the human-computer interaction interface;
    获得所述目标位置在所述三维画面中对应的位置信息,所述位置信息包括纬度和经度。Obtaining corresponding location information of the target location in the three-dimensional picture, the location information including latitude and longitude.
  6. 根据权利要求3所述的方法,其特征在于,所述通过人机交互界面获得航点的高度信 息,包括:The method according to claim 3, wherein said obtaining a high degree of waypoints through a human-machine interface Interest, including:
    控制所述航点执行预设操作;Controlling the waypoint to perform a preset operation;
    确定所述航点完成预设操作后在所述三维画面中的高度信息。Determining height information in the three-dimensional picture after the waypoint completes the preset operation.
  7. 根据权利要求6所述的方法,其特征在于,所述控制航点执行预设操作,包括:The method according to claim 6, wherein the controlling the waypoint to perform a preset operation comprises:
    获得在所述人机交互界面的参数设置面板中设置的所述航点的平移高度,并控制所述航点按照所述平移高度在垂直方向移动;或者,Obtaining a translation height of the waypoint set in a parameter setting panel of the human-computer interaction interface, and controlling the waypoint to move in a vertical direction according to the translation height; or
    控制所述航点按照拖动操作在垂直方向上移动。The waypoint is controlled to move in the vertical direction according to the drag operation.
  8. 根据权利要求1所述的方法,其特征在于,所述基于所述人机交互界面获得航点的初始三维信息,包括:The method according to claim 1, wherein the obtaining the initial three-dimensional information of the waypoint based on the human-computer interaction interface comprises:
    根据遥控器发出的控制指令,控制飞行器模型从所述三维画面中的起飞点开始进行模拟飞行;Controlling the aircraft model to perform a simulated flight from a take-off point in the three-dimensional picture according to a control command issued by the remote controller;
    如果在模拟飞行过程中的任一飞行点上接收到所述控制器发出的航点增加指令,则确定所述飞行点为航点,并记录所述航点的初始三维信息;If the waypoint increase command issued by the controller is received at any flight point during the simulated flight, determining the flight point as a waypoint and recording initial three-dimensional information of the waypoint;
    保存每个航点的初始三维信息,所述初始三维信息包括航点的位置信息和高度信息。The initial three-dimensional information of each waypoint is saved, and the initial three-dimensional information includes location information and altitude information of the waypoint.
  9. 根据权利要求8所述的方法,其特征在于,所述人机交互界面中还包括预览窗口;所述方法还包括:The method according to claim 8, wherein the human-computer interaction interface further comprises a preview window; the method further comprises:
    获取所述飞行器模型在所述模拟飞行过程中拍摄的图像数据;Acquiring image data captured by the aircraft model during the simulated flight;
    通过所述三维渲染引擎对所述图像数据进行渲染;Rendering the image data by the three-dimensional rendering engine;
    将渲染后的模拟画面呈现在所述预览窗口。The rendered simulated picture is rendered in the preview window.
  10. 根据权利要求8所述的方法,其特征在于,所述方法还包括:The method of claim 8 further comprising:
    在所述模拟飞行的过程中,如果在某个航点接收到暂停指令,则中断执行所述模拟飞行;During the simulated flight, if a pause command is received at a certain waypoint, the simulated flight is interrupted;
    获得针对所述航点的调整后的初始三维信息;Obtaining adjusted initial three-dimensional information for the waypoint;
    保存所述航点的调整后的初始三维信息。The adjusted initial three-dimensional information of the waypoint is saved.
  11. 根据权利要求10所述的方法,其特征在于,所述方法还包括:The method of claim 10, wherein the method further comprises:
    接收到目标航点的选择指令,所述目标航点为通过所述航点增加指令确定的航点中的任一航点;Receiving a selection instruction of a target waypoint, wherein the target waypoint is any one of the waypoints determined by the waypoint increase instruction;
    控制所述飞行器模型从所述目标航点开始,在所述三维画面中执行所述模拟飞行。Controlling the aircraft model begins with the target waypoint, performing the simulated flight in the three-dimensional picture.
  12. 根据权利要求1所述的方法,其特征在于,所述基于所述人机交互界面获得航点的初始三维信息,包括:The method according to claim 1, wherein the obtaining the initial three-dimensional information of the waypoint based on the human-computer interaction interface comprises:
    在所述画面窗口中加载预设的航线模板; Loading a preset route template in the picture window;
    根据所述航线模板生成初始模拟航线,所述初始模拟航线中包含多个初始航点,每个初始航点的航点信息中包含初始三维信息;Generating an initial simulated route according to the route template, where the initial simulated route includes a plurality of initial waypoints, and the waypoint information of each initial waypoint includes initial three-dimensional information;
    通过所述人机交互界面获得针对任一初始航点的修改后的初始三维信息;Obtaining modified initial three-dimensional information for any initial waypoint through the human-computer interaction interface;
    保存每个航点修改后的初始三维信息,所述初始三维信息包括位置信息和高度信息。The modified three-dimensional information of each waypoint is saved, and the initial three-dimensional information includes location information and height information.
  13. 根据权利要求12所述的方法,其特征在于,每个航线模板对应的初始模拟航线具有固定形状;所述根据所述航线模板生成初始模拟航线,包括:The method according to claim 12, wherein the initial simulated route corresponding to each route template has a fixed shape; and the initial simulated route is generated according to the route template, including:
    确定初始模拟航线的起飞点和降落点,根据所述起飞点和降落点,按照所述初始模拟航线的固定形状生成初始模拟航线;Determining a take-off point and a landing point of the initial simulated route, and generating an initial simulated route according to the fixed shape of the initial simulated route according to the take-off point and the landing point;
    或者,or,
    确定初始模拟航线的起飞点和长度,根据所述起飞点和长度,按照所述初始模拟航线的固定形状生成初始模拟航线。Determining a takeoff point and length of the initial simulated route, and generating an initial simulated route according to the fixed shape of the initial simulated route according to the takeoff point and length.
  14. 根据权利要求3、8或12所述的方法,其特征在于,所述高度信息包括:用于表示所述航点的海拔高度的绝对高度,或者,用于表示所述航点相对于起飞点高度的相对高度。The method according to claim 3, 8 or 12, wherein said height information comprises: an absolute height for indicating an altitude of said waypoint, or for indicating said waypoint relative to a takeoff point The relative height of the height.
  15. 根据权利要求1所述的方法,其特征在于,所述根据所述初始三维信息生成模拟航线,包括:The method according to claim 1, wherein the generating a simulated route according to the initial three-dimensional information comprises:
    根据所述初始三维信息获得航点的目标三维信息;Obtaining target three-dimensional information of the waypoint according to the initial three-dimensional information;
    保存模拟航线文件,所述模拟航线文件中包括:航点顺序和每个航点的航点信息;所述航点信息包括所述航点的目标三维信息、以及航点的属性信息;And storing the simulated route file, where the simulated route file includes: a waypoint sequence and waypoint information of each waypoint; the waypoint information includes target three-dimensional information of the waypoint, and attribute information of the waypoint;
    其中,所述航点的目标三维信息包括:所述航点的位置信息和高度信息;The target three-dimensional information of the waypoint includes: location information and altitude information of the waypoint;
    所述航点的属性信息包括:飞行器飞行到所述航点时的云台的姿态参数、飞行器的速度参数、飞行器的姿态参数。The attribute information of the waypoint includes: a posture parameter of the pan/tilt when the aircraft flies to the waypoint, a speed parameter of the aircraft, and an attitude parameter of the aircraft.
  16. 根据权利要求15所述的方法,其特征在于,所述航点的初始三维信息包括:航点的位置信息和绝对高度;The method according to claim 15, wherein the initial three-dimensional information of the waypoint comprises: location information of the waypoint and an absolute height;
    所述根据所述初始三维信息获得航点的目标三维信息,包括:And obtaining the target three-dimensional information of the waypoint according to the initial three-dimensional information, including:
    获取飞行器模型的起飞点在所述三维模型上的投影高度;Obtaining a projection height of a takeoff point of the aircraft model on the three-dimensional model;
    将每个航点的绝对高度与所述投影高度的差值,确定为每个航点的高度信息。The difference between the absolute height of each waypoint and the projected height is determined as the height information of each waypoint.
  17. 根据权利要求15所述的方法,其特征在于,所述人机交互界面中还包括预览窗口;所述方法还包括:The method according to claim 15, wherein the human-machine interaction interface further comprises a preview window; the method further comprises:
    当任一航点的航点信息确定后,获取飞行器模型在三维画面中基于所述航点信息拍摄的图像数据; After the waypoint information of any waypoint is determined, acquiring image data of the aircraft model based on the waypoint information in the three-dimensional image;
    通过所述三维渲染引擎对所述图像数据进行渲染;Rendering the image data by the three-dimensional rendering engine;
    将渲染后的模拟画面呈现在所述预览窗口。The rendered simulated picture is rendered in the preview window.
  18. 一种模拟飞行的方法,其特征在于,所述方法应用如权利要求1至17任一方法生成的模拟航线进行模拟飞行,所述方法包括:A method of simulating flight, characterized in that the method uses a simulated route generated by the method of any one of claims 1 to 17 for simulated flight, the method comprising:
    通过参数调节模拟器设置飞行器模型的飞行参数;Setting the flight parameters of the aircraft model through the parameter adjustment simulator;
    在接收到模拟飞行指令后,控制所述飞行器模型按照所述飞行参数在三维画面中执行所述模拟航线,获得模拟飞行数据;After receiving the simulated flight instruction, controlling the aircraft model to execute the simulated route in a three-dimensional picture according to the flight parameter to obtain simulated flight data;
    通过三维渲染引擎对所述模拟飞行数据进行渲染;Rendering the simulated flight data by a three-dimensional rendering engine;
    根据渲染结果在人机交互界面的画面窗口输出模拟飞行画面。The simulated flight picture is output in the picture window of the human-computer interaction interface according to the rendering result.
  19. 根据权利要求18所述的方法,其特征在于,所述方法还包括:The method of claim 18, wherein the method further comprises:
    在所述飞行器模型执行模拟航线的过程中,如果在某个航点接收到暂停指令,则中断执行所述模拟航线;During the execution of the simulated route by the aircraft model, if a pause command is received at a certain waypoint, the execution of the simulated route is interrupted;
    获得针对所述航点的调整后的三维信息;Obtaining adjusted three-dimensional information for the waypoint;
    基于调整后的三维信息生成更新后的模拟航线。The updated simulated route is generated based on the adjusted three-dimensional information.
  20. 根据权利要求19所述的方法,其特征在于,所述方法还包括:The method of claim 19, wherein the method further comprises:
    在重新生成模拟航线后,接收到目标航点的选择指令;After regenerating the simulated route, receiving a selection instruction of the target waypoint;
    控制所述飞行器模型从所述目标航点开始,在所述三维画面中执行所述更新后的模拟航线。Controlling the aircraft model begins with the target waypoint, and executing the updated simulated route in the three-dimensional picture.
  21. 根据权利要求18所述的方法,其特征在于,所述飞行参数包括:飞行器模型的云台参数、飞行器模型挂载模拟相机的参数、飞行器模型的GPS参数、姿态参数。The method of claim 18, wherein the flight parameters comprise: a pan/tilt parameter of the aircraft model, a parameter of the aircraft model mount analog camera, a GPS parameter of the aircraft model, and a pose parameter.
  22. 一种生成模拟航线的装置,其特征在于,包括:A device for generating a simulated route, comprising:
    加载单元,用于加载目标场景的三维模型;a loading unit for loading a three-dimensional model of the target scene;
    渲染单元,用于调用三维渲染引擎对所述三维模型进行渲染后,输出人机交互界面,所述人机交互界面中包含用于呈现渲染后的三维画面的画面窗口;a rendering unit, configured to invoke a three-dimensional rendering engine to render the three-dimensional model, and output a human-computer interaction interface, where the human-computer interaction interface includes a screen window for presenting the rendered three-dimensional image;
    获得单元,用于基于所述人机交互界面获得航点的初始三维信息;An obtaining unit, configured to obtain initial three-dimensional information of a waypoint based on the human-computer interaction interface;
    生成单元,用于根据所述初始三维信息生成模拟航线。And a generating unit, configured to generate a simulated route according to the initial three-dimensional information.
  23. 一种模拟飞行的装置,其特征在于,所述装置应用如权利要求22所述装置生成的模拟航线进行模拟飞行,包括:A device for simulating flight, characterized in that the device applies a simulated flight generated by the device according to claim 22 for simulated flight, comprising:
    设置单元,用于通过参数调节模拟器设置飞行器模型的飞行参数;a setting unit configured to set flight parameters of the aircraft model by a parameter adjustment simulator;
    控制单元,用于在接收到模拟飞行指令后,控制所述飞行器模型按照所述飞行参数在三 维画面中执行所述模拟航线,获得模拟飞行数据;a control unit, configured to control the aircraft model according to the flight parameter after receiving a simulated flight instruction Performing the simulated route in the dimension picture to obtain simulated flight data;
    渲染单元,用于通过三维渲染引擎对所述模拟飞行数据进行渲染;a rendering unit, configured to render the simulated flight data by using a three-dimensional rendering engine;
    输出单元,用于根据渲染结果在人机交互界面的画面窗口输出模拟飞行画面。And an output unit, configured to output a simulated flight picture in a picture window of the human-computer interaction interface according to the rendering result.
  24. 一种计算设备,其特征在于,包括通过内部总线连接的存储器、处理器和外部接口,A computing device, including a memory, a processor, and an external interface connected by an internal bus,
    所述存储器,用于存储生成模拟航线的控制逻辑对应的机器可读指令;The memory is configured to store machine readable instructions corresponding to control logic for generating an analog route;
    所述处理器,用于读取所述存储器上的机器可读指令,并执行所述指令以实现如下操作:The processor is configured to read machine readable instructions on the memory and execute the instructions to:
    加载目标场景的三维模型;Loading a three-dimensional model of the target scene;
    调用三维渲染引擎对所述三维模型进行渲染后,输出人机交互界面,所述人机交互界面中包含用于呈现渲染后的三维画面的画面窗口;After the 3D rendering engine is invoked to render the 3D model, a human-computer interaction interface is output, where the human-computer interaction interface includes a screen window for presenting the rendered three-dimensional image;
    基于所述人机交互界面获得航点的初始三维信息;Obtaining initial three-dimensional information of a waypoint based on the human-computer interaction interface;
    根据所述初始三维信息生成模拟航线。A simulated route is generated based on the initial three-dimensional information.
  25. 根据权利要求24所述的计算设备,其特征在于,The computing device of claim 24 wherein:
    所述处理器,具体用于执行在接收到云端服务器生成的目标场景的三维模型后,加载所述三维模型;或者,在通过本地三维重建功能生成目标场景的三维模型后,加载所述三维模型。The processor is specifically configured to: after receiving the three-dimensional model of the target scene generated by the cloud server, loading the three-dimensional model; or, after generating the three-dimensional model of the target scene by using the local three-dimensional reconstruction function, loading the three-dimensional model .
  26. 根据权利要求24所述的计算设备,其特征在于,The computing device of claim 24 wherein:
    所述处理器,具体用于执行根据模式切换指令控制所述人机交互界面在位置编辑模式和高度编辑模式之间切换;当切换到位置编辑模式时,通过所述人机交互界面获得航点的位置信息;当切换到高度编辑模式时,通过所述人机交互界面获得航点的高度信息;并保存每个航点的初始三维信息,所述初始三维信息包括所述位置信息和所述高度信息。The processor is configured to perform, according to the mode switching instruction, controlling the human-machine interaction interface to switch between a position editing mode and a height editing mode; when switching to the position editing mode, obtaining a waypoint through the human-machine interaction interface Position information; when switching to the height editing mode, obtaining height information of the waypoint through the human-machine interaction interface; and saving initial three-dimensional information of each waypoint, the initial three-dimensional information including the location information and the Height information.
  27. 根据权利要求26所述的计算设备,其特征在于,The computing device of claim 26, wherein
    所述处理器,具体用于执行根据检测到的所述三维画面的翻转状态获得模式切换指令,当所述三维画面翻转到俯视状态时,切换到位置编辑模式,当所述三维画面翻转到平视状态时,切换到高度编辑模式;或者,根据所述人机交互界面提供的模式切换选项获得模式切换指令,当位置选项被选中时,切换到位置编辑模式,当高度选项被选中时,切换到高度编辑模式。The processor is configured to: obtain a mode switching instruction according to the detected inversion state of the three-dimensional picture, and switch to a position editing mode when the three-dimensional picture is flipped to a top view state, when the three-dimensional picture is flipped to a head-up view In the state, switch to the height editing mode; or, according to the mode switching option provided by the human-computer interaction interface, obtain a mode switching instruction, when the position option is selected, switch to the position editing mode, when the height option is selected, switch to Highly edit mode.
  28. 根据权利要求26所述的计算设备,其特征在于,The computing device of claim 26, wherein
    所述处理器,具体用于执行基于所述三维画面上的打点操作,生成多个航点;确定任一航点经过拖动操作后的目标位置,或者在所述人机交互界面的参数设置面板中进行位置参数设置后的目标位置;获得所述目标位置在所述三维画面中对应的位置信息,所述位置信息包 括纬度和经度。The processor is specifically configured to: generate a plurality of waypoints based on the striking operation on the three-dimensional picture; determine a target position after any of the waypoints by the drag operation, or set parameter settings in the human-machine interaction interface a target position after the position parameter setting is performed in the panel; obtaining position information corresponding to the target position in the three-dimensional picture, the location information package Includes latitude and longitude.
  29. 根据权利要求26所述的计算设备,其特征在于,The computing device of claim 26, wherein
    所述处理器,具体用于执行控制所述航点执行预设操作;确定所述航点完成预设操作后在所述三维画面中的高度信息。The processor is specifically configured to perform control of the waypoint to perform a preset operation; and determine height information in the three-dimensional picture after the waypoint completes the preset operation.
  30. 根据权利要求29所述的计算设备,其特征在于,The computing device of claim 29, wherein
    所述处理器,具体用于执行获得在所述人机交互界面的参数设置面板中设置的所述航点的平移高度,并控制所述航点按照所述平移高度在垂直方向移动;或者,控制所述航点按照拖动操作在垂直方向上移动。The processor is specifically configured to: obtain a translation height of the waypoint set in a parameter setting panel of the human-computer interaction interface, and control the waypoint to move in a vertical direction according to the translation height; or The waypoint is controlled to move in the vertical direction according to the drag operation.
  31. 根据权利要求24所述的计算设备,其特征在于,The computing device of claim 24 wherein:
    所述处理器,具体用于执行根据遥控器发出的控制指令,控制飞行器模型从所述三维画面中的起飞点开始进行模拟飞行;如果在模拟飞行过程中的任一飞行点上接收到所述控制器发出的航点增加指令,则确定所述飞行点为航点,并记录所述航点的初始三维信息;并保存每个航点的初始三维信息,所述初始三维信息包括航点的位置信息和高度信息。The processor is specifically configured to execute, according to a control command issued by the remote controller, control the aircraft model to start a simulated flight from a take-off point in the three-dimensional picture; if the flight is received at any flight point during the simulated flight a waypoint increase command issued by the controller, determining that the flight point is a waypoint, and recording initial three-dimensional information of the waypoint; and storing initial three-dimensional information of each waypoint, the initial three-dimensional information including a waypoint Location and height information.
  32. 根据权利要求31所述的计算设备,其特征在于,The computing device of claim 31 wherein:
    所述处理器,具体用于执行获取所述飞行器模型在所述模拟飞行过程中拍摄的图像数据;通过所述三维渲染引擎对所述图像数据进行渲染;将渲染后的模拟画面呈现在所述预览窗口。The processor is specifically configured to perform acquiring image data captured by the aircraft model during the simulated flight; rendering the image data by the three-dimensional rendering engine; presenting the rendered simulated image in the Preview window.
  33. 根据权利要求31所述的计算设备,其特征在于,The computing device of claim 31 wherein:
    所述处理器,还用于执行在所述模拟飞行的过程中,如果在某个航点接收到暂停指令,则中断执行所述模拟飞行;获得针对所述航点的调整后的初始三维信息;保存所述航点的调整后的初始三维信息。The processor is further configured to execute, during a process of the simulated flight, if a pause command is received at a certain waypoint, interrupting execution of the simulated flight; and obtaining adjusted initial three-dimensional information for the waypoint ; The adjusted initial three-dimensional information of the waypoint is saved.
  34. 根据权利要求33所述的计算设备,其特征在于,The computing device of claim 33, wherein
    所述处理器,还用于执行接收到目标航点的选择指令,所述目标航点为通过所述航点增加指令确定的航点中的任一航点;控制所述飞行器模型从所述目标航点开始,在所述三维画面中执行所述模拟飞行。The processor is further configured to execute a selection instruction of receiving a target waypoint, the target waypoint being any one of the waypoints determined by the waypoint addition instruction; controlling the aircraft model from the The target waypoint begins, and the simulated flight is performed in the three-dimensional picture.
  35. 根据权利要求24所述的计算设备,其特征在于,The computing device of claim 24 wherein:
    所述处理器,具体用于执行在所述画面窗口中加载预设的航线模板;根据所述航线模板生成初始模拟航线,所述初始模拟航线中包含多个初始航点,每个初始航点的航点信息中包含初始三维信息;通过所述人机交互界面获得针对任一初始航点的修改后的初始三维信息;保存每个航点修改后的初始三维信息,所述初始三维信息包括位置信息和高度信息。The processor is specifically configured to perform loading a preset route template in the picture window, and generate an initial simulated route according to the route template, where the initial simulated route includes multiple initial waypoints, and each initial waypoint The waypoint information includes initial three-dimensional information; the modified initial three-dimensional information for any initial waypoint is obtained through the human-computer interaction interface; and the modified initial three-dimensional information of each waypoint is saved, the initial three-dimensional information includes Location and height information.
  36. 根据权利要求35所述的计算设备,其特征在于, A computing device according to claim 35, wherein
    所述处理器,具体用于执行确定初始模拟航线的起飞点和降落点,根据所述起飞点和降落点,按照所述初始模拟航线的固定形状生成初始模拟航线;或者,确定初始模拟航线的起飞点和长度,根据所述起飞点和长度,按照所述初始模拟航线的固定形状生成初始模拟航线。The processor is specifically configured to perform a determination of a takeoff point and a landing point of the initial simulated route, and generate an initial simulated route according to the fixed shape of the initial simulated route according to the takeoff point and the landing point; or determine an initial simulated route. The takeoff point and length, based on the takeoff point and length, generate an initial simulated route in accordance with the fixed shape of the initial simulated route.
  37. 根据权利要求26、31或35所述的计算设备,其特征在于,所述高度信息包括:用于表示所述航点的海拔高度的绝对高度,或者,用于表示所述航点相对于起飞点高度的相对高度。A computing device according to claim 26, 31 or 35, wherein said height information comprises: an absolute height for indicating the altitude of said waypoint, or for indicating said waypoint relative to takeoff The relative height of the point height.
  38. 根据权利要求24所述的计算设备,其特征在于,The computing device of claim 24 wherein:
    所述处理器,具体用于执行根据所述初始三维信息获得航点的目标三维信息;保存模拟航线文件,所述模拟航线文件中包括:航点顺序和每个航点的航点信息;所述航点信息包括所述航点的目标三维信息、以及航点的属性信息;The processor is specifically configured to perform target three-dimensional information for obtaining a waypoint according to the initial three-dimensional information; and save a simulated route file, where the simulated route file includes: a waypoint sequence and a waypoint information of each waypoint; The waypoint information includes target three-dimensional information of the waypoint and attribute information of the waypoint;
    其中,所述航点的目标三维信息包括:所述航点的位置信息和高度信息;The target three-dimensional information of the waypoint includes: location information and altitude information of the waypoint;
    所述航点的属性信息包括:飞行器飞行到所述航点时的云台的姿态参数、飞行器的速度参数、飞行器的姿态参数。The attribute information of the waypoint includes: a posture parameter of the pan/tilt when the aircraft flies to the waypoint, a speed parameter of the aircraft, and an attitude parameter of the aircraft.
  39. 根据权利要求38所述的计算设备,其特征在于,所述航点的初始三维信息包括:航点的位置信息和绝对高度;The computing device according to claim 38, wherein the initial three-dimensional information of the waypoint comprises: location information of the waypoint and an absolute height;
    所述处理器,具体用于执行获取飞行器模型的起飞点在所述三维模型上的投影高度;将每个航点的绝对高度与所述投影高度的差值,确定为每个航点的高度信息。The processor is specifically configured to perform a projection height of a takeoff point of the acquiring aircraft model on the three-dimensional model; determining a difference between an absolute height of each waypoint and the projected height as a height of each waypoint information.
  40. 根据权利要求38所述的计算设备,其特征在于,所述人机交互界面中还包括预览窗口;The computing device according to claim 38, wherein the human-machine interaction interface further comprises a preview window;
    所述处理器,还用于执行当任一航点的航点信息确定后,获取飞行器模型在三维画面中基于所述航点信息拍摄的图像数据;通过所述三维渲染引擎对所述图像数据进行渲染;将渲染后的模拟画面呈现在所述预览窗口。The processor is further configured to: after the waypoint information of any waypoint is determined, acquire image data captured by the aircraft model based on the waypoint information in a three-dimensional image; and the image data is obtained by the three-dimensional rendering engine Rendering; presenting the rendered simulated picture in the preview window.
  41. 一种计算设备,其特征在于,包括通过内部总线连接的存储器、处理器和外部接口,A computing device, including a memory, a processor, and an external interface connected by an internal bus,
    所述存储器,用于存储模拟飞行的控制逻辑对应的机器可读指令,所述模拟飞行的控制逻辑对应的模拟航线为如权利要求24至40任一计算设备生成的模拟航线;The memory is configured to store machine readable instructions corresponding to control logic of the simulated flight, and the simulated route corresponding to the control logic of the simulated flight is an analog route generated by the computing device of any one of claims 24 to 40;
    所述处理器,用于读取所述存储器上的所述机器可读指令,并执行所述指令以实现如下操作:The processor is configured to read the machine readable instructions on the memory and execute the instructions to:
    通过参数调节模拟器设置飞行器模型的飞行参数;Setting the flight parameters of the aircraft model through the parameter adjustment simulator;
    在接收到模拟飞行指令后,控制所述飞行器模型按照所述飞行参数在三维画面中执行所述模拟航线,获得模拟飞行数据; After receiving the simulated flight instruction, controlling the aircraft model to execute the simulated route in a three-dimensional picture according to the flight parameter to obtain simulated flight data;
    通过三维渲染引擎对所述模拟飞行数据进行渲染;Rendering the simulated flight data by a three-dimensional rendering engine;
    根据渲染结果在人机交互界面的画面窗口输出模拟飞行画面。The simulated flight picture is output in the picture window of the human-computer interaction interface according to the rendering result.
  42. 根据权利要求41所述的计算设备,其特征在于,A computing device according to claim 41, wherein
    所述处理器,还用于执行在所述飞行器模型执行模拟航线的过程中,如果在某个航点接收到暂停指令,则中断执行所述模拟航线;获得针对所述航点的调整后的三维信息;基于调整后的三维信息生成更新后的模拟航线。The processor is further configured to perform execution of the simulated route during the execution of the simulated route of the aircraft model, if the suspension instruction is received at a certain waypoint, interrupting execution of the simulated route; and obtaining an adjusted for the waypoint Three-dimensional information; generating an updated simulated route based on the adjusted three-dimensional information.
  43. 根据权利要求42所述的计算设备,其特征在于,The computing device of claim 42 wherein:
    所述处理器,还用于执行在重新生成模拟航线后,接收到目标航点的选择指令;控制所述飞行器模型从所述目标航点开始,在所述三维画面中执行所述更新后的模拟航线。The processor is further configured to perform a selection instruction of receiving a target waypoint after regenerating the simulated route; controlling the aircraft model to start from the target waypoint, and executing the updated in the three-dimensional picture Simulate the route.
  44. 根据权利要求41所述的计算设备,其特征在于,所述飞行参数包括:飞行器模型的云台参数、飞行器模型挂载模拟相机的参数、飞行器模型的GPS参数、姿态参数。The computing device of claim 41, wherein the flight parameters comprise: a pan/tilt parameter of the aircraft model, a parameter of the aircraft model mount analog camera, a GPS parameter of the aircraft model, and a pose parameter.
  45. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述程序被执行时实现如下操作:A computer readable storage medium having stored thereon a computer program, wherein when the program is executed, the following operations are performed:
    加载目标场景的三维模型;Loading a three-dimensional model of the target scene;
    调用三维渲染引擎对所述三维模型进行渲染后,输出人机交互界面,所述人机交互界面中包含用于呈现渲染后的三维画面的画面窗口;After the 3D rendering engine is invoked to render the 3D model, a human-computer interaction interface is output, where the human-computer interaction interface includes a screen window for presenting the rendered three-dimensional image;
    基于所述人机交互界面获得航点的初始三维信息;Obtaining initial three-dimensional information of a waypoint based on the human-computer interaction interface;
    根据所述初始三维信息生成模拟航线。A simulated route is generated based on the initial three-dimensional information.
  46. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述程序被执行时实现如下操作:A computer readable storage medium having stored thereon a computer program, wherein when the program is executed, the following operations are performed:
    通过参数调节模拟器设置飞行器模型的飞行参数;Setting the flight parameters of the aircraft model through the parameter adjustment simulator;
    在接收到模拟飞行指令后,控制所述飞行器模型按照所述飞行参数在三维画面中执行模拟航线,获得模拟飞行数据,所述模拟航线为执行如权利要求45所述计算机可读存储介质上的程序生成的模拟航线;After receiving the simulated flight instruction, controlling the aircraft model to perform a simulated flight route in a three-dimensional picture according to the flight parameter, and obtaining simulated flight data, the simulated flight path being performed on the computer readable storage medium according to claim 45 Simulated route generated by the program;
    通过三维渲染引擎对所述模拟飞行数据进行渲染;Rendering the simulated flight data by a three-dimensional rendering engine;
    根据渲染结果在人机交互界面的画面窗口输出模拟飞行画面。 The simulated flight picture is output in the picture window of the human-computer interaction interface according to the rendering result.
PCT/CN2017/109783 2017-11-07 2017-11-07 Method for generating simulated route, method and device for flight simulation, and storage medium WO2019090488A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2017/109783 WO2019090488A1 (en) 2017-11-07 2017-11-07 Method for generating simulated route, method and device for flight simulation, and storage medium
CN201780004905.8A CN108521788B (en) 2017-11-07 2017-11-07 Method for generating simulated flight path, method and equipment for simulating flight and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/109783 WO2019090488A1 (en) 2017-11-07 2017-11-07 Method for generating simulated route, method and device for flight simulation, and storage medium

Publications (1)

Publication Number Publication Date
WO2019090488A1 true WO2019090488A1 (en) 2019-05-16

Family

ID=63434484

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/109783 WO2019090488A1 (en) 2017-11-07 2017-11-07 Method for generating simulated route, method and device for flight simulation, and storage medium

Country Status (2)

Country Link
CN (1) CN108521788B (en)
WO (1) WO2019090488A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110689597A (en) * 2019-09-30 2020-01-14 北京金山安全软件有限公司 Animation model display method and device
CN111309037A (en) * 2019-11-25 2020-06-19 中国航空无线电电子研究所 Visual control system based on unmanned aerial vehicle ground satellite station
CN111569414A (en) * 2020-06-08 2020-08-25 浙江商汤科技开发有限公司 Flight display method and device of virtual aircraft, electronic equipment and storage medium
CN112035934A (en) * 2020-09-04 2020-12-04 国网山西省电力公司经济技术研究院 Method for construction management control based on digital design model of transformer substation
CN112212854A (en) * 2020-10-12 2021-01-12 西安羚控电子科技有限公司 Route planning method
CN114095772A (en) * 2021-12-08 2022-02-25 广州方硅信息技术有限公司 Virtual object display method and system under live microphone connection and computer equipment
CN115661426A (en) * 2022-12-15 2023-01-31 山东捷瑞数字科技股份有限公司 Model modification method, device, equipment and medium based on three-dimensional engine
CN115661363A (en) * 2022-11-18 2023-01-31 湖北晓雲科技有限公司 Three-dimensional building model construction method utilizing unmanned aerial vehicle oblique photography
CN117311562A (en) * 2023-11-28 2023-12-29 北京蓝天航空科技股份有限公司 Real-time control method and device for visual angle of aviation simulator based on mouse control

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020113417A1 (en) * 2018-12-04 2020-06-11 深圳市大疆创新科技有限公司 Three-dimensional reconstruction method and system for target scene, and unmanned aerial vehicle
CN109870910A (en) * 2019-03-02 2019-06-11 哈尔滨理工大学 A kind of flying vehicles control method based on synovial membrane control
CN111815745B (en) * 2020-06-16 2024-01-12 万物镜像(北京)计算机系统有限公司 Driving condition display method and device, storage medium and electronic equipment
CN112287056A (en) * 2020-11-04 2021-01-29 北京蒙泰华奥国际贸易有限公司 Navigation management visualization method and device, electronic equipment and storage medium
CN112783188A (en) * 2020-12-30 2021-05-11 甘肃建投矿业有限公司 Unmanned aerial vehicle remote inspection flight control system and method based on 5G technology
CN113660509A (en) * 2021-10-18 2021-11-16 上海飞机制造有限公司 Three-dimensional model processing system and method based on cloud rendering
CN115440091B (en) * 2022-11-03 2023-07-04 成都沃飞天驭科技有限公司 Course switching view display method and device, aircraft and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105043382A (en) * 2015-07-06 2015-11-11 深圳一电科技有限公司 Unmanned plane cruise method and apparatus thereof
CN106530896A (en) * 2016-11-30 2017-03-22 中国直升机设计研究所 Virtual system for unmanned aerial vehicle flight demonstration
CN106845032A (en) * 2017-03-14 2017-06-13 西安电子科技大学 The construction method of multimode navigation three-dimensional dynamic visual simulation platform

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101251385B (en) * 2008-03-20 2010-09-08 北京航空航天大学 Method for real time bookbinding and processing navigating point for unmanned aerial vehicle
US9476962B2 (en) * 2013-05-02 2016-10-25 The Boeing Company Device, system and methods using angle of arrival measurements for ADS-B authentication and navigation
CN104240541B (en) * 2014-09-09 2016-01-27 中国电子科技集团公司第二十八研究所 A kind of 4D flight path generation method
WO2016049905A1 (en) * 2014-09-30 2016-04-07 深圳市大疆创新科技有限公司 Method, device and system for processing flight mission
US20170075556A1 (en) * 2015-09-14 2017-03-16 Honeywell International Inc. Aircraft systems and methods for enhanced waypoint list display
CN105676864A (en) * 2016-04-08 2016-06-15 合肥工业大学 Simulation system of UAV (Unmanned Aerial Vehicle) aerial photography program
CN105912288A (en) * 2016-04-12 2016-08-31 上海易天无人飞行器科技有限公司 Method and system for comprehensive processing display capable of monitoring flight state of unmanned aerial vehicle
CN106019987A (en) * 2016-07-19 2016-10-12 四川九洲空管科技有限责任公司 3D interactive simulated flight path generation method and 3D interactive simulated flight path generation system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105043382A (en) * 2015-07-06 2015-11-11 深圳一电科技有限公司 Unmanned plane cruise method and apparatus thereof
CN106530896A (en) * 2016-11-30 2017-03-22 中国直升机设计研究所 Virtual system for unmanned aerial vehicle flight demonstration
CN106845032A (en) * 2017-03-14 2017-06-13 西安电子科技大学 The construction method of multimode navigation three-dimensional dynamic visual simulation platform

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110689597A (en) * 2019-09-30 2020-01-14 北京金山安全软件有限公司 Animation model display method and device
CN110689597B (en) * 2019-09-30 2024-02-09 北京金山安全软件有限公司 Animation model display method and device
CN111309037B (en) * 2019-11-25 2023-03-28 中国航空无线电电子研究所 Visual control system based on unmanned aerial vehicle ground satellite station
CN111309037A (en) * 2019-11-25 2020-06-19 中国航空无线电电子研究所 Visual control system based on unmanned aerial vehicle ground satellite station
CN111569414A (en) * 2020-06-08 2020-08-25 浙江商汤科技开发有限公司 Flight display method and device of virtual aircraft, electronic equipment and storage medium
CN111569414B (en) * 2020-06-08 2024-03-29 浙江商汤科技开发有限公司 Flight display method and device of virtual aircraft, electronic equipment and storage medium
CN112035934A (en) * 2020-09-04 2020-12-04 国网山西省电力公司经济技术研究院 Method for construction management control based on digital design model of transformer substation
CN112212854A (en) * 2020-10-12 2021-01-12 西安羚控电子科技有限公司 Route planning method
CN114095772A (en) * 2021-12-08 2022-02-25 广州方硅信息技术有限公司 Virtual object display method and system under live microphone connection and computer equipment
CN114095772B (en) * 2021-12-08 2024-03-12 广州方硅信息技术有限公司 Virtual object display method, system and computer equipment under continuous wheat direct sowing
CN115661363A (en) * 2022-11-18 2023-01-31 湖北晓雲科技有限公司 Three-dimensional building model construction method utilizing unmanned aerial vehicle oblique photography
CN115661426B (en) * 2022-12-15 2023-03-17 山东捷瑞数字科技股份有限公司 Model modification method, device, equipment and medium based on three-dimensional engine
CN115661426A (en) * 2022-12-15 2023-01-31 山东捷瑞数字科技股份有限公司 Model modification method, device, equipment and medium based on three-dimensional engine
CN117311562A (en) * 2023-11-28 2023-12-29 北京蓝天航空科技股份有限公司 Real-time control method and device for visual angle of aviation simulator based on mouse control
CN117311562B (en) * 2023-11-28 2024-02-20 北京蓝天航空科技股份有限公司 Real-time control method and device for visual angle of aviation simulator based on mouse control

Also Published As

Publication number Publication date
CN108521788B (en) 2022-02-25
CN108521788A (en) 2018-09-11

Similar Documents

Publication Publication Date Title
WO2019090488A1 (en) Method for generating simulated route, method and device for flight simulation, and storage medium
US11829139B2 (en) Applications and skills for an autonomous unmanned aerial vehicle
CN110531960B (en) System and method for developing, testing and deploying digital reality applications in the real world through a virtual world
US9947230B2 (en) Planning a flight path by identifying key frames
US20200255143A1 (en) Three-dimensional reconstruction method, system and apparatus based on aerial photography by unmanned aerial vehicle
US11755041B2 (en) Objective-based control of an autonomous unmanned aerial vehicle
WO2017186137A1 (en) Unmanned aerial vehicle control method and device
US9928649B2 (en) Interface for planning flight path
US10754422B1 (en) Systems and methods for providing interaction with elements in a virtual architectural visualization
JP5752715B2 (en) Projector and depth camera for deviceless augmented reality and interaction
US10297085B2 (en) Augmented reality creations with interactive behavior and modality assignments
WO2019119187A1 (en) Route planning method for unmanned aerial vehicle, control device, and storage medium
US20200394841A1 (en) Information processing apparatus, information processing method, and storage medium
WO2018076372A1 (en) Waypoint editing method, apparatus, device and aircraft
US20200035034A1 (en) Method, device, terminal device and storage medium for realizing augmented reality image
US20190089911A1 (en) Digital camera with audio, visual and motion analysis
WO2022247498A1 (en) Unmanned aerial vehicle monitoring
KR102403258B1 (en) Method and system for 3d modeling based on volume estimation
CN117274542A (en) Apparatus and method for generating dynamic virtual content in mixed reality
JP2020160944A (en) Inspection work support device, inspection work support method, and inspection work support program
US20230144319A1 (en) Motion tracking interface for planning travel path
WO2018065857A1 (en) Systems and methods for determining predicted risk for a flight path of an unmanned aerial vehicle
WO2019037102A1 (en) Method and apparatus for obtaining flight simulation data, storage medium and device
Chen et al. ARPilot: designing and investigating AR shooting interfaces on mobile devices for drone videography
JP2022507714A (en) Surveying sampling point planning method, equipment, control terminal and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17931456

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17931456

Country of ref document: EP

Kind code of ref document: A1