CN112955868A - Software extension method, terminal device, movable platform, load and storage medium - Google Patents

Software extension method, terminal device, movable platform, load and storage medium Download PDF

Info

Publication number
CN112955868A
CN112955868A CN201980067327.1A CN201980067327A CN112955868A CN 112955868 A CN112955868 A CN 112955868A CN 201980067327 A CN201980067327 A CN 201980067327A CN 112955868 A CN112955868 A CN 112955868A
Authority
CN
China
Prior art keywords
control
load
configuration file
movable platform
control configuration
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201980067327.1A
Other languages
Chinese (zh)
Inventor
杨勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SZ DJI Technology Co Ltd
Original Assignee
SZ DJI Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SZ DJI Technology Co Ltd filed Critical SZ DJI Technology Co Ltd
Publication of CN112955868A publication Critical patent/CN112955868A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/10Simultaneous control of position or course in three dimensions

Abstract

A software extension method is used for a terminal device, the terminal device is in communication connection with a movable platform, a load is loaded on the movable platform, and the terminal device is in communication with the load through the movable platform; the terminal equipment is provided with control software for controlling the movable platform; the method comprises the following steps: acquiring a control configuration file of a load, wherein the control configuration file comprises attribute information of at least one control (S110); and displaying an interactive interface of the load on a display interface of the control software according to the control configuration file, wherein the interactive interface is used for displaying the control (S120).

Description

Software extension method, terminal device, movable platform, load and storage medium
Technical Field
The present disclosure relates to the field of computer software technologies, and in particular, to a software extension method, a terminal device, a mobile platform, a load, and a storage medium.
Background
Due to the wide expansion of the application of movable platforms such as unmanned planes, the types of loads which can be carried by the movable platforms are more and more diversified, for example, cameras, radars and the like can be carried by the movable platforms. For an open movable platform. Each third party vendor may develop its own load access to the mobile platform. At present, the interaction between the terminal equipment and the load is generally realized through terminal application programs independently developed by load manufacturers, and if a terminal user purchases loads of different manufacturers, when the terminal user uses the terminal equipment on the same movable platform, the application programs corresponding to different loads on the terminal equipment need to be switched back and forth, so that the use is inconvenient.
Disclosure of Invention
Based on this, the present specification provides a software extension method, a terminal device, a movable platform, a load and a storage medium, which aim to implement extending the function of movable platform control software on the terminal device according to the load carried by the movable platform, so as to implement interaction between the terminal device and the load.
In a first aspect, the present specification provides a software extension method, which is used for a terminal device, where the terminal device is in communication connection with a movable platform, a load is loaded on the movable platform, and the terminal device communicates with the load through the movable platform; the terminal equipment is provided with control software for controlling the movable platform; the method comprises the following steps:
acquiring a control configuration file of the load; wherein the control configuration file comprises attribute information of at least one control;
displaying an interactive interface of the load on a display interface of the control software according to the control configuration file; wherein, the interactive interface is used for displaying the control.
In a second aspect, the present specification provides a software extension method for a load mounted on a movable platform, where the movable platform is in communication connection with a terminal device, and the load communicates with the terminal device through the movable platform; the terminal equipment is provided with control software for controlling the movable platform; the method comprises the following steps:
acquiring a control configuration file of the load; wherein the control configuration file comprises attribute information of at least one control;
sending the control configuration file to the terminal equipment through the movable platform, so that the terminal equipment can display an interactive interface of the load on a display interface of the control software according to the control configuration file; wherein, the interactive interface is used for displaying the control.
In a third aspect, the present specification provides a software extension method, which is used for a movable platform, where the movable platform is in communication connection with a terminal device, a load is loaded on the movable platform, and the terminal device is equipped with control software for controlling the movable platform; the method comprises the following steps:
acquiring a control configuration file of the load; wherein the control configuration file comprises attribute information of at least one control;
sending the control configuration file of the load to the terminal equipment so that the terminal equipment can display the interactive interface of the load on a display interface of the control software according to the control configuration file; wherein, the interactive interface is used for displaying the control.
In a fourth aspect, the present specification provides a terminal device, where the terminal device is capable of being communicatively connected to a movable platform, the movable platform is loaded with a load, and the terminal device communicates with the load through the movable platform;
the terminal equipment comprises a memory and a processor;
the memory for storing a computer program and at least a computer program of control software for controlling the movable platform;
the processor is configured to execute the computer program and, when executing the computer program, implement the following steps:
acquiring a control configuration file of the load; wherein the control configuration file comprises attribute information of at least one control;
displaying an interactive interface of the load on a display interface of the control software according to the control configuration file; wherein, the interactive interface is used for displaying the control.
In a fifth aspect, the present specification provides a load of a movable platform, the load being capable of communicating with a terminal device through the movable platform when carried on the movable platform, the terminal device being equipped with control software for controlling the movable platform;
the load comprises a memory and a processor;
the memory is used for storing a computer program;
the processor is configured to execute the computer program and, when executing the computer program, implement the following steps:
acquiring a control configuration file of the load; wherein the control configuration file comprises attribute information of at least one control;
sending the control configuration file to the terminal equipment through the movable platform, so that the terminal equipment displays an interactive interface of the load on a display interface of the control software according to the control configuration file; wherein, the interactive interface is used for displaying the control.
In a sixth aspect, the present specification provides a movable platform capable of communicative connection with a terminal device, the movable platform being configured to carry a load, the terminal device being configured to install control software for controlling the movable platform;
the movable platform comprises a memory and a processor;
the memory is used for storing a computer program;
the processor is configured to execute the computer program and, when executing the computer program, implement the following steps:
acquiring a control configuration file of the load; wherein the control configuration file comprises attribute information of at least one control;
sending the control configuration file of the load to the terminal equipment so that the terminal equipment displays an interactive interface of the load on a display interface of the control software according to the control configuration file; wherein, the interactive interface is used for displaying the control.
In a seventh aspect, the present specification provides a computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to implement the above-mentioned method.
The embodiment of the specification provides a software extension method, terminal equipment, a movable platform, a load and a storage medium, wherein an interactive interface for interacting with the load is extended on the basis of control software for controlling the movable platform by acquiring a control configuration file of the load of the movable platform and displaying the interactive interface of the load on a display interface of the control software according to the control configuration file, so that a user can realize the control of the movable platform and the interaction between the terminal equipment and the load without frequently switching different software, and the development workload of a load developer can be reduced.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure as claimed.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present disclosure, and it is obvious for those skilled in the art to obtain other drawings based on the drawings without creative efforts.
Fig. 1 is a schematic view of a load carried by a movable platform currently controlled by a terminal device;
FIG. 2 is a flow chart illustrating a software extension method according to an embodiment of the present disclosure;
fig. 3 is a schematic diagram of controlling a load carried by a movable platform by a terminal device according to an embodiment of the present specification;
FIG. 4 is a schematic diagram of an interactive interface displaying a load on a display interface of the control software;
FIG. 5 is a diagram of a terminal device displaying control information for a load;
FIG. 6 is a flowchart illustrating a software extension method according to another embodiment of the present disclosure;
FIG. 7 is a flowchart illustrating a software extension method according to yet another embodiment of the present disclosure;
fig. 8 is a schematic block diagram of a terminal device provided in an embodiment of the present specification;
FIG. 9 is a schematic block diagram of a load of a movable platform provided by an embodiment of the present description;
FIG. 10 is a schematic block diagram of a movable platform provided by an embodiment of the present description.
Detailed Description
The technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are some, but not all, of the embodiments of the present disclosure. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present specification without any creative effort belong to the protection scope of the present specification.
The flow diagrams depicted in the figures are merely illustrative and do not necessarily include all of the elements and operations/steps, nor do they necessarily have to be performed in the order depicted. For example, some operations/steps may be decomposed, combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
Some embodiments of the present description will be described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.
Referring to fig. 1, fig. 1 is a schematic diagram illustrating a load carried by a movable platform being controlled by a terminal device.
Specifically, the terminal device is in communication connection with the movable platform, and an application program for controlling the movable platform may be installed on the terminal device, for example, the application program may be used to control the movement, the posture, the movement track, and the like of the movable platform.
The mobile platform may carry one or more loads and the terminal device may be required to carry one or more applications for controlling the respective load and/or retrieving information from the load in addition to the application for controlling the mobile platform. As shown in fig. 1, an application 1 installed on a terminal device is used to control a load 1, and an application 2 is used to obtain data collected by the load 2 from the load 2.
In some embodiments, the application for controlling the movable platform may be launched by a movable platform developer, installed by the movable platform developer or installed by a user at the terminal device.
The load may be a load developed by a third party manufacturer, and the third party manufacturer may develop its own load and an application program of the terminal device based on an interface of the open mobile platform. For example, a third party manufacturer can open a software package according to a load application program released by a movable platform developer, and transplant the software package on a load to develop the application program on the load; the third-party manufacturer can also develop an application program which is used for being installed on the terminal equipment and used for interacting with the load according to a software package of the mobile-end application released by the mobile platform developer.
The inventor of the present application finds that the above control method for the load needs to install more application programs on the terminal device, and needs to frequently switch the application programs running on the terminal device when in use, which is inconvenient, and a third party manufacturer needs to develop the application programs of the terminal device, which is difficult to develop and has a long period.
In view of this finding, the inventors of the present application have improved a control method of a load to realize more convenient expansion of functions for interacting with the load on a terminal device.
Referring to fig. 2, fig. 2 is a flowchart illustrating a software expansion method according to an embodiment of the present disclosure. The software extension method can be applied to terminal equipment which can be in communication connection with the movable platform, for example, data can be transmitted between the terminal equipment and the movable platform through a wireless channel.
As shown in fig. 3, the terminal device applying the software extension method is, for example, a mobile phone, a tablet computer, or the like, and the terminal device may be connected to the movable platform through another terminal device, for example, a ground station, a remote controller, or the like, so as to extend a communication distance between the mobile platform and the terminal device, for example, the mobile phone, the tablet computer, or the like.
The movable platform can carry one or more loads thereon. For example, the load may be connected to the movable platform through a hardware interface, so as to transfer information with the movable platform.
The load may include at least one of a pan/tilt head, a camera, a radar, an air pressure measuring device, a height measuring device, a gas detecting device, a lighting device, and a sound generating device, for example.
The terminal device is capable of communicating with the load through the movable platform; and the terminal equipment is provided with control software for controlling the movable platform.
The software extension method applied to the terminal equipment can be used for extending the function of the movable platform control software on the terminal equipment according to the load carried by the movable platform so as to realize the interaction between the terminal equipment and the load.
The terminal device may include at least one of a mobile phone, a tablet computer, a notebook computer, a desktop computer, a personal digital assistant, a wearable device, a remote controller, and the like. The movable platform may be, for example, a robot, a robotic vehicle, an aircraft, or the like. Further, the aircraft can be rotor type unmanned aerial vehicle, for example, quad-rotor unmanned aerial vehicle, hexa-rotor unmanned aerial vehicle, eight-rotor unmanned aerial vehicle, also can be fixed wing unmanned aerial vehicle.
As shown in fig. 2, the software extension method of the embodiment of the present specification includes steps S110 to S120.
S110, acquiring a control configuration file of the load; wherein the control configuration file comprises attribute information of at least one control.
Specifically, a third party vendor may develop its own load based on an open interface of the mobile platform. For example, a third party vendor may open a software package, such as a Payload SDK, from a Payload application launched by a mobile platform developer to port the software package onto a Payload to develop an application on the Payload.
Illustratively, the control profile is generated by the load or stored by the load.
For example, the load may generate a control profile from the load application opening package and/or the application on the load.
Illustratively, the control configuration file includes attribute information of at least one control, which may be described by a file such as JSON format, xml format, html format, etc., for defining UI (User Interface) attributes, presentation styles, control types, etc. of the control.
For example, the load may send the control configuration file to the terminal device via the movable platform.
Specifically, the movable platform may obtain the control configuration file of the load, and then send the control configuration file of the load to the terminal device.
In some embodiments, the terminal device obtains the control configuration file that the load actively sends after the movable platform is in communication connection with the terminal device.
For example, while the load is connected to the movable platform, it may be detected whether the movable platform is communicatively connected to the terminal device; and if the movable platform is detected to be in communication connection with the terminal equipment, the load transmits the control configuration file to the movable platform, so that the movable platform sends the control configuration file of the load to the terminal equipment.
For example, the movable platform may detect whether a load is mounted, and if the load is detected, send a control configuration file of the load to the terminal device when the movable platform is in communication connection with the terminal device.
In some embodiments, the terminal device sends a file acquisition instruction to the load, and acquires the control configuration file sent by the load according to the file acquisition instruction.
For example, the terminal device may send a file acquisition instruction to a load of the movable platform when an application program for controlling the movable platform is started or when a communication connection with the movable platform is successful, so that the load sends the control configuration file to the terminal device through the movable platform.
S120, displaying an interactive interface of the load on a display interface of the control software according to the control configuration file; wherein, the interactive interface is used for displaying the control.
Illustratively, as shown in fig. 4, the terminal device displays an interactive interface of the camera load and an interactive interface of the radar load on a display interface of the control software, and respectively displays a control of the camera and a control of the radar.
In some implementations, the control profile also includes a control icon for the control.
The displaying the interactive interface of the load on the display interface of the control software according to the control configuration file comprises the following steps: and displaying the control icon on the interactive interface according to the attribute information of the control.
For example, the attribute information may define a display mode, a function definition, an interactive interface, and the like of the control icon. The attribute information of the control profile such as a camera load includes information for defining a control icon for photographing, recording, and the like as a clickable state, and information for defining a control icon for zooming as a slider including a slide bar in an up-down direction and black on the slide bar and a state in which the slider is slidable on the slide bar, and the like. And the terminal equipment can display the control icons on the interactive interface according to the attribute information and define the functions corresponding to the control icons.
Illustratively, the load-running program includes a service interface adapted to the control software. The terminal device may send instructions for controlling the load to the service interface via the control software.
Illustratively, the terminal device can execute a function corresponding to the attribute information of the control when detecting the operation of the control by the user.
It is understood that the executing the function corresponding to the attribute information of the control may include the terminal device executing the corresponding function by itself, the terminal device controlling the movable platform and/or the load to execute the corresponding function, and the terminal device executing the corresponding function together with the movable platform and/or the load.
For example, when the user clicks the picture taking control icon of the camera in fig. 4, the terminal device may store the image taken by the camera and transmitted back by the movable platform.
For example, if the terminal device obtains the operation of the user on the control icon, the terminal device may send a control instruction corresponding to the attribute information to the load via the movable platform according to the operation of the control icon, so that the load executes a preset task according to the control instruction.
For example, when the user clicks the left and right swipe control icon of the camera in fig. 4, the terminal device may control the shooting direction of the camera carried by the movable platform to reciprocate left and right.
In some embodiments, the terminal device may further obtain operation information of the load, and display the operation information on the interactive interface.
Illustratively, the load-running program includes a service interface adapted to the control software. The load may send the operation information of said load to the terminal device via the service interface.
For example, the radar load may send operation information such as a height measured by the radar from the ground, a distance to an obstacle, and the like to the terminal device. The terminal equipment can obtain the running information of the load and display the running information on the interactive interface. As shown in fig. 4, the current height from the ground is 50 meters and the distance from the obstacle is 10 meters.
Therefore, the function of the movable platform control software on the terminal equipment is expanded according to the load carried by the movable platform by the terminal equipment, so that the interaction between the terminal equipment and the load is realized.
In some embodiments, the load or the movable platform may send the control information of the load to the terminal device, so that the terminal device obtains the control configuration file of the load according to the control information.
The control information may include information for identifying at least one of a kind of the load, a unique identification of the load, a control version of the load, check information of a control profile of the load, a generation time of the control profile of the load, and the like.
For example, the control information may include MD5 verification information for the control profile. In particular, the payload may determine MD5 verification information for the control profile based on a hash function, such as MD5, which may translate a data string of any length to a shorter fixed-length value. If the MD5 verification information of two data is the same, it can be determined that the two data are the same data, complete without error, and have not been tampered. Whether the corresponding control configuration file exists locally can be known by checking the MD5, if the check is successful, the corresponding control configuration file exists locally, and the control configuration file does not need to be transmitted further; if the verification is unsuccessful, the corresponding control configuration file is not stored locally (the control configuration file is not transmitted or is updated), and the control configuration file needs to be further transmitted.
When the types of the loads are different and the control versions of the loads are different, the control information of the loads is also different. When the control configuration file of the load is damaged, the control information of the load is different. Therefore, the terminal equipment can distinguish different control configuration files according to the control information.
Illustratively, the obtaining the control configuration file of the load includes: acquiring control information of the load; and acquiring a control configuration file of the load according to the control information.
For example, as shown in fig. 5, the terminal device may further display the control information on a display interface of the control software. Specifically, the load may send control information of the load to the terminal device via the movable platform. Therefore, the user can check the information of the type of the load carried by the movable platform, the version of the control of the load and the like.
Illustratively, if the terminal device detects the operation of the user on the control information, the terminal device may obtain the control configuration file of the load according to the operation of the control information. For example, if the terminal device detects an operation of the control information by the user, the terminal device may send a file acquisition instruction to the load according to the operation of the control information, and acquire the control configuration file sent by the load according to the file acquisition instruction.
For example, when a user wishes to extend the interactive function of the load 1 on the control software of the terminal device, the user may click the control information of the load 1 displayed on the display interface, trigger the terminal device to send a file acquisition instruction to the load 1, and acquire the control configuration file sent by the load 1 according to the file acquisition instruction. The user can thus choose whether to extend the interactive functionality of a certain load to the control software of the terminal device.
For example, after the terminal device obtains the control configuration file, it may check whether the obtained control configuration file is correct according to the check information in the control information. And if not, can be retrieved.
In other embodiments, the terminal device may obtain the control configuration file of the load from an external server. And the server stores the control configuration file of the load.
For example, the control information of the load may include type information of the load. The terminal device may obtain the control configuration file of the load from an external server according to the type information of the load.
For example, when the terminal device runs the control software, a control downloading interface may be displayed, and the control downloading interface may display control configuration files of respective loads uploaded by a plurality of load developers.
Specifically, the external server may store control configuration files of respective loads uploaded by load development vendors, and the user may operate on the control software, so that the terminal device connects to the server to display control information of a plurality of vendor loads, or the user may search and download control information of a control configuration file of a certain load stored in the server.
For example, the terminal device may obtain the control configuration file of the load from an external server according to the control information of the load, where the step is performed automatically by the terminal device or is performed by the terminal device according to an operation of a user. For example, the load or the movable platform may send control information of the load to the terminal device, and the terminal device automatically obtains a control configuration file of the load from an external server according to the control information. For example, if the terminal device detects an operation of the control information by the user, the terminal device may send a file acquisition instruction to the server according to the operation of the control information, and acquire the control configuration file sent by the server. Therefore, the load developer and the user can update the load control more conveniently.
In some embodiments, the obtaining the control configuration file of the load according to the control information includes: determining whether the terminal equipment stores a control configuration file corresponding to the control information; if the terminal equipment stores a control configuration file corresponding to the control information, acquiring the stored control configuration file; and if the terminal equipment does not store the control configuration file corresponding to the control information, acquiring the control configuration file corresponding to the control information from the movable platform and/or the server.
For example, if the terminal device has previously acquired the control configuration file of the load, the terminal device does not need to repeatedly acquire the control configuration file from the load, so that the time is saved, and the practical efficiency is improved.
For example, whether a control configuration file of an updated version exists may be further determined according to the control information, and if so, the control configuration file of the updated version is acquired from the movable platform and/or the server, and a previously stored control configuration file of an old version may be deleted.
For example, whether the control configuration file stored in the terminal device is damaged or not may be determined according to the control information, and if the control configuration file is damaged, a correct control configuration file may be obtained from the movable platform and/or the server, and the damaged control configuration file may be deleted.
In some embodiments, the step S110 of obtaining the control configuration file of the load includes: and acquiring a control configuration file of the load, which is consistent with the equipment attribute information, according to the equipment attribute information of the terminal equipment.
Illustratively, the device attribute information includes at least one of a language used by the terminal device and a screen size.
The control software on the terminal device can set the language used by the user, and can also match the screen size of the terminal device, such as adjusting the size and resolution of the displayed interface.
For example, the terminal device may send device attribute information of the terminal device to the load, so that the load obtains a control configuration file consistent with the device attribute information; and then the terminal equipment acquires the control configuration file sent by the load through the movable platform. And the terminal equipment acquires the control configuration file of the load, which is consistent with the equipment attribute information.
Therefore, when the interactive interface of the load is displayed on the display interface of the control software according to the control configuration file in step S120, the interactive interface consistent with the habit of the user and the terminal device can be displayed, which is convenient for the user to use the control of the load.
For example, the terminal device may send the device attribute information to the movable platform, and after receiving the device attribute information sent by the terminal device, the movable platform may transmit the device attribute information to the load.
For example, after the load acquires the device attribute information of the terminal device from the terminal device, a control configuration file matching the device attribute information may be generated, for example, a control configuration file matching the device attribute information such as language and display resolution may be generated, and then the control configuration file may be transmitted to the movable platform.
The movable platform can acquire the control configuration file consistent with the device attribute information from the load and send the control configuration file to the terminal device.
For example, the terminal device may send device attribute information of the terminal device to an external server, so that the server obtains a control configuration file of the load, which is consistent with the device attribute information; and then the terminal equipment acquires the control configuration file sent by the server.
Specifically, the server may pre-store control configuration files in different languages and adapted to terminal devices of different screen sizes, so as to meet software expansion requirements of different users and terminal devices.
In the software extension method provided in the embodiment of the present specification, the control configuration file of the load of the movable platform is obtained, so that the interactive interface of the load is displayed on the display interface of the control software according to the control configuration file, and the interactive interface for interacting with the load is extended on the basis of the control software for controlling the movable platform, so that a user can control the movable platform and interact between the terminal device and the load without frequently switching different software, and the development workload of a load developer can be reduced.
Referring to fig. 6 in conjunction with the foregoing embodiment, fig. 6 is a flowchart illustrating a software expansion method according to another embodiment of the present application, where the method can be used for a load mounted on a movable platform. The movable platform is in communication connection with the terminal equipment, and the load is in communication with the terminal equipment through the movable platform; and the terminal equipment is provided with control software for controlling the movable platform.
As shown in fig. 6, the software extension method for a load of the embodiment of the present specification includes steps S210 to S220.
S210, acquiring a control configuration file of the load; wherein the control configuration file comprises attribute information of at least one control.
S220, sending the control configuration file to the terminal equipment through the movable platform, so that the terminal equipment can display the interactive interface of the load on a display interface of the control software according to the control configuration file; wherein, the interactive interface is used for displaying the control.
Illustratively, the control profile is generated by the load or stored by the load.
Illustratively, the obtaining the control configuration file of the load includes:
acquiring equipment attribute information of the terminal equipment from the terminal equipment;
and generating a control configuration file matched with the equipment attribute information.
Illustratively, the device attribute information includes at least one of a language used by the terminal device and a screen size.
Illustratively, the method further comprises:
and sending the control information of the load to the terminal equipment through the movable platform.
Illustratively, the sending the control configuration file to the terminal device via the movable platform includes:
if a file acquisition instruction sent by the terminal equipment is acquired, sending the control configuration file to the terminal equipment through the movable platform;
and the file acquisition instruction is sent by the terminal equipment according to the operation of the user on the control information.
Illustratively, the method further comprises:
and if a control instruction sent by the terminal equipment according to the operation of the user on the control is obtained, executing a preset task according to the control instruction.
Illustratively, the method further comprises:
acquiring the running information of the load;
and sending the operation information to the terminal equipment so that the terminal equipment displays the operation information on the interactive interface.
Illustratively, the load includes at least one of a pan/tilt head, a camera, a radar, an air pressure measuring device, a height measuring device, a gas detecting device, a lighting device, and a sound emitting device.
Illustratively, the load-running program includes a service interface adapted to the control software.
The specific principle and implementation manner of the software extension method for a load provided in the embodiment of this specification are similar to those of the software extension method for a terminal device in the foregoing embodiment, and are not described herein again.
Referring to fig. 7 in conjunction with the foregoing embodiment, fig. 7 is a flowchart illustrating a software expansion method according to another embodiment of the present application, where the method can be applied to a movable platform. The movable platform is in communication connection with the terminal equipment, a load is loaded on the movable platform, and the terminal equipment is provided with control software for controlling the movable platform.
As shown in fig. 7, the software extension method for a load of the embodiment of the present specification includes steps S310 to S320.
S310, acquiring a control configuration file of the load; wherein the control configuration file comprises attribute information of at least one control.
S320, sending the control configuration file of the load to the terminal equipment so that the terminal equipment can display the interactive interface of the load on a display interface of the control software according to the control configuration file; wherein, the interactive interface is used for displaying the control.
Illustratively, the obtaining the control configuration file of the load includes:
acquiring equipment attribute information of the terminal equipment from the terminal equipment;
transmitting the equipment attribute information to the load so that the load generates a control configuration file matched with the equipment attribute information;
and acquiring a control configuration file consistent with the equipment attribute information from the load.
Illustratively, the device attribute information includes at least one of a language used by the terminal device, a screen size, and control attribute configuration information.
The specific principle and implementation manner of the software extension method for the movable platform provided in the embodiment of the present specification are similar to those of the software extension method for the terminal device and the software extension method for the load in the foregoing embodiments, and are not described herein again.
In the software extension method provided in the embodiment of the present specification, the control configuration file of the load of the movable platform is sent to the terminal device, so that the terminal device displays the interactive interface of the load on the display interface of the control software according to the control configuration file, and the interactive interface for interacting with the load is extended on the basis of the control software for controlling the movable platform, so that a user can realize control over the movable platform and interaction between the terminal device and the load without frequently switching different software, and the development workload of a load developer can be reduced.
Referring to fig. 8 in conjunction with the foregoing embodiment, fig. 8 is a schematic block diagram of a terminal device 600 according to an embodiment of the present disclosure. The terminal device 600 comprises a processor 601 and a memory 602.
Illustratively, the processor 601 and the memory 602 are coupled by a bus 603, such as an I2C (Inter-integrated Circuit) bus.
Specifically, the Processor 601 may be a Micro-controller Unit (MCU), a Central Processing Unit (CPU), a Digital Signal Processor (DSP), or the like.
Specifically, the Memory 602 may be a Flash chip, a Read-Only Memory (ROM) magnetic disk, an optical disk, a usb disk, or a removable hard disk.
The processor 601 is configured to run a computer program stored in the memory 602, and when executing the computer program, implement the foregoing software extension method for a terminal device.
Specifically, the terminal device 600 can be in communication connection with a movable platform, a load is loaded on the movable platform, and the terminal device 600 communicates with the load through the movable platform.
Illustratively, the processor 601 is configured to run a computer program stored in the memory 602 and to implement the following steps when executing the computer program:
acquiring a control configuration file of the load; wherein the control configuration file comprises attribute information of at least one control;
displaying an interactive interface of the load on a display interface of the control software according to the control configuration file; wherein, the interactive interface is used for displaying the control.
The specific principle and implementation manner of the terminal device provided in the embodiment of this specification are similar to those of the software extension method in the foregoing embodiment, and are not described here again.
In an embodiment of the present specification, a computer-readable storage medium is further provided, where a computer program is stored in the computer-readable storage medium, where the computer program includes program instructions, and the processor executes the program instructions to implement the steps of the software extension method for a terminal device provided in the foregoing embodiment.
The computer-readable storage medium may be an internal storage unit of the terminal device according to any of the foregoing embodiments, for example, a hard disk or a memory of the terminal device. The computer readable storage medium may also be an external storage device of the terminal device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like provided on the terminal device.
Referring to fig. 9 in conjunction with the above embodiments, fig. 9 is a schematic block diagram of a load 700 provided in an embodiment of the present disclosure. The load 700 comprises a processor 701 and a memory 702.
Illustratively, the processor 701 and the memory 702 are connected by a bus 703, such as an I2C (Inter-integrated Circuit) bus.
Specifically, the Processor 701 may be a Micro-controller Unit (MCU), a Central Processing Unit (CPU), a Digital Signal Processor (DSP), or the like.
Specifically, the Memory 702 may be a Flash chip, a Read-Only Memory (ROM) magnetic disk, an optical disk, a usb disk, or a removable hard disk.
The processor 701 is configured to run a computer program stored in the memory 702, and when executing the computer program, implement the software extension method for a load.
Specifically, when the load 700 is mounted on a movable platform, it is possible to communicate with a terminal device, which is equipped with control software for controlling the movable platform.
Illustratively, the processor 701 is configured to run a computer program stored in the memory 702 and to implement the following steps when executing the computer program:
acquiring a control configuration file of the load; wherein the control configuration file comprises attribute information of at least one control;
sending the control configuration file to the terminal equipment through the movable platform, so that the terminal equipment displays an interactive interface of the load on a display interface of the control software according to the control configuration file; wherein, the interactive interface is used for displaying the control.
The specific principle and implementation manner of the load of the movable platform provided in the embodiment of the present specification are similar to those of the software extension method in the foregoing embodiment, and are not described herein again.
In an embodiment of the present specification, a computer-readable storage medium is further provided, where a computer program is stored in the computer-readable storage medium, where the computer program includes program instructions, and the processor executes the program instructions to implement the steps of the software extension method for a load provided in the foregoing embodiment.
The computer-readable storage medium may be an internal storage unit of the load in any of the foregoing embodiments, for example, a hard disk or a memory of the load. The computer readable storage medium may also be an external storage device of the load, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), etc. provided on the load.
Referring to fig. 10 in conjunction with the above embodiments, fig. 10 is a schematic block diagram of a movable platform 800 according to an embodiment of the present disclosure. The movable platform 800 includes a processor 801 and a memory 802.
Illustratively, the processor 801 and the memory 802 are connected by a bus 803.
Illustratively, the movable platform includes at least one of: unmanned vehicles, handheld cloud platform, cloud platform truck.
The processor 801 is configured to run a computer program stored in the memory 802, and when executing the computer program, implement the software extension method for the movable platform.
Illustratively, the processor 801 is configured to run a computer program stored in the memory 802, and when executing the computer program, to implement the following steps:
acquiring a control configuration file of the load; wherein the control configuration file comprises attribute information of at least one control;
sending the control configuration file of the load to the terminal equipment so that the terminal equipment displays an interactive interface of the load on a display interface of the control software according to the control configuration file; wherein, the interactive interface is used for displaying the control.
The specific principle and implementation manner of the movable platform provided in the embodiment of the present specification are similar to those of the software extension method in the foregoing embodiment, and are not described herein again.
In an embodiment of the present specification, a computer-readable storage medium is further provided, where a computer program is stored in the computer-readable storage medium, where the computer program includes program instructions, and the processor executes the program instructions to implement the steps of the software extension method for a movable platform provided in the foregoing embodiment.
The computer readable storage medium may be an internal storage unit of the removable platform described in any previous embodiment, for example, a hard disk or a memory of the removable platform. The computer readable storage medium may also be an external storage device of the removable platform, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), etc. provided on the removable platform.
In the terminal device, the load, the movable platform, and the computer-readable storage medium provided in the foregoing embodiments of the present specification, the terminal device may obtain the control configuration file of the load of the movable platform, so as to display the interactive interface of the load on the display interface of the control software according to the control configuration file, thereby extending the interactive interface for interacting with the load on the basis of the control software for controlling the movable platform, and a user may implement control of the movable platform and interaction between the terminal device and the load without frequently switching different software, and may reduce the development workload of a load developer.
It is to be understood that the terminology used in the description herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the description.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
The above description is only for the specific embodiments of the present disclosure, but the scope of the present disclosure is not limited thereto, and any person skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the present disclosure, and these modifications or substitutions should be covered within the scope of the present disclosure. Therefore, the protection scope of the present specification shall be subject to the protection scope of the claims.

Claims (33)

1. A software extension method is characterized in that the software extension method is used for a terminal device, the terminal device is in communication connection with a movable platform, a load is loaded on the movable platform, and the terminal device is in communication with the load through the movable platform; the terminal equipment is provided with control software for controlling the movable platform; the method comprises the following steps:
acquiring a control configuration file of the load; wherein the control configuration file comprises attribute information of at least one control;
displaying an interactive interface of the load on a display interface of the control software according to the control configuration file; wherein, the interactive interface is used for displaying the control.
2. The method of claim 1, wherein obtaining the control profile for the load comprises:
sending a file acquisition instruction to the load, and acquiring the control configuration file sent by the load according to the file acquisition instruction; or
Acquiring the control configuration file actively sent by the load after the movable platform is in communication connection with the terminal equipment;
wherein the control profile is generated by the load or stored by the load.
3. The method of claim 1, wherein obtaining the control profile for the load comprises:
acquiring control information of the load;
and acquiring a control configuration file of the load according to the control information.
4. The method of claim 3, further comprising:
displaying the control information on a display interface of the control software;
the obtaining the control configuration file of the load according to the control information includes:
and if the operation of the user on the control information is detected, acquiring the control configuration file of the load according to the operation of the control information.
5. The method of claim 3, wherein obtaining the control configuration file of the load according to the control information comprises:
acquiring a control configuration file of the load from an external server according to the control information; and the server stores the control configuration file of the load.
6. The method of claim 5, wherein the control information comprises type information of the load;
the obtaining the control configuration file of the load from an external server according to the control information includes:
and acquiring the control configuration file of the load from an external server according to the type information of the load.
7. The method according to any of claims 3-6, wherein the obtaining the control configuration file of the load according to the control information comprises:
determining whether the terminal equipment stores a control configuration file corresponding to the control information;
if the terminal equipment stores a control configuration file corresponding to the control information, acquiring the stored control configuration file;
and if the terminal equipment does not store the control configuration file corresponding to the control information, acquiring the control configuration file corresponding to the control information from the movable platform and/or the server.
8. The method according to any of claims 1-6, wherein the obtaining the control profile of the load comprises:
acquiring a control configuration file of the load, which is consistent with the equipment attribute information, according to the equipment attribute information of the terminal equipment;
wherein the device attribute information includes at least one of a language used by the terminal device and a screen size.
9. The method according to claim 8, wherein the obtaining the control configuration file of the load according to the device property information of the terminal device, the control configuration file being consistent with the device property information, comprises:
sending the equipment attribute information of the terminal equipment to the load so that the load can acquire a control configuration file consistent with the equipment attribute information;
obtaining the control configuration file sent by the load via the movable platform.
10. The method according to claim 8, wherein the obtaining the control configuration file of the load according to the device property information of the terminal device, the control configuration file being consistent with the device property information, comprises:
sending the equipment attribute information of the terminal equipment to an external server so that the server acquires a control configuration file of the load, which is consistent with the equipment attribute information;
and acquiring the control configuration file sent by the server.
11. The method of any of claims 1-6, wherein the control profile further comprises a control icon for the control;
the displaying the interactive interface of the load on the display interface of the control software according to the control configuration file comprises the following steps:
and displaying the control icon on the interactive interface according to the attribute information of the control.
12. The method of claim 11, further comprising:
and when detecting the operation of the user on the control, executing a function corresponding to the attribute information of the control.
13. The method of claim 12, wherein when detecting the operation of the control by the user, executing a function corresponding to the property information of the control comprises:
and if the operation of the user on the control icon is acquired, sending a control instruction corresponding to the attribute information to the load through the movable platform according to the operation of the control icon, so that the load executes a preset task according to the control instruction.
14. The method according to any one of claims 1-13, further comprising:
acquiring the running information of the load;
and displaying the operation information on the interactive interface.
15. The method of any one of claims 1-6, wherein the load comprises at least one of a pan-tilt, a camera, a radar, a barometric pressure measurement device, a height measurement device, a gas detection device, a lighting device, a sound device.
16. The method of claim 15, wherein the load-running program comprises a service interface adapted to the control software.
17. A software extension method is characterized in that the method is used for a load carried on a movable platform, the movable platform is in communication connection with a terminal device, and the load is in communication with the terminal device through the movable platform; the terminal equipment is provided with control software for controlling the movable platform; the method comprises the following steps:
acquiring a control configuration file of the load; wherein the control configuration file comprises attribute information of at least one control;
sending the control configuration file to the terminal equipment through the movable platform, so that the terminal equipment can display an interactive interface of the load on a display interface of the control software according to the control configuration file; wherein, the interactive interface is used for displaying the control.
18. The method of claim 17, wherein the control profile is generated by the load or stored by the load.
19. The method of claim 18, wherein obtaining the control profile for the load comprises:
acquiring equipment attribute information of the terminal equipment from the terminal equipment;
and generating a control configuration file matched with the equipment attribute information.
20. The method according to claim 19, wherein the device attribute information includes at least one of a language used by the terminal device and a screen size.
21. The method according to any one of claims 17-20, further comprising:
sending the control information of the load to the terminal equipment through the movable platform;
the sending the control configuration file to the terminal device via the movable platform comprises:
if a file acquisition instruction sent by the terminal equipment is acquired, sending the control configuration file to the terminal equipment through the movable platform;
and the file acquisition instruction is sent by the terminal equipment according to the operation of the user on the control information.
22. The method according to any one of claims 17-20, further comprising:
and if a control instruction sent by the terminal equipment according to the operation of the user on the control is obtained, executing a preset task according to the control instruction.
23. The method according to any one of claims 17-22, further comprising:
acquiring the running information of the load;
and sending the operation information to the terminal equipment so that the terminal equipment displays the operation information on the interactive interface.
24. The method of any one of claims 17-20, wherein the load comprises at least one of a pan-tilt, a camera, a radar, a barometric pressure measurement device, a height measurement device, a gas detection device, a lighting device, a sound device.
25. A method according to any of claims 17-20, characterized in that the load-running program comprises a service interface adapted to the control software.
26. A software extension method is characterized by being used for a movable platform, wherein the movable platform is in communication connection with a terminal device, a load is loaded on the movable platform, and the terminal device is provided with control software for controlling the movable platform; the method comprises the following steps:
acquiring a control configuration file of the load; wherein the control configuration file comprises attribute information of at least one control;
sending the control configuration file of the load to the terminal equipment so that the terminal equipment can display the interactive interface of the load on a display interface of the control software according to the control configuration file; wherein, the interactive interface is used for displaying the control.
27. The method of claim 26, wherein obtaining the control profile for the load comprises:
acquiring equipment attribute information of the terminal equipment from the terminal equipment;
transmitting the equipment attribute information to the load so that the load generates a control configuration file matched with the equipment attribute information;
and acquiring a control configuration file consistent with the equipment attribute information from the load.
28. The method according to claim 27, wherein the device attribute information includes at least one of a language used by the terminal device, a screen size, and control attribute configuration information.
29. A terminal device is characterized in that the terminal device can be in communication connection with a movable platform, a load is loaded on the movable platform, and the terminal device is in communication with the load through the movable platform;
the terminal equipment comprises a memory and a processor;
the memory for storing a computer program and at least a computer program of control software for controlling the movable platform;
the processor is configured to execute the computer program and, when executing the computer program, implement the following steps:
acquiring a control configuration file of the load; wherein the control configuration file comprises attribute information of at least one control;
displaying an interactive interface of the load on a display interface of the control software according to the control configuration file; wherein, the interactive interface is used for displaying the control.
30. A load of a movable platform is characterized in that when the load is carried on the movable platform, the load can communicate with a terminal device through the movable platform, and the terminal device is provided with control software for controlling the movable platform;
the load comprises a memory and a processor;
the memory is used for storing a computer program;
the processor is configured to execute the computer program and, when executing the computer program, implement the following steps:
acquiring a control configuration file of the load; wherein the control configuration file comprises attribute information of at least one control;
sending the control configuration file to the terminal equipment through the movable platform, so that the terminal equipment displays an interactive interface of the load on a display interface of the control software according to the control configuration file; wherein, the interactive interface is used for displaying the control.
31. A movable platform is characterized in that the movable platform can be in communication connection with a terminal device, the movable platform is used for carrying a load, and the terminal device is provided with control software for controlling the movable platform;
the movable platform comprises a memory and a processor;
the memory is used for storing a computer program;
the processor is configured to execute the computer program and, when executing the computer program, implement the following steps:
acquiring a control configuration file of the load; wherein the control configuration file comprises attribute information of at least one control;
sending the control configuration file of the load to the terminal equipment so that the terminal equipment displays an interactive interface of the load on a display interface of the control software according to the control configuration file; wherein, the interactive interface is used for displaying the control.
32. The movable platform of claim 31, wherein the movable platform comprises at least one of: unmanned vehicles, handheld cloud platform, cloud platform truck.
33. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program which, when executed by a processor, causes the processor to implement the software extension method of any one of claims 1-28.
CN201980067327.1A 2019-12-18 2019-12-18 Software extension method, terminal device, movable platform, load and storage medium Pending CN112955868A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/126432 WO2021120074A1 (en) 2019-12-18 2019-12-18 Software extension method, terminal device, movable platform, load, and storage medium

Publications (1)

Publication Number Publication Date
CN112955868A true CN112955868A (en) 2021-06-11

Family

ID=76234680

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201980067327.1A Pending CN112955868A (en) 2019-12-18 2019-12-18 Software extension method, terminal device, movable platform, load and storage medium

Country Status (2)

Country Link
CN (1) CN112955868A (en)
WO (1) WO2021120074A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030041236A1 (en) * 2001-08-22 2003-02-27 International Business Machines Corporation Method and system for loading a software platform onto a computer system
CN107077113A (en) * 2014-10-27 2017-08-18 深圳市大疆创新科技有限公司 Unmanned vehicle flight display
CN109062617A (en) * 2018-06-26 2018-12-21 百富计算机技术(深圳)有限公司 A kind of application method, the mobile terminal of platform that supporting polymorphic type equipment
CN110109598A (en) * 2019-05-06 2019-08-09 北京奇艺世纪科技有限公司 A kind of animation interaction implementation method, device and electronic equipment

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10336453B2 (en) * 2016-01-14 2019-07-02 Elwha Llc System and method for payload management for unmanned aircraft
CN106043694B (en) * 2016-05-20 2019-09-17 腾讯科技(深圳)有限公司 A kind of method, mobile terminal, aircraft and system controlling aircraft flight
CN105867422A (en) * 2016-06-08 2016-08-17 南京钟山苑航空技术有限公司 Handheld ground control station of unmanned aerial vehicle
CN107077152A (en) * 2016-11-30 2017-08-18 深圳市大疆创新科技有限公司 Control method, equipment, system, unmanned plane and moveable platform
CN110291363A (en) * 2018-04-26 2019-09-27 深圳市大疆创新科技有限公司 The method and relevant device of the navigation sensor detection of moveable platform

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030041236A1 (en) * 2001-08-22 2003-02-27 International Business Machines Corporation Method and system for loading a software platform onto a computer system
CN107077113A (en) * 2014-10-27 2017-08-18 深圳市大疆创新科技有限公司 Unmanned vehicle flight display
CN109062617A (en) * 2018-06-26 2018-12-21 百富计算机技术(深圳)有限公司 A kind of application method, the mobile terminal of platform that supporting polymorphic type equipment
CN110109598A (en) * 2019-05-06 2019-08-09 北京奇艺世纪科技有限公司 A kind of animation interaction implementation method, device and electronic equipment

Also Published As

Publication number Publication date
WO2021120074A1 (en) 2021-06-24

Similar Documents

Publication Publication Date Title
CN107943489B (en) Data sharing method and mobile terminal
CN107438830B (en) Upgrading method, upgrading device, upgrading equipment and upgrading system
US20140380340A1 (en) Dependency Based Configuration Package Activation
CN108595226B (en) Dynamic loading method and device and computer readable storage medium
CN108021642B (en) Application program recommendation method and device, mobile terminal and storage medium
CN105144197A (en) Image-based application launcher
US10866800B2 (en) Information processing system, client terminal, and control method
US20050143848A1 (en) Output service provision system, virtual object management terminal, mobile object, virtual object management terminal program, mobile object program, and output service provision method
CN105511945B (en) Mobile device and matching method of application program of auxiliary device
WO2021169992A1 (en) Content presentation method and apparatus, terminal device, and computer-readable storage medium
US20140137096A1 (en) Information processing system, information processing apparatus, non-transitory computer-readable storage medium having stored therein information processing program, and information processing method
EP2965299A1 (en) Modifying functionality based on distances between devices
US10165611B2 (en) Bluetooth pairing system and operating method thereof
US10412564B2 (en) Apparatus, method, and system for displaying antenna location of communication terminal, and recording medium
CN109683967B (en) Firmware support method, device, mobile terminal and readable storage medium
US9497271B2 (en) Method, storage medium, and apparatus for performing peer to peer service by using contacts information
CN108199935B (en) Distribution network code display method, terminal, server and computer readable storage medium
CN107908491B (en) Card screen detection and solution method, mobile terminal and computer readable storage medium
US20160343156A1 (en) Information display device and information display program
KR101630812B1 (en) Mobile terminal for connection with terminal guide device and Method for automatically applying terminal environment
KR20200072727A (en) An electornic devid and a method for displaying web contents in augmented reality mode
US20180268817A1 (en) Information processing apparatus, information processing method, and computer program product
KR20200058157A (en) Electronic device and method for providing in-vehicle infortainment service
CN112955868A (en) Software extension method, terminal device, movable platform, load and storage medium
CN111124764A (en) System restoring method, smart television and computer storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination