WO2023065112A1

WO2023065112A1 - Interaction method and apparatus of following tripod head and tripod head system

Info

Publication number: WO2023065112A1
Application number: PCT/CN2021/124681
Authority: WO
Inventors: 谢振生; 常贤茂; 洪俊达
Original assignee: 深圳市大疆创新科技有限公司
Priority date: 2021-10-19
Filing date: 2021-10-19
Publication date: 2023-04-27

Abstract

An interaction method and apparatus (130, 140, 150, 160) of a following tripod head (11) and a tripod head system, which can facilitate a user aligning a lens to a desired shooting target. The method comprises: in a process of controlling a tripod head (11) to follow a base (12) thereof on the basis of target state information of the tripod head (11), calculating in real time an error between current state information of the tripod head (11) and target state information, the state information comprising pose information and/or position information in a predetermined translation direction (21); and displaying the error (22).

Description

Interaction method, device and cloud-tilt system when pan-tilt follows

technical field

The present application relates to the field of control technology, and in particular to an interaction method, device and a pan-tilt system when following a pan-tilt.

Background technique

The gimbal can be used to stabilize the camera. The user uses the gimbal to fix the shooting device, and can shoot stable and smooth pictures even under sports conditions.

At present, during the shooting process of the shooting device, the gimbal can provide the function of following the movement of the base. When the gimbal is following, if the parameter setting is strong, the gimbal following speed is faster, and the user can feel that the target of the gimbal following is the base of the gimbal. However, if the parameter setting is weaker, the gimbal will follow at a slower speed, and the smaller the error, the slower the motion, and it is difficult for the user to predict the motion of the gimbal, which makes it difficult for the user to predict the direction the lens will eventually align, resulting in It is more difficult for the user to aim the lens at the desired shooting target.

Contents of the invention

Embodiments of the present application provide a pan-tilt-following interaction method, device, and pan-tilt system to solve the problem in the prior art that it is difficult for a user to align a lens to a desired shooting target.

In the first aspect, the embodiment of the present application provides a method for interacting with the PTZ when following, including:

According to the state information of the cloud platform target, in the process of controlling the cloud platform to follow its base, calculate the error between the current state information of the cloud platform and the state information of the target in real time; the state information includes attitude information and/or positional information in preset translational directions;

Display the error.

In the second aspect, the embodiment of the present application provides a method for interacting with the PTZ when following, including:

According to the error and the preset position in the current display screen, calculate the corresponding position of the state information of the target in the current display screen, wherein the preset position refers to the current state information of the pan/tilt in the current Display the corresponding position in the screen;

A target position identifier is displayed at a corresponding position of the state information of the target in the current display screen.

In the third aspect, the embodiment of the present application provides a method for interacting with the PTZ when following, including:

Determine the corresponding position of the state information of the cloud platform target in the current display screen; the corresponding position of the state information of the target in the current display screen is in the process of the cloud platform following its base, based on the current state of the cloud platform The error between the state information of the target and the state information of the target and the preset position in the current display screen are calculated, and the preset position refers to the corresponding position of the current state information of the pan/tilt in the current display screen , the state information includes attitude information and/or position information in a preset translation direction;

In the fourth aspect, the embodiment of the present application provides a method for interacting with the PTZ when following, including:

When the current state information of the platform is not the state information of the target, the target position mark is displayed at the target position; the target position is the corresponding position of the state information of the target in the current display screen, and the state information of the target is State information of the target of the pan-tilt in the mode of following the base of the pan-tilt, the state information includes posture information and/or position information in a preset translation direction;

When the current state information of the pan/tilt is the state information of the target, displaying the target position identifier at a preset position in the current display screen.

In the fifth aspect, the embodiment of the present application provides a PTZ follow-up interaction device, the device includes: a memory and a processor;

The memory is used to store program codes;

The processor invokes the program code, and when the program code is executed, performs the following operations:

Display the error.

In a sixth aspect, the embodiment of the present application provides a PTZ follow-up interaction device, the device includes: a memory and a processor;

The memory is used to store program codes;

In the seventh aspect, the embodiment of the present application provides a PTZ follow-up interaction device, the device includes: a memory and a processor;

The memory is used to store program codes;

In an eighth aspect, the embodiment of the present application provides a pan/tilt follow-up interaction device, the device includes: a memory and a processor;

The memory is used to store program codes;

In the ninth aspect, the embodiment of the present application provides a pan-tilt system, and the pan-tilt system includes:

base;

A pan-tilt arranged on the base, the pan-tilt is used to carry a shooting device;

And, for controlling the controller of the pan tilt, the controller is used for:

Display the error.

In a tenth aspect, the embodiment of the present application provides a pan-tilt system, and the pan-tilt system includes:

base;

In an eleventh aspect, the embodiment of the present application provides a pan-tilt system, and the pan-tilt system includes:

base;

In a twelfth aspect, the embodiment of the present application provides a pan-tilt system, and the pan-tilt system includes:

base;

In addition, an embodiment of the present application provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, the computer program includes at least one piece of code, and the at least one piece of code can be executed by a computer to control the computer Executing the method described in any one of the first aspect to the fourth aspect above.

An embodiment of the present application provides a computer program, which is used to implement the method described in any one of the first aspect to the fourth aspect when the computer program is executed by a computer.

In the embodiment of the present application, by displaying to the user the error between the current state information of the pan/tilt and the state information of the target, or displaying to the user the corresponding position of the state information indicating the target of the pan/tilt in the current display screen, so that During the process of the gimbal following the base, the user can expect the movement of the gimbal according to the displayed content, so that the direction in which the lens will be finally aligned can be predicted according to the movement of the gimbal, so that the user can compare the direction in which the lens is finally aligned with the desired direction. When there is a deviation in the expected final alignment direction of the lens, the movement of the base can be adjusted in time so as to timely adjust the expected final alignment direction of the lens, thereby facilitating the user to align the lens to a desired shooting target.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description These are some embodiments of the present application. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

FIG. 1 is a schematic diagram of an application scenario of an interaction method when a pan/tilt follows in an embodiment of the present application;

Fig. 2 is a schematic flow chart of the interaction method when the pan/tilt follows according to an embodiment of the present application;

FIG. 3 is a schematic flow diagram of an interaction method when the pan/tilt follows according to another embodiment of the present application;

4 is a schematic diagram of the relationship between the vertical field of view, the height of the image sensor, and the focal length of the lens provided by the embodiment of the present application;

FIG. 5A is a schematic diagram of the relationship between the first angle and the preset position provided by an embodiment of the present application;

FIG. 5B is a schematic diagram of the relationship between the second angle and the preset position provided by an embodiment of the present application;

FIG. 6 is a schematic diagram of determining a first corresponding position according to an embodiment of the present application;

FIG. 7 is a schematic diagram of the relationship between the target error and the position of the third edge provided by an embodiment of the present application;

FIG. 8 is a schematic diagram of displaying the current location identifier and the target location identifier in the current display screen provided by an embodiment of the present application;

FIG. 9 is a schematic diagram of displaying the current location identifier and the target location identifier in the current display screen provided by another embodiment of the present application;

FIG. 10 is a schematic flow diagram of an interaction method for pan-tilt following provided in another embodiment of the present application;

FIG. 11 is a schematic flow diagram of an interaction method when a pan/tilt follows according to another embodiment of the present application;

FIG. 12 is a schematic flow diagram of an interaction method for pan-tilt following provided in another embodiment of the present application;

FIG. 13 is a schematic structural diagram of an interaction device for pan-tilt following provided by an embodiment of the present application;

FIG. 14 is a schematic structural diagram of an interaction device when a pan/tilt follows according to another embodiment of the present application;

FIG. 15 is a schematic structural diagram of an interaction device for pan-tilt following provided in another embodiment of the present application;

FIG. 16 is a schematic structural diagram of an interaction device for pan-tilt following provided in another embodiment of the present application.

Detailed ways

In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

The method provided in the embodiment of the present application may be applied to the application scenario shown in FIG. 1 . Referring to FIG. 1 , the application scenario may include a pan-tilt 11 and a base 12 , and the pan-tilt 11 may be set on the base 12 .

In some embodiments, the pan/tilt 11 may include an axial stabilization mechanism, the axial stabilization mechanism includes at least one rotating shaft mechanism, and the rotating shaft mechanism includes at least one driving motor and at least one shaft arm rotating around a corresponding axis. Of course, in In some embodiments, the rotating shaft mechanism may not include a shaft arm, but is directly connected to the load through a driving motor. Taking the cloud platform 11 as a three-axis platform as an example, the cloud platform 11 can include three rotating shaft mechanisms, and these three rotating shaft mechanisms can include a drive motor and a pitch axis arm that rotate around the pitch axis, and rotate around the yaw (yaw) axis. ) axis to rotate the drive motor and the yaw axis arm, and the drive motor and the roll axis arm to rotate around the roll axis. It should be understood that the axial stabilization mechanism can adjust the attitude of the gimbal according to the attitude of the base.

In some embodiments, the platform 11 may include a vertical stabilization mechanism, and the vertical stabilization mechanism may directly carry a load so as to be in the vertical direction. It should be understood that the vertical stabilization mechanism can adjust the position of the pan-tilt according to the position of the base. Certainly, the platform 11 may also include a stabilizing mechanism for stabilizing the load such as in the horizontal direction or in the front-back direction.

In some embodiments, the pan/tilt 11 may include an axial stabilization mechanism and a vertical stabilization mechanism. The vertical stabilization mechanism may be arranged between the base 12 and the axial stabilization mechanism for bearing the axial stabilization stabilizing mechanism to stabilize the load on the axial stabilizing mechanism in the vertical direction.

The base 12 can specifically be any type of support structure that can be used to install the pan/tilt 11. Exemplarily, the base 12 can include a handle, a hand-held mechanism, a body of a movable platform, etc., and the movable platform can include an unmanned vehicle , drones, etc.

As shown in FIG. 1 , the application scenario may further include a controller 13 , which may be used to control the pan/tilt 11 . The controller 13 in FIG. 1 is located in the base 12 for example only. When the pan-tilt 11 is in the mode of following its base, the controller 13 can determine the target posture of the pan-tilt 11 according to the current posture of the base 12, and control the posture of the pan-tilt 11 to follow the base according to the target posture of the pan-tilt 11 12; and/or, the controller 13 can determine the target position of the pan/tilt 11 in the preset translation direction according to the current position of the base 12 in the preset translation direction, and according to the preset position of the pan/tilt 11 The target position in the translation direction controls the position of the pan-tilt 11 to follow the position of the base 12 . Wherein, the current posture may be represented by current posture information, the current position may be represented by current position information, the target posture may be represented by target posture information, and the target position may be represented by target position information.

It should be noted that in the embodiments of the present application, both attitude and position can be understood as states, that is, both attitude and position of the pan/tilt can be understood as the state of the pan/tilt. Based on this, when the gimbal 11 is in the mode of following its base, the controller 13 can control the gimbal to follow the base according to the status information of the gimbal target, and the current status of the gimbal can also exist relative to the status information of the gimbal target information, wherein the state information may include posture information and/or position information, and the position information is information on a position in a preset translation direction.

When the pan/tilt includes a vertical stabilization mechanism and does not include an axial stabilization mechanism, the pan/tilt follows its base, specifically, the pan/tilt follows the base in the vertical direction, that is, the position of the pan/tilt in the vertical direction can follow The position of its base in the vertical direction. When the pan/tilt includes an axial stabilization mechanism and does not include a vertical stabilization mechanism, the pan/tilt follows its base specifically may mean that the pan/tilt axially follows the base, that is, the posture of the pan/tilt follows the posture of its base. When the pan/tilt includes an axial stabilization mechanism and also includes a vertical stabilization mechanism, the pan/tilt follows its base specifically can be: the pan/tilt axially follows the base, and the vertical stabilization mechanism is used for stabilization; or, the pan/tilt The platform follows the base vertically, and the axial stabilization mechanism is used for stabilizing; or, the platform follows the base both axially and vertically. Wherein, the axial heel base can be a uniaxial heel, a biaxial heel or a triaxial heel.

The pan/tilt 11 may also include a fixing mechanism for fixing a load, such as a shooting device. The shooting device may be a mobile phone or a camera, for example. Taking the base 12 as the handle as an example, when the user uses the fixed shooting device on the pan-tilt 11 to shoot the desired object, the user can turn the handle of the pan-tilt 11, since the controller 13 can control the attitude of the pan-tilt 11 to follow the handle Therefore, the pan-tilt 11 can rotate following the rotation of the handle, and the rotation of the pan-tilt will drive the camera to rotate, thereby changing the shooting direction of the camera, so that the camera can aim at the shooting target required by the user.

In practical applications, the speed at which the controller 13 controls the pan/tilt 11 to follow the base 12 may be slow. For example, when the pan/tilt 11 can be controlled to follow the base 12 according to the set parameters, when the parameter setting is strong, the pan/tilt follows The speed is fast, and when the parameter setting is weak, the gimbal will follow at a slow speed. When the pan/tilt follows at a slow speed, it is difficult for the user to predict the movement of the pan/tilt, which makes it difficult for the user to predict the direction in which the lens is finally aimed, which makes it difficult for the user to align the lens to the desired shooting target.

In order to solve the technical problem that it is difficult for the user to predict the motion of the pan-tilt when the pan-tilt follows the base, and it is difficult for the user to aim the lens at the shooting target, in the embodiment of this application, the current state information of the pan-tilt and the target's The error between the state information, or display to the user the corresponding position of the state information used to indicate the target of the gimbal in the current display screen, so that the user can expect the gimbal according to the displayed content during the process of the gimbal following the base. Movement, so that the direction in which the lens is finally aligned can be expected according to the movement of the gimbal, so that the user can adjust the movement of the base in time to Adjust the expected direction of the final alignment of the lens in time, so that it is convenient for the user to align the lens to the desired shooting target.

The method provided in the embodiment of the present application can be executed by the interactive device when the pan-tilt is followed, and the specific product form of the interactive device when the pan-tilt is followed can be flexibly implemented according to requirements. In one embodiment, the interaction device when the pan-tilt follows can be included in the pan-tilt system, that is, the method provided in the embodiment of the present application can be executed by the pan-tilt system, for example, the interaction device when the pan-tilt follows can be implemented by the controller 13 , that is, the controller 13 may execute the method provided in the embodiment of the present application. Wherein, the pan/tilt system may include a display device, and the display device may be integrated, for example, integrated in the base, or detachable, for example, detachably connected with the base.

In another embodiment, the interaction device when the pan-tilt follows can be included outside the pan-tilt system, that is, the method provided in the embodiment of the present application can be performed by a device outside the pan-tilt system, for example, the interaction device when the pan-tilt follows can be provided by The control device communicatively connected with the pan-tilt system realizes, that is, the control device communicatively connected with the pan-tilt system can execute the method provided in the embodiment of the present application.

Some implementations of the present application will be described in detail below in conjunction with the accompanying drawings. In the case of no conflict, the following embodiments and features in the embodiments can be combined with each other.

FIG. 2 is a schematic flowchart of a pan-tilt-following interaction method provided by an embodiment of the present application. The execution subject of this embodiment may be an interaction device for pan-tilt following, specifically, a processor of the interaction device. As shown in Figure 2, the method of this embodiment may include:

Step 21, in the process of controlling the pan-tilt to follow its base according to the state information of the pan-tilt target, calculate the error between the current state information of the pan-tilt and the state information of the target in real time; the state The information includes attitude information and/or position information in a preset translation direction.

In this step, the attitude information of the gimbal target refers to the attitude information of the gimbal determined according to the current attitude information of the base in the mode of following the base of the gimbal. According to the attitude information of the gimbal target, the attitude of the gimbal can be controlled to follow the attitude of its base. It should be noted that, regarding the determination of the attitude information of the pan-tilt target and the implementation of controlling the attitude of the pan-tilt to follow the attitude of its base, you can refer to the specific description in related technologies, and will not repeat them here.

The position information of the gimbal target refers to the position information of the gimbal in the preset translation direction determined according to the current position information of the base in the preset translation direction in the mode of following its base. According to the position information of the gimbal target, the position of the gimbal can be controlled to follow the position of its base. In practical applications, the motor drive can be used to maintain the joint angle between the vertical stabilization mechanism and the base, so that the position of the gimbal follows the position of its base. It should be noted that for the implementation of determining the position information of the pan-tilt target and controlling the position of the pan-tilt to follow the position of its base, reference may be made to specific descriptions in related technologies, which will not be repeated here.

The current status information of the gimbal refers to the status information of the gimbal at the current moment, which can be obtained through sensor measurement. Sensor for example can be arranged on the fixing mechanism that is used for fixing shooting device of cloud platform, or can be arranged on the parts (such as the shaft arm of platform) that is fixedly connected with fixing mechanism of cloud platform, or can also be arranged on the shooting device . It should be noted that since the gimbal is fixedly connected to the camera, the current state information of the gimbal can also be considered as the status information of the camera mounted on the gimbal at the current moment.

It should be understood that when the state information includes attitude information, the error between the current state information of the gimbal and the state information of the target includes the attitude error between the current attitude information of the gimbal and the attitude information of the target; When the position information in the translation direction is set, the error between the current state information of the gimbal and the state information of the target includes the current position information of the gimbal in the preset translation direction, and the difference between the current position information of the gimbal in the preset The position error between the position information in the moving direction.

Exemplarily, the current attitude information of the gimbal and the attitude information of the target of the gimbal may be represented by Euler angles or four elements. Take the current attitude information of the gimbal and the attitude information of the target as an example, the four elements of the current attitude information represent q_current, the four elements of the target attitude information represent q_follow_target, and the error between the two q_follow_err , the relationship between the three can satisfy the following formula (1).

q_follow_err=inv(q_current)×q_follow_target Formula (1)

Among them, q_follow_err is a four-dimensional vector, that is, q_follow_err=[q0, q1, q2, q3], and inv(q_current) represents the conjugate quaternion of the quaternion q_current.

Step 22, displaying the error.

In this step, optionally, the calculated error can be directly displayed. For example, when the base is a handle and a display device is provided on the handle, the error can be displayed directly through the display device provided on the handle; or, the The calculated error is sent to other devices/equipment to display the error by other devices/equipment. For example, when the base is a UAV, the error can be sent to the control terminal used to control the UAV to be displayed by the UAV. The control terminal displays the error.

Exemplarily, the error between the calculated current state information of the pan/tilt and the state information of the target can be displayed graphically, that is, the error can be displayed graphically, so that the user can intuitively know the state of the pan/tilt The error between the current position (and/or attitude) and the target position (and/or attitude) is beneficial to improve user experience. In one embodiment, the display error can be superimposed on the current display screen, so that the user can intuitively know the current position (and/or attitude) and target position (and and/or attitude).

Wherein, the currently displayed image refers to the currently displayed shooting image. It should be understood that the currently displayed shooting picture is related to the picture taken by the shooting device mounted on the gimbal. If the shooting picture obtained by shooting is cut and then displayed, the cut shooting picture can be used as the current display picture; if it is The shooting picture obtained by shooting is not cut and displayed, and the uncut shooting picture can be used as the current display picture.

It should be understood that since the pan/tilt can drive the shooting device to rotate, and the rotating shaft mechanism in the pan/tilt will rotate around one or more axes during the process of the pan/tilt following the base, therefore, during the process of the pan/tilt following the base, the photographing device The shooting range of the camera also changes with the attitude of the gimbal, that is, the shooting picture of the shooting device is associated with the attitude of the gimbal.

Optionally, when superimposing and displaying errors, the correlation between the shooting picture and the attitude of the gimbal can be ignored. For example, the thickness of the line between two fixed pixel blocks in the current display picture can be used to represent a certain rotation axis The error in the direction, that is, by displaying a connection line corresponding to the thickness of the error between two pixel blocks in the current display screen, the error in the direction of a certain rotation axis can be superimposed and displayed in the current display screen.

Or optionally, when superimposing and displaying errors, the correlation between the shooting picture and the attitude of the gimbal can be considered. Specifically, the current position indicator can be displayed through the corresponding position of the current state information of the gimbal in the current display picture , and at the corresponding position of the state information of the pan/tilt target in the current display screen, display the target position mark, so as to realize superimposing and displaying the error on the current display screen.

The method provided in this embodiment calculates and displays the error between the current state information of the pan-tilt and the state information of the target in real time during the process of controlling the pan-tilt to follow its base according to the state information of the pan-tilt target, so that During the process of the gimbal following the base, the user can predict the motion of the gimbal according to the displayed error between the gimbal's current attitude and the target attitude, and/or the error between the current position and the target position, so that the user can The movement of the gimbal anticipates the direction in which the lens is finally aligned, so that the user can adjust the movement of the base in time to adjust the expected lens in time when there is a deviation between the direction in which the expected lens is finally aligned and the direction in which the expected lens is finally aligned. The direction of the final alignment, so that it is convenient for the user to align the lens to the desired shooting target.

Fig. 3 is a schematic flow chart of the interaction method of the pan/tilt following provided by another embodiment of the present application. On the basis of the embodiment shown in Fig. 2, this embodiment mainly describes a method of superimposing display errors in the current display screen Specific implementation, as shown in Figure 3, the method of this embodiment may include:

Step 31, during the process of controlling the pan/tilt to follow its base according to the state information of the pan/tilt target, calculate the error between the current state information of the pan/tilt and the state information of the target in real time.

It should be noted that step 31 is similar to step 21 and will not be repeated here.

Step 32, according to the error and the preset position in the current display screen, calculate the corresponding position of the state information of the target in the current display screen, the preset position refers to the current state information of the pan/tilt in the current The corresponding position on the display screen is displayed.

Step 33, displaying the target location mark at the corresponding position of the state information of the target in the current display screen, and displaying the current position mark at the preset position.

It should be understood that the current display screen may be constantly changing, and the current display screen when calculating the corresponding position of the state information of the target may be the same screen as the current display screen when displaying the target position identifier, or may be a different screen, but their corresponding The location is the same location on the screen used to display the current display.

The preset position can be flexibly selected according to requirements, for example, the center position of the screen can be used as the preset position. The selection of the preset position may be related to the composition of the picture, and the focus position set in the screen may be used as the preset position, so that it is convenient for the user to compose the picture.

Since the error may vary during the process of the pan/tilt following its base, the corresponding position of the state information of the pan/tilt target in the current display screen may also vary. Therefore, in the process of the pan/tilt following its base, the display position of the target position mark in the current display screen can change with the change of the current state information of the pan/tilt, and the position difference between the current position mark and the target position mark The difference between the current status information related to the gimbal and the status information of the target.

It should be noted that the corresponding position of the status information of the gimbal target in the current display screen (that is, the position of the target position identifier in the current display screen) is the same as the corresponding position of the current status information of the gimbal in the current display screen (ie The error between the preset position) can represent the error between the current state information of the pan/tilt and the state information of the target. When the error between the current status information of the gimbal and the status information of the target is continuously reduced, the corresponding position of the status information of the target in the current display screen can be continuously approached to the preset position, and the current status information of the gimbal and the status of the target When the information is consistent, the corresponding position of the target's position information in the current display screen is the preset position. In one embodiment, when the current location information of the pan/tilt is consistent with the location information of the target, the current location identifier and the target location identifier can overlap on the current display screen.

Wherein, the current position mark and the target position mark can be the same or different, because the display position of the current position mark is fixed (that is, fixed as a preset position) during the process of the pan/tilt following its base, and the position of the current position mark The displayed position is variable, so although the current position mark is the same as the target position mark, the user can still distinguish which is the current position mark and which is the target position mark. When the current location identifier is different from the target location identifier, for example, the color of the current location identifier may be different from that of the target location identifier, and/or the shape of the current location identifier may be different from that of the target location identifier.

In the embodiment of the present application, when the state information includes posture information, the error may include posture error, and the corresponding position of the state information of the target in the current display screen may include the first corresponding position of the posture information of the target in the current display screen, and the target The position identification may include a first target position identification for characterizing the first corresponding position, step 32 may include determining the first corresponding position according to the attitude error and the preset position in the current display screen, and step 33 may include displaying at the first corresponding position The first target location identifier. When the state information includes position information, the error may include a position error, the corresponding position of the state information of the target in the current display screen may include the second corresponding position of the position information of the target in the current display screen, and the target position identification may include A second target location mark representing the second corresponding position, step 32 may include displaying the second target position mark at the second corresponding position, and step 33 may include displaying the second target position mark at the second corresponding position. Therefore, when the error between the current state information of the pan-tilt and the state information of the target includes the position error and the attitude error, the position error and the attitude error can be displayed separately. Wherein, in order to reduce the number of displayed current location identifiers, the preset location based on which the first corresponding location and the second corresponding location are determined may be the same location.

Based on this, the embodiment of the present application may include the following three situations: 1), the state information includes attitude information but not position information, the first corresponding position is calculated according to the attitude error, and the first target position mark is displayed at the first corresponding position; 2), the state information includes position information but does not include attitude information, calculate the second corresponding position according to the position error, and display the second target position mark at the second corresponding position; 3), the state information includes attitude information and position information, according to the attitude calculating the first corresponding position by error, and displaying the first target position mark at the first corresponding position; and calculating the second corresponding position according to the position error, and displaying the second target position mark at the second corresponding position.

In the following, the method of calculating the first corresponding position according to the attitude error (referred to as method 1) and the method of calculating the second corresponding position according to the position error (referred to as method 2) will be described respectively. It should be understood that mode 1 can be used for the aforementioned case 1), mode 2 can be used for the aforementioned case 2), and mode 1+mode 2 can be used for the aforementioned case 3.

way 1

Optionally, when calculating the corresponding position of the state information of the target in the current display screen, different axes in the gimbal coordinate system may not be distinguished, for example, the overall error size may be calculated according to the error, according to the error size and the preset position , to determine the corresponding position of the state information of the target in the current display screen.

Alternatively, different axes in the gimbal coordinate system may be distinguished when calculating the corresponding position of the state information of the target in the current display screen. Based on this, in one embodiment, the foregoing step 32 may specifically include the following steps A and B.

Step A, according to the attitude error, calculate the error angle on at least one axis under the gimbal coordinate system of the gimbal;

Step B, determining the first corresponding position according to the error angle on the at least one axis and the preset position in the current display screen.

Wherein, at least one axis in the gimbal coordinate system can be all or part of the axes in the gimbal coordinate system, which can be flexibly implemented according to requirements. Exemplarily, at least one axis may include a first axis corresponding to the vertical direction in the current display picture, and/or, a second axis corresponding to the horizontal direction in the current display picture.

The first axis in the gimbal coordinate system refers to the rotation axis that can move the current display screen in the vertical direction when the gimbal rotates around it. Taking the first axis as the y-axis in the gimbal coordinate system as an example, for the error shown in the aforementioned formula (1), the error angle Err_y on the y-axis in the gimbal coordinate system can satisfy the formula (2).

Err_y＝Vy×err_angle Formula (2)

Among them, Vy is the Vy in the rotation axis [Vx, Vy, Vz] of the error q_follow_err represented by four elements, and Vy satisfies the following formula (3); err_angle represents the rotation angle of the error q_follow_err represented by four elements, and err_angle satisfies the following formula (4).

The second axis in the gimbal coordinate system refers to the rotation axis that can move the current display screen in the horizontal direction when the gimbal rotates around it. Taking the second axis as the z-axis in the gimbal coordinate system as an example, for the error shown in the aforementioned formula (1), the error angle Err_z on the z-axis in the gimbal coordinate system can satisfy the formula (5).

Err_z＝Vz×err_angle Formula (5)

Among them, Vz is the Vz in the rotation axis [Vx, Vy, Vz] of the error q_follow_err represented by four elements, Vz satisfies the following formula (6), err_angle represents the rotation angle of the error q_follow_err represented by four elements, and err_angle satisfies the aforementioned formula (4).

Exemplarily, the first corresponding position may be calculated based on a pre-established two-dimensional coordinate system. Based on this, when at least one axis includes the first axis, in an embodiment, step B may specifically include: taking the ratio of the error angle on the first axis to the first angle as the attitude information of the target in the first coordinate system The corresponding vertical coordinates are used to obtain the corresponding vertical position of the attitude information of the target in the current display screen. Therefore, the vertical position of the first target position mark in the current display screen can be linked with the rotation of the first axis. In addition, when the pan/tilt rotates around the first axis, the current display screen can move in the vertical direction, so it can ensure that the pan/tilt The consistency between the rotation around the first axis and the vertical position change of the first target position marker.

Based on this, when at least one axis includes the second axis, in an embodiment, step B may specifically include: using the ratio of the error angle on the second axis to the second angle as the attitude information of the target at the second The corresponding abscissa in a coordinate system is used to determine the corresponding horizontal position of the attitude information of the target in the current display screen. Therefore, the horizontal position of the first target position mark in the current display screen can be linked with the rotation of the second axis. In addition, when the pan/tilt rotates around the second axis, the current display screen can move in the horizontal direction, so it can ensure that the pan/tilt The consistency between the rotation around the second axis and the horizontal position change of the first target position mark.

Wherein, the first angle and the second angle are both related to the preset position, the first coordinate system takes the preset position as the coordinate origin, the horizontal direction of the current display screen is the horizontal axis direction, and the vertical direction of the current display screen is the vertical axis direction Cartesian coordinate system.

The first angle can be understood as an error angle corresponding to a unit length in the direction of the vertical axis in the first coordinate system. Since the edge position of the currently displayed picture in the vertical axis direction is related to the coordinate origin of the first coordinate system (ie the preset position), the distance to the coordinate origin of the first coordinate system is related to the preset position through the first angle, The vertical coordinate of the edge position of the currently displayed picture in the vertical axis direction in the first coordinate system can be the first specific value.

In one embodiment, the first specific value may be 1, and the first angle may also be related to the vertical viewing angle corresponding to the current display screen, so that the vertical position of the first target position in the current display screen can be used to indicate When the gimbal is in the target posture, the subject of the device is photographed.

It should be understood that, when the currently displayed picture is an uncropped shooting picture, the vertical field angle corresponding to the current displayed picture may be equal to the vertical field angle of the shooting device; when the currently displayed picture is a cropped shooting picture, The vertical viewing angle corresponding to the currently displayed image may be smaller than the vertical viewing angle of the photographing device.

Wherein, the vertical field of view fov_h of the photographing device, the height sensor_size_h of the image sensor (sensor) of the photographing device and the focal length of the lens focus_len, the relationship between the three can be shown in Figure 4, according to Figure 4, it can be determined that the three satisfy Formula (7) is as follows.

fov_h＝2×arctan(0.5×sensor_size_h/focus_len) Formula (7)

It should be noted that the error angle on the first axis of the gimbal coordinate system can be positive or negative. When the error angle on the first axis is positive, it can correspond to the positive direction of the vertical axis of the first coordinate system. When the error angle on the axis is negative, it may correspond to the negative direction of the vertical axis of the first coordinate system.

In practical applications, when the number of pixels between the preset position and the two edge positions of the current display screen in the vertical axis direction is different, the first angle can be between the preset position and the first edge position in the current display screen. The field of view corresponding to the number of pixels. Wherein, there are two edge positions in the vertical axis direction of the current display picture, and when the error angle on the first axis is positive, the first edge position can be one of the two edge positions in the positive direction of the vertical axis, the first When the error angle on the axis is negative, the first edge position may be one of the two edge positions in the negative direction of the vertical axis. Therefore, the vertical coordinate of the edge position of the current display picture in the vertical axis direction in the first coordinate system may be 1.

For example, the number of pixels between the preset position and one edge position of the current display screen in the vertical axis direction is twice the number of pixels between the preset position and the other edge position of the current display screen in the vertical axis direction, The relationship between the first angle and the preset position may be as shown in FIG. 5A . In Fig. 5A, the coordinates of the edge position 51 in the first coordinate system with the preset position as the origin of the coordinates are (0, 1), where 1 can correspond to the vertical viewing angle corresponding to 1/3 of the current display screen, that is, the longitudinal The corresponding first angle in the positive direction of the axis can be 1/3 times the vertical viewing angle corresponding to the current display screen; the coordinates of the edge position 52 in the first coordinate system are also (0,1), and 1 can correspond to 2 The vertical viewing angle corresponding to the current display image of /3, that is, the first angle corresponding to the negative direction of the vertical axis may be 2/3 times the vertical viewing angle corresponding to the current display image. Wherein, the edge position 51 and the edge position 52 are two edge positions in the vertical axis direction from the preset position to the current display image.

In practical applications, when the number of pixels between the preset position and the two edge positions of the current display image in the vertical axis direction is the same, the first angle may be equal to 1/2 times the vertical viewing angle corresponding to the current display image. In one embodiment, the preset position is the center position of the current display image, and the first angle is equal to 1/2 times the vertical viewing angle corresponding to the current display image. Therefore, the vertical coordinate of the edge position of the current display picture in the vertical axis direction in the first coordinate system may be 1.

Taking the preset position as the center position of the current display screen, and the current display screen is an uncropped screen as an example, the ordinate y corresponding to the target posture in the first coordinate system can satisfy the following formula (8)

y=2Err_y/fov_h formula (8)

Among them, Err_y represents the error angle on the y-axis in the gimbal coordinate system, and fov_h represents the vertical field of view angle of the camera.

Wherein, the second angle can be understood as an error angle corresponding to a unit length in the direction of the horizontal axis in the first coordinate system. Since the edge position of the currently displayed picture in the vertical axis direction is related to the coordinate origin of the first coordinate system (ie, the preset position), the distance to the coordinate origin of the first coordinate system is related to the preset position through the second angle, It can be made that the abscissa of the edge position of the currently displayed image in the vertical axis direction in the first coordinate system can be the second specific value.

In one embodiment, the second specific value can be 1, and the second angle can also be related to the horizontal field of view corresponding to the current display screen, so that the vertical position of the target position in the current display screen can be used to indicate the pan/tilt Photograph the subject of the device while in the target pose.

It should be understood that when the currently displayed picture is an uncropped shooting picture, the horizontal field of view corresponding to the current displayed picture may be equal to the horizontal field of view of the shooting device; when the currently displayed picture is a cropped shooting picture, The horizontal field of view corresponding to the currently displayed image may be smaller than the horizontal field of view of the photographing device.

Wherein, the horizontal field of view fov_l of the photographing device, the horizontal size sensor_size_l of the image sensor (sensor) of the photographing device, and the focal length of the lens focus_len may satisfy the following formula (9).

fov_l＝2×arctan(0.5×sensor_size_l/focus_len) Formula (9)

It should be noted that the error angle on the second axis of the gimbal coordinate system can be positive or negative. When the error angle on the second axis is positive, it can correspond to the positive direction of the horizontal axis of the first coordinate system. When the error angle on the axis is negative, it can correspond to the negative direction of the horizontal axis of the first coordinate system.

In practical applications, when the number of pixels between the preset position and the two edge positions of the current display screen in the horizontal axis direction is different, the second angle can be between the preset position and the second edge position in the current display screen. The field of view corresponding to the number of pixels. Wherein, there are two edge positions in the direction of the horizontal axis in the current display picture, and when the error angle on the second axis is positive, the second edge position can be one of the two edge positions in the positive direction of the horizontal axis, and the second When the error angle on the axis is negative, the second edge position may be one of the two edge positions in the negative direction of the horizontal axis. Therefore, the abscissa of the edge position of the current display image in the abscissa direction in the first coordinate system may be 1.

As an example, the number of pixels between the preset position and one edge position of the current display screen in the horizontal axis direction is twice the number of pixels between the preset position and the other edge position of the current display screen in the horizontal axis direction, The relationship among the second angle, the preset position and the first coordinate system may be as shown in FIG. 5B . In Fig. 5B, the coordinates of the edge position 61 in the first coordinate system with the preset position as the origin of the coordinates are (1,0), where 1 may correspond to the horizontal viewing angle corresponding to 1/3 of the current display screen, that is, the horizontal field of view. The second angle corresponding to the negative axis direction can be 1/3 times the horizontal viewing angle corresponding to the current display screen; the abscissa of the edge position 62 in the first coordinate system is also (1,0), and 1 in it can be The horizontal viewing angle corresponding to 2/3 of the current display image, that is, the second angle corresponding to the positive direction of the horizontal axis may be 2/3 times the horizontal viewing angle corresponding to the current display image. Wherein, the edge position 61 and the edge position 62 are two edge positions in the horizontal axis direction from the preset position to the current display image.

In practical applications, when the number of pixels between the preset position and the two edge positions of the current display image in the horizontal axis direction is the same, the second angle may be equal to 1/2 times the horizontal viewing angle corresponding to the current display image. In one embodiment, the preset position is the center position of the current display image, and the second angle is equal to 1/2 times the horizontal viewing angle corresponding to the current display image. Therefore, the abscissa of the edge position of the current display image in the abscissa direction in the first coordinate system may be 1.

Taking the preset position as the center position of the current display screen, and the current display screen is an uncropped screen as an example, the abscissa x corresponding to the target posture in the first coordinate system can satisfy the following formula (10)

y=2Err_z/fov_l formula (10)

Among them, Err_z represents the error angle on the z-axis in the gimbal coordinate system, and fov_l represents the horizontal field of view angle of the shooting device.

The horizontal position and vertical position of the first target position mark in the current display screen can be used to indicate the subject of the shooting device when the pan/tilt is in the target posture, so that the user can not only expect The rotation of the gimbal can also predict the change of the lens aimed at the object caused by the rotation of the gimbal, so that the user can predict the direction of the final alignment of the lens according to the rotation of the gimbal and the change of the lens aimed at the object, which is beneficial Improves the accuracy of the user's expected final alignment of the camera.

In addition, when the horizontal position and the vertical position of the first target position mark in the current display screen can be used to indicate that the pan/tilt is in the target posture when shooting the object of the device, the object located in the first target position mark in the current display screen The object that the photographing device expects to capture when following the base can be completed for the posture of the pan/tilt, so that the first target position indicator displayed at the first corresponding position in the current display screen can indicate that the posture of the pan/tilt follows the posture of its base desired subjects. Exemplarily, the object to be photographed may be a movable object, so that the user can aim the lens at the movable object.

Further, since the position of the first target position mark in the current display screen is related to the error between the current attitude information of the pan-tilt and the attitude information of the target and the preset position, and the preset position and the attitude information of the target are determined, so the position of the first target position mark in the current display screen can change with the change of the posture of the pan-tilt, and the posture of the pan-tilt changes with the change of the posture of the base, so the first target position mark The position in the current display screen can change with the posture of the base, so that the first target position mark can be superimposed on the desired object in the current display screen, that is, the first target position mark can be used to clearly indicate to the user The object to be photographed, and can use the function of the gimbal to follow the base to realize the shooting of the object.

Optionally, on the basis that at least one axis includes the first axis and/or the second axis, at least one axis may further include a third axis perpendicular to the first axis or the second axis. Taking the y-axis under the pan-tilt coordinate system as the first axis, and the z-axis as the second axis as an example, the third axis can be, for example, the x-axis under the pan-tilt coordinate system. For the error shown in the aforementioned formula (1), the cloud How can the error angle Err_x on the x-axis in the table coordinate system satisfy formula (11).

Err_x＝Vx×err_angle Formula (11)

Among them, Vx is Vx in the rotation axis [Vx, Vy, Vz] of the error q_follow_err represented by four elements, Vx satisfies the following formula (12), err_angle represents the rotation angle of the error q_follow_err represented by four elements, and err_angle satisfies the aforementioned formula (4).

Optionally, the display gesture of the first target position mark in the current display screen can be linked with the rotation of the third axis. Based on this, the aforementioned displaying the first target position mark at the first corresponding position may specifically include: displaying the first target position mark at the first corresponding position, and rotating the first target position mark by a target angle, the target angle being on the third axis the error angle.

It should be understood that when the position corresponding to the posture information of the target in the current display screen is determined through the first coordinate system in step 32, the determined coordinates corresponding to the posture information of the target in the first coordinate system may be located outside the current display screen. inside, or outside the current display.

When the coordinates corresponding to the posture information of the target in the first coordinate system are located within the current display screen, the position represented by the coordinates corresponding to the posture information of the target in the first coordinate system can be used as the first corresponding position; once there is a target If the coordinates corresponding to the posture information of the target in the first coordinate system are located outside the current display screen, the position indicated by the coordinates corresponding to the posture information of the target in the first coordinate system cannot be used as the first corresponding position.

In order to display the first target position identifier when the corresponding coordinates of the target posture information in the first coordinate system are outside the current display screen, it is necessary to determine the corresponding first corresponding position. In an embodiment, a position other than the preset position in the current display screen may be used as the first corresponding position. Or, in another embodiment, the aforementioned determination of the first corresponding position according to the posture error and the preset position in the current display screen may also include: determining the first corresponding position according to the corresponding coordinates of the target's posture information in the first coordinate system .

Exemplarily, when the coordinates corresponding to the attitude information of the target in the first coordinate system include the aforementioned ordinate and the aforementioned abscissa, determining the first corresponding position according to the coordinates corresponding to the attitude information of the target in the first coordinate system may specifically include : Determining the intersection position of the line connecting the coordinate origin of the first coordinate system to the corresponding positions of the abscissa and ordinate and the edge of the current display screen; and determining the intersection position as the first corresponding position. Therefore, the first target position identifier can be used to represent the direction of the coordinates corresponding to the posture information of the target in the first coordinate system relative to the origin of the coordinates.

For example, assume that the corresponding position of the abscissa and the ordinate is the position x1 in FIG. Line L, the convenient intersection position between line L and the current display screen is position x2, then position x2 can be determined as the corresponding position of the target posture in the current display screen.

way 2

Exemplarily, the second corresponding position may be calculated based on a pre-established one-dimensional coordinate system. Based on this, in one embodiment, according to the position error and the preset position in the current display screen, determining the second corresponding position may include: taking the ratio of the position error to the target error as the corresponding coordinate of the target position in the second coordinate system , to get the second corresponding position. Wherein, the target error is related to the preset position, and the second coordinate system is a one-dimensional coordinate system with the preset position as the coordinate origin and the specific direction of the current display screen as the coordinate axis direction.

Wherein, the target error can be understood as an error distance corresponding to a unit length in the direction of the coordinate axis in the second coordinate system. Since the edge position of the currently displayed screen in the direction of the coordinate axis is related to the coordinate origin of the second coordinate system (ie, the preset position), the distance to the coordinate origin of the second coordinate system is related, so the target error can be related to the preset position. The coordinates of the edge position of the currently displayed picture in the direction of the coordinate axis in the second coordinate system may be a third specific value.

The specific direction can be determined based on the preset translation direction and the current attitude of the shooting device mounted on the gimbal. Exemplarily, when the preset translation direction is the vertical direction, and the current shooting posture of the shooting device is horizontal shooting, that is, the shooting orientation of the shooting device is horizontal, the specific direction may be the vertical direction. Exemplarily, when the preset translation direction is the vertical direction, and the current shooting posture of the shooting device is vertical shooting, that is, the shooting orientation of the shooting device is vertically oriented, the specific direction may be the horizontal direction. By determining the specific direction based on the preset translation direction and the current shooting posture of the shooting device, the movement of the pan/tilt in the preset translation direction and the position change of the second target position mark can be consistent.

On the basis that the specific direction is determined based on the preset translation direction and the current shooting posture of the shooting device, in one embodiment, the third specific value may be 1, and the target error may also be the field of view angle corresponding to the current display screen, and The current focal length of the photographing device is related, so that the position of the second target position identifier in the current display screen can be used to indicate the subject of the photographing device when the pan/tilt is at the target position. When the specific direction is the horizontal direction, the target error may specifically be related to the horizontal viewing angle corresponding to the current display picture; when the specific direction is the vertical direction, the target error may be specifically related to the vertical viewing angle corresponding to the current display picture.

It should be noted that the position error can be positive or negative. When the position error is positive, it can correspond to the positive direction of the coordinate axis of the second coordinate system. When the position error is negative, it can correspond to the negative direction of the coordinate axis of the second coordinate system. .

In practical applications, when the number of pixels between the preset position and the two edge positions of the current display screen in the direction of the coordinate axis of the second coordinate system is different, the target error can be the preset position in the current display screen and the current The corresponding pan-tilt translation distance between the third edge positions in the display screen. Among them, there are two edge positions in a specific direction on the current display screen. When the position error is positive, the third edge position is one of the two edge positions in the positive direction of the coordinate axis. When the position error is negative, the third edge position The position is one of the two edge positions in the negative direction of the coordinate axis. Therefore, the coordinate of the edge position in the direction of the coordinate axis of the current display screen may be 1 in the second coordinate system.

Among them, the pan-tilt translation distance can be understood as the current focal length of the shooting device and the field angle corresponding to the current display picture, by moving the pan-tilt in the preset translation direction, the preset position in the current display picture The screen content of the current display screen is moved to the third edge position along a specific direction, or the screen content at the third edge position in the current display screen is moved to a preset position along a specific direction, the distance that the pan/tilt needs to be translated. Taking both the specific direction and the preset translational direction as the vertical direction, the preset position is the position 71 in FIG. 7 , and the third edge position is the position 72 in FIG. 7 as an example, the position 71 in the specific direction and The displacement between positions 72 is 73, and the pan-tilt translation distance can be the distance 74 in Figure 7. According to the displacement 73, the FOV angle, and the object distance, the pan-tilt translation distance can be converted, and the object distance can be calculated according to the focal length get. It should be noted that in Figure 7, the dashed and solid line rectangles are used to represent the movement of the base of the gimbal in the vertical direction, the ellipse represents the lens, and the angle between the two lines represents the FOV angle .

The position of the second target position mark in the current display screen can be used to indicate the subject of the shooting device when the pan/tilt is at the target position, so that the user can not only predict the position of the pan/tilt according to the displayed current position mark and the second target position mark Movement can also predict the change of the lens aiming object caused by the movement of the pan/tilt, so that the user can predict the direction of the final alignment of the lens according to the movement of the pan/tilt and the change of the lens aiming object, which is conducive to improving user expectations. The resulting accuracy of the final alignment direction of the lens.

In addition, when the position of the second target position mark in the current display screen can be used to indicate the object of the shooting device when the pan/tilt is at the target position, the object located in the second target position mark in the current display screen can be the object of the pan/tilt. The object that the photographing device expects to photograph when the position completes following the base, so that the second target position indicator displayed at the second corresponding position in the current display screen can indicate the desired photographing object during the position of the pan/tilt following the position of its base.

Further, since the position of the second target position mark in the current display screen is related to the error between the current position information of the pan-tilt and the position information of the target and the preset position, and the preset position and the position information of the target are determined, so the position of the second target position mark in the current display screen can change with the change of the position of the pan-tilt, and the position of the pan-tilt changes with the change of the position of the base, thus the second target position mark The position in the current display screen can change with the position of the base, so that the second target position mark can be superimposed on the desired object in the current display screen, that is, the second target position mark can be used to clearly indicate to the user The object to be photographed, and can use the function of the gimbal to follow the base to realize the shooting of the object.

It should be understood that when the position corresponding to the target's position information in the current display screen is determined through the second coordinate system in step 32, the corresponding coordinates of the determined target's position information in the second coordinate system may be located outside the current display screen. inside, or outside the current display.

When the coordinates corresponding to the position information of the target in the second coordinate system are within the current display screen, the position represented by the coordinates corresponding to the position information of the target in the second coordinate system can be used as the second corresponding position; once there is a target If the coordinates corresponding to the position information of the object in the second coordinate system are outside the current display screen, the position indicated by the coordinates corresponding to the position information of the target in the first coordinate system cannot be used as the second corresponding position.

In an embodiment, a position other than the preset position in the current display image may be used as the second corresponding position. Or, in another embodiment, the aforementioned determination of the second corresponding position according to the position error and the preset position in the current display screen may also include: determining the second corresponding position according to the corresponding coordinates of the target's position information in the second coordinate system .

Exemplarily, determining the second corresponding position according to the coordinates corresponding to the position information of the target in the second coordinate system may specifically include: when the coordinates corresponding to the position information of the target in the second coordinate system are positive coordinates, setting the second coordinates The position of the intersection point between the positive direction of the coordinate axis of the coordinate system and the edge of the current display screen is determined as the second corresponding position; when the coordinates corresponding to the position information of the target in the second coordinate system are negative coordinates, the coordinate axis of the second coordinate system is negative The intersection position of the direction and the edge of the current display screen is determined as the second corresponding position.

In the embodiment of the present application, in order to facilitate the user to know whether the coordinates of the target state information in the corresponding coordinate system are inside or outside the current display screen, different processing can be performed when displaying the target position identifier. It should be understood that for the attitude information of the target, its corresponding coordinate system may be the aforementioned first coordinate system; for the target's position information, its corresponding coordinate system may be the aforementioned second coordinate system.

Based on this, in the aforementioned step 33, displaying the target position identification at the corresponding position of the target state information in the current display screen may specifically include: displaying the first type of target at the first target corresponding position of the target state information in the current display screen Position identification, the corresponding position of the first target is obtained by at least one coordinate corresponding to the first state information of the target in the first target coordinate system, at least one coordinate is related to the first error and is located within the current display screen, the first type The target position identifier of is used to indicate that the corresponding coordinates of the first state information of the target in the first target coordinate system are located within the current display screen, wherein the first state information of the target includes the posture information of the target, and the first target coordinate system includes The first coordinate system, the first error includes the attitude error between the current attitude information of the gimbal and the attitude information of the target; and/or, the first state information of the target includes the position information of the target, and the first target coordinate system includes the second In the coordinate system, the first error includes a position error between the current position information of the gimbal and the position information of the target.

It should be noted that the specific form of the first type of target location mark can be flexibly implemented. Exemplarily, the first type of target position mark can include a cross cursor.

Assuming that the second state information of the target includes the posture information of the target, the preset position is the center position of the screen, and at least one axis includes the first axis, the second axis and the third axis, then the posture information of the target corresponds to When both the ordinate and the abscissa of are located within the current display screen, the display effect of displaying the current position mark and the target position mark in the current display screen may be, for example, as shown in FIG. 8 . It should be noted that, in FIG. 8 , both the current position mark and the target position mark are cross cursors for example only.

And/or, in the aforementioned step 33, displaying the target location identifier at the corresponding position of the target status information in the current display screen may specifically include: displaying the second type of icon at the second target corresponding position of the target status information in the current display screen. Target position identification, the corresponding position of the second target is obtained from at least one coordinate in the second target coordinate system of the second state information of the target, at least one coordinate is related to the second error and at least part of the coordinates are located outside the current display screen The target position identifier of the second type is used to indicate that the corresponding coordinates of the second state information of the target in the second target coordinate system are located within the current display screen. Wherein, the second state information of the target includes the attitude information of the target, the second target coordinate system includes the first coordinate system, and the second error includes the attitude error between the current attitude information of the gimbal and the attitude information of the target; and/or, The second state information of the target includes position information of the target, the second target coordinate system includes the second coordinate system, and the second error includes a position error between the current position information of the pan/tilt and the position information of the target.

It should be noted that the specific form of the second type of target location identifier can be flexibly implemented. Exemplarily, the second type of target location identifier may include an arrow pointing to a direction in which the aforementioned connecting line extends from the coordinate origin. Therefore, the effect of the second type of target position identification representing the direction of the corresponding coordinates of the target posture in the corresponding coordinate system relative to the origin of the coordinates is more intuitive. For example, in FIG. 6 , the arrow may point to the direction in which the line L extends from the origin O of the coordinates.

Assuming that the second state information of the target includes the posture information of the target, the preset position is the center position of the screen, and at least one axis includes the first axis and the second axis, then the corresponding ordinate and When the abscissas are all outside the current display screen, the display effect of displaying the current position mark and the target position mark in the current display screen may be as shown in FIG. 9 , for example. It should be noted that the current position marked as a cross cursor in FIG. 9 is only an example.

The method provided in this embodiment calculates the corresponding position of the state information of the target in the current display screen according to the error and the preset position in the current display screen. The preset position refers to the position of the current posture of the pan/tilt in the current display screen. Corresponding position, the target position mark is displayed at the corresponding position of the target's posture information in the current display screen, and the current position mark is displayed at the preset position, which can realize the distance between the current position mark and the target position mark in the current display screen relationship to represent the error relationship between the current state information of the gimbal and the state information of the target, so that the user can understand the error situation more vividly, which is conducive to improving the user experience.

FIG. 10 is a schematic flowchart of a pan-tilt-following interaction method provided by another embodiment of the present application. The execution subject of this embodiment may be an interaction device for pan-tilt following, specifically, a processor of the interaction device. As shown in Figure 10, the method of this embodiment may include:

Step 101, in the process of controlling the pan-tilt to follow its base according to the state information of the pan-tilt target, calculating the error between the current state information of the pan-tilt and the state information of the target in real time; the state The information includes attitude information and/or position information in a preset translation direction.

It should be noted that step 101 is similar to step 21 and will not be repeated here.

Step 102, according to the error and the preset position in the current display screen, calculate the corresponding position of the state information of the target in the current display screen, wherein the preset position refers to the current state of the pan/tilt The corresponding position of the information in the current display screen.

It should be noted that, as for the specific manner of calculating the corresponding position of the target pose in the current display screen according to the error and the preset position, reference may be made to the relevant description in the embodiment shown in FIG. 3 , which will not be repeated here.

Step 103 , displaying a target location identifier at a corresponding position of the state information of the target in the current display screen.

It should be noted that, as for the specific manner of displaying the target location identifier, reference may be made to the relevant description in the embodiment shown in FIG. 3 , which will not be repeated here.

The method provided in this embodiment, in the process of controlling the pan-tilt to follow its base according to the state information of the pan-tilt target, calculates the error between the current state information of the pan-tilt and the state information of the target in real time, according to the error and preset The location calculates the corresponding position of the state information of the target in the current display screen, and displays the target position identification at the corresponding position of the target state information in the current display screen, so that the user can follow the base during the pan/tilt. The corresponding position of the target's status information in the current display screen is used to anticipate the motion of the pan/tilt.

FIG. 11 is a schematic flowchart of a pan-tilt-following interaction method provided by another embodiment of the present application. The execution subject of this embodiment may be an interaction device for pan-tilt following, specifically, a processor of the interaction device. As shown in Figure 11, the method of this embodiment may include:

Step 111, determine the corresponding position of the status information of the pan/tilt target in the current display screen; the corresponding position of the status information of the target in the current display screen is in the process of the pan/tilt following its base, based on the The error between the current state information of the pan/tilt and the state information of the target, and the preset position in the current display screen are calculated, and the preset position refers to the current state information of the pan/tilt in the current display screen The state information includes attitude information and/or position information in a preset translation direction.

In this step, the corresponding position of the state information of the PTZ object in the current display screen can be calculated by the execution subject of this embodiment and a third party other than the PTZ. Regarding the specific manner of the corresponding position of the status information of the third-party computing platform object in the current display screen, refer to the relevant description in the embodiment shown in FIG. 3 , which will not be repeated here.

The specific method for determining the corresponding position of the state information of the PTZ object in the current display screen is not limited in the present application. For example, the state information of the PTZ object can be determined by receiving the indication information sent by a third party and according to the indication information. The corresponding position in the currently displayed screen.

Step 112 , displaying a target location identifier at a corresponding position of the target state information in the current display screen.

The method provided in this embodiment, by determining the corresponding position of the state information of the pan-tilt target in the current display screen, and displaying the target position identification at the corresponding position of the state information of the target in the current display screen, so that the pan-tilt follows the base During the process, the user can anticipate the movement of the pan/tilt according to the corresponding position of the displayed target status information in the current display screen.

FIG. 12 is a schematic flowchart of a pan-tilt-following interaction method provided by another embodiment of the present application. The execution subject of this embodiment may be an interaction device for pan-tilt following, specifically a processor of the interaction device. As shown in Figure 12, the method of this embodiment may include:

Step 121, when the current state information of the platform is not the state information of the target, display the target position identification at the target position; the target position is the corresponding position of the state information of the target in the current display screen, and the target position The status information is the status information of the target of the pan-tilt in the mode of following the base of the pan-tilt, and the status information includes posture information and/or position information in a preset translation direction.

In this step, when the current state information of the pan/tilt is not the state information of the target, the corresponding position of the state information of the target in the current display screen (that is, the target position) is not the preset position. It should be understood that when the current state information of the pan/tilt is approaching the state information of the target, the position of the target may be close to a preset position, and the corresponding position of the state information of the target in the current display screen may be calculated according to the preset position.

The corresponding position of the status information of the object in the current display screen can be obtained by the execution subject of this embodiment, or the execution subject of this embodiment and a third party other than the pan/tilt. It should be noted that, as for the specific manner of calculating the corresponding position of the state information of the pan/tilt object in the current display screen, refer to the related description in the embodiment shown in FIG. 3 , which will not be repeated here.

Step 122, when the current status information of the pan/tilt is the status information of the target, display the target location identifier at a preset position in the current display screen.

In the method provided in this embodiment, when the current state information of the pan/tilt is not the state information of the target, the target position logo is displayed at the target position, and when the current state information of the pan/tilt is the state information of the target, the current display screen The target position mark is displayed at the preset position of the target, so that during the process of the pan-tilt following the base, the user can anticipate the movement of the pan-tilt according to the corresponding position of the displayed target status information in the current display screen.

FIG. 13 is a schematic structural diagram of a pan/tilt follow-up interaction device according to an embodiment of the present application. As shown in FIG. 13 , the device 130 may include: a processor 131 and a memory 132 .

The memory 132 is used to store program codes;

The processor 131 invokes the program code, and when the program code is executed, is used to perform the following operations:

Display the error.

The interactive device for pan/tilt following provided in this embodiment can be used to execute the technical solutions of the method embodiments shown in FIG. 2 and FIG. 3 .

FIG. 14 is a schematic structural diagram of an interaction device when a pan/tilt follows according to another embodiment of the present application. As shown in FIG. 14 , the device 140 may include: a processor 141 and a memory 142 .

The memory 142 is used to store program codes;

The processor 141 invokes the program code, and when the program code is executed, is used to perform the following operations:

The interactive device for pan/tilt follow-up provided in this embodiment can be used to implement the technical solution of the method embodiment shown in FIG. 10 , and its implementation principle and technical effect are similar to those of the method embodiment, and will not be repeated here.

FIG. 15 is a schematic structural diagram of a pan/tilt-following interaction device according to yet another embodiment of the present application. As shown in FIG. 15 , the device 150 may include: a processor 151 and a memory 152 .

The memory 152 is used to store program codes;

The processor 151 invokes the program code, and when the program code is executed, is used to perform the following operations:

The interactive device for pan/tilt following provided in this embodiment can be used to implement the technical solution of the method embodiment shown in FIG. 11 , and its implementation principle and technical effect are similar to those of the method embodiment, and will not be repeated here.

FIG. 16 is a schematic structural diagram of an interaction device for pan/tilt follow provided in another embodiment of the present application. As shown in FIG. 16 , the device 160 may include: a processor 161 and a memory 162 .

The memory 162 is used to store program codes;

The processor 161 invokes the program code, and when the program code is executed, is used to perform the following operations:

The interactive device for pan-tilt follow-up provided in this embodiment can be used to implement the technical solution of the method embodiment shown in FIG. 12 , and its implementation principle and technical effect are similar to those of the method embodiment, and will not be repeated here.

Exemplarily, the interactive device when the pan-tilt follows can specifically be included in the pan-tilt system. Exemplarily, the interactive device when the pan-tilt follows can specifically be the controller of the pan-tilt; or, the interactive device when the pan-tilt follows can specifically It may be included outside the pan-tilt system. Exemplarily, the interaction device when the pan-tilt follows may specifically be a control device connected to the pan-tilt system.

In addition, the embodiment of the present application also provides a pan-tilt system. The structure of the pan-tilt system may include, as shown in FIG. device; and, for controlling the controller 13 of the cloud platform 12, the controller 13 is used for:

In the process of controlling the pan-tilt to follow its base according to the state information of the pan-tilt target, the error between the current state information of the pan-tilt and the state information of the target is calculated in real time, and the state information includes attitude information and/or position information in the preset translation direction, and display the error.

The embodiment of the present application also provides a pan-tilt system. The structure of the pan-tilt system may include: a base 12; a pan-tilt 11 arranged on the base 12, the pan-tilt 11 is used to carry a camera; And, for controlling the controller 13 of the cloud platform 12, the controller 13 is used for:

At the corresponding position of the status information of the target in the current display screen, the target position mark is displayed.

The embodiment of the present application also provides a pan-tilt system. The structure of the pan-tilt system may include: a base 12; a pan-tilt 11 arranged on the base 12, the pan-tilt 11 is used to carry a camera; And, for controlling the controller 13 of the cloud platform 11, the controller 13 is used for:

The above pan/tilt system may further include a control terminal and/or a shooting device, wherein the control terminal may communicate with the controller 13 for controlling the pan/tilt 11 , and the shooting device may be mounted on the pan/tilt 11 .

It can be understood that the controller 13 in the above-mentioned pan/tilt system can also perform other steps, and for details, reference can be made to the content in the above-mentioned related method embodiments, which will not be repeated here.

Those of ordinary skill in the art can understand that all or part of the steps for implementing the above method embodiments can be completed by program instructions and related hardware. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps including the above-mentioned method embodiments; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other various media that can store program codes.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit it; although the application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: It is still possible to modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the various embodiments of the present application. scope.

Claims

A kind of interaction method when the cloud platform follows, it is characterized in that, comprises:

According to the state information of the cloud platform target, in the process of controlling the cloud platform to follow its base, calculate the error between the current state information of the cloud platform and the state information of the target in real time; the state information includes attitude information and/or positional information in preset translational directions;

Display the error.
The method according to claim 1, wherein the displaying the error comprises: graphically displaying the error.
The method according to claim 2, wherein the graphically displaying the error comprises:

In the current display screen, the error is superimposed and displayed.
The method according to claim 3, wherein the superimposing and displaying the error in the current display screen includes:

According to the error and the preset position in the current display screen, calculate the corresponding position of the state information of the target in the current display screen, the preset position refers to the current state information of the pan/tilt in the current display screen corresponding position of

The target position mark is displayed at the corresponding position of the state information of the target in the current display screen, and the current position mark is displayed at the preset position.
The method according to claim 4, characterized in that, the target position mark can indicate a desired shooting object in the process of the pan-tilt following the base.
The method according to claim 5, wherein the position of the target position mark in the current display screen can be changed with the change of the state information of the base, so that the target position mark can be superimposed on the current display screen. The desired subject is displayed on the screen.
The method of claim 6, wherein the desired subject is a movable subject.
The method according to claim 4, characterized in that, during the process of the pan/tilt following the base, the display position of the target position mark in the current display screen can be changed according to the status information of the pan/tilt. The position difference between the current position identifier and the target position identifier is related to the difference between the current state information of the pan/tilt and the state information of the target.
The method according to claim 8, characterized in that, when the current state information of the pan/tilt is consistent with the state information of the target, the current position mark and the target position mark overlap on the current display screen.
The method according to claim 4, characterized in that when the corresponding position of the state information of the target in the current display screen is the preset position, it means that the current state information of the pan/tilt is the position of the target. status information.
The method according to claim 4, wherein when the state information includes the attitude information, the error includes the attitude between the current attitude information of the pan-tilt and the attitude information of the pan-tilt target Error, the corresponding position of the state information of the target in the current display screen includes the first corresponding position of the posture information of the target in the current display screen, and the target position identifier includes the first corresponding position used to characterize the first corresponding position. Target location identification;

The calculating the corresponding position of the state information of the target in the current display screen according to the error and the preset position in the current display screen includes:

determining the first corresponding position according to the posture error and a preset position in the current display screen;

The displaying target position identification at the corresponding position of the state information of the target in the current display screen includes:

Displaying the first target location identifier at the first corresponding location.
The method according to claim 11, wherein the determining the first corresponding position according to the attitude error and the preset position in the current display screen comprises:

According to the attitude error, calculate the error angle on at least one axis under the gimbal coordinate system of the gimbal;

The first corresponding position is determined according to the error angle on the at least one axis and the preset position in the current display screen.
The method according to claim 12, wherein the at least one axis includes a first axis and/or a second axis, the first axis corresponds to the vertical direction in the current display picture, and the second axis corresponds to the vertical direction in the current display picture horizontal direction.
The method according to claim 13, wherein the determining the first corresponding position according to the error angle on at least one axis and the preset position in the current display screen comprises:

Taking the ratio of the error angle on the first axis to the first angle as the ordinate corresponding to the attitude information of the target in the first coordinate system to obtain the corresponding ordinate of the attitude information of the target in the current display screen. vertical position; and/or,

Taking the ratio of the error angle on the second axis to the second angle as the abscissa corresponding to the posture information of the target in the first coordinate system, so as to obtain the corresponding abscissa of the posture information of the target in the current display screen horizontal position;

Wherein, both the first angle and the second angle are related to the preset position, the first coordinate system takes the preset position as the coordinate origin, the horizontal direction of the current display screen is the direction of the horizontal axis, The vertical direction of the current display screen is a Cartesian coordinate system in the direction of the vertical axis.
The method according to claim 14, wherein the first angle is also related to a vertical viewing angle corresponding to the currently displayed picture.
The method according to claim 15, wherein the first angle is an angle of view corresponding to the number of pixels between the preset position and the first edge position in the current display screen;

There are two edge positions in the vertical axis direction of the current display picture, and when the error angle on the first axis is positive, the first edge position is one of the two edge positions in the positive direction of the vertical axis, When the error angle on the first axis is negative, the first edge position is one of the two edge positions in the negative direction of the vertical axis.
The method according to claim 15, wherein the preset position is the center position of the currently displayed image, and the first angle is equal to 1/2 times the vertical viewing angle.
The method according to claim 14, wherein the second angle is also related to the horizontal viewing angle corresponding to the currently displayed picture.
The method according to claim 18, wherein the second angle is an angle of view corresponding to the number of pixels between the preset position and the second edge position in the current display screen;

There are two edge positions in the horizontal axis direction of the current display picture, and when the error angle on the second axis is positive, the second edge position is one of the two edge positions in the positive direction of the horizontal axis, When the error angle on the second axis is negative, the second edge position is one of the two edge positions in the negative direction of the horizontal axis.
The method according to claim 18, wherein the preset position is the center position of the screen, and the second angle is equal to 1/2 times the horizontal viewing angle.
The method according to claim 14, wherein when at least one coordinate corresponding to the attitude information of the target in the first coordinate system is outside the current display screen, the The error angle above and the preset position in the current display screen, determining the first corresponding position, also includes:

The first corresponding position is determined according to the corresponding coordinates of the posture information of the target in the first coordinate system.
The method according to claim 21, wherein when the coordinates of the target's posture information in the first coordinate system include the ordinate and the abscissa, the The coordinates of the information in the first coordinate system to determine the first corresponding position include:

Determining the intersection position of the line connecting the coordinate origin of the first coordinate system to the corresponding positions of the abscissa and the ordinate and the edge of the current display screen;

Determine the position of the intersection point as the first corresponding position.
The method according to claim 13, wherein the at least one axis further includes a third axis, and the third axis is perpendicular to the first axis or the second axis; The corresponding location displays the first target location identifier, including:

The first target position mark is displayed at the first corresponding position, and the first target position mark is rotated by a target angle, where the target angle is an error angle on the third axis.
The method according to claim 4, wherein when the state information includes the position information, the error includes the difference between the current position information of the pan-tilt in the preset translation direction and the position information of the cloud platform. The position error between the position information of the target in the preset translation direction, the corresponding position of the state information of the target in the current display screen includes the second corresponding position of the position information of the target in the current display screen, The target location identifier includes a second target location identifier for characterizing the second corresponding location;

The calculating the corresponding position of the state information of the target in the current display screen according to the error and the preset position in the current display screen includes:

determining the second corresponding position according to the position error and a preset position in the current display screen;

The displaying target position identification at the corresponding position of the state information of the target in the current display screen includes:

displaying the second target location identifier at the second corresponding location.
The method according to claim 24, wherein the determining the second corresponding position according to the position error and the preset position in the current display screen comprises:

The ratio of the position error to the target error is used as the corresponding coordinate of the target position in the second coordinate system to obtain the second corresponding position, the target error is related to the preset position, and the first The two-coordinate system is a one-dimensional coordinate system with the preset position as the coordinate origin and the specific direction of the current display screen as the coordinate axis direction.
The method according to claim 25, wherein the specific direction is determined based on the preset translational direction and the current shooting posture of the shooting device mounted on the pan/tilt.
The method according to claim 26, wherein the preset translation direction is a vertical direction.
The method according to claim 26, wherein the target error is also related to the field angle corresponding to the currently displayed image and the current focal length of the photographing device.
The method according to claim 28, wherein the target error is the corresponding pan-tilt translation distance between the preset position in the current display screen and the third edge position in the current display screen;

There are two edge positions in the specific direction of the currently displayed picture, and when the position error is positive, the third edge position is one of the two edge positions in the positive direction of the coordinate axis, and the position error When negative, the third edge position is one of the two edge positions in the negative direction of the coordinate axis.
The method according to claim 25, characterized in that, when the coordinates of the position information of the target in the second coordinate system are outside the current display screen, according to the position error and the current display screen The preset position, determining the second corresponding position, also includes:

The second corresponding position is determined according to the coordinates corresponding to the position information of the target in the second coordinate system.
The method according to claim 30, wherein the determining the second corresponding position according to the coordinates corresponding to the position information of the target in the second coordinate system comprises:

When the coordinates corresponding to the position information of the target in the second coordinate system are positive coordinates, the intersection position between the positive direction of the coordinate axis of the second coordinate system and the edge of the current display screen is determined as the second corresponding position ;

When the coordinates corresponding to the position information of the target in the second coordinate system are negative coordinates, the intersection position between the negative direction of the coordinate axis of the second coordinate system and the edge of the current display screen is determined as the second corresponding position.
The method according to claim 4, wherein the displaying the target position identification at the corresponding position of the state information of the target in the current display screen comprises:

The first type of target position identification is displayed at the first target corresponding position of the target state information in the current display screen, and the first target corresponding position is corresponded in the first target coordinate system through the first state information of the target At least one coordinate is obtained, the at least one coordinate is related to the first error and is located within the current display screen, and the first type of target position identifier is used to represent the first state information of the target in the first The corresponding coordinates in the target coordinate system are located within the current display screen;

Wherein, the first state information of the target includes the attitude information of the target, the first target coordinate system includes the first coordinate system, and the first error includes the attitude between the current attitude information of the gimbal and the attitude information of the target error; and/or, the first state information of the target includes the position information of the target, the first target coordinate system includes the second coordinate system, and the first error includes the current position information of the platform and the position information of the target The position error between;

Wherein, the first coordinate system is a Cartesian coordinate system with the preset position as the coordinate origin, the horizontal direction of the current display screen as the horizontal axis direction, and the vertical direction of the current display screen as the vertical axis direction; the second coordinate system is A one-dimensional coordinate system with the preset position as the coordinate origin and the specific direction of the current display screen as the coordinate axis direction.
The method of claim 32, wherein the first type of target location marker comprises a crosshair.
The method according to claim 4, wherein the displaying the target position identification at the corresponding position of the state information of the target in the current display screen comprises:

A second type of target position identification is displayed at the second target corresponding position of the target state information in the current display screen, and the second target corresponding position is obtained through the second target state information in the second target coordinate system At least one coordinate is obtained, the at least one coordinate is related to the second error and at least part of the coordinates are located outside the current display screen, and the second type of target position identifier is used to characterize the second state information of the target in the The corresponding coordinates in the second target coordinate system are located within the current display screen;

Wherein, the second state information of the target includes the attitude information of the target, the second target coordinate system includes the first coordinate system, and the second error includes the attitude between the current attitude information of the gimbal and the attitude information of the target Error; and/or, the second state information of the target includes the position information of the target, the second target coordinate system includes the second coordinate system, and the second error includes the current position information of the platform and the position information of the target The position error between;

Wherein, the first coordinate system is a Cartesian coordinate system with the preset position as the coordinate origin, the horizontal direction of the current display screen as the horizontal axis direction, and the vertical direction of the current display screen as the vertical axis direction; the second coordinate system is A one-dimensional coordinate system with the preset position as the coordinate origin and the specific direction of the current display screen as the coordinate axis direction.
The method of claim 34, wherein said second type of target location marker comprises an arrow.
A kind of interaction method when the cloud platform follows, it is characterized in that, comprises:

According to the state information of the cloud platform target, in the process of controlling the cloud platform to follow its base, calculate the error between the current state information of the cloud platform and the state information of the target in real time; the state information includes attitude information and/or positional information in preset translational directions;

According to the error and the preset position in the current display screen, calculate the corresponding position of the state information of the target in the current display screen, wherein the preset position refers to the current state information of the pan/tilt in the current Display the corresponding position in the screen;

A target position identifier is displayed at a corresponding position of the state information of the target in the current display screen.
A kind of interaction method when the cloud platform follows, it is characterized in that, comprises:

Determine the corresponding position of the state information of the cloud platform target in the current display screen; wherein, the corresponding position of the state information of the target in the current display screen is in the process of the cloud platform following its base, based on the cloud The error between the current state information of the platform and the state information of the target, and the preset position in the current display screen are calculated, and the preset position refers to the position of the current state information of the pan/tilt in the current display screen Corresponding to the position, the state information includes posture information and/or position information in a preset translation direction;

A target position identifier is displayed at a corresponding position of the state information of the target in the current display screen.
A kind of interaction method when the cloud platform follows, it is characterized in that, comprises:

When the current state information of the platform is not the state information of the target, the target position mark is displayed at the target position; the target position is the corresponding position of the state information of the target in the current display screen, and the state information of the target is State information of the target of the pan-tilt in the mode of following the base of the pan-tilt, the state information includes posture information and/or position information in a preset translation direction;

When the current state information of the pan/tilt is the state information of the target, displaying the target position identifier at a preset position in the current display screen.
A kind of interaction device when the pan/tilt follows, it is characterized in that the device includes: a memory and a processor;

The memory is used to store program codes;

The processor invokes the program code, and when the program code is executed, performs the following operations:

According to the state information of the cloud platform target, in the process of controlling the cloud platform to follow its base, calculate the error between the current state information of the cloud platform and the state information of the target in real time; the state information includes attitude information and/or positional information in preset translational directions;

Display the error.
The device according to claim 39, wherein the processor is configured to display the error, specifically comprising: displaying the error graphically.
The device according to claim 40, wherein the processor is configured to graphically display the error, specifically comprising:

In the current display screen, the error is superimposed and displayed.
The device according to claim 41, wherein the processor is configured to superimpose and display the error in the current display screen, specifically comprising:

According to the error and the preset position in the current display screen, calculate the corresponding position of the state information of the target in the current display screen, the preset position refers to the current state information of the pan/tilt in the current display screen corresponding position of

The target position mark is displayed at the corresponding position of the state information of the target in the current display screen, and the current position mark is displayed at the preset position.
The device according to claim 42, wherein the target position mark can indicate a desired subject during the process of the pan-tilt following the base.
The device according to claim 43, wherein the position of the target position mark in the current display screen can be changed with the state information of the base, so that the target position mark can be superimposed on the current display screen. The desired subject is displayed on the screen.
The apparatus of claim 44, wherein the desired subject is a movable subject.
The device according to claim 42, characterized in that, during the process of the pan/tilt following the base, the display position of the target position mark in the current display screen can be changed according to the status information of the pan/tilt. The position difference between the current position identifier and the target position identifier is related to the difference between the current state information of the pan/tilt and the state information of the target.
The device according to claim 46, wherein when the current state information of the pan/tilt is consistent with the state information of the target, the current position mark and the target position mark overlap on the current display screen.
The device according to claim 42, characterized in that when the corresponding position of the state information of the target in the current display screen is the preset position, it means that the current state information of the pan/tilt is the position of the target. status information.
The device according to claim 42, wherein when the state information includes the attitude information, the error includes the attitude between the current attitude information of the pan-tilt and the attitude information of the pan-tilt target Error, the corresponding position of the state information of the target in the current display screen includes the first corresponding position of the posture information of the target in the current display screen, and the target position identifier includes the first corresponding position used to characterize the first corresponding position. Target location identification;

The processor is used to calculate the corresponding position of the state information of the target in the current display screen according to the error and the preset position in the current display screen, specifically including:

determining the first corresponding position according to the posture error and a preset position in the current display screen;

The processor is configured to display the target position identifier at the corresponding position of the target state information in the current display screen, specifically including:

Displaying the first target location identifier at the first corresponding location.
The device according to claim 49, wherein the processor is configured to determine the first corresponding position according to the attitude error and a preset position in the current display screen, specifically comprising:

According to the attitude error, calculate the error angle on at least one axis under the gimbal coordinate system of the gimbal;

The first corresponding position is determined according to the error angle on the at least one axis and the preset position in the current display screen.
The device according to claim 50, wherein the at least one axis includes a first axis and/or a second axis, the first axis corresponds to the vertical direction in the current display screen, and the second axis corresponds to the vertical direction in the current display screen horizontal direction.
The device according to claim 51, wherein the processor is configured to determine the first corresponding position according to an error angle on at least one axis and a preset position in the current display screen, specifically comprising:

Taking the ratio of the error angle on the first axis to the first angle as the ordinate corresponding to the attitude information of the target in the first coordinate system to obtain the corresponding ordinate of the attitude information of the target in the current display screen. vertical position; and/or,

Taking the ratio of the error angle on the second axis to the second angle as the abscissa corresponding to the posture information of the target in the first coordinate system, so as to obtain the corresponding abscissa of the posture information of the target in the current display screen. horizontal position;

Wherein, both the first angle and the second angle are related to the preset position, the first coordinate system takes the preset position as the coordinate origin, the horizontal direction of the current display screen is the direction of the horizontal axis, The vertical direction of the current display screen is a Cartesian coordinate system in the direction of the vertical axis.
The device according to claim 52, wherein the first angle is also related to the vertical viewing angle corresponding to the currently displayed picture.
The device according to claim 53, wherein the first angle is an angle of view corresponding to the number of pixels between the preset position and the first edge position in the current display screen;

There are two edge positions in the vertical axis direction of the current display picture, and when the error angle on the first axis is positive, the first edge position is one of the two edge positions in the positive direction of the vertical axis, When the error angle on the first axis is negative, the first edge position is one of the two edge positions in the negative direction of the vertical axis.
The device according to claim 53, wherein the preset position is the center position of the currently displayed image, and the first angle is equal to 1/2 times the vertical viewing angle.
The device according to claim 52, wherein the second angle is also related to the horizontal viewing angle corresponding to the currently displayed picture.
The device according to claim 56, wherein the second angle is an angle of view corresponding to the number of pixels between the preset position and the second edge position in the current display screen;

There are two edge positions in the horizontal axis direction of the current display picture, and when the error angle on the second axis is positive, the second edge position is one of the two edge positions in the positive direction of the horizontal axis, When the error angle on the second axis is negative, the second edge position is one of the two edge positions in the negative direction of the horizontal axis.
The device according to claim 56, wherein the preset position is the center position of the screen, and the second angle is equal to 1/2 times the horizontal viewing angle.
The device according to claim 52, wherein when at least one coordinate corresponding to the posture information of the target in the first coordinate system is outside the current display screen, the processor is further configured to:

The first corresponding position is determined according to the coordinates corresponding to the posture information of the target in the first coordinate system.
The device according to claim 59, wherein when the coordinates of the posture information of the target in the first coordinate system include the ordinate and the abscissa, the processor is configured to The coordinates of the attitude information of the target in the first coordinate system, and determining the first corresponding position, specifically include:

Determining the intersection position of the line connecting the coordinate origin of the first coordinate system to the corresponding positions of the abscissa and the ordinate and the edge of the current display screen;

Determine the position of the intersection point as the first corresponding position.
The device according to claim 51, wherein the at least one axis further includes a third axis, and the third axis is perpendicular to the first axis or the second axis; The first corresponding location displays the first target location identifier, specifically including:

The first target position mark is displayed at the first corresponding position, and the first target position mark is rotated by a target angle, where the target angle is an error angle on the third axis.
The device according to claim 42, wherein when the state information includes the position information, the error includes the difference between the current position information of the pan-tilt in the preset translation direction and the position information of the cloud platform. The position error between the position information of the target in the preset translation direction, the corresponding position of the state information of the target in the current display screen includes the second corresponding position of the position information of the target in the current display screen, The target location identifier includes a second target location identifier for characterizing the second corresponding location;

The processor is used to calculate the corresponding position of the state information of the target in the current display screen according to the error and the preset position in the current display screen, specifically including:

determining the second corresponding position according to the position error and a preset position in the current display screen;

The processor is configured to display the target position identifier at the corresponding position of the target state information in the current display screen, specifically including:

displaying the second target location identifier at the second corresponding location.
The device according to claim 62, wherein the processor is configured to determine the second corresponding position according to the position error and a preset position in the current display screen, specifically comprising:

The ratio of the position error to the target error is used as the corresponding coordinate of the target position in the second coordinate system to obtain the second corresponding position, the target error is related to the preset position, and the first The two-coordinate system is a one-dimensional coordinate system with the preset position as the coordinate origin and the specific direction of the current display screen as the coordinate axis direction.
The device according to claim 63, wherein the specific direction is determined based on the preset translational direction and the current shooting posture of the shooting device mounted on the pan/tilt.
The device according to claim 64, wherein the preset translation direction is a vertical direction.
The device according to claim 64, wherein the target error is also related to the field of view angle corresponding to the currently displayed picture and the current focal length of the shooting device.
The device according to claim 66, wherein the target error is the pan-tilt translation distance corresponding between the preset position in the current display screen and the third edge position in the current display screen;

There are two edge positions in the specific direction of the currently displayed picture, and when the position error is positive, the third edge position is one of the two edge positions in the positive direction of the coordinate axis, and the position error When negative, the third edge position is one of the two edge positions in the negative direction of the coordinate axis.
The device according to claim 63, wherein when the coordinates of the position information of the target in the second coordinate system are outside the current display screen, the processor is further configured to: The coordinates corresponding to the position information in the second coordinate system are determined to determine the second corresponding position.
The device according to claim 68, wherein the processor is configured to determine the second corresponding position according to the coordinates corresponding to the position information of the target in the second coordinate system, specifically comprising:

When the coordinates corresponding to the position information of the target in the second coordinate system are positive coordinates, the intersection position between the positive direction of the coordinate axis of the second coordinate system and the edge of the current display screen is determined as the second corresponding position ;

When the coordinates corresponding to the position information of the target in the second coordinate system are negative coordinates, the intersection position between the negative direction of the coordinate axis of the second coordinate system and the edge of the current display screen is determined as the second corresponding position.
The device according to claim 42, wherein the processor is configured to display a target position identifier at a corresponding position of the target state information in the current display screen, specifically comprising:

The first type of target position identification is displayed at the first target corresponding position of the target state information in the current display screen, and the first target corresponding position is corresponded in the first target coordinate system through the first state information of the target At least one coordinate is obtained, the at least one coordinate is related to the first error and is located within the current display screen, and the first type of target position identifier is used to represent the first state information of the target in the first The corresponding coordinates in the target coordinate system are located within the current display screen;

The first state information of the target includes attitude information of the target, the first target coordinate system includes a first coordinate system, and the first error includes an attitude error between the current attitude information of the gimbal and the attitude information of the target; And/or, the first state information of the target includes the position information of the target, the first target coordinate system includes the second coordinate system, and the first error includes the difference between the current position information of the pan/tilt and the position information of the target. position error;

Wherein, the first coordinate system is a Cartesian coordinate system with the preset position as the coordinate origin, the horizontal direction of the current display screen as the horizontal axis direction, and the vertical direction of the current display screen as the vertical axis direction; the second coordinate system is A one-dimensional coordinate system with the preset position as the coordinate origin and the specific direction of the current display screen as the coordinate axis direction.
The apparatus of claim 70, wherein the first type of target location marker comprises a crosshair.
The device according to claim 42, wherein the displaying the target position identification at the corresponding position of the state information of the target in the current display screen comprises:

A second type of target position identification is displayed at the second target corresponding position of the target state information in the current display screen, and the second target corresponding position is obtained through the second target state information in the second target coordinate system At least one coordinate is obtained, the at least one coordinate is related to the second error and at least part of the coordinates are located outside the current display screen, and the second type of target position identifier is used to characterize the second state information of the target in the The corresponding coordinates in the second target coordinate system are located within the current display screen;

The second state information of the target includes attitude information of the target, the second target coordinate system includes the first coordinate system, and the second error includes an attitude error between the current attitude information of the gimbal and the attitude information of the target; And/or, the second state information of the target includes the position information of the target, the second target coordinate system includes the second coordinate system, and the second error includes the difference between the current position information of the pan/tilt and the position information of the target position error;

Wherein, the first coordinate system is a Cartesian coordinate system with the preset position as the coordinate origin, the horizontal direction of the current display screen as the horizontal axis direction, and the vertical direction of the current display screen as the vertical axis direction; the second coordinate system is A one-dimensional coordinate system with the preset position as the coordinate origin and the specific direction of the current display screen as the coordinate axis direction.
The apparatus of claim 72, wherein the second type of target location marker comprises an arrow.
A kind of interaction device when the pan/tilt follows, it is characterized in that the device includes: a memory and a processor;

The memory is used to store program codes;

The processor invokes the program code, and when the program code is executed, performs the following operations:

According to the state information of the cloud platform target, in the process of controlling the cloud platform to follow its base, calculate the error between the current state information of the cloud platform and the state information of the target in real time; the state information includes attitude information and/or positional information in preset translational directions;

According to the error and the preset position in the current display screen, calculate the corresponding position of the state information of the target in the current display screen, wherein the preset position refers to the current state information of the pan/tilt in the current Display the corresponding position in the screen;

A target position identifier is displayed at a corresponding position of the state information of the target in the current display screen.
A kind of interaction device when the pan/tilt follows, it is characterized in that the device includes: a memory and a processor;

The memory is used to store program codes;

The processor invokes the program code, and when the program code is executed, performs the following operations:

Determine the corresponding position of the state information of the cloud platform target in the current display screen; wherein, the corresponding position of the state information of the target in the current display screen is in the process of the cloud platform following its base, based on the cloud The error between the current state information of the platform and the state information of the target, and the preset position in the current display screen are calculated, and the preset position refers to the position of the current state information of the pan/tilt in the current display screen Corresponding to the position, the state information includes posture information and/or position information in a preset translation direction;

A target position identifier is displayed at a corresponding position of the state information of the target in the current display screen.
A kind of interaction device when the pan/tilt follows, it is characterized in that the device includes: a memory and a processor;

The memory is used to store program codes;

The processor invokes the program code, and when the program code is executed, performs the following operations:

When the current state information of the platform is not the state information of the target, the target position mark is displayed at the target position; the target position is the corresponding position of the state information of the target in the current display screen, and the state information of the target is State information of the target of the pan-tilt in the mode of following the base of the pan-tilt, the state information includes posture information and/or position information in a preset translation direction;

When the current state information of the pan/tilt is the state information of the target, displaying the target position identifier at a preset position in the current display screen.
A kind of cloud platform system, it is characterized in that, described cloud platform system comprises:

base;

A pan-tilt arranged on the base, the pan-tilt is used to carry a shooting device;

And, a controller for controlling the pan/tilt, the controller is used for executing the interaction method according to any one of claims 1 to 38.
A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, the computer program includes at least one piece of code, and the at least one piece of code can be executed by a computer to control the computer to perform the claims The interaction method described in any one of 1 to 38.
A computer program, characterized in that, when the computer program is executed by a computer, it is used to execute the interaction method described in any one of claims 1 to 38.