WO2022061535A1 - Handheld gimbal control method, handheld gimbal, system, and readable storage medium - Google Patents

Handheld gimbal control method, handheld gimbal, system, and readable storage medium Download PDF

Info

Publication number
WO2022061535A1
WO2022061535A1 PCT/CN2020/116894 CN2020116894W WO2022061535A1 WO 2022061535 A1 WO2022061535 A1 WO 2022061535A1 CN 2020116894 W CN2020116894 W CN 2020116894W WO 2022061535 A1 WO2022061535 A1 WO 2022061535A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
handheld
target object
user
pan
Prior art date
Application number
PCT/CN2020/116894
Other languages
French (fr)
Chinese (zh)
Inventor
谢卓
苏铁
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN202080007154.7A priority Critical patent/CN113260942A/en
Priority to PCT/CN2020/116894 priority patent/WO2022061535A1/en
Publication of WO2022061535A1 publication Critical patent/WO2022061535A1/en

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D3/00Control of position or direction
    • G05D3/12Control of position or direction using feedback
    • G05D3/20Control of position or direction using feedback using a digital comparing device
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F16ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
    • F16MFRAMES, CASINGS OR BEDS OF ENGINES, MACHINES OR APPARATUS, NOT SPECIFIC TO ENGINES, MACHINES OR APPARATUS PROVIDED FOR ELSEWHERE; STANDS; SUPPORTS
    • F16M11/00Stands or trestles as supports for apparatus or articles placed thereon Stands for scientific apparatus such as gravitational force meters
    • F16M11/02Heads
    • F16M11/18Heads with mechanism for moving the apparatus relatively to the stand
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F16ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
    • F16MFRAMES, CASINGS OR BEDS OF ENGINES, MACHINES OR APPARATUS, NOT SPECIFIC TO ENGINES, MACHINES OR APPARATUS PROVIDED FOR ELSEWHERE; STANDS; SUPPORTS
    • F16M13/00Other supports for positioning apparatus or articles; Means for steadying hand-held apparatus or articles
    • F16M13/04Other supports for positioning apparatus or articles; Means for steadying hand-held apparatus or articles for supporting on, or holding steady relative to, a person, e.g. by chains, e.g. rifle butt or pistol grip supports, supports attached to the chest or head
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects

Definitions

  • the present application relates to the technical field of PTZ control, and in particular, to a handheld PTZ control method, a handheld PTZ, a system and a readable storage medium.
  • the handheld gimbal brings great convenience to the use of the camera, and people can easily take pictures with stable images and smooth zooming in various scenes and various sports modes.
  • the smart follow mode of the handheld gimbal is often used by users, and the current trigger of the smart follow mode needs to be realized by means of a mobile terminal or a third-party image transmission device installed with an adapted program application.
  • the trigger method is cumbersome and inconvenient for users to use.
  • the shooting parameters of different manufacturers, different series and different models of shooting equipment are different, the existing following algorithms cannot adapt to different manufacturers, different series and different types of shooting equipment, and the following effect is not good.
  • the embodiments of the present application provide a handheld PTZ control method, a handheld PTZ, a system and a readable storage medium, which aim to improve the convenience and following effect of a user controlling a PTZ intelligently following a target object, and improve user experience .
  • an embodiment of the present application provides a method for controlling a handheld PTZ, the handheld PTZ includes a display device, the handheld PTZ is used for carrying a photographing device, and the handheld PTZ is communicatively connected to the photography device , the method includes:
  • the hand-held pan/tilt head is controlled to move, so that the shooting device can follow the shooting of the target object.
  • an embodiment of the present application further provides a handheld pan/tilt, the handheld pan/tilt includes a memory, a processor, and a display device, the handheld pan/tilt is used for carrying a photographing device, and the handheld pan/tilt is connected to the hand-held pan/tilt. Communication connection of shooting equipment;
  • the memory for storing computer programs
  • the processor is configured to execute the computer program and implement the following steps when executing the computer program:
  • the hand-held pan/tilt head is controlled to move, so that the shooting device can follow the shooting of the target object.
  • an embodiment of the present application further provides a shooting system, the shooting system includes the above-mentioned handheld gimbal and a shooting device mounted on the handheld gimbal, the handheld gimbal and the shooting device communication connection.
  • the present application also provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the above-mentioned handheld cloud The steps of the console control method.
  • Embodiments of the present application provide a handheld PTZ control method, a handheld PTZ, a system, and a readable storage medium.
  • a handheld PTZ control method By acquiring a field of view of a shooting device and an image collected in real time by the shooting device, and controlling a display device to display the image, Then, in response to the user's object selection operation on the image displayed on the display device, the target object in the image is determined, and according to the field of view of the shooting device and the position of the target object in the image, the hand-held pan/tilt is controlled to move, so that the shooting device
  • the following shooting of the target object is convenient for the user to control the gimbal to follow the target object intelligently, improve the convenience of the user to control the gimbal to follow the target object intelligently, and also improve the following effect of the handheld gimbal to the target object, which greatly improves the user's ability to follow the target object. experience.
  • FIG. 1 is a schematic structural diagram of a handheld PTZ implementing the method for controlling a handheld PTZ provided by an embodiment of the present application;
  • FIG. 2 is a schematic flowchart of steps of a method for controlling a handheld PTZ provided by an embodiment of the present application
  • FIG. 3 is a schematic diagram of an image displayed by a display device in an embodiment of the present application.
  • FIG. 4 is another schematic diagram of an image displayed by a display device in an embodiment of the present application.
  • FIG. 5 is another schematic diagram of an image displayed by a display device in an embodiment of the present application.
  • FIG. 6 is another schematic diagram of an image displayed by a display device in an embodiment of the present application.
  • FIG. 7 is another schematic diagram of an image displayed by a display device in an embodiment of the present application.
  • FIG. 8 is another schematic diagram of an image displayed by a display device in an embodiment of the present application.
  • FIG. 9 is another schematic diagram of an image displayed by a display device in an embodiment of the present application.
  • FIG. 10 is another schematic diagram of an image displayed by a display device in an embodiment of the present application.
  • FIG. 11 is another schematic diagram of an image displayed by a display device in an embodiment of the present application.
  • FIG. 12 is another schematic diagram of an image displayed by a display device in an embodiment of the present application.
  • FIG. 13 is another schematic diagram of an image displayed by a display device in an embodiment of the present application.
  • FIG. 14 is another schematic diagram of an image displayed by a display device in an embodiment of the present application.
  • 15 is another schematic diagram of an image displayed by a display device in an embodiment of the present application.
  • 16 is a schematic block diagram of the structure of a handheld cloud platform provided by an embodiment of the present application.
  • FIG. 17 is a schematic block diagram of the structure of a photographing system provided by an embodiment of the present application.
  • the handheld gimbal brings great convenience to the use of the camera, and people can easily take pictures with stable images and smooth zooming in various scenes and various sports modes.
  • the smart follow mode of the handheld gimbal is often used by users, and the current trigger of the smart follow mode needs to be realized by means of a mobile terminal or a third-party image transmission device installed with an adapted program application.
  • the trigger method is cumbersome and inconvenient for users to use. , the user experience is not good.
  • FIG. 1 is a schematic structural diagram of a handheld gimbal for implementing the method for controlling a handheld gimbal provided by an embodiment of the present application.
  • the handheld pan/tilt in the embodiment of the present application will be described below with reference to FIG. 1 .
  • the handheld pan/tilt 100 includes a handle portion 101 , a pan/tilt 102 provided on the handle portion 101 , and a display device 103 provided on the handle portion 101 . It can be integrated with the PTZ 102 or externally connected to the PTZ 102 .
  • the pan/tilt 102 includes three-axis motors, which are a pitch (pitch) axis motor 1021 , a roll (roll) axis motor 1022 and a yaw (yaw) axis motor 1023 .
  • the balance posture of the photographing device 104 on the camera can be used to capture a stable and smooth picture.
  • the display device 103 is used to display images collected in real time by the photographing device 104 .
  • the user can also control the pan/tilt 102 or the photographing device 104 mounted on the pan/tilt 102 by touching the display device 103 .
  • the display device 103 is a touch screen.
  • the handheld platform 100 obtains the position coordinates of the touch position of the touch operation in the image, and determines the target object in the image according to the position coordinates, Then, according to the position of the target object in the image, the pan/tilt head 102 is controlled to move, so that the shooting device 104 can follow the shooting of the target object.
  • the display device 103 displays a parameter control slider.
  • an adjustment instruction of the target shooting parameter is triggered, so that the shooting device 104 adjusts the value of the target shooting parameter based on the adjustment instruction, and the target shooting parameter includes focal length, exposure value, sensitivity and shutter speed.
  • the handle portion 101 is further provided with an operation button 105 , so that the user can operate the operation button to control the gimbal 102 or the photographing device 104 mounted on the gimbal 102 .
  • the operation buttons 105 are arranged around the display device 103 .
  • the operation key may be, for example, a key, a trigger, a knob or a rocker, etc., of course, other forms of physical keys are also included.
  • the joystick can be used to control the movement of the three axes, thereby controlling the movement of the gimbal 102 , for example, the buttons can be used to control the gimbal 102 to start up. Understandably, the joystick can also be used for other functions.
  • the display device 103 displays an image containing the frame of the region to be selected, and the image is acquired in real time by the photographing device 104.
  • the handheld pan/tilt 100 responds to the user's first trigger operation on the operation button 105 to obtain the frame of the region to be selected.
  • the current position information in the image; the target object in the image is determined according to the current position information, and the pan/tilt 102 is controlled to move according to the position of the target object in the image, so that the shooting device 104 can follow the target object.
  • the handheld pan/tilt 100 changes the position of the frame to be selected in the image; in response to the user's first trigger operation on the operation button 105, obtains the frame of the to-be-selected area in the image.
  • the current position information in the image; the target object in the image is determined according to the current position information, and the pan/tilt 102 is controlled to move according to the position of the target object in the image, so that the shooting device 104 can follow and shoot the target object.
  • the first trigger operation is different from the second trigger operation.
  • the handheld pan/tilt 100 includes a processor, and the processor is used to process input control instructions, or send and receive signals.
  • the processor may be provided inside the handle portion 101 .
  • the processor may be a central processing unit (Central Processing Unit, CPU), and the processor may also be other general-purpose processors, digital signal processors (Digital Signal Processors, DSP), application specific integrated circuits (application specific integrated circuits) circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
  • a general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
  • the control method of the handheld PTZ provided by the embodiment of the present application will be described in detail with reference to the handheld PTZ in FIG. 1 .
  • the handheld PTZ in FIG. 1 is only used to explain the handheld PTZ control method provided by the embodiments of the present application, but does not constitute a limitation on the application scenarios of the handheld PTZ control methods provided by the embodiments of the present application.
  • FIG. 2 is a schematic flowchart of steps of a method for controlling a handheld PTZ provided by an embodiment of the present application.
  • the hand-held pan-tilt control method includes steps S101 to S104.
  • the existing following algorithms cannot adapt to different manufacturers, different series and different types of shooting equipment, and the following effect is not good.
  • the field of view is adapted to follow the target object, so as to improve the follow-up effect of the handheld gimbal to the target object.
  • the method of acquiring the field of view of the photographing device may be: acquiring the field of view of the photographing device in response to the user's first input operation.
  • the first input operation includes a user's field of view angle input operation on the field of view angle input pop-up window
  • the field of view angle input pop-up window can be displayed by the display device of the handheld pan/tilt or a terminal device connected to the handheld pan/tilt, and the terminal device Can be used for smartphones and tablets etc.
  • the user can display the field of view input pop-up window through the display device or the connected terminal device, and the user can manually input the field of view of the shooting device.
  • the adaptation of the field of view of the device is acquiring the field of view of the photographing device in response to the user's first input operation.
  • the first input operation includes a user's field of view angle input operation on the field of view angle input pop-up window
  • the field of view angle input pop-up window can be displayed by the display device of the handheld pan/tilt
  • the manner of acquiring the field of view of the photographing device may further be: acquiring the field of view of the photographing device based on a preset angle of view calibration operation.
  • the preset field-of-view calibration operation may be set based on the actual situation, which is not specifically limited in this embodiment of the present application.
  • control the hand-held gimbal to rotate, and control the shooting device to take pictures when the hand-held gimbal is in the first posture obtain the first image
  • control the shooting device to take pictures to obtain the second image and then according to the position difference of the same object in the first image and the second image and the handheld gimbal in the first posture
  • the rotation angle between the second posture and the second posture determines the field of view of the photographing device.
  • the FOV of the shooting device can be obtained without the need for the user to manually input the FOV of the shooting device, and the FOV of the shooting device can be accurately determined, which is convenient for subsequent follow-up based on the accurate FOV Following the target object enables the shooting device to better follow the target object, improves the following effect, and greatly improves the user experience.
  • the method of acquiring the field of view of the photographing device may be: acquiring the first image obtained by the photographing device in the first posture of the handheld gimbal and the second posture.
  • the first image obtained by shooting; the field of view angle of the shooting device is determined according to the position difference of the same object in the first image and the second image and the rotation angle of the handheld platform between the first posture and the second posture.
  • the method of acquiring the first image captured by the handheld gimbal in the first posture and the first image captured in the second posture may be: acquiring the triggered field angle calibration instruction, and according to the The field of view angle calibration command controls the rotation of the handheld gimbal; when the handheld gimbal is in the first attitude, it controls the shooting device to take pictures to obtain the first image; when the handheld gimbal is in the second attitude, it controls the shooting device to take pictures and obtains the second image. image.
  • the FOV calibration command can be triggered by the user operating the FOV calibration button. Of course, the user can also trigger in other ways, for example, through the FOV calibration icon displayed by the display device or the terminal device connected to the handheld pan/tilt.
  • the device identification of the photographing device is obtained, and whether the device identification exists in the device identification library of the handheld cloud platform, if the device identification does not exist in the device identification library.
  • device identification output the FOV calibration prompt information to prompt the user to calibrate the FOV of the shooting device; in response to the user's triggering operation on the FOV calibration button, trigger the FOV calibration instruction; if the device ID library exists The device ID is not processed.
  • the device identification is used to identify the manufacturer, series and/or model of the photographing device.
  • the prompt information for the calibration of the field of view is output, which facilitates the user to calibrate the field of view of the shooting device in time.
  • S102 Acquire an image captured by the photographing device in real time, and control the display device to display the image.
  • the handheld gimbal can be connected to the photographing device through a control line, such as a shutter release line.
  • a control line such as a shutter release line.
  • the type of the shutter release cable is not limited here, for example, the shutter release cable may be a Universal Serial Bus (Universal Serial Bus, USB).
  • the handheld gimbal can also be connected to the shooting device wirelessly, for example, the handheld gimbal is connected to the shooting device through Bluetooth.
  • Scaling, image enhancement and/or cropping processing is performed to obtain a target image, which is then displayed on a display device. Due to the small size of the display device, it is inconvenient for users to read. Therefore, by performing scaling, image enhancement and/or cropping processing on the image, and then displaying the processed image on the display device, the display effect of the image can be improved and the user can browse easily.
  • the handheld pan/tilt includes a handle portion, a pan/tilt provided on the handle portion, and a display device provided on the handle portion.
  • the user can select the target object to be followed through the image displayed by the display device, for example, the user touches a certain area in the image to determine the target object to be followed .
  • the object selection operation includes a user's touch operation on the image
  • the method of determining the target object in the image may be: in response to the user's operation on the display device.
  • the touch operation on the image obtain the position coordinates of the touch position of the touch operation in the image; according to the position coordinates, determine the target object in the image, that is, obtain the target image area corresponding to the position coordinates from the image , and perform target recognition on the object in the target image area, and then use the recognized object as the target object to be followed.
  • the target object can be determined, and it does not need to be realized through a mobile terminal or a third-party image transmission device installed with an adapted program application, which greatly improves the user's ability to control the PTZ's intelligence.
  • a mobile terminal or a third-party image transmission device installed with an adapted program application which greatly improves the user's ability to control the PTZ's intelligence.
  • FIG. 3 is a schematic diagram of an image displayed by a display device in an embodiment of the present application. As shown in If you touch the area where the displayed object 13 is located, the handheld gimbal responds to the touch operation, taking the object 13 as the target object to be followed, and if you touch the area where the displayed object 12 is located, the handheld gimbal responds to the touch. Operation, take object 12 as the target object to be followed.
  • the method of determining the target object in the image may be: according to the length and width information of the display device and the length and width information of the image, determine the coordinate conversion relationship; according to the coordinate conversion relationship, the position coordinate Convert to obtain the target position coordinates, and determine the target object in the image according to the target position coordinates. Since the image displayed by the display device is an image after coordinate conversion, the position coordinates can be converted through the length and width information of the display device and the length and width information of the image, and then the image can be accurately determined based on the converted position coordinates. target object in .
  • a frame to be selected is displayed in the image
  • the handheld pan/tilt also includes operation buttons
  • the object selection operation includes a first trigger operation of the operation button by the user, and in response to the user's object selection operation on the image
  • the method of determining the target object in the image may be: in response to the user's first triggering operation on the operation button, obtaining current position information of the frame to be selected in the image; and determining the target object in the image according to the current position information.
  • the to-be-selected area frame may be located in the center of the image
  • the operation button may include a button disposed around the display device
  • the first trigger operation includes any one of the user's click operation, long-press operation and double-click operation on the button .
  • the target object can be determined through the first trigger operation of the operation button, which does not need to be realized by a mobile terminal or a third-party image transmission device installed with an adapted program application, which greatly improves the convenience of the user to control the PTZ to follow the target object intelligently. properties and improve user experience.
  • FIG. 4 is another schematic diagram of an image displayed by a display device in an embodiment of the present application.
  • the image displayed by the display device includes object 11, object 12, object 13, and a candidate for selection.
  • the area frame 14, when detecting the user's double-click operation on the button, performs target recognition on the image area where the area frame 14 to be selected is located. Since there is no target in the image area where the area frame 14 to be selected is located, the display device can output " "Target not recognized" prompt message, as shown in Figure 5, the object 13 moves, and the object 13 is located in the to-be-selected area frame 14.
  • the to-be-selected area frame 14 Performing target recognition in the image area where the target area frame 14 is located because the object 13 exists in the image area where the area frame 14 to be selected is located, therefore, the object 13 is taken as the target object.
  • the method of determining the target object in the image may also be: in response to the user's second trigger operation on the operation button, changing the position of the frame to be selected in the image. ; in response to the user's first trigger operation on the operation button, obtain the current position information of the frame to be selected in the image; according to the current position information, determine the target object in the image.
  • the position of the area frame to be selected is changed through the second trigger operation of the operation button to change the target object selected by the user, and then the selected target object is determined through the first trigger operation of the operation button, which greatly improves user control.
  • the convenience of the PTZ intelligently follows the target object and improves the user experience.
  • the method of changing the position of the frame to be selected in the image may be: performing target recognition on the image to determine whether there is an object in the image, and if there is an object in the image, If there is an object, according to the second trigger operation, move the to-be-selected area frame to the image area where the object is located to change the position of the to-be-selected area frame in the image, and when there are multiple objects in the image, according to the second trigger operation , select an object from multiple objects as a candidate object, and move the frame of the region to be selected to the image area where the candidate object is located, so as to change the position of the frame of the region to be selected in the image.
  • the first trigger operation is different from the second trigger operation.
  • the first trigger operation is a double-click operation
  • the second trigger operation is a single-click operation.
  • the operation buttons include a first operation button and a second operation button.
  • the triggering operation includes the user's triggering operation on the first operation button, which may be, for example, a double-click operation on the button
  • the second triggering operation includes the user's triggering operation on the second operation button, which may be, for example, a stick operation on a joystick.
  • the object 13 is located in the to-be-selected area frame 14, and if the user clicks the button at this time, the to-be-selected area frame 14 changes from the position shown in FIG. 6 or the position shown in FIG. 7 , that is, the area frame 14 to be selected is moved to the area where the object 11 or the object 12 is located. At this time, when the user double-clicks the button, the object 11 or the object located in the area frame 14 to be selected will be moved. 12 as the target object.
  • the to-be-selected area frame 14 is composed of the area shown in FIG. 4 .
  • the position shown is changed to the position shown in FIG. 8, that is, the object 12 is located in the area frame 14 to be selected, and if the user continues to hit the stick to the right, the area frame 14 to be selected changes from the position shown in FIG. 9, that is, the object 13 is located in the to-be-selected area frame 14, and if the user continues to move the stick to the right at this time, the to-be-selected area frame 14 changes from the position shown in FIG. 9 to the position shown in 10 , that is, the object 11 is located in the to-be-selected area frame 14 .
  • the target control coefficient of the control loop of the hand-held gimbal is controlled, and the movement of the hand-held gimbal is controlled according to the target control coefficient and the position of the target object in the image.
  • the control loop is a PID controller
  • the target control coefficients include a proportional control coefficient P, an integral control coefficient I, and a differential control coefficient D.
  • the target control coefficient of the control loop of the handheld gimbal is determined by the field of view of the shooting device. Based on the determined target control coefficient and the position of the target object in the image, the handheld gimbal can be controlled to better follow the target object and improve the following effect. , which greatly improves the user experience.
  • the position of the target object in the image is used as the reference position, and the current live view picture collected by the shooting device is acquired at preset time intervals; the position of the target object in the current live view picture is determined, and the The current position, and according to the current position of the target object, the position of the base station and the target control coefficient, control the movement of the handheld gimbal, so that the difference between the position of the target object in the current live view screen and the position of the base station is less than the preset position difference .
  • the difference between the preset time and the preset position may be set based on the actual situation, which is not specifically limited in this application.
  • the control loop is a PID control loop, and the P (proportional) coefficient in the target control coefficients calibrated according to the field of view angle is large. At this time, due to the hysteresis of the control loop, it will cause the hand-held gimbal to shake after overshoot. , resulting in a decrease in the quality of the film.
  • the target control coefficient is adjusted; according to the position of the target object in the image and the adjusted target control coefficient, the movement of the handheld gimbal is controlled.
  • the second input operation may be a user's turning operation on the dial key, or may be a user's touch operation on the control coefficient adjustment icon displayed by the display device or the terminal device.
  • control authority of the control loop may be opened to the user, and in response to the user's second input operation, the method of adjusting the target control coefficient may be: in response to the user's second input operation, reading the Control the coefficient adjustment amount, and adjust the target control coefficient according to the control coefficient adjustment amount; or in response to the user's second input operation, obtain the target control gear from a plurality of control gears, and use the control coefficient corresponding to the target control gear as the adjusted target control coefficient.
  • 1-30 control gears can be opened, each control gear corresponds to a set of control coefficients, and a target control gear can be determined among the above control gears through the second input operation of the user, and the target control gear The corresponding control coefficient is used as the adjusted target control coefficient.
  • the target control coefficient is adjusted; according to the position of the target object in the image and the adjusted target control coefficient, Control the movement of the handheld gimbal.
  • the gimbal can detect the movement of the gimbal through the built-in IMU (Inertial Measurement Unit), and based on the detected information, you can know whether a preset jitter event occurs in the gimbal.
  • IMU Inertial Measurement Unit
  • the proportional coefficient P in the PID control loop can generally be reduced.
  • the amount of control is reduced, which in turn reduces jitter due to overshoot.
  • the proportional coefficient P can be decreased step by step to keep it in a reasonable adjustment range.
  • the motion control amount input by the pan-tilt control part is obtained;
  • the gimbal moves to change the position of the target object within the image.
  • the pan-tilt control component includes any one of a joystick and a dial key
  • the trigger operation includes any one of a user's operation on the joystick and a user's rotation operation on the dial key.
  • the target object 21 is located in the central area of the image.
  • the hand-held pan/tilt is controlled to move, so that the position of the target object 21 in the image is determined by: The center position shown in FIG. 21 is changed to the left area position shown in FIG. 12 .
  • control the movement of the handheld pan/tilt to change the position of the target object in the image first control the handheld pan/tilt to suspend following the target object, and after suspending the tracking of the target object , according to the motion control amount, control the movement of the hand-held gimbal to change the position of the target object in the image.
  • the handheld gimbal within a preset time after responding to the trigger operation, if it is detected that the control part of the gimbal is not operated, the handheld gimbal is controlled to continue to follow the target object.
  • the preset time may be set based on the actual situation, which is not specifically limited in this application, for example, the preset time is 2 seconds.
  • the method of acquiring the motion control amount input by the pan-tilt control part may be: in response to the user's operation of the joystick, determining the first position of the hand-held pan-tilt control part.
  • the first rotation control amount of a target motor at the same time, in response to the user's rotation operation on the dial key, determine the second rotation control amount of the second target motor of the handheld pan-tilt head; according to the first rotation control amount, control the hand-held pan-tilt head
  • the first target motor rotates, and according to the second rotation control amount, the second target motor of the handheld gimbal is controlled to rotate.
  • the first target motor is different from the second target motor
  • the first target motor includes any one of a pitch axis motor, a translation axis motor and a roll axis motor
  • the second target motor includes a pitch axis motor, a translation axis motor and a roll axis motor Either of the roller motors.
  • an identification icon is displayed on each object to be followed.
  • the identification icon whose object to be followed is the target object is the first identification icon
  • the identification icon whose object to be followed is not the target object is the second identification icon
  • the first identification icon is different from the second identification icon
  • the first identification icon It includes a first rectangular frame
  • the second identification icon includes a second rectangular frame. The color of the first rectangular frame and the second rectangular frame is different.
  • the tracking logo is displayed in the first rectangular frame, and the second rectangular frame is displayed.
  • tracking mark displayed inside, and the specific form of the tracking mark can be set according to the actual situation, such as a five-pointed star.
  • the image displayed by the display device includes three objects to be followed, namely the object to be followed 31 , the object to be followed 32 and the object to be followed 33 , and the object to be followed 31 , the object to be followed 32 and the
  • the identification icons on the object to be followed 33 are the identification icon 34, the identification icon 35 and the identification icon 36 respectively, and the object to be followed 31 is the target object, therefore, the identification icon 34 displays the tracking mark 37, the identification icon 35 and the identification icon 36 Trace marks are not shown.
  • an object to be followed in response to a user's triggering operation on the object switching component, an object to be followed is re-selected from a plurality of objects to be followed as the target object.
  • the object switching part of the handheld gimbal is set on the handle part, the object switching part is used to switch the target object to follow, and the object switching part includes a joystick, dial keys and buttons, etc. After re-selecting the target object, adjust the object to be followed
  • the identification icon on the re-selected target object is the first identification icon.
  • the object to be followed 31 is the target object. If the user operates the object switching component at this time, the target object changes from the object to be followed 31 shown in FIG. 13 to the object to be followed as shown in FIG. 14 .
  • the tracking mark 37 changes from the position shown in FIG. 13 to the position shown in FIG. 14, that is, the tracking mark 37 is located at the identification icon 35 of the object to be followed 32, or the target object is shown in FIG. 13.
  • the object to be followed 31 is changed to the object to be followed 33 as shown in Figure 15, and the tracking mark 37 is changed from the position shown in Figure 13 to the position shown in Figure 15, that is, the tracking mark 37 is located at the position of the object to be followed 33. logo icon 36.
  • the handheld pan-tilt control method obtained by the above-mentioned embodiments obtains the field of view of the photographing device and the image collected in real time by the photographing device, and controls the display device to display the image, and then responds to the user's selection of the object of the image displayed on the display device. Operation, determine the target object in the image, and control the movement of the handheld gimbal according to the field of view of the shooting device and the position of the target object in the image, so that the shooting device can follow the target object, and it is convenient for the user to control the intelligent gimbal. Following the target object improves the convenience for the user to control the PTZ intelligently following the target object, and can also improve the tracking effect of the handheld PTZ to the target object, which greatly improves the user experience.
  • FIG. 16 is a schematic block diagram of the structure of a handheld gimbal provided by an embodiment of the present application.
  • the handheld pan/tilt 200 includes a processor 201, a memory 202, and a display device 203.
  • the processor 201, the memory 202, and the display device 203 are connected through a bus 204, such as an I2C (Inter-integrated Circuit) bus. .
  • I2C Inter-integrated Circuit
  • the processor 201 may be a micro-controller unit (Micro-controller Unit, MCU), a central processing unit (Central Processing Unit, CPU), or a digital signal processor (Digital Signal Processor, DSP) or the like.
  • MCU Micro-controller Unit
  • CPU Central Processing Unit
  • DSP Digital Signal Processor
  • the memory 202 may be a Flash chip, a read-only memory (ROM, Read-Only Memory) magnetic disk, an optical disk, a U disk, or a removable hard disk, or the like.
  • ROM Read-Only Memory
  • the memory 202 may be a Flash chip, a read-only memory (ROM, Read-Only Memory) magnetic disk, an optical disk, a U disk, or a removable hard disk, or the like.
  • the processor 201 is used for running the computer program stored in the memory 202, and implements the following steps when executing the computer program:
  • the hand-held pan/tilt head is controlled to move, so that the shooting device can follow the shooting of the target object.
  • the acquiring the field of view of the photographing device includes performing any of the following operations:
  • the viewing angle is acquired based on a preset viewing angle calibration operation.
  • the obtaining the field of view angle based on the preset field of view angle calibration operation includes:
  • the visual angle of the photographing device is determined field angle.
  • the acquiring the first image obtained by the photographing device in the first posture of the handheld gimbal and the first image photographed in the second posture includes:
  • the photographing device is controlled to take pictures to obtain the second image.
  • controlling the movement of the handheld gimbal according to the angle of view and the position of the target object in the image includes:
  • the hand-held pan/tilt head is controlled to move.
  • the processor is further configured to implement the following steps:
  • the movement of the handheld gimbal is controlled.
  • the processor is further configured to implement the following steps:
  • the movement of the handheld gimbal is controlled.
  • the handheld pan/tilt head includes a handle portion, and the display device is disposed on the handle portion.
  • the handheld pan/tilt head further includes operation buttons, and the operation buttons are arranged around the display device.
  • the object selection operation includes a user's touch operation on the image
  • the determining the target object in the image in response to the user's object selection operation on the image includes:
  • the target object in the image is determined.
  • the determining the target object in the image according to the position coordinates includes:
  • the position coordinates are converted according to the coordinate conversion relationship to obtain target position coordinates, and the target object in the image is determined according to the target position coordinates.
  • a frame to be selected is displayed in the image
  • the handheld pan/tilt further includes an operation button
  • the object selection operation includes a first trigger operation of the operation button by the user
  • the The object selection operation of the image, to determine the target object in the image includes:
  • the target object in the image is determined.
  • the determining the target object in the image in response to the user's object selection operation on the image includes:
  • the target object in the image is determined.
  • the first trigger operation is different from the second trigger operation.
  • the handheld pan/tilt further includes a pan/tilt control component, and the processor is further configured to implement the following steps:
  • the hand-held pan/tilt head is controlled to move to change the position of the target object in the image.
  • the method before controlling the motion of the handheld gimbal to change the position of the target object in the image according to the motion control amount, the method further includes:
  • the handheld gimbal is controlled to suspend following the target object.
  • the processor is further configured to implement the following steps:
  • the handheld pan-tilt is controlled to continue to follow the target object.
  • the pan/tilt control component includes any one of a joystick and a dial key
  • the trigger operation includes a user's lever operation on the rocker and a user's rotation of the dial key. any of the operations.
  • the acquiring the motion control quantity input by the pan-tilt control component in response to the triggering operation of the pan-tilt control component by the user includes:
  • the controlling the movement of the handheld gimbal according to the movement control amount includes:
  • the first target motor of the handheld gimbal is controlled to rotate
  • the second target motor of the handheld gimbal is controlled to rotate
  • a first identification icon is displayed on the target object, and the processor is further configured to implement the following steps:
  • an identification icon is displayed on each of the objects to be followed;
  • the identification icon in which the object to be followed is the target object is the first identification icon
  • the identification icon in which the object to be followed is not the target object is the second identification icon
  • the first identification icon includes a first rectangular frame
  • the second identification icon includes a second rectangular frame
  • the color of the first rectangular frame and the second rectangular frame are different.
  • a tracking mark is displayed in the first rectangular frame, and no tracking mark is displayed in the second rectangular frame.
  • the handheld pan/tilt further includes an object switching component, and the processor is further configured to implement the following steps:
  • an object to be followed is reselected from the plurality of objects to be followed as a target object.
  • the processor is further configured to implement the following steps:
  • the identification icon is adjusted so that the identification icon on the reselected target object is the first identification icon.
  • FIG. 17 is a schematic block diagram of the structure of a photographing system provided by an embodiment of the present application.
  • the photographing system 300 includes a handheld gimbal 310 and a photographing device 320 mounted on the handheld gimbal 310 , and the handheld gimbal 310 is communicatively connected to the photographing device 320 .
  • Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and the computer program includes program instructions, and the processor executes the program instructions to realize the provision of the above embodiments.
  • the steps of the hand-held PTZ control method are described in detail below.
  • the computer-readable storage medium may be an internal storage unit of the handheld pan/tilt described in any of the foregoing embodiments, such as a hard disk or a memory of the handheld pan/tilt.
  • the computer-readable storage medium can also be an external storage device of the handheld PTZ, such as a plug-in hard disk equipped on the handheld PTZ, a smart memory card (Smart Media Card, SMC), a Secure Digital (Secure Digital) , SD) card, flash memory card (Flash Card), etc.

Abstract

A handheld gimbal control method, a handheld gimbal, a system, and a readable storage medium. The method comprises: obtaining an angle of view of a photographing device (S101); controlling a display apparatus to display an image collected by the photographing device in real time (S102); determining a target object in the image in response to an object selection operation of a user on the image displayed on the display apparatus (S103); and controlling, according to the angle of view and the position of the target object in the image, a handheld gimbal to move (S104). The method improves user experience.

Description

手持云台控制方法、手持云台、系统及可读存储介质Handheld PTZ control method, handheld PTZ, system and readable storage medium 技术领域technical field
本申请涉及云台控制技术领域,尤其涉及一种手持云台控制方法、手持云台、系统及可读存储介质。The present application relates to the technical field of PTZ control, and in particular, to a handheld PTZ control method, a handheld PTZ, a system and a readable storage medium.
背景技术Background technique
手持云台给相机的使用带来了极大的便利,人们可以在各种场景、各种运动模式下简单轻松地拍出图像稳定和变焦流畅的画面。手持云台的智能跟随模式是用户经常使用的,而目前的智能跟随模式的触发需要借助安装有适配的程序应用的移动终端或者第三方图传设备实现,触发方式较为繁琐,不方便用户使用,且不同厂家、不同系列以及不同型号的拍摄设备的拍摄参数各不相同不同,现有的跟随算法并不能适配不同厂家、不同系列以及不同型号的拍摄设备,跟随效果不好。The handheld gimbal brings great convenience to the use of the camera, and people can easily take pictures with stable images and smooth zooming in various scenes and various sports modes. The smart follow mode of the handheld gimbal is often used by users, and the current trigger of the smart follow mode needs to be realized by means of a mobile terminal or a third-party image transmission device installed with an adapted program application. The trigger method is cumbersome and inconvenient for users to use. , and the shooting parameters of different manufacturers, different series and different models of shooting equipment are different, the existing following algorithms cannot adapt to different manufacturers, different series and different types of shooting equipment, and the following effect is not good.
发明内容SUMMARY OF THE INVENTION
基于此,本申请实施例提供了一种手持云台控制方法、手持云台、系统及可读存储介质,旨在提高用户控制云台智能的跟随目标对象的便利性和跟随效果,提高用户体验。Based on this, the embodiments of the present application provide a handheld PTZ control method, a handheld PTZ, a system and a readable storage medium, which aim to improve the convenience and following effect of a user controlling a PTZ intelligently following a target object, and improve user experience .
第一方面,本申请实施例提供了一种手持云台控制方法,所述手持云台包括显示装置,所述手持云台用于搭载拍摄设备,所述手持云台与所述拍摄设备通信连接,所述方法包括:In a first aspect, an embodiment of the present application provides a method for controlling a handheld PTZ, the handheld PTZ includes a display device, the handheld PTZ is used for carrying a photographing device, and the handheld PTZ is communicatively connected to the photography device , the method includes:
获取所述拍摄设备的视场角;obtaining the field of view of the photographing device;
获取所述拍摄设备实时采集到的图像,并控制所述显示装置显示所述图像;acquiring an image captured in real time by the photographing device, and controlling the display device to display the image;
响应于用户对所述图像的对象选择操作,确定所述图像中的目标对象;In response to a user's object selection operation on the image, determining a target object in the image;
根据所述视场角和所述目标对象在所述图像中的位置,控制所述手持云台运动,以使所述拍摄设备对所述目标对象进行跟随拍摄。According to the angle of view and the position of the target object in the image, the hand-held pan/tilt head is controlled to move, so that the shooting device can follow the shooting of the target object.
第二方面,本申请实施例还提供了一种手持云台,所述手持云台包括存储器、处理器和显示装置,所述手持云台用于搭载拍摄设备,所述手持云台与所述拍摄设备通信连接;In a second aspect, an embodiment of the present application further provides a handheld pan/tilt, the handheld pan/tilt includes a memory, a processor, and a display device, the handheld pan/tilt is used for carrying a photographing device, and the handheld pan/tilt is connected to the hand-held pan/tilt. Communication connection of shooting equipment;
所述存储器,用于存储计算机程序;the memory for storing computer programs;
所述处理器,用于执行所述计算机程序并在执行所述计算机程序时,实现如下步骤:The processor is configured to execute the computer program and implement the following steps when executing the computer program:
获取所述拍摄设备的视场角;obtaining the field of view of the photographing device;
获取所述拍摄设备实时采集到的图像,并控制所述显示装置显示所述图像;acquiring an image captured in real time by the photographing device, and controlling the display device to display the image;
响应于用户对所述图像的对象选择操作,确定所述图像中的目标对象;In response to a user's object selection operation on the image, determining a target object in the image;
根据所述视场角和所述目标对象在所述图像中的位置,控制所述手持云台运动,以使所述拍摄设备对所述目标对象进行跟随拍摄。According to the angle of view and the position of the target object in the image, the hand-held pan/tilt head is controlled to move, so that the shooting device can follow the shooting of the target object.
第三方面,本申请实施例还提供了一种拍摄系统,所述拍摄系统包括如上所述的手持云台和搭载于所述手持云台的拍摄设备,所述手持云台与所述拍摄设备通信连接。In a third aspect, an embodiment of the present application further provides a shooting system, the shooting system includes the above-mentioned handheld gimbal and a shooting device mounted on the handheld gimbal, the handheld gimbal and the shooting device communication connection.
第四方面,本申请还提供了一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时使所述处理器实现如上所述的手持云台控制方法的步骤。In a fourth aspect, the present application also provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the above-mentioned handheld cloud The steps of the console control method.
本申请实施例提供了一种手持云台控制方法、手持云台、系统及可读存储介质,通过获取拍摄设备的视场角以及拍摄设备实时采集到的图像,并控制显示装置显示该图像,然后响应于用户对显示装置上显示的图像的对象选择操作,确定图像中的目标对象,并根据拍摄设备的视场角和目标对象在图像中的位置,控制手持云台运动,以使拍摄设备对目标对象进行跟随拍摄,便于用户控制云台智能的跟随目标对象,提高用户控制云台智能的跟随目标对象的便利性,也可以提高手持云台对目标对象的跟随效果,极大地提高了用户体验。Embodiments of the present application provide a handheld PTZ control method, a handheld PTZ, a system, and a readable storage medium. By acquiring a field of view of a shooting device and an image collected in real time by the shooting device, and controlling a display device to display the image, Then, in response to the user's object selection operation on the image displayed on the display device, the target object in the image is determined, and according to the field of view of the shooting device and the position of the target object in the image, the hand-held pan/tilt is controlled to move, so that the shooting device The following shooting of the target object is convenient for the user to control the gimbal to follow the target object intelligently, improve the convenience of the user to control the gimbal to follow the target object intelligently, and also improve the following effect of the handheld gimbal to the target object, which greatly improves the user's ability to follow the target object. experience.
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本申请。It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not limiting of the present application.
附图说明Description of drawings
为了更清楚地说明本申请实施例技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to explain the technical solutions of the embodiments of the present application more clearly, the following briefly introduces the accompanying drawings used in the description of the embodiments. For those of ordinary skill, other drawings can also be obtained from these drawings without any creative effort.
图1是实施本申请实施例提供的手持云台控制方法的手持云台的一结构示意图;1 is a schematic structural diagram of a handheld PTZ implementing the method for controlling a handheld PTZ provided by an embodiment of the present application;
图2是本申请实施例提供的一种手持云台控制方法的步骤示意流程图;FIG. 2 is a schematic flowchart of steps of a method for controlling a handheld PTZ provided by an embodiment of the present application;
图3是本申请实施例中显示装置显示的图像的一示意图;3 is a schematic diagram of an image displayed by a display device in an embodiment of the present application;
图4是本申请实施例中显示装置显示的图像的另一示意图;4 is another schematic diagram of an image displayed by a display device in an embodiment of the present application;
图5是本申请实施例中显示装置显示的图像的另一示意图;5 is another schematic diagram of an image displayed by a display device in an embodiment of the present application;
图6是本申请实施例中显示装置显示的图像的另一示意图;6 is another schematic diagram of an image displayed by a display device in an embodiment of the present application;
图7是本申请实施例中显示装置显示的图像的另一示意图;7 is another schematic diagram of an image displayed by a display device in an embodiment of the present application;
图8是本申请实施例中显示装置显示的图像的另一示意图;8 is another schematic diagram of an image displayed by a display device in an embodiment of the present application;
图9是本申请实施例中显示装置显示的图像的另一示意图;9 is another schematic diagram of an image displayed by a display device in an embodiment of the present application;
图10是本申请实施例中显示装置显示的图像的另一示意图;10 is another schematic diagram of an image displayed by a display device in an embodiment of the present application;
图11是本申请实施例中显示装置显示的图像的另一示意图;11 is another schematic diagram of an image displayed by a display device in an embodiment of the present application;
图12是本申请实施例中显示装置显示的图像的另一示意图;12 is another schematic diagram of an image displayed by a display device in an embodiment of the present application;
图13是本申请实施例中显示装置显示的图像的另一示意图;13 is another schematic diagram of an image displayed by a display device in an embodiment of the present application;
图14是本申请实施例中显示装置显示的图像的另一示意图;14 is another schematic diagram of an image displayed by a display device in an embodiment of the present application;
图15是本申请实施例中显示装置显示的图像的另一示意图;15 is another schematic diagram of an image displayed by a display device in an embodiment of the present application;
图16是本申请实施例提供的一种手持云台的结构示意性框图;16 is a schematic block diagram of the structure of a handheld cloud platform provided by an embodiment of the present application;
图17是本申请实施例提供的一种拍摄系统的结构示意性框图。FIG. 17 is a schematic block diagram of the structure of a photographing system provided by an embodiment of the present application.
具体实施方式detailed description
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.
附图中所示的流程图仅是示例说明,不是必须包括所有的内容和操作/步骤,也不是必须按所描述的顺序执行。例如,有的操作/步骤还可以分解、组合或部分合并,因此实际执行的顺序有可能根据实际情况改变。The flowcharts shown in the figures are for illustration only, and do not necessarily include all contents and operations/steps, nor do they have to be performed in the order described. For example, some operations/steps can also be decomposed, combined or partially combined, so the actual execution order may be changed according to the actual situation.
下面结合附图,对本申请的一些实施方式作详细说明。在不冲突的情况下,下述的实施例及实施例中的特征可以相互组合。Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and features in the embodiments may be combined with each other without conflict.
手持云台给相机的使用带来了极大的便利,人们可以在各种场景、各种运动模式下简单轻松地拍出图像稳定和变焦流畅的画面。手持云台的智能跟随模式是用户经常使用的,而目前的智能跟随模式的触发需要借助安装有适配的程序应用的移动终端或者第三方图传设备实现,触发方式较为繁琐,不方便用户使用,用户体验不好。The handheld gimbal brings great convenience to the use of the camera, and people can easily take pictures with stable images and smooth zooming in various scenes and various sports modes. The smart follow mode of the handheld gimbal is often used by users, and the current trigger of the smart follow mode needs to be realized by means of a mobile terminal or a third-party image transmission device installed with an adapted program application. The trigger method is cumbersome and inconvenient for users to use. , the user experience is not good.
为解决上述问题,本申请实施例提供了一种手持云台控制方法、手持云台、系统及可读存储介质,该手持云台控制方法可以应用手持云台。请参照图1, 图1是实施本申请实施例提供的手持云台控制方法的手持云台的一结构示意图。以下将结合图1,对本申请实施例中的手持云台进行说明。In order to solve the above problems, embodiments of the present application provide a hand-held pan-tilt control method, a hand-held pan-tilt, a system and a readable storage medium, and the hand-held pan-tilt control method can be applied to a hand-held pan-tilt. Please refer to FIG. 1 . FIG. 1 is a schematic structural diagram of a handheld gimbal for implementing the method for controlling a handheld gimbal provided by an embodiment of the present application. The handheld pan/tilt in the embodiment of the present application will be described below with reference to FIG. 1 .
如图1所示,手持云台100包括手柄部101、设于手柄部101上的云台102和设于手柄部101上的显示装置103,云台102用于搭载拍摄设备104,拍摄设备104可以与云台102一体设置,也可以外接于云台102。As shown in FIG. 1 , the handheld pan/tilt 100 includes a handle portion 101 , a pan/tilt 102 provided on the handle portion 101 , and a display device 103 provided on the handle portion 101 . It can be integrated with the PTZ 102 or externally connected to the PTZ 102 .
其中,云台102包括三轴电机,分别为俯仰(pitch)轴电机1021、横滚(roll)轴电机1022和平移(yaw)轴电机1023,所述三轴电机用于调整搭载于云台102上的拍摄设备104的平衡姿态,以便拍摄稳定流畅的画面。The pan/tilt 102 includes three-axis motors, which are a pitch (pitch) axis motor 1021 , a roll (roll) axis motor 1022 and a yaw (yaw) axis motor 1023 . The balance posture of the photographing device 104 on the camera can be used to capture a stable and smooth picture.
其中,该显示装置103用于显示拍摄设备104实时采集到的图像,此外,用户也可以通过显示装置103的触控来控制云台102或搭载于云台102上的拍摄设备104。可选地,显示装置103为触摸屏。例如,手持云台100响应于用户对显示装置103上显示的图像的触控操作,获取触控操作的触控位置在图像内的位置坐标,并根据该位置坐标,确定图像中的目标对象,然后根据目标对象在该图像中的位置,控制云台102运动,以使拍摄设备104对目标对象进行跟随拍摄,又例如,显示装置103显示有参数控制滑条,当用户滑动该参数控制滑条时,触发目标拍摄参数的调整指令,使得拍摄设备104基于该调整指令调整目标拍摄参数的取值,目标拍摄参数包括焦距、曝光值、感光度和快门速度等。The display device 103 is used to display images collected in real time by the photographing device 104 . In addition, the user can also control the pan/tilt 102 or the photographing device 104 mounted on the pan/tilt 102 by touching the display device 103 . Optionally, the display device 103 is a touch screen. For example, in response to the user's touch operation on the image displayed on the display device 103, the handheld platform 100 obtains the position coordinates of the touch position of the touch operation in the image, and determines the target object in the image according to the position coordinates, Then, according to the position of the target object in the image, the pan/tilt head 102 is controlled to move, so that the shooting device 104 can follow the shooting of the target object. For example, the display device 103 displays a parameter control slider. When the user slides the parameter control slider When , an adjustment instruction of the target shooting parameter is triggered, so that the shooting device 104 adjusts the value of the target shooting parameter based on the adjustment instruction, and the target shooting parameter includes focal length, exposure value, sensitivity and shutter speed.
在一实施例中,手柄部101上还设有操作按键105,以便用户操作该操作按键以控制云台102或搭载于云台102上的拍摄设备104。可选地,该操作按键105设于显示装置103周围。该操作按键可例如为按键、扳机、旋钮或者摇杆等,当然也包括其他形式的物理按键。例如,摇杆可以用于控制三个轴的运动,进而控制云台102的运动,例如,按键可以用于控制云台102开机启动。可以理解的是,摇杆也可以用于其他功能。In one embodiment, the handle portion 101 is further provided with an operation button 105 , so that the user can operate the operation button to control the gimbal 102 or the photographing device 104 mounted on the gimbal 102 . Optionally, the operation buttons 105 are arranged around the display device 103 . The operation key may be, for example, a key, a trigger, a knob or a rocker, etc., of course, other forms of physical keys are also included. For example, the joystick can be used to control the movement of the three axes, thereby controlling the movement of the gimbal 102 , for example, the buttons can be used to control the gimbal 102 to start up. Understandably, the joystick can also be used for other functions.
例如,显示装置103显示有包含待选区域框的图像,该图像是由拍摄设备104实时采集得到的,手持云台100响应于用户对操作按键105的第一触发操作,获取待选区域框在图像内的当前位置信息;根据当前位置信息,确定该图像中的目标对象,并根据目标对象在该图像中的位置,控制云台102运动,以使拍摄设备104对目标对象进行跟随拍摄。For example, the display device 103 displays an image containing the frame of the region to be selected, and the image is acquired in real time by the photographing device 104. The handheld pan/tilt 100 responds to the user's first trigger operation on the operation button 105 to obtain the frame of the region to be selected. The current position information in the image; the target object in the image is determined according to the current position information, and the pan/tilt 102 is controlled to move according to the position of the target object in the image, so that the shooting device 104 can follow the target object.
又例如,手持云台100响应于用户对操作按键105的第二触发操作,改变待选区域框在图像内的位置;响应于用户对操作按键105的第一触发操作,获取待选区域框在图像内的当前位置信息;根据当前位置信息,确定图像中的目 标对象,并根据目标对象在该图像中的位置,控制云台102运动,以使拍摄设备104对目标对象进行跟随拍摄。其中,第一触发操作与第二触发操作不同。For another example, in response to the user's second trigger operation on the operation button 105, the handheld pan/tilt 100 changes the position of the frame to be selected in the image; in response to the user's first trigger operation on the operation button 105, obtains the frame of the to-be-selected area in the image. The current position information in the image; the target object in the image is determined according to the current position information, and the pan/tilt 102 is controlled to move according to the position of the target object in the image, so that the shooting device 104 can follow and shoot the target object. Wherein, the first trigger operation is different from the second trigger operation.
其中,手持云台100包括处理器,处理器用于对输入的控制指令进行处理,或者收发信号等。处理器可以设置在手柄部101的内部。可选地,该处理器可以是中央处理单元(Central Processing Unit,CPU),该处理器还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(application specific integrated circuit,ASIC)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。The handheld pan/tilt 100 includes a processor, and the processor is used to process input control instructions, or send and receive signals. The processor may be provided inside the handle portion 101 . Optionally, the processor may be a central processing unit (Central Processing Unit, CPU), and the processor may also be other general-purpose processors, digital signal processors (Digital Signal Processors, DSP), application specific integrated circuits (application specific integrated circuits) circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
以下,将结合图1中的手持云台对本申请实施例提供的手持云台控制方法进行详细介绍。需知,图1中的手持云台仅用于解释本申请实施例提供的手持云台控制方法,但并不构成对本申请实施例提供的手持云台控制方法应用场景的限定。Hereinafter, the control method of the handheld PTZ provided by the embodiment of the present application will be described in detail with reference to the handheld PTZ in FIG. 1 . It should be noted that the handheld PTZ in FIG. 1 is only used to explain the handheld PTZ control method provided by the embodiments of the present application, but does not constitute a limitation on the application scenarios of the handheld PTZ control methods provided by the embodiments of the present application.
请参阅图2,图2是本申请实施例提供的一种手持云台控制方法的步骤示意流程图。Please refer to FIG. 2 , which is a schematic flowchart of steps of a method for controlling a handheld PTZ provided by an embodiment of the present application.
如图2所示,该手持云台控制方法包括步骤S101至步骤S104。As shown in FIG. 2 , the hand-held pan-tilt control method includes steps S101 to S104.
S101、获取所述拍摄设备的视场角。S101. Acquire a field of view of the photographing device.
具发明人已知现有的跟随算法并未考虑拍摄设备的视场角,但拍摄设备的视场角会影响跟随效果,且不同厂家、不同系列以及不同型号的拍摄设备的视场角不同,现有的跟随算法并不能适配不同厂家、不同系列以及不同型号的拍摄设备,跟随效果不好。The inventors know that the existing following algorithms do not consider the field of view of the shooting device, but the field of view of the shooting device will affect the follow-up effect, and the field of view of different manufacturers, different series and different models of shooting equipment is different. The existing following algorithms cannot adapt to different manufacturers, different series and different types of shooting equipment, and the following effect is not good.
由于不同拍摄设备的视场角不同,且视场角会影响云台跟随目标对象的效果,因此在手持云台与拍摄设备连接后,需要获取拍摄设备的视场角,便于手持云台基于该视场角适配的对目标对象进行跟随,以提高手持云台对目标对象的跟随效果。Since the field of view of different shooting devices is different, and the field of view will affect the effect of the gimbal following the target object, after the handheld gimbal is connected to the shooting device, it is necessary to obtain the field of view of the shooting device. The field of view is adapted to follow the target object, so as to improve the follow-up effect of the handheld gimbal to the target object.
在一实施例中,获取拍摄设备的视场角的方式可以为:响应于用户的第一输入操作,获取拍摄设备的视场角。其中,第一输入操作包括用户在视场角输入弹窗上的视场角输入操作,视场角输入弹窗可以通过手持云台的显示装置或者与手持云台连接的终端设备显示,终端设备可以为智能手机和平板电脑等。对于用户清楚拍摄设备的视场角的场景,用户可以通过显示装置或连接的终端设备显示视场角输入弹窗,由用户手动的输入拍摄设备的视场角,可以实现手 持云台与不同拍摄设备的视场角的适配。In one embodiment, the method of acquiring the field of view of the photographing device may be: acquiring the field of view of the photographing device in response to the user's first input operation. Wherein, the first input operation includes a user's field of view angle input operation on the field of view angle input pop-up window, and the field of view angle input pop-up window can be displayed by the display device of the handheld pan/tilt or a terminal device connected to the handheld pan/tilt, and the terminal device Can be used for smartphones and tablets etc. For the scene where the user is clear about the field of view of the shooting device, the user can display the field of view input pop-up window through the display device or the connected terminal device, and the user can manually input the field of view of the shooting device. The adaptation of the field of view of the device.
在一实施例中,获取拍摄设备的视场角的方式还可以为:基于预设的视场角校准操作,获取拍摄设备的视场角。其中,预设的视场角校准操作可以基于实际情况进行设置,本申请实施例对此不做具体限定,例如,控制手持云台转动,当手持云台处于第一姿态时,控制拍摄设备拍照,得到第一图像,当手持云台处于第二姿态时,控制拍摄设备拍照,得到第二图像,之后根据第一图像和第二图像中的相同对象的位置差和手持云台在第一姿态与第二姿态之间的转动角度,确定拍摄设备的视场角。通过预设的视场角校准操作,获取拍摄设备的视场角,不需要用户手动的输入拍摄设备的视场角,能够准确地确定拍摄设备的视场角,便于后续基于准确的视场角跟随目标对象,使得拍摄设备能够更好的跟随目标对象,提高跟随效果,极大地提高用户体验。In an embodiment, the manner of acquiring the field of view of the photographing device may further be: acquiring the field of view of the photographing device based on a preset angle of view calibration operation. The preset field-of-view calibration operation may be set based on the actual situation, which is not specifically limited in this embodiment of the present application. For example, control the hand-held gimbal to rotate, and control the shooting device to take pictures when the hand-held gimbal is in the first posture , obtain the first image, when the handheld gimbal is in the second posture, control the shooting device to take pictures to obtain the second image, and then according to the position difference of the same object in the first image and the second image and the handheld gimbal in the first posture The rotation angle between the second posture and the second posture determines the field of view of the photographing device. Through the preset FOV calibration operation, the FOV of the shooting device can be obtained without the need for the user to manually input the FOV of the shooting device, and the FOV of the shooting device can be accurately determined, which is convenient for subsequent follow-up based on the accurate FOV Following the target object enables the shooting device to better follow the target object, improves the following effect, and greatly improves the user experience.
在一实施例中,基于预设的视场角校准操作,获取拍摄设备的视场角的方式可以为:获取拍摄设备在手持云台处于第一姿态拍摄得到的第一图像和处于第二姿态拍摄得到的第一图像;根据第一图像和第二图像中的相同对象的位置差和手持云台在第一姿态与第二姿态之间的转动角度,确定拍摄设备的视场角。例如,目标对象保持不动,且目标对象在第一图像内的图像区域占第一图像的画面比例为K 1,目标对象在第一图像内的图像区域占第二图像的画面比例为K 2,手持云台在第一姿态与第二姿态之间的转动角度为β,则拍摄设备的视场角为α,且α=β/(K 1-K 2)。 In one embodiment, based on the preset field of view angle calibration operation, the method of acquiring the field of view of the photographing device may be: acquiring the first image obtained by the photographing device in the first posture of the handheld gimbal and the second posture. The first image obtained by shooting; the field of view angle of the shooting device is determined according to the position difference of the same object in the first image and the second image and the rotation angle of the handheld platform between the first posture and the second posture. For example, the target object remains stationary, and the ratio of the image area of the target object in the first image to the first image is K 1 , and the ratio of the image area of the target object in the first image to the second image is K 2 , the rotation angle of the handheld gimbal between the first posture and the second posture is β, then the field of view of the photographing device is α, and α=β/(K 1 −K 2 ).
在一实施例中,获取拍摄设备在手持云台处于第一姿态拍摄得到的第一图像和处于第二姿态拍摄得到的第一图像的方式可以为:获取触发的视场角校准指令,并根据视场角校准指令,控制手持云台转动;当手持云台处于第一姿态时,控制拍摄设备拍照,得到第一图像;当手持云台处于第二姿态时,控制拍摄设备拍照,得到第二图像。其中,视场角校准指令可由用户操作视场角校准按钮触发,当然用户也可以通过其余方式进行触发,例如,通过显示装置或与手持云台连接的终端设备显示的视场角校准图标触发。In one embodiment, the method of acquiring the first image captured by the handheld gimbal in the first posture and the first image captured in the second posture may be: acquiring the triggered field angle calibration instruction, and according to the The field of view angle calibration command controls the rotation of the handheld gimbal; when the handheld gimbal is in the first attitude, it controls the shooting device to take pictures to obtain the first image; when the handheld gimbal is in the second attitude, it controls the shooting device to take pictures and obtains the second image. image. The FOV calibration command can be triggered by the user operating the FOV calibration button. Of course, the user can also trigger in other ways, for example, through the FOV calibration icon displayed by the display device or the terminal device connected to the handheld pan/tilt.
在一实施例中,当检测到拍摄设备与手持云台连接时,获取拍摄设备的设备标识,并获取手持云台的设备标识库中是否存在该设备标识,如果该设备标识库中不存在该设备标识,则输出视场角校准提示信息,以提示用户校准拍摄设备的视场角;响应于用户对视场角校准按钮的触发操作,触发视场角校准指令;如果该设备标识库中存在该设备标识,则不做处理。其中,该设备标识用于标识拍摄设备的厂商、系列和/或型号。通过在新的拍摄设备接入手持云台时, 输出视场角校准提示信息,便于用户及时的校准拍摄设备的视场角。In one embodiment, when it is detected that the photographing device is connected to the handheld platform, the device identification of the photographing device is obtained, and whether the device identification exists in the device identification library of the handheld cloud platform, if the device identification does not exist in the device identification library. device identification, output the FOV calibration prompt information to prompt the user to calibrate the FOV of the shooting device; in response to the user's triggering operation on the FOV calibration button, trigger the FOV calibration instruction; if the device ID library exists The device ID is not processed. Wherein, the device identification is used to identify the manufacturer, series and/or model of the photographing device. When the new shooting device is connected to the handheld pan/tilt, the prompt information for the calibration of the field of view is output, which facilitates the user to calibrate the field of view of the shooting device in time.
S102、获取所述拍摄设备实时采集到的图像,并控制所述显示装置显示所述图像。S102: Acquire an image captured by the photographing device in real time, and control the display device to display the image.
其中,手持云台可以通过控制线与拍摄设备连接,该控制线例如为快门线。此处不限定快门线的种类,例如,该快门线可以是通用串行总线(Universal Serial Bus,USB)。手持云台也可以通过无线的方式与拍摄设备连接,例如,手持云台通过蓝牙与拍摄设备连接。Wherein, the handheld gimbal can be connected to the photographing device through a control line, such as a shutter release line. The type of the shutter release cable is not limited here, for example, the shutter release cable may be a Universal Serial Bus (Universal Serial Bus, USB). The handheld gimbal can also be connected to the shooting device wirelessly, for example, the handheld gimbal is connected to the shooting device through Bluetooth.
在一实施例中,通过拍摄设备的高清多媒体接口(High Definition Multimedia Interface,HDMI)的输出信号获取拍摄设备实时采集到的图像,并控制手持云台的显示装置显示拍摄设备实时采集到的图像,即获取该图像的第一长宽信息和该显示装置的第二长宽信息,并根据第一长宽信息和第二长宽信息,确定长宽比例,并根据该长宽比例对该图像进行缩放、图像增强和/或裁切处理,得到目标图像,然后通过显示装置显示该目标图像。由于显示装置的尺寸较小,不便于用户阅览,因此通过对图像进行缩放、图像增强和/或裁切处理,再由显示装置显示处理后的图像,可以提高图像的显示效果,便于用户阅览。In one embodiment, obtain the image that the photographing equipment collects in real time through the output signal of the high-definition multimedia interface (High Definition Multimedia Interface, HDMI) of the photographing equipment, and control the display device of the handheld platform to display the image that the photographing equipment collects in real time, That is, the first length-width information of the image and the second length-width information of the display device are acquired, the length-width ratio is determined according to the first length-width information and the second length-width information, and the image is processed according to the length-width ratio. Scaling, image enhancement and/or cropping processing is performed to obtain a target image, which is then displayed on a display device. Due to the small size of the display device, it is inconvenient for users to read. Therefore, by performing scaling, image enhancement and/or cropping processing on the image, and then displaying the processed image on the display device, the display effect of the image can be improved and the user can browse easily.
在一实施例中,手持云台包括手柄部、设于手柄部的云台和设于手柄部的显示装置。通过在手持云台的手柄部设置显示装置,便于用户通过显示装置控制手持云台或者控制拍摄设备。In one embodiment, the handheld pan/tilt includes a handle portion, a pan/tilt provided on the handle portion, and a display device provided on the handle portion. By arranging the display device on the handle portion of the handheld pan/tilt, it is convenient for the user to control the handheld pan/tilt or control the photographing device through the display device.
S103、响应于用户对所述图像的对象选择操作,确定所述图像中的目标对象。S103. In response to a user's object selection operation on the image, determine a target object in the image.
其中,在显示装置显示拍摄设备实时采集到的图像后,用户可以通过显示装置显示的图像选择待跟随的目标对象,例如,用户触控该图像中的某个区域,从而确定待跟随的目标对象。Wherein, after the display device displays the image collected in real time by the photographing device, the user can select the target object to be followed through the image displayed by the display device, for example, the user touches a certain area in the image to determine the target object to be followed .
在一实施例中,所述对象选择操作包括用户对所述图像的触控操作,响应于用户对图像的对象选择操作,确定图像中的目标对象的方式可以为:响应于用户在显示装置上的对图像的触控操作,获取触控操作的触控位置在图像内的位置坐标;根据该位置坐标,确定该图像中的目标对象,即从该图像中获取该位置坐标对应的目标图像区域,并对该目标图像区域中的对象进行目标识别,然后将识别到的对象作为待跟随的目标对象。通过用户在显示装置上的对图像的触控操作,可以确定目标对象,不需要通过安装有适配的程序应用的移动终端或者第三方图传设备实现,极大地提高了用户控制云台智能的跟随目标对象的便利性,提高用户体验。In one embodiment, the object selection operation includes a user's touch operation on the image, and in response to the user's object selection operation on the image, the method of determining the target object in the image may be: in response to the user's operation on the display device. The touch operation on the image, obtain the position coordinates of the touch position of the touch operation in the image; according to the position coordinates, determine the target object in the image, that is, obtain the target image area corresponding to the position coordinates from the image , and perform target recognition on the object in the target image area, and then use the recognized object as the target object to be followed. Through the user's touch operation on the image on the display device, the target object can be determined, and it does not need to be realized through a mobile terminal or a third-party image transmission device installed with an adapted program application, which greatly improves the user's ability to control the PTZ's intelligence. Follow the convenience of the target object and improve the user experience.
示例性的,请参阅图3,图3是本申请实施例中显示装置显示的图像的一示意图,如图3所示,显示装置显示的图像包括对象11、对象12和对象13,用户对显示的对象13所在的区域进行触控,则手持云台响应触控操作,将对象13作为待跟随的目标对象,而如果对显示的对象12所在的区域进行触控,则手持云台响应触控操作,将对象12作为待跟随的目标对象。3 is a schematic diagram of an image displayed by a display device in an embodiment of the present application. As shown in If you touch the area where the displayed object 13 is located, the handheld gimbal responds to the touch operation, taking the object 13 as the target object to be followed, and if you touch the area where the displayed object 12 is located, the handheld gimbal responds to the touch. Operation, take object 12 as the target object to be followed.
在一实施例中,根据该位置坐标,确定该图像中的目标对象的方式可以为:根据显示装置的长宽信息和图像的长宽信息,确定坐标转换关系;根据坐标转换关系对该位置坐标进行转换,得到目标位置坐标,并根据目标位置坐标,确定图像中的目标对象。由于显示装置显示的图像为经过坐标转换后的图像,因此,通过显示装置的长宽信息和图像的长宽信息,对该位置坐标进行转换,再基于转换得到的位置坐标,可以准确地确定图像中的目标对象。In one embodiment, according to the position coordinates, the method of determining the target object in the image may be: according to the length and width information of the display device and the length and width information of the image, determine the coordinate conversion relationship; according to the coordinate conversion relationship, the position coordinate Convert to obtain the target position coordinates, and determine the target object in the image according to the target position coordinates. Since the image displayed by the display device is an image after coordinate conversion, the position coordinates can be converted through the length and width information of the display device and the length and width information of the image, and then the image can be accurately determined based on the converted position coordinates. target object in .
在一实施例中,所述图像内显示有待选区域框,手持云台还包括操作按键,所述对象选择操作包括用户对操作按键的第一触发操作,响应于用户对图像的对象选择操作,确定图像中的目标对象的方式可以为:响应于用户对操作按键的第一触发操作,获取待选区域框在图像内的当前位置信息;根据当前位置信息,确定图像中的目标对象。其中,待选区域框可以位于图像的中央位置,该操作按键可以包括设置于显示装置周围的按钮,第一触发操作包括用户对该按钮的点击操作、长按操作和双击操作中的任一项。通过对操作按键的第一触发操作可以确定目标对象,不需要通过安装有适配的程序应用的移动终端或者第三方图传设备实现,极大地提高了用户控制云台智能的跟随目标对象的便利性,提高用户体验。In one embodiment, a frame to be selected is displayed in the image, the handheld pan/tilt also includes operation buttons, and the object selection operation includes a first trigger operation of the operation button by the user, and in response to the user's object selection operation on the image, The method of determining the target object in the image may be: in response to the user's first triggering operation on the operation button, obtaining current position information of the frame to be selected in the image; and determining the target object in the image according to the current position information. Wherein, the to-be-selected area frame may be located in the center of the image, the operation button may include a button disposed around the display device, and the first trigger operation includes any one of the user's click operation, long-press operation and double-click operation on the button . The target object can be determined through the first trigger operation of the operation button, which does not need to be realized by a mobile terminal or a third-party image transmission device installed with an adapted program application, which greatly improves the convenience of the user to control the PTZ to follow the target object intelligently. properties and improve user experience.
示例性的,请参照图4,图4是本申请实施例中显示装置显示的图像的另一示意图,如图4所示,显示装置显示的图像包括对象11、对象12、对象13和待选区域框14,当检测到用户对该按钮的双击操作时,对待选区域框14所在的图像区域进行目标识别,由于待选区域框14所在的图像区域内不存在目标,则显示装置可以输出“未识别到目标”的提示信息,如图5所示,对象13移动,此时对象13位于待选区域框14内,如果此时检测到用户对该按钮的双击操作,则对待选区域框14所在的图像区域进行目标识别由于待选区域框14所在的图像区域内存在对象13,因此,将对象13作为目标对象。4 is another schematic diagram of an image displayed by a display device in an embodiment of the present application. As shown in FIG. 4 , the image displayed by the display device includes object 11, object 12, object 13, and a candidate for selection. The area frame 14, when detecting the user's double-click operation on the button, performs target recognition on the image area where the area frame 14 to be selected is located. Since there is no target in the image area where the area frame 14 to be selected is located, the display device can output " "Target not recognized" prompt message, as shown in Figure 5, the object 13 moves, and the object 13 is located in the to-be-selected area frame 14. If the user double-clicks the button is detected at this time, the to-be-selected area frame 14 Performing target recognition in the image area where the target area frame 14 is located because the object 13 exists in the image area where the area frame 14 to be selected is located, therefore, the object 13 is taken as the target object.
在一实施例中,响应于用户对图像的对象选择操作,确定图像中的目标对象的方式还可以为:响应于用户对操作按键的第二触发操作,改变待选区域框在图像内的位置;响应于用户对操作按键的第一触发操作,获取待选区域框在 图像内的当前位置信息;根据当前位置信息,确定图像中的目标对象。其中,通过对操作按键的第二触发操作,改变待选区域框的位置,以改变用户选择的目标对象,再通过对操作按键的第一触发操作确定选择的目标对象,极大地提高了用户控制云台智能的跟随目标对象的便利性,提高用户体验。In one embodiment, in response to the user's object selection operation on the image, the method of determining the target object in the image may also be: in response to the user's second trigger operation on the operation button, changing the position of the frame to be selected in the image. ; in response to the user's first trigger operation on the operation button, obtain the current position information of the frame to be selected in the image; according to the current position information, determine the target object in the image. The position of the area frame to be selected is changed through the second trigger operation of the operation button to change the target object selected by the user, and then the selected target object is determined through the first trigger operation of the operation button, which greatly improves user control. The convenience of the PTZ intelligently follows the target object and improves the user experience.
在一实施例中,响应于用户对操作按键的第二触发操作,改变待选区域框在图像内的位置的方式可以为:对图像进行目标识别,以确定图像中是否存在对象,若图像中存在对象,则根据第二触发操作,将待选区域框移动至该对象所在的图像区域,以改变待选区域框在图像内的位置,而图像中存在多个对象时,根据第二触发操作,从多个对象选择一个对象作为候选对象,并将待选区域框移动至该候选对象所在的图像区域,以改变待选区域框在图像内的位置。In one embodiment, in response to the second triggering operation of the operation button by the user, the method of changing the position of the frame to be selected in the image may be: performing target recognition on the image to determine whether there is an object in the image, and if there is an object in the image, If there is an object, according to the second trigger operation, move the to-be-selected area frame to the image area where the object is located to change the position of the to-be-selected area frame in the image, and when there are multiple objects in the image, according to the second trigger operation , select an object from multiple objects as a candidate object, and move the frame of the region to be selected to the image area where the candidate object is located, so as to change the position of the frame of the region to be selected in the image.
其中,第一触发操作与第二触发操作不同,例如,第一触发操作为双击操作,第二触发操作为单击操作,又例如,操作按键包括第一操作按键和第二操作按键,第一触发操作包括用户对第一操作按键的触发操作,可例如为对按钮的双击操作,第二触发操作包括用户对第二操作按键的触发操作,可例如为对摇杆的打杆操作。The first trigger operation is different from the second trigger operation. For example, the first trigger operation is a double-click operation, and the second trigger operation is a single-click operation. For another example, the operation buttons include a first operation button and a second operation button. The triggering operation includes the user's triggering operation on the first operation button, which may be, for example, a double-click operation on the button, and the second triggering operation includes the user's triggering operation on the second operation button, which may be, for example, a stick operation on a joystick.
示例性的,如图5所示,对象13位于待选区域框14内,而如果此时用户对按钮进行单击操作,则待选区域框14由如图5所示的位置改变为如图6或者如图7所示的位置,即待选区域框14移动到对象11或者对象12所在的区域,此时用户对按钮进行双击操作时,将位于待选区域框14内的对象11或者对象12作为目标对象。Exemplarily, as shown in FIG. 5, the object 13 is located in the to-be-selected area frame 14, and if the user clicks the button at this time, the to-be-selected area frame 14 changes from the position shown in FIG. 6 or the position shown in FIG. 7 , that is, the area frame 14 to be selected is moved to the area where the object 11 or the object 12 is located. At this time, when the user double-clicks the button, the object 11 or the object located in the area frame 14 to be selected will be moved. 12 as the target object.
示例性的,如图4所示,待选区域框14内不存在对象,而如果此时用户对摇杆进行打杆操作,且向右打杆,则待选区域框14由如图4所示的位置改变为如图8所示的位置,即对象12位于待选区域框14内,而如果用户继续向右打杆,则待选区域框14由如图8所示的位置改变为如9所示的位置,即对象13位于待选区域框14内,而如果用户此时继续向右打杆,则待选区域框14由如图9所示的位置改变为如10所示的位置,即对象11位于待选区域框14内。Exemplarily, as shown in FIG. 4 , there is no object in the to-be-selected area frame 14 , and if the user performs a stick operation on the joystick and moves the stick to the right, the to-be-selected area frame 14 is composed of the area shown in FIG. 4 . The position shown is changed to the position shown in FIG. 8, that is, the object 12 is located in the area frame 14 to be selected, and if the user continues to hit the stick to the right, the area frame 14 to be selected changes from the position shown in FIG. 9, that is, the object 13 is located in the to-be-selected area frame 14, and if the user continues to move the stick to the right at this time, the to-be-selected area frame 14 changes from the position shown in FIG. 9 to the position shown in 10 , that is, the object 11 is located in the to-be-selected area frame 14 .
S104、根据所述视场角和所述目标对象在所述图像中的位置,控制所述手持云台运动,以使所述拍摄设备对所述目标对象进行跟随拍摄。S104. Control the movement of the handheld gimbal according to the angle of view and the position of the target object in the image, so that the photographing device can follow the photographing of the target object.
在确定拍摄设备的视场角和目标对象后,基于视场角和目标对象在图像中的位置,控制手持云台运动,以使拍摄设备对目标对象进行跟随拍摄,即根据视场角,确定手持云台的控制环路的目标控制系数,并根据该目标控制系数和目标对象在图像中的位置,控制手持云台运动。举例来说,若控制环路为PID 控制器,则目标控制系数包括比例控制系数P、积分控制系数I和微分控制系数D。通过拍摄设备的视场角确定手持云台的控制环路的目标控制系数,能够基于确定的目标控制系数和目标对象在图像中的位置,控制手持云台更好地跟随目标对象,提高跟随效果,极大地提高用户体验。After determining the field of view of the shooting device and the target object, control the movement of the handheld gimbal based on the field of view and the position of the target object in the image, so that the shooting device can follow the shooting of the target object, that is, according to the field of view, determine The target control coefficient of the control loop of the hand-held gimbal is controlled, and the movement of the hand-held gimbal is controlled according to the target control coefficient and the position of the target object in the image. For example, if the control loop is a PID controller, the target control coefficients include a proportional control coefficient P, an integral control coefficient I, and a differential control coefficient D. The target control coefficient of the control loop of the handheld gimbal is determined by the field of view of the shooting device. Based on the determined target control coefficient and the position of the target object in the image, the handheld gimbal can be controlled to better follow the target object and improve the following effect. , which greatly improves the user experience.
具体地,将目标对象在该图像中的位置作为基准位置,并以间隔预设时间获取拍摄设备采集到的当前实时取景画面;确定目标对象在该当前实时取景画面内的位置,得到目标对象的当前位置,并根据目标对象的当前位置、基站位置和目标控制系数,控制手持云台运动,使得目标对象在当前实时取景画面内的位置与该基站位置之间的差值小于预设位置差值。其中,预设时间和预设位置差值可基于实际情况进行设置,本申请对此不做具体限定。Specifically, the position of the target object in the image is used as the reference position, and the current live view picture collected by the shooting device is acquired at preset time intervals; the position of the target object in the current live view picture is determined, and the The current position, and according to the current position of the target object, the position of the base station and the target control coefficient, control the movement of the handheld gimbal, so that the difference between the position of the target object in the current live view screen and the position of the base station is less than the preset position difference . The difference between the preset time and the preset position may be set based on the actual situation, which is not specifically limited in this application.
在一实施例中,若根据拍摄设备的视场角校准得到的目标控制系数与实际待跟随的目标运动速度不匹配,手持云台的跟随控制可能存在控制超调的问题,举例来说,若控制环路为PID控制环路,且根据视场角校准得到的目标控制系数中的P(比例)系数较大,此时因为控制环路的滞后性,会导致超调后的手持云台抖动,导致成片质量下降。因此,响应于用户的第二输入操作,调整目标控制系数;根据目标对象在图像中的位置和调整后的目标控制系数,控制手持云台运动。其中,第二输入操作可以为用户对拨轮键的转动操作,也可以为用户对显示装置或终端设备显示的控制系数调整图标的触控操作。通过提供目标控制系数的调整功能,使得用户能够更加灵活地配置目标控制系数,使得跟随拍摄更加符合用户的需求,极大的提高用户体验。In one embodiment, if the target control coefficient obtained by calibration based on the field of view of the photographing device does not match the actual motion speed of the target to be followed, there may be a problem of control overshoot in the follow-up control of the handheld gimbal. The control loop is a PID control loop, and the P (proportional) coefficient in the target control coefficients calibrated according to the field of view angle is large. At this time, due to the hysteresis of the control loop, it will cause the hand-held gimbal to shake after overshoot. , resulting in a decrease in the quality of the film. Therefore, in response to the user's second input operation, the target control coefficient is adjusted; according to the position of the target object in the image and the adjusted target control coefficient, the movement of the handheld gimbal is controlled. Wherein, the second input operation may be a user's turning operation on the dial key, or may be a user's touch operation on the control coefficient adjustment icon displayed by the display device or the terminal device. By providing the adjustment function of the target control coefficient, the user can configure the target control coefficient more flexibly, so that the follow-up shooting is more in line with the user's needs, and the user experience is greatly improved.
在一实施例中,可以向用户开放控制环路的控制权限,响应于用户的第二输入操作,调整目标控制系数的方式可以为:响应于用户的第二输入操作,读取由用户输入的控制系数调整量,并根据控制系数调整量,调整目标控制系数;或者响应于用户的第二输入操作,从多个控制档位中获取目标控制档位,并将目标控制档位对应的控制系数作为调整后的目标控制系数。例如,可以开放1-30个控制档位,每个控制档位对应一组控制系数,通过用户的第二输入操作可以在上述控制档位中确定一个目标控制档位,并将目标控制档位对应的控制系数作为调整后的目标控制系数。In an embodiment, the control authority of the control loop may be opened to the user, and in response to the user's second input operation, the method of adjusting the target control coefficient may be: in response to the user's second input operation, reading the Control the coefficient adjustment amount, and adjust the target control coefficient according to the control coefficient adjustment amount; or in response to the user's second input operation, obtain the target control gear from a plurality of control gears, and use the control coefficient corresponding to the target control gear as the adjusted target control coefficient. For example, 1-30 control gears can be opened, each control gear corresponds to a set of control coefficients, and a target control gear can be determined among the above control gears through the second input operation of the user, and the target control gear The corresponding control coefficient is used as the adjusted target control coefficient.
在一实施例中,检测手持云台是否发生预设抖动事件;若确定手持云台发生预设抖动事件,则调整目标控制系数;根据目标对象在图像中的位置和调整后的目标控制系数,控制手持云台运动。其中,云台可以通过内置的IMU(惯性测量单元)检测云台的运动,基于检测得到的信息,可以获知云台是否发生 预设抖动事件。通过在手持云台发生异常抖动时调整目标控制系数,使得云台能够基于目标对象在图像中的位置和调整后的目标控制系数,更好的跟随目标对象,提高跟随效果。In one embodiment, it is detected whether a preset shaking event occurs in the handheld gimbal; if it is determined that a preset jittering event occurs in the handheld gimbal, the target control coefficient is adjusted; according to the position of the target object in the image and the adjusted target control coefficient, Control the movement of the handheld gimbal. Among them, the gimbal can detect the movement of the gimbal through the built-in IMU (Inertial Measurement Unit), and based on the detected information, you can know whether a preset jitter event occurs in the gimbal. By adjusting the target control coefficient when the handheld gimbal shakes abnormally, the gimbal can better follow the target object and improve the following effect based on the position of the target object in the image and the adjusted target control coefficient.
举例来说,若控制环路为PID控制环路,则在确定手持云台发生预设抖动事件时,一般情况下可以调小PID控制环路中的比例系数P,这样,相当于基于反馈的控制量减小,进而减少因超调发生的抖动。然而,若比例系数P减小太多,可能会出现控制量过小,导致云台追不上目标。因此,可以逐级递减比例系数P,使之处于一个合理的调节范围。For example, if the control loop is a PID control loop, when it is determined that a preset jitter event occurs in the handheld gimbal, the proportional coefficient P in the PID control loop can generally be reduced. The amount of control is reduced, which in turn reduces jitter due to overshoot. However, if the proportional coefficient P is reduced too much, the control amount may be too small, causing the gimbal to fail to catch up with the target. Therefore, the proportional coefficient P can be decreased step by step to keep it in a reasonable adjustment range.
在一实施例中,在跟随拍摄目标对象的过程中,响应于用户对手持云台的云台控制部件的触发操作,获取云台控制部件输入的运动控制量;根据该运动控制量,控制手持云台运动,以改变目标对象在该图像内的位置。其中,云台控制部件包括摇杆和拨轮键中的任一项,触发操作包括用户对摇杆的打杆操作和用户对拨轮键的转动操作中的任一项。通过在跟随目标对象的过程中,通过云台控制部件调整目标对象在该图像内的位置,提高用户构图的便利性。In one embodiment, in the process of following the shooting target object, in response to the user's triggering operation on the pan-tilt control part of the hand-held pan-tilt, the motion control amount input by the pan-tilt control part is obtained; The gimbal moves to change the position of the target object within the image. Wherein, the pan-tilt control component includes any one of a joystick and a dial key, and the trigger operation includes any one of a user's operation on the joystick and a user's rotation operation on the dial key. During the process of following the target object, the position of the target object in the image is adjusted through the pan-tilt control component, so as to improve the convenience of the user's composition.
示例性的,如图11所示,目标对象21位于图像的中央区域,当用户操作摇杆和/或拨轮键后,控制手持云台运动,使得目标对象21在该图像内的位置由如图21所示的中央位置变化为如图12所示的左侧区域位置。Exemplarily, as shown in FIG. 11 , the target object 21 is located in the central area of the image. After the user operates the joystick and/or the dial button, the hand-held pan/tilt is controlled to move, so that the position of the target object 21 in the image is determined by: The center position shown in FIG. 21 is changed to the left area position shown in FIG. 12 .
在一实施例中,根据该运动控制量,控制手持云台运动,以改变目标对象在该图像内的位置之前,先控制手持云台暂停对目标对象进行跟随,在暂停对目标对象进行跟随之后,根据该运动控制量,控制手持云台运动,以改变目标对象在该图像内的位置。通过暂停对目标对象进行跟随,再控制手持云台运动,以改变目标对象在该图像内的位置,可以防止用户的构图发生变化,提高用户体验。In one embodiment, according to the motion control amount, control the movement of the handheld pan/tilt to change the position of the target object in the image, first control the handheld pan/tilt to suspend following the target object, and after suspending the tracking of the target object , according to the motion control amount, control the movement of the hand-held gimbal to change the position of the target object in the image. By pausing to follow the target object, and then controlling the movement of the handheld gimbal to change the position of the target object in the image, the composition of the user can be prevented from changing, and the user experience can be improved.
在一实施例中,在响应触发操作后的预设时间内,若检测到云台控制部件未被操作,则控制手持云台继续对目标对象进行跟随。其中,预设时间可基于实际情况进行设置,本申请对此不做具体限定,例如,预设时间为2秒。通过改变目标对象在该图像内的位置后的一段时间内,用户未操作云台控制部件时,可以控制手持云台继续对目标对象进行跟随,不需要用户手动的再次触发目标对象的跟随,极大地提高了用户体验。In one embodiment, within a preset time after responding to the trigger operation, if it is detected that the control part of the gimbal is not operated, the handheld gimbal is controlled to continue to follow the target object. Wherein, the preset time may be set based on the actual situation, which is not specifically limited in this application, for example, the preset time is 2 seconds. By changing the position of the target object in the image for a period of time, when the user does not operate the control part of the gimbal, the handheld gimbal can be controlled to continue to follow the target object, and the user does not need to manually trigger the following of the target object again. Greatly improved user experience.
在一实施例中,响应于用户对云台控制部件的触发操作,获取云台控制部件输入的运动控制量的方式可以为:响应于用户对摇杆的打杆操作,确定手持云台的第一目标电机的第一转动控制量;同时响应于用户对拨轮键的转动操作, 确定手持云台的第二目标电机的第二转动控制量;根据第一转动控制量,控制手持云台的第一目标电机转动,并根据第二转动控制量,控制手持云台的第二目标电机转动。其中,第一目标电机与第二目标电机不同,第一目标电机包括俯仰轴电机、平移轴电机和横滚轴电机中的任一项,第二目标电机包括俯仰轴电机、平移轴电机和横滚轴电机中的任一项。用户可以通过摇杆和拨轮键同时对手持云台进行控制,提高了用户对云台的控制便利性。In one embodiment, in response to the user's triggering operation on the pan-tilt control part, the method of acquiring the motion control amount input by the pan-tilt control part may be: in response to the user's operation of the joystick, determining the first position of the hand-held pan-tilt control part. The first rotation control amount of a target motor; at the same time, in response to the user's rotation operation on the dial key, determine the second rotation control amount of the second target motor of the handheld pan-tilt head; according to the first rotation control amount, control the hand-held pan-tilt head The first target motor rotates, and according to the second rotation control amount, the second target motor of the handheld gimbal is controlled to rotate. Wherein, the first target motor is different from the second target motor, the first target motor includes any one of a pitch axis motor, a translation axis motor and a roll axis motor, and the second target motor includes a pitch axis motor, a translation axis motor and a roll axis motor Either of the roller motors. The user can control the handheld gimbal at the same time through the joystick and the dial button, which improves the user's convenience in controlling the gimbal.
在一实施例中,在跟随目标对象的过程中,若检测到图像内存在多个待跟随对象,则在每个待跟随对象上显示标识图标。其中,待跟随对象为目标对象的标识图标为第一标识图标,待跟随对象不为目标对象的标识图标为第二标识图标,第一标识图标与第二标识图标不同,例如,第一标识图标包括第一矩形框,第二标识图标包括第二矩形框,所述第一矩形框与所述第二矩形框的颜色不同,又例如,第一矩形框内显示有跟踪标识,第二矩形框内未显示有跟踪标识,该跟踪标识的具体形式可以根据实际情况进行设置,例如为五角星。通过在每个待跟随对象上显示标识图标,便于用户区分目标对象,也便于用户从多个待跟随对象中重新选择目标对象。In one embodiment, in the process of following the target object, if it is detected that there are multiple objects to be followed in the image, an identification icon is displayed on each object to be followed. Wherein, the identification icon whose object to be followed is the target object is the first identification icon, the identification icon whose object to be followed is not the target object is the second identification icon, and the first identification icon is different from the second identification icon, for example, the first identification icon It includes a first rectangular frame, and the second identification icon includes a second rectangular frame. The color of the first rectangular frame and the second rectangular frame is different. For another example, the tracking logo is displayed in the first rectangular frame, and the second rectangular frame is displayed. There is no tracking mark displayed inside, and the specific form of the tracking mark can be set according to the actual situation, such as a five-pointed star. By displaying an identification icon on each object to be followed, it is convenient for the user to distinguish the target object, and it is also convenient for the user to re-select the target object from a plurality of objects to be followed.
示例性的,如图13所示,显示装置显示的图像包括三个待跟随对象,分别为待跟随对象31、待跟随对象32和待跟随对象33,且待跟随对象31、待跟随对象32和待跟随对象33上的标识图标分别为标识图标34、标识图标35和标识图标36,而待跟随对象31为目标对象,因此,标识图标34内显示有跟踪标识37,标识图标35和标识图标36未显示有跟踪标识。Exemplarily, as shown in FIG. 13 , the image displayed by the display device includes three objects to be followed, namely the object to be followed 31 , the object to be followed 32 and the object to be followed 33 , and the object to be followed 31 , the object to be followed 32 and the The identification icons on the object to be followed 33 are the identification icon 34, the identification icon 35 and the identification icon 36 respectively, and the object to be followed 31 is the target object, therefore, the identification icon 34 displays the tracking mark 37, the identification icon 35 and the identification icon 36 Trace marks are not shown.
在一实施例中,响应于用户对对象切换部件的触发操作,从多个待跟随对象中重新选择一个待跟随对象作为目标对象。其中,手持云台的对象切换部件设置于手柄部,对象切换部件用于切换跟随的目标对象,对象切换部件包括摇杆、拨轮键和按钮等,在重新选择目标对象后,调整待跟随对象上的标识图标,以使重新选择的目标对象上的标识图标为第一标识图标。通过设置对象切换部件,便于用户快速的切换目标对象。In one embodiment, in response to a user's triggering operation on the object switching component, an object to be followed is re-selected from a plurality of objects to be followed as the target object. Among them, the object switching part of the handheld gimbal is set on the handle part, the object switching part is used to switch the target object to follow, and the object switching part includes a joystick, dial keys and buttons, etc. After re-selecting the target object, adjust the object to be followed The identification icon on the re-selected target object is the first identification icon. By setting the object switching component, it is convenient for the user to quickly switch the target object.
示例性的,如图13所示,待跟随对象31为目标对象,如果此时用户操作对象切换部件,则目标对象由如图13所示的待跟随对象31变化为如图14所示的待跟随对象32,且跟踪标识37由如图13所示的位置变化为如图14所示的位置,即跟踪标识37位于待跟随对象32的标识图标35,或者,目标对象由如图13所示的待跟随对象31变化为如图15所示的待跟随对象33,且跟踪标识37由如图13所示的位置变化为如图15所示的位置,即跟踪标识37位于待跟 随对象33的标识图标36。Exemplarily, as shown in FIG. 13 , the object to be followed 31 is the target object. If the user operates the object switching component at this time, the target object changes from the object to be followed 31 shown in FIG. 13 to the object to be followed as shown in FIG. 14 . Follow the object 32, and the tracking mark 37 changes from the position shown in FIG. 13 to the position shown in FIG. 14, that is, the tracking mark 37 is located at the identification icon 35 of the object to be followed 32, or the target object is shown in FIG. 13. The object to be followed 31 is changed to the object to be followed 33 as shown in Figure 15, and the tracking mark 37 is changed from the position shown in Figure 13 to the position shown in Figure 15, that is, the tracking mark 37 is located at the position of the object to be followed 33. logo icon 36.
上述实施例提供的手持云台控制方法,通过获取拍摄设备的视场角和拍摄设备实时采集到的图像,并控制显示装置显示该图像,然后响应于用户对显示装置上显示的图像的对象选择操作,确定图像中的目标对象,并根据拍摄设备的视场角和目标对象在图像中的位置,控制手持云台运动,以使拍摄设备对目标对象进行跟随拍摄,便于用户控制云台智能的跟随目标对象,提高用户控制云台智能的跟随目标对象的便利性,也可以提高手持云台对目标对象的跟随效果,极大地提高了用户体验。The handheld pan-tilt control method provided by the above-mentioned embodiments obtains the field of view of the photographing device and the image collected in real time by the photographing device, and controls the display device to display the image, and then responds to the user's selection of the object of the image displayed on the display device. Operation, determine the target object in the image, and control the movement of the handheld gimbal according to the field of view of the shooting device and the position of the target object in the image, so that the shooting device can follow the target object, and it is convenient for the user to control the intelligent gimbal. Following the target object improves the convenience for the user to control the PTZ intelligently following the target object, and can also improve the tracking effect of the handheld PTZ to the target object, which greatly improves the user experience.
请参阅图16,图16是本申请实施例提供的一种手持云台的结构示意性框图。Please refer to FIG. 16 . FIG. 16 is a schematic block diagram of the structure of a handheld gimbal provided by an embodiment of the present application.
如图16所示,手持云台200包括处理器201、存储器202和显示装置203,处理器201、存储器202和显示装置203通过总线204连接,该总线204比如为I2C(Inter-integrated Circuit)总线。As shown in FIG. 16 , the handheld pan/tilt 200 includes a processor 201, a memory 202, and a display device 203. The processor 201, the memory 202, and the display device 203 are connected through a bus 204, such as an I2C (Inter-integrated Circuit) bus. .
具体地,处理器201可以是微控制单元(Micro-controller Unit,MCU)、中央处理单元(Central Processing Unit,CPU)或数字信号处理器(Digital Signal Processor,DSP)等。Specifically, the processor 201 may be a micro-controller unit (Micro-controller Unit, MCU), a central processing unit (Central Processing Unit, CPU), or a digital signal processor (Digital Signal Processor, DSP) or the like.
具体地,存储器202可以是Flash芯片、只读存储器(ROM,Read-Only Memory)磁盘、光盘、U盘或移动硬盘等。Specifically, the memory 202 may be a Flash chip, a read-only memory (ROM, Read-Only Memory) magnetic disk, an optical disk, a U disk, or a removable hard disk, or the like.
其中,所述处理器201用于运行存储在存储器202中的计算机程序,并在执行所述计算机程序时实现如下步骤:Wherein, the processor 201 is used for running the computer program stored in the memory 202, and implements the following steps when executing the computer program:
获取所述拍摄设备的视场角;obtaining the field of view of the photographing device;
获取所述拍摄设备实时采集到的图像,并控制所述显示装置显示所述图像;acquiring an image captured in real time by the photographing device, and controlling the display device to display the image;
响应于用户对所述图像的对象选择操作,确定所述图像中的目标对象;In response to a user's object selection operation on the image, determining a target object in the image;
根据所述视场角和所述目标对象在所述图像中的位置,控制所述手持云台运动,以使所述拍摄设备对所述目标对象进行跟随拍摄。According to the angle of view and the position of the target object in the image, the hand-held pan/tilt head is controlled to move, so that the shooting device can follow the shooting of the target object.
在一实施例中,所述获取所述拍摄设备的视场角,包括执行以下任意操作:In one embodiment, the acquiring the field of view of the photographing device includes performing any of the following operations:
响应于用户的第一输入操作,获取所述视场角;或,In response to the user's first input operation, acquiring the field of view; or,
基于预设的视场角校准操作,获取所述视场角。The viewing angle is acquired based on a preset viewing angle calibration operation.
在一实施例中,所述基于预设的视场角校准操作,获取所述视场角,包括:In one embodiment, the obtaining the field of view angle based on the preset field of view angle calibration operation includes:
获取所述拍摄设备在所述手持云台处于第一姿态拍摄得到的第一图像和处于第二姿态拍摄得到的第一图像;acquiring a first image captured by the photographing device in a first posture of the handheld gimbal and a first image captured in a second posture;
根据所述第一图像和所述第二图像中的相同对象的位置差和所述手持云台 在所述第一姿态与所述第二姿态之间的转动角度,确定所述拍摄设备的视场角。According to the position difference of the same object in the first image and the second image and the rotation angle of the handheld platform between the first posture and the second posture, the visual angle of the photographing device is determined field angle.
在一实施例中,所述获取所述拍摄设备在所述手持云台处于第一姿态拍摄得到的第一图像和处于第二姿态拍摄得到的第一图像,包括:In one embodiment, the acquiring the first image obtained by the photographing device in the first posture of the handheld gimbal and the first image photographed in the second posture includes:
获取触发的视场角校准指令,并根据所述视场角校准指令,控制所述手持云台转动;acquiring the triggered field angle calibration instruction, and controlling the hand-held pan/tilt to rotate according to the field angle calibration instruction;
当所述手持云台处于所述第一姿态时,控制所述拍摄设备拍照,得到所述第一图像;When the handheld gimbal is in the first posture, controlling the photographing device to take pictures to obtain the first image;
当所述手持云台处于所述第二姿态时,控制所述拍摄设备拍照,得到所述第二图像。When the handheld gimbal is in the second posture, the photographing device is controlled to take pictures to obtain the second image.
在一实施例中,所述根据所述视场角和所述目标对象在所述图像中的位置,控制所述手持云台运动,包括:In an embodiment, the controlling the movement of the handheld gimbal according to the angle of view and the position of the target object in the image includes:
根据所述视场角,确定所述手持云台的控制环路的目标控制系数;determining the target control coefficient of the control loop of the handheld pan/tilt according to the field of view;
根据所述目标对象在所述图像中的位置和所述目标控制系数,控制所述手持云台运动。According to the position of the target object in the image and the target control coefficient, the hand-held pan/tilt head is controlled to move.
在一实施例中,所述处理器还用于实现以下步骤:In one embodiment, the processor is further configured to implement the following steps:
响应于用户的第二输入操作,调整所述目标控制系数;adjusting the target control coefficient in response to the user's second input operation;
根据所述目标对象在所述图像中的位置和调整后的所述目标控制系数,控制所述手持云台运动。According to the position of the target object in the image and the adjusted target control coefficient, the movement of the handheld gimbal is controlled.
在一实施例中,所述处理器还用于实现以下步骤:In one embodiment, the processor is further configured to implement the following steps:
检测所述手持云台是否发生预设抖动事件;Detecting whether a preset jitter event occurs in the handheld gimbal;
若确定发生所述预设抖动事件,调整所述目标控制系数;If it is determined that the preset shaking event occurs, adjusting the target control coefficient;
根据所述目标对象在所述图像中的位置和调整后的所述目标控制系数,控制所述手持云台运动。According to the position of the target object in the image and the adjusted target control coefficient, the movement of the handheld gimbal is controlled.
在一实施例中,所述手持云台包括手柄部,所述显示装置设置于所述手柄部。In one embodiment, the handheld pan/tilt head includes a handle portion, and the display device is disposed on the handle portion.
在一实施例中,所述手持云台还包括操作按键,所述操作按键设置于所述显示装置周围。In an embodiment, the handheld pan/tilt head further includes operation buttons, and the operation buttons are arranged around the display device.
在一实施例中,所述对象选择操作包括用户对所述图像的触控操作,所述响应于用户对所述图像的对象选择操作,确定所述图像中的目标对象,包括:In one embodiment, the object selection operation includes a user's touch operation on the image, and the determining the target object in the image in response to the user's object selection operation on the image includes:
响应于用户在所述显示装置上的对所述图像的触控操作,获取所述触控操作的触控位置在所述图像内的位置坐标;In response to a user's touch operation on the image on the display device, acquiring the position coordinates of the touch position of the touch operation in the image;
根据所述位置坐标,确定所述图像中的目标对象。According to the position coordinates, the target object in the image is determined.
在一实施例中,所述根据所述位置坐标,确定所述图像中的目标对象,包括:In an embodiment, the determining the target object in the image according to the position coordinates includes:
根据所述显示装置的长宽信息和所述图像的长宽信息,确定坐标转换关系;Determine the coordinate conversion relationship according to the length and width information of the display device and the length and width information of the image;
根据所述坐标转换关系对所述位置坐标进行转换,得到目标位置坐标,并根据所述目标位置坐标,确定所述图像中的目标对象。The position coordinates are converted according to the coordinate conversion relationship to obtain target position coordinates, and the target object in the image is determined according to the target position coordinates.
在一实施例中,所述图像内显示有待选区域框,所述手持云台还包括操作按键,所述对象选择操作包括用户对所述操作按键的第一触发操作,所述响应于用户对所述图像的对象选择操作,确定所述图像中的目标对象,包括:In an embodiment, a frame to be selected is displayed in the image, the handheld pan/tilt further includes an operation button, the object selection operation includes a first trigger operation of the operation button by the user, the The object selection operation of the image, to determine the target object in the image, includes:
响应于用户对所述操作按键的第一触发操作,获取所述待选区域框在所述图像内的当前位置信息;Acquiring current position information of the to-be-selected area frame in the image in response to the user's first trigger operation on the operation button;
根据所述当前位置信息,确定所述图像中的目标对象。According to the current position information, the target object in the image is determined.
在一实施例中,所述响应于用户对所述图像的对象选择操作,确定所述图像中的目标对象,包括:In one embodiment, the determining the target object in the image in response to the user's object selection operation on the image includes:
响应于用户对所述操作按键的第二触发操作,改变所述待选区域框在所述图像内的位置;In response to the user's second trigger operation on the operation button, changing the position of the to-be-selected area frame within the image;
响应于用户对所述操作按键的第一触发操作,获取所述待选区域框在所述图像内的当前位置信息;Acquiring current position information of the to-be-selected area frame in the image in response to the user's first trigger operation on the operation button;
根据所述当前位置信息,确定所述图像中的目标对象。According to the current position information, the target object in the image is determined.
在一实施例中,所述第一触发操作与所述第二触发操作不同。In one embodiment, the first trigger operation is different from the second trigger operation.
在一实施例中,所述手持云台还包括云台控制部件,所述处理器还用于实现以下步骤:In one embodiment, the handheld pan/tilt further includes a pan/tilt control component, and the processor is further configured to implement the following steps:
在跟随拍摄所述目标对象的过程中,响应于用户对所述云台控制部件的触发操作,获取所述云台控制部件输入的运动控制量;In the process of following and photographing the target object, in response to a triggering operation of the pan-tilt control part by the user, acquiring the motion control amount input by the pan-tilt control part;
根据所述运动控制量,控制所述手持云台运动,以改变所述目标对象在所述图像内的位置。According to the motion control amount, the hand-held pan/tilt head is controlled to move to change the position of the target object in the image.
在一实施例中,所述根据所述运动控制量,控制所述手持云台运动,以改变所述目标对象在所述图像内的位置之前,还包括:In one embodiment, before controlling the motion of the handheld gimbal to change the position of the target object in the image according to the motion control amount, the method further includes:
控制所述手持云台暂停对所述目标对象进行跟随。The handheld gimbal is controlled to suspend following the target object.
在一实施例中,所述处理器还用于实现以下步骤:In one embodiment, the processor is further configured to implement the following steps:
在响应所述触发操作后的预设时间内,若检测到所述云台控制部件未被操作,则控制所述手持云台继续对所述目标对象进行跟随。Within a preset time after responding to the trigger operation, if it is detected that the pan-tilt control component is not operated, the handheld pan-tilt is controlled to continue to follow the target object.
在一实施例中,所述云台控制部件包括摇杆和拨轮键中的任一项,所述触 发操作包括用户对所述摇杆的打杆操作和用户对所述拨轮键的转动操作中的任一项。In one embodiment, the pan/tilt control component includes any one of a joystick and a dial key, and the trigger operation includes a user's lever operation on the rocker and a user's rotation of the dial key. any of the operations.
在一实施例中,所述响应于用户对所述云台控制部件的触发操作,获取所述云台控制部件输入的运动控制量,包括:In one embodiment, the acquiring the motion control quantity input by the pan-tilt control component in response to the triggering operation of the pan-tilt control component by the user includes:
响应于用户对所述摇杆的打杆操作,确定所述手持云台的第一目标电机的第一转动控制量;In response to the user's manipulation of the joystick, determining the first rotation control amount of the first target motor of the handheld gimbal;
同时响应于用户对所述拨轮键的转动操作,确定所述手持云台的第二目标电机的第二转动控制量;At the same time, in response to the user's rotational operation of the dial key, determining the second rotational control amount of the second target motor of the handheld pan/tilt head;
所述根据所述运动控制量,控制所述手持云台运动,包括:The controlling the movement of the handheld gimbal according to the movement control amount includes:
根据所述第一转动控制量,控制所述手持云台的第一目标电机转动,并根据所述第二转动控制量,控制所述手持云台的第二目标电机转动。According to the first rotation control amount, the first target motor of the handheld gimbal is controlled to rotate, and according to the second rotation control amount, the second target motor of the handheld gimbal is controlled to rotate.
在一实施例中,所述目标对象上显示有第一标识图标,所述处理器还用于实现以下步骤:In one embodiment, a first identification icon is displayed on the target object, and the processor is further configured to implement the following steps:
在跟随所述目标对象的过程中,若检测到所述图像内存在多个待跟随对象,则在每个所述待跟随对象上显示标识图标;During the process of following the target object, if it is detected that there are multiple objects to be followed in the image, an identification icon is displayed on each of the objects to be followed;
其中,所述待跟随对象为所述目标对象的标识图标为第一标识图标,所述待跟随对象不为所述目标对象的标识图标为第二标识图标。Wherein, the identification icon in which the object to be followed is the target object is the first identification icon, and the identification icon in which the object to be followed is not the target object is the second identification icon.
在一实施例中,所述第一标识图标包括第一矩形框,所述第二标识图标包括第二矩形框,所述第一矩形框与所述第二矩形框的颜色不同。In one embodiment, the first identification icon includes a first rectangular frame, the second identification icon includes a second rectangular frame, and the color of the first rectangular frame and the second rectangular frame are different.
在一实施例中,所述第一矩形框内显示有跟踪标识,所述第二矩形框内未显示有跟踪标识。In one embodiment, a tracking mark is displayed in the first rectangular frame, and no tracking mark is displayed in the second rectangular frame.
在一实施例中,所述手持云台还包括对象切换部件,所述处理器还用于实现以下步骤:In one embodiment, the handheld pan/tilt further includes an object switching component, and the processor is further configured to implement the following steps:
响应于用户对所述对象切换部件的触发操作,从所述多个待跟随对象中重新选择一个待跟随对象作为目标对象。In response to a triggering operation of the object switching component by the user, an object to be followed is reselected from the plurality of objects to be followed as a target object.
在一实施例中,所述处理器还用于实现以下步骤:In one embodiment, the processor is further configured to implement the following steps:
在重新选择目标对象后,调整所述标识图标,以使重新选择的目标对象上的标识图标为所述第一标识图标。After the target object is reselected, the identification icon is adjusted so that the identification icon on the reselected target object is the first identification icon.
需要说明的是,所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,上述描述的手持云台的具体工作过程,可以参考前述手持云台控制方法实施例中的对应过程,在此不再赘述。It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of the description, for the specific working process of the hand-held pan/tilt head described above, you can refer to the corresponding process in the above-mentioned embodiments of the hand-held pan/tilt control method. This will not be repeated here.
请参阅图17,图17是本申请实施例提供的一种拍摄系统的结构示意性框 图。Please refer to FIG. 17. FIG. 17 is a schematic block diagram of the structure of a photographing system provided by an embodiment of the present application.
如图17所示,拍摄系统300包括手持云台310和搭载于手持云台310上的拍摄设备320,手持云台310与拍摄设备320通信连接。As shown in FIG. 17 , the photographing system 300 includes a handheld gimbal 310 and a photographing device 320 mounted on the handheld gimbal 310 , and the handheld gimbal 310 is communicatively connected to the photographing device 320 .
需要说明的是,所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,上述描述的拍摄系统的具体工作过程,可以参考前述手持云台控制方法实施例中的对应过程,在此不再赘述。It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of the description, for the specific working process of the shooting system described above, reference may be made to the corresponding process in the foregoing embodiments of the handheld pan-tilt control method. No longer.
本申请实施例还提供一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序中包括程序指令,所述处理器执行所述程序指令,实现上述实施例提供的手持云台控制方法的步骤。Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and the computer program includes program instructions, and the processor executes the program instructions to realize the provision of the above embodiments. The steps of the hand-held PTZ control method.
其中,所述计算机可读存储介质可以是前述任一实施例所述的手持云台的内部存储单元,例如所述手持云台的硬盘或内存。所述计算机可读存储介质也可以是所述手持云台的外部存储设备,例如所述手持云台上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。Wherein, the computer-readable storage medium may be an internal storage unit of the handheld pan/tilt described in any of the foregoing embodiments, such as a hard disk or a memory of the handheld pan/tilt. The computer-readable storage medium can also be an external storage device of the handheld PTZ, such as a plug-in hard disk equipped on the handheld PTZ, a smart memory card (Smart Media Card, SMC), a Secure Digital (Secure Digital) , SD) card, flash memory card (Flash Card), etc.
应当理解,在此本申请说明书中所使用的术语仅仅是出于描述特定实施例的目的而并不意在限制本申请。如在本申请说明书和所附权利要求书中所使用的那样,除非上下文清楚地指明其它情况,否则单数形式的“一”、“一个”及“该”意在包括复数形式。It should be understood that the terms used in the specification of the present application herein are for the purpose of describing particular embodiments only and are not intended to limit the present application. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural unless the context clearly dictates otherwise.
还应当理解,在本申请说明书和所附权利要求书中使用的术语“和/或”是指相关联列出的项中的一个或多个的任何组合以及所有可能组合,并且包括这些组合。It will also be understood that, as used in this specification and the appended claims, the term "and/or" refers to and including any and all possible combinations of one or more of the associated listed items.
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到各种等效的修改或替换,这些修改或替换都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以权利要求的保护范围为准。The above are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of various equivalents within the technical scope disclosed in the present application. Modifications or substitutions shall be covered by the protection scope of this application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (50)

  1. 一种手持云台控制方法,其特征在于,所述手持云台包括显示装置,所述手持云台用于搭载拍摄设备,所述手持云台与所述拍摄设备通信连接,所述方法包括:A method for controlling a handheld PTZ, characterized in that the handheld PTZ includes a display device, the handheld PTZ is used for carrying a shooting device, and the handheld PTZ is communicatively connected to the shooting device, and the method includes:
    获取所述拍摄设备的视场角;obtaining the field of view of the photographing device;
    获取所述拍摄设备实时采集到的图像,并控制所述显示装置显示所述图像;acquiring an image captured in real time by the photographing device, and controlling the display device to display the image;
    响应于用户对所述图像的对象选择操作,确定所述图像中的目标对象;In response to a user's object selection operation on the image, determining a target object in the image;
    根据所述视场角和所述目标对象在所述图像中的位置,控制所述手持云台运动,以使所述拍摄设备对所述目标对象进行跟随拍摄。According to the angle of view and the position of the target object in the image, the hand-held pan/tilt head is controlled to move, so that the shooting device can follow the shooting of the target object.
  2. 根据权利要求1所述的手持云台控制方法,其特征在于,所述获取所述拍摄设备的视场角,包括执行以下任意操作:The method for controlling a handheld PTZ according to claim 1, wherein the acquiring the field of view of the shooting device comprises performing any of the following operations:
    响应于用户的第一输入操作,获取所述视场角;或,In response to the user's first input operation, acquiring the field of view; or,
    基于预设的视场角校准操作,获取所述视场角。The viewing angle is acquired based on a preset viewing angle calibration operation.
  3. 根据权利要求2所述的手持云台控制方法,其特征在于,所述基于预设的视场角校准操作,获取所述视场角,包括:The hand-held pan-tilt control method according to claim 2, wherein the obtaining the field of view angle based on the preset field of view angle calibration operation comprises:
    获取所述拍摄设备在所述手持云台处于第一姿态拍摄得到的第一图像和处于第二姿态拍摄得到的第一图像;Acquiring a first image obtained by the photographing device when the handheld gimbal is in a first posture and a first image obtained by being photographed in a second posture;
    根据所述第一图像和所述第二图像中的相同对象的位置差和所述手持云台在所述第一姿态与所述第二姿态之间的转动角度,确定所述拍摄设备的视场角。According to the position difference of the same object in the first image and the second image and the rotation angle of the handheld platform between the first posture and the second posture, the visual angle of the photographing device is determined field angle.
  4. 根据权利要求3所述的手持云台控制方法,其特征在于,所述获取所述拍摄设备在所述手持云台处于第一姿态拍摄得到的第一图像和处于第二姿态拍摄得到的第一图像,包括:The method for controlling a handheld gimbal according to claim 3, wherein the acquiring a first image captured by the photographing device in a first attitude of the handheld gimbal and a first image captured in a second attitude images, including:
    获取触发的视场角校准指令,并根据所述视场角校准指令,控制所述手持云台转动;acquiring the triggered field angle calibration instruction, and controlling the hand-held pan/tilt to rotate according to the field angle calibration instruction;
    当所述手持云台处于所述第一姿态时,控制所述拍摄设备拍照,得到所述第一图像;When the handheld gimbal is in the first posture, controlling the photographing device to take pictures to obtain the first image;
    当所述手持云台处于所述第二姿态时,控制所述拍摄设备拍照,得到所述第二图像。When the handheld gimbal is in the second posture, the photographing device is controlled to take pictures to obtain the second image.
  5. 根据权利要求1-4任一项所述的手持云台控制方法,其特征在于,所述根据所述视场角和所述目标对象在所述图像中的位置,控制所述手持云台运动, 包括:The method for controlling a handheld gimbal according to any one of claims 1 to 4, wherein the controlling the movement of the handheld gimbal according to the angle of view and the position of the target object in the image , include:
    根据所述视场角,确定所述手持云台的控制环路的目标控制系数;determining the target control coefficient of the control loop of the handheld pan/tilt according to the field of view;
    根据所述目标对象在所述图像中的位置和所述目标控制系数,控制所述手持云台运动。According to the position of the target object in the image and the target control coefficient, the hand-held pan/tilt head is controlled to move.
  6. 根据权利要求5所述的手持云台控制方法,其特征在于,所述方法还包括:The hand-held PTZ control method according to claim 5, wherein the method further comprises:
    响应于用户的第二输入操作,调整所述目标控制系数;adjusting the target control coefficient in response to the user's second input operation;
    根据所述目标对象在所述图像中的位置和调整后的所述目标控制系数,控制所述手持云台运动。According to the position of the target object in the image and the adjusted target control coefficient, the movement of the handheld gimbal is controlled.
  7. 根据权利要求5所述的手持云台控制方法,其特征在于,所述方法还包括:The hand-held PTZ control method according to claim 5, wherein the method further comprises:
    检测所述手持云台是否发生预设抖动事件;Detecting whether a preset jitter event occurs in the handheld gimbal;
    若确定发生所述预设抖动事件,调整所述目标控制系数;If it is determined that the preset shaking event occurs, adjusting the target control coefficient;
    根据所述目标对象在所述图像中的位置和调整后的所述目标控制系数,控制所述手持云台运动。According to the position of the target object in the image and the adjusted target control coefficient, the movement of the handheld gimbal is controlled.
  8. 根据权利要求1-4中任一项所述的手持云台控制方法,其特征在于,所述手持云台包括手柄部,所述显示装置设置于所述手柄部。The method for controlling a handheld pan/tilt according to any one of claims 1 to 4, wherein the handheld pan/tilt comprises a handle portion, and the display device is disposed on the handle portion.
  9. 根据权利要求1-4中任一项所述的手持云台控制方法,其特征在于,所述手持云台还包括操作按键,所述操作按键设置于所述显示装置周围。The method for controlling a handheld pan/tilt head according to any one of claims 1 to 4, wherein the handheld pan/tilt head further comprises an operation button, and the operation button is arranged around the display device.
  10. 根据权利要求1-4中任一项所述的手持云台控制方法,其特征在于,所述对象选择操作包括用户对所述图像的触控操作,所述响应于用户对所述图像的对象选择操作,确定所述图像中的目标对象,包括:The method for controlling a handheld PTZ according to any one of claims 1-4, wherein the object selection operation comprises a user's touch operation on the image, and the object selection in response to the user's operation on the image The selection operation, which determines the target object in the image, includes:
    响应于用户在所述显示装置上的对所述图像的触控操作,获取所述触控操作的触控位置在所述图像内的位置坐标;In response to a user's touch operation on the image on the display device, acquiring the position coordinates of the touch position of the touch operation in the image;
    根据所述位置坐标,确定所述图像中的目标对象。According to the position coordinates, the target object in the image is determined.
  11. 根据权利要求10所述的手持云台控制方法,其特征在于,所述根据所述位置坐标,确定所述图像中的目标对象,包括:The method for controlling a handheld PTZ according to claim 10, wherein the determining the target object in the image according to the position coordinates comprises:
    根据所述显示装置的长宽信息和所述图像的长宽信息,确定坐标转换关系;Determine the coordinate conversion relationship according to the length and width information of the display device and the length and width information of the image;
    根据所述坐标转换关系对所述位置坐标进行转换,得到目标位置坐标,并根据所述目标位置坐标,确定所述图像中的目标对象。The position coordinates are converted according to the coordinate conversion relationship to obtain target position coordinates, and the target object in the image is determined according to the target position coordinates.
  12. 根据权利要求1-4中任一项所述的手持云台控制方法,其特征在于,所述图像内显示有待选区域框,所述手持云台还包括操作按键,所述对象选择 操作包括用户对所述操作按键的第一触发操作,所述响应于用户对所述图像的对象选择操作,确定所述图像中的目标对象,包括:The method for controlling a handheld pan/tilt according to any one of claims 1 to 4, wherein a region frame to be selected is displayed in the image, the handheld pan/tilt further includes operation buttons, and the object selection operation includes a user The first trigger operation on the operation button, the determining the target object in the image in response to the user's object selection operation on the image, includes:
    响应于用户对所述操作按键的第一触发操作,获取所述待选区域框在所述图像内的当前位置信息;Acquiring current position information of the to-be-selected area frame in the image in response to the user's first trigger operation on the operation button;
    根据所述当前位置信息,确定所述图像中的目标对象。According to the current position information, the target object in the image is determined.
  13. 根据权利要求12所述的手持云台控制方法,其特征在于,所述响应于用户对所述图像的对象选择操作,确定所述图像中的目标对象,包括:The method for controlling a handheld PTZ according to claim 12, wherein the determining the target object in the image in response to a user's object selection operation on the image comprises:
    响应于用户对所述操作按键的第二触发操作,改变所述待选区域框在所述图像内的位置;In response to the user's second trigger operation on the operation button, changing the position of the to-be-selected area frame within the image;
    响应于用户对所述操作按键的第一触发操作,获取所述待选区域框在所述图像内的当前位置信息;Acquiring current position information of the to-be-selected area frame in the image in response to the user's first trigger operation on the operation button;
    根据所述当前位置信息,确定所述图像中的目标对象。According to the current position information, the target object in the image is determined.
  14. 根据权利要求13所述的手持云台控制方法,其特征在于,所述第一触发操作与所述第二触发操作不同。The method for controlling a handheld pan-tilt head according to claim 13, wherein the first triggering operation is different from the second triggering operation.
  15. 根据权利要求1-4中任一项所述的手持云台控制方法,其特征在于,所述手持云台还包括云台控制部件,所述方法还包括:The handheld PTZ control method according to any one of claims 1-4, wherein the handheld PTZ further comprises a PTZ control component, and the method further comprises:
    在跟随拍摄所述目标对象的过程中,响应于用户对所述云台控制部件的触发操作,获取所述云台控制部件输入的运动控制量;In the process of following and photographing the target object, in response to a triggering operation of the pan-tilt control part by the user, acquiring the motion control amount input by the pan-tilt control part;
    根据所述运动控制量,控制所述手持云台运动,以改变所述目标对象在所述图像内的位置。According to the motion control amount, the hand-held pan/tilt head is controlled to move to change the position of the target object in the image.
  16. 根据权利要求15所述的手持云台控制方法,其特征在于,所述根据所述运动控制量,控制所述手持云台运动,以改变所述目标对象在所述图像内的位置之前,还包括:The method for controlling the hand-held pan-tilt head according to claim 15, wherein before the control of the motion of the hand-held pan-tilt head according to the motion control amount to change the position of the target object in the image, further include:
    控制所述手持云台暂停对所述目标对象进行跟随。The handheld gimbal is controlled to suspend following the target object.
  17. 根据权利要求16所述的手持云台控制方法,其特征在于,所述方法还包括:The hand-held PTZ control method according to claim 16, wherein the method further comprises:
    在响应所述触发操作后的预设时间内,若检测到所述云台控制部件未被操作,则控制所述手持云台继续对所述目标对象进行跟随。Within a preset time after responding to the trigger operation, if it is detected that the pan-tilt control component is not operated, the handheld pan-tilt is controlled to continue to follow the target object.
  18. 根据权利要求15所述的手持云台控制方法,其特征在于,所述云台控制部件包括摇杆和拨轮键中的任一项,所述触发操作包括用户对所述摇杆的打杆操作和用户对所述拨轮键的转动操作中的任一项。The method for controlling a handheld PTZ according to claim 15, wherein the PTZ control component comprises any one of a joystick and a dial button, and the triggering operation comprises a user pressing a lever on the joystick Any one of the operation and the user's turning operation of the dial key.
  19. 根据权利要求18所述的手持云台控制方法,其特征在于,所述响应于 用户对所述云台控制部件的触发操作,获取所述云台控制部件输入的运动控制量,包括:The hand-held pan-tilt control method according to claim 18, wherein, in response to a triggering operation of the pan-tilt control part by a user, obtaining the motion control amount input by the pan-tilt control part, comprising:
    响应于用户对所述摇杆的打杆操作,确定所述手持云台的第一目标电机的第一转动控制量;In response to the user's manipulation of the joystick, determining the first rotation control amount of the first target motor of the handheld gimbal;
    同时响应于用户对所述拨轮键的转动操作,确定所述手持云台的第二目标电机的第二转动控制量;At the same time, in response to the user's rotational operation of the dial key, determining the second rotational control amount of the second target motor of the handheld pan/tilt head;
    所述根据所述运动控制量,控制所述手持云台运动,包括:The controlling the movement of the handheld gimbal according to the movement control amount includes:
    根据所述第一转动控制量,控制所述手持云台的第一目标电机转动,并根据所述第二转动控制量,控制所述手持云台的第二目标电机转动。According to the first rotation control amount, the first target motor of the handheld gimbal is controlled to rotate, and according to the second rotation control amount, the second target motor of the handheld gimbal is controlled to rotate.
  20. 根据权利要求1-4中任一项所述的手持云台控制方法,其特征在于,所述目标对象上显示有第一标识图标,所述方法还包括:The method for controlling a handheld PTZ according to any one of claims 1-4, wherein a first identification icon is displayed on the target object, and the method further comprises:
    在跟随所述目标对象的过程中,若检测到所述图像内存在多个待跟随对象,则在每个所述待跟随对象上显示标识图标;During the process of following the target object, if it is detected that there are multiple objects to be followed in the image, an identification icon is displayed on each of the objects to be followed;
    其中,所述待跟随对象为所述目标对象的标识图标为第一标识图标,所述待跟随对象不为所述目标对象的标识图标为第二标识图标。Wherein, the identification icon in which the object to be followed is the target object is the first identification icon, and the identification icon in which the object to be followed is not the target object is the second identification icon.
  21. 根据权利要求20所述的手持云台控制方法,其特征在于,所述第一标识图标包括第一矩形框,所述第二标识图标包括第二矩形框,所述第一矩形框与所述第二矩形框的颜色不同。The method for controlling a handheld PTZ according to claim 20, wherein the first identification icon comprises a first rectangular frame, the second identification icon comprises a second rectangular frame, and the first rectangular frame and the The color of the second rectangle is different.
  22. 根据权利要求21所述的手持云台控制方法,其特征在于,所述第一矩形框内显示有跟踪标识,所述第二矩形框内未显示有跟踪标识。The method for controlling a handheld PTZ according to claim 21, wherein a tracking mark is displayed in the first rectangular frame, and a tracking mark is not displayed in the second rectangular frame.
  23. 根据权利要求20所述的手持云台控制方法,其特征在于,所述手持云台还包括对象切换部件,所述方法还包括:The method for controlling a handheld PTZ according to claim 20, wherein the handheld PTZ further comprises an object switching component, and the method further comprises:
    响应于用户对所述对象切换部件的触发操作,从所述多个待跟随对象中重新选择一个待跟随对象作为目标对象。In response to a triggering operation of the object switching component by the user, an object to be followed is reselected from the plurality of objects to be followed as a target object.
  24. 根据权利要求20所述的手持云台控制方法,其特征在于,所述方法还包括:The hand-held PTZ control method according to claim 20, wherein the method further comprises:
    在重新选择目标对象后,调整所述标识图标,以使重新选择的目标对象上的标识图标为所述第一标识图标。After the target object is reselected, the identification icon is adjusted so that the identification icon on the reselected target object is the first identification icon.
  25. 一种手持云台,其特征在于,所述手持云台包括存储器、处理器和显示装置,所述手持云台用于搭载拍摄设备,所述手持云台与所述拍摄设备通信连接;A handheld PTZ, characterized in that the handheld PTZ comprises a memory, a processor and a display device, the handheld PTZ is used for carrying a photographing device, and the handheld PTZ is communicatively connected to the photography device;
    所述存储器,用于存储计算机程序;the memory for storing computer programs;
    所述处理器,用于执行所述计算机程序并在执行所述计算机程序时,实现如下步骤:The processor is configured to execute the computer program and implement the following steps when executing the computer program:
    获取所述拍摄设备的视场角;obtaining the field of view of the photographing device;
    获取所述拍摄设备实时采集到的图像,并控制所述显示装置显示所述图像;acquiring an image captured in real time by the photographing device, and controlling the display device to display the image;
    响应于用户对所述图像的对象选择操作,确定所述图像中的目标对象;In response to a user's object selection operation on the image, determining a target object in the image;
    根据所述视场角和所述目标对象在所述图像中的位置,控制所述手持云台运动,以使所述拍摄设备对所述目标对象进行跟随拍摄。According to the angle of view and the position of the target object in the image, the hand-held pan/tilt head is controlled to move, so that the shooting device can follow the shooting of the target object.
  26. 根据权利要求25所述的手持云台,其特征在于,所述获取所述拍摄设备的视场角,包括执行以下任意操作:The handheld platform according to claim 25, wherein the acquiring the field of view of the photographing device comprises performing any of the following operations:
    响应于用户的第一输入操作,获取所述视场角;或,In response to the user's first input operation, acquiring the field of view; or,
    基于预设的视场角校准操作,获取所述视场角。The viewing angle is acquired based on a preset viewing angle calibration operation.
  27. 根据权利要求26所述的手持云台,其特征在于,所述基于预设的视场角校准操作,获取所述视场角,包括:The handheld gimbal according to claim 26, wherein the obtaining the field of view angle based on the preset field of view angle calibration operation comprises:
    获取所述拍摄设备在所述手持云台处于第一姿态拍摄得到的第一图像和处于第二姿态拍摄得到的第一图像;Acquiring a first image obtained by the photographing device when the handheld gimbal is in a first posture and a first image obtained by being photographed in a second posture;
    根据所述第一图像和所述第二图像中的相同对象的位置差和所述手持云台在所述第一姿态与所述第二姿态之间的转动角度,确定所述拍摄设备的视场角。According to the position difference of the same object in the first image and the second image and the rotation angle of the handheld platform between the first posture and the second posture, the visual angle of the photographing device is determined field angle.
  28. 根据权利要求27所述的手持云台,其特征在于,所述获取所述拍摄设备在所述手持云台处于第一姿态拍摄得到的第一图像和处于第二姿态拍摄得到的第一图像,包括:The handheld gimbal according to claim 27, wherein the acquiring a first image captured by the photographing device in a first posture of the handheld gimbal and a first image captured in a second posture, include:
    获取触发的视场角校准指令,并根据所述视场角校准指令,控制所述手持云台转动;acquiring the triggered field angle calibration instruction, and controlling the hand-held pan/tilt to rotate according to the field angle calibration instruction;
    当所述手持云台处于所述第一姿态时,控制所述拍摄设备拍照,得到所述第一图像;When the handheld gimbal is in the first posture, controlling the photographing device to take pictures to obtain the first image;
    当所述手持云台处于所述第二姿态时,控制所述拍摄设备拍照,得到所述第二图像。When the handheld gimbal is in the second posture, the photographing device is controlled to take pictures to obtain the second image.
  29. 根据权利要求25-28中任一项所述的手持云台,其特征在于,所述根据所述视场角和所述目标对象在所述图像中的位置,控制所述手持云台运动,包括:The handheld gimbal according to any one of claims 25-28, wherein the movement of the handheld gimbal is controlled according to the angle of view and the position of the target object in the image, include:
    根据所述视场角,确定所述手持云台的控制环路的目标控制系数;determining the target control coefficient of the control loop of the handheld pan/tilt according to the field of view;
    根据所述目标对象在所述图像中的位置和所述目标控制系数,控制所述手持云台运动。According to the position of the target object in the image and the target control coefficient, the hand-held pan/tilt head is controlled to move.
  30. 根据权利要求29所述的手持云台,其特征在于,所述处理器还用于实现以下步骤:The handheld PTZ according to claim 29, wherein the processor is further configured to implement the following steps:
    响应于用户的第二输入操作,调整所述目标控制系数;adjusting the target control coefficient in response to the user's second input operation;
    根据所述目标对象在所述图像中的位置和调整后的所述目标控制系数,控制所述手持云台运动。According to the position of the target object in the image and the adjusted target control coefficient, the movement of the handheld gimbal is controlled.
  31. 根据权利要求29所述的手持云台,其特征在于,所述处理器还用于实现以下步骤:The handheld PTZ according to claim 29, wherein the processor is further configured to implement the following steps:
    检测所述手持云台是否发生预设抖动事件;Detecting whether a preset jitter event occurs in the handheld gimbal;
    若确定发生所述预设抖动事件,调整所述目标控制系数;If it is determined that the preset jitter event occurs, adjusting the target control coefficient;
    根据所述目标对象在所述图像中的位置和调整后的所述目标控制系数,控制所述手持云台运动。According to the position of the target object in the image and the adjusted target control coefficient, the movement of the handheld gimbal is controlled.
  32. 根据权利要求25-28中任一项所述的手持云台,其特征在于,所述手持云台包括手柄部,所述显示装置设置于所述手柄部。The handheld cloud platform according to any one of claims 25-28, characterized in that, the handheld cloud platform includes a handle portion, and the display device is arranged on the handle portion.
  33. 根据权利要求25-28中任一项所述的手持云台,其特征在于,所述手持云台还包括操作按键,所述操作按键设置于所述显示装置周围。The handheld PTZ according to any one of claims 25-28, characterized in that, the handheld PTZ further comprises operation buttons, and the operation buttons are arranged around the display device.
  34. 根据权利要求25-28中任一项所述的手持云台,其特征在于,所述对象选择操作包括用户对所述图像的触控操作,所述响应于用户对所述图像的对象选择操作,确定所述图像中的目标对象,包括:The handheld cloud platform according to any one of claims 25-28, wherein the object selection operation comprises a user's touch operation on the image, and the object selection operation in response to the user's operation on the image , determine the target object in the image, including:
    响应于用户在所述显示装置上的对所述图像的触控操作,获取所述触控操作的触控位置在所述图像内的位置坐标;In response to a user's touch operation on the image on the display device, acquiring the position coordinates of the touch position of the touch operation in the image;
    根据所述位置坐标,确定所述图像中的目标对象。According to the position coordinates, the target object in the image is determined.
  35. 根据权利要求34所述的手持云台,其特征在于,所述根据所述位置坐标,确定所述图像中的目标对象,包括:The handheld PTZ according to claim 34, wherein the determining the target object in the image according to the position coordinates comprises:
    根据所述显示装置的长宽信息和所述图像的长宽信息,确定坐标转换关系;Determine the coordinate conversion relationship according to the length and width information of the display device and the length and width information of the image;
    根据所述坐标转换关系对所述位置坐标进行转换,得到目标位置坐标,并根据所述目标位置坐标,确定所述图像中的目标对象。The position coordinates are converted according to the coordinate conversion relationship to obtain target position coordinates, and the target object in the image is determined according to the target position coordinates.
  36. 根据权利要求25所述的手持云台,其特征在于,所述图像内显示有待选区域框,所述手持云台还包括操作按键,所述对象选择操作包括用户对所述操作按键的第一触发操作,所述响应于用户对所述图像的对象选择操作,确定所述图像中的目标对象,包括:The handheld pan/tilt according to claim 25, wherein a frame to be selected is displayed in the image, the handheld pan/tilt further includes an operation button, and the object selection operation includes a user pressing the first operation button on the operation button. Triggering the operation of determining the target object in the image in response to the user's object selection operation on the image, including:
    响应于用户对所述操作按键的第一触发操作,获取所述待选区域框在所述图像内的当前位置信息;Acquiring current position information of the to-be-selected area frame in the image in response to the user's first trigger operation on the operation button;
    根据所述当前位置信息,确定所述图像中的目标对象。According to the current position information, the target object in the image is determined.
  37. 根据权利要求36所述的手持云台,其特征在于,所述响应于用户对所述图像的对象选择操作,确定所述图像中的目标对象,包括:The handheld platform according to claim 36, wherein the determining the target object in the image in response to the user's object selection operation on the image comprises:
    响应于用户对所述操作按键的第二触发操作,改变所述待选区域框在所述图像内的位置;In response to the user's second trigger operation on the operation button, changing the position of the to-be-selected area frame within the image;
    响应于用户对所述操作按键的第一触发操作,获取所述待选区域框在所述图像内的当前位置信息;Acquiring current position information of the to-be-selected area frame in the image in response to the user's first trigger operation on the operation button;
    根据所述当前位置信息,确定所述图像中的目标对象。According to the current position information, the target object in the image is determined.
  38. 根据权利要求37所述的手持云台,其特征在于,所述第一触发操作与所述第二触发操作不同。The handheld gimbal according to claim 37, wherein the first triggering operation is different from the second triggering operation.
  39. 根据权利要求25-28中任一项所述的手持云台,其特征在于,所述手持云台还包括云台控制部件,所述处理器还用于实现以下步骤:The handheld PTZ according to any one of claims 25-28, wherein the handheld PTZ further comprises a PTZ control component, and the processor is further configured to implement the following steps:
    在跟随拍摄所述目标对象的过程中,响应于用户对所述云台控制部件的触发操作,获取所述云台控制部件输入的运动控制量;In the process of following and photographing the target object, in response to a triggering operation of the pan-tilt control part by the user, acquiring the motion control amount input by the pan-tilt control part;
    根据所述运动控制量,控制所述手持云台运动,以改变所述目标对象在所述图像内的位置。According to the motion control amount, the hand-held pan/tilt head is controlled to move to change the position of the target object in the image.
  40. 根据权利要求39所述的手持云台,其特征在于,所述根据所述运动控制量,控制所述手持云台运动,以改变所述目标对象在所述图像内的位置之前,还包括:The handheld gimbal according to claim 39, wherein before the controlling the movement of the handheld gimbal to change the position of the target object in the image according to the motion control amount, the method further comprises:
    控制所述手持云台暂停对所述目标对象进行跟随。The handheld gimbal is controlled to suspend following the target object.
  41. 根据权利要求40所述的手持云台,其特征在于,所述处理器还用于实现以下步骤:The handheld PTZ according to claim 40, wherein the processor is further configured to implement the following steps:
    在响应所述触发操作后的预设时间内,若检测到所述云台控制部件未被操作,则控制所述手持云台继续对所述目标对象进行跟随。Within a preset time after responding to the trigger operation, if it is detected that the pan-tilt control component is not operated, the handheld pan-tilt is controlled to continue to follow the target object.
  42. 根据权利要求39所述的手持云台,其特征在于,所述云台控制部件包括摇杆和拨轮键中的任一项,所述触发操作包括用户对所述摇杆的打杆操作和用户对所述拨轮键的转动操作中的任一项。The hand-held PTZ according to claim 39, wherein the PTZ control component comprises any one of a joystick and a dial button, and the triggering operation comprises a user's stick operation on the joystick and Any one of the user's rotation operations on the dial keys.
  43. 根据权利要求42所述的手持云台,其特征在于,所述响应于用户对所述云台控制部件的触发操作,获取所述云台控制部件输入的运动控制量,包括:The handheld PTZ according to claim 42, wherein, in response to a triggering operation of the PTZ control part by the user, acquiring the motion control quantity input by the PTZ control part comprises:
    响应于用户对所述摇杆的打杆操作,确定所述手持云台的第一目标电机的第一转动控制量;In response to the user's manipulation of the joystick, determining the first rotation control amount of the first target motor of the handheld gimbal;
    同时响应于用户对所述拨轮键的转动操作,确定所述手持云台的第二目标 电机的第二转动控制量;At the same time, in response to the user's rotation operation of the dial key, determine the second rotation control amount of the second target motor of the handheld platform;
    所述根据所述运动控制量,控制所述手持云台运动,包括:The controlling the movement of the handheld gimbal according to the movement control amount includes:
    根据所述第一转动控制量,控制所述手持云台的第一目标电机转动,并根据所述第二转动控制量,控制所述手持云台的第二目标电机转动。According to the first rotation control amount, the first target motor of the handheld pan/tilt is controlled to rotate, and according to the second rotation control amount, the second target motor of the handheld pan/tilt is controlled to rotate.
  44. 根据权利要求25-28中任一项所述的手持云台,其特征在于,所述目标对象上显示有第一标识图标,所述处理器还用于实现以下步骤:The handheld cloud platform according to any one of claims 25-28, wherein a first identification icon is displayed on the target object, and the processor is further configured to implement the following steps:
    在跟随所述目标对象的过程中,若检测到所述图像内存在多个待跟随对象,则在每个所述待跟随对象上显示标识图标;During the process of following the target object, if it is detected that there are multiple objects to be followed in the image, an identification icon is displayed on each of the objects to be followed;
    其中,所述待跟随对象为所述目标对象的标识图标为第一标识图标,所述待跟随对象不为所述目标对象的标识图标为第二标识图标。Wherein, the identification icon in which the object to be followed is the target object is the first identification icon, and the identification icon in which the object to be followed is not the target object is the second identification icon.
  45. 根据权利要求44所述的手持云台,其特征在于,所述第一标识图标包括第一矩形框,所述第二标识图标包括第二矩形框,所述第一矩形框与所述第二矩形框的颜色不同。The hand-held platform according to claim 44, wherein the first identification icon comprises a first rectangular frame, the second identification icon comprises a second rectangular frame, the first rectangular frame and the second rectangular frame The rectangles are colored differently.
  46. 根据权利要求45所述的手持云台,其特征在于,所述第一矩形框内显示有跟踪标识,所述第二矩形框内未显示有跟踪标识。The handheld pan/tilt according to claim 45, wherein a tracking mark is displayed in the first rectangular frame, and no tracking mark is displayed in the second rectangular frame.
  47. 根据权利要求44所述的手持云台,其特征在于,所述手持云台还包括对象切换部件,所述处理器还用于实现以下步骤:The handheld PTZ according to claim 44, wherein the handheld PTZ further comprises an object switching component, and the processor is further configured to implement the following steps:
    响应于用户对所述对象切换部件的触发操作,从所述多个待跟随对象中重新选择一个待跟随对象作为目标对象。In response to a triggering operation of the object switching component by the user, an object to be followed is reselected from the plurality of objects to be followed as a target object.
  48. 根据权利要求44所述的手持云台,其特征在于,所述处理器还用于实现以下步骤:The handheld platform according to claim 44, wherein the processor is further configured to implement the following steps:
    在重新选择目标对象后,调整所述标识图标,以使重新选择的目标对象上的标识图标为所述第一标识图标。After the target object is reselected, the identification icon is adjusted so that the identification icon on the reselected target object is the first identification icon.
  49. 一种拍摄系统,其特征在于,所述拍摄系统包括如权利要求25-48中任一项所述的手持云台和搭载于所述手持云台的拍摄设备,所述手持云台与所述拍摄设备通信连接。A photographing system, characterized in that, the photographing system comprises the handheld cloud platform according to any one of claims 25-48 and a photography device mounted on the handheld cloud platform, the handheld cloud platform and the Shooting device communication connection.
  50. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时使所述处理器实现如权利要求1-24中任一项所述的手持云台控制方法的步骤。A computer-readable storage medium, characterized in that, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the method described in any one of claims 1-24. The steps of the hand-held PTZ control method described above.
PCT/CN2020/116894 2020-09-22 2020-09-22 Handheld gimbal control method, handheld gimbal, system, and readable storage medium WO2022061535A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202080007154.7A CN113260942A (en) 2020-09-22 2020-09-22 Handheld holder control method, handheld holder, system and readable storage medium
PCT/CN2020/116894 WO2022061535A1 (en) 2020-09-22 2020-09-22 Handheld gimbal control method, handheld gimbal, system, and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/116894 WO2022061535A1 (en) 2020-09-22 2020-09-22 Handheld gimbal control method, handheld gimbal, system, and readable storage medium

Publications (1)

Publication Number Publication Date
WO2022061535A1 true WO2022061535A1 (en) 2022-03-31

Family

ID=77181495

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/116894 WO2022061535A1 (en) 2020-09-22 2020-09-22 Handheld gimbal control method, handheld gimbal, system, and readable storage medium

Country Status (2)

Country Link
CN (1) CN113260942A (en)
WO (1) WO2022061535A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115460342A (en) * 2022-07-29 2022-12-09 浙江大华技术股份有限公司 Service setting method and device of camera equipment and multi-path camera linkage system

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117170418B (en) * 2023-11-02 2024-02-20 杭州华橙软件技术有限公司 Cloud deck control method, device, equipment and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102143324A (en) * 2011-04-07 2011-08-03 天津市亚安科技电子有限公司 Method for automatically and smoothly tracking target by cradle head
CN105716582A (en) * 2016-02-15 2016-06-29 中林信达(北京)科技信息有限责任公司 Method and device for measuring field angle of vidicon and vidicon field angle measuring instrument
US20170150031A1 (en) * 2014-09-05 2017-05-25 Fujifilm Corporation Pan and tilt operation device, camera system, pan and tilt operation program, and pan and tilt operation method
CN110083180A (en) * 2019-05-22 2019-08-02 深圳市道通智能航空技术有限公司 Cloud platform control method, device, controlling terminal and aerocraft system
CN110401799A (en) * 2019-08-02 2019-11-01 睿魔智能科技(深圳)有限公司 A kind of auto-tracking shooting method and system
CN110771143A (en) * 2018-09-13 2020-02-07 深圳市大疆创新科技有限公司 Control method of handheld cloud deck, handheld cloud deck and handheld equipment
CN111385459A (en) * 2018-12-28 2020-07-07 南京婆娑航空科技有限公司 Automatic control, focusing and photometry method for unmanned aerial vehicle cradle head
CN111656403A (en) * 2019-06-27 2020-09-11 深圳市大疆创新科技有限公司 Method and device for tracking target and computer storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108427407B (en) * 2017-02-13 2021-03-05 昊翔电能运动科技(昆山)有限公司 Holder control method, holder control system and holder equipment
CN109313455B (en) * 2017-11-16 2021-09-28 深圳市大疆创新科技有限公司 Intelligent glasses, method for controlling holder of intelligent glasses, holder, control method and unmanned aerial vehicle
CN110622089A (en) * 2018-01-22 2019-12-27 深圳市大疆创新科技有限公司 Following control method, control terminal and unmanned aerial vehicle

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102143324A (en) * 2011-04-07 2011-08-03 天津市亚安科技电子有限公司 Method for automatically and smoothly tracking target by cradle head
US20170150031A1 (en) * 2014-09-05 2017-05-25 Fujifilm Corporation Pan and tilt operation device, camera system, pan and tilt operation program, and pan and tilt operation method
CN105716582A (en) * 2016-02-15 2016-06-29 中林信达(北京)科技信息有限责任公司 Method and device for measuring field angle of vidicon and vidicon field angle measuring instrument
CN110771143A (en) * 2018-09-13 2020-02-07 深圳市大疆创新科技有限公司 Control method of handheld cloud deck, handheld cloud deck and handheld equipment
CN111385459A (en) * 2018-12-28 2020-07-07 南京婆娑航空科技有限公司 Automatic control, focusing and photometry method for unmanned aerial vehicle cradle head
CN110083180A (en) * 2019-05-22 2019-08-02 深圳市道通智能航空技术有限公司 Cloud platform control method, device, controlling terminal and aerocraft system
CN111656403A (en) * 2019-06-27 2020-09-11 深圳市大疆创新科技有限公司 Method and device for tracking target and computer storage medium
CN110401799A (en) * 2019-08-02 2019-11-01 睿魔智能科技(深圳)有限公司 A kind of auto-tracking shooting method and system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115460342A (en) * 2022-07-29 2022-12-09 浙江大华技术股份有限公司 Service setting method and device of camera equipment and multi-path camera linkage system
CN115460342B (en) * 2022-07-29 2024-02-27 浙江大华技术股份有限公司 Service setting method and device of camera equipment and multi-path camera linkage system

Also Published As

Publication number Publication date
CN113260942A (en) 2021-08-13

Similar Documents

Publication Publication Date Title
JP6748582B2 (en) Imaging device, control method thereof, program, and recording medium
US9560261B2 (en) Display control for a camera
KR101830975B1 (en) Information processing device, information processing method, and computer readable recording medium
WO2020107266A1 (en) Handheld gimbal and photographing control method thereof
US11210796B2 (en) Imaging method and imaging control apparatus
US20110019058A1 (en) Condition changing device
WO2022061535A1 (en) Handheld gimbal control method, handheld gimbal, system, and readable storage medium
US9779290B2 (en) Detecting apparatus, detecting method and computer readable recording medium recording program for detecting state in predetermined area within images
CN112738402B (en) Shooting method, shooting device, electronic equipment and medium
WO2021026789A1 (en) Photographing method based on handheld gimbal, and handheld gimbal and storage medium
US20170111574A1 (en) Imaging apparatus and imaging method
WO2022061537A1 (en) Control method, handheld gimbal, system, and computer-readable storage medium
WO2021026764A1 (en) Photographing terminal control method and system, and handheld gimbal and readable storage medium
US20220116543A1 (en) Following shoot method, gimbal control method, photographing apparatus, handheld gimbal and photographing system
WO2022061541A1 (en) Control method, handheld gimbal, system, and computer-readable storage medium
JP7423248B2 (en) Electronic devices, control methods for electronic devices, programs and storage media
WO2022041013A1 (en) Control method, handheld gimbal, system, and computer readable storage medium
WO2022061539A1 (en) Parameter adaptive method, handheld gimbal, system, and computer-readable storage medium
WO2022061540A1 (en) Control method, focus control method, apparatus, handheld platform and storage medium
US20220091487A1 (en) Shooting control method and shooting control device
JP5907184B2 (en) Information processing apparatus, information processing method, and program
JP6393296B2 (en) IMAGING DEVICE AND ITS CONTROL METHOD, IMAGING CONTROL DEVICE, PROGRAM, AND STORAGE MEDIUM
JP2021029034A (en) Exposure setting device, control method of the same, program, and storage medium
WO2023065125A1 (en) Photographing method, photographic device, terminal device and storage medium
WO2022061536A1 (en) Handheld gimbal control method, handheld gimbal, and computer readable storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20954389

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20954389

Country of ref document: EP

Kind code of ref document: A1