CN113016174B - Picture switching method, device, terminal equipment, system and storage medium - Google Patents

Picture switching method, device, terminal equipment, system and storage medium Download PDF

Info

Publication number
CN113016174B
CN113016174B CN202080005981.2A CN202080005981A CN113016174B CN 113016174 B CN113016174 B CN 113016174B CN 202080005981 A CN202080005981 A CN 202080005981A CN 113016174 B CN113016174 B CN 113016174B
Authority
CN
China
Prior art keywords
picture
target object
zoom lens
zoom
adjusting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202080005981.2A
Other languages
Chinese (zh)
Other versions
CN113016174A (en
Inventor
方馨月
温亚停
陈晨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SZ DJI Technology Co Ltd
Original Assignee
SZ DJI Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SZ DJI Technology Co Ltd filed Critical SZ DJI Technology Co Ltd
Publication of CN113016174A publication Critical patent/CN113016174A/en
Application granted granted Critical
Publication of CN113016174B publication Critical patent/CN113016174B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
    • H04N23/662—Transmitting camera control signals through networks, e.g. control via the Internet by using master/slave camera arrangements for affecting the control of camera image capture, e.g. placing the camera in a desirable condition to capture a desired image
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/268—Signal distribution or switching

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)

Abstract

The application discloses a picture switching method, a device, terminal equipment, a system and a storage medium, wherein the method comprises the following steps: displaying a first screen (S101); determining a target object in the first picture, and adjusting the position of the target object in the second picture to enable the target object to be positioned in the second picture (S102); when a picture switching instruction triggered by a user is detected, the displayed picture is switched from a first picture to a second picture (S103). The application improves user experience.

Description

Picture switching method, device, terminal equipment, system and storage medium
Technical Field
The present application relates to the field of interactive technologies, and in particular, to a method, an apparatus, a terminal device, a system, and a storage medium for switching a picture.
Background
Along with the rapid development of camera technique, terminal equipment such as mobile terminal, camera and unmanned aerial vehicle that takes photo by plane installs one or more camera lenses, can search for and look over target object through one or more camera lenses of installation. At present, a target object can be searched and checked through a single zoom lens, specifically, the zoom multiple of the zoom lens is adjusted to be the lowest, so that the visual angle of the zoom lens is the largest, the target object is convenient to search, and after a suspected target object is searched, the zoom multiple of the zoom lens is adjusted to be the high multiple, so that a user can conveniently and carefully check the target object. And repeating the steps so as to finally find the target object. However, in the process of repeatedly zooming, the position of the lens needs to be mechanically adjusted, which not only increases energy consumption, but also causes loss to mechanical equipment. In addition, the user needs to repeat the zoom operation and the search, and the user experience is not good.
Disclosure of Invention
Based on this, the application provides a picture switching method, device, terminal device, system and storage medium, aiming at accurately and quickly determining a target object, reducing power consumption and loss of mechanical equipment and improving user experience.
In a first aspect, the present application provides a picture switching method, where the method is used to control a display picture of a terminal device to switch between a first picture and a second picture, where the first picture is a current picture of a wide-angle lens, and the second picture is a current picture of a zoom lens, and the method includes:
displaying the first picture in a display interface of the terminal equipment;
determining a target object in the first picture, and adjusting the position of the target object in the second picture so that the target object is positioned in the second picture;
when a picture switching instruction triggered by a user is detected, switching the picture displayed in the display interface from the first picture to the second picture, wherein the target object is located in the second picture.
In a second aspect, the present application further provides an image switching device, where the image switching device is configured to control a display image of a terminal device to switch between a first image and a second image, where the first image is a current image of a wide-angle lens, and the second image is a current image of a zoom lens, and the image switching device includes a memory and a processor;
the memory is used for storing a computer program;
the processor is configured to execute the computer program and, when executing the computer program, implement the following steps:
displaying the first picture in a display interface of the terminal equipment;
determining a target object in the first picture, and adjusting the position of the target object in the second picture so that the target object is positioned in the second picture;
when a picture switching instruction triggered by a user is detected, switching the picture displayed in the display interface from the first picture to the second picture, wherein the target object is located in the second picture.
In a third aspect, the present application further provides a terminal device, where the terminal device includes a display device and a picture switching device, the picture switching device is configured to control a display picture of the display device to switch between a first picture and a second picture, the first picture is a current picture of a wide-angle lens, and the second picture is a current picture of a zoom lens, where:
the display device is used for displaying a display interface containing the first picture;
the picture switching device is used for determining a target object in the first picture and adjusting the position of the target object in the second picture so that the target object is positioned in the second picture;
the picture switching device is further configured to control the display device to switch a picture displayed in the display interface from the first picture to the second picture when a picture switching instruction triggered by a user is detected, where the target object is located in the second picture.
In a fourth aspect, the present application further provides a picture switching system, where the picture switching system includes a terminal device and a shooting device, the terminal device is in communication connection with the shooting device, where:
the terminal device is used for acquiring a picture transmission picture of the shooting device, wherein the picture transmission picture comprises a first picture and a second picture, the first picture is a current picture of the wide-angle lens, and the second picture is a current picture of the zoom lens;
the terminal device is further used for displaying the first picture in a display interface;
the terminal device is further configured to determine a target object in the first picture, and adjust a position of the target object in the second picture, so that the target object is located in the second picture;
the terminal device is further configured to switch, when a picture switching instruction triggered by a user is detected, a picture displayed in the display interface from the first picture to the second picture, where the target object is located in the second picture.
In a fifth aspect, the present application further provides a computer-readable storage medium storing a computer program, which when executed by a processor causes the processor to implement any one of the screen switching methods provided in the present specification.
The embodiment of the application provides a picture switching method, a device, terminal equipment, a system and a storage medium, wherein a display interface containing a current picture of a wide-angle lens is displayed, then a target object is determined in the current picture of the wide-angle lens, and the position of the target object in the current picture of a zoom lens is adjusted, so that the target object can be located in the current picture of the zoom lens, and when a picture switching instruction triggered by a user is detected, the picture displayed in the display interface is switched from the current picture of the wide-angle lens to the current picture of the zoom lens, so that the target object can be determined accurately and quickly, the focal length of the zoom lens does not need to be adjusted repeatedly, the power consumption and the loss of mechanical equipment are reduced, and the user experience is greatly improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a schematic diagram of a scene for implementing the frame switching method provided in the present specification;
fig. 2 is a flowchart illustrating steps of a method for switching a screen according to an embodiment of the present application;
FIG. 3 is a schematic diagram of a display interface of a terminal device in an embodiment of the present application;
FIG. 4 is another schematic diagram of a display interface of a terminal device in the embodiment of the present application;
FIG. 5 is another schematic diagram of a display interface of a terminal device in the embodiment of the present application;
FIG. 6 is another schematic diagram of a display interface of a terminal device in the embodiment of the present application;
fig. 7 is a schematic block diagram of a structure of a screen switching apparatus according to an embodiment of the present application;
fig. 8 is a schematic block diagram of a structure of a terminal device provided in an embodiment of the present application;
fig. 9 is a schematic block diagram of a structure of a screen switching system according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The flow diagrams depicted in the figures are merely illustrative and do not necessarily include all of the elements and operations/steps, nor do they necessarily have to be performed in the order depicted. For example, some operations/steps may be decomposed, combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.
Based on the above problems, the present application provides a picture switching method, where the picture switching method is used to control a display picture of a terminal device to switch between a first picture and a second picture, where the first picture is a current picture of a wide-angle lens, and the second picture is a current picture of a zoom lens, and in some embodiments, the first picture is displayed in a display interface of the terminal device, where the terminal device may display the display interface including the first picture through a display device, or may display the display interface including the first picture through an external display device, a user or the terminal device determines a target object in the first picture, and adjusts a position of the target object in the second picture, so that the target object may be located in the second picture, and when a picture switching instruction triggered by the user is detected, the picture displayed in the display interface is switched from the first picture to the second picture, so that the target object may be determined accurately and quickly, power consumption and loss of the terminal device may be reduced, and a problem that the target object is lost after the displayed picture is switched from the picture of the wide-angle lens to the picture of the zoom lens may be solved, and user experience may be greatly improved. The terminal equipment comprises a handheld cloud deck, a smart phone, a tablet personal computer, a notebook computer, a PC (personal computer), a ground control platform, a remote controller and the like.
In one embodiment, the wide-angle lens and the zoom lens are both mounted on a terminal device, for example, the terminal device is a video camera, a mobile phone, etc., the two lenses are integrally disposed with the terminal device, the posture of the zoom lens can be changed along with the posture change of the terminal device, and simultaneously the position of the target object in the second screen can be changed along with the posture change of the zoom lens, therefore, after the terminal device displays the first screen and the target object is determined in the first screen, the user manually adjusts the posture of the terminal device, and can adjust the position of the target object in the second screen, so that the target object can be located in the second screen.
In another embodiment, the terminal device is a pan-tilt camera, the pan-tilt camera includes a camera and a pan-tilt, the camera is integrated with the pan-tilt, the camera includes a wide-angle lens and a zoom lens, the posture of the zoom lens can be changed along with the change of the posture of the terminal device or the joint angle of each rotating shaft of the pan-tilt, and the position of the target object in the second picture can be changed along with the change of the posture of the zoom lens or the joint angle of each rotating shaft of the pan-tilt, so that the first picture is displayed in the display interface of the terminal device, and after the target object is determined in the first picture, the posture of the terminal device manually by a user, the joint angle of each rotating shaft of the pan-tilt or the joint angle of each rotating shaft of the pan-tilt automatically by the terminal device can be adjusted, and the position of the target object in the second picture can be adjusted, so that the target object can be located in the second picture.
In another embodiment, the wide-angle lens and the zoom lens are located in the same shooting device, the shooting device is in communication connection with the terminal device, the terminal device can acquire a picture-transfer picture of the shooting device, the picture-transfer picture includes a first picture and a second picture, the first picture is a current picture of the wide-angle lens, the second picture is a current picture of the zoom lens, the posture of the zoom lens can be changed along with the change of the posture of the shooting device, and the position of the target object in the second picture is changed along with the change of the posture of the zoom lens, so that the first picture is displayed in a display interface of the terminal device, and after the target object is determined in the first picture, the position of the target object in the second picture can be adjusted by adjusting the posture of the shooting device, so that the target object can be located in the second picture. The shooting device can be mounted on a terminal device, and can also be mounted on other movable electronic devices, such as an unmanned aerial vehicle and a movable robot, so that the terminal device can display a picture transmission picture of a wide-angle lens and a zoom lens which are remotely mounted on the electronic device.
In another embodiment, the wide-angle lens is mounted on a first shooting device, the zoom lens is mounted on a second shooting device, the terminal devices are respectively in communication connection with the first shooting device and the second shooting device, so that the terminal devices can acquire a picture-passing picture of the first shooting device, picture-passing pictures of the first shooting device and the second shooting device, and picture-passing pictures of the second shooting device and the terminal devices, the first picture is a current picture of the wide-angle lens, the second picture is a current picture of the zoom lens, the posture of the zoom lens can be changed along with the change of the posture of the second shooting device, and meanwhile, the position of the target object in the second picture is changed along with the change of the posture of the zoom lens, so that the first picture is displayed in a display interface of the terminal devices, and after the target object is determined in the first picture, the position of the target object in the second picture can be adjusted by adjusting the posture of the second shooting device, so that the target object can be located in the second picture. The first shooting device and the second shooting device may be both mounted on the terminal device, and may also be both mounted on other movable electronic devices, such as an unmanned aerial vehicle and a movable robot, so that the terminal device may display a picture of a wide-angle lens and a zoom lens mounted on the electronic device in a remote manner.
Referring to fig. 1, fig. 1 is a schematic view of a scene for implementing a picture switching method provided in this specification, as shown in fig. 1, a terminal device 100 is in communication connection with a drone 200, the terminal device 100 includes a display device 110, the drone 200 includes a shooting device 210, the shooting device 210 includes a wide-angle lens and a zoom lens (not shown in the figure), when the shooting device 210 shoots through the wide-angle lens and the zoom lens, the drone 200 transmits a picture transfer picture of the shooting device 210 to the terminal device 100 through a wireless link, so that the terminal device 100 can display the picture transfer picture of the shooting device 210, the picture transfer picture includes a first picture and a second picture, the first picture is a current picture of the wide-angle lens, the second picture is a current picture of the zoom lens, an attitude of the zoom lens can be changed with a change in an attitude of the shooting device, and a position of a target object in the second picture is changed with a change in an attitude of the zoom lens at the same time, therefore, a display interface including the first picture is displayed on the display device 110 of the terminal device 100, and after a target object is determined in the first picture, the attitude of the target object can be further adjusted to adjust an attitude of the second picture, so that the target object is located in the second picture.
The drone 200 may have one or more propulsion units to allow the drone 200 to fly in the air. The one or more propulsion units may cause the drone 200 to move at one or more, two or more, three or more, four or more, five or more, six or more free angles. In some cases, the drone 200 may rotate about one, two, three, or more axes of rotation. The axes of rotation may be perpendicular to each other. The axes of rotation may be maintained perpendicular to each other throughout the flight of the drone 200. The axis of rotation may include a pitch axis, a roll axis, and/or a yaw axis. The drone 200 may be movable in one or more dimensions. For example, the drone 200 can move upward due to the lift generated by one or more rotors. In some cases, the drone 200 may be movable along a Z-axis (which may be upward with respect to the drone 200), an X-axis, and/or a Y-axis (which may be lateral). The drone 200 may move along one, two, or three axes that are perpendicular to each other.
Drone 200 may be a rotorcraft. In some cases, drone 200 may be a multi-rotor aircraft that may include multiple rotors. The plurality of rotors may rotate to generate lift for the drone 200. The rotor may be a propulsion unit that allows the drone 200 to move freely in the air. The rotors may rotate at the same rate and/or may produce the same amount of lift or thrust. The rotors may rotate at will at different rates, generating different amounts of lift or thrust and/or allowing the drone 200 to rotate. In some cases, one, two, three, four, five, six, seven, eight, nine, ten, or more rotors may be provided on the drone 200. The rotors may be arranged with their axes of rotation parallel to each other. In some cases, the axes of rotation of the rotors may be at any angle relative to each other, which may affect the motion of the drone 200.
The drone 200 may have multiple rotors. The rotor may be connected to the body of the drone 200, which may include a control unit, an Inertial Measurement Unit (IMU), a processor, a battery, a power source, and/or other sensors. The rotor may be connected to the body by one or more arms or extensions that branch off from a central portion of the body. For example, one or more arms may extend radially from the central body of the drone 200 and may have rotors at or near the ends of the arms.
Referring to fig. 2, fig. 2 is a flowchart illustrating steps of a frame switching method according to an embodiment of the present disclosure. Specifically, as shown in fig. 2, the screen switching method includes steps S101 to S103.
And S101, displaying the first picture in a display interface of the terminal equipment.
The terminal equipment comprises a display device used for displaying a shooting picture of the wide-angle lens or the zoom lens.
The terminal equipment can acquire a first picture and a second picture, wherein the first picture is a current picture of the wide-angle lens, and the second picture is a current picture of the zoom lens; and displaying a display interface containing the first picture on the display device or the display equipment by default. The display interface can also display the current picture of the zoom lens, namely the first picture is a displayed main picture, and the second picture displays the current picture of the zoom lens in the display interface in a small window mode and a picture-in-picture mode. The current picture of the wide-angle lens and the current picture of the zoom lens are displayed in the display interface, so that a user can simultaneously read the shooting conditions of the wide-angle lens and the zoom lens, the user operation is facilitated, and the user experience is greatly improved.
S102, determining a target object in the first picture, and adjusting the position of the target object in the second picture to enable the target object to be located in the second picture.
The target object can be determined from the displayed candidate objects by a user, and after the target object is determined, the position of the target object in the second picture is adjusted, so that the target object can be located in the second picture, and the target object is enabled not to be lost when the first picture in the display interface is switched to the second picture in the following process. The target object may be located at any position of the second screen, which is not specifically limited in this application. Optionally, the position of the target object within the second screen is adjusted so that the target object can be located in a central area of the second screen.
In one embodiment, the method comprises the steps of acquiring a trigger operation of a user on a candidate object in a first picture; and determining a target object from at least one candidate object according to the triggering operation. After the target object is determined, a locking icon is displayed in the center area of the target object, wherein the locking icon is used for showing that the displayed candidate object is the target object, and the locking icon is convenient for a user to read.
In an embodiment, the manner of adjusting the position of the target object within the second screen is specifically: and adjusting the posture of the zoom lens so that the target object can be positioned in the central area of the second picture. The position of the target object in the second picture changes along with the change of the posture of the zoom lens, and the user can manually adjust the position of the target object in the second picture or automatically adjust the position of the target object in the second picture according to the current position of the target object in the second picture and the position of the central area of the second picture. The target object is positioned in the central area of the second picture by adjusting the position of the target object in the second picture, so that the target object is not lost when the picture displayed in the display interface is switched from the first picture to the second picture, the target object is convenient for a user to read, and the user experience is greatly improved.
In one embodiment, the wide-angle lens and the zoom lens are both mounted on a terminal device, for example, the terminal device is a video camera, a mobile phone, and the like, the two lenses are integrally disposed with the terminal device, for example, the terminal device is a smart phone mounted with the wide-angle lens and the zoom lens, when a user adjusts the posture and/or the position of the terminal device, the posture of the zoom lens changes along with the change of the posture and/or the position of the terminal device, so that the position of the target object in the second screen also changes accordingly. When the posture and/or the position of the terminal device are/is adjusted, a user can judge whether a target object is positioned in the second picture by browsing whether the target object is displayed in the zooming display frame, so that the posture and/or the position of the terminal device can be conveniently adjusted by the user.
In one embodiment, the wide-angle lens and the zoom lens are both mounted on the terminal device, and the wide-angle lens and the zoom lens are integrally arranged with the terminal device, the terminal device is mounted on the pan-tilt, the terminal device is in communication connection with the pan-tilt, and when the attitude of the pan-tilt changes, the attitude of the zoom lens changes, so that the position of the target object in the second picture can be adjusted by adjusting the joint angles of the rotating shafts of the pan-tilt. By carrying the terminal equipment on the pan-tilt, the joint angles of all rotating shafts of the pan-tilt can be automatically adjusted to adjust the position of the target object in the second picture, and the user does not need to manually adjust the posture and/or the position of the terminal equipment, so that the user experience is greatly improved. In one embodiment, the cradle head is a handheld cradle head, or the cradle head is mounted on a mobile device, such as a drone.
When the wide-angle lens and the zoom lens are both positioned in the same shooting device and the shooting device is carried on the holder, and when the postures of the wide-angle lens and the zoom lens are the same and the distance between the central points of the lenses is smaller than a certain specific threshold value, the central points of the visual angles of the wide-angle lens and the zoom lens can be considered to be the same, so that the posture of the shooting device can be adjusted through the position of the target object in the first picture and the central point of the first picture, and the position of the target object in the second picture can be adjusted. Specifically, a first position coordinate of a target object in a first picture and a position coordinate of a central point of the first picture are obtained; determining a target attitude parameter of the holder according to the first position coordinate and the second position coordinate; and adjusting joint angles of all rotating shafts of the holder according to the target attitude parameters of the holder, so that the target object can be positioned in the central area of the second picture.
In an embodiment, the wide-angle lens and the zoom lens are located in the same shooting device, and the postures of the wide-angle lens and the zoom lens are the same, for example, the wide-angle lens and the zoom lens are located in the same camera, the camera is in communication connection with a terminal device, for example, the shooting device is mounted on an unmanned aerial vehicle or the shooting device and the unmanned aerial vehicle are integrally arranged, the unmanned aerial vehicle is in communication connection with the shooting device, and the unmanned aerial vehicle is in communication connection with the terminal device, so that the unmanned aerial vehicle can transmit a picture of the shooting device to the terminal device and is displayed by the terminal device, therefore, the posture of the shooting device can be adjusted to adjust the position of the target object in the second picture, wherein the posture of the zoom lens changes along with the change of the posture of the shooting device. It can be understood that when the shooting equipment is carried on the unmanned aerial vehicle or the shooting equipment and the unmanned aerial vehicle are integrally arranged, the posture of the shooting equipment can be adjusted by adjusting the posture of the unmanned aerial vehicle and/or the joint angle of the holder carrying the shooting equipment.
In an embodiment, the manner of adjusting the posture of the shooting device is specifically: acquiring a first position coordinate of a target object in a first picture and a second position coordinate of a central point of the first picture; determining a target attitude parameter of the shooting equipment according to the first position coordinate and the second position coordinate; and adjusting the posture of the shooting equipment according to the target posture parameters. When the shooting equipment is carried on the unmanned aerial vehicle or the shooting equipment and the unmanned aerial vehicle are integrally arranged, the target attitude parameters comprise at least one of attitude parameters of the unmanned aerial vehicle and joint angles of rotating shafts of a holder carrying the shooting equipment.
In one embodiment, the wide-angle lens is installed on a first shooting device, the zoom lens is installed on a second shooting device, the first shooting device is installed on a first cloud deck of an unmanned aerial vehicle, the first shooting device is connected with the unmanned aerial vehicle, the second shooting device is installed on a second cloud deck of the unmanned aerial vehicle, the second shooting device is connected with the unmanned aerial vehicle, and the unmanned aerial vehicle is in communication connection with a terminal device, so that the terminal device can transmit a picture of the first shooting device and a picture of the second shooting device to the terminal device to be displayed by the terminal device, and therefore, the position of a target object in a second picture can be adjusted by adjusting the posture of the second shooting device, wherein the posture of the zoom lens changes along with the change of the posture of the second shooting device. Since the wide-angle lens is mounted on the first photographing apparatus and the zoom lens is mounted on the second photographing apparatus, that is, the wide-angle lens and the zoom lens are located on different photographing apparatuses, the position of the target object within the second picture can be adjusted according to the posture and the angle of view of the wide-angle lens and the posture and the angle of view of the zoom lens, so that the second picture can be located on the second picture.
It can be understood that the second shooting device is carried on the second pan tilt of the unmanned aerial vehicle, and the attitude of the second shooting device can be adjusted by adjusting the joint angle of each rotating shaft of the second pan tilt, and certainly, the attitude of the second shooting device can also be adjusted by adjusting the attitude of the unmanned aerial vehicle, which is not specifically limited in the present specification.
In an embodiment, a zoom display frame is displayed in the first image, the zoom display frame is used for indicating the size of the angle of view of the zoom lens in the first image, and the manner of adjusting the position of the target object in the second image is specifically: acquiring a first position of a zoom display frame in a first picture, and acquiring a second position of a target object in the first picture; and adjusting the posture of the zoom lens according to the first position and the second position so as to enable the target object to be positioned in the zooming display frame. The position of the zooming display frame in the first picture changes along with the change of the posture of the zooming lens, the shape and the constituent elements of the zooming display frame can be set based on actual conditions, and the shape and the constituent elements are not specifically limited in the present application. Illustratively, the shape of the zoom display frame is consistent with the angle of view of the zoom lens. When the posture of the zoom lens is adjusted, and the target object is located in the zoom display frame, the target object can be determined to be located in the picture of the zoom lens, namely the target object is located in the second picture, when the first picture in the display interface is switched to the second picture, the target object is not lost, and user experience is greatly improved.
Illustratively, as shown in fig. 3, the terminal device displays a first screen, a target object 10 and a zoom display frame 20 are displayed in the first screen, and the target object 10 is not located in the zoom display frame 20, and after the posture of the zoom lens is adjusted, the position of the zoom display frame 20 in the first screen changes accordingly, as shown in fig. 4, the zoom display frame 20 is displayed in the left area of the first screen, and the target object 10 is located in the zoom display frame 20.
In an embodiment, the manner of adjusting the position of the target object within the second screen is specifically: acquiring a posture adjustment instruction triggered by a user, wherein the posture adjustment instruction is used for adjusting the posture of the zoom lens; and adjusting the posture of the zoom lens according to the posture adjusting instruction, wherein the position of the zooming display frame in the first picture is changed along with the change of the posture of the zoom lens. When the target object in the first picture is located in the zooming display frame, the user can determine that the target object is located in the second picture, and therefore the user stops adjusting the posture of the zoom lens. The gesture adjustment instruction triggering mode may be set according to an actual situation, which is not specifically limited in this application, for example, a gesture adjustment icon of a zoom lens is displayed in the first image, and when a user's triggering operation on the gesture adjustment icon is acquired, the gesture adjustment instruction of the zoom lens is triggered. By displaying the zooming display frame, the user can judge whether the target object is positioned in the second picture by browsing whether the target object is displayed in the zooming display frame, so that the user can conveniently adjust the posture of the zooming lens.
In one embodiment, the size of the zoom display frame in the first frame is determined according to the angle of view of the zoom lens, the larger the size of the zoom display frame in the first frame, and the smaller the angle of view of the zoom lens, the smaller the size of the zoom display frame in the first frame. The angle of view of the zoom lens is related to the zoom multiple of the zoom lens, the higher the zoom multiple of the zoom lens is, the smaller the angle of view of the zoom lens is, the lower the zoom multiple of the zoom lens is, the larger the angle of view of the zoom lens is, and therefore, a user can adjust the size of the zoom display frame in the first picture by adjusting the zoom multiple of the zoom lens.
In one embodiment, the position of the zoom display frame in the first picture is determined according to the postures of the wide-angle lens and the zoom lens and the lens parameters. The lens parameters include the size of the angle of view. Specifically, when the postures of the wide-angle lens and the zoom lens installed in the same shooting device are the same, and the distance between the center points of the wide-angle lens and the zoom lens is smaller than a preset threshold value, the zooming display frame is located in the central area of the first picture. In this case, the angle of view of the wide-angle lens and the center point of the angle of view of the zoom lens are infinitely close to each other, and the two may be considered to overlap each other. By displaying the zooming display frame in the central area of the display interface, a user can conveniently check the target object in the zooming display frame, and the user can conveniently adjust the display size of the target object.
In an embodiment, when the postures of the wide-angle lens and the zoom lens installed in the same shooting device are different, the postures of the wide-angle lens and/or the zoom lens are adjusted, so that the postures of the wide-angle lens and the zoom lens are the same, and it is ensured that the zoom display frame can be located in the central area of the first picture when the distance between the wide-angle lens and the zoom lens is smaller than a preset threshold, wherein when the postures of the two lenses are the same and the distance between the central points of the two lenses is smaller than the preset threshold, the central points of the visual angles of the two lenses are determined to be overlapped.
S103, when a picture switching instruction triggered by a user is detected, switching the picture displayed in the display interface from the first picture to the second picture, wherein the target object is located in the second picture.
The user triggering image switching instruction specifically comprises that a user clicks a specific control on a display interface or presses a physical key on the terminal device.
When a picture switching instruction triggered by a user is detected, the picture displayed in the display interface is switched from a first picture to a second picture based on the picture switching instruction. And the target object is positioned in the second picture, and the sizes of the target object in the first picture and the second picture are different.
In an embodiment, after the target object is located on the second screen, the display size of the target object in the second screen is not convenient for a user to observe carefully, and therefore, after the target object is located on the second screen or after the displayed screen in the display interface is switched from the first screen to the second screen, the size of the target object in the second screen is adjusted, so that the display size of the target object reaches an appropriate size, which is convenient for the user to observe carefully, and greatly improves user experience.
In one embodiment, the zoom magnification of the zoom lens is adjusted, wherein the size of the target object in the second picture is changed along with the change of the zoom magnification of the zoom lens. It is understood that the larger the zoom factor, the larger the display size of the target object within the second screen, and the smaller the zoom factor, the smaller the display size of the target object within the second screen. The display size of the target object in the second picture is changed by adjusting the zoom multiple of the zoom lens, so that the display size of the target object reaches a proper size, a user can conveniently observe the target object carefully, and the user experience is greatly improved.
In an embodiment, the adjusting the zoom magnification of the zoom lens specifically includes: acquiring the distance between a target object and the zoom lens; and adjusting the zooming times of the zoom lens according to the distance between the target object and the zoom lens. Or acquiring the proportion of the target object in the second picture; and adjusting the zoom multiple of the zoom lens according to the proportion of the target object in the second picture, so that the proportion of the target object in the second picture can reach a preset proportion. The zoom multiple of the zoom lens can be accurately adjusted through the distance between the target object and the zoom lens or the proportion of the target object in the second picture, so that the display size of the target object reaches the appropriate size, a user can conveniently observe the target object carefully, and the user experience is greatly improved.
The distance between the target object and the zoom lens can be determined according to the distance measuring sensor, if the distance between the target object and the zoom lens is long, the zoom multiple of the zoom lens needs to be increased, if the distance between the target object and the zoom lens is short, the zoom multiple of the zoom lens needs to be decreased, and the corresponding relation and the preset proportion between the zoom multiple and the distance can be set according to actual conditions.
In one embodiment, a zoom adjustment icon and a zoom display frame are displayed in the first frame, the zoom adjustment icon is used for a user to adjust a zoom multiple of the zoom lens, the target object is located in the zoom display frame, and the method for adjusting the zoom multiple of the zoom lens specifically includes: and adjusting the zooming multiple of the zoom lens according to the triggering operation of the user on the zooming adjusting icon, wherein the size of the target object in the zooming display frame is changed along with the change of the zooming multiple of the zoom lens. The specific form and the display position in the first screen of the zoom adjustment icon may be set based on actual conditions, which is not specifically limited in this application specification, for example, the zoom adjustment icon is a zoom slide bar. Through the displayed zooming adjusting icon and the zooming display frame, when a user adjusts the zooming multiple of the zooming lens through the zooming adjusting icon, the user can read the size of the target object through the zooming display frame, the zooming multiple of the zooming lens can be conveniently adjusted by the user, and the user experience is greatly improved.
Illustratively, as shown in fig. 5, the first frame includes a target object 10, a zoom display frame 20 and a zoom adjustment icon 30, the target object 10 is located in the zoom display frame 20, since the center point of the angle of view of the zoom lens is the same as that of the wide-angle lens, the zoom display frame 20 is displayed in the central area of the first frame, the zoom adjustment icon 30 is displayed in the right area of the first frame, and the center line of the zoom adjustment icon 30 represents the current zoom multiple of the zoom lens, and the specific value of the current zoom multiple of the zoom lens is also displayed near the center line.
In an embodiment, a picture switching icon is further displayed on the display interface, and a specific form and a display position of the picture switching icon in the display interface may be set according to an actual situation, which is not specifically limited in this application. When the trigger operation of the user on the picture switching icon is acquired, a picture switching instruction is triggered, so that the terminal equipment can switch the picture displayed in the display interface from the first picture to the second picture based on the triggered picture switching instruction. It can be understood that after the picture displayed in the display interface is switched from the first picture to the second picture, when the trigger operation of the user on the picture switching icon is acquired, the picture switching instruction is triggered, so that the terminal device can switch the shooting picture displayed in the display interface or the main shooting picture from the second picture to the first picture based on the triggered picture switching instruction, thereby implementing the mutual switching between the first picture and the second picture.
In one embodiment, the display interface further displays a first screen switching icon and a second screen switching icon, and the first screen switching icon and the second screen switching icon are displayed in different display modes, so that a user can know whether a screen displayed in the display interface is a first screen or a second screen.
In one embodiment, after the screen displayed in the display interface is switched from the first screen to the second screen, the display interface displays the zoom adjustment icon and the target object, but does not display the zoom display frame. As shown in fig. 6, the target object 10 and the zoom adjustment icon 30 are displayed in the display interface, but the zoom display frame is not displayed, the target object 10 is located in the central area of the second screen, and the zoom adjustment icon 30 is located in the right area of the second screen.
According to the image switching method provided by the application specification, the target object is determined in the current image of the wide-angle lens by displaying the display interface of the current image containing the wide-angle lens, and the position of the target object in the current image of the zoom lens is adjusted, so that the target object can be located in the current image of the zoom lens, and when an image switching instruction triggered by a user is detected, the image displayed in the display interface is switched from the current image of the wide-angle lens to the current image of the zoom lens, so that the target object can be accurately and quickly determined, the focal length of the zoom lens does not need to be adjusted repeatedly, the power consumption and the loss of mechanical accessories are reduced, and the user experience is greatly improved.
Referring to fig. 7, fig. 7 is a schematic block diagram of a frame switching device according to an embodiment of the present disclosure. As shown in fig. 7, the screen switching device 300 includes a processor 301 and a memory 302, wherein the processor 301 and the memory 302 are connected by a bus 303, and the bus 303 is, for example, an I2C (Inter-integrated Circuit) bus.
The image switching device 300 is applied to a terminal device, and the image switching device 300 is configured to control a display image of the terminal device to switch between a first image and a second image, where the first image is a current image of a wide-angle lens, and the second image is a current image of a zoom lens.
Specifically, the Processor 301 may be a Micro-controller Unit (MCU), a Central Processing Unit (CPU), a Digital Signal Processor (DSP), or the like.
Specifically, the Memory 302 may be a Flash chip, a Read-Only Memory (ROM) magnetic disk, an optical disk, a usb disk, or a removable hard disk.
Wherein the processor 301 is configured to run a computer program stored in the memory 302, and when executing the computer program, implement the following steps:
displaying the first picture in a display interface of the terminal equipment;
determining a target object in the first picture, and adjusting the position of the target object in the second picture so that the target object is positioned in the second picture;
when a picture switching instruction triggered by a user is detected, switching the picture displayed in the display interface from the first picture to the second picture, wherein the target object is located in the second picture.
Optionally, the target object has a different size within the first and second pictures.
Optionally, at least one candidate object is displayed in the first picture; the processor, when implementing determining a target object within the first screen, is configured to implement:
acquiring a trigger operation of a user on the candidate object in the first picture;
and determining a target object from the at least one candidate object according to the triggering operation.
Optionally, the trigger operation includes any one of a click operation, a double click operation, a long press operation, and a frame selection operation.
Optionally, the processor, when implementing adjusting the position of the target object within the second picture, is configured to implement:
and adjusting the posture of the zoom lens so that the target object is positioned in the central area of the second picture, wherein the position of the target object in the second picture is changed along with the change of the posture of the zoom lens.
Optionally, the wide-angle lens and the zoom lens are located in the same shooting device; when the processor realizes the adjustment of the posture of the zoom lens, the processor is used for realizing the following steps:
adjusting an attitude of the photographing apparatus, wherein an attitude of the zoom lens varies with a variation in the attitude of the photographing apparatus.
Optionally, when the processor is configured to adjust the posture of the shooting device, the processor is configured to:
acquiring a first position coordinate of the target object in the first picture and a second position coordinate of a central point of the first picture;
determining a target attitude parameter of the shooting equipment according to the first position coordinate and the second position coordinate;
and adjusting the posture of the shooting equipment according to the target posture parameter.
Optionally, the wide-angle lens is mounted on a first shooting device, and the zoom lens is mounted on a second shooting device; when the processor realizes the adjustment of the posture of the zoom lens, the processor is used for realizing the following steps:
adjusting an attitude of the second photographing apparatus, wherein an attitude of the zoom lens varies with a variation in the attitude of the second photographing apparatus.
Optionally, the terminal device comprises a wide-angle lens and a zoom lens, and the wide-angle lens and the zoom lens are mounted on a holder of the terminal device; when the processor realizes the adjustment of the posture of the zoom lens, the processor is used for realizing the following steps:
and adjusting the joint angle of the holder of the terminal equipment, wherein the posture of the zoom lens is changed along with the change of the joint angle of the holder of the terminal equipment.
Optionally, the processor is further configured to adjust the position of the target object within the second screen so that the target object is located behind the second screen, and further configured to:
and adjusting the size of the target object in the second picture.
Optionally, the processor is configured to, when adjusting the size of the target object in the second picture, implement:
and adjusting the zoom multiple of the zoom lens, wherein the size of the target object in the second picture is changed along with the change of the zoom multiple of the zoom lens.
Optionally, the processor is configured to, when adjusting the zoom magnification of the zoom lens, implement:
acquiring a distance between the target object and the zoom lens;
and adjusting the zooming multiple of the zoom lens according to the distance between the target object and the zoom lens.
Optionally, the processor is configured to, when adjusting the zoom magnification of the zoom lens, implement:
acquiring the proportion of the target object in the second picture;
and adjusting the zoom multiple of the zoom lens according to the proportion of the target object in the second picture.
Optionally, a zoom adjustment icon and a zoom display frame are displayed in the first image, the zoom adjustment icon is used for a user to adjust a zoom multiple of the zoom lens, and the target object is located in the zoom display frame; when the processor realizes the adjustment of the zoom multiple of the zoom lens, the processor is used for realizing that:
and adjusting the zooming multiple of the zoom lens according to the triggering operation of the user on the zooming adjusting icon, wherein the size of the target object in the zooming display frame is changed along with the change of the zooming multiple of the zoom lens.
Optionally, a zoom display frame is displayed in the first image, and the zoom display frame is used for displaying a current image of the zoom lens; the processor is used for realizing that when the position of the target object in the second picture is adjusted, the processor is used for realizing that:
acquiring a first position of the zoom display frame in the first picture, and acquiring a second position of the target object in the first picture;
and adjusting the posture of the zoom lens according to the first position and the second position so as to enable the target object to be positioned in the zooming display frame.
Optionally, the processor, when implementing adjusting the position of the target object within the second picture, is configured to implement:
acquiring a posture adjustment instruction triggered by a user, wherein the posture adjustment instruction is used for adjusting the posture of the zoom lens;
and adjusting the posture of the zoom lens according to the posture adjusting instruction, wherein the position of the zooming display frame in the first picture is changed along with the change of the posture of the zoom lens.
Optionally, the size of the zoom display frame in the first picture is determined according to the angle of view of the zoom lens.
Optionally, the position of the zoom display frame in the first picture is determined according to the postures of the wide-angle lens and the zoom lens and lens parameters.
Optionally, when the wide-angle lens installed on the same shooting device is identical to the posture of the zoom lens, and the distance between the wide-angle lens and the central point of the zoom lens is smaller than a preset threshold, the zoom display frame is located in the central area of the first picture.
Optionally, when the postures of the wide-angle lens and the zoom lens installed in the same shooting device are different, the posture of the wide-angle lens and/or the zoom lens is adjusted so that the postures of the wide-angle lens and the zoom lens are the same.
It should be noted that, as is clear to those skilled in the art, for convenience and simplicity of description, the specific working process of the image switching apparatus described above may refer to the corresponding process in the foregoing image switching method embodiment, and details are not repeated herein.
Referring to fig. 8, fig. 8 is a schematic block diagram of a structure of a terminal device according to an embodiment of the present application.
As shown in fig. 8, the terminal device 400 includes a display device 401 and a screen switching device 402, the screen switching device 402 is configured to control the display screen of the display device 401 to switch between a first screen and a second screen, the first screen is a current screen of the wide-angle lens, and the second screen is a current screen of the zoom lens, where:
the display device 401 is configured to display a display interface including the first picture;
the picture switching device 402 is configured to determine a target object in the first picture and adjust a position of the target object in the second picture, so that the target object is located in the second picture;
the screen switching device 402 is further configured to, when a screen switching instruction triggered by a user is detected, control the display device to switch a screen displayed in the display interface from the first screen to the second screen, where the target object is located on the second screen.
The terminal equipment comprises a handheld cloud deck, a smart phone, a tablet personal computer, a notebook computer, a PC (personal computer), a ground control platform, a remote controller and the like.
In one embodiment, the wide-angle lens and the zoom lens are both mounted on the terminal device 400, and both lenses are integrated with the terminal device 400, for example, the terminal device 400 is a smart phone, a tablet computer, a camera or a video camera, etc. The posture of the zoom lens can be changed as the posture of the terminal device 400 is changed, while the position of the target object within the second screen is changed as the posture of the zoom lens is changed, and therefore, after the display device 401 of the terminal device 400 displays the display interface including the first screen and the target object is determined within the first screen, the user manually adjusts the posture of the terminal device, and can adjust the position of the target object within the second screen so that the target object can be located on the second screen.
In another embodiment, the terminal device 400 is a pan-tilt camera including a camera and a pan-tilt, the camera is integrated with the pan-tilt, the camera includes a wide-angle lens and a zoom lens, a posture of the zoom lens can be changed with a change in a posture of the terminal device or a joint angle of each rotation shaft of the pan-tilt, and a position of the target object in the second screen can be changed with a change in a posture of the zoom lens or a joint angle of each rotation shaft of the pan-tilt, so that the first screen is displayed in the display interface of the terminal device 400, and after the target object is determined in the first screen, the posture of the terminal device 400 manually by a user, the joint angle of each rotation shaft of the pan-tilt is adjusted, or the joint angle of each rotation shaft of the pan-tilt is automatically adjusted by the terminal device 400, and the position of the target object in the second screen can be adjusted, so that the target object can be located in the second screen.
In another embodiment, the wide-angle lens and the zoom lens are located in the same shooting device, the shooting device is in communication connection with the terminal device 400, the terminal device 400 can acquire image-transfer pictures of the shooting device, the image-transfer pictures include a first picture and a second picture, the first picture is a current picture of the wide-angle lens, the second picture is a current picture of the zoom lens, the shooting device can be mounted on other movable electronic devices, such as an unmanned aerial vehicle and a movable robot, so that the terminal device 400 can display the image-transfer pictures of the wide-angle lens and the zoom lens mounted on the electronic device remotely.
In another embodiment, the wide-angle lens is mounted on a first shooting device, the zoom lens is mounted on a second shooting device, the terminal device 400 is in communication connection with the first shooting device and the second shooting device respectively, so that the terminal device 400 can acquire a picture of the first shooting device, the picture of the first shooting device is recorded as a picture of the first shooting device, the picture of the second shooting device is recorded as a picture of the second shooting device, the first picture is a current picture of the wide-angle lens, the second picture is a current picture of the zoom lens, the first shooting device and the second shooting device can both be mounted on other movable electronic devices, such as an unmanned aerial vehicle and a movable robot, so that the terminal device 400 can display remote picture of the wide-angle lens and the zoom lens mounted on the electronic device.
It should be clearly understood by those skilled in the art that, for convenience and simplicity of description, the specific working process of the terminal device described above may refer to the corresponding process in the foregoing image switching method embodiment, and details are not described herein again.
Referring to fig. 9, fig. 9 is a schematic block diagram illustrating a structure of a frame switching system according to an embodiment of the present disclosure. As shown in fig. 9, the screen switching system 500 includes a terminal device 501 and a photographing device 502, the terminal device 501 is connected to the photographing device 502 in communication, wherein:
the terminal device 501 is configured to obtain a picture transmission picture of the shooting device 502, where the picture transmission picture includes a first picture and a second picture, the first picture is a current picture of a wide-angle lens, and the second picture is a current picture of a zoom lens;
the terminal device 501 is further configured to display the first picture in a display interface;
the terminal device 501 is further configured to determine a target object in the first screen, and adjust a position of the target object in the second screen, so that the target object is located in the second screen;
the terminal device 501 is further configured to switch, when detecting a screen switching instruction triggered by a user, a screen displayed in the display interface from the first screen to the second screen, where the target object is located in the second screen.
In one embodiment, the wide-angle lens and the zoom lens are located in a shooting device 502, and the shooting device 502 can be mounted on an electronic device, such as a drone, a mobile robot, and the like, so that the terminal device 501 can display a picture of the wide-angle lens and the zoom lens mounted on the electronic device remotely. In another embodiment, the photographing device 502 includes a first photographing device and a second photographing device, the wide-angle lens is mounted on the first photographing device, the zoom lens is mounted on the second photographing device, and the first photographing device and the second photographing device may be mounted on the remaining mobile electronic devices, such as the unmanned aerial vehicle and the mobile robot, so that the terminal device 501 may display the picture of the wide-angle lens and the zoom lens mounted on the electronic device remotely.
In one embodiment, the wide-angle lens and the zoom lens are located in the photographing device 502, and the photographing device 502 may be mounted on the terminal device 501, for example, the terminal device is a handheld pan-tilt head, so as to form the picture switching system 500, so that the terminal device 501 can display a picture of the photographing device 502 mounted on the terminal device 501.
It should be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process of the image switching system described above may refer to the corresponding process in the foregoing image switching method embodiment, and is not described herein again.
An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, where the computer program includes program instructions, and the processor executes the program instructions to implement the steps of the picture switching method provided in the foregoing embodiment.
The computer-readable storage medium may be an internal storage unit of the terminal device according to any of the foregoing embodiments, for example, a hard disk or a memory of the terminal device. The computer readable storage medium may also be an external storage device of the terminal device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like provided on the terminal device.
It is to be understood that the terminology used in the description of the present application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this specification and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think of various equivalent modifications or substitutions within the technical scope of the present application, and these modifications or substitutions should be covered within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (43)

1. A picture switching method, for controlling a display picture of a terminal device to switch between a first picture which is a current picture of a wide-angle lens and a second picture which is a current picture of a zoom lens, the method comprising:
displaying the first picture in a display interface of the terminal equipment;
determining a target object in the first picture, and automatically adjusting the position of the target object in the second picture so that the target object is located in the second picture;
when a picture switching instruction triggered by a user is detected, switching a picture displayed in the display interface from the first picture to the second picture, wherein the target object is located in the second picture;
a zooming display frame is displayed in the first picture and used for indicating the size of the angle of view of the zooming lens in the first picture; the automatically adjusting the position of the target object within the second picture comprises:
and automatically adjusting the posture of the zoom lens to enable the target object to be located in the zoom display frame.
2. The screen switching method according to claim 1, wherein sizes of the target object within the first screen and the second screen are different.
3. The screen switching method according to claim 1, wherein at least one candidate object is displayed within the first screen; the determining a target object within the first frame includes:
acquiring a trigger operation of a user on the candidate object in the first picture;
and determining a target object from the at least one candidate object according to the triggering operation.
4. The screen switching method according to claim 3, wherein the trigger operation includes any one of a click operation, a double click operation, a long press operation, and a frame selection operation.
5. The screen switching method according to claim 1, wherein the automatically adjusting the position of the target object within the second screen comprises:
and adjusting the posture of the zoom lens to enable the target object to be located in the central area of the second picture, wherein the position of the target object in the second picture is changed along with the change of the posture of the zoom lens.
6. The picture switching method according to claim 5, wherein the wide-angle lens is located in the same photographing apparatus as the zoom lens; the adjusting the posture of the zoom lens comprises:
adjusting an attitude of the photographing apparatus, wherein an attitude of the zoom lens varies with a variation in the attitude of the photographing apparatus.
7. The picture switching method according to claim 6, wherein the adjusting the attitude of the photographing apparatus includes:
acquiring a first position coordinate of the target object in the first picture and a second position coordinate of a central point of the first picture;
determining a target attitude parameter of the shooting equipment according to the first position coordinate and the second position coordinate;
and adjusting the posture of the shooting equipment according to the target posture parameter.
8. The picture switching method according to claim 5, wherein the wide-angle lens is mounted to a first photographing apparatus, and the zoom lens is mounted to a second photographing apparatus; the adjusting the posture of the zoom lens comprises:
adjusting an attitude of the second photographing apparatus, wherein an attitude of the zoom lens varies with a variation in the attitude of the second photographing apparatus.
9. The picture switching method according to claim 5, wherein the terminal device includes a wide-angle lens and a zoom lens, the wide-angle lens and the zoom lens being mounted on a pan-tilt of the terminal device; the adjusting the posture of the zoom lens comprises:
and adjusting the joint angle of the holder of the terminal equipment, wherein the posture of the zoom lens is changed along with the change of the joint angle of the holder of the terminal equipment.
10. The screen switching method according to any one of claims 1 to 9, wherein the automatically adjusting the position of the target object within the second screen so that the target object is located behind the second screen further comprises:
and adjusting the size of the target object in the second picture.
11. The screen switching method according to claim 10, wherein the adjusting the size of the target object in the second screen includes:
and adjusting the zoom multiple of the zoom lens, wherein the size of the target object in the second picture is changed along with the change of the zoom multiple of the zoom lens.
12. The picture switching method according to claim 11, wherein the adjusting the zoom magnification of the zoom lens comprises:
acquiring a distance between the target object and the zoom lens;
and adjusting the zooming multiple of the zoom lens according to the distance between the target object and the zoom lens.
13. The picture switching method according to claim 11, wherein said adjusting a zoom magnification of said zoom lens comprises:
acquiring the proportion of the target object in the second picture;
and adjusting the zoom multiple of the zoom lens according to the proportion of the target object in the second picture.
14. The picture switching method according to claim 11, wherein a zoom adjustment icon and a zoom display frame are displayed in the first picture, the zoom adjustment icon is used for a user to adjust a zoom multiple of the zoom lens, and the target object is located in the zoom display frame; the adjusting the zoom multiple of the zoom lens comprises:
and adjusting the zooming multiple of the zoom lens according to the triggering operation of the user on the zooming adjusting icon, wherein the size of the target object in the zooming display frame is changed along with the change of the zooming multiple of the zoom lens.
15. The picture switching method according to claim 1 or 14, wherein a zoom display frame for indicating a size of an angle of view of the zoom lens in the first picture is displayed within the first picture; the automatically adjusting the position of the target object within the second picture comprises:
acquiring a first position of the zoom display frame in the first picture, and acquiring a second position of the target object in the first picture;
and adjusting the posture of the zoom lens according to the first position and the second position so as to enable the target object to be positioned in the zooming display frame.
16. The screen switching method according to claim 15, wherein the automatically adjusting the position of the target object within the second screen comprises:
acquiring a posture adjustment instruction triggered by a user, wherein the posture adjustment instruction is used for adjusting the posture of the zoom lens;
and adjusting the posture of the zoom lens according to the posture adjusting instruction, wherein the position of the zooming display frame in the first picture is changed along with the change of the posture of the zoom lens.
17. The picture switching method according to claim 15, wherein the size of the zoom display frame within the first picture is determined according to an angle of view of the zoom lens.
18. The picture switching method according to claim 15, wherein the position of the zoom display frame within the first picture is determined according to the postures of the wide-angle lens and zoom lens and lens parameters.
19. The picture switching method according to claim 15, wherein when the postures of the wide-angle lens and the zoom lens installed in the same photographing apparatus are the same, and a distance between a central point of the wide-angle lens and a central point of the zoom lens is smaller than a preset threshold, the zoom display frame is located in a central area of the first picture.
20. The picture switching method according to claim 19, wherein when the postures of the wide angle lens and the zoom lens mounted to the same photographing apparatus are different, the postures of the wide angle lens and/or the zoom lens are adjusted so that the postures of the wide angle lens and the zoom lens are the same.
21. The picture switching device is characterized by being used for controlling a display picture of a terminal device to be switched between a first picture and a second picture, wherein the first picture is a current picture of a wide-angle lens, the second picture is a current picture of a zoom lens, and the picture switching device comprises a memory and a processor;
the memory is used for storing a computer program;
the processor is configured to execute the computer program and, when executing the computer program, implement the following steps:
displaying the first picture in a display interface of the terminal equipment;
determining a target object in the first picture, and automatically adjusting the position of the target object in the second picture so that the target object is positioned in the second picture;
when a picture switching instruction triggered by a user is detected, switching a picture displayed in the display interface from the first picture to the second picture, wherein the target object is located in the second picture;
a zoom display frame is displayed in the first picture, and the zoom display frame is used for indicating the size of the angle of view of the zoom lens in the first picture; the automatically adjusting the position of the target object within the second picture comprises:
and automatically adjusting the posture of the zoom lens to enable the target object to be located in the zoom display frame.
22. The screen switching apparatus according to claim 21, wherein the target object is different in size within the first screen and the second screen.
23. The screen switching apparatus according to claim 21, wherein at least one candidate object is displayed in the first screen; the processor, when implementing determining a target object within the first screen, is configured to implement:
acquiring a trigger operation of a user on the candidate object in the first picture;
and determining a target object from the at least one candidate object according to the triggering operation.
24. The screen switching apparatus according to claim 23, wherein the trigger operation includes any one of a click operation, a double click operation, a long press operation, and a frame selection operation.
25. The picture switching apparatus according to claim 21, wherein the processor, when implementing automatic adjustment of the position of the target object within the second picture, is configured to implement:
and adjusting the posture of the zoom lens to enable the target object to be located in the central area of the second picture, wherein the position of the target object in the second picture is changed along with the change of the posture of the zoom lens.
26. The picture switching apparatus according to claim 25, wherein the wide-angle lens is located in the same photographing device as the zoom lens; when the processor realizes the adjustment of the posture of the zoom lens, the processor is used for realizing the following steps:
adjusting an attitude of the photographing apparatus, wherein an attitude of the zoom lens varies with a variation in the attitude of the photographing apparatus.
27. The picture switching apparatus according to claim 26, wherein the processor, when implementing the adjustment of the posture of the photographing device, is configured to implement:
acquiring a first position coordinate of the target object in the first picture and a second position coordinate of a central point of the first picture;
determining a target attitude parameter of the shooting equipment according to the first position coordinate and the second position coordinate;
and adjusting the posture of the shooting equipment according to the target posture parameter.
28. The picture switching apparatus according to claim 25, wherein the wide-angle lens is mounted to a first photographing device, and the zoom lens is mounted to a second photographing device; when the processor realizes the adjustment of the posture of the zoom lens, the processor is used for realizing the following steps:
and adjusting the posture of the second shooting device, wherein the posture of the zoom lens changes along with the change of the posture of the second shooting device.
29. The picture switching apparatus according to claim 25, wherein the terminal device includes a wide-angle lens and a zoom lens, the wide-angle lens and the zoom lens being mounted on a pan/tilt head of the terminal device; when the processor realizes the adjustment of the posture of the zoom lens, the processor is used for realizing the following steps:
and adjusting the joint angle of the holder of the terminal equipment, wherein the posture of the zoom lens changes along with the change of the joint angle of the holder of the terminal equipment.
30. The screen switching apparatus according to any one of claims 21 to 29, wherein the processor is further configured to automatically adjust the position of the target object within the second screen such that the target object is located behind the second screen, and further configured to:
and adjusting the size of the target object in the second picture.
31. The picture switching apparatus according to claim 30, wherein the processor, when performing resizing of the target object within the second picture, is configured to perform:
and adjusting the zoom multiple of the zoom lens, wherein the size of the target object in the second picture is changed along with the change of the zoom multiple of the zoom lens.
32. The picture switching device according to claim 31, wherein the processor, when implementing adjusting the zoom factor of the zoom lens, is configured to implement:
acquiring a distance between the target object and the zoom lens;
and adjusting the zooming multiple of the zoom lens according to the distance between the target object and the zoom lens.
33. The picture switching device according to claim 31, wherein the processor, when implementing adjusting the zoom factor of the zoom lens, is configured to implement:
acquiring the proportion of the target object in the second picture;
and adjusting the zoom multiple of the zoom lens according to the proportion of the target object in the second picture.
34. The image switching apparatus according to claim 31, wherein a zoom adjustment icon and a zoom display frame are displayed in the first image, the zoom adjustment icon is used for a user to adjust a zoom multiple of the zoom lens, and the target object is located in the zoom display frame; when the processor realizes the adjustment of the zoom multiple of the zoom lens, the processor is used for realizing that:
and adjusting the zooming multiple of the zoom lens according to the triggering operation of the user on the zooming adjusting icon, wherein the size of the target object in the zooming display frame is changed along with the change of the zooming multiple of the zoom lens.
35. The picture switching apparatus according to claim 31 or 34, wherein a zoom display frame is displayed in the first picture, the zoom display frame indicating a size of an angle of view of the zoom lens in the first picture; the processor is used for realizing that when the position of the target object in the second picture is automatically adjusted, the processor is used for realizing that:
acquiring a first position of the zoom display frame in the first picture, and acquiring a second position of the target object in the first picture;
and adjusting the posture of the zoom lens according to the first position and the second position so as to enable the target object to be positioned in the zooming display frame.
36. The picture switching apparatus according to claim 35, wherein the processor, when implementing automatic adjustment of the position of the target object within the second picture, is configured to implement:
acquiring a posture adjustment instruction triggered by a user, wherein the posture adjustment instruction is used for adjusting the posture of the zoom lens;
and adjusting the posture of the zoom lens according to the posture adjusting instruction, wherein the position of the zooming display frame in the first picture is changed along with the change of the posture of the zoom lens.
37. The picture switching apparatus according to claim 35, wherein the size of the zoom display frame within the first picture is determined according to an angle of view of the zoom lens.
38. The picture switching apparatus according to claim 35, wherein the position of the zoom display frame within the first picture is determined according to the postures of the wide angle lens and zoom lens and lens parameters.
39. The image switching apparatus according to claim 35, wherein when the postures of the wide-angle lens and the zoom lens installed in the same photographing device are the same, and a distance between a central point of the wide-angle lens and a central point of the zoom lens is smaller than a preset threshold, the zoom display frame is located in a central area of the first image.
40. The picture switching apparatus according to claim 39, wherein when the postures of the wide angle lens and the zoom lens mounted to the same photographing device are different, the postures of the wide angle lens and/or the zoom lens are adjusted so that the postures of the wide angle lens and the zoom lens are the same.
41. A terminal device, comprising a display device and a picture switching device, wherein the picture switching device is configured to control a display picture of the display device to switch between a first picture and a second picture, the first picture is a current picture of a wide-angle lens, and the second picture is a current picture of a zoom lens, wherein:
the display device is used for displaying a display interface containing the first picture;
the picture switching device is used for determining a target object in the first picture and automatically adjusting the position of the target object in the second picture so that the target object is positioned in the second picture;
the picture switching device is further configured to control the display device to switch a picture displayed in the display interface from the first picture to the second picture when a picture switching instruction triggered by a user is detected, where the target object is located in the second picture;
a zoom display frame is displayed in the first picture, and the zoom display frame is used for indicating the size of the angle of view of the zoom lens in the first picture; the picture switching device is further configured to:
and automatically adjusting the posture of the zoom lens to enable the target object to be located in the zoom display frame.
42. A picture switching system, characterized in that the picture switching system comprises a terminal device and a photographing device, the terminal device being in communication connection with the photographing device, wherein:
the terminal device is used for acquiring a picture transmission picture of the shooting device, wherein the picture transmission picture comprises a first picture and a second picture, the first picture is a current picture of the wide-angle lens, and the second picture is a current picture of the zoom lens;
the terminal equipment is also used for displaying the first picture in a display interface;
the terminal device is further configured to determine a target object in the first picture, and automatically adjust a position of the target object in the second picture, so that the target object is located in the second picture;
the terminal device is further configured to switch, when a picture switching instruction triggered by a user is detected, a picture displayed in the display interface from the first picture to the second picture, where the target object is located in the second picture;
a zooming display frame is displayed in the first picture and used for indicating the size of the angle of view of the zooming lens in the first picture; the terminal device is further configured to:
and automatically adjusting the posture of the zoom lens to enable the target object to be located in the zoom display frame.
43. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program which, when executed by a processor, causes the processor to implement the picture switching method according to any one of claims 1 to 20.
CN202080005981.2A 2020-05-06 2020-05-06 Picture switching method, device, terminal equipment, system and storage medium Active CN113016174B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/088845 WO2021223126A1 (en) 2020-05-06 2020-05-06 Image switching method and apparatus, terminal device, system and storage medium

Publications (2)

Publication Number Publication Date
CN113016174A CN113016174A (en) 2021-06-22
CN113016174B true CN113016174B (en) 2022-12-13

Family

ID=76384105

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080005981.2A Active CN113016174B (en) 2020-05-06 2020-05-06 Picture switching method, device, terminal equipment, system and storage medium

Country Status (2)

Country Link
CN (1) CN113016174B (en)
WO (1) WO2021223126A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009224882A (en) * 2008-03-13 2009-10-01 Ricoh Co Ltd Image pickup device, display method of image pickup device, program, and computer readable recording medium
CN105991915A (en) * 2015-02-03 2016-10-05 中兴通讯股份有限公司 Shooting method and apparatus, and terminal
JP2019015765A (en) * 2017-07-03 2019-01-31 三菱電機エンジニアリング株式会社 Imaging device
CN109525752A (en) * 2018-06-13 2019-03-26 幻想动力(上海)文化传播有限公司 Capture apparatus and image pickup method
CN110445978A (en) * 2019-06-24 2019-11-12 华为技术有限公司 A kind of image pickup method and equipment
CN112106344A (en) * 2019-08-29 2020-12-18 深圳市大疆创新科技有限公司 Display method, photographing method and related device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2667571Y (en) * 2003-10-27 2004-12-29 北京雷波泰克信息技术有限公司 Fast multi-target human figures identification and tracking safety protection apparatus
JP2009284309A (en) * 2008-05-23 2009-12-03 Casio Comput Co Ltd Imaging device, display control program, and display control method
CN110460748A (en) * 2018-05-08 2019-11-15 杭州海康威视数字技术股份有限公司 A kind of video camera and monitoring system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009224882A (en) * 2008-03-13 2009-10-01 Ricoh Co Ltd Image pickup device, display method of image pickup device, program, and computer readable recording medium
CN105991915A (en) * 2015-02-03 2016-10-05 中兴通讯股份有限公司 Shooting method and apparatus, and terminal
JP2019015765A (en) * 2017-07-03 2019-01-31 三菱電機エンジニアリング株式会社 Imaging device
CN109525752A (en) * 2018-06-13 2019-03-26 幻想动力(上海)文化传播有限公司 Capture apparatus and image pickup method
CN110445978A (en) * 2019-06-24 2019-11-12 华为技术有限公司 A kind of image pickup method and equipment
CN112106344A (en) * 2019-08-29 2020-12-18 深圳市大疆创新科技有限公司 Display method, photographing method and related device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
智能视频监控技术的应用与发展;吕金刚等;《通信电源技术》;20061025(第05期);全文 *

Also Published As

Publication number Publication date
CN113016174A (en) 2021-06-22
WO2021223126A1 (en) 2021-11-11

Similar Documents

Publication Publication Date Title
US11649052B2 (en) System and method for providing autonomous photography and videography
CN108769531B (en) Method for controlling shooting angle of shooting device, control device and remote controller
EP3188467B1 (en) Method for image capturing using unmanned image capturing device and electronic device supporting the same
CN109040600B (en) Mobile device, system and method for shooting and browsing panoramic scene
CN113794840B (en) Video processing method, video processing equipment, unmanned aerial vehicle and video processing system
CN108780324B (en) Unmanned aerial vehicle, and unmanned aerial vehicle control method and device
US20200084424A1 (en) Unmanned aerial vehicle imaging control method, unmanned aerial vehicle imaging method, control terminal, unmanned aerial vehicle control device, and unmanned aerial vehicle
CN105045279A (en) System and method for automatically generating panorama photographs through aerial photography of unmanned aerial aircraft
CN108778932B (en) Method and device for controlling cradle head to reset, cradle head and unmanned aerial vehicle
CN106303448B (en) Aerial image processing method, unmanned aerial vehicle, head-mounted display device and system
CN113273172A (en) Panorama shooting method, device and system and computer readable storage medium
CN110022444A (en) The panorama photographic method of unmanned flight's machine and the unmanned flight's machine for using it
US11611700B2 (en) Unmanned aerial vehicle with virtual un-zoomed imaging
US20210004005A1 (en) Image capture method and device, and machine-readable storage medium
EP3737082A1 (en) Pan-tilt control method, pan-tilt and machine readable storage medium
WO2021217371A1 (en) Control method and apparatus for movable platform
WO2020019175A1 (en) Image processing method and apparatus, and photographing device and unmanned aerial vehicle
CN113016174B (en) Picture switching method, device, terminal equipment, system and storage medium
CN113302908A (en) Control method, handheld cloud deck, system and computer readable storage medium
US20220345607A1 (en) Image exposure method and device, unmanned aerial vehicle
CN112514366A (en) Image processing method, image processing apparatus, and image processing system
WO2022041013A1 (en) Control method, handheld gimbal, system, and computer readable storage medium
JP2019080165A (en) Image provision method
CN116762354A (en) Image shooting method, control device, movable platform and computer storage medium
KR20180060403A (en) Control apparatus for drone based on image

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant