WO2019127333A1 - 一种图像处理方法、移动平台、控制设备及系统 - Google Patents

一种图像处理方法、移动平台、控制设备及系统 Download PDF

Info

Publication number
WO2019127333A1
WO2019127333A1 PCT/CN2017/119753 CN2017119753W WO2019127333A1 WO 2019127333 A1 WO2019127333 A1 WO 2019127333A1 CN 2017119753 W CN2017119753 W CN 2017119753W WO 2019127333 A1 WO2019127333 A1 WO 2019127333A1
Authority
WO
WIPO (PCT)
Prior art keywords
panoramic
mobile platform
photographing
control device
preset
Prior art date
Application number
PCT/CN2017/119753
Other languages
English (en)
French (fr)
Inventor
林濠
陈一
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN202111197077.9A priority Critical patent/CN113890996A/zh
Priority to PCT/CN2017/119753 priority patent/WO2019127333A1/zh
Priority to CN201780022955.9A priority patent/CN109076161B/zh
Publication of WO2019127333A1 publication Critical patent/WO2019127333A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/62Control of parameters via user interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/695Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95Computational photography systems, e.g. light-field imaging systems
    • H04N23/951Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265Mixing

Definitions

  • the present application relates to the field of image technologies, and in particular, to an image processing method, a mobile platform, a control device, and a system.
  • the embodiment of the present application provides an image processing method, a mobile platform, a control device, and a system, which can automatically capture an image set of a target object according to a panoramic shooting instruction, and can automatically generate a panoramic image according to the image set, thereby improving the generation of the panoramic image. effectiveness.
  • the first aspect of the embodiment of the present application provides an image processing method, which is applied to a mobile platform, and includes:
  • the captured image collection is sent to the control device of the mobile platform.
  • the second aspect of the embodiments of the present application provides another image processing method, which is applied to a control device of a mobile platform, and includes:
  • a third aspect of the embodiments of the present application provides a mobile platform, including: a processor and a communication interface, where
  • the processor is further configured to adjust a current posture of the photographing device to a preset posture according to the panoramic shooting instruction, and the photographing device is disposed on the mobile platform;
  • the processor is further configured to control the shooting device to shoot the target object in a preset shooting direction of the preset posture, to obtain a captured image set;
  • a communication interface for transmitting a captured image collection to a control device of the mobile platform.
  • a fourth aspect of the embodiments of the present application provides a control device, including: a processor, a communication interface, and a display screen.
  • a communication interface configured to receive a captured image set sent by the mobile platform for the target object
  • a processor configured to process the captured image according to the first operation to generate a panoramic image of the target object if the first operation for the captured image set is detected;
  • a fifth aspect of the embodiments of the present application provides an image processing system, comprising: the mobile platform of the third aspect; and the control device of the fourth aspect.
  • a sixth aspect of the embodiments of the present application provides a computer readable storage medium.
  • the computer readable storage medium stores a computer program.
  • the steps of the method provided by the first aspect are implemented.
  • a seventh aspect of the present application provides a computer readable storage medium.
  • the computer readable storage medium stores a computer program.
  • the steps of the method provided by the second aspect are implemented.
  • a panoramic shooting instruction is first acquired, and the current posture of the shooting device is adjusted to a preset posture according to the acquired panoramic shooting instruction, and then the shooting device is controlled to shoot the target object in a preset shooting direction of the preset posture.
  • the panoramic image can be automatically generated according to the image collection, thereby improving the efficiency of generating the panoramic image.
  • FIG. 1 is a schematic flowchart diagram of an image processing method according to an embodiment of the present application
  • FIG. 2 is a schematic diagram of a panoramic shooting provided by an embodiment of the present application.
  • FIG. 3 is a schematic flowchart diagram of another image processing method according to an embodiment of the present disclosure.
  • FIG. 4 is a schematic diagram of an icon associated with a captured image set provided by an embodiment of the present application.
  • FIG. 5 is a schematic diagram of a waiting prompt for loading a panoramic image according to an embodiment of the present application.
  • FIG. 6 is a schematic diagram of a panoramic image display interface provided by an embodiment of the present application.
  • FIG. 7 is a schematic diagram of another panoramic image display interface provided by an embodiment of the present application.
  • FIG. 8 is a schematic diagram of prompt information provided by an embodiment of the present application.
  • FIG. 9 is a schematic diagram of still another panoramic image display interface according to an embodiment of the present application.
  • FIG. 10 is a schematic flowchart diagram of still another image processing method according to an embodiment of the present application.
  • FIG. 11 is a schematic structural diagram of a mobile platform according to an embodiment of the present application.
  • FIG. 12 is a schematic structural diagram of a control device according to an embodiment of the present disclosure.
  • FIG. 13 is a schematic structural diagram of an image processing system according to an embodiment of the present application.
  • FIG. 1 is a schematic flowchart diagram of an image processing method according to an embodiment of the present application.
  • the image processing method described in the embodiment of the present application includes:
  • the mobile platform acquires a panoramic shooting instruction.
  • the mobile platform may be a drone. Take the mobile platform as an example of a drone:
  • the specific manner for the mobile platform to obtain the panoramic shooting instruction is: the mobile platform receives the panoramic shooting instruction sent by the control device of the mobile platform.
  • the panoramic shooting instruction may be sent to the mobile platform after the control device acquires the first operation information of the user.
  • the first operation information may be, for example, click information of the user's panoramic shooting button for the control device, and the panoramic shooting button may be physical or virtual, which is not limited in the embodiment of the present application.
  • the specific manner of the mobile platform acquiring the panoramic shooting instruction is: the mobile platform first receives instruction information sent by the control device of the mobile platform, the instruction information includes panoramic position information and a panoramic shooting instruction; and then according to the instruction information
  • the panoramic position information included therein controls the mobile platform to move to the panoramic position; further, detecting whether the mobile platform is located at the panoramic position, and when detecting that the mobile platform is located at the panoramic position, acquiring the panoramic shooting instruction included in the instruction information.
  • the command information may be sent by the control device to the mobile platform according to the second operation information after acquiring the second operation information of the user.
  • the second operation information may be that the user inputs the panoramic position information for the control device, the panoramic position information includes information such as the coordinate value of the panoramic shooting position and the altitude, and the information such as the coordinate value and the altitude of the panoramic shooting position may be manually input by the user.
  • the control device may obtain the touch information of the display map for the user, and determine the touch information according to the touch information.
  • the manner in which the mobile platform obtains the panoramic shooting instruction may be other than the above description, which is not limited in the embodiment of the present application.
  • the mobile platform adjusts a current posture of the photographing device to a preset posture according to the panoramic photographing instruction.
  • a photographing device (such as a camera or a camera) is disposed on the mobile platform, and may be supported on a carrier of the mobile platform, and the carrier of the mobile platform may be a pan-tilt device.
  • the preset posture of the photographing device may include a first posture and a second posture. After the mobile platform acquires the panoramic shooting instruction, the current posture of the shooting device may be adjusted to the first posture or the second posture in response to the panoramic shooting instruction.
  • the preset posture of the photographing device may be a posture, and may further include other postures than the first posture and the second posture described above, as long as a set of captured images sufficient for generating a panoramic image is obtained.
  • the embodiment of the present application is not limited.
  • the mobile platform controls the shooting device to capture the target object in a preset shooting direction of the preset posture, to obtain a captured image set.
  • the preset shooting direction corresponding to the preset posture may include a first shooting direction and a second shooting direction.
  • the first photographing direction when the photographing device is in the first posture, the first photographing direction is upward and is at a third preset angle with the horizontal direction, and the third preset angle may be, for example, 0 degrees to 10 degrees.
  • the second photographing direction When the photographing device is in the second posture, the second photographing direction is downward and is at a fourth preset angle with the vertical direction, and the fourth preset angle may be, for example, 35 degrees to 55 degrees.
  • the first photographing direction when the photographing device is in the first posture, is a horizontal direction.
  • the second photographing direction is downward and is at a fifth preset angle with the vertical direction, and the fifth preset angle may be, for example, 45 degrees.
  • the fourth preset angle and the fifth preset angle may also be other angles, which are not limited in the embodiment of the present application; optionally, the fourth preset angle and the fifth preset angle may correspondingly enable shooting.
  • the image captured by the device in the first photographing direction and the image photographed by the photographing device in the second photographing direction may have a certain overlapping area (for example, fifteen to thirty-five percent).
  • the mobile platform first controls the photographing device to be in the first posture, and controls the photographing device to photograph the target object in the first photographing direction to obtain a first image set of the target object; and then control the photographing device to be in the first a second gesture, and controlling the photographing device to photograph the target object in the second photographing direction to obtain a second image set of the target object.
  • the mobile platform first controls the shooting device to be in the second posture, and controls the shooting device to capture the target object in the second shooting direction to obtain a second image set; then, the shooting device is controlled to be in the first posture, and The photographing device is controlled to photograph the target object in the first photographing direction to obtain a first image set.
  • the mobile platform controls the shooting device to capture the target object in the first shooting direction, and the specific manner of obtaining the first image set is: the mobile platform controls the shooting device to rotate the target object according to the first preset direction, and obtains the first The first image collection of the shooting direction.
  • the first preset direction may be a clockwise direction or a counterclockwise direction.
  • the mobile platform can control the mobile platform to rotate in a first preset direction, thereby driving the photographing device to rotate in a first preset direction, and controlling the photographing device to target the target after each rotation of the first preset angle of the mobile platform At least one shooting is performed, and after the shooting device rotates the shooting for the target object, the first image set of the first shooting direction is obtained.
  • the mobile platform controls the mobile platform to remain stationary, and the carrier controlling the mobile platform rotates in a first preset direction, thereby driving the photographing device to rotate in a first preset direction, and after each rotation of the first preset angle of the carrier,
  • the shooting device is controlled to perform at least one shooting for the target object, thereby obtaining a first image set of the first shooting direction.
  • the mobile platform controls the photographing device to photograph the target object in the second photographing direction, and the specific manner of obtaining the second image set is: the mobile platform controls the photographing device to rotate the target object according to the second preset direction, and obtains the second A second image collection of the shooting direction.
  • the second preset direction may be a clockwise direction or a counterclockwise direction.
  • the mobile platform controls the mobile platform to rotate in the second preset direction, thereby driving the photographing device to rotate in the second preset direction, and controlling the photographing device to target the target object after each rotation of the second preset angle of the moving platform. At least one shot is taken, and after the shooting device finishes shooting for the target object, a second image set of the second shooting direction is obtained.
  • the mobile platform controls the mobile platform to remain stationary, and the carrier controlling the mobile platform rotates in the second preset direction, thereby driving the shooting device to rotate in the second preset direction, and after each rotation of the carrier by the second preset angle,
  • the photographing device is controlled to perform at least one photographing for the target object, thereby obtaining a second image set of the second photographing direction.
  • the first preset angle and the second preset angle may each be no more than 45 degrees, so as to obtain multiple photos with overlapping regions for generating a panoramic image.
  • the rotation angle may be at least 360. Degree, so that the target object's picture is not missed, and image filtering can be performed to enhance the panoramic image generation effect.
  • the photographing apparatus when the rotation angle of the mobile platform controlling the photographing apparatus for rotating shooting of the target object is greater than 360 degrees, the photographing apparatus has different starting photographing directions in each 360-degree rotating circle. For example, suppose the mobile platform controls the shooting device to perform a rotation shooting with a rotation angle of 720 degrees, and firstly controls the shooting device to start rotating shooting in the positive direction in the clockwise direction, and the moving platform is rotated 360 degrees after the shooting device is moved. You can control the shooting device to start rotating in the counterclockwise direction or clockwise direction at 10 degrees north and south.
  • part or all of the images in the captured image set may have overlapping regions or image content adjacent, but part or all images in the captured image set may be used to synthesize the panoramic image. After the explanation, the definition will not be repeated later.
  • the mobile platform sends the captured image set to a control device of the mobile platform.
  • the mobile platform sends the first image set and the second image set of the target object to the control device of the mobile platform.
  • the first set of images and the second set of images can be used to generate a panoramic image of the target object.
  • the mobile platform after acquiring, by the mobile platform, the first image set and the second image set of the target object, first screening, in the first image set and the second image set, a preset quantity that meets a preset condition Target image.
  • the mobile platform selects, according to the matching feature points of the adjacent images, a preset number of target images that match the first requirement in the first image set and the second image set, for example, adjacent a and b images.
  • the image with the same feature points can be selected in other images to fill the gap portion, that is, assuming 5 feature points on the right side of the a image and 4 feature points on the left side of the b image, which can be filtered out.
  • the c image including the above nine feature points is added to the gap between a and b.
  • the mobile platform selects, in the first image set and the second image set, a preset number of target images in which the overlapping area meets the second requirement according to the overlapping area of the adjacent image, for example, between adjacent a and b images.
  • the image including the gap portion may be selected in other images to fill the gap portion, that is, when the overlap region of the c image and the a and b images is the largest, the c image may be screened to complement between a and b. Clearance.
  • the preset number of target images includes all the images of the target object, and the preset number may be, for example, at least 17 sheets. Then, the mobile platform sends the filtered preset number of target images to the control device of the mobile platform, and the preset number of target images can be used to generate a panoramic image of the target object.
  • the preset posture of the photographing device may further include a third posture.
  • the preset photographing direction may further include a third photographing direction.
  • the third photographing direction is Vertical and downward.
  • the mobile platform controls the mobile platform after acquiring the panoramic shooting instruction, or after obtaining the first image of the target object, or after obtaining the second image of the target object, or after obtaining the first image and the second image of the target object
  • the photographing device is in the third posture, and controls the photographing device to perform at least one shooting on the target object in the third photographing direction to obtain a third image set of the target object.
  • the specific manner in which the mobile platform sends the captured image set to the control device of the mobile platform is: the mobile platform sends the first image set, the second image set and the third image set of the target object to the control device of the mobile platform, the first image The set, the second set of images, and the third set of images may be used to generate a panoramic image of the target object.
  • FIG. 2 is a schematic diagram of the shooting device rotating the target object.
  • the shooting device is controlled to perform 360-degree rotation shooting in the horizontal direction for the target object.
  • the mobile platform controls the shooting device to rotate the first preset angle in a clockwise or counterclockwise direction (for example, After 45 degrees), at least one image is taken for the target object, so that about 30% of the content between the left and right adjacent images is coincident, and the 360-degree rotation shooting is completed, and the first image collection is obtained.
  • the shooting device is controlled to perform a 360-degree rotation shooting obliquely downward for the target object.
  • the moving platform controls the shooting direction of the shooting device to be downward and at a fifth preset angle (for example, 45 degrees) with the vertical direction, and controls shooting.
  • a fifth preset angle for example, 45 degrees
  • the device captures at least one image for the target object, thereby ensuring that about 30% of the content between the left and right adjacent images is coincident. It is also ensured that about 30% of the content between the adjacent images shot horizontally coincides, until the 360-degree rotation is completed, and the second image collection is obtained.
  • the shooting device is controlled to shoot at least one photo for the target object vertically downward to obtain a third image collection.
  • the shooting angle adjustment is more accurate, and the mobile platform can automatically capture the image set of the target object according to the panoramic shooting instruction, and the images in the image set have more matching feature points, and the overlapping regions between adjacent images are also more accurate.
  • the image stitching effect is good, according to the image set can generate the ideal panoramic image.
  • a panoramic shooting instruction is first acquired, and the current posture of the shooting device is adjusted to a preset posture according to the acquired panoramic shooting instruction, and then the shooting device is controlled to shoot the target object in a preset shooting direction of the preset posture.
  • the efficiency of image collection is first acquired, and the current posture of the shooting device is adjusted to a preset posture according to the acquired panoramic shooting instruction, and then the shooting device is controlled to shoot the target object in a preset shooting direction of the preset posture.
  • FIG. 3 is a schematic flowchart diagram of another image processing method according to an embodiment of the present application.
  • the image processing method described in the embodiment of the present application includes:
  • the control device receives a captured image set sent by the mobile platform for the target object.
  • the control device may be a remote control device or a mobile terminal, and the mobile platform may be an unmanned aerial vehicle.
  • the set of captured images received by the control device may be a first image set and a second image set of the target object, or may be a first image set of the target object, based on a different shooting direction of the mobile platform or a filtering process on the image.
  • the first captured image set is that the shooting device of the mobile platform controls the mobile platform is in the first posture, and controls the shooting device to capture the target object in the first shooting direction; the second captured image set is the mobile platform controls the shooting.
  • the device is in the second posture, and controls the shooting device to capture the target object in the second shooting direction; the third captured image set is that the mobile platform controls the shooting device to be in the third posture, and controls the shooting device to be in the third shooting direction.
  • the target image is selected by the mobile platform from the first image set and the second image set according to the matching feature points or overlapping regions of the adjacent images, or the moving platform is from the first image set according to the matching feature points or overlapping regions of the adjacent images.
  • the second image set and the third image set are filtered out.
  • the control device before receiving the captured image set for the target object sent by the mobile platform, the control device first acquires first operation information of the user for the control device; and then sends the panoramic shooting to the mobile platform according to the first operation information.
  • the instruction, the panoramic shooting instruction is used to instruct the mobile platform to perform panoramic shooting on the target object to obtain a captured image set.
  • the first operation information may be, for example, click information of a user's panoramic shooting button for the control device, and the panoramic shooting button may be physical or virtual.
  • the control device first acquires second operation information of the user for the control device before receiving the captured image set for the target object that is sent by the mobile platform; and then sends the instruction information to the mobile platform according to the second operation information
  • the instruction information includes panoramic position information and a panoramic shooting instruction.
  • the control device acquires the panoramic position information input by the user, and then carries the panoramic position information and the panoramic shooting instruction in the instruction information and sends the information to the mobile platform.
  • the control device acquires touch information of the map displayed by the user on the display interface of the control device, and determines the panoramic position information according to the touch information, and then carries the panoramic position information and the panoramic shooting instruction in the instruction information and sends the information to the mobile platform.
  • the panoramic location information includes information such as coordinate values and altitudes of the panoramic shooting position.
  • the instruction information is used to indicate that the mobile platform moves to the panoramic shooting position, and performs panoramic shooting for the target object in response to the panoramic shooting instruction to obtain a captured image set.
  • control device may also send the panoramic shooting instruction to the mobile platform in other forms after acquiring other operation information of the user, such as a voice command, which is not limited in the embodiment of the present application.
  • the panoramic image sample of the panoramic location may be first acquired according to the panoramic location information, and then the panoramic image sample is taken according to the panoramic image sample. prompt.
  • the control device first acquires the best panoramic image sample and the worst panoramic image sample of the panoramic position from the cloud server, and displays the best panoramic image sample and the worst panoramic image of the panoramic position. The sample is such that the user determines whether to perform panoramic shooting at the panoramic position based on the best panoramic image sample and the worst panoramic image sample of the panoramic position.
  • the control device then outputs shooting prompt information for prompting the user to perform panoramic shooting at the panoramic position; when the control device receives the determination instruction input by the user for the shooting prompt information, the instruction information is sent to the mobile platform.
  • the best panoramic image sample and the worst panoramic image sample of the panoramic position may be obtained according to a comprehensive evaluation of a plurality of users.
  • control device may also obtain the panoramic image sample of the panoramic position by other means, and at the same time, the panoramic image sample of the panoramic position acquired by the control device may be in addition to the best or worst panoramic image sample.
  • panoramic images are set according to specific requirements, which are not limited in the embodiment of the present application.
  • the control device after the control device acquires the panoramic location information, before sending the instruction information to the mobile platform, the environment information of the panoramic location may be first acquired, and then the shooting prompt is performed according to the environmental information.
  • the control device may obtain the environment information of the panoramic location through the Internet, or acquire the environmental information of the panoramic location by using at least one image of the environment where the panoramic location collected by the mobile platform is located.
  • the environmental information of the panoramic location includes information such as climate, season, and light.
  • the control device outputs, according to the acquired environment information of the panoramic position, the shooting prompt information, which is used to prompt the user to perform an operation such as adjusting the shooting mode, and may also be used to prompt the user whether to perform panoramic shooting at the panoramic position;
  • the control device receives the determination instruction input by the user for the shooting prompt information, and sends the instruction information to the mobile platform.
  • the captured image set may be archived, such as storing the captured image set in a folder or an album; further The control device may store the captured image set of the target object by using a preset identifier.
  • the preset identifier is a panoramic image identifier, and the panoramic image identifier is used to prompt the user that the image set corresponding to the panoramic image identifier can be used to generate a panoramic image to distinguish it from other normal images.
  • the display interface of the control device may include an icon associated with the archived stored image collection, the icon may include a panoramic image identification and a cover image obtained from the captured image collection. For example, please refer to FIG. 4 together. FIG.
  • the panoramic image identifier may be located at a lower left corner of the icon, or the panoramic image identifier is located at a cover image obtained according to the captured image set. The bottom left corner. It should be noted that the panoramic image identifier may also be located at other corners of the icon, or may be in the middle of the icon, which is not limited in the embodiment of the present application.
  • the control device detects the first operation for the captured image set, the captured image set is processed according to the first operation to generate a panoramic image of the target object.
  • the first operation may be a click operation for capturing a collection of images, or may be a click operation for an icon associated with the stored captured image collection.
  • the click operation may be a click operation of a finger or a knuckle, or a multiple click operation of a finger or a knuckle.
  • the first operation may also be other types of touch operations, and may also be other operations, such as a gesture operation or a voice operation, which are not limited in this embodiment.
  • the control device first performs projection transformation on each image in the captured image set, which may be planar projection, cylindrical projection, cube projection, or spherical projection. Because different images may be taken by the shooting device at different angles, they are not on the same projection plane. If the overlapping images are directly spliced directly, the visual consistency of the actual scene will be destroyed, so the image needs to be first Perform a projection transformation. Then, the control device acquires valid feature matching points of each image in the image set, and performs image stitching on each image in the image set according to the obtained effective feature matching points to obtain a panoramic view of the target object.
  • the image mosaic includes registration and Blending. The registration is based on the geometric motion model, and each image in the image set is registered in the same coordinate system, and the fusion is performed after registration. The image is combined into a large mosaic image.
  • the control device may output the first image before processing the captured image according to the first operation to generate a panoramic image of the target object.
  • the second prompt information is used to prompt the user to select a generation mode of the panoramic image; wherein the generation mode of the panoramic image includes a spherical panoramic image generation mode and a 360-degree panoramic image generation mode. Then, the control device receives a selection instruction input by the user for the second prompt information.
  • the control device processes the captured image set in response to the selection instruction to generate a spherical panoramic image of the target object; if the selection instruction input by the user indicates the panoramic image
  • the generation mode is a 360-degree panoramic image, and the control device processes the captured image set in response to the selection instruction to generate a 360-degree panoramic image of the target object.
  • control device may output a waiting prompt for loading the panoramic image in the process of processing the captured image set to generate a panoramic image of the target object, where the waiting prompt includes a preset icon and/or Default typeface. For example, as shown in FIG. 5, as shown in FIG.
  • the waiting prompt may be prompted in the form of an interface, and the waiting prompting interface may include a preset icon, and the preset icon may be a spherical icon, and the spherical icon may be Including "360", the spherical icon may also include the word "is being generated”; the waiting prompt interface may further include a delete icon, in the process of generating the panoramic image, if the user detects a click such as clicking on the deleted icon Operation, you can delete the intermediate document generated during the process of generating the panoramic image, and exit the waiting prompt interface.
  • the waiting prompt may also be in other forms, such as a voice prompt, a photoelectric prompt, and the like.
  • the preset icon and the preset typeface may also be in other forms, and may be set according to specific needs. limited.
  • the control device processes the captured image set, and after generating the panoramic image of the target object, saves the panoramic image of the target object.
  • the panoramic image of the target object and the captured image collection may be saved in the same folder or album. If the control device detects the first operation of the captured image set by the user again, the panoramic image of the target object is directly displayed, so that the panoramic image of the target object does not need to be generated again, and the hardware and software resources of the control device are saved.
  • the control device displays a panoramic image.
  • FIG. 6 is a schematic diagram of a panoramic image display interface according to an embodiment of the present disclosure.
  • the display interface of the panoramic image includes a panoramic image of the target object, and includes a menu bar.
  • the menu bar includes a toolbar and a title bar.
  • the control device switches the browsing mode of the panoramic image when detecting the second operation of the user for the panoramic image.
  • the browsing mode of the panoramic image includes a manual browsing mode and a somatosensory browsing mode, and the second operation may be a double tap or a three-click operation of the user's finger or knuckle.
  • the control device switches the browsing mode of the panoramic image to the somatosensory browsing mode when detecting the second operation of the panoramic image by the user; if the panoramic image The current browsing mode is the somatosensory browsing mode, and the control device switches the browsing mode of the panoramic image to the manual browsing mode when detecting the second operation of the user for the panoramic image.
  • the second operation may also be other types of touch operations (such as pressing, sliding, etc.), and may also be, for example, a gesture operation or a voice operation, which is not limited in the embodiment of the present application.
  • the control device after the control device displays the panoramic image of the target object, when detecting the third operation of the panoramic image by the user, the control device hides or displays the menu bar of the display interface of the panoramic image, where The third operation may be a click operation for the panoramic image.
  • the display interface of the panoramic image displays a menu bar.
  • the control device detects the third operation for the panoramic image, the display interface of the panoramic image is The menu bar is hidden, and the display interface after the menu bar is hidden is shown in FIG. 7 .
  • the menu bar of the display interface of the panoramic image shown in FIG. 7 is hidden.
  • the control device detects the third operation for the panoramic image
  • the menu bar of the display interface of the panoramic image is displayed, and after the menu bar is displayed,
  • the display interface is shown in Figure 6.
  • the third operation may also be other types of touch operations, and may also be, for example, a gesture operation or a voice operation, which is not limited in this embodiment.
  • first operation, the second operation, and the third operation are different to implement corresponding functions, and at the same time, the functions corresponding to the first operation, the second operation, and the third operation can be performed before the control terminal leaves the factory.
  • the setting can also be customized by the user, which is not limited in the embodiment of the present application.
  • the first prompt information may be output.
  • the first prompt information is used to prompt the user to adjust the posture of the control device, and the prompt duration of the first prompt information may be 1.5 seconds to 3 seconds.
  • FIG. 8 is a schematic diagram of a display interface of the first prompt information.
  • the first prompt information is displayed in the middle of the panoramic image, and the first prompt information includes, for example, a “tilt device”. Watch the words such as the prompt.
  • the duration of the prompting of the first prompt information may be other durations.
  • the first prompt information may be a voice prompt, a blinking light, or the like, which is not limited in the embodiment of the present application.
  • the control device after detecting the first prompt information, the control device immediately turns off the first prompt information if it detects that the posture of the control device changes.
  • the control device acquires posture information of the control device every preset time interval interval or in real time, and according to the obtained posture information of the control device. Adjust the display of the panoramic image.
  • the control device first acquires posture information of the control device by using a preset sensor (eg, a gravity sensor, a gyroscope, etc.), the posture information includes a tilt direction and a tilt angle of the control device, and then according to the control device
  • a preset sensor eg, a gravity sensor, a gyroscope, etc.
  • the tilting direction and the tilting angle adjust the display screen of the panoramic image, and when the tilting direction and the tilting angle of the control device are different, the content of the display screen based on the panoramic image may be different.
  • the control device acquires manual operation information of the panoramic image for the user, and adjusts the display image of the panoramic image according to the manual operation information.
  • the manual operation information includes touch information and/or gesture information. For example, when the control device detects the user's drag operation for the panoramic image, the direction and distance of the drag operation are acquired, and the display image of the panoramic image is adjusted according to the direction and distance of the drag operation; when the control device When the zoom gesture of the user for the panoramic image is detected, the panoramic image is enlarged, or the spherical panoramic image or the 360 panoramic image is expanded into a planar panoramic image, as shown in FIG. 9 , and FIG. 9 is the spherical panoramic image or 360 is a schematic diagram after the panoramic image is expanded into a planar panoramic image; when the control device detects the user's zoom-out gesture for the panoramic image, the panoramic image is reduced.
  • the control device first receives the captured image set sent by the mobile platform for the target object, and then if the first operation for the captured image set is detected, processes the captured image according to the first operation to generate the target object.
  • a panoramic image and finally a panoramic image.
  • the panoramic image can be automatically generated according to the captured image set of the target object, thereby improving the efficiency of generating the panoramic image.
  • the user can preview the panoramic shooting effect through the control device, and the timeliness is high.
  • FIG. 10 is a schematic flowchart diagram of still another image processing method according to an embodiment of the present application.
  • the image processing method described in the embodiment of the present application includes:
  • the control device acquires operation information of the user for the control device.
  • the control device sends a panoramic shooting instruction to the mobile platform.
  • the control device first acquires first operation information of the user for the control device; and then sends a panoramic shooting instruction to the mobile platform according to the first operation information.
  • the first operation information may be click information of a user's panoramic shooting button for the control device.
  • control device first acquires second operation information of the user for the control device, and then sends instruction information to the mobile platform according to the second operation information, where the instruction information includes panoramic position information and a panoramic shooting instruction.
  • the mobile platform acquires a panoramic shooting instruction.
  • the mobile platform receives a panoramic shooting instruction sent by the control device.
  • the mobile platform first receives instruction information sent by the control device, where the instruction information includes panoramic location information and a panoramic shooting instruction; and then controls the mobile platform to move to the panoramic position according to the panoramic location information included in the instruction information; further, detecting the mobile platform Whether it is in the panoramic position, when detecting that the mobile platform is in the panoramic position, the panoramic shooting instruction included in the instruction information is acquired.
  • the mobile platform adjusts a current posture of the photographing device to a preset posture according to the panoramic shooting instruction.
  • the photographing device is disposed on the mobile platform, and the preset posture of the photographing device includes the first posture and the second posture.
  • the mobile platform After acquiring the panoramic shooting instruction, the mobile platform adjusts the current posture of the photographing device to the first posture or the second posture in response to the panoramic shooting instruction.
  • the mobile platform controls the shooting device to shoot the target object in a preset shooting direction of the preset posture, to obtain a captured image set.
  • the preset shooting direction includes a first shooting direction and a second shooting direction.
  • the first photographing direction is upward and a third preset angle with the horizontal direction.
  • the second photographing direction is downward and at a fourth preset angle with the vertical direction.
  • the mobile platform first controls the photographing device to be in the first posture, and controls the photographing device to photograph the target object in the first photographing direction to obtain a first image set of the target object; and then controls the photographing device to be in the second posture, And controlling the photographing device to photograph the target object in the second photographing direction to obtain a second image set of the target object.
  • S1006 The mobile platform sends the captured image set to the control device.
  • the mobile platform sends the first image set and the second image set of the target object to the control device.
  • the first set of images and the second set of images can be used to generate a panoramic image of the target object.
  • the control device receives the captured image set sent by the mobile platform for the target object.
  • control device detects the first operation for the captured image set, the captured image set is processed according to the first operation to generate a panoramic image of the target object.
  • the first operation may be a click operation for capturing a collection of images.
  • the control device first performs projection transformation on each image in the image set, and then the control device acquires valid feature matching points of each image in the image set. And performing image stitching on each image in the image set according to the obtained effective feature matching points to obtain a panoramic view of the target object.
  • the control device displays a panoramic image.
  • control device may be a remote control device or a mobile terminal; the mobile platform may be a drone.
  • the control device first acquires the operation information of the user, and sends a panoramic shooting instruction to the mobile platform according to the operation information; then, after the mobile platform acquires the panoramic shooting instruction, the preset shooting direction of the shooting device in the preset posture is controlled.
  • the target object is photographed, a captured image set is obtained, and the captured image set is transmitted to the control device; then the control device generates and displays a panoramic image of the target object after detecting the first operation for the captured image set.
  • the image collection of the target object can be automatically captured according to the panoramic shooting instruction, and the panoramic image can be automatically generated according to the image collection, thereby improving the efficiency of generating the panoramic image.
  • FIG. 11 is a schematic structural diagram of a mobile platform according to an embodiment of the present disclosure.
  • the mobile platform described in the embodiment of the present application includes: a processor 1101, a communication interface 1102, and a memory 1103.
  • the processor 1101, the communication interface 1102, and the memory 1103 can be connected by using a bus or other means.
  • the embodiment of the present application is exemplified by a bus connection.
  • the processor 1101 may be a central processing unit (CPU), a network processor (NP), or a combination of a CPU and an NP.
  • the processor 1101 may also be a core for implementing communication identity binding in a multi-core CPU or a multi-core NP.
  • the processor 1101 described above may be a hardware chip.
  • the hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof.
  • the PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a general array logic (GAL), or any combination thereof.
  • the communication interface 1102 described above can be used for transceiving information or signaling interactions, as well as receiving and transmitting signals.
  • the memory 1103 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, a storage program required for at least one function (such as a text storage function, a location storage function, etc.); the storage data area may be stored according to Data created by the use of the mobile platform (such as image data, text data), etc., and may include application storage programs and the like. Further, the memory 1103 may include a high speed random access memory, and may also include a nonvolatile memory such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
  • the above memory 1103 is also used to store program instructions.
  • the processor 1101 described above can call the program instructions stored in the memory 1103 to implement the image processing method shown in FIG. 1. specifically:
  • the processor 1101 is configured to acquire a panoramic shooting instruction.
  • the processor 1101 is further configured to adjust a current posture of the photographing device to a preset posture according to the panoramic photographing instruction, and the photographing device is disposed on the mobile platform;
  • the processor 1101 is further configured to control the shooting device to capture the target object in a preset shooting direction of the preset posture, to obtain a captured image set;
  • the communication interface 1102 is configured to send the captured image set to a control device of the mobile platform.
  • the processor 1101 is further configured to filter, in the captured image set, a preset number of target images that meet preset conditions;
  • the communication interface 1102 is specifically configured to send the target image to the control device of the mobile platform.
  • the processor 1101 filters, in the captured image set, a preset number of target images that meet the preset condition, by filtering matching features in the captured image set according to the matching feature points of the adjacent images. A predetermined number of target images meeting the first requirement.
  • the specific method for the processor 1101 to filter the preset number of target images that meet the preset condition in the captured image set is: screening the overlapping regions in the captured image set according to the overlapping regions of the adjacent images. The second required number of target images.
  • the preset posture includes a first posture and a second posture
  • the preset shooting direction includes a first shooting direction and a second shooting direction
  • the processor 1101 is specifically configured to:
  • the communication interface 1102 is specifically configured to send the first image set and the second image set to a control device of the mobile platform.
  • the processor 1101 is specifically configured to:
  • the shooting device is controlled to rotate the target object in a second preset direction to obtain a second image set in the second shooting direction.
  • the processor 1101 is specifically configured to:
  • the mobile platform is controlled to rotate in a second preset direction, and after each second rotation of the mobile platform, the shooting device is controlled to shoot the target object to obtain a second image set in the second shooting direction.
  • the processor 1101 is specifically configured to: control the carrier of the mobile platform to rotate in a first preset direction, and control the shooting device to shoot the target object after each rotation of the first preset angle of the carrier, a first image set of the first shooting direction, the photographing device is supported on the carrier;
  • the control carrier rotates in the second preset direction, and after the second preset angle of the carrier is rotated, the shooting device is controlled to shoot the target object to obtain a second image set in the second shooting direction.
  • the first preset angle and the second preset angle are no more than 45 degrees.
  • the angle at which the shooting device rotates is at least 360 degrees.
  • the photographing device when the angle at which the photographing device rotates and photographs is greater than 360 degrees, the photographing device has different starting photographing directions at each 360-degree rotation circle.
  • the preset posture further includes a third posture
  • the preset shooting direction further includes a third shooting direction
  • the processor 1101 is further configured to:
  • the communication interface 1102 is specifically configured to send the first image set, the second image set, and the third image set to a control device of the mobile platform.
  • the first photographing direction when the photographing device is in the first posture, the first photographing direction is upward and is at a third preset angle with the horizontal direction; when the photographing device is in the second posture, the second photographing direction is downward and A fourth preset angle with the vertical direction; when the photographing device is in the third posture, the third photographing direction is a vertical direction and faces downward.
  • the third predetermined angle is 0 degrees to 10 degrees.
  • the first photographing direction when the photographing device is in the first posture, the first photographing direction is a horizontal direction; when the photographing device is in the second posture, the second photographing direction is downward and a fifth preset angle with the vertical direction; When the photographing device is in the third posture, the third photographing direction is the vertical direction and faces downward.
  • the communication interface 1102 is further configured to: receive a panoramic shooting instruction sent by a control device of the mobile platform.
  • the communication interface 1102 is further configured to: receive instruction information sent by a control device of the mobile platform, where the instruction information includes panoramic location information and a panoramic shooting instruction;
  • the processor 1101 is further configured to: detect whether the mobile platform is located at a position indicated by the panoramic position information; if yes, acquire a panoramic shooting instruction in the instruction information.
  • control device includes a remote control device or a mobile terminal; the mobile platform is a drone.
  • the processor 1101, the communication interface 1102, and the memory 1103 described in the embodiment of the present application may be implemented on the mobile platform side described in an image processing method provided by the embodiment of the present application, and no longer Narration.
  • a panoramic shooting instruction is first acquired, and the current posture of the shooting device is adjusted to a preset posture according to the acquired panoramic shooting instruction, and then the shooting device is controlled to shoot the target object in a preset shooting direction of the preset posture.
  • the captured image set is obtained, and finally the captured image set is sent to the control device of the mobile platform; in the above manner, the image set of the target object can be automatically captured according to the panoramic shooting instruction, thereby improving the acquisition efficiency of the captured image set.
  • FIG. 12 is a schematic structural diagram of a control device according to an embodiment of the present application.
  • the control device described in the embodiment of the present application includes: a user interface 1201, a display screen 1202, a processor 1203, a communication interface 1204, and a memory 1205, the user interface 1201, the display screen 1202, the processor 1203, the communication interface 1204, and the memory.
  • the 1205 can be connected via a bus or otherwise.
  • the processor 1203 may be a central processing unit (CPU), a network processor (NP), a graphics processing unit (GPU), or a combination of a CPU, a GPU, and an NP.
  • the processor 1203 may also be a core for implementing communication identity binding in a multi-core CPU, a multi-core GPU, or a multi-core NP.
  • the communication interface 1204 can be used for transceiving information or signaling interactions, as well as receiving and transmitting signals. In particular, the communication interface 1204 can communicate with the network and the signal transmitting device via wireless communication and receive data of the signal transmitting device.
  • the user interface 1201 can be used to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the control device.
  • the user interface 1201 described above may include a touch panel and other input devices.
  • a touch panel also referred to as a touch screen, can collect touch operations on or near the user (such as the user using a finger, a stylus, or the like, any suitable object or accessory on or near the touch panel).
  • the corresponding connecting device is driven according to a preset program.
  • Other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.
  • Display 1202 can be used to display information entered by the user or information provided to the user as well as various menus of the control device.
  • the display screen 1202 can be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like.
  • the memory 1205 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, a storage program required for at least one function (such as a text storage function, a location storage function, etc.); the storage data area may be stored according to Control data generated by the use of the device (such as image data, text data), etc., and may include a network communication module, a user interface module, an application storage program, and the like.
  • the above memory 1205 is also used to store program instructions.
  • the processor 1203 can call the program instructions stored in the memory 1205 to implement the image processing method shown in FIG. specifically:
  • a communication interface 1204 configured to receive a captured image set sent by the mobile platform for the target object
  • the processor 1203 is configured to: if the first operation for the captured image set is detected, process the captured image set according to the first operation to generate a panoramic image of the target object;
  • a display screen 1202 for displaying a panoramic image is shown.
  • the processor 1203 is further configured to acquire first operation information of the user for the control device;
  • the communication interface 1204 is further configured to send a panoramic shooting instruction to the mobile platform according to the first operation information.
  • the processor 1203 is further configured to acquire second operation information of the user for the control device;
  • the communication interface 1204 is further configured to send the instruction information to the mobile platform according to the second operation information, where the instruction information includes the panoramic position information and the panoramic shooting instruction.
  • the processor 1203 is configured to acquire the panoramic location information input by the user, and the communication interface 1204 is specifically configured to send the instruction information to the mobile platform according to the panoramic location information.
  • the processor 1203 is configured to acquire the touch information of the user for displaying the map, and determine the panoramic location information according to the touch information.
  • the communication interface 1204 is specifically configured to send the mobile terminal according to the panoramic location information. Instruction information.
  • the processor 1203 is further configured to:
  • the processor 1203 is further configured to: acquire environment information of the panoramic location according to the panoramic location information; and perform a shooting prompt according to the environmental information.
  • the processor 1203 is further configured to: if the second operation for the panoramic image is detected, switch the browsing mode of the panoramic image.
  • the browsing mode includes a manual browsing mode and a somatosensory browsing mode.
  • display 1202 is also used to:
  • the first prompt information is output, and the first prompt information is used to prompt the user to adjust the posture of the control device.
  • the prompt duration of the first prompt information is 1.5 seconds to 3 seconds.
  • the processor 1203 is further configured to: when the posture of the control device changes, turn off the first prompt information.
  • the processor 1203 is further configured to: acquire the posture information of the control device when the browsing mode of the panoramic image is the somatosensory browsing mode;
  • the display screen of the panoramic image is adjusted according to the posture information.
  • the processor 1203 is further configured to: when the browsing mode of the panoramic image is the manual browsing mode, acquire manual operation information for the panoramic image;
  • the display screen of the panoramic image is adjusted according to the manual operation information.
  • the manual operation information includes touch information and/or gesture information.
  • the processor 1203 is further configured to: store a captured image set.
  • the processor 1203 is specifically configured to: store the captured image set by using a preset identifier.
  • the display screen 1202 is further configured to output second prompt information, where the second prompt information is used to prompt the user to select a generation mode of the panoramic image;
  • a user interface 1201 configured to receive a selection instruction input by the user for the second prompt information
  • the processor 1203 is specifically configured to process the captured image set according to the first operation and the selection instruction to generate a panoramic image of the target object.
  • the generation mode includes a spherical panoramic image generation mode and a 360 degree panoramic image generation mode.
  • the display screen 1202 is further configured to hide or display a menu bar of the display interface of the panoramic image if the third operation for the panoramic image is detected.
  • the display screen 1202 is further configured to output a waiting prompt for loading the panoramic image during the process of generating the panoramic image.
  • the waiting prompt includes a preset icon and/or a preset font
  • the control device includes a remote control device or a mobile terminal
  • the mobile platform is a drone.
  • the user interface 1201, the display screen 1202, the processor 1203, the communication interface 1204, and the memory 1205 described in the embodiment of the present application may be configured as described in the image processing method provided by the embodiment of the present application. The implementation method will not be described here.
  • the captured image set for the target object sent by the mobile platform is first received, and then if the first operation for the captured image set is detected, the captured image is processed according to the first operation to generate a panoramic image of the target object. Finally, the panoramic image is displayed. In the above manner, the panoramic image can be automatically generated according to the captured image set of the target object, thereby improving the efficiency of generating the panoramic image.
  • FIG. 13 is a schematic structural diagram of an image processing system according to an embodiment of the present application.
  • the image processing system described in the embodiment of the present application includes:
  • the control device 1301 is configured to acquire operation information of the user for the control device.
  • the control device 1301 is further configured to send a panoramic shooting instruction to the mobile platform 1302 according to the operation information.
  • the mobile platform 1302 is configured to acquire a panoramic shooting instruction.
  • the mobile platform 1302 is further configured to adjust a current posture of the photographing device to a preset posture according to the panoramic photographing instruction.
  • the mobile platform 1302 is further configured to control the shooting device to capture the target object in a preset shooting direction of the preset posture, to obtain a captured image set.
  • the mobile platform 1302 is further configured to send the captured image set to the control device.
  • the control device 1301 is further configured to receive a captured image set for the target object that is sent by the mobile platform.
  • the control device 1301 is further configured to: if the first operation for the captured image set is detected, process the captured image set according to the first operation to generate a panoramic image of the target object.
  • the control device 1301 is further configured to display a panoramic image.
  • control device 1301 and the mobile platform 1302 in the embodiments of the present application may be specifically implemented according to the method in the foregoing method embodiment, and the specific implementation process may refer to the related description of the foregoing method embodiment, and details are not described herein again. .
  • the control device first acquires the operation information of the user, and sends a panoramic shooting instruction to the mobile platform according to the operation information; then, after the mobile platform acquires the panoramic shooting instruction, the preset shooting direction of the shooting device in the preset posture is controlled.
  • the target object is photographed, a captured image set is obtained, and the captured image set is transmitted to the control device; then the control device generates and displays a panoramic image of the target object after detecting the first operation for the captured image set.
  • the image collection of the target object can be automatically captured according to the panoramic shooting instruction, and the panoramic image can be automatically generated according to the image collection, thereby improving the efficiency of generating the panoramic image.
  • the computer readable storage medium may be stored in a computer readable storage medium, where the computer readable storage medium stores a computer program, and the computer readable storage medium is stored on the mobile platform side or the control device side.
  • the program is executed by the processor, the various step flows described in the above corresponding method embodiments may be implemented.
  • the program may be stored in a computer readable storage medium, and the storage medium may include: Flash disk, Read-Only Memory (ROM), Random Access Memory (RAM), disk or optical disk.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)

Abstract

一种图像处理方法、移动平台、控制设备及系统,其中方法包括:获取全景拍摄指令;根据全景拍摄指令调整拍摄设备的当前姿态为预设姿态,拍摄设备设于移动平台上;控制拍摄设备在预设姿态的预设拍摄方向对目标对象进行拍摄,得到拍摄图像集合;将拍摄图像集合发送至移动平台的控制设备,拍摄图像集合用于生成全景图像。通过本申请实施例可以根据全景拍摄指令自动拍摄得到目标对象的图像集合,且可以根据图像集合自动生成全景图像,从而提高生成全景图像的效率。

Description

一种图像处理方法、移动平台、控制设备及系统 技术领域
本申请涉及图像技术领域,尤其涉及一种图像处理方法、移动平台、控制设备及系统。
背景技术
随着社会的发展,为满足人们对于图像表现形式的多样性的需求,全景图像应运而生,全景图像目前广泛应用于人们的生活中。
现有技术中,首先需要通过采集多张图像素材,然后利用个人计算机和图像处理软件对采集到的图像素材进行手动加工,得到全景图像。但是,采用上述方式生成全景图像时,图像素材采集程序复杂,且不能在采集到图像素材后快速生成全景图像,需要用户对采集到的图像素材进行手动加工,手动加工浪费时间,全景图像生成效率低。
发明内容
本申请实施例提供了一种图像处理方法、移动平台、控制设备及系统,可以根据全景拍摄指令自动拍摄得到目标对象的图像集合,且可以根据图像集合自动生成全景图像,从而提高生成全景图像的效率。
本申请实施例第一方面提供了一种图像处理方法,应用于移动平台,包括:
获取全景拍摄指令;
根据全景拍摄指令调整拍摄设备的当前姿态为预设姿态,拍摄设备设于移动平台上;
控制拍摄设备在预设姿态的预设拍摄方向对目标对象进行拍摄,得到拍摄图像集合;
将拍摄图像集合发送至移动平台的控制设备。
本申请实施例第二方面提供了另一种图像处理方法,应用于移动平台的控制设备,包括:
接收移动平台发送的针对目标对象的拍摄图像集合;
若检测到针对拍摄图像集合的第一操作,则根据第一操作对拍摄图像进行处理,生成目标对象的全景图像;
显示全景图像。
本申请实施例第三方面提供了一种移动平台,包括:处理器和通信接口,
处理器,用于获取全景拍摄指令;
处理器,还用于根据全景拍摄指令调整拍摄设备的当前姿态为预设姿态,拍摄设备设于移动平台上;
处理器,还用于控制拍摄设备在预设姿态的预设拍摄方向对目标对象进行拍摄,得到拍摄图像集合;
通信接口,用于将拍摄图像集合发送至移动平台的控制设备。
本申请实施例第四方面提供了一种控制设备,包括:处理器、通信接口和显示屏,
通信接口,用于接收移动平台发送的针对目标对象的拍摄图像集合;
处理器,用于若检测到针对拍摄图像集合的第一操作,则根据第一操作对拍摄图像进行处理,生成目标对象的全景图像;
显示屏,用于显示全景图像。
本申请实施例第五方面提供了一种图像处理系统,系统包括:上述第三方面的移动平台和上述第四方面的控制设备。
本申请实施例第六方面提供了一种计算机可读存储介质,计算机可读存储介质中存储有计算机程序,计算机程序被处理器执行时实现上述第一方面提供的方法的步骤。
本申请实施例第七方面提供了一种计算机可读存储介质,计算机可读存储介质中存储有计算机程序,计算机程序被处理器执行时实现上述第二方面提供的方法的步骤。
本申请实施例中,首先获取全景拍摄指令,并根据获取到的全景拍摄指令调整拍摄设备的当前姿态为预设姿态,然后控制该拍摄设备在预设姿态的预设拍摄方向对目标对象进行拍摄,得到拍摄图像集合,最后将该拍摄图像集合发送至移动平台的控制设备,其中,该拍摄图像集合用于生成全景图像;采用上述方式,可以根据全景拍摄指令自动拍摄得到目标对象的图像集合,且可以根 据图像集合自动生成全景图像,从而提高生成全景图像的效率。
附图说明
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。
图1是本申请实施例提供的一种图像处理方法的流程示意图;
图2是本申请实施例提供的一种全景拍摄的示意图;
图3是本申请实施例提供的另一种图像处理方法的流程示意图;
图4是本申请实施例提供的一种与拍摄图像集合关联的图标的示意图;
图5是本申请实施例提供的一种加载全景图像的等待提示的示意图;
图6是本申请实施例提供的一种全景图像显示界面的示意图;
图7是本申请实施例提供的另一种全景图像显示界面的示意图;
图8是本申请实施例提供的一种提示信息的示意图;
图9是本申请实施例提供的又一种全景图像显示界面的示意图;
图10是本申请实施例提供的又一种图像处理方法的流程示意图;
图11是本申请实施例提供的一种移动平台的结构示意图;
图12是本申请实施例提供的一种控制设备的结构示意图;
图13是本申请实施例提供的一种图像处理系统的结构示意图。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述。
请参阅图1,图1为本申请实施例提供的一种图像处理方法的流程示意图。本申请实施例中所描述的图像处理方法,包括:
S101、移动平台获取全景拍摄指令。
本申请实施例中,移动平台可以是无人机。以移动平台为无人机为例进行说明:
移动平台获取全景拍摄指令的具体方式为:移动平台接收移动平台的控制设备发送的全景拍摄指令。其中,该全景拍摄指令可以是控制设备获取到用户的第一操作信息后向移动平台发送的。该第一操作信息可以是用户针对控制设备的全景拍摄按钮的诸如点击信息,该全景拍摄按钮可以是物理的,也可以是虚拟的,本申请实施例不做限定。
在一些可行的实施方式中,移动平台获取全景拍摄指令的具体方式为:移动平台首先接收移动平台的控制设备发送的指令信息,该指令信息包括全景位置信息和全景拍摄指令;然后根据该指令信息中包括的全景位置信息控制移动平台移动到全景位置;进一步地,检测移动平台是否位于全景位置,当检测到移动平台位于全景位置时,获取该指令信息中包括的全景拍摄指令。其中,该指令信息可以是控制设备获取到用户的第二操作信息后,根据该第二操作信息向移动平台发送的。该第二操作信息可以是用户针对控制设备输入全景位置信息,该全景位置信息包括全景拍摄位置的坐标值和海拔等信息,全景拍摄位置的坐标值和海拔等信息可以是用户手动输入的,也可以是控制设备通过获取用户针对显示地图的触控信息,并根据该触控信息确定得到的。
需要说明的是,移动平台获取全景拍摄指令的方式除了上述说明的内容,还可以是其他方式,本申请实施例不做限定。
S102、移动平台根据全景拍摄指令调整拍摄设备的当前姿态为预设姿态。
本申请实施例中,拍摄设备(例如照相机或摄像机)设于移动平台上,且可以支撑于移动平台的载体上,移动平台的载体可以是云台设备。其中,拍摄设备的预设姿态可以包括第一姿态和第二姿态。移动平台获取到全景拍摄指令之后,可以响应该全景拍摄指令将拍摄设备的当前姿态调整为第一姿态或者第二姿态。
需要说明的是,拍摄设备的预设姿态可以为一种姿态,还可以包括除上述说明的第一姿态和第二姿态以外的其他姿态,只要能得到够用于生成全景图像的拍摄图像集合即可,本申请实施例不做限定。
S103、移动平台控制拍摄设备在预设姿态的预设拍摄方向对目标对象进行拍摄,得到拍摄图像集合。
本申请实施例中,与预设姿态对应的预设拍摄方向可以包括第一拍摄方向 和第二拍摄方向。其中,当拍摄设备处于第一姿态时,第一拍摄方向为朝上且与水平方向成第三预设角度,该第三预设角度可以为诸如0度至10度。当拍摄设备处于第二姿态时,第二拍摄方向为朝下且与垂直方向成第四预设角度,该第四预设角度可以为诸如35度至55度。
在一些可行的实施方式中,当拍摄设备处于第一姿态时,第一拍摄方向为水平方向。当拍摄设备处于第二姿态时,第二拍摄方向为朝下且与垂直方向成第五预设角度,该第五预设角度可以为诸如45度。需要说明的是,第四预设角度和第五预设角度也可以是其他角度,本申请实施例不做限定;可选的,第四预设角度和第五预设角度可以相应地使得拍摄设备在第一拍摄方向上拍摄的图像与拍摄设备在第二拍摄方向上拍摄的图像具有一定(例如百分之十五至百分之三十五)的重叠区域即可。
本申请实施例中,移动平台首先控制该拍摄设备处于第一姿态,并控制该拍摄设备在第一拍摄方向对目标对象进行拍摄,得到目标对象的第一图像集合;然后控制该拍摄设备处于第二姿态,并控制该拍摄设备在第二拍摄方向对目标对象进行拍摄,得到目标对象的第二图像集合。其中,也可以是移动平台首先控制该拍摄设备处于第二姿态,并控制该拍摄设备在第二拍摄方向对目标对象进行拍摄,得到第二图像集合;然后控制该拍摄设备处于第一姿态,并控制该拍摄设备在第一拍摄方向对目标对象进行拍摄,得到第一图像集合。
其中,移动平台控制拍摄设备在第一拍摄方向对目标对象进行拍摄,得到第一图集合的具体方式为:移动平台控制该拍摄设备按第一预设方向对目标对象进行旋转拍摄,得到第一拍摄方向的第一图像集合。其中,第一预设方向可以是顺时针方向,也可以是逆时针方向。
具体地,移动平台可以控制移动平台自身按第一预设方向旋转,从而带动拍摄设备按第一预设方向旋转,并在移动平台每旋转第一预设角度后,控制该拍摄设备针对目标对象进行至少一次拍摄,待拍摄设备针对目标对象旋转拍摄完毕后,得到第一拍摄方向的第一图像集合。或者,移动平台控制移动平台自身保持不动,控制移动平台的载体按第一预设方向旋转,从而带动拍摄设备按第一预设方向旋转,并在该载体每旋转第一预设角度后,控制该拍摄设备针对目标对象进行至少一次拍摄,从而得到第一拍摄方向的第一图像集合。
其中,移动平台控制拍摄设备在第二拍摄方向对目标对象进行拍摄,得到第二图像集合的具体方式为:移动平台控制该拍摄设备按第二预设方向对目标对象进行旋转拍摄,得到第二拍摄方向的第二图像集合。其中,第二预设方向可以是顺时针方向,也可以是逆时针方向。
具体地,移动平台控制移动平台自身按第二预设方向旋转,从而带动拍摄设备按第二预设方向旋转,并在移动平台每旋转第二预设角度后,控制该拍摄设备针对目标对象进行至少一次拍摄,待拍摄设备针对目标对象旋转拍摄完毕后,得到第二拍摄方向的第二图像集合。或者,移动平台控制移动平台自身保持不动,控制移动平台的载体按第二预设方向旋转,从而带动拍摄设备按第二预设方向旋转,并在该载体每旋转第二预设角度后,控制该拍摄设备针对目标对象进行至少一次拍摄,从而得到第二拍摄方向的第二图像集合。
本申请实施例中,第一预设角度和第二预设角度可以均不大于45度,以获取具有重叠区域的多张照片进行全景图像的生成。进一步的,移动平台控制该拍摄设备按第一预设方向对目标对象进行旋转拍摄时,以及移动平台控制该拍摄设备按第二预设方向对目标对象进行旋转拍摄时的旋转角度可以至少为360度,从而不会漏拍掉目标对象的画面,且能够进行图像筛选,加强全景图像的生成效果。
在一些可行的实施方式中,当移动平台控制拍摄设备针对目标对象进行旋转拍摄时的旋转角度大于360度时,拍摄设备在每一360度旋转圈的起始拍摄方向不同。举例来说,假设移动平台控制拍摄设备进行旋转拍摄时的旋转角度为720度,且首先控制拍摄设备按顺时针方向在正东方开始进行旋转拍摄,则待拍摄设备旋转了360度后,移动平台可以控制拍摄设备在东偏北10度开始按逆时针方向或顺时针方向开始进行旋转拍摄。
需要说明的是,本申请实施例中,拍摄图像集合中的部分图像或全部图像可以有重叠区域或者图像内容相邻,但拍摄图像集合中的部分图像或全部图像可以用来合成全景图像,此处说明之后,在后面即不再重复限定。
S104、移动平台将拍摄图像集合发送至移动平台的控制设备。
本申请实施例中,移动平台将目标对象的第一图像集合和第二图像集合发送给移动平台的控制设备。该第一图像集合和第二图像集合可以用于生成目标 对象的全景图像。
在一些可行的实施方式中,移动平台获取到目标对象的第一图像集合和第二图像集合之后,首先在该第一图像集合和该第二图像集合中筛选出满足预设条件的预设数量的目标图像。具体地,移动平台根据相邻图像的匹配特征点,在第一图像集合和第二图像集合中筛选出匹配特征点符合第一要求的预设数量的目标图像,例如,相邻a、b图像之间有间隙时,可以在其它图像中筛选出存在同样特征点的图像来补上间隙部分,即假设a图像右侧有5个特征点,b图像左侧有4个特征点,可以筛选出包括上述9个特征点的c图像来补上a、b之间的间隙。或者,移动平台根据相邻图像的重叠区域,在第一图像集合和第二图像集合中筛选出重叠区域符合第二要求的预设数量的目标图像,例如,相邻a、b图像之间有间隙时,可以在其它图像中筛选出包括间隙部分的图像来补上间隙部分,即当c图像分别与a、b图像的重叠区域最大时,可以筛选出c图像来补上a、b之间的间隙。其中,该预设数量的目标图像包括目标对象的所有画面,该预设数量例如可以是至少17张。然后,移动平台将筛选出的预设数量的目标图像发送至移动平台的控制设备,该预设数量的目标图像可以用于生成目标对象的全景图像。
在一些可行的实施方式中,拍摄设备的预设姿态还可以包括第三姿态,相应的,预设拍摄方向还可以包括第三拍摄方向,当拍摄设备处于第三姿态时,第三拍摄方向为垂直方向且朝下。移动平台在获取到全景拍摄指令之后,或者在得到目标对象的第一图像之后,或者在得到目标对象的第二图像之后,或者在得到目标对象的第一图像和第二图像后,移动平台控制拍摄设备处于第三姿态,并控制拍摄设备在第三拍摄方向对目标对象进行至少一次拍摄,得到目标对象的第三图像集合。移动平台将拍摄图像集合发送至移动平台的控制设备的具体方式为:移动平台将目标对象的第一图像集合、第二图像集合和第三图像集合发送至移动平台的控制设备,该第一图像集合、第二图像集合和第三图像集合可以用于生成目标对象的全景图像。
举例来说,请一并参见图2,图2为拍摄设备针对目标对象进行旋转拍摄的示意图。移动平台获取到全景拍摄指令之后,首先控制拍摄设备针对目标对象进行水平方向上的360度旋转拍摄,具体地,移动平台控制拍摄设备以顺时针 或者逆时针方向每旋转第一预设角度(例如45度)后,针对目标对象拍摄至少一张图像,从而可以保证左右相邻图像间有百分之三十左右的内容是重合的,直至360度旋转拍摄完成,得到第一图像集合。然后,控制拍摄设备针对目标对象进行斜下方的360度旋转拍摄,具体地,移动平台控制拍摄设备的拍摄方向为朝下且与垂直方向成第五预设角度(例如45度),并控制拍摄设备以顺时针或者逆时针方向每旋转第二预设角度(例如45度)后,针对目标对象拍摄至少一张图像,从而可以保证左右相邻图像间有百分之三十左右的内容是重合的,也可以保证与水平拍摄的相邻图像间有百分之三十左右的内容是重合的,直至360度旋转拍摄完成,得到第二图像集合。最后,控制拍摄设备垂直朝下针对目标对象拍摄至少一张照片,得到第三图像集合。采用上述方式,拍摄角度调整更加精确,移动平台可以根据全景拍摄指令自动拍摄得到目标对象的图像集合,且该图像集合中的图像的匹配特征点较多,相邻图像之间的重叠区域也较大,图像拼接效果好,根据该图像集合可以生成理想的全景图像。
本申请实施例中,首先获取全景拍摄指令,并根据获取到的全景拍摄指令调整拍摄设备的当前姿态为预设姿态,然后控制该拍摄设备在预设姿态的预设拍摄方向对目标对象进行拍摄,得到拍摄图像集合,最后将该拍摄图像集合发送至移动平台的控制设备;采用上述方式,可以根据全景拍摄指令自动拍摄得到目标对象的图像集合,无需用户手动调整拍摄方向与角度,从而提高拍摄图像集合的获取效率。
请参阅图3,图3为本申请实施例提供的另一种图像处理方法的流程示意图。本申请实施例中所描述的图像处理方法,包括:
S301、控制设备接收移动平台发送的针对目标对象的拍摄图像集合。
本申请实施例中,控制设备可以是遥控设备或移动终端,移动平台可以是无人机,本申请实施例以移动平台为无人机为例进行说明。基于移动平台的拍摄方向的不同或对图像的筛选处理,控制设备接收到的拍摄图像集合可以是目标对象的第一图像集合和第二图像集合;也可以是目标对象的第一图像集合、第二图像集合和第三图像集合;还可以是满足预设条件的预设数量的目标图像。其中,第一拍摄图像集合是移动平台控制移动平台的拍摄设备处于第一姿态,并控制该拍摄设备在第一拍摄方向对目标对象进行拍摄得到的;第二拍摄 图像集合是移动平台控制该拍摄设备处于第二姿态,并控制该拍摄设备在第二拍摄方向对目标对象进行拍摄得到的;第三拍摄图像集合是移动平台控制该拍摄设备处于第三姿态,并控制拍摄设备在第三拍摄方向对目标对象进行拍摄得到的。目标图像是移动平台根据相邻图像的匹配特征点或者重叠区域从第一图像集合和第二图像集合筛选出来的,或者是移动平台根据相邻图像的匹配特征点或者重叠区域从第一图像集合、第二图像集合和第三图像集合中筛选出来的。
在一些可行的实施方式中,控制设备在接收移动平台发送的针对目标对象的拍摄图像集合之前,首先获取用户针对控制设备的第一操作信息;然后根据该第一操作信息向移动平台发送全景拍摄指令,该全景拍摄指令用于指示移动平台针对目标对象进行全景拍摄,得到拍摄图像集合。该第一操作信息可以是用户针对控制设备的全景拍摄按钮的诸如点击信息,该全景拍摄按钮可以是物理的,也可以是虚拟的。
在一些可行的实施方式中,控制设备在接收移动平台发送的针对目标对象的拍摄图像集合之前,首先获取用户针对控制设备的第二操作信息;然后根据第二操作信息向移动平台发送指令信息,该指令信息包括全景位置信息和全景拍摄指令。具体地,控制设备获取用户输入的全景位置信息,然后将全景位置信息和全景拍摄指令携带在指令信息中发送给移动平台。或者,控制设备获取用户针对控制设备的显示界面所显示的地图的触控信息,并根据该触控信息确定全景位置信息,然后将全景位置信息和全景拍摄指令携带在指令信息中发送给移动平台。其中,该全景位置信息包括全景拍摄位置的坐标值和海拔等信息。该指令信息用于指示移动平台移动到全景拍摄位置后,响应全景拍摄指令针对目标对象进行全景拍摄,得到拍摄图像集合。
需要说明的是,控制设备也可以是在获取到用户的其他操作信息之后,如语音指令,以其他形式将全景拍摄指令发送给移动平台,本申请实施例不做限定。
在一些可行的实施方式中,控制设备获取到全景位置信息之后,在向移动平台发送指令信息之前,可以首先根据该全景位置信息获取该全景位置的全景图像样本,然后根据该全景图像样本进行拍摄提示。具体地,示例性的,控制 设备首先从云端服务器获取该全景位置的最好的全景图像样本和最差的全景图像样本,并显示该全景位置的最好的全景图像样本和最差的全景图像样本,以使得用户根据该全景位置的最好的全景图像样本和最差的全景图像样本判断是否在该全景位置处进行全景拍摄。控制设备然后输出拍摄提示信息,该拍摄提示信息用于提示用户是否在该全景位置处进行全景拍摄;当控制设备接收到用户针对该拍摄提示信息输入的确定指令,将该指令信息发送给移动平台。其中,该全景位置的最好的全景图像样本和最差的全景图像样本可以是根据多个用户的综合评价得到的。
需要说明的是,控制设备也可以通过其他方式获取该全景位置的全景图像样本,同时,控制设备获取到的该全景位置的全景图像样本除了最好或最差的全景图像样本之外,也可以是其他类型的全景图像,可以根据具体相应进行设置,本申请实施例不做限定。
在一些可行的实施方式中,控制设备获取到全景位置信息之后,在向移动平台发送指令信息之前,可以首先获取全景位置的环境信息,然后根据该环境信息进行拍摄提示。具体地,控制设备可以通过互联网获取到全景位置的环境信息,也可以通过移动平台采集的全景位置所处环境的至少一张图像获取到全景位置的环境信息。其中,该全景位置的环境信息包括气候、季节、光线等信息。控制设备根据获取到的该全景位置的环境信息输出拍摄提示信息,该拍摄提示信息用于提示用户进行拍摄模式的调整等操作,还可以用于提示用户是否在该全景位置处进行全景拍摄;当控制设备接收到用户针对该拍摄提示信息输入的确定指令,将该指令信息发送给移动平台。
在一些可行的实施方式中,控制设备接收到移动平台发送的针对目标对象的拍摄图像集合之后,可以归档存储该拍摄图像集合,如将该拍摄图像集合存储到一个文件夹或者相册中;进一步地,控制设备可以利用预设标识存储该目标对象的拍摄图像集合。其中,该预设标识为全景图像标识,该全景图像标识用于提示用户该全景图像标识对应的图像集合可以用于生成全景图像,以区别于其它的普通图像。更进一步的,控制设备的显示界面可以包括与归档存储的拍摄图像集合相关联的图标,该图标可以包括全景图像标识以及根据该拍摄图像集合得到的封面图像。举例来说,请一并参见图4,图4为该图标的示意图, 其中,该全景图像标识可以位于该图标的左下角,或者说,该全景图像标识位于根据该拍摄图像集合得到的封面图像的左下角。需要说明的是,该全景图像标识也可以位于该图标的其他角上,也可以为与该图标的中间,本申请实施例不做限定。
S302、控制设备若检测到针对拍摄图像集合的第一操作,则根据第一操作对拍摄图像集合进行处理,生成目标对象的全景图像。
本申请实施例中,该第一操作可以是针对拍摄图像集合的点击操作,或者说可以是针对与存储的拍摄图像集合相关联的图标的点击操作。该点击操作可以是手指或者指关节的单击操作,也可以是手指或者指关节的多次点击操作。需要说明的是,该第一操作也可以是其他类型的触控操作,还可以是其他操作,如手势操作或语音操作等,本申请实施例不做限定。
具体地,控制设备检测到用户针对该拍摄图像集合的第一操作之后,首先对该拍摄图像集合中的各张图像进行投影变换,可以是进行平面投影、柱面投影、立方体投影或者球面投影等;因为不同图像可能是拍摄设备在不同角度下拍摄得到的,故而他们并不在同一投影平面上,如果直接对重叠的图像进行无缝拼接,会破坏实际景物的视觉一致性,所以需要先对图像进行投影变换。然后,控制设备获取该图像集合中各张图像的有效特征匹配点,并根据获取到的有效特征匹配点对该图像集合中的各张图像进行图像拼接,得到目标对象的全景图。其中,图像拼接包括配准(Registration)和融合(Blending),配准是根据几何运动模型,将该图像集合中的各张图像注册到同一个坐标系中,融合则是将配准后的各张图像合成为一张大的拼接图像。
在一些可行的实施方式中,控制设备在检测到针对该拍摄图像集合的第一操作之后,在根据该第一操作对该拍摄图像进行处理,生成目标对象的全景图像之前,控制设备可以输出第二提示信息,该第二提示信息用于提示用户选择全景图像的生成模式;其中,全景图像的生成模式包括球形全景图像生成模式和360度全景图像生成模式。然后,控制设备接收用户针对该第二提示信息输入的选择指令。若用户输入的选择指令指示全景图像的生成模式为球形全景图像,则控制设备响应该选择指令对该拍摄图像集合进行处理,生成目标对象的球形全景图像;若用户输入的选择指令指示全景图像的生成模式为360度全景 图像,则控制设备响应该选择指令对该拍摄图像集合进行处理,生成目标对象的360度全景图像。
在一些可行的实施方式中,控制设备在对该拍摄图像集合进行处理,生成目标对象的全景图像的过程中,可以输出加载全景图像的等待提示,其中,该等待提示包括预设图标和/或预设字样。举例来说,请一并参见图5,如图5所示,该等待提示可以以界面的形式进行提示,该等待提示界面可以包括预设图标,预设图标可以为球形图标,该球形图标可以包括“360”字样,该球形图标的下方还可以包括“正在生成”字样;该等待提示界面还可以包括删除图标,当在生成全景图像的过程中,若检测到用户针对该删除图标的诸如点击操作,则可以将生成全景图像过程中产生的中间文档删除,并退出等待提示界面。需要说明的是,该等待提示也可以是其他形式,如语音提示、光电提示等,该预设图标和该预设字样也可以是其他形式,可以根据具体需要进行设置,本申请实施例不做限定。
在一些可行的实施方式中,控制设备对该拍摄图像集合进行处理,生成目标对象的全景图像之后,保存该目标对象的全景图像。其中,可以将该目标对象的全景图像与该拍摄图像集合保存到同一文件夹或者相册中。若控制设备再次检测到用户针对该拍摄图像集合的第一操作,则直接显示该目标对象的全景图像,从而无需再次生成目标对象的全景图像,节省控制设备的软硬件资源。
S303、控制设备显示全景图像。
本申请实施例中,控制设备在生成该目标对象的全景图像之后,显示该全景图像。请一并参见图6,图6为本申请实施例提供的一种全景图像显示界面的示意图,如图6所示,该全景图像的显示界面包括目标对象的全景图像,以及包括菜单栏,该菜单栏包括工具栏和标题栏。控制设备在检测到用户针对该全景图像的第二操作时,将该全景图像的浏览模式进行切换。其中,该全景图像的浏览模式包括手动浏览模式和体感浏览模式,该第二操作可以是用户的手指或者指关节的双击或者三击操作。具体地,若该全景图像的当前浏览模式为手动浏览模式,则控制设备在检测到用户针对该全景图像的第二操作时,将该全景图像的浏览模式切换为体感浏览模式;若该全景图像的当前浏览模式为体感浏览模式,则控制设备在检测到用户针对该全景图像的第二操作时,将该全景 图像的浏览模式切换为手动浏览模式。需要说明的是,该第二操作也可以是其他类型的触控操作(例如按压、滑动等),还可以为诸如手势操作或语音操作等,本申请实施例不做限定。
在一些可行的实施方式中,控制设备在显示该目标对象的全景图像之后,当检测到用户针对该全景图像的第三操作时,控制设备隐藏或显示该全景图像的显示界面的菜单栏,其中,该第三操作可以是针对该全景图像的单击操作。请一并参见图6和图7,如图6所示,该全景图像的显示界面显示有菜单栏,当控制设备检测到针对该全景图像的第三操作时,将该全景图像的显示界面的菜单栏隐藏,菜单栏隐藏后的显示界面如图7所示。同理,如图7所示的该全景图像的显示界面的菜单栏隐藏,当控制设备检测到针对该全景图像的第三操作时,显示该全景图像的显示界面的菜单栏,菜单栏显示后的显示界面如图6所示。需要说明的是,该第三操作也可以是其他类型的触控操作,还可以为诸如手势操作或语音操作等,本申请实施例不做限定。
可以理解的是,第一操作、第二操作、第三操作不同,以相应实现对应的功能,同时,该第一操作、第二操作、第三操作对应实现的功能可以在控制终端出厂前进行设置,也可以由用户进行自定义设置,本申请实施例不做限定。
在一些可行的实施方式中,控制设备在将该全景图像的浏览模式切换为体感浏览模式后,可以输出第一提示信息。其中,该第一提示信息用于提示用户调整该控制设备的姿态,该第一提示信息的提示时长可以为1.5秒至3秒。请一并参见图8,图8为第一提示信息的显示界面的示意图,如图8所示,该第一提示信息显示于该全景图像的中间,且该第一提示信息包括诸如“倾斜设备观看”等提示字样。需要说明的是,该第一提示信息的提示时长也可以是其他时长,该第一提示信息除了文字方式,还可以是语音提示,呼吸灯闪烁等提示方式,本申请实施例不做限定。
在一些可行的实施方式中,控制设备在输出第一提示信息之后,若检测到控制设备的姿态发生变化,则立即关闭该第一提示信息。
在一些可行的实施方式中,控制设备在将该全景图像的浏览模式切换为体感浏览模式后,每隔预设时长间隔或实时获取控制设备的姿态信息,并根据获取到的控制设备的姿态信息调整该全景图像的显示画面。具体地,示例性的, 控制设备首先通过预置的传感器(例如重力传感器、陀螺仪等)获取控制设备的姿态信息,该姿态信息包括控制设备的倾斜方向和倾斜角度,然后根据该控制设备的倾斜方向和倾斜角度调整该全景图像的显示画面,当控制设备的倾斜方向和倾斜角度不同时,基于该全景图像的显示画面的内容可以不同。
在一些可行的实施方式中,控制设备在将该全景图像的浏览模式切换为手动浏览模式后,获取用户针对该全景图像的手动操作信息,并根据该手动操作信息调整该全景图像的显示画面。其中,该手动操作信息包括触控信息和/或手势信息。例如,当控制设备检测到用户针对该全景图像的拖动操作时,则获取该拖动操作的方向和距离,并根据该拖动操作的方向和距离调整该全景图像的显示画面;当控制设备检测到用户针对该全景图像的放大手势时,放大该全景图像,或者说,将该球形全景图像或者360全景图像展开为平面全景图像,如图9所示,图9为将该球形全景图像或者360全景图像展开为平面全景图像后的示意图;当控制设备检测到用户针对该全景图像的缩小手势时,缩小该全景图像。
本申请实施例中,控制设备首先接收移动平台发送的针对目标对象的拍摄图像集合,然后若检测到针对拍摄图像集合的第一操作,则根据第一操作对拍摄图像进行处理,生成目标对象的全景图像,最后显示全景图像。采用上述方式,可以根据目标对象的拍摄图像集合自动生成全景图像,从而提高生成全景图像的效率,同时,用户可以通过控制设备预览全景拍摄效果,及时性高。
请参阅图10,图10为本申请实施例提供的又一种图像处理方法的流程示意图。示例性的,本申请实施例中所描述的图像处理方法,包括:
S1001、控制设备获取用户针对控制设备的操作信息。
S1002、控制设备将全景拍摄指令发送至移动平台。
本申请实施例中,控制设备首先获取用户针对控制设备的第一操作信息;然后根据该第一操作信息向移动平台发送全景拍摄指令。该第一操作信息可以是用户针对控制设备的全景拍摄按钮的点击信息。
在一些可行的实施方式中,控制设备首先获取用户针对控制设备的第二操作信息,然后根据第二操作信息向移动平台发送指令信息,该指令信息包括全景位置信息和全景拍摄指令。
S1003、移动平台获取全景拍摄指令。
本申请实施例中,移动平台接收控制设备发送的全景拍摄指令。或者,移动平台首先接收控制设备发送的指令信息,该指令信息包括全景位置信息和全景拍摄指令;然后根据该指令信息中包括的全景位置信息控制移动平台移动到全景位置;进一步地,检测移动平台是否位于全景位置,当检测到移动平台位于全景位置时,获取该指令信息中包括的全景拍摄指令。
S1004、移动平台根据全景拍摄指令调整拍摄设备的当前姿态为预设姿态。
本申请实施例中,拍摄设备设于移动平台上,拍摄设备的预设姿态包括第一姿态和第二姿态。移动平台获取到全景拍摄指令之后,响应该全景拍摄指令将拍摄设备的当前姿态调整为第一姿态或者第二姿态。
S1005、移动平台控制拍摄设备在预设姿态的预设拍摄方向对目标对象进行拍摄,得到拍摄图像集合。
本申请实施例中,预设拍摄方向包括第一拍摄方向和第二拍摄方向。当拍摄设备处于第一姿态时,第一拍摄方向为朝上且与水平方向成第三预设角度。当拍摄设备处于第二姿态时,第二拍摄方向为朝下且与垂直方向成第四预设角度。
具体地,移动平台首先控制该拍摄设备处于第一姿态,并控制该拍摄设备在第一拍摄方向对目标对象进行拍摄,得到目标对象的第一图像集合;然后控制该拍摄设备处于第二姿态,并控制该拍摄设备在第二拍摄方向对目标对象进行拍摄,得到目标对象的第二图像集合。
S1006、移动平台将拍摄图像集合发送至控制设备。
本申请实施例中,移动平台将目标对象的第一图像集合和第二图像集合发送给控制设备。该第一图像集合和第二图像集合可以用于生成目标对象的全景图像。
S1007、控制设备接收移动平台发送的针对目标对象的拍摄图像集合。
S1008、控制设备若检测到针对拍摄图像集合的第一操作,则根据第一操作对拍摄图像集合进行处理,生成目标对象的全景图像。
本申请实施例中,该第一操作可以是针对拍摄图像集合的点击操作。具体地,控制设备检测到用户针对该拍摄图像集合的第一操作之后,首先对该图像 集合中的各张图像进行投影变换,然后,控制设备获取该图像集合中各张图像的有效特征匹配点,并根据获取到的有效特征匹配点对该图像集合中的各张图像进行图像拼接,得到目标对象的全景图。
S1009、控制设备显示全景图像。
本申请实施例中,控制设备可以是遥控设备或移动终端;移动平台可以是无人机。
需要说明的是,本申请实施例所提供的图像处理方法中的各步骤可参考上述方法实施例中所描述的具体实现方式,在此不再赘述。
本申请实施例中,首先控制设备获取用户的操作信息,并根据该操作信息向移动平台发送全景拍摄指令;然后移动平台获取到全景拍摄指令之后,控制拍摄设备在预设姿态的预设拍摄方向对目标对象进行拍摄,得到拍摄图像集合,并将该拍摄图像集合发送至控制设备;然后控制设备在检测到针对拍摄图像集合的第一操作之后,生成并显示目标对象的全景图像。采用上述方式,可以根据全景拍摄指令自动拍摄得到目标对象的图像集合,且可以根据图像集合自动生成全景图像,从而提高生成全景图像的效率。
请参见图11,图11是本申请实施例提供的一种移动平台的结构示意图,本申请实施例中所描述的移动平台包括:处理器1101、通信接口1102、存储器1103。其中,处理器1101、通信接口1102、存储器1103可通过总线或其他方式连接,本申请实施例以通过总线连接为例。
处理器1101可以是中央处理器(central processing unit,CPU),网络处理器(network processor,NP),或者CPU和NP的组合。处理器1101也可以是多核CPU或多核NP中用于实现通信标识绑定的核。
上述处理器1101可以是硬件芯片。上述硬件芯片可以是专用集成电路(application-specific integrated circuit,ASIC),可编程逻辑器件(programmable logic device,PLD)或其组合。上述PLD可以是复杂可编程逻辑器件(complex programmable logic device,CPLD),现场可编程逻辑门阵列(field-programmable gate array,FPGA),通用阵列逻辑(generic array logic,GAL)或其任意组合。
上述通信接口1102可用于收发信息或信令的交互,以及信号的接收和传递。上述存储器1103可主要包括存储程序区和存储数据区,其中,存储程序区 可存储操作系统、至少一个功能所需的存储程序(比如文字存储功能、位置存储功能等);存储数据区可存储根据移动平台的使用所创建的数据(比如图像数据、文字数据)等,并可以包括应用存储程序等。此外,存储器1103可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
上述存储器1103还用于存储程序指令。上述处理器1101可以调用上述存储器1103存储的程序指令,实现如图1所示的图像处理方法。具体地:
处理器1101,用于获取全景拍摄指令;
处理器1101,还用于根据全景拍摄指令调整拍摄设备的当前姿态为预设姿态,拍摄设备设于移动平台上;
处理器1101,还用于控制拍摄设备在预设姿态的预设拍摄方向对目标对象进行拍摄,得到拍摄图像集合;
通信接口1102,用于将拍摄图像集合发送至移动平台的控制设备。
在一些可行的实施方式中,处理器1101,还用于在拍摄图像集合中筛选满足预设条件的预设数量的目标图像;
通信接口1102,具体用于将目标图像发送至移动平台的控制设备。
在一些可行的实施方式中,处理器1101在拍摄图像集合中筛选满足预设条件的预设数量的目标图像的具体方式为:根据相邻图像的匹配特征点,在拍摄图像集合中筛选匹配特征点符合第一要求的预设数量的目标图像。
在一些可行的实施方式中,处理器1101在拍摄图像集合中筛选满足预设条件的预设数量的目标图像的具体方式为:根据相邻图像的重叠区域,在拍摄图像集合中筛选重叠区域符合第二要求的预设数量的目标图像。
在一些可行的实施方式中,预设姿态包括第一姿态和第二姿态,预设拍摄方向包括第一拍摄方向和第二拍摄方向,处理器1101具体用于:
控制拍摄设备处于第一姿态,并控制拍摄设备在第一拍摄方向对目标对象进行拍摄,得到第一图像集合;
控制拍摄设备处于第二姿态,并控制拍摄设备在第二拍摄方向对目标对象进行拍摄,得到第二图像集合;
通信接口1102,具体用于将第一图像集合和第二图像集合发送至移动平台 的控制设备。
在一些可行的实施方式中,处理器1101具体用于:
控制拍摄设备按第一预设方向对目标对象进行旋转拍摄,得到第一拍摄方向的第一图像集合;
控制拍摄设备按第二预设方向对目标对象进行旋转拍摄,得到第二拍摄方向的第二图像集合。
在一些可行的实施方式中,处理器1101具体用于:
控制移动平台按第一预设方向旋转,并在移动平台每旋转第一预设角度后,控制拍摄设备针对目标对象进行拍摄,得到第一拍摄方向的第一图像集合;
控制移动平台按第二预设方向旋转,并在移动平台每旋转第二预设角度后,控制拍摄设备针对目标对象进行拍摄,得到第二拍摄方向的第二图像集合。
在一些可行的实施方式中,处理器1101具体用于:控制移动平台的载体按第一预设方向旋转,并在载体每旋转第一预设角度后,控制拍摄设备针对目标对象进行拍摄,得到第一拍摄方向的第一图像集合,拍摄设备支撑于载体上;
控制载体按第二预设方向旋转,并在载体每旋转第二预设角度后,控制拍摄设备针对目标对象进行拍摄,得到第二拍摄方向的第二图像集合。
在一些可行的实施方式中,第一预设角度和第二预设角度不大于45度。拍摄设备旋转拍摄时的角度为至少360度。
在一些可行的实施方式中,当拍摄设备旋转拍摄时的角度大于360度时,拍摄设备在每一360度旋转圈的起始拍摄方向不同。
在一些可行的实施方式中,预设姿态还包括第三姿态,预设拍摄方向还包括第三拍摄方向,处理器1101还用于:
控制拍摄设备处于第三姿态,并控制拍摄设备在第三拍摄方向对目标对象进行拍摄,得到第三图像集合;
通信接口1102,具体用于将第一图像集合、第二图像集合和第三图像集合发送至移动平台的控制设备。
在一些可行的实施方式中,拍摄设备处于第一姿态时,第一拍摄方向为朝上且与水平方向成第三预设角度;拍摄设备处于第二姿态时,第二拍摄方向为朝下且与垂直方向成第四预设角度;拍摄设备处于第三姿态时,第三拍摄方向 为垂直方向且朝下。
在一些可行的实施方式中,第三预设角度为0度至10度。
在一些可行的实施方式中,拍摄设备处于第一姿态时,第一拍摄方向为水平方向;拍摄设备处于第二姿态时,第二拍摄方向为朝下且与垂直方向成第五预设角度;拍摄设备处于第三姿态时,第三拍摄方向为垂直方向且朝下。
在一些可行的实施方式中,通信接口1102还用于:接收移动平台的控制设备发送的全景拍摄指令。
在一些可行的实施方式中,通信接口1102还用于:接收移动平台的控制设备发送的指令信息,指令信息包括全景位置信息和全景拍摄指令;
处理器1101,还用于:检测移动平台是否位于全景位置信息指示的位置;若是,则获取指令信息中的全景拍摄指令。
在一些可行的实施方式中,控制设备包括遥控设备或移动终端;移动平台为无人机。
具体实现中,本申请实施例中所描述的处理器1101、通信接口1102、存储器1103可执行本申请实施例提供的一种图像处理方法中所描述的移动平台侧的实现方式,在此不再赘述。
本申请实施例中,首先获取全景拍摄指令,并根据获取到的全景拍摄指令调整拍摄设备的当前姿态为预设姿态,然后控制该拍摄设备在预设姿态的预设拍摄方向对目标对象进行拍摄,得到拍摄图像集合,最后将该拍摄图像集合发送至移动平台的控制设备;采用上述方式,可以根据全景拍摄指令自动拍摄得到目标对象的图像集合,从而提高拍摄图像集合的获取效率。
请参阅图12,图12为本申请实施例提供的一种控制设备的结构示意图。本申请实施例中所描述的控制设备,包括:用户接口1201,显示屏1202,处理器1203,通信接口1204和存储器1205,上述用户接口1201,显示屏1202,处理器1203,通信接口1204以及存储器1205可以通过总线连接,也可以以其他方式连接。
处理器1203可以是中央处理器(central processing unit,CPU),网络处理器(network processor,NP),图形处理器(graphics processing unit,GPU),或者CPU、GPU和NP的组合。处理器1203也可以是多核CPU、多核GPU或多 核NP中用于实现通信标识绑定的核。通信接口1204可用于收发信息或信令的交互,以及信号的接收和发送,特别地,通信接口1204可以通过无线通信与网络和信号发射设备进行通信,并接收信号发射设备的数据。
用户接口1201可用于接收输入的数字或字符信息,以及产生与控制设备的用户设置以及功能控制有关的键信号输入。具体地,上述用户接口1201可包括触控面板以及其他输入设备。触控面板,也称为触摸屏,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板上或在触控面板附近的操作),并根据预先设定的程式驱动相应的连接装置。其他输入设备可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。显示屏1202可用于显示由用户输入的信息或提供给用户的信息以及控制设备的各种菜单。显示屏1202可以采用LCD(Liquid Crystal Display,液晶显示器)、OLED(Organic Light-Emitting Diode,有机发光二极管)等形式来配置。
上述存储器1205可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的存储程序(比如文字存储功能、位置存储功能等);存储数据区可存储根据控制设备的使用所创建的数据(比如图像数据、文字数据)等,并可以包括网络通信模块、用户接口模块,应用存储程序等。
上述存储器1205还用于存储程序指令。上述处理器1203可以调用上述存储器1205存储的程序指令,实现如图3所示的图像处理方法。具体地:
通信接口1204,用于接收移动平台发送的针对目标对象的拍摄图像集合;
处理器1203,用于若检测到针对拍摄图像集合的第一操作,则根据第一操作对拍摄图像集合进行处理,生成目标对象的全景图像;
显示屏1202,用于显示全景图像。
在一些可行的实施方式中,处理器1203,还用于获取用户针对控制设备的第一操作信息;
通信接口1204,还用于根据第一操作信息向移动平台发送全景拍摄指令。
在一些可行的实施方式中,处理器1203,还用于获取用户针对控制设备的第二操作信息;
通信接口1204,还用于根据第二操作信息向移动平台发送指令信息,指令信息包括全景位置信息和全景拍摄指令。
在一些可行的实施方式中,处理器1203,具体用于获取用户输入的全景位置信息;通信接口1204,具体用于根据全景位置信息向移动平台发送指令信息。
在一些可行的实施方式中,处理器1203,具体用于获取用户针对显示地图的触控信息,并根据触控信息确定全景位置信息;通信接口1204,具体用于根据全景位置信息向移动平台发送指令信息。
在一些可行的实施方式中,处理器1203还用于:
根据全景位置信息获取全景位置的全景图像样本;
根据全景图像样本进行拍摄提示。
在一些可行的实施方式中,处理器1203还用于:根据全景位置信息获取全景位置的环境信息;根据环境信息进行拍摄提示。
在一些可行的实施方式中,处理器1203还用于:若检测到针对全景图像的第二操作,则将全景图像的浏览模式进行切换。其中,浏览模式包括手动浏览模式和体感浏览模式。
在一些可行的实施方式中,显示屏1202还用于:
当将浏览模式切换为体感浏览模式时,输出第一提示信息,第一提示信息用于提示用户调整控制设备的姿态。
其中,第一提示信息的提示时长为1.5秒至3秒。
在一些可行的实施方式中,处理器1203还用于:当控制设备的姿态发生变化时,关闭第一提示信息。
在一些可行的实施方式中,处理器1203还用于:当全景图像的浏览模式为体感浏览模式时,获取控制设备的姿态信息;
根据姿态信息调整全景图像的显示画面。
在一些可行的实施方式中,处理器1203还用于:当全景图像的浏览模式为手动浏览模式时,获取针对全景图像的手动操作信息;
根据手动操作信息调整全景图像的显示画面。
其中,手动操作信息包括触控信息和/或手势信息。
在一些可行的实施方式中,处理器1203还用于:存储拍摄图像集合。
在一些可行的实施方式中,处理器1203具体用于:利用预设标识存储拍摄图像集合。
在一些可行的实施方式中,显示屏1202,还用于输出第二提示信息,第二提示信息用于提示用户选择全景图像的生成模式;
用户接口1201,用于接收用户针对第二提示信息输入的选择指令;
处理器1203,具体用于根据第一操作和选择指令对拍摄图像集合进行处理,生成目标对象的全景图像。
在一些可行的实施方式中,生成模式包括球形全景图像生成模式和360度全景图像生成模式。
在一些可行的实施方式中,显示屏1202,还用于若检测到针对全景图像的第三操作,则隐藏或显示全景图像的显示界面的菜单栏。
在一些可行的实施方式中,显示屏1202,还用于在生成全景图像的过程中,输出加载全景图像的等待提示。
在一些可行的实施方式中,等待提示包括预设图标和/或预设字样;控制设备包括遥控设备或移动终端;移动平台为无人机。
具体实现中,本申请实施例中所描述的用户接口1201,显示屏1202,处理器1203,通信接口1204,和存储器1205,可执行本申请实施例提供的图像处理方法中控制设备侧所描述的实现方式,在此不再赘述。
本申请实施例中,首先接收移动平台发送的针对目标对象的拍摄图像集合,然后若检测到针对拍摄图像集合的第一操作,则根据第一操作对拍摄图像进行处理,生成目标对象的全景图像,最后显示全景图像。采用上述方式,可以根据目标对象的拍摄图像集合自动生成全景图像,从而提高生成全景图像的效率。
请参阅图13,图13为本申请实施例提供的一种图像处理系统的架构示意图。本申请实施例中所描述的图像处理系统,包括:
控制设备1301,用于获取用户针对控制设备的操作信息。
控制设备1301,还用于根据操作信息将全景拍摄指令发送至移动平台1302。
移动平台1302,用于获取全景拍摄指令。
移动平台1302,还用于根据全景拍摄指令调整拍摄设备的当前姿态为预设姿态。
移动平台1302,还用于控制拍摄设备在预设姿态的预设拍摄方向对目标对象进行拍摄,得到拍摄图像集合。
移动平台1302,还用于将拍摄图像集合发送至控制设备。
控制设备1301,还用于接收移动平台发送的针对目标对象的拍摄图像集合。
控制设备1301,还用于若检测到针对拍摄图像集合的第一操作,则根据第一操作对拍摄图像集合进行处理,生成目标对象的全景图像。
控制设备1301,还用于显示全景图像。
可以理解的是,本申请实施例的控制设备1301和移动平台1302的功能可根据上述方法实施例中的方法具体实现,其具体实现过程可以参照上述方法实施例的相关描述,此处不再赘述。
本申请实施例中,首先控制设备获取用户的操作信息,并根据该操作信息向移动平台发送全景拍摄指令;然后移动平台获取到全景拍摄指令之后,控制拍摄设备在预设姿态的预设拍摄方向对目标对象进行拍摄,得到拍摄图像集合,并将该拍摄图像集合发送至控制设备;然后控制设备在检测到针对拍摄图像集合的第一操作之后,生成并显示目标对象的全景图像。采用上述方式,可以根据全景拍摄指令自动拍摄得到目标对象的图像集合,且可以根据图像集合自动生成全景图像,从而提高生成全景图像的效率。
基于移动平台一侧或控制设备一侧,本申请实施例分别可以提供一种计算机可读存储介质,计算机可读存储介质中存储有计算机程序,该计算机可读存储介质上存储有计算机程序,计算机程序被处理器执行时,可以实现上述相应的方法实施例中说明的各个步骤流程。
需要说明的是,对于前述的各个方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本申请并不受所描述的动作顺序的限制,因为依据本申请,某一些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优 选实施例,所涉及的动作和模块并不一定是本申请所必须的。
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序可以存储于一计算机可读存储介质中,存储介质可以包括:闪存盘、只读存储器(Read-Only Memory,ROM)、随机存取器(Random Access Memory,RAM)、磁盘或光盘等。
以上对本申请实施例所提供的一种图像处理方法、移动平台、控制设备及系统进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。

Claims (89)

  1. 一种图像处理方法,应用于移动平台,其特征在于,所述方法包括:
    获取全景拍摄指令;
    根据所述全景拍摄指令调整拍摄设备的当前姿态为预设姿态,所述拍摄设备设于所述移动平台上;
    控制所述拍摄设备在所述预设姿态的预设拍摄方向对目标对象进行拍摄,得到拍摄图像集合;
    将所述拍摄图像集合发送至所述移动平台的控制设备。
  2. 根据权利要求1所述的方法,其特征在于,所述将所述拍摄图像集合发送至所述移动平台的控制设备,包括:
    在所述拍摄图像集合中筛选满足预设条件的预设数量的目标图像;
    将所述目标图像发送至所述移动平台的控制设备。
  3. 根据权利要求2所述的方法,其特征在于,所述在所述拍摄图像集合中筛选满足预设条件的预设数量的目标图像,包括:
    根据相邻图像的匹配特征点,在所述拍摄图像集合中筛选匹配特征点符合第一要求的预设数量的目标图像。
  4. 根据权利要求2所述的方法,其特征在于,所述在所述拍摄图像集合中筛选满足预设条件的预设数量的目标图像,包括:
    根据相邻图像的重叠区域,在所述拍摄图像集合中筛选重叠区域符合第二要求的预设数量的目标图像。
  5. 根据权利要求1至4中任一项所述的方法,其特征在于,所述预设姿态包括第一姿态和第二姿态,所述预设拍摄方向包括第一拍摄方向和第二拍摄方向,所述控制所述拍摄设备在所述预设姿态的预设拍摄方向对目标对象进行拍摄,得到拍摄图像集合,包括:
    控制所述拍摄设备处于所述第一姿态,并控制所述拍摄设备在所述第一拍摄方向对目标对象进行拍摄,得到第一图像集合;
    控制所述拍摄设备处于所述第二姿态,并控制所述拍摄设备在所述第二拍摄方向对所述目标对象进行拍摄,得到第二图像集合;
    所述将所述拍摄图像集合发送至所述移动平台的控制设备,包括:
    将所述第一图像集合和所述第二图像集合发送至所述移动平台的控制设备。
  6. 根据权利要求5所述的方法,其特征在于,所述控制所述拍摄设备在所述第一拍摄方向对目标对象进行拍摄,得到第一图集合包括:
    控制所述拍摄设备按第一预设方向对目标对象进行旋转拍摄,得到所述第一拍摄方向的第一图像集合;
    所述控制所述拍摄设备在所述第二拍摄方向对所述目标对象进行拍摄,得到第二图像集合,包括:
    控制所述拍摄设备按第二预设方向对所述目标对象进行旋转拍摄,得到所述第二拍摄方向的第二图像集合。
  7. 根据权利要求6所述的方法,其特征在于,所述控制所述拍摄设备按第一预设方向对目标对象进行旋转拍摄,得到所述第一拍摄方向的第一图像集合,包括:
    控制所述移动平台按第一预设方向旋转,并在所述移动平台每旋转第一预设角度后,控制所述拍摄设备针对目标对象进行拍摄,得到所述第一拍摄方向的第一图像集合;
    所述控制所述拍摄设备按第二预设方向对所述目标对象进行旋转拍摄,得到所述第二拍摄方向的第二图像集合,包括:
    控制所述移动平台按第二预设方向旋转,并在所述移动平台每旋转第二预设角度后,控制所述拍摄设备针对所述目标对象进行拍摄,得到所述第二拍摄方向的第二图像集合。
  8. 根据权利要求6所述的方法,其特征在于,所述控制所述拍摄设备按所述第一预设方向对目标对象进行旋转拍摄,得到所述第一拍摄方向的第一图像集合,包括:
    控制所述移动平台的载体按第一预设方向旋转,并在所述载体每旋转第一预设角度后,控制所述拍摄设备针对目标对象进行拍摄,得到所述第一拍摄方向的第一图像集合,所述拍摄设备支撑于所述载体上;
    所述控制所述拍摄设备按第二预设方向对所述目标对象进行旋转拍摄,得到所述第二拍摄方向的第二图像集合,包括:
    控制所述载体按第二预设方向旋转,并在所述载体每旋转第二预设角度后,控制所述拍摄设备针对所述目标对象进行拍摄,得到所述第二拍摄方向的第二图像集合。
  9. 根据权利要求7或8所述的方法,其特征在于,所述第一预设角度和所述第二预设角度不大于45度。
  10. 根据权利要求6至9中任一项所述的方法,其特征在于,所述拍摄设备旋转拍摄时的角度为至少360度。
  11. 根据权利要求10所述的方法,其特征在于,当所述拍摄设备旋转拍摄时的角度大于360度时,所述拍摄设备在每一360度旋转圈的起始拍摄方向不同。
  12. 根据权利要求5至11中任一项所述的方法,其特征在于,所述预设姿态还包括第三姿态,所述预设拍摄方向还包括第三拍摄方向,在所述得到第二图像集合之后,所述方法还包括:
    控制所述拍摄设备处于所述第三姿态,并控制所述拍摄设备在所述第三拍摄方向对所述目标对象进行拍摄,得到第三图像集合;
    所述将所述拍摄图像集合发送至所述移动平台的控制设备,包括:
    将所述第一图像集合、所述第二图像集合和所述第三图像集合发送至所述移动平台的控制设备。
  13. 根据权利要求12所述的方法,其特征在于,所述拍摄设备处于所述第一姿态时,所述第一拍摄方向为朝上且与水平方向成第三预设角度;
    所述拍摄设备处于所述第二姿态时,所述第二拍摄方向为朝下且与垂直方向成第四预设角度;
    所述拍摄设备处于所述第三姿态时,所述第三拍摄方向为所述垂直方向且朝下。
  14. 根据权利要求13所述的方法,其特征在于,所述第三预设角度为0度至10度。
  15. 根据权利要求12所述的方法,其特征在于,所述拍摄设备处于所述第一姿态时,所述第一拍摄方向为水平方向;
    所述拍摄设备处于所述第二姿态时,所述第二拍摄方向为朝下且与垂直方 向成第五预设角度;
    所述拍摄设备处于所述第三姿态时,所述第三拍摄方向为所述垂直方向且朝下。
  16. 根据权利要求1至15中任一项所述的方法,其特征在于,所述获取全景拍摄指令,包括:
    接收所述移动平台的控制设备发送的全景拍摄指令。
  17. 根据权利要求1至15中任一项所述的方法,其特征在于,所述获取全景拍摄指令,包括:
    接收所述移动平台的控制设备发送的指令信息,所述指令信息包括全景位置信息和全景拍摄指令;
    检测所述移动平台是否位于所述全景位置信息指示的位置;
    若是,则获取所述指令信息中的全景拍摄指令。
  18. 根据权利要求16或17所述的方法,其特征在于,所述控制设备包括遥控设备或移动终端。
  19. 根据权利要求1至18中任一项所述的方法,其特征在于,所述移动平台为无人机。
  20. 一种图像处理方法,应用于移动平台的控制设备,其特征在于,所述方法包括:
    接收所述移动平台发送的针对目标对象的拍摄图像集合;
    若检测到针对所述拍摄图像集合的第一操作,则根据所述第一操作对所述拍摄图像集合进行处理,生成所述目标对象的全景图像;
    显示所述全景图像。
  21. 根据权利要求20所述的方法,其特征在于,在所述接收所述移动平台发送的针对目标对象的拍摄图像集合之前,所述方法还包括:
    获取用户针对所述控制设备的第一操作信息;
    根据所述第一操作信息向所述移动平台发送全景拍摄指令。
  22. 根据权利要求20所述的方法,其特征在于,在所述接收所述移动平台发送的针对目标对象的拍摄图像集合之前,所述方法还包括:
    获取用户针对所述控制设备的第二操作信息;
    根据所述第二操作信息向所述移动平台发送指令信息,所述指令信息包括全景位置信息和全景拍摄指令。
  23. 根据权利要求22所述的方法,其特征在于,所述获取用户针对所述控制设备的第二操作信息,包括:
    获取用户输入的全景位置信息;
    根据所述第二操作信息向所述移动平台发送指令信息,包括:
    根据所述全景位置信息向所述移动平台发送指令信息。
  24. 根据权利要求22所述的方法,其特征在于,所述获取用户针对所述控制设备的第二操作信息,包括:
    获取用户针对显示地图的触控信息,并根据所述触控信息确定全景位置信息;
    根据所述第二操作信息向所述移动平台发送指令信息,包括:
    根据所述全景位置信息向所述移动平台发送指令信息。
  25. 根据权利要求22至24中任一项所述的方法,其特征在于,在所述根据所述第二操作信息向所述移动平台发送指令信息之前,所述方法还包括:
    根据所述全景位置信息获取所述全景位置的全景图像样本;
    根据所述全景图像样本进行拍摄提示。
  26. 根据权利要求22至25中任一项所述的方法,其特征在于,在所述根据所述第二操作信息向所述移动平台发送指令信息之前,所述方法还包括:
    根据所述全景位置信息获取所述全景位置的环境信息;
    根据所述环境信息进行拍摄提示。
  27. 根据权利要求20至26中任一项所述的方法,其特征在于,在所述显示所述全景图像之后,所述方法还包括:
    若检测到针对所述全景图像的第二操作,则将所述全景图像的浏览模式进行切换。
  28. 根据权利要求27所述的方法,其特征在于,所述浏览模式包括手动浏览模式和体感浏览模式。
  29. 根据权利要求28所述的方法,其特征在于,所述方法还包括:
    当将所述浏览模式切换为所述体感浏览模式时,输出第一提示信息,所述 第一提示信息用于提示用户调整所述控制设备的姿态。
  30. 根据权利要求29所述的方法,其特征在于,所述第一提示信息的提示时长为1.5秒至3秒。
  31. 根据权利要求29或30所述的方法,其特征在于,在所述输出第一提示信息之后,所述方法还包括:
    当所述控制设备的姿态发生变化时,关闭所述第一提示信息。
  32. 根据权利要求29至31中任一项所述的方法,其特征在于,所述方法还包括:
    当所述全景图像的浏览模式为所述体感浏览模式时,获取所述控制设备的姿态信息;
    根据所述姿态信息调整所述全景图像的显示画面。
  33. 根据权利要求28所述的方法,其特征在于,所述方法还包括:
    当所述全景图像的浏览模式为所述手动浏览模式时,获取针对所述全景图像的手动操作信息;
    根据所述手动操作信息调整所述全景图像的显示画面。
  34. 根据权利要求33所述的方法,其特征在于,所述手动操作信息包括触控信息和/或手势信息。
  35. 根据权利要求20至34任一项所述的方法,其特征在于,在所述接收所述移动平台发送的针对目标对象的拍摄图像集合之后,所述方法还包括:
    存储所述拍摄图像集合。
  36. 根据权利要求35所述的方法,其特征在于,所述存储所述拍摄图像集合,包括:
    利用预设标识存储所述拍摄图像集合。
  37. 根据权利要求20至36中任一项所述的方法,其特征在于,在所述根据所述第一操作对所述拍摄图像集合进行处理,生成所述目标对象的全景图像之前,所述方法还包括:
    输出第二提示信息,所述第二提示信息用于提示用户选择所述全景图像的生成模式;
    接收所述用户针对所述第二提示信息输入的选择指令;
    所述根据所述第一操作对所述拍摄图像集合进行处理,生成所述目标对象的全景图像,包括:
    根据所述第一操作和所述选择指令对所述拍摄图像集合进行处理,生成所述目标对象的全景图像。
  38. 根据权利要求37所述的方法,其特征在于,所述生成模式包括球形全景图像生成模式和360度全景图像生成模式。
  39. 根据权利要求20至38中任一项所述的方法,其特征在于,在所述显示所述全景图像之后,所述方法还包括:
    若检测到针对所述全景图像的第三操作,则隐藏或显示所述全景图像的显示界面的菜单栏。
  40. 根据权利要求20至39中任一项所述的方法,其特征在于,所述方法还包括:
    在生成所述全景图像的过程中,输出加载所述全景图像的等待提示。
  41. 根据权利要求40所述的方法,其特征在于,所述等待提示包括预设图标和/或预设字样。
  42. 根据权利要求20至41中任一项所述的方法,其特征在于,所述控制设备包括遥控设备或移动终端。
  43. 根据权利要求20至42中任一项所述的方法,其特征在于,所述移动平台为无人机。
  44. 一种移动平台,其特征在于,包括:处理器和通信接口,
    所述处理器,用于获取全景拍摄指令;
    所述处理器,还用于根据所述全景拍摄指令调整拍摄设备的当前姿态为预设姿态,所述拍摄设备设于所述移动平台上;
    所述处理器,还用于控制所述拍摄设备在所述预设姿态的预设拍摄方向对目标对象进行拍摄,得到拍摄图像集合;
    所述通信接口,用于将所述拍摄图像集合发送至所述移动平台的控制设备。
  45. 根据权利要求44所述的移动平台,其特征在于,
    所述处理器,还用于在所述拍摄图像集合中筛选满足预设条件的预设数量 的目标图像;
    所述通信接口,具体用于将所述目标图像发送至所述移动平台的控制设备。
  46. 根据权利要求45所述的移动平台,其特征在于,所述处理器在所述拍摄图像集合中筛选满足预设条件的预设数量的目标图像时,具体用于:
    根据相邻图像的匹配特征点,在所述拍摄图像集合中筛选匹配特征点符合第一要求的预设数量的目标图像。
  47. 根据权利要求45所述的移动平台,其特征在于,所述处理器在所述拍摄图像集合中筛选满足预设条件的预设数量的目标图像时,具体用于:
    根据相邻图像的重叠区域,在所述拍摄图像集合中筛选重叠区域符合第二要求的预设数量的目标图像。
  48. 根据权利要求44至47中任一项所述的移动平台,其特征在于,所述预设姿态包括第一姿态和第二姿态,所述预设拍摄方向包括第一拍摄方向和第二拍摄方向,所述处理器具体用于:
    控制所述拍摄设备处于所述第一姿态,并控制所述拍摄设备在所述第一拍摄方向对目标对象进行拍摄,得到第一图像集合;
    控制所述拍摄设备处于所述第二姿态,并控制所述拍摄设备在所述第二拍摄方向对所述目标对象进行拍摄,得到第二图像集合;
    所述通信接口,具体用于将所述第一图像集合和所述第二图像集合发送至所述移动平台的控制设备。
  49. 根据权利要求48所述的移动平台,其特征在于,所述处理器具体用于:
    控制所述拍摄设备按第一预设方向对目标对象进行旋转拍摄,得到所述第一拍摄方向的第一图像集合;
    控制所述拍摄设备按第二预设方向对所述目标对象进行旋转拍摄,得到所述第二拍摄方向的第二图像集合。
  50. 根据权利要求49所述的移动平台,其特征在于,所述处理器具体用于:
    控制所述移动平台按第一预设方向旋转,并在所述移动平台每旋转第一预设角度后,控制所述拍摄设备针对目标对象进行拍摄,得到所述第一拍摄方向的第一图像集合;
    控制所述移动平台按第二预设方向旋转,并在所述移动平台每旋转第二预设角度后,控制所述拍摄设备针对所述目标对象进行拍摄,得到所述第二拍摄方向的第二图像集合。
  51. 根据权利要求49所述的移动平台,其特征在于,所述处理器具体用于:
    控制所述移动平台的载体按第一预设方向旋转,并在所述载体每旋转第一预设角度后,控制所述拍摄设备针对目标对象进行拍摄,得到所述第一拍摄方向的第一图像集合,所述拍摄设备支撑于所述载体上;
    控制所述载体按第二预设方向旋转,并在所述载体每旋转第二预设角度后,控制所述拍摄设备针对所述目标对象进行拍摄,得到所述第二拍摄方向的第二图像集合。
  52. 根据权利要求50或51所述的移动平台,其特征在于,所述第一预设角度和所述第二预设角度不大于45度。
  53. 根据权利要求49至52中任一项所述的移动平台,其特征在于,所述拍摄设备旋转拍摄时的角度为至少360度。
  54. 根据权利要求53所述的移动平台,其特征在于,当所述拍摄设备旋转拍摄时的角度大于360度时,所述拍摄设备在每一360度旋转圈的起始拍摄方向不同。
  55. 根据权利要求48至54中任一项所述的移动平台,其特征在于,所述预设姿态还包括第三姿态,所述预设拍摄方向还包括第三拍摄方向,所述处理器还用于:
    控制所述拍摄设备处于所述第三姿态,并控制所述拍摄设备在所述第三拍摄方向对所述目标对象进行拍摄,得到第三图像集合;
    所述通信接口,具体用于将所述第一图像集合、所述第二图像集合和所述第三图像集合发送至所述移动平台的控制设备。
  56. 根据权利要求55所述的移动平台,其特征在于,所述拍摄设备处于所述第一姿态时,所述第一拍摄方向为朝上且与水平方向成第三预设角度;
    所述拍摄设备处于所述第二姿态时,所述第二拍摄方向为朝下且与垂直方向成第四预设角度;
    所述拍摄设备处于所述第三姿态时,所述第三拍摄方向为所述垂直方向且 朝下。
  57. 根据权利要求56所述的移动平台,其特征在于,所述第三预设角度为0度至10度。
  58. 根据权利要求55所述的移动平台,其特征在于,所述拍摄设备处于所述第一姿态时,所述第一拍摄方向为水平方向;
    所述拍摄设备处于所述第二姿态时,所述第二拍摄方向为朝下且与垂直方向成第五预设角度;
    所述拍摄设备处于所述第三姿态时,所述第三拍摄方向为所述垂直方向且朝下。
  59. 根据权利要求44至58中任一项所述的移动平台,其特征在于,所述通信接口还用于:
    接收所述移动平台的控制设备发送的全景拍摄指令。
  60. 根据权利要求44至58中任一项所述的移动平台,其特征在于,所述通信接口还用于:
    接收所述移动平台的控制设备发送的指令信息,所述指令信息包括全景位置信息和全景拍摄指令;
    所述处理器,还用于:
    检测所述移动平台是否位于所述全景位置信息指示的位置;
    若是,则获取所述指令信息中的全景拍摄指令。
  61. 根据权利要求59或60所述的移动平台,其特征在于,所述控制设备包括遥控设备或移动终端。
  62. 根据权利要求44至61中任一项所述的移动平台,其特征在于,所述移动平台为无人机。
  63. 一种控制设备,其特征在于,包括:处理器、通信接口和显示屏,
    所述通信接口,用于接收所述移动平台发送的针对目标对象的拍摄图像集合;
    所述处理器,用于若检测到针对所述拍摄图像集合的第一操作,则根据所述第一操作对所述拍摄图像集合进行处理,生成所述目标对象的全景图像;
    所述显示屏,用于显示所述全景图像。
  64. 根据权利要求63所述的控制设备,其特征在于,
    所述处理器,还用于获取用户针对所述控制设备的第一操作信息;
    所述通信接口,还用于根据所述第一操作信息向所述移动平台发送全景拍摄指令。
  65. 根据权利要求63所述的控制设备,其特征在于,
    所述处理器,还用于获取用户针对所述控制设备的第二操作信息;
    所述通信接口,还用于根据所述第二操作信息向所述移动平台发送指令信息,所述指令信息包括全景位置信息和全景拍摄指令。
  66. 根据权利要求65所述的控制设备,其特征在于,
    所述处理器,具体用于获取用户输入的全景位置信息;
    所述通信接口,具体用于根据所述全景位置信息向所述移动平台发送指令信息。
  67. 根据权利要求65所述的控制设备,其特征在于,
    所述处理器,具体用于获取用户针对显示地图的触控信息,并根据所述触控信息确定全景位置信息;
    所述通信接口,具体用于根据所述全景位置信息向所述移动平台发送指令信息。
  68. 根据权利要求65至67中任一项所述的控制设备,其特征在于,所述处理器还用于:
    根据所述全景位置信息获取所述全景位置的全景图像样本;
    根据所述全景图像样本进行拍摄提示。
  69. 根据权利要求65至68中任一项所述的控制设备,其特征在于,所述处理器还用于:
    根据所述全景位置信息获取所述全景位置的环境信息;
    根据所述环境信息进行拍摄提示。
  70. 根据权利要求63至69中任一项所述的控制设备,其特征在于,所述处理器还用于:
    若检测到针对所述全景图像的第二操作,则将所述全景图像的浏览模式进行切换。
  71. 根据权利要求70所述的控制设备,其特征在于,所述浏览模式包括手动浏览模式和体感浏览模式。
  72. 根据权利要求71所述的控制设备,其特征在于,所述显示屏还用于:
    当将所述浏览模式切换为所述体感浏览模式时,输出第一提示信息,所述第一提示信息用于提示用户调整所述控制设备的姿态。
  73. 根据权利要求72所述的控制设备,其特征在于,所述第一提示信息的提示时长为1.5秒至3秒。
  74. 根据权利要求72或73所述的控制设备,其特征在于,所述处理器还用于:当所述控制设备的姿态发生变化时,关闭所述第一提示信息。
  75. 根据权利要求72至74中任一项所述的控制设备,其特征在于,所述处理器还用于:
    当所述全景图像的浏览模式为所述体感浏览模式时,获取所述控制设备的姿态信息;
    根据所述姿态信息调整所述全景图像的显示画面。
  76. 根据权利要求72所述的控制设备,其特征在于,所述处理器还用于:
    当所述全景图像的浏览模式为所述手动浏览模式时,获取针对所述全景图像的手动操作信息;
    根据所述手动操作信息调整所述全景图像的显示画面。
  77. 根据权利要求76所述的控制设备,其特征在于,所述手动操作信息包括触控信息和/或手势信息。
  78. 根据权利要求63至77任一项所述的控制设备,其特征在于,所述处理器还用于:存储所述拍摄图像集合。
  79. 根据权利要求78所述的控制设备,其特征在于,所述处理器具体用于:利用预设标识存储所述拍摄图像集合。
  80. 根据权利要求63至79中任一项所述的控制设备,其特征在于,
    所述显示屏,还用于输出第二提示信息,所述第二提示信息用于提示用户选择所述全景图像的生成模式;
    所述控制设备还包括用户接口,所述用户接口,用于接收所述用户针对所述第二提示信息输入的选择指令;
    所述处理器,具体用于根据所述第一操作和所述选择指令对所述拍摄图像集合进行处理,生成所述目标对象的全景图像。
  81. 根据权利要求80所述的控制设备,其特征在于,所述生成模式包括球形全景图像生成模式和360度全景图像生成模式。
  82. 根据权利要求63至81中任一项所述的控制设备,其特征在于,所述显示屏,还用于若检测到针对所述全景图像的第三操作,则隐藏或显示所述全景图像的显示界面的菜单栏。
  83. 根据权利要求63至82中任一项所述的控制设备,其特征在于,所述显示屏,还用于在生成所述全景图像的过程中,输出加载所述全景图像的等待提示。
  84. 根据权利要求83所述的控制设备,其特征在于,所述等待提示包括预设图标和/或预设字样。
  85. 根据权利要求63至84中任一项所述的控制设备,其特征在于,所述控制设备包括遥控设备或移动终端。
  86. 根据权利要求63至85中任一项所述的控制设备,其特征在于,所述移动平台为无人机。
  87. 一种图像处理系统,其特征在于,包括:如权利要求44至62中任一项所述的移动平台和如权利要求63至86中任一项所述的控制设备。
  88. 一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机程序,其特征在于:所述计算机程序被处理器执行时实现如权利要求1至19中任一项所述方法的步骤。
  89. 一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机程序,其特征在于:所述计算机程序被处理器执行时实现如权利要求20至43中任一项所述方法的步骤。
PCT/CN2017/119753 2017-12-29 2017-12-29 一种图像处理方法、移动平台、控制设备及系统 WO2019127333A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202111197077.9A CN113890996A (zh) 2017-12-29 2017-12-29 一种图像处理方法、移动平台、控制设备及系统
PCT/CN2017/119753 WO2019127333A1 (zh) 2017-12-29 2017-12-29 一种图像处理方法、移动平台、控制设备及系统
CN201780022955.9A CN109076161B (zh) 2017-12-29 2017-12-29 一种图像处理方法、移动平台、控制设备及系统

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/119753 WO2019127333A1 (zh) 2017-12-29 2017-12-29 一种图像处理方法、移动平台、控制设备及系统

Publications (1)

Publication Number Publication Date
WO2019127333A1 true WO2019127333A1 (zh) 2019-07-04

Family

ID=64812395

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/119753 WO2019127333A1 (zh) 2017-12-29 2017-12-29 一种图像处理方法、移动平台、控制设备及系统

Country Status (2)

Country Link
CN (2) CN109076161B (zh)
WO (1) WO2019127333A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114697534A (zh) * 2020-12-30 2022-07-01 超聚变数字技术有限公司 一种升降平台和升降平台的控制方法
CN111858811B (zh) * 2020-07-20 2023-07-28 北京百度网讯科技有限公司 一种构建兴趣点图像的方法、装置、电子设备及存储介质

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3998578A4 (en) * 2019-07-16 2022-07-20 SZ DJI Technology Co., Ltd. METHOD, DEVICE, AND SYSTEM FOR PHOTOGRAPHY, AND COMPUTER READABLE INFORMATION MEDIA
CN111583692A (zh) * 2020-04-27 2020-08-25 新石器慧通(北京)科技有限公司 一种基于自动驾驶的远程视野获取方法、装置及系统
CN112044799A (zh) * 2020-08-20 2020-12-08 博众精工科技股份有限公司 一种换电站的电池表面清洁度的判断方法及系统
CN113228619A (zh) * 2020-08-25 2021-08-06 深圳市大疆创新科技有限公司 拍摄控制方法、装置、可移动平台及存储介质
CN113207059B (zh) * 2020-12-28 2023-05-16 汉桑(南京)科技股份有限公司 一种音响参数确定方法和系统
US11895466B2 (en) 2020-12-28 2024-02-06 Hansong (Nanjing) Technology Ltd. Methods and systems for determining parameters of audio devices
CN112995503B (zh) * 2021-02-07 2023-04-07 苏州臻迪智能科技有限公司 手势控制全景图像获取方法、装置、电子设备及存储介质
CN113891000A (zh) * 2021-11-02 2022-01-04 维沃移动通信有限公司 拍摄方法、装置和电子设备
CN114928696A (zh) * 2022-05-11 2022-08-19 北京有竹居网络技术有限公司 拍摄方法、装置和拍摄设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103533239A (zh) * 2013-09-30 2014-01-22 宇龙计算机通信科技(深圳)有限公司 全景拍摄的方法和系统
CN105391939A (zh) * 2015-11-04 2016-03-09 腾讯科技(深圳)有限公司 无人机拍摄控制方法和装置、无人机拍摄方法和无人机
US20160173757A1 (en) * 2014-12-15 2016-06-16 Samsung Electro-Mechanics Co., Ltd. Camera module
CN105847691A (zh) * 2016-04-15 2016-08-10 乐视控股(北京)有限公司 摄像装置控制方法及装置
CN106303195A (zh) * 2015-05-28 2017-01-04 中兴通讯股份有限公司 拍摄设备及跟踪拍摄方法和系统

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20140123835A (ko) * 2013-04-15 2014-10-23 재단법인대구경북과학기술원 무인 항공기 제어 장치 및 그 방법
CN104796611A (zh) * 2015-04-20 2015-07-22 零度智控(北京)智能科技有限公司 移动终端遥控无人机实现智能飞行拍摄的方法及系统
CN105120144A (zh) * 2015-07-31 2015-12-02 小米科技有限责任公司 图像拍摄方法和装置
CN205263655U (zh) * 2015-08-03 2016-05-25 余江 一种用于自动生成全景照片的系统、无人飞行器及地面站
CN106708070B (zh) * 2015-08-17 2021-05-11 深圳市道通智能航空技术股份有限公司 一种航拍控制方法和装置
CN106657733A (zh) * 2016-11-25 2017-05-10 深圳市元征科技股份有限公司 一种基于无人机的全景直播方法及终端
CN106713659B (zh) * 2017-01-20 2019-11-05 维沃移动通信有限公司 一种全景拍摄方法及移动终端

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103533239A (zh) * 2013-09-30 2014-01-22 宇龙计算机通信科技(深圳)有限公司 全景拍摄的方法和系统
US20160173757A1 (en) * 2014-12-15 2016-06-16 Samsung Electro-Mechanics Co., Ltd. Camera module
CN106303195A (zh) * 2015-05-28 2017-01-04 中兴通讯股份有限公司 拍摄设备及跟踪拍摄方法和系统
CN105391939A (zh) * 2015-11-04 2016-03-09 腾讯科技(深圳)有限公司 无人机拍摄控制方法和装置、无人机拍摄方法和无人机
CN105847691A (zh) * 2016-04-15 2016-08-10 乐视控股(北京)有限公司 摄像装置控制方法及装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111858811B (zh) * 2020-07-20 2023-07-28 北京百度网讯科技有限公司 一种构建兴趣点图像的方法、装置、电子设备及存储介质
CN114697534A (zh) * 2020-12-30 2022-07-01 超聚变数字技术有限公司 一种升降平台和升降平台的控制方法

Also Published As

Publication number Publication date
CN109076161A (zh) 2018-12-21
CN113890996A (zh) 2022-01-04
CN109076161B (zh) 2021-11-02

Similar Documents

Publication Publication Date Title
WO2019127333A1 (zh) 一种图像处理方法、移动平台、控制设备及系统
US10623621B2 (en) Control method for photographing using unmanned aerial vehicle, photographing method using unmanned aerial vehicle, mobile terminal, and unmanned aerial vehicle
US9712745B2 (en) Method and apparatus for operating camera function in portable terminal
CN106060406B (zh) 一种拍照方法及移动终端
KR102092330B1 (ko) 촬영 제어 방법 및 그 전자 장치
US8773502B2 (en) Smart targets facilitating the capture of contiguous images
WO2016058468A1 (zh) 移动终端、服务器、拍摄方法及计算机存储介质
US9742995B2 (en) Receiver-controlled panoramic view video share
EP2822267A2 (en) Method and apparatus for previewing a dual-shot image
US20210084228A1 (en) Tracking shot method and device, and storage medium
KR20140081470A (ko) 문자 확대 표시 방법, 상기 방법이 적용되는 장치, 및 상기 방법을 수행하는 프로그램을 저장하는 컴퓨터로 읽을 수 있는 저장 매체
US20180124310A1 (en) Image management system, image management method and recording medium
JP6555026B2 (ja) 情報提供システム
JP6107518B2 (ja) 情報処理装置、情報処理方法、及びプログラム
US20230332888A1 (en) Information processing apparatus
JP2008225862A (ja) 電子黒板付き工事写真撮像及び工事管理台帳自動作成システム並びにこれに使用するプログラム
JP6721004B2 (ja) 画像管理システム、及び画像管理方法
JP2014030104A (ja) 受信装置、画像共有システム、受信方法、及びプログラム
CN106412429B (zh) 一种基于温室大棚的图像处理方法及装置
US11950030B2 (en) Electronic apparatus and method of controlling the same, and recording medium
JP2016173827A (ja) 送信装置
JP5942637B2 (ja) 付加情報管理システム、画像共有システム、付加情報管理方法、及びプログラム
CN112637491A (zh) 拍摄方法和拍摄装置
JP6233451B2 (ja) 画像共有システム、通信方法及びプログラム
JP2021060738A (ja) プログラム、画像処理システム、通信端末

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17936863

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17936863

Country of ref document: EP

Kind code of ref document: A1