WO2018113657A1 - Image processing method and device - Google Patents

Image processing method and device Download PDF

Info

Publication number
WO2018113657A1
WO2018113657A1 PCT/CN2017/117151 CN2017117151W WO2018113657A1 WO 2018113657 A1 WO2018113657 A1 WO 2018113657A1 CN 2017117151 W CN2017117151 W CN 2017117151W WO 2018113657 A1 WO2018113657 A1 WO 2018113657A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
target
target object
image
remaining
Prior art date
Application number
PCT/CN2017/117151
Other languages
French (fr)
Chinese (zh)
Inventor
侯伟
Original Assignee
纳恩博(北京)科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 纳恩博(北京)科技有限公司 filed Critical 纳恩博(北京)科技有限公司
Publication of WO2018113657A1 publication Critical patent/WO2018113657A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265Mixing
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
    • G05D1/0253Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means extracting relative motion information from a plurality of images taken successively, e.g. visual odometry, optical flow
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/13Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with multiple sensors

Definitions

  • the present invention relates to the field of images, and in particular to an image processing method and apparatus.
  • the stereoscopic image can be recorded by placing the camera at a fixed position around it.
  • the stereoscopic image cannot be recorded and recorded in the above manner.
  • Embodiments of the present invention provide an image processing method and apparatus to solve at least the technical problem that a stereoscopic image of a moving object cannot be recorded in the prior art.
  • an image processing method applied to a target electronic device having a driving device the driving device being configured to provide a driving force to the target electronic device to enable the target electronic device to enable Moving according to the movement condition of the target object
  • the target electronic device further has an image acquisition unit
  • the target electronic device is any one of the plurality of electronic devices, and the target electronic device and the target object
  • the relative position of the electronic device remains unchanged, and the relative positions of the remaining electronic devices other than the target electronic device and the target object remain unchanged
  • the method comprising: The target electronic device acquires a plurality of first images obtained by the plurality of the electronic devices capturing the target object from different angles; the target electronic device synthesizes the plurality of the first images to obtain a stereoscopic image of the target object .
  • the plurality of the electronic devices are N the electronic devices
  • the target electronic device acquires, by the plurality of the electronic devices, the plurality of the first images obtained by capturing the target object from different angles, including:
  • the target electronic device identifies the target object according to its own image acquisition unit, and the target electronic device captures the target object at an angle of the target electronic device relative to the target object to obtain a first image;
  • the target electronic device Obtaining, according to the manner in which the plurality of the electronic devices communicate with each other by the group network, the N-1 first images obtained by the remaining electronic devices capturing the target object from different angles, wherein the i-th electronic device according to the The image acquisition unit identifies the target object, and the ith electronic device captures the target object at an ith angle to obtain the first image, wherein the ith angle is a relative position of the ith electronic device
  • the angle of the target object, wherein i takes 1 to N-1 in turn, and the N angles of the plurality of electronic devices with respect to the target object are N
  • the target electronic device synthesizes the plurality of the first images, and obtaining the stereoscopic image of the target object includes: acquiring, by the target electronic device, a shooting time of each of the first images; The electronic device combines the plurality of the first images having the same shooting time to obtain the stereoscopic image.
  • the target electronic device synthesizes the plurality of the first images with the same shooting time, and obtaining the stereoscopic image includes: removing, by the target electronic device, a background portion in the first image to obtain a background removal. a first image; the target electronic device synthesizes a plurality of background-removed first images with the same shooting time to obtain the stereo image.
  • the target electronic device before the target electronic device acquires the plurality of first images obtained by the plurality of the electronic devices from the different angles, the target electronic device further includes: the target electronic device according to the movement of the target object Generating a first motion trajectory, wherein the target electronic device moves according to the first motion trajectory; the target electronic device calculates each of the plurality of electronic devices other than the target electronic device a relative position of the device relative to the target electronic device; the target electronic device transmitting the relative position to the remaining electronic devices of the plurality of the electronic devices except the target electronic device; wherein the relative position is used
  • Each of the plurality of electronic devices except the target electronic device generates a motion trajectory in conjunction with the first motion trajectory, and performs motion according to the generated motion trajectory.
  • the method further includes: acquiring, by the target electronic device, a standard time; The target electronic device calibrates the time of each of the plurality of the electronic devices according to the standard time.
  • an image processing apparatus applied to a target electronic device having a driving device, the driving device being configured to provide a driving force to the target electronic device to enable the electronic device to enable the electronic device Moving according to the movement condition of the target object
  • the electronic device further has an image collection unit
  • the target electronic device is any one of the plurality of electronic devices, and between the target electronic device and the target object
  • the relative position of the remaining electronic devices of the plurality of electronic devices other than the target electronic device and the target object remain unchanged, and the device includes: first obtaining a unit, configured to acquire a plurality of first images obtained by capturing the target object from different angles by the plurality of electronic devices; and a first synthesizing unit configured to combine the plurality of the first images to obtain the target object Stereoscopic image.
  • the plurality of the electronic devices are N the electronic devices
  • the first acquiring unit comprises: a first shooting subunit, configured to identify the target object according to an image acquisition unit of the same, the target electronic device The device captures the target object at an angle of the target electronic device with respect to the target object, to obtain a first image, and the first acquiring subunit is configured to acquire according to the manner in which the plurality of the electronic devices communicate with each other by a group network
  • the remaining electronic device captures N-1 first images obtained by the target object from different angles
  • the i-th electronic device of the remaining electronic devices includes: an i-th identification sub-unit, which is disposed at the i-th station
  • the electronic device is configured to identify the target object according to the image capturing unit of the ith electronic device; the ith shooting subunit is disposed on the ith electronic device, and is configured to photograph the ith angle Target object, obtaining the first image, wherein the ith angle is an angle of the ith electronic device relative to the target object, wherein i is sequential
  • the first synthesizing unit includes: a second acquiring subunit configured to acquire a photographing time of each of the first images; and a first synthesizing subunit configured to set the plurality of the photographing times to be the same An image is synthesized to obtain the stereoscopic image.
  • the first synthesizing subunit includes: a first removing module configured to remove a background portion in the first image to obtain a first image after background removal; and a first synthesizing module configured to set a shooting time The same plurality of background-removed first images are combined to obtain the stereoscopic image.
  • the device further includes: a generating unit, configured to be disposed on the target electronic device of the plurality of the electronic devices, configured to generate a first motion trajectory according to a movement condition of the target object, where The target electronic device performs motion according to the first motion trajectory; and the calculating unit is disposed on the target electronic device, and is configured to calculate each of the plurality of electronic devices other than the target electronic device a first transmitting unit, disposed on the target electronic device, configured to send the relative position to a plurality of the electronic devices other than the target electronic device
  • An electronic device wherein each of the plurality of electronic devices other than the target electronic device is provided with a control unit, and each of the plurality of electronic devices except the target electronic device Relative position of the target electronic device is used by the control unit to generate a motion trajectory in conjunction with the first motion trajectory, and control Said plurality of electronic devices each electronic device other than the target electronic apparatus in accordance with the generated motion trajectory.
  • the device further includes: a second acquiring unit, configured to acquire a standard time before the first acquiring unit acquires a movement condition of the target object obtained by the electronic device detecting the target object; the first calibration unit, A time is set to calibrate each of the plurality of electronic devices according to the standard time.
  • a second acquiring unit configured to acquire a standard time before the first acquiring unit acquires a movement condition of the target object obtained by the electronic device detecting the target object
  • the first calibration unit A time is set to calibrate each of the plurality of electronic devices according to the standard time.
  • an image processing method which is applied to a remaining electronic device having a driving device, wherein the remaining electronic device is an electronic device other than the target electronic device among the plurality of electronic devices.
  • the driving device is configured to provide a driving force for the remaining electronic devices to enable the remaining electronic devices to move according to a movement condition of the target object, wherein the remaining electronic devices further have an image capturing unit, and the remaining electronic devices
  • the relative position with the target object remains unchanged, and the relative position between the target electronic device and the target object remains unchanged
  • the method comprising: the remaining electronic device with the remaining electronic device Capturing the target object with respect to an angle of the target object to obtain a first image; the remaining electronic device transmitting the obtained first image to the target electronic device such that the target electronic device is at least according to the The first image synthesizes a stereoscopic image of the target object.
  • the remaining electronic device capturing the target object at an angle of the remaining electronic device relative to the target object to obtain the first image includes: the remaining electronic device receiving the first motion trajectory, wherein The first motion trajectory is generated by the target electronic device according to the movement condition of the target object; the remaining electronic device receives the relative position of the remaining electronic device sent by the target electronic device relative to the target electronic device The remaining electronic device generates a motion trajectory according to the first motion trajectory and the relative position; and in a case where the remaining electronic device performs motion according to the generated motion trajectory, the remaining electronic device is relative to the target The angle of the object captures the target object to obtain a first image.
  • the method further includes: the remaining electronic device recording the shooting time of the remaining electronic device to capture the target object at an angle of the remaining electronic device relative to the target object, wherein the shooting time A stereoscopic image for the target electronic device to synthesize the target object.
  • the method further includes: the remaining electronic device acquiring the standard time; The remaining electronic devices calibrate the time of the remaining electronic devices according to the standard time.
  • the sending, by the remaining electronic device, the obtained first image to the target electronic device includes: removing, by the remaining electronic device, a background portion in the obtained first image, and obtaining a background removed An image; the remaining electronic device transmits the first image after the background removal to the target electronic device.
  • an image processing method for use in a system including a plurality of electronic devices having a driving device, the driving device being configured to provide driving power for a plurality of the electronic devices
  • the plurality of the electronic devices further have an image acquisition unit
  • the plurality of the electronic devices include: target electronic devices and The remaining electronic device, the target electronic device is any one of the plurality of the electronic devices, the relative position between the plurality of target electronic devices and the target object remains unchanged, and the method includes : the target electronic device photographs the target object at an angle of the target electronic device relative to the target object to obtain a first image; and the remaining electronic devices are photographed at an angle of the remaining electronic device relative to the target object
  • the target object obtains a first image
  • the remaining electronic device captures the target object to obtain the first image
  • the image is sent to the target electronic device; the target electronic device combines a plurality of first
  • the method further includes: The target electronic device records a shooting time of the target object at an angle of the target electronic device relative to the target object; the remaining electronic device records the target object at an angle of the remaining electronic device relative to the target object a plurality of first images obtained by capturing the target object from different angles by the plurality of electronic devices, and obtaining a stereoscopic image of the target object includes: the target electronic device A plurality of the first images of the same time are captured by the plurality of electronic devices to be combined to obtain a stereoscopic image of the target object.
  • the target electronic device and the remaining electronic device respectively remove the background portion in the respective first images to obtain the first image after the background removal, or the target electronic device removes the plurality of the electronic devices to take the image.
  • a background image in the first image obtaining a first image after the background is removed;
  • the target electronic device synthesizing a plurality of first images of the same time of the electronic device to obtain a stereoscopic image of the target object
  • the method includes: the target electronic device synthesizes a plurality of background-removed first images with the same shooting time to obtain the stereoscopic image.
  • the target electronic device photographs the target object at an angle of the target electronic device relative to the target object to obtain a first image
  • the remaining electronic devices are opposite to the remaining electronic device
  • the method further includes: the target electronic device generating a first motion trajectory according to the movement condition of the target object, wherein the target electronic device follows the first motion The trajectory is moved; the target electronic device calculates a relative position of each of the plurality of electronic devices other than the target electronic device relative to the target electronic device; the target electronic device The relative position is sent to the remaining electronic devices other than the target electronic device among the plurality of electronic devices; each of the plurality of electronic devices except the target electronic device is according to the first motion track And generating a motion trajectory with respect to the relative position of the target electronic device, and following the generated motion trajectory Line movement.
  • the target electronic device photographs the target object at an angle of the target electronic device relative to the target object to obtain a first image
  • the remaining electronic devices are opposite to the remaining electronic device
  • the method further includes: the target electronic device and/or the remaining electronic device acquiring standard time; the target electronic device and/or the remaining electronic device according to the The standard time is used to calibrate the time of each of the plurality of electronic devices.
  • an image processing apparatus for use in a remaining electronic device having a driving device, wherein the remaining electronic device is an electronic device other than the target electronic device among the plurality of electronic devices.
  • the driving device is configured to provide a driving force for the remaining electronic devices to enable the remaining electronic devices to move according to a movement condition of the target object, wherein the remaining electronic devices further have an image capturing unit, and the remaining electronic devices are The relative position between the target objects remains unchanged, the relative position between the target electronic device and the target object remains unchanged, and the apparatus includes: a photographing unit configured to be opposite to the remaining electronic devices Shooting the target object at an angle of the target object to obtain a first image; the second sending unit is configured to send the obtained first image to the target electronic device, so that the target electronic device is at least according to the The first image synthesizes a stereoscopic image of the target object.
  • the shooting unit includes: a first receiving module configured to receive a first motion trajectory, wherein the first motion trajectory is generated by the target electronic device according to a movement condition of the target object; a receiving module, configured to receive a relative position of the remaining electronic device sent by the target electronic device with respect to the target electronic device; and a generating module configured to generate a motion according to the first motion trajectory and the relative position a trajectory; a photographing module configured to photograph the target object at an angle of the remaining electronic device relative to the target object to obtain a first image in a motion according to the generated motion trajectory.
  • the device further includes: a recording unit configured to record a shooting time of the remaining electronic device to capture the target object at an angle of the remaining electronic device with respect to the target object, wherein the shooting time A stereoscopic image for the target electronic device to synthesize the target object.
  • a recording unit configured to record a shooting time of the remaining electronic device to capture the target object at an angle of the remaining electronic device with respect to the target object, wherein the shooting time A stereoscopic image for the target electronic device to synthesize the target object.
  • the method further includes: a third acquiring unit, configured to acquire a standard Time; a second calibration unit configured to calibrate the time of the remaining electronic devices according to the standard time.
  • the second sending unit includes: a second removing module, configured to remove the obtained background portion in the first image to obtain a first image after background removal; and a sending module, configured to remove the background The first image is sent to the target electronic device.
  • an image processing system including a plurality of electronic devices having a driving device, the driving device being configured to provide driving power to a plurality of the electronic devices to cause a plurality of the devices
  • the electronic device can be moved according to the moving condition of the target object, wherein the plurality of the electronic devices further have an image collecting unit, and the plurality of the electronic devices include: the target electronic device and the remaining electronic devices except the target electronic device.
  • the target electronic device is any one of the plurality of the electronic devices, and a relative position between the plurality of target electronic devices and the target object remains unchanged, wherein the target electronic device is set to Taking the target object at an angle of the target electronic device relative to the target object to obtain a first image; the remaining electronic device is configured to capture the target at an angle of the remaining electronic device relative to the target object Obtaining a first image, and the remaining electronic device photographing the target object to send the first image to The target electronic device is further configured to combine a plurality of first images obtained by capturing the target object from different angles by the plurality of electronic devices to obtain a stereoscopic image of the target object.
  • the target electronic device is further configured to synthesize a plurality of first images obtained by capturing, by the target electronic device, the plurality of the electronic devices from different angles to obtain the target object, to obtain the target object. Recording a shooting time of the target object at an angle of the target electronic device relative to the target object before the stereoscopic image; the remaining electronic device recording the target at an angle of the remaining electronic device relative to the target object a shooting time of the object; the target electronic device is further configured to combine a plurality of first images obtained by capturing the target object from different angles by the plurality of electronic devices, and obtaining a stereoscopic image of the target object includes: The target electronic device combines a plurality of first images of the same time of the electronic device to obtain a stereoscopic image of the target object.
  • the target electronic device and the remaining electronic device are further configured to respectively remove the background portion in the respective first images to obtain a first image after the background removal, or the target electronic device is further configured to And removing a background portion in the first image captured by the plurality of electronic devices to obtain a first image after the background removal; the target electronic device is further configured to: the plurality of the electronic devices are photographed at the same time.
  • the image is synthesized, and obtaining the stereoscopic image of the target object includes: the target electronic device synthesizing the first image after removing the plurality of backgrounds with the same shooting time to obtain the stereoscopic image.
  • the target electronic device is further configured to: at the target electronic device, photograph the target object at an angle of the target electronic device relative to the target object, to obtain a first image, and the remaining electronic device Before the remaining electronic device photographs the target object with respect to an angle of the target object to obtain a first image, generating a first motion trajectory according to the movement condition of the target object, wherein the target electronic device follows the first Moving the trajectory; the target electronic device is further configured to calculate a relative position of each of the plurality of electronic devices other than the target electronic device relative to the target electronic device; The target electronic device is further configured to send the relative position to the remaining electronic devices other than the target electronic device among the plurality of the electronic devices; each of the plurality of the electronic devices except the target electronic device The electronic device is further configured to generate a position according to the first motion trajectory and itself relative to the target electronic device Trajectory, and in accordance with the generated motion trajectory.
  • the target electronic device and/or the remaining electronic device are further configured to: at the target electronic device, capture the target object at an angle of the target electronic device relative to the target object, to obtain a first image. And acquiring, by the remaining electronic device, a standard time before the first electronic image is captured by the remaining electronic device at an angle relative to the target object; the target electronic device and/or the remaining electronic device, It is further arranged to calibrate the time of each of the plurality of electronic devices according to the standard time.
  • a storage medium including a stored program, wherein, when the program is running, controlling a device in which the storage medium is located performs any of the above Image processing method.
  • a processor for executing a program, wherein the program is executed to perform the image processing method according to any one of the above.
  • an image processing method includes: acquiring a movement condition of the target object obtained by detecting an object by an electronic device, wherein the plurality of the electronic devices move according to the target object Moving to maintain a relative position between each of the plurality of electronic devices and the target object; acquiring a first image obtained by capturing the target object from different angles by the plurality of electronic devices, and obtaining a plurality of images The first image; synthesizing a plurality of the first images to obtain a stereoscopic image of the target object.
  • the plurality of the electronic devices are the N electronic devices, and the plurality of the electronic devices acquire the first image obtained by capturing the target object from different angles, and obtaining the plurality of the first images includes: The i-stage electronic device identifies the target object according to its own image acquisition unit; the i-th electronic device captures the target object at an ith angle to obtain the first image, wherein the ith angle is the The angle of the i-th electronic device with respect to the target object, wherein i takes 1 to N in order, the first angle to the Nth angle are N mutually different angles, and N is an integer greater than 1.
  • combining the plurality of the first images to obtain a stereoscopic image of the target object includes: acquiring a shooting time of each of the first images; and performing a plurality of the first images with the same shooting time Synthesize to obtain the stereoscopic image.
  • combining the plurality of the first images with the same shooting time to obtain the stereoscopic image includes: removing a background portion in the first image to obtain a first image after the background removal; and taking the same shooting time The plurality of background-removed first images are combined to obtain the stereoscopic image.
  • the acquiring, by the electronic device, the movement of the target object obtained by detecting the target object comprises: generating, by the target electronic device, the first motion trajectory according to the movement condition of the target object, wherein the The target electronic device moves according to the first motion trajectory; the target electronic device calculates a relative state of each of the plurality of electronic devices other than the target electronic device relative to the target electronic device a location; the target electronic device transmits the relative location to a remaining one of the plurality of electronic devices other than the target electronic device; each of the plurality of the electronic devices except the target electronic device The electronic device generates a motion trajectory according to the first motion trajectory and its relative position with respect to the target electronic device, and performs motion according to the generated motion trajectory.
  • the method before acquiring the movement condition of the target object obtained by the electronic device detecting the target object, the method further includes: acquiring a standard time; and calibrating each of the plurality of the electronic devices according to the standard time The time of the device.
  • an image processing apparatus including: a fourth acquiring unit, configured to acquire a movement condition of the target object obtained by detecting an object by an electronic device, where The electronic device moves according to the movement condition of the target object to keep the relative positions of the plurality of the electronic devices and the target object unchanged; the fifth obtaining unit is configured to acquire the plurality of the electronic devices from Shooting the first image obtained by the target object at different angles to obtain a plurality of the first images; and the second combining unit is configured to combine the plurality of the first images to obtain a stereoscopic image of the target object.
  • the plurality of the electronic devices are the N electronic devices
  • the fifth obtaining unit includes: an i-th identification sub-unit, disposed on the i-th electronic device, and configured to be according to the i-th electronic device
  • the image capturing unit of the device identifies the target object;
  • the ith shooting subunit is disposed on the ith electronic device, and is configured to capture the target object at an ith angle to obtain the first image, wherein
  • the i-th angle is an angle of the i-th electronic device with respect to the target object, wherein i is taken from 1 to N in sequence, and the first to N-th angles are N different angles, and N is greater than 1. Integer.
  • the second synthesizing unit includes: a third acquiring subunit configured to acquire a photographing time of each of the first images; and a second synthesizing subunit configured to set the plurality of photographs with the same photographing time An image is synthesized to obtain the stereoscopic image.
  • the second synthesizing subunit includes: a third removing module configured to remove a background portion in the first image to obtain a first image after background removal; and a second synthesizing module configured to set a shooting time The same plurality of background-removed first images are combined to obtain the stereoscopic image.
  • the fourth acquiring unit includes: a generating subunit, configured on the target electronic device in the plurality of the electronic devices, configured to generate a first motion track according to the moving condition of the target object, where The target electronic device performs motion according to the first motion trajectory; and the calculation subunit is disposed on the target electronic device, and is configured to calculate each of the plurality of the electronic devices except the target electronic device.
  • a relative position of the electronic device relative to the target electronic device a transmitting subunit disposed on the target electronic device, configured to transmit the relative position to the plurality of the electronic devices other than the target electronic device a remaining electronic device, a control subunit, disposed on each of the plurality of the electronic devices except the target electronic device, configured to be according to the first motion trajectory and the plurality of electronic devices Generating a motion trajectory of each electronic device other than the target electronic device with respect to the relative position of the target electronic device, and controlling a plurality of stations Each electronic device in the electronic device other than the target electronic apparatus in accordance with the generated motion trajectory.
  • the device further includes: a sixth acquiring unit, configured to acquire a standard time before the first acquiring unit acquires a movement condition of the target object obtained by the electronic device detecting the target object; and a third calibration unit, A time is set to calibrate each of the plurality of electronic devices according to the standard time.
  • a sixth acquiring unit configured to acquire a standard time before the first acquiring unit acquires a movement condition of the target object obtained by the electronic device detecting the target object
  • a time is set to calibrate each of the plurality of electronic devices according to the standard time.
  • the target object is in a moving state
  • the plurality of electronic devices detect the motion of the target object to obtain the motion of the target object, and adjust the motion state of the target object according to the motion condition of the target object, so that the target object remains relatively stationary with the target object.
  • Each electronic device captures a target object from different angles, obtains multiple images, and combines the multiple images to obtain a stereoscopic image of the target object, thereby achieving the technical effect of recording a stereoscopic image of the moving object, thereby solving the existing The technical problem of the stereoscopic image of a moving object cannot be recorded in the technology.
  • FIG. 1 is a flow chart of an image processing method according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram showing positions of a plurality of electronic devices and a target object according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of motion trajectories of a plurality of electronic devices and a target object according to an embodiment of the present invention
  • FIG. 4 is a flowchart of an image processing method based on a target electronic device according to an embodiment of the present invention
  • FIG. 5 is a structural block diagram of an image processing apparatus on a target electronic device side according to an embodiment of the present invention.
  • FIG. 6 is a structural block diagram of a first acquiring unit 52 in an image processing apparatus on a target electronic device side according to an embodiment of the present invention
  • FIG. 7 is a structural block diagram of a first synthesizing unit 54 in an image processing apparatus on a target electronic device side according to an embodiment of the present invention
  • FIG. 8 is a structural block diagram of a first synthesizing subunit 74 in a first synthesizing unit 54 in an image processing apparatus on a target electronic device side according to an embodiment of the present invention
  • FIG. 9 is a block diagram 1 of a preferred structure of an image processing apparatus on a target electronic device side according to an embodiment of the present invention.
  • FIG. 10 is a block diagram 2 of a preferred structure of an image processing apparatus on a target electronic device side according to an embodiment of the present invention
  • FIG. 11 is a flowchart of an image processing method based on remaining electronic devices according to an embodiment of the present invention.
  • FIG. 12 is a block diagram showing the structure of an image processing apparatus based on remaining electronic devices according to an embodiment of the present invention.
  • FIG. 13 is a block diagram showing a preferred configuration of a photographing unit 122 in an image processing apparatus based on remaining electronic devices according to an embodiment of the present invention
  • FIG. 14 is a block diagram 1 showing a preferred structure of an image processing apparatus based on remaining electronic devices according to an embodiment of the present invention
  • 15 is a block diagram 2 of a preferred structure of an image processing apparatus based on remaining electronic devices according to an embodiment of the present invention
  • 16 is a block diagram showing a preferred configuration of a second transmitting unit 124 in an image processing apparatus based on remaining electronic devices according to an embodiment of the present invention
  • FIG. 17 is a flowchart of an image processing method of a system based on a target electronic device and remaining electronic devices, according to an embodiment of the present invention.
  • FIG. 18 is a schematic structural diagram of an image processing system according to an embodiment of the present invention.
  • 19 is a preferred schematic diagram of an image processing apparatus in accordance with an embodiment of the present invention.
  • an embodiment of an image processing method is provided, it being noted that the steps illustrated in the flowchart of the figures may be performed in a computer system such as a set of computer executable instructions, and, although The logical order is shown in the flowcharts, but in some cases the steps shown or described may be performed in a different order than the ones described herein.
  • FIG. 1 is a flow chart of an image processing method in accordance with an embodiment of the present invention.
  • the image processing method is applied to an electronic device having a driving device configured to provide a driving force for the electronic device to enable the electronic device to move, and the electronic device further has an image capturing unit.
  • the method includes the following steps:
  • Step S102 Acquire a movement condition of the target object obtained by the electronic device detecting the target object, wherein the plurality of electronic devices perform motion according to the movement condition of the target object to keep the relative positions between the plurality of electronic devices and the target object unchanged.
  • Step S104 Acquire a first image obtained by capturing, by a plurality of electronic devices, a target object from different angles to obtain a plurality of first images.
  • step S106 a plurality of first images are combined to obtain a stereoscopic image of the target object.
  • the target object is a moving object that can move freely within a certain range.
  • the electronic device can be a robot.
  • the electronic device can have a binocular camera that is set to shoot.
  • the plurality of electronic devices move according to the movement of the target object to keep the relative positions of the plurality of electronic devices and the target object unchanged, that is, each of the electronic devices is stationary with respect to the target object.
  • each electronic device captures the target object to obtain a first image, and multiple electronic devices obtain a plurality of first images in total. Each first image records the image of the target object from different angles.
  • a stereoscopic image of the target object By synthesizing a plurality of first images, a stereoscopic image of the target object can be obtained, and the stereoscopic image includes information on the omnidirectional object.
  • the target object is in a moving state
  • the plurality of electronic devices detect the motion of the target object to obtain the motion of the target object, and adjust the motion state of the target object according to the motion condition of the target object, so that the target object remains relatively stationary with the target object.
  • Each electronic device captures a target object from different angles, obtains multiple images, and combines the multiple images to obtain a stereoscopic image of the target object, thereby solving the technical problem that the stereoscopic image of the moving object cannot be recorded in the prior art.
  • the technical effect of recording a stereoscopic image of a moving object is achieved.
  • the plurality of electronic devices are N electronic devices
  • the first image obtained by the plurality of electronic devices capturing the target object from different angles is obtained, and obtaining the plurality of first images includes: the i-th electronic device according to its own image acquisition unit Identifying the target object; the i-th electronic device photographs the target object at the ith angle to obtain a first image, wherein the i-th angle is an angle of the i-th electronic device relative to the target object, wherein i takes 1 to N in turn, first The angle to the Nth angle is N different angles, and N is an integer greater than 1.
  • FIG. 2 shows three electronic devices, which are an electronic device E1, an electronic device E2, and an electronic device E3, respectively, and A is a target object.
  • the target object A is moving, and the electronic device E1, the electronic device E2, and the electronic device E3 adjust their own motion according to the motion of the target object A to keep the relative position between itself and the target object A unchanged.
  • the angles and orientations of the electronic device E1, the electronic device E2, and the electronic device E3 are different with respect to the target object, and the three electronic devices respectively capture the target object to obtain three first images.
  • the three first images record the image of the target object from different angles, and combine the three first images to obtain a stereoscopic image of the target object A.
  • combining the plurality of first images to obtain a stereoscopic image of the target object includes: acquiring a shooting time of each of the first images; and synthesizing the plurality of first images having the same shooting time to obtain a stereoscopic image.
  • Each electronic device will capture multiple first images, which may be taken at different times.
  • the recording time is recorded. By reading the shooting time, it is possible to know when the electronic device takes an image.
  • a plurality of first images of the same shooting time taken by different electronic devices are combined to obtain a stereoscopic image of the target object.
  • the electronic device E1 shown in FIG. 2 captures the first image P11 at time T1, the first image P12 at time T2, and the first image P13 at time T3.
  • the electronic device E2 captures the first image P21 at time T1, captures the first image P22 at time T2, and captures the first image P23 at time T3.
  • the electronic device E3 captures the first image P31 at time T1, captures the first image P32 at time T2, and captures the first image P33 at time T3.
  • the first image P11, the first image P21, and the first image P31 at the time T1 are combined to obtain a stereoscopic image of the target object at time T1.
  • the first image P12, the first image P22, and the first image P32 at the time T2 are combined to obtain a stereoscopic image of the target object at time T2.
  • the first image P13, the first image P23, and the first image P33 at the time T3 are combined to obtain a stereoscopic image of the target object at time T3.
  • the method before acquiring the movement condition of the target object obtained by the electronic device detecting the target object, the method further includes: acquiring a standard time; and calibrating the time of each of the plurality of electronic devices according to the standard time.
  • the time in an electronic device may or may not be accurate. If the time in the plurality of electronic devices is not synchronized, in the process of synthesizing a plurality of first images having the same shooting time to obtain a stereoscopic image, an error occurs, that is, a plurality of first images having different actual shooting times The image is synthesized to get the wrong image.
  • the time of each of the plurality of electronic devices is calibrated using standard time, so that the time in the plurality of electronic devices is synchronized.
  • combining the plurality of first images with the same shooting time to obtain the stereoscopic image includes: removing the background portion in the first image to obtain the first image after the background removal; and removing the plurality of backgrounds with the same shooting time
  • the first image is synthesized to obtain a stereoscopic image.
  • the background portions in the plurality of first images may be removed first, and then the plurality of first images are combined to remove the interference of the background, thereby obtaining a clearer and more prominent A stereoscopic image of the target object.
  • the subject target object
  • the background is removed from the current 3D image, and the subject is cut out.
  • the method by which multiple electronic devices generate their own motion trajectory can be any of the following:
  • Multiple electronic devices can detect the motion of the target object in real time, and then generate their own motion trajectory in real time according to the motion condition of the target object and the position of the target object relative to the target object, so that the target object is relatively stationary.
  • an electronic device E1, an electronic device E2, and an electronic device E3 there are three electronic devices, namely, an electronic device E1, an electronic device E2, and an electronic device E3, and A is a target object.
  • the target object A is moving, and the electronic device E1, the electronic device E2, and the electronic device E3 move according to the motion of the target object A to keep the relative position between itself and the target object A unchanged.
  • the electronic device E1, the electronic device E2, and the electronic device E3 detect the motion of the target object A in real time, and generate its own motion trajectory according to the motion of the target object A, so that itself and the target object A remain relatively stationary.
  • the trajectory G0 shows the motion trajectory of the target object A;
  • the trajectory G1 shows the motion trajectory of the electronic device E1;
  • the trajectory G2 shows the motion trajectory of the electronic device E2;
  • the trajectory G3 shows the motion trajectory of the electronic device E3.
  • the target electronic device in the plurality of electronic devices generates a first motion trajectory according to the movement condition of the target object, wherein the target electronic device performs motion according to the first motion trajectory; and the target electronic device calculates other than the target electronic device among the plurality of electronic devices
  • the relative position of each electronic device relative to the target electronic device the target electronic device transmits the relative position to the remaining electronic devices of the plurality of electronic devices except the target electronic device; each of the plurality of electronic devices except the target electronic device
  • the device generates a motion trajectory according to the first motion trajectory and its relative position with respect to the target electronic device, and performs motion according to the generated motion trajectory.
  • the plurality of electronic devices have communication capability, and one of the electronic devices (target electronic devices) can generate a first motion trajectory according to the movement condition of the target object, and when the target electronic device performs motion according to the first motion trajectory, the target electronic device The relative position to the target object does not change.
  • Each electronic device of the plurality of electronic devices except the target electronic device generates a motion trajectory according to the first motion trajectory and its relative position with respect to the target electronic device, and performs motion according to the generated motion trajectory to make itself and the target object The relative position is unchanged.
  • the target electronic device may be any one of a plurality of electronic devices, or may be the one with the strongest computing power among the plurality of electronic devices.
  • the target electronic device needs to detect the movement of the target object, and the other electronic devices do not need to detect the movement of the target object, so that the workload of the electronic device is much less.
  • each electronic device Since each electronic device is stationary relative to the target object, any two electronic devices are relatively stationary, that is, the relative positions of any two electronic devices at any one time remain unchanged.
  • the target electronic device calculates the relative position of each of the remaining electronic devices relative to the target electronic device, which may be detected or calculated in real time, or may be detected or calculated at any time during the motion, or may be started at the target object. Previously detected and calculated, it can also be input by the user.
  • Each of the plurality of electronic devices except the target electronic device generates a motion trajectory according to the first motion trajectory and its relative position with respect to the target electronic device, and performs motion according to the generated motion trajectory.
  • each of the plurality of electronic devices except the target electronic device is stationary with respect to the target electronic device, the target electronic device is stationary with respect to the target object, and therefore, each of the plurality of electronic devices is stationary with respect to the target object.
  • a plurality of electronic devices are self-organized to communicate with each other to realize coordinated motion, and the 3D images are cooperatively followed to form a full-scale 3D image.
  • the target electronic device an electronic device for synthesizing a stereoscopic image
  • the remaining image for assisting the target electronic device to synthesize the stereoscopic image are included in the role involved in the image processing method of the present application.
  • the operations performed by the respective characters in the image processing method of the present application clearer are separately described below.
  • FIG. 4 is a flowchart of an image processing method based on a target electronic device according to an embodiment of the present invention.
  • the image processing method is applied to a target electronic device having a driving device, and the driving device is configured as a target electronic device.
  • the target electronic device Providing a driving force to enable the target electronic device to move according to the movement condition of the target object, wherein the target electronic device further has an image capturing unit, the target electronic device is any one of the plurality of electronic devices, the target electronic device and the target object The relative position between them remains unchanged, and the relative positions of the remaining electronic devices of the plurality of electronic devices except the target electronic device and the target object remain unchanged, and the method includes the following steps:
  • Step S402 the target electronic device acquires a plurality of first images obtained by the plurality of electronic devices capturing the target object from different angles;
  • Step S402 the target electronic device combines the plurality of first images to obtain a stereoscopic image of the target object.
  • the target object is in a moving state
  • the target electronic device can be moved according to the movement condition of the target object
  • the plurality of electronic devices including the target electronic device and the remaining electronic devices adjust the motion of the target object according to the movement condition of the target object.
  • the state keeps itself and the target object relatively stationary, each electronic device shoots the target object from different angles, obtains multiple images, and the target electronic device combines the multiple images to obtain a stereoscopic image of the target object, and solves the problem.
  • the technical problem of the stereoscopic image of the moving object cannot be recorded, and the technical effect of recording the stereoscopic image of the moving object is achieved.
  • the plurality of electronic devices are N electronic devices
  • the target electronic device acquires the plurality of first images obtained by capturing the target objects from different angles by the plurality of electronic devices, including: the target electronic device not only needs to be at an angle relative to the target object The target object is photographed, and the first image obtained by taking the target object with respect to the angle of the target object relative to the target object is also acquired as follows:
  • the target electronic device identifies the target object according to its own image acquisition unit, and the target electronic device captures the target object with the target electronic device at an angle relative to the target object to obtain a first image; the target electronic device acquires according to the manner of multiple electronic devices self-organizing network communication.
  • the remaining electronic devices capture N-1 first images obtained from the target object from different angles, wherein the i-th electronic device recognizes the target object according to the image acquisition unit of the same, and the i-th electronic device captures the target object at the ith angle, a first image, wherein the ith angle is an angle of the i-th electronic device relative to the target object, wherein i sequentially takes 1 to N-1, and the N angles of the plurality of electronic devices relative to the target object are N different from each other. Angle, N is an integer greater than one.
  • the target electronic device may acquire each of the first images.
  • the shooting time after that, the target electronic device synthesizes a plurality of first images of the same shooting time to obtain a stereoscopic image.
  • the synthesized stereoscopic images are unified in time.
  • the target electronic device when the target electronic device combines the plurality of first images having the same shooting time to obtain a stereoscopic image, the background portion in the first image may be removed by the target electronic device.
  • the first image after the background removal is obtained; after that, the target electronic device combines the first images after the background removal with the same shooting time to obtain a stereoscopic image.
  • the method may be implemented in multiple manners: the plurality of electronic devices including the target electronic device and the remaining electronic devices are according to the target The movement of the object moves.
  • multiple electronic devices can respectively obtain the movement of the target object according to the detection of the target object, and then move according to the movement of the target object obtained by itself; or multiple electronic devices
  • An electronic device (target electronic device) in the device determines the movement of the target object according to the detection of the target object by the target electronic device, and then determines the remaining electrons according to the relative position between the target electronic device and the remaining electronic device.
  • the movement trajectory of the device which is then moved by other electronic devices in accordance with the determined movement trajectory.
  • the second method since only the target electronic device needs to detect the motion of the target object, other electronic devices do not need to detect the motion of the target object, so that the workload of the electronic device is greatly increased. less.
  • the foregoing second method may be configured as follows: the target electronic device generates a first motion trajectory according to the movement condition of the target object, wherein the target electronic device performs motion according to the first motion trajectory; and the target electronic device calculates multiple electronic devices. a relative position of each of the electronic devices other than the target electronic device relative to the target electronic device; the target electronic device transmits the relative position to the remaining electronic devices of the plurality of electronic devices other than the target electronic device; wherein, the relative position is used for Each of the plurality of electronic devices except the target electronic device generates a motion trajectory in conjunction with the first motion trajectory, and moves according to the generated motion trajectory.
  • the time in an electronic device may or may not be accurate. If the time in the plurality of electronic devices is not synchronized, in the process of synthesizing a plurality of first images having the same shooting time to obtain a stereoscopic image, an error occurs, that is, a plurality of first images having different actual shooting times The image is synthesized to get the wrong image.
  • the target electronic device may acquire the standard time before the target electronic device acquires the plurality of first images obtained by the plurality of electronic devices capturing the target object from different angles; after that, the target electronic device calibrates the plurality of the plurality of units according to the standard time.
  • the time of each electronic device in multiple electronic devices is calibrated using standard time, so that the time in multiple electronic devices is synchronized.
  • FIG. 5 is a structural block diagram of an image processing apparatus on a target electronic device side according to an embodiment of the present invention.
  • the image processing apparatus is applied to a target electronic device having a driving device, and the driving device is configured as a target electronic device.
  • the target electronic device is any one of the plurality of electronic devices, and between the target electronic device and the target object
  • the relative position of the electronic device remains unchanged from the target electronic device, and the device includes: the first obtaining unit 52 and the first synthesizing unit 54. The device will be described below.
  • the first obtaining unit 52 is configured to acquire a plurality of first images obtained by the plurality of electronic devices capturing the target object from different angles; the first synthesizing unit 54 is connected to the first acquiring unit 52, and is configured to set the plurality of first images The synthesis is performed to obtain a stereoscopic image of the target object.
  • FIG. 6 is a structural block diagram of a first acquiring unit 52 in an image processing apparatus on a target electronic device side according to an embodiment of the present invention.
  • the first acquiring unit 52 includes a first shooting subunit 62 and a first acquiring unit.
  • the subunit 64 wherein the plurality of electronic devices are N electronic devices, the first obtaining unit 52 will be described below.
  • the first photographing sub-unit 62 is configured to recognize the target object according to the image acquisition unit of the object, and the target electronic device photographs the target object at an angle of the target electronic device with respect to the target object to obtain a first image;
  • the first acquisition sub-unit 64 is configured according to The plurality of electronic devices are configured to communicate with each other by the network, and obtain the N-1 first images obtained by the remaining electronic devices from the different angles, wherein the i-th electronic device in the remaining electronic devices includes: the i-th recognition sub-unit And being disposed on the i-th electronic device, configured to identify the target object according to the image capturing unit of the i-th electronic device; the i-th shooting sub-unit is disposed on the i-th electronic device, and is set to photograph the target object at the ith angle Obtaining a first image, wherein the ith angle is an angle of the i-th electronic device relative to the target object, wherein i takes 1 to N-1 in sequence, and the N angles of the plurality of electronic devices relative to
  • FIG. 7 is a structural block diagram of a first synthesizing unit 54 in an image processing apparatus on a target electronic device side according to an embodiment of the present invention.
  • the first synthesizing unit 54 includes: a second acquiring subunit 72 and a first The synthesis subunit 74 will be described below with respect to the first synthesis unit 54.
  • the second obtaining sub-unit 72 is configured to acquire a shooting time of each first image; the first combining sub-unit 74 is connected to the second acquiring sub-unit 72, and is configured to synthesize the plurality of first images with the same shooting time , to get a stereo image.
  • FIG. 8 is a structural block diagram of a first synthesizing subunit 74 in a first synthesizing unit 54 in an image processing apparatus on a target electronic device side according to an embodiment of the present invention.
  • the first synthesizing subunit 74 includes: A removal module 82 and a first synthesis module 84 are described below for the first synthesis subunit 74.
  • the first removing module 82 is configured to remove the background portion in the first image to obtain a first image after the background removal; the first combining module 84 is connected to the first removing module 82, and is configured to set a plurality of times with the same shooting time. The first image after the background removal is combined to obtain a stereoscopic image.
  • FIG. 9 is a block diagram of a preferred structure of an image processing apparatus on a target electronic device side according to an embodiment of the present invention.
  • the apparatus includes, in addition to all the structures shown in FIG. 5, a generating unit 92, which is calculated.
  • Unit 94 and first transmitting unit 96, the preferred structure will be described below.
  • the generating unit 92 is disposed on the target electronic device in the plurality of electronic devices, and is configured to generate a first motion track according to the movement condition of the target object, wherein the target electronic device performs motion according to the first motion track; and the calculating unit 94 is configured to be
  • the target electronic device is configured to calculate a relative position of each of the plurality of electronic devices except the target electronic device with respect to the target electronic device;
  • the first sending unit 96 is connected to the generating unit 92, the calculating unit 94, and
  • the first obtaining unit 52 is disposed on the target electronic device, and is configured to send the relative position to the remaining electronic devices of the plurality of electronic devices except the target electronic device, wherein each of the plurality of electronic devices except the target electronic device
  • the control unit is provided on the electronic device, and the relative positions of each of the plurality of electronic devices except the target electronic device relative to the target electronic device are used by the control unit to generate a motion track in combination with the first motion track, and control multiple electronic devices.
  • FIG. 10 is a block diagram of a preferred structure of an image processing apparatus on a target electronic device side according to an embodiment of the present invention. As shown in FIG. 10, the apparatus includes: second acquisition unit 102, in addition to all the structures shown in FIG. And the first calibration unit 104, the preferred structure will be described below.
  • the second obtaining unit 102 is configured to acquire a standard time before the first acquiring unit acquires the moving condition of the target object obtained by the electronic device detecting the target object; the first calibration unit 104 is connected to the second acquiring unit 102, and is configured to be configured according to Standard time to calibrate each electronic device in multiple electronic devices.
  • FIG. 11 is a flowchart of an image processing method based on remaining electronic devices according to an embodiment of the present invention.
  • the image processing method is applied to other electronic devices having a driving device, and the remaining electronic devices are multiple electronic devices.
  • the driving device is configured to provide a driving force for the remaining electronic devices to enable the remaining electronic devices to move according to the moving condition of the target object, wherein the remaining electronic devices further have an image capturing unit, and the remaining electronic devices
  • the relative position with the target object remains unchanged, and the relative position between the target electronic device and the target object remains unchanged.
  • the method includes:
  • Step S1102 the remaining electronic devices photograph the target object at an angle of the remaining electronic device with respect to the target object to obtain a first image
  • Step S1104 The remaining electronic device sends the obtained first image to the target electronic device, so that the target electronic device synthesizes the stereoscopic image of the target object according to at least the first image, so that the target electronic device synthesizes the stereoscopic target object according to at least the first image. image.
  • the stereoscopic image of the target electronic device at least according to the first image synthesis target object refers to the first image captured by the target electronic device according to the first electronic image transmitted by the target electronic device.
  • the image is synthesized into a stereoscopic image of the target object, for example, the first image is used by the target electronic device to combine the first image obtained by capturing the target object with an angle between each of the plurality of electronic devices except the remaining electronic devices and the target object.
  • a stereoscopic image of a synthetic target object A stereoscopic image of a synthetic target object.
  • each of the plurality of electronic devices respectively maintains a relative position unchanged from the target object, and the remaining electronic devices capture the target object at an angle of the remaining electronic device with respect to the target object to obtain the first image
  • the remaining electronic devices receive the relative positions of the remaining electronic devices sent by the target electronic device with respect to the target electronic device;
  • the remaining electronic devices generate a motion trajectory according to the first motion trajectory and the relative position; and in the case that the remaining electronic devices move according to the generated motion trajectory, the target image is captured by the remaining electronic device at an angle relative to the target object to obtain a first image.
  • the shooting time of the shooting target object may be recorded by the remaining electronic devices, for example, the remaining electronic devices record the remaining electronic devices to shoot at the angle of the remaining electronic devices relative to the target object.
  • the shooting time of the target object wherein the shooting time is used for the stereoscopic image of the target electronic device to synthesize the target object.
  • the time of each of the remaining electronic devices is synchronized before the remaining electronic devices capture the target object, for example, when the remaining electronic devices shoot the target object at an angle relative to the target object of the remaining electronic devices.
  • the remaining electronic devices acquire the standard time; the remaining electronic devices calibrate the time of the remaining electronic devices according to the standard time.
  • the remaining electronic device transmits the obtained first image to the target electronic device: the background portion in the obtained first image is removed by the remaining electronic device, The first image after the background is removed; after that, the first image after the background removal is sent by the remaining electronic devices to the target electronic device.
  • FIG. 12 is a structural block diagram of an image processing apparatus based on remaining electronic devices according to an embodiment of the present invention.
  • the image processing apparatus is applied to other electronic devices having a driving device, and the remaining electronic devices are multiple electronic devices.
  • An electronic device other than the target electronic device in the device, the driving device is configured to provide a driving force for the remaining electronic device to enable the remaining electronic device to move according to the moving condition of the target object, wherein the remaining electronic device further has an image collecting unit, and the remaining electronic
  • the relative position between the device and the target object remains unchanged, and the relative position between the target electronic device and the target object remains unchanged.
  • the device includes a photographing unit 122 and a second transmitting unit 124, which will be described below.
  • the photographing unit 122 is configured to photograph the target object with the angle of the remaining electronic device relative to the target object to obtain a first image; the second sending unit 124 is connected to the photographing unit 122, and is configured to send the obtained first image to the target electronic device. So that the target electronic device synthesizes the stereoscopic image of the target object based on at least the first image.
  • FIG. 13 is a block diagram showing a preferred structure of a photographing unit 122 in an image processing apparatus based on the remaining electronic devices.
  • the photographing unit 122 includes a first receiving module 132 and a second receiving module 134.
  • the generating module 136 and the photographing module 138 are described below, and the photographing unit 122 will be described below.
  • the first receiving module 132 is configured to receive the first motion trajectory, wherein the first motion trajectory is generated by the target electronic device according to the movement condition of the target object;
  • the second receiving module 134 is connected to the first receiving module 132, and is configured.
  • a generating module 136 connected to the second receiving module 134, configured to generate a motion trajectory according to the first motion trajectory and the relative position;
  • the shooting module 138 is configured to receive the relative position of the remaining electronic device sent by the target electronic device relative to the target electronic device; And connected to the generating module 136, configured to capture the target object at an angle of the remaining electronic device relative to the target object to obtain the first image in the case of moving according to the generated motion trajectory.
  • FIG. 14 is a block diagram showing a preferred structure of an image processing apparatus based on the remaining electronic devices according to an embodiment of the present invention.
  • the preferred structure includes: a recording unit 142 in addition to all the structures shown in FIG.
  • the recording unit 142 will be described below.
  • the recording unit 142 is configured to record the shooting time of the remaining electronic device to capture the target object at an angle of the remaining electronic device with respect to the target object, wherein the shooting time is used for the target electronic device to synthesize the stereoscopic image of the target object.
  • FIG. 15 is a block diagram of a preferred structure of an image processing apparatus based on remaining electronic devices according to an embodiment of the present invention. As shown in FIG. 15, the preferred structure includes: a third acquisition unit in addition to all the structures shown in FIG. 152 and second calibration unit 154, the preferred results are described below.
  • the third obtaining unit 152 is configured to acquire a standard time before the remaining electronic device photographs the target object at an angle relative to the target object to obtain the first image; the second calibration unit 154 is connected to the third acquiring unit 152 and The photographing unit 122 is configured to calibrate the time of the remaining electronic devices according to the standard time.
  • the second transmitting unit 124 includes: a second removing module 162 and a transmitting module, according to an embodiment of the present invention. 164.
  • the second transmitting unit 124 will be described below.
  • the second removing module 162 is configured to remove the background portion in the obtained first image to obtain a first image after the background removal, and the sending module 164 is connected to the second removing module 162 for removing the background. The image is sent to the target electronic device.
  • FIG. 17 is a flowchart of an image processing method of a system based on a target electronic device and remaining electronic devices, as shown in FIG. 17, which is applied to a system including a plurality of electronic devices having a driving device, according to an embodiment of the present invention
  • the driving device is configured to provide a driving force for the plurality of electronic devices to enable the plurality of electronic devices to move according to the movement condition of the target object, wherein the plurality of electronic devices further have an image capturing unit, and the plurality of electronic devices include: the target electronic device and the The remaining electronic devices other than the target electronic device, the target electronic device is any one of the plurality of electronic devices, and the relative positions between the plurality of target electronic devices and the target object remain unchanged, and the method includes:
  • Step S1702 The target electronic device photographs the target object at an angle of the target electronic device with respect to the target object to obtain a first image.
  • Step S1704 the remaining electronic devices capture the target object with the angle of the remaining electronic device relative to the target object to obtain the first image, and send the first electronic image of the remaining electronic device to obtain the first image to the target electronic device;
  • Step S1706 The target electronic device combines the plurality of first images obtained by capturing the target objects from different angles by the plurality of electronic devices to obtain a stereoscopic image of the target object.
  • the method further includes: the target electronic device records the target electronic device relative to the target The angle of the object captures the shooting time of the target object; the remaining electronic devices record the shooting time of the target object with the angle of the remaining electronic device relative to the target object; the target electronic device takes multiple electronic devices to capture the target object from different angles.
  • the image is synthesized, and the stereoscopic image of the target object is obtained: the target electronic device combines the plurality of first images with the same shooting time of the plurality of electronic devices to obtain a stereoscopic image of the target object.
  • the target electronic device and the remaining electronic devices respectively remove the background portion in the respective first images to obtain the first image after the background removal, or the target electronic device removes the background portion in the first image captured by the plurality of electronic devices.
  • Obtaining a first image after the background is removed; the target electronic device synthesizes the plurality of first images with the same shooting time of the plurality of electronic devices, and obtaining the stereoscopic image of the target object comprises: removing, by the target electronic device, the plurality of backgrounds with the same shooting time The subsequent first image is synthesized to obtain a stereoscopic image.
  • the target electronic device photographs the target object at an angle of the target electronic device relative to the target object to obtain a first image
  • the remaining electronic device photographs the target object at an angle relative to the target object with respect to the target object to obtain the first image
  • the target electronic device generates a first motion trajectory according to the movement condition of the target object, wherein the target electronic device performs motion according to the first motion trajectory; and the target electronic device calculates each of the plurality of electronic devices except the target electronic device.
  • the target electronic device Relative to the target electronic device; the target electronic device transmits the relative position to the remaining electronic devices of the plurality of electronic devices except the target electronic device; each of the plurality of electronic devices except the target electronic device is according to the first
  • the motion trajectory and its relative position relative to the target electronic device generate motion trajectories and move according to the generated motion trajectory.
  • the target electronic device photographs the target object at an angle of the target electronic device relative to the target object to obtain a first image
  • the remaining electronic device photographs the target object at an angle relative to the target object with respect to the target object to obtain the first image
  • the method includes: the target electronic device and/or the remaining electronic device acquires a standard time; and the target electronic device and/or the remaining electronic device calibrate the time of each of the plurality of electronic devices according to the standard time.
  • the image processing system 180 includes a plurality of electronic devices including a driving device, and the driving device is configured to provide driving power for a plurality of electronic devices.
  • the plurality of electronic devices including: the target electronic device 182 and the remaining electronic devices 184 other than the target electronic, the target The electronic device is any one of the plurality of electronic devices, and the relative position between the plurality of target electronic devices and the target object remains unchanged, wherein the target electronic device is set to shoot at an angle of the target electronic device relative to the target object.
  • the target object obtains the first image;
  • the remaining electronic device is configured to take the first image by taking the target object at an angle of the remaining electronic device relative to the target object, and send the first electronic image to the target electronic device by the remaining electronic device;
  • Target electronic device also set to never use multiple electronic devices
  • the plurality of first images obtained by shooting the target object at the same angle are combined to obtain a stereoscopic image of the target object.
  • the target electronic device is further configured to combine the plurality of first images obtained by the target electronic device to capture the target object from different angles to obtain a stereoscopic image of the target object, and record the target electronic device relative to the target electronic device.
  • the angle of the target object captures the shooting time of the target object; the remaining electronic devices record the shooting time of the target object with the angle of the remaining electronic device relative to the target object; the target electronic device is also set to capture the target object from different angles of the electronic device.
  • the plurality of first images are combined to obtain a stereoscopic image of the target object, and the target electronic device combines the plurality of first images of the plurality of electronic devices with the same shooting time to obtain a stereoscopic image of the target object.
  • the target electronic device and the remaining electronic devices are further configured to respectively remove the background portion in the respective first images to obtain the first image after the background removal, or the target electronic device is further configured to remove multiple electronic devices.
  • the background image in the first image is obtained as a first image after the background is removed; the target electronic device is further configured to combine the plurality of first images with the same shooting time of the plurality of electronic devices, and obtaining the stereoscopic image of the target object includes: The target electronic device combines the first images after the plurality of backgrounds with the same shooting time to obtain a stereoscopic image.
  • the target electronic device is further configured to: at the target electronic device, photograph the target object at an angle of the target electronic device relative to the target object to obtain a first image, and the remaining electronic device photographs the target object at an angle of the remaining electronic device relative to the target object.
  • the first motion trajectory is generated according to the movement condition of the target object, wherein the target electronic device performs motion according to the first motion trajectory; and the target electronic device is further configured to calculate a plurality of electronic devices other than the target electronic device.
  • the relative position of each of the remaining electronic devices relative to the target electronic device; the target electronic device is further configured to transmit the relative position to the remaining electronic devices other than the target electronic device among the plurality of electronic devices; and the target electronic device among the plurality of electronic devices
  • Each of the electronic devices other than the electronic device is further configured to generate a motion trajectory according to the first motion trajectory and its relative position with respect to the target electronic device, and perform motion according to the generated motion trajectory.
  • the target electronic device and/or the remaining electronic device are further configured to: at the target electronic device, capture the target object at an angle of the target electronic device relative to the target object, to obtain a first image, and the remaining electronic devices with respect to the remaining electronic device The angle of the object is taken before the first object is obtained to obtain the standard time; the target electronic device and/or the remaining electronic device are also set to calibrate the time of each of the plurality of electronic devices according to the standard time.
  • a storage medium is further provided, where the storage medium includes a stored program, wherein the device in which the storage medium is located controls the image processing method of any one of the above items when the program is running.
  • Also provided in the embodiment of the present invention is a processor for running a program, wherein the image processing method of any one of the above is executed when the program is running.
  • Positioning and adjusting orientations include, but are not limited to, the use of vision, ultrasound, microwave, and the like.
  • User triggering or any other means allows the robot combination to turn on full 3D image recording.
  • the robot visually recognizes the subject through binocular vision and communicates with each other in conjunction with its own position to confirm the subject and confirm the relative position of the subject and the robot.
  • each robot visually recognizes the subject from the current binocular, removes the background, and retains information such as recording time.
  • the object movement is sensed by binocular vision, and the positional change between the object and the robot is calculated.
  • the robot keeps the relative position with the subject as much as possible by autonomous movement.
  • Multiple robots calibrate the captured images by recording time and synthesize a full range of 3D images (stereo images).
  • a plurality of robots are connected to each other through a network or other means to exchange information, and signaling is transmitted between the robots so that they can work together to generate a full 3D image at different angles at the same time.
  • the azimuth image realizes multi-robot collaborative omnidirectional dynamic 3D image recording.
  • an image processing apparatus is also provided.
  • the image processing apparatus can execute the image processing method described above, and the image processing method can be implemented by the image processing apparatus.
  • the image processing apparatus should be provided as an electronic device having a driving device configured to provide a driving force for the electronic device to enable the electronic device to move, and the electronic device further has an image capturing unit.
  • the apparatus includes: a fourth acquisition unit 10, a fifth acquisition unit 20, and a second synthesis unit 30.
  • the fourth acquiring unit 10 is configured to acquire a movement condition of the target object obtained by the electronic device detecting the target object, wherein the plurality of electronic devices perform motion according to the movement condition of the target object to maintain the relationship between each of the plurality of electronic devices and the target object. The relative position is unchanged.
  • the fifth obtaining unit 20 is configured to acquire a first image obtained by capturing, by the plurality of electronic devices, the target object from different angles, to obtain a plurality of first images.
  • the second synthesizing unit 30 is configured to combine the plurality of first images to obtain a stereoscopic image of the target object.
  • the plurality of electronic devices are N electronic devices
  • the fifth obtaining unit 20 includes N identification subunits and N shooting subunits.
  • the N identification subunits are the first identification subunit to the Nth identification subunit, respectively.
  • the N shooting subunits are the first to Nth shooting subunits, respectively.
  • the i-th recognition sub-unit is disposed on the i-th electronic device and configured to recognize the target object according to the image acquisition unit of the i-th electronic device.
  • the i-th shooting sub-unit is disposed on the i-th electronic device, and is configured to photograph the target object at the ith angle to obtain a first image, wherein the ith angle is an angle of the i-th electronic device relative to the target object, wherein, i Taking 1 to N in order, the first angle to the Nth angle are N different angles, and N is an integer greater than 1.
  • the second synthesizing unit 30 includes: a third acquiring subunit and a second synthesizing subunit.
  • the third acquisition subunit is configured to acquire a shooting time of each of the first images.
  • the second synthesizing subunit is configured to synthesize a plurality of first images having the same shooting time to obtain a stereoscopic image.
  • the second synthesis subunit includes: a third removal module and a second synthesis module.
  • the third removing module is configured to remove the background portion in the first image to obtain a first image after the background is removed.
  • the second synthesizing module is configured to synthesize the first images after the plurality of backgrounds with the same shooting time are combined to obtain a stereoscopic image.
  • the fourth obtaining unit includes: a generating subunit, a calculating subunit, a sending subunit, and a control subunit.
  • the generating subunit is disposed on the target electronic device in the plurality of electronic devices, and is configured to generate a first motion trajectory according to the movement condition of the target object, wherein the target electronic device performs motion according to the first motion trajectory.
  • the calculating subunit is disposed on the target electronic device and configured to calculate a relative position of each of the plurality of electronic devices except the target electronic device with respect to the target electronic device.
  • the transmitting subunit is set on the target electronic device and is set to transmit the relative position to the remaining electronic devices of the plurality of electronic devices except the target electronic device.
  • control subunit configured on each of the plurality of electronic devices except the target electronic device, configured to be based on the first motion trajectory and each of the plurality of electronic devices except the target electronic device relative to the target electronic device
  • the relative position of the device generates a motion trajectory, and controls each electronic device of the plurality of electronic devices except the target electronic device to move according to the generated motion trajectory.
  • the device further includes: a sixth obtaining unit and a third calibration unit.
  • the sixth obtaining unit is configured to acquire the standard time before the fourth acquiring unit 10 acquires the movement condition of the target object obtained by the electronic device detecting the target object.
  • the third calibration unit is configured to calibrate the time of each of the plurality of electronic devices according to the standard time.
  • the disclosed technical contents may be implemented in other manners.
  • the device embodiments described above are only schematic.
  • the division of the unit may be a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, unit or module, and may be electrical or otherwise.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium.
  • the technical solution of the present invention which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium.
  • a number of instructions are included to cause a computer device (which may be a personal computer, server or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk, and the like. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Electromagnetism (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Image Processing (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Studio Devices (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

Disclosed in the present invention are an image processing method and device. The method comprises: obtaining movement condition of a target object obtained when electronic devices detect a target object, the multiple electronic devices moving according to the movement condition of the target object, so that the relative positions between the multiple electronic devices and the target object are unchanged; obtaining first images obtained when the multiple electronic devices capture the target object from different angles, so as to obtain multiple first images; and merging the multiple first images to obtain a stereo image of the target object. The present invention resolves the technical problem in the prior art of failure to record a stereo image of a moving object.

Description

图像处理方法和装置Image processing method and device 技术领域Technical field
本发明涉及图像领域,具体而言,涉及一种图像处理方法和装置。The present invention relates to the field of images, and in particular to an image processing method and apparatus.
背景技术Background technique
对于静止的物体,可以通过在其周围的固定位置摆放摄像头的方式来记录其立体影像,但是,对于移动的物体来说,无法通过上述方式来及记录其立体影像。For a stationary object, the stereoscopic image can be recorded by placing the camera at a fixed position around it. However, for a moving object, the stereoscopic image cannot be recorded and recorded in the above manner.
针对上述的问题,目前尚未提出有效的解决方案。In response to the above problems, no effective solution has been proposed yet.
发明内容Summary of the invention
本发明实施例提供了一种图像处理方法和装置,以至少解决现有技术中无法记录运动物体的立体影像的技术问题。Embodiments of the present invention provide an image processing method and apparatus to solve at least the technical problem that a stereoscopic image of a moving object cannot be recorded in the prior art.
根据本发明实施例的一方面,提供了一种图像处理方法,应用于具备驱动装置的目标电子设备,所述驱动装置设置为为所述目标电子设备提供驱动力以使得所述目标电子设备能够根据目标物体的移动情况移动,其中,所述目标电子设备还具有图像采集单元,所述目标电子设备为多台电子设备中的任意一台电子设备,所述目标电子设备与所述目标物体之间的相对位置保持不变,多台所述电子设备中除所述目标电子设备之外的其余电子设备各自与所述目标物体之间的相对位置也保持不变,所述方法包括:所述目标电子设备获取多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像;所述目标电子设备将多张所述第一图像进行合成,得到所述目标物体的立体影像。According to an aspect of an embodiment of the present invention, there is provided an image processing method applied to a target electronic device having a driving device, the driving device being configured to provide a driving force to the target electronic device to enable the target electronic device to enable Moving according to the movement condition of the target object, wherein the target electronic device further has an image acquisition unit, the target electronic device is any one of the plurality of electronic devices, and the target electronic device and the target object The relative position of the electronic device remains unchanged, and the relative positions of the remaining electronic devices other than the target electronic device and the target object remain unchanged, the method comprising: The target electronic device acquires a plurality of first images obtained by the plurality of the electronic devices capturing the target object from different angles; the target electronic device synthesizes the plurality of the first images to obtain a stereoscopic image of the target object .
可选地,多台所述电子设备为N台所述电子设备,所述目标电子设备获取多台所述电子设备从不同角度拍摄所述目标物体得到的多张所述第一图像包括:所述目标电子设备根据自身的图像采集单元识别所述目标物体,所述目标电子设备以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体,得到第一图像;所述目标电子设备根据所述多台所述电子设备自组网络通信的方式,获取所述其余电子设备从不同角度拍摄所述目标物体得到的N-1张第一图像,其中,第i台电子设备根据自身的图像采集单元识别所述目标物体,所述第i台电子设备以第i角度拍摄所述目标物体,得 到所述第一图像,其中,所述第i角度是所述第i台电子设备相对所述目标物体的角度,其中,i依次取1至N-1,多台电子设备相对所述目标物体的N个角度为N个互不相同的角度,N为大于1的整数。Optionally, the plurality of the electronic devices are N the electronic devices, and the target electronic device acquires, by the plurality of the electronic devices, the plurality of the first images obtained by capturing the target object from different angles, including: The target electronic device identifies the target object according to its own image acquisition unit, and the target electronic device captures the target object at an angle of the target electronic device relative to the target object to obtain a first image; the target electronic device Obtaining, according to the manner in which the plurality of the electronic devices communicate with each other by the group network, the N-1 first images obtained by the remaining electronic devices capturing the target object from different angles, wherein the i-th electronic device according to the The image acquisition unit identifies the target object, and the ith electronic device captures the target object at an ith angle to obtain the first image, wherein the ith angle is a relative position of the ith electronic device The angle of the target object, wherein i takes 1 to N-1 in turn, and the N angles of the plurality of electronic devices with respect to the target object are N different angles, and N is large An integer of 1.
可选地,所述目标电子设备将多张所述第一图像进行合成,得到所述目标物体的立体影像包括:所述目标电子设备获取每张所述第一图像的拍摄时间;所述目标电子设备将拍摄时间相同的多张所述第一图像进行合成,得到所述立体影像。Optionally, the target electronic device synthesizes the plurality of the first images, and obtaining the stereoscopic image of the target object includes: acquiring, by the target electronic device, a shooting time of each of the first images; The electronic device combines the plurality of the first images having the same shooting time to obtain the stereoscopic image.
可选地,所述目标电子设备将拍摄时间相同的多张所述第一图像进行合成,得到所述立体影像包括:所述目标电子设备去除所述第一图像中的背景部分,得到背景去除后的第一图像;所述目标电子设备将拍摄时间相同的多张背景去除后的第一图像进行合成,得到所述立体影像。Optionally, the target electronic device synthesizes the plurality of the first images with the same shooting time, and obtaining the stereoscopic image includes: removing, by the target electronic device, a background portion in the first image to obtain a background removal. a first image; the target electronic device synthesizes a plurality of background-removed first images with the same shooting time to obtain the stereo image.
可选地,在所述目标电子设备获取多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像之前,还包括:所述目标电子设备根据所述目标物体的移动情况生成第一运动轨迹,其中,所述目标电子设备按照所述第一运动轨迹进行运动;所述目标电子设备计算多台所述电子设备中除所述目标电子设备以外的其余每台所述电子设备相对于所述目标电子设备的相对位置;所述目标电子设备将所述相对位置发送给多台所述电子设备中除所述目标电子设备以外的其余电子设备;其中,所述相对位置用于多台所述电子设备中除所述目标电子设备以外的每台电子设备结合所述第一运动轨迹生成运动轨迹,并按照生成的运动轨迹进行运动。Optionally, before the target electronic device acquires the plurality of first images obtained by the plurality of the electronic devices from the different angles, the target electronic device further includes: the target electronic device according to the movement of the target object Generating a first motion trajectory, wherein the target electronic device moves according to the first motion trajectory; the target electronic device calculates each of the plurality of electronic devices other than the target electronic device a relative position of the device relative to the target electronic device; the target electronic device transmitting the relative position to the remaining electronic devices of the plurality of the electronic devices except the target electronic device; wherein the relative position is used Each of the plurality of electronic devices except the target electronic device generates a motion trajectory in conjunction with the first motion trajectory, and performs motion according to the generated motion trajectory.
可选地,在所述目标电子设备获取多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像之前,所述方法还包括:所述目标电子设备获取标准时间;所述目标电子设备根据所述标准时间校准多台所述电子设备中每台所述电子设备的时间。Optionally, before the target electronic device acquires the plurality of first images obtained by the plurality of electronic devices capturing the target object from different angles, the method further includes: acquiring, by the target electronic device, a standard time; The target electronic device calibrates the time of each of the plurality of the electronic devices according to the standard time.
根据本发明实施例的另一方面,提供了一种图像处理装置,应用于具备驱动装置的目标电子设备,所述驱动装置设置为为所述目标电子设备提供驱动力以使得所述电子设备能够根据目标物体的移动情况移动,其中,所述电子设备还具有图像采集单元,所述目标电子设备为多台电子设备中的任意一台电子设备,所述目标电子设备与所述目标物体之间的相对位置保持不变,多台所述电子设备中除所述目标电子设备之外的其余电子设备各自与所述目标物体之间的相对位置也保持不变,所述装置包括:第一获取单元,设置为获取多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像;第一合成单元,设置为将多张所述第一图像进行合成,得到所述目标物体的立体影像。According to another aspect of an embodiment of the present invention, there is provided an image processing apparatus applied to a target electronic device having a driving device, the driving device being configured to provide a driving force to the target electronic device to enable the electronic device to enable the electronic device Moving according to the movement condition of the target object, wherein the electronic device further has an image collection unit, the target electronic device is any one of the plurality of electronic devices, and between the target electronic device and the target object The relative position of the remaining electronic devices of the plurality of electronic devices other than the target electronic device and the target object remain unchanged, and the device includes: first obtaining a unit, configured to acquire a plurality of first images obtained by capturing the target object from different angles by the plurality of electronic devices; and a first synthesizing unit configured to combine the plurality of the first images to obtain the target object Stereoscopic image.
可选地,多台所述电子设备为N台所述电子设备,所述第一获取单元包括:第一 拍摄子单元,设置为根据自身的图像采集单元识别所述目标物体,所述目标电子设备以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体,得到第一图像;第一获取子单元,设置为根据所述多台所述电子设备自组网络通信的方式,获取所述其余电子设备从不同角度拍摄所述目标物体得到的N-1张第一图像,其中,所述其余电子设备中的第i台电子设备包括:第i识别子单元,设置在第i台电子设备上,设置为根据所述第i台电子设备的图像采集单元识别所述目标物体;第i拍摄子单元,设置在所述第i台电子设备上,设置为以第i角度拍摄所述目标物体,得到所述第一图像,其中,所述第i角度是所述第i台电子设备相对所述目标物体的角度,其中,i依次取1至N-1,多台电子设备相对所述目标物体的N个角度为N个互不相同的角度,N为大于1的整数。Optionally, the plurality of the electronic devices are N the electronic devices, and the first acquiring unit comprises: a first shooting subunit, configured to identify the target object according to an image acquisition unit of the same, the target electronic device The device captures the target object at an angle of the target electronic device with respect to the target object, to obtain a first image, and the first acquiring subunit is configured to acquire according to the manner in which the plurality of the electronic devices communicate with each other by a group network The remaining electronic device captures N-1 first images obtained by the target object from different angles, wherein the i-th electronic device of the remaining electronic devices includes: an i-th identification sub-unit, which is disposed at the i-th station The electronic device is configured to identify the target object according to the image capturing unit of the ith electronic device; the ith shooting subunit is disposed on the ith electronic device, and is configured to photograph the ith angle Target object, obtaining the first image, wherein the ith angle is an angle of the ith electronic device relative to the target object, wherein i is sequentially taken from 1 to N-1, and multiple Sub-device of the target object relative angle N of N mutually different angles, N being an integer greater than 1.
可选地,所述第一合成单元包括:第二获取子单元,设置为获取每张所述第一图像的拍摄时间;第一合成子单元,设置为将拍摄时间相同的多张所述第一图像进行合成,得到所述立体影像。Optionally, the first synthesizing unit includes: a second acquiring subunit configured to acquire a photographing time of each of the first images; and a first synthesizing subunit configured to set the plurality of the photographing times to be the same An image is synthesized to obtain the stereoscopic image.
可选地,所述第一合成子单元包括:第一去除模块,设置为去除所述第一图像中的背景部分,得到背景去除后的第一图像;第一合成模块,设置为将拍摄时间相同的多张背景去除后的第一图像进行合成,得到所述立体影像。Optionally, the first synthesizing subunit includes: a first removing module configured to remove a background portion in the first image to obtain a first image after background removal; and a first synthesizing module configured to set a shooting time The same plurality of background-removed first images are combined to obtain the stereoscopic image.
可选地,所述装置还包括:生成单元,设置在多台所述电子设备中的所述目标电子设备上,设置为根据所述目标物体的移动情况生成第一运动轨迹,其中,所述目标电子设备按照所述第一运动轨迹进行运动;计算单元,设置在所述目标电子设备上,设置为计算多台所述电子设备中除所述目标电子设备以外的其余每台所述电子设备相对于所述目标电子设备的相对位置;第一发送单元,设置在所述目标电子设备上,设置为将所述相对位置发送给多台所述电子设备中除所述目标电子设备以外的其余电子设备,其中,在多台所述电子设备中除所述目标电子设备以外的每台电子设备上设置有控制单元,多台所述电子设备中除所述目标电子设备以外的每台电子设备相对于所述目标电子设备的相对位置用于所述控制单元结合所述第一运动轨迹生成运动轨迹,并控制多台所述电子设备中除所述目标电子设备以外的每台电子设备按照生成的运动轨迹进行运动。Optionally, the device further includes: a generating unit, configured to be disposed on the target electronic device of the plurality of the electronic devices, configured to generate a first motion trajectory according to a movement condition of the target object, where The target electronic device performs motion according to the first motion trajectory; and the calculating unit is disposed on the target electronic device, and is configured to calculate each of the plurality of electronic devices other than the target electronic device a first transmitting unit, disposed on the target electronic device, configured to send the relative position to a plurality of the electronic devices other than the target electronic device An electronic device, wherein each of the plurality of electronic devices other than the target electronic device is provided with a control unit, and each of the plurality of electronic devices except the target electronic device Relative position of the target electronic device is used by the control unit to generate a motion trajectory in conjunction with the first motion trajectory, and control Said plurality of electronic devices each electronic device other than the target electronic apparatus in accordance with the generated motion trajectory.
可选地,所述装置还包括:第二获取单元,设置为在所述第一获取单元获取电子设备检测目标物体得到的所述目标物体的移动情况之前,获取标准时间;第一校准单元,设置为根据所述标准时间校准多台所述电子设备中每台所述电子设备的时间。Optionally, the device further includes: a second acquiring unit, configured to acquire a standard time before the first acquiring unit acquires a movement condition of the target object obtained by the electronic device detecting the target object; the first calibration unit, A time is set to calibrate each of the plurality of electronic devices according to the standard time.
根据本发明实施例的又一方面,还提供了一种图像处理方法,应用于具备驱动装置的其余电子设备中,所述其余电子设备为多台电子设备中除目标电子设备之外的电 子设备,所述驱动装置设置为为所述其余电子设备提供驱动力以使得所述其余电子设备能够根据目标物体的移动情况移动,其中,所述其余电子设备还具有图像采集单元,所述其余电子设备与所述目标物体之间的相对位置保持不变,所述目标电子设备与所述目标物体之间的相对位置也保持不变,所述方法包括:所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像;所述其余电子设备将得到的所述第一图像发送给所述目标电子设备,以使所述目标电子设备至少根据所述第一图像合成所述目标物体的立体影像。According to still another aspect of the embodiments of the present invention, there is also provided an image processing method, which is applied to a remaining electronic device having a driving device, wherein the remaining electronic device is an electronic device other than the target electronic device among the plurality of electronic devices. The driving device is configured to provide a driving force for the remaining electronic devices to enable the remaining electronic devices to move according to a movement condition of the target object, wherein the remaining electronic devices further have an image capturing unit, and the remaining electronic devices The relative position with the target object remains unchanged, and the relative position between the target electronic device and the target object remains unchanged, the method comprising: the remaining electronic device with the remaining electronic device Capturing the target object with respect to an angle of the target object to obtain a first image; the remaining electronic device transmitting the obtained first image to the target electronic device such that the target electronic device is at least according to the The first image synthesizes a stereoscopic image of the target object.
可选地,所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像包括:所述其余电子设备接收到第一运动轨迹,其中,所述第一运动轨迹为所述目标电子设备根据所述目标物体的移动情况生成的;所述其余电子设备接收到所述目标电子设备发送的所述其余电子设备相对于所述目标电子设备的相对位置;所述其余电子设备根据所述第一运动轨迹和所述相对位置生成运动轨迹;在所述其余电子设备按照生成的运动轨迹进行运动的情况下,以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像。Optionally, the remaining electronic device capturing the target object at an angle of the remaining electronic device relative to the target object to obtain the first image includes: the remaining electronic device receiving the first motion trajectory, wherein The first motion trajectory is generated by the target electronic device according to the movement condition of the target object; the remaining electronic device receives the relative position of the remaining electronic device sent by the target electronic device relative to the target electronic device The remaining electronic device generates a motion trajectory according to the first motion trajectory and the relative position; and in a case where the remaining electronic device performs motion according to the generated motion trajectory, the remaining electronic device is relative to the target The angle of the object captures the target object to obtain a first image.
可选地,所述方法还包括:所述其余电子设备记录所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体的拍摄时间,其中,所述拍摄时间用于所述目标电子设备合成所述目标物体的立体影像。Optionally, the method further includes: the remaining electronic device recording the shooting time of the remaining electronic device to capture the target object at an angle of the remaining electronic device relative to the target object, wherein the shooting time A stereoscopic image for the target electronic device to synthesize the target object.
可选地,在所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像之前,所述方法还包括:所述其余电子设备获取标准时间;所述其余电子设备根据所述标准时间校准所述其余电子设备的时间。Optionally, before the remaining electronic device takes the target object to obtain the first image with the remaining electronic device at an angle relative to the target object, the method further includes: the remaining electronic device acquiring the standard time; The remaining electronic devices calibrate the time of the remaining electronic devices according to the standard time.
可选地,所述其余电子设备将得到的所述第一图像发送给所述目标电子设备包括:所述其余电子设备去除得到的所述第一图像中的背景部分,得到背景去除后的第一图像;所述其余电子设备将背景去除后的第一图像发送给所述目标电子设备。Optionally, the sending, by the remaining electronic device, the obtained first image to the target electronic device includes: removing, by the remaining electronic device, a background portion in the obtained first image, and obtaining a background removed An image; the remaining electronic device transmits the first image after the background removal to the target electronic device.
根据本发明实施例的又一方面,还提供了一种图像处理方法,应用于包括具备驱动装置的多台电子设备的系统中,所述驱动装置设置为为多台所述电子设备提供驱动力以使得多台所述电子设备能够根据目标物体的移动情况移动,其中,多台所述电子设备还具有图像采集单元,多台所述电子设备包括:目标电子设备和除所述目标电子之外的其余电子设备,所述目标电子设备为多台所述电子设备中的任意一台电子设备,所述多台目标电子设备与所述目标物体之间的相对位置保持不变,所述方法包括:所述目标电子设备以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体,得到第一图像;所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像,并将所述其余电子设备拍摄所述目标物体得到所述第一 图像发送给所述目标电子设备;所述目标电子设备将多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像进行合成,得到所述目标物体的立体影像。According to still another aspect of an embodiment of the present invention, there is also provided an image processing method for use in a system including a plurality of electronic devices having a driving device, the driving device being configured to provide driving power for a plurality of the electronic devices In order to enable a plurality of the electronic devices to move according to a movement condition of a target object, wherein the plurality of the electronic devices further have an image acquisition unit, and the plurality of the electronic devices include: target electronic devices and The remaining electronic device, the target electronic device is any one of the plurality of the electronic devices, the relative position between the plurality of target electronic devices and the target object remains unchanged, and the method includes : the target electronic device photographs the target object at an angle of the target electronic device relative to the target object to obtain a first image; and the remaining electronic devices are photographed at an angle of the remaining electronic device relative to the target object The target object obtains a first image, and the remaining electronic device captures the target object to obtain the first image The image is sent to the target electronic device; the target electronic device combines a plurality of first images obtained by capturing the target object from different angles by the plurality of electronic devices to obtain a stereoscopic image of the target object.
可选地,在所述目标电子设备将多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像进行合成,得到所述目标物体的立体影像之前,还包括:所述目标电子设备记录以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体的拍摄时间;所述其余电子设备记录以所述其余电子设备相对所述目标物体的角度拍摄所述目标物体的拍摄时间;所述目标电子设备将多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像进行合成,得到所述目标物体的立体影像包括:所述目标电子设备将多台所述电子设备拍摄时间相同的多张第一图像进行合成,得到所述目标物体的立体影像。Optionally, before the target electronic device combines the plurality of first images obtained by capturing the target object from different angles to obtain a stereoscopic image of the target object, the method further includes: The target electronic device records a shooting time of the target object at an angle of the target electronic device relative to the target object; the remaining electronic device records the target object at an angle of the remaining electronic device relative to the target object a plurality of first images obtained by capturing the target object from different angles by the plurality of electronic devices, and obtaining a stereoscopic image of the target object includes: the target electronic device A plurality of the first images of the same time are captured by the plurality of electronic devices to be combined to obtain a stereoscopic image of the target object.
可选地,所述目标电子设备和所述其余电子设备分别去除各自第一图像中的背景部分,得到背景去除后的第一图像,或者,所述目标电子设备去除多台所述电子设备拍摄的第一图像中的背景部分,得到背景去除后的第一图像;所述目标电子设备将多台所述电子设备拍摄时间相同的多张第一图像进行合成,得到所述目标物体的立体影像包括:所述目标电子设备将拍摄时间相同的多张背景去除后的第一图像进行合成,得到所述立体影像。Optionally, the target electronic device and the remaining electronic device respectively remove the background portion in the respective first images to obtain the first image after the background removal, or the target electronic device removes the plurality of the electronic devices to take the image. a background image in the first image, obtaining a first image after the background is removed; the target electronic device synthesizing a plurality of first images of the same time of the electronic device to obtain a stereoscopic image of the target object The method includes: the target electronic device synthesizes a plurality of background-removed first images with the same shooting time to obtain the stereoscopic image.
可选地,在所述目标电子设备以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体,得到第一图像,和所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像之前,还包括:所述目标电子设备根据所述目标物体的移动情况生成第一运动轨迹,其中,所述目标电子设备按照所述第一运动轨迹进行运动;所述目标电子设备计算多台所述电子设备中除所述目标电子设备以外的其余每台所述电子设备相对于所述目标电子设备的相对位置;所述目标电子设备将所述相对位置发送给多台所述电子设备中除所述目标电子设备以外的其余电子设备;多台所述电子设备中除所述目标电子设备以外的每台电子设备根据所述第一运动轨迹和自身相对于所述目标电子设备的相对位置生成运动轨迹,并按照生成的运动轨迹进行运动。Optionally, the target electronic device photographs the target object at an angle of the target electronic device relative to the target object to obtain a first image, and the remaining electronic devices are opposite to the remaining electronic device Before the target object is photographed to obtain the first image, the method further includes: the target electronic device generating a first motion trajectory according to the movement condition of the target object, wherein the target electronic device follows the first motion The trajectory is moved; the target electronic device calculates a relative position of each of the plurality of electronic devices other than the target electronic device relative to the target electronic device; the target electronic device The relative position is sent to the remaining electronic devices other than the target electronic device among the plurality of electronic devices; each of the plurality of electronic devices except the target electronic device is according to the first motion track And generating a motion trajectory with respect to the relative position of the target electronic device, and following the generated motion trajectory Line movement.
可选地,在所述目标电子设备以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体,得到第一图像,和所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像之前,还包括:所述目标电子设备和/或所述其余电子设备获取标准时间;所述目标电子设备和/或所述其余电子设备根据所述标准时间校准多台所述电子设备中每台电子设备的时间。Optionally, the target electronic device photographs the target object at an angle of the target electronic device relative to the target object to obtain a first image, and the remaining electronic devices are opposite to the remaining electronic device Before the target object is photographed to obtain the first image, the method further includes: the target electronic device and/or the remaining electronic device acquiring standard time; the target electronic device and/or the remaining electronic device according to the The standard time is used to calibrate the time of each of the plurality of electronic devices.
根据本发明实施例的还一方面,提供了一种图像处理装置,应用于具备驱动装置 的其余电子设备中,所述其余电子设备为多台电子设备中除目标电子设备之外的电子设备,所述驱动装置设置为为所述其余电子设备提供驱动力以使得所述其余电子设备能够根据目标物体的移动情况移动,其中,所述其余电子设备还具有图像采集单元,所述其余电子设备与所述目标物体之间的相对位置保持不变,所述目标电子设备与所述目标物体之间的相对位置也保持不变,所述装置包括:拍摄单元,设置为以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像;第二发送单元,设置为将得到的所述第一图像发送给所述目标电子设备,以使所述目标电子设备至少根据所述第一图像合成所述目标物体的立体影像。According to still another aspect of the embodiments of the present invention, an image processing apparatus is provided for use in a remaining electronic device having a driving device, wherein the remaining electronic device is an electronic device other than the target electronic device among the plurality of electronic devices. The driving device is configured to provide a driving force for the remaining electronic devices to enable the remaining electronic devices to move according to a movement condition of the target object, wherein the remaining electronic devices further have an image capturing unit, and the remaining electronic devices are The relative position between the target objects remains unchanged, the relative position between the target electronic device and the target object remains unchanged, and the apparatus includes: a photographing unit configured to be opposite to the remaining electronic devices Shooting the target object at an angle of the target object to obtain a first image; the second sending unit is configured to send the obtained first image to the target electronic device, so that the target electronic device is at least according to the The first image synthesizes a stereoscopic image of the target object.
可选地,所述拍摄单元包括:第一接收模块,设置为接收到第一运动轨迹,其中,所述第一运动轨迹为所述目标电子设备根据所述目标物体的移动情况生成的;第二接收模块,设置为接收到所述目标电子设备发送的所述其余电子设备相对于所述目标电子设备的相对位置;生成模块,设置为根据所述第一运动轨迹和所述相对位置生成运动轨迹;拍摄模块,设置为在按照生成的运动轨迹进行运动的情况下,以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像。Optionally, the shooting unit includes: a first receiving module configured to receive a first motion trajectory, wherein the first motion trajectory is generated by the target electronic device according to a movement condition of the target object; a receiving module, configured to receive a relative position of the remaining electronic device sent by the target electronic device with respect to the target electronic device; and a generating module configured to generate a motion according to the first motion trajectory and the relative position a trajectory; a photographing module configured to photograph the target object at an angle of the remaining electronic device relative to the target object to obtain a first image in a motion according to the generated motion trajectory.
可选地,所述装置还包括:记录单元,设置为记录所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体的拍摄时间,其中,所述拍摄时间用于所述目标电子设备合成所述目标物体的立体影像。Optionally, the device further includes: a recording unit configured to record a shooting time of the remaining electronic device to capture the target object at an angle of the remaining electronic device with respect to the target object, wherein the shooting time A stereoscopic image for the target electronic device to synthesize the target object.
可选地,在所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像之前,所述方法还包括:第三获取单元,设置为获取标准时间;第二校准单元,设置为根据所述标准时间校准所述其余电子设备的时间。Optionally, before the remaining electronic device takes the target object to obtain the first image with the remaining electronic device at an angle relative to the target object, the method further includes: a third acquiring unit, configured to acquire a standard Time; a second calibration unit configured to calibrate the time of the remaining electronic devices according to the standard time.
可选地,所述第二发送单元包括:第二去除模块,设置为去除得到的所述第一图像中的背景部分,得到背景去除后的第一图像;发送模块,用于将背景去除后的第一图像发送给所述目标电子设备。Optionally, the second sending unit includes: a second removing module, configured to remove the obtained background portion in the first image to obtain a first image after background removal; and a sending module, configured to remove the background The first image is sent to the target electronic device.
根据本发明实施例的再一方面,提供了一种图像处理系统,包括具备驱动装置的多台电子设备,所述驱动装置设置为为多台所述电子设备提供驱动力以使得多台所述电子设备能够根据目标物体的移动情况移动,其中,多台所述电子设备还具有图像采集单元,多台所述电子设备包括:目标电子设备和除所述目标电子之外的其余电子设备,所述目标电子设备为多台所述电子设备中的任意一台电子设备,所述多台目标电子设备与所述目标物体之间的相对位置保持不变,其中,所述目标电子设备,设置为以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体,得到第一图像;所述其余电子设备,设置为以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像,并将所述其余电子设备拍摄所述目标物体得到所述第一图像发 送给所述目标电子设备;所述目标电子设备,还设置为将多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像进行合成,得到所述目标物体的立体影像。According to still another aspect of an embodiment of the present invention, there is provided an image processing system including a plurality of electronic devices having a driving device, the driving device being configured to provide driving power to a plurality of the electronic devices to cause a plurality of the devices The electronic device can be moved according to the moving condition of the target object, wherein the plurality of the electronic devices further have an image collecting unit, and the plurality of the electronic devices include: the target electronic device and the remaining electronic devices except the target electronic device. The target electronic device is any one of the plurality of the electronic devices, and a relative position between the plurality of target electronic devices and the target object remains unchanged, wherein the target electronic device is set to Taking the target object at an angle of the target electronic device relative to the target object to obtain a first image; the remaining electronic device is configured to capture the target at an angle of the remaining electronic device relative to the target object Obtaining a first image, and the remaining electronic device photographing the target object to send the first image to The target electronic device is further configured to combine a plurality of first images obtained by capturing the target object from different angles by the plurality of electronic devices to obtain a stereoscopic image of the target object.
可选地,所述目标电子设备,还设置为在所述目标电子设备将多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像进行合成,得到所述目标物体的立体影像之前,记录以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体的拍摄时间;所述其余电子设备记录以所述其余电子设备相对所述目标物体的角度拍摄所述目标物体的拍摄时间;所述目标电子设备,还设置为将多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像进行合成,得到所述目标物体的立体影像包括:所述目标电子设备将多台所述电子设备拍摄时间相同的多张第一图像进行合成,得到所述目标物体的立体影像。Optionally, the target electronic device is further configured to synthesize a plurality of first images obtained by capturing, by the target electronic device, the plurality of the electronic devices from different angles to obtain the target object, to obtain the target object. Recording a shooting time of the target object at an angle of the target electronic device relative to the target object before the stereoscopic image; the remaining electronic device recording the target at an angle of the remaining electronic device relative to the target object a shooting time of the object; the target electronic device is further configured to combine a plurality of first images obtained by capturing the target object from different angles by the plurality of electronic devices, and obtaining a stereoscopic image of the target object includes: The target electronic device combines a plurality of first images of the same time of the electronic device to obtain a stereoscopic image of the target object.
可选地,所述目标电子设备和所述其余电子设备,还设置为分别去除各自第一图像中的背景部分,得到背景去除后的第一图像,或者,所述目标电子设备,还设置为去除多台所述电子设备拍摄的第一图像中的背景部分,得到背景去除后的第一图像;所述目标电子设备,还设置为将多台所述电子设备拍摄时间相同的多张第一图像进行合成,得到所述目标物体的立体影像包括:所述目标电子设备将拍摄时间相同的多张背景去除后的第一图像进行合成,得到所述立体影像。Optionally, the target electronic device and the remaining electronic device are further configured to respectively remove the background portion in the respective first images to obtain a first image after the background removal, or the target electronic device is further configured to And removing a background portion in the first image captured by the plurality of electronic devices to obtain a first image after the background removal; the target electronic device is further configured to: the plurality of the electronic devices are photographed at the same time. The image is synthesized, and obtaining the stereoscopic image of the target object includes: the target electronic device synthesizing the first image after removing the plurality of backgrounds with the same shooting time to obtain the stereoscopic image.
可选地,所述目标电子设备,还设置为在所述目标电子设备以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体,得到第一图像,和所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像之前,根据所述目标物体的移动情况生成第一运动轨迹,其中,所述目标电子设备按照所述第一运动轨迹进行运动;所述目标电子设备,还设置为计算多台所述电子设备中除所述目标电子设备以外的其余每台所述电子设备相对于所述目标电子设备的相对位置;所述目标电子设备,还设置为将所述相对位置发送给多台所述电子设备中除所述目标电子设备以外的其余电子设备;多台所述电子设备中除所述目标电子设备以外的每台电子设备,还设置为根据所述第一运动轨迹和自身相对于所述目标电子设备的相对位置生成运动轨迹,并按照生成的运动轨迹进行运动。Optionally, the target electronic device is further configured to: at the target electronic device, photograph the target object at an angle of the target electronic device relative to the target object, to obtain a first image, and the remaining electronic device Before the remaining electronic device photographs the target object with respect to an angle of the target object to obtain a first image, generating a first motion trajectory according to the movement condition of the target object, wherein the target electronic device follows the first Moving the trajectory; the target electronic device is further configured to calculate a relative position of each of the plurality of electronic devices other than the target electronic device relative to the target electronic device; The target electronic device is further configured to send the relative position to the remaining electronic devices other than the target electronic device among the plurality of the electronic devices; each of the plurality of the electronic devices except the target electronic device The electronic device is further configured to generate a position according to the first motion trajectory and itself relative to the target electronic device Trajectory, and in accordance with the generated motion trajectory.
可选地,所述目标电子设备和/或所述其余电子设备,还设置为在所述目标电子设备以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体,得到第一图像,和所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像之前,获取标准时间;所述目标电子设备和/或所述其余电子设备,还设置为根据所述标准时间校准多台所述电子设备中每台电子设备的时间。Optionally, the target electronic device and/or the remaining electronic device are further configured to: at the target electronic device, capture the target object at an angle of the target electronic device relative to the target object, to obtain a first image. And acquiring, by the remaining electronic device, a standard time before the first electronic image is captured by the remaining electronic device at an angle relative to the target object; the target electronic device and/or the remaining electronic device, It is further arranged to calibrate the time of each of the plurality of electronic devices according to the standard time.
根据本发明实施例的另一方面,还提供了一种存储介质,所述存储介质包括存储 的程序,其中,在所述程序运行时控制所述存储介质所在设备执行上述任意一项所述的图像处理方法。According to another aspect of an embodiment of the present invention, a storage medium is provided, the storage medium including a stored program, wherein, when the program is running, controlling a device in which the storage medium is located performs any of the above Image processing method.
根据本发明实施例的另一方面,还提供了一种处理器,所述处理器用于运行程序,其中,所述程序运行时执行上述任意一项所述的图像处理方法。According to another aspect of an embodiment of the present invention, there is further provided a processor for executing a program, wherein the program is executed to perform the image processing method according to any one of the above.
根据本发明实施例的一个方面,提供了一种图像处理方法,包括:获取电子设备检测目标物体得到的所述目标物体的移动情况,其中,多台所述电子设备根据所述目标物体的移动情况进行运动,以保持多台所述电子设备各自与所述目标物体之间的相对位置不变;获取多台所述电子设备从不同角度拍摄所述目标物体得到的第一图像,得到多张所述第一图像;将多张所述第一图像进行合成,得到所述目标物体的立体影像。According to an aspect of the embodiments of the present invention, an image processing method includes: acquiring a movement condition of the target object obtained by detecting an object by an electronic device, wherein the plurality of the electronic devices move according to the target object Moving to maintain a relative position between each of the plurality of electronic devices and the target object; acquiring a first image obtained by capturing the target object from different angles by the plurality of electronic devices, and obtaining a plurality of images The first image; synthesizing a plurality of the first images to obtain a stereoscopic image of the target object.
可选的,多台所述电子设备为N台所述电子设备,获取多台所述电子设备从不同角度拍摄所述目标物体得到的第一图像,得到多张所述第一图像包括:第i台电子设备根据自身的图像采集单元识别所述目标物体;所述第i台电子设备以第i角度拍摄所述目标物体,得到所述第一图像,其中,所述第i角度是所述第i台电子设备相对所述目标物体的角度,其中,i依次取1至N,第1角度至第N角度为N个互不相同的角度,N为大于1的整数。Optionally, the plurality of the electronic devices are the N electronic devices, and the plurality of the electronic devices acquire the first image obtained by capturing the target object from different angles, and obtaining the plurality of the first images includes: The i-stage electronic device identifies the target object according to its own image acquisition unit; the i-th electronic device captures the target object at an ith angle to obtain the first image, wherein the ith angle is the The angle of the i-th electronic device with respect to the target object, wherein i takes 1 to N in order, the first angle to the Nth angle are N mutually different angles, and N is an integer greater than 1.
可选的,将多张所述第一图像进行合成,得到所述目标物体的立体影像包括:获取每张所述第一图像的拍摄时间;将拍摄时间相同的多张所述第一图像进行合成,得到所述立体影像。Optionally, combining the plurality of the first images to obtain a stereoscopic image of the target object includes: acquiring a shooting time of each of the first images; and performing a plurality of the first images with the same shooting time Synthesize to obtain the stereoscopic image.
可选的,将拍摄时间相同的多张所述第一图像进行合成,得到所述立体影像包括:去除所述第一图像中的背景部分,得到背景去除后的第一图像;将拍摄时间相同的多张背景去除后的第一图像进行合成,得到所述立体影像。Optionally, combining the plurality of the first images with the same shooting time to obtain the stereoscopic image includes: removing a background portion in the first image to obtain a first image after the background removal; and taking the same shooting time The plurality of background-removed first images are combined to obtain the stereoscopic image.
可选的,获取电子设备检测目标物体得到的所述目标物体的移动情况包括:多台所述电子设备中的目标电子设备根据所述目标物体的移动情况生成第一运动轨迹,其中,所述目标电子设备按照所述第一运动轨迹进行运动;所述目标电子设备计算多台所述电子设备中除所述目标电子设备以外的其余每台所述电子设备相对于所述目标电子设备的相对位置;所述目标电子设备将所述相对位置发送给多台所述电子设备中除所述目标电子设备以外的其余电子设备;多台所述电子设备中除所述目标电子设备以外的每台电子设备根据所述第一运动轨迹和自身相对于所述目标电子设备的相对位置生成运动轨迹,并按照生成的运动轨迹进行运动。Optionally, the acquiring, by the electronic device, the movement of the target object obtained by detecting the target object comprises: generating, by the target electronic device, the first motion trajectory according to the movement condition of the target object, wherein the The target electronic device moves according to the first motion trajectory; the target electronic device calculates a relative state of each of the plurality of electronic devices other than the target electronic device relative to the target electronic device a location; the target electronic device transmits the relative location to a remaining one of the plurality of electronic devices other than the target electronic device; each of the plurality of the electronic devices except the target electronic device The electronic device generates a motion trajectory according to the first motion trajectory and its relative position with respect to the target electronic device, and performs motion according to the generated motion trajectory.
可选的,在获取电子设备检测目标物体得到的所述目标物体的移动情况之前,所 述方法还包括:获取标准时间;根据所述标准时间校准多台所述电子设备中每台所述电子设备的时间。Optionally, before acquiring the movement condition of the target object obtained by the electronic device detecting the target object, the method further includes: acquiring a standard time; and calibrating each of the plurality of the electronic devices according to the standard time The time of the device.
根据本发明实施例的另一方面,还提供了一种图像处理装置,包括:第四获取单元,设置为获取电子设备检测目标物体得到的所述目标物体的移动情况,其中,多台所述电子设备根据所述目标物体的移动情况进行运动,以保持多台所述电子设备各自与所述目标物体之间的相对位置不变;第五获取单元,设置为获取多台所述电子设备从不同角度拍摄所述目标物体得到的第一图像,得到多张所述第一图像;第二合成单元,设置为将多张所述第一图像进行合成,得到所述目标物体的立体影像。According to another aspect of the present invention, an image processing apparatus is further provided, including: a fourth acquiring unit, configured to acquire a movement condition of the target object obtained by detecting an object by an electronic device, where The electronic device moves according to the movement condition of the target object to keep the relative positions of the plurality of the electronic devices and the target object unchanged; the fifth obtaining unit is configured to acquire the plurality of the electronic devices from Shooting the first image obtained by the target object at different angles to obtain a plurality of the first images; and the second combining unit is configured to combine the plurality of the first images to obtain a stereoscopic image of the target object.
可选的,多台所述电子设备为N台所述电子设备,所述第五获取单元包括:第i识别子单元,设置在第i台电子设备上,设置为根据所述第i台电子设备的图像采集单元识别所述目标物体;第i拍摄子单元,设置在所述第i台电子设备上,设置为以第i角度拍摄所述目标物体,得到所述第一图像,其中,所述第i角度是所述第i台电子设备相对所述目标物体的角度,其中,i依次取1至N,第1角度至第N角度为N个互不相同的角度,N为大于1的整数。Optionally, the plurality of the electronic devices are the N electronic devices, and the fifth obtaining unit includes: an i-th identification sub-unit, disposed on the i-th electronic device, and configured to be according to the i-th electronic device The image capturing unit of the device identifies the target object; the ith shooting subunit is disposed on the ith electronic device, and is configured to capture the target object at an ith angle to obtain the first image, wherein The i-th angle is an angle of the i-th electronic device with respect to the target object, wherein i is taken from 1 to N in sequence, and the first to N-th angles are N different angles, and N is greater than 1. Integer.
可选的,所述第二合成单元包括:第三获取子单元,设置为获取每张所述第一图像的拍摄时间;第二合成子单元,设置为将拍摄时间相同的多张所述第一图像进行合成,得到所述立体影像。Optionally, the second synthesizing unit includes: a third acquiring subunit configured to acquire a photographing time of each of the first images; and a second synthesizing subunit configured to set the plurality of photographs with the same photographing time An image is synthesized to obtain the stereoscopic image.
可选的,所述第二合成子单元包括:第三去除模块,设置为去除所述第一图像中的背景部分,得到背景去除后的第一图像;第二合成模块,设置为将拍摄时间相同的多张背景去除后的第一图像进行合成,得到所述立体影像。Optionally, the second synthesizing subunit includes: a third removing module configured to remove a background portion in the first image to obtain a first image after background removal; and a second synthesizing module configured to set a shooting time The same plurality of background-removed first images are combined to obtain the stereoscopic image.
可选的,所述第四获取单元包括:生成子单元,设置在多台所述电子设备中的目标电子设备上,设置为根据所述目标物体的移动情况生成第一运动轨迹,其中,所述目标电子设备按照所述第一运动轨迹进行运动;计算子单元,设置在所述目标电子设备上,设置为计算多台所述电子设备中除所述目标电子设备以外的其余每台所述电子设备相对于所述目标电子设备的相对位置;发送子单元,设置在所述目标电子设备上,设置为将所述相对位置发送给多台所述电子设备中除所述目标电子设备以外的其余电子设备;控制子单元,设置在多台所述电子设备中除所述目标电子设备以外的每台电子设备上,设置为根据所述第一运动轨迹和多台所述电子设备中除所述目标电子设备以外的每台电子设备相对于所述目标电子设备的相对位置生成运动轨迹,并控制多台所述电子设备中除所述目标电子设备以外的每台电子设备按照生成的运动轨迹进行运动。Optionally, the fourth acquiring unit includes: a generating subunit, configured on the target electronic device in the plurality of the electronic devices, configured to generate a first motion track according to the moving condition of the target object, where The target electronic device performs motion according to the first motion trajectory; and the calculation subunit is disposed on the target electronic device, and is configured to calculate each of the plurality of the electronic devices except the target electronic device. a relative position of the electronic device relative to the target electronic device; a transmitting subunit disposed on the target electronic device, configured to transmit the relative position to the plurality of the electronic devices other than the target electronic device a remaining electronic device, a control subunit, disposed on each of the plurality of the electronic devices except the target electronic device, configured to be according to the first motion trajectory and the plurality of electronic devices Generating a motion trajectory of each electronic device other than the target electronic device with respect to the relative position of the target electronic device, and controlling a plurality of stations Each electronic device in the electronic device other than the target electronic apparatus in accordance with the generated motion trajectory.
可选的,所述装置还包括:第六获取单元,设置为在所述第一获取单元获取电子设备检测目标物体得到的所述目标物体的移动情况之前,获取标准时间;第三校准单元,设置为根据所述标准时间校准多台所述电子设备中每台所述电子设备的时间。Optionally, the device further includes: a sixth acquiring unit, configured to acquire a standard time before the first acquiring unit acquires a movement condition of the target object obtained by the electronic device detecting the target object; and a third calibration unit, A time is set to calibrate each of the plurality of electronic devices according to the standard time.
在本发明实施例中,目标物体是处于运动状态的,多台电子设备检测目标物体得到目标物体的运动情况,根据目标物体的运动情况调整自身的运动状态,使得自身与目标物体保持相对静止,每台电子设备从不同角度对目标物体进行拍摄,得到多张图像,将这多张图像进行合成,得到目标物体的立体影像,达到了记录运动物体的立体影像的技术效果,进而解决了现有技术中无法记录运动物体的立体影像的技术问题。In the embodiment of the present invention, the target object is in a moving state, and the plurality of electronic devices detect the motion of the target object to obtain the motion of the target object, and adjust the motion state of the target object according to the motion condition of the target object, so that the target object remains relatively stationary with the target object. Each electronic device captures a target object from different angles, obtains multiple images, and combines the multiple images to obtain a stereoscopic image of the target object, thereby achieving the technical effect of recording a stereoscopic image of the moving object, thereby solving the existing The technical problem of the stereoscopic image of a moving object cannot be recorded in the technology.
附图说明DRAWINGS
此处所说明的附图用来提供对本发明的进一步理解,构成本发明的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:The drawings described herein are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:
图1是根据本发明实施例的一种图像处理方法的流程图;1 is a flow chart of an image processing method according to an embodiment of the present invention;
图2是根据本发明实施例的多台电子设备与目标物体的位置示意图;2 is a schematic diagram showing positions of a plurality of electronic devices and a target object according to an embodiment of the present invention;
图3是根据本发明实施例的多台电子设备与目标物体的运动轨迹示意图;3 is a schematic diagram of motion trajectories of a plurality of electronic devices and a target object according to an embodiment of the present invention;
图4是根据本发明实施例的基于目标电子设备的图像处理方法的流程图;4 is a flowchart of an image processing method based on a target electronic device according to an embodiment of the present invention;
图5是根据本发明实施例的目标电子设备侧的图像处理装置的结构框图;FIG. 5 is a structural block diagram of an image processing apparatus on a target electronic device side according to an embodiment of the present invention; FIG.
图6是根据本发明实施例的目标电子设备侧的图像处理装置中第一获取单元52的结构框图;FIG. 6 is a structural block diagram of a first acquiring unit 52 in an image processing apparatus on a target electronic device side according to an embodiment of the present invention;
图7是根据本发明实施例的目标电子设备侧的图像处理装置中第一合成单元54的结构框图;FIG. 7 is a structural block diagram of a first synthesizing unit 54 in an image processing apparatus on a target electronic device side according to an embodiment of the present invention;
图8是根据本发明实施例的目标电子设备侧的图像处理装置中第一合成单元54中第一合成子单元74的结构框图;FIG. 8 is a structural block diagram of a first synthesizing subunit 74 in a first synthesizing unit 54 in an image processing apparatus on a target electronic device side according to an embodiment of the present invention;
图9是根据本发明实施例的目标电子设备侧的图像处理装置的优选结构框图一;9 is a block diagram 1 of a preferred structure of an image processing apparatus on a target electronic device side according to an embodiment of the present invention;
图10是根据本发明实施例的目标电子设备侧的图像处理装置的优选结构框图二;10 is a block diagram 2 of a preferred structure of an image processing apparatus on a target electronic device side according to an embodiment of the present invention;
图11是根据本发明实施例的基于其余电子设备的图像处理方法的流程图;11 is a flowchart of an image processing method based on remaining electronic devices according to an embodiment of the present invention;
图12是根据本发明实施例的基于其余电子设备的图像处理装置的结构框图;FIG. 12 is a block diagram showing the structure of an image processing apparatus based on remaining electronic devices according to an embodiment of the present invention; FIG.
图13是根据本发明实施例的基于其余电子设备的图像处理装置中拍摄单元122的优选结构框图;FIG. 13 is a block diagram showing a preferred configuration of a photographing unit 122 in an image processing apparatus based on remaining electronic devices according to an embodiment of the present invention; FIG.
图14是根据本发明实施例的基于其余电子设备的图像处理装置的优选结构框图一;FIG. 14 is a block diagram 1 showing a preferred structure of an image processing apparatus based on remaining electronic devices according to an embodiment of the present invention; FIG.
图15是根据本发明实施例的基于其余电子设备的图像处理装置的优选结构框图二;15 is a block diagram 2 of a preferred structure of an image processing apparatus based on remaining electronic devices according to an embodiment of the present invention;
图16是根据本发明实施例的基于其余电子设备的图像处理装置中第二发送单元124的优选结构框图;16 is a block diagram showing a preferred configuration of a second transmitting unit 124 in an image processing apparatus based on remaining electronic devices according to an embodiment of the present invention;
图17是根据本发明实施例的基于目标电子设备和其余电子设备的系统的图像处理方法的流程图;17 is a flowchart of an image processing method of a system based on a target electronic device and remaining electronic devices, according to an embodiment of the present invention;
图18是根据本发明实施例的图像处理系统的结构示意图;18 is a schematic structural diagram of an image processing system according to an embodiment of the present invention;
图19是根据本发明实施例的一种图像处理装置的优选示意图。19 is a preferred schematic diagram of an image processing apparatus in accordance with an embodiment of the present invention.
具体实施方式detailed description
为了使本技术领域的人员更好地理解本发明方案,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分的实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is an embodiment of the invention, but not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts shall fall within the scope of the present invention.
需要说明的是,本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的本发明的实施例能够以除了在这里图示或描述的那些以外的顺序实施。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。It is to be understood that the terms "first", "second" and the like in the specification and claims of the present invention are used to distinguish similar objects, and are not necessarily used to describe a particular order or order. It is to be understood that the data so used may be interchanged where appropriate, so that the embodiments of the invention described herein can be implemented in a sequence other than those illustrated or described herein. In addition, the terms "comprises" and "comprises" and "the" and "the" are intended to cover a non-exclusive inclusion, for example, a process, method, system, product, or device that comprises a series of steps or units is not necessarily limited to Those steps or units may include other steps or units not explicitly listed or inherent to such processes, methods, products or devices.
根据本发明实施例,提供了一种图像处理方法的实施例,需要说明的是,在附图的流程图示出的步骤可以在诸如一组计算机可执行指令的计算机系统中执行,并且,虽然在流程图中示出了逻辑顺序,但是在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤。In accordance with an embodiment of the present invention, an embodiment of an image processing method is provided, it being noted that the steps illustrated in the flowchart of the figures may be performed in a computer system such as a set of computer executable instructions, and, although The logical order is shown in the flowcharts, but in some cases the steps shown or described may be performed in a different order than the ones described herein.
图1是根据本发明实施例的一种图像处理方法的流程图。该图像处理方法应用于具备驱动装置的电子设备,驱动装置设置为为电子设备提供驱动力以使得电子设备能够移动,电子设备还具有图像采集单元。1 is a flow chart of an image processing method in accordance with an embodiment of the present invention. The image processing method is applied to an electronic device having a driving device configured to provide a driving force for the electronic device to enable the electronic device to move, and the electronic device further has an image capturing unit.
如图1所示,该方法包括如下步骤:As shown in FIG. 1, the method includes the following steps:
步骤S102,获取电子设备检测目标物体得到的目标物体的移动情况,其中,多台电子设备根据目标物体的移动情况进行运动,以保持多台电子设备各自与目标物体之间的相对位置不变。Step S102: Acquire a movement condition of the target object obtained by the electronic device detecting the target object, wherein the plurality of electronic devices perform motion according to the movement condition of the target object to keep the relative positions between the plurality of electronic devices and the target object unchanged.
步骤S104,获取多台电子设备从不同角度拍摄目标物体得到的第一图像,得到多张第一图像。Step S104: Acquire a first image obtained by capturing, by a plurality of electronic devices, a target object from different angles to obtain a plurality of first images.
步骤S106,将多张第一图像进行合成,得到目标物体的立体影像。In step S106, a plurality of first images are combined to obtain a stereoscopic image of the target object.
目标物体是移动的物体,可以在一定范围内自由移动。The target object is a moving object that can move freely within a certain range.
电子设备可以是机器人。电子设备可以具有设置为拍摄的双目摄像头。The electronic device can be a robot. The electronic device can have a binocular camera that is set to shoot.
多台电子设备根据目标物体的移动情况进行运动,以保持多台电子设备各自与目标物体之间的相对位置不变,即,每台电子设备相对于目标物体都是静止的。The plurality of electronic devices move according to the movement of the target object to keep the relative positions of the plurality of electronic devices and the target object unchanged, that is, each of the electronic devices is stationary with respect to the target object.
每台电子设备相对于目标物体的角度、方位都是不同的,每台电子设备对目标物体进行拍摄,得到第一图像,多台电子设备一共得到多张第一图像。每张第一图像都从不同角度对目标物体的影像进行了记录。The angle and orientation of each electronic device are different with respect to the target object. Each electronic device captures the target object to obtain a first image, and multiple electronic devices obtain a plurality of first images in total. Each first image records the image of the target object from different angles.
将多张第一图像进行合成,即能够得到目标物体的立体影像,该立体影像中包含了目标物体全方位的信息。By synthesizing a plurality of first images, a stereoscopic image of the target object can be obtained, and the stereoscopic image includes information on the omnidirectional object.
在本发明实施例中,目标物体是处于运动状态的,多台电子设备检测目标物体得到目标物体的运动情况,根据目标物体的运动情况调整自身的运动状态,使得自身与目标物体保持相对静止,每台电子设备从不同角度对目标物体进行拍摄,得到多张图像,将这多张图像进行合成,得到目标物体的立体影像,解决了现有技术中无法记录运动物体的立体影像的技术问题,达到了记录运动物体的立体影像的技术效果。In the embodiment of the present invention, the target object is in a moving state, and the plurality of electronic devices detect the motion of the target object to obtain the motion of the target object, and adjust the motion state of the target object according to the motion condition of the target object, so that the target object remains relatively stationary with the target object. Each electronic device captures a target object from different angles, obtains multiple images, and combines the multiple images to obtain a stereoscopic image of the target object, thereby solving the technical problem that the stereoscopic image of the moving object cannot be recorded in the prior art. The technical effect of recording a stereoscopic image of a moving object is achieved.
可选地,多台电子设备为N台电子设备,获取多台电子设备从不同角度拍摄目标物体得到的第一图像,得到多张第一图像包括:第i台电子设备根据自身的图像采集单元识别目标物体;第i台电子设备以第i角度拍摄目标物体,得到第一图像,其中,第i角度是第i台电子设备相对目标物体的角度,其中,i依次取1至N,第1角度至第N角度为N个互不相同的角度,N为大于1的整数。Optionally, the plurality of electronic devices are N electronic devices, and the first image obtained by the plurality of electronic devices capturing the target object from different angles is obtained, and obtaining the plurality of first images includes: the i-th electronic device according to its own image acquisition unit Identifying the target object; the i-th electronic device photographs the target object at the ith angle to obtain a first image, wherein the i-th angle is an angle of the i-th electronic device relative to the target object, wherein i takes 1 to N in turn, first The angle to the Nth angle is N different angles, and N is an integer greater than 1.
例如,图2中示出了3台电子设备,分别为电子设备E1、电子设备E2、电子设备E3,A为目标物体。目标物体A是运动的,电子设备E1、电子设备E2、电子设备E3根据目标物体A的运动情况调整自身的运动情况,以保持自身与目标物体A之间的相对位置不变。For example, FIG. 2 shows three electronic devices, which are an electronic device E1, an electronic device E2, and an electronic device E3, respectively, and A is a target object. The target object A is moving, and the electronic device E1, the electronic device E2, and the electronic device E3 adjust their own motion according to the motion of the target object A to keep the relative position between itself and the target object A unchanged.
电子设备E1、电子设备E2、电子设备E3相对于目标物体的角度、方位都是不同的,这3台电子设备分别对目标物体进行拍摄,得到3张第一图像。这3张第一图像从不同角度对目标物体的影像进行了记录,将这3张第一图像进行合成,就得到了目标物体A的立体影像。The angles and orientations of the electronic device E1, the electronic device E2, and the electronic device E3 are different with respect to the target object, and the three electronic devices respectively capture the target object to obtain three first images. The three first images record the image of the target object from different angles, and combine the three first images to obtain a stereoscopic image of the target object A.
可选地,将多张第一图像进行合成,得到目标物体的立体影像包括:获取每张第一图像的拍摄时间;将拍摄时间相同的多张第一图像进行合成,得到立体影像。Optionally, combining the plurality of first images to obtain a stereoscopic image of the target object includes: acquiring a shooting time of each of the first images; and synthesizing the plurality of first images having the same shooting time to obtain a stereoscopic image.
每台电子设备都会拍摄得到多张第一图像,这多张第一图像可以是在不同的时间拍摄的。电子设备在拍摄图像时,会记录拍摄时间。通过读取拍摄时间,能够知道电子设备拍摄图像的时间。Each electronic device will capture multiple first images, which may be taken at different times. When the electronic device captures an image, the recording time is recorded. By reading the shooting time, it is possible to know when the electronic device takes an image.
将不同电子设备拍摄的拍摄时间相同的多张第一图像进行合成,得到目标物体的立体影像。A plurality of first images of the same shooting time taken by different electronic devices are combined to obtain a stereoscopic image of the target object.
例如,图2中示出的电子设备E1在T1时刻拍摄得到第一图像P11,在T2时刻拍摄得到第一图像P12,在T3时刻拍摄得到第一图像P13。For example, the electronic device E1 shown in FIG. 2 captures the first image P11 at time T1, the first image P12 at time T2, and the first image P13 at time T3.
电子设备E2在T1时刻拍摄得到第一图像P21,在T2时刻拍摄得到第一图像P22,在T3时刻拍摄得到第一图像P23。The electronic device E2 captures the first image P21 at time T1, captures the first image P22 at time T2, and captures the first image P23 at time T3.
电子设备E3在T1时刻拍摄得到第一图像P31,在T2时刻拍摄得到第一图像P32,在T3时刻拍摄得到第一图像P33。The electronic device E3 captures the first image P31 at time T1, captures the first image P32 at time T2, and captures the first image P33 at time T3.
将拍摄时间同为T1时刻的第一图像P11、第一图像P21、第一图像P31进行合成,得到目标物体在T1时刻的立体图像。The first image P11, the first image P21, and the first image P31 at the time T1 are combined to obtain a stereoscopic image of the target object at time T1.
将拍摄时间同为T2时刻的第一图像P12、第一图像P22、第一图像P32进行合成,得到目标物体在T2时刻的立体图像。The first image P12, the first image P22, and the first image P32 at the time T2 are combined to obtain a stereoscopic image of the target object at time T2.
将拍摄时间同为T3时刻的第一图像P13、第一图像P23、第一图像P33进行合成,得到目标物体在T3时刻的立体图像。The first image P13, the first image P23, and the first image P33 at the time T3 are combined to obtain a stereoscopic image of the target object at time T3.
可选地,在获取电子设备检测目标物体得到的目标物体的移动情况之前,方法还包括:获取标准时间;根据标准时间校准多台电子设备中每台电子设备的时间。Optionally, before acquiring the movement condition of the target object obtained by the electronic device detecting the target object, the method further includes: acquiring a standard time; and calibrating the time of each of the plurality of electronic devices according to the standard time.
电子设备中的时间有可能是准确的,也可能是不准确的。如果多台电子设备中的时间不同步,那么在将拍摄时间相同的多张第一图像进行合成,得到立体影像的过程中,就会出现错误,即,将实际拍摄时间不同的多张第一图像进行合成会得到错误的图像。The time in an electronic device may or may not be accurate. If the time in the plurality of electronic devices is not synchronized, in the process of synthesizing a plurality of first images having the same shooting time to obtain a stereoscopic image, an error occurs, that is, a plurality of first images having different actual shooting times The image is synthesized to get the wrong image.
为了避免上述问题,使用标准时间对多台电子设备中每台电子设备的时间进行校准,使得多台电子设备中的时间同步。In order to avoid the above problem, the time of each of the plurality of electronic devices is calibrated using standard time, so that the time in the plurality of electronic devices is synchronized.
可选地,将拍摄时间相同的多张第一图像进行合成,得到立体影像包括:去除第一图像中的背景部分,得到背景去除后的第一图像;将拍摄时间相同的多张背景去除后的第一图像进行合成,得到立体影像。Optionally, combining the plurality of first images with the same shooting time to obtain the stereoscopic image includes: removing the background portion in the first image to obtain the first image after the background removal; and removing the plurality of backgrounds with the same shooting time The first image is synthesized to obtain a stereoscopic image.
在将拍摄时间相同的多张第一图像进行合成之前,可以先去除多张第一图像中的背景部分,然后再将多张第一图像进行合成,能够去掉背景的干扰,得到更加清晰突出的目标物体的立体影像。通过识别和交互,确认被拍摄主体(目标物体),并从当前3D影像中去除背景,剪切出被拍摄主体。Before synthesizing a plurality of first images having the same shooting time, the background portions in the plurality of first images may be removed first, and then the plurality of first images are combined to remove the interference of the background, thereby obtaining a clearer and more prominent A stereoscopic image of the target object. By recognizing and interacting, the subject (target object) is confirmed, and the background is removed from the current 3D image, and the subject is cut out.
多台电子设备生成自身的运动轨迹的方法可以为以下任意一种:The method by which multiple electronic devices generate their own motion trajectory can be any of the following:
多台电子设备生成自身的运动轨迹的第一种方法:The first method in which multiple electronic devices generate their own motion trajectories:
多台电子设备可以各自实时检测目标物体的运动情况,然后各自根据目标物体的运动情况和自身相对于目标物体的位置实时生成自身的运动轨迹,以使自身与目标物体相对静止。Multiple electronic devices can detect the motion of the target object in real time, and then generate their own motion trajectory in real time according to the motion condition of the target object and the position of the target object relative to the target object, so that the target object is relatively stationary.
如图3所示,一共有3台电子设备,分别为电子设备E1、电子设备E2、电子设备E3,A为目标物体。目标物体A是运动的,电子设备E1、电子设备E2、电子设备E3根据目标物体A的运动情况进行运动,以保持自身与目标物体A之间的相对位置不变。电子设备E1、电子设备E2、电子设备E3均实时检测目标物体A的运动情况,根据目标物体A的运动情况生成自身的运动轨迹,以使自身与目标物体A保持相对静止。轨迹G0示出了目标物体A的运动轨迹;轨迹G1示出了电子设备E1的运动轨迹;轨迹G2示出了电子设备E2的运动轨迹;轨迹G3示出了电子设备E3的运动轨迹。As shown in FIG. 3, there are three electronic devices, namely, an electronic device E1, an electronic device E2, and an electronic device E3, and A is a target object. The target object A is moving, and the electronic device E1, the electronic device E2, and the electronic device E3 move according to the motion of the target object A to keep the relative position between itself and the target object A unchanged. The electronic device E1, the electronic device E2, and the electronic device E3 detect the motion of the target object A in real time, and generate its own motion trajectory according to the motion of the target object A, so that itself and the target object A remain relatively stationary. The trajectory G0 shows the motion trajectory of the target object A; the trajectory G1 shows the motion trajectory of the electronic device E1; the trajectory G2 shows the motion trajectory of the electronic device E2; and the trajectory G3 shows the motion trajectory of the electronic device E3.
多台电子设备生成自身的运动轨迹的第二种方法:The second method in which multiple electronic devices generate their own motion trajectories:
多台电子设备中的目标电子设备根据目标物体的移动情况生成第一运动轨迹,其中,目标电子设备按照第一运动轨迹进行运动;目标电子设备计算多台电子设备中除目标电子设备以外的其余每台电子设备相对于目标电子设备的相对位置;目标电子设备将相对位置发送给多台电子设备中除目标电子设备以外的其余电子设备;多台电子 设备中除目标电子设备以外的每台电子设备根据第一运动轨迹和自身相对于目标电子设备的相对位置生成运动轨迹,并按照生成的运动轨迹进行运动。The target electronic device in the plurality of electronic devices generates a first motion trajectory according to the movement condition of the target object, wherein the target electronic device performs motion according to the first motion trajectory; and the target electronic device calculates other than the target electronic device among the plurality of electronic devices The relative position of each electronic device relative to the target electronic device; the target electronic device transmits the relative position to the remaining electronic devices of the plurality of electronic devices except the target electronic device; each of the plurality of electronic devices except the target electronic device The device generates a motion trajectory according to the first motion trajectory and its relative position with respect to the target electronic device, and performs motion according to the generated motion trajectory.
多台电子设备之间具有通信能力,可以由其中一台电子设备(目标电子设备)根据目标物体的移动情况生成第一运动轨迹,当目标电子设备按照第一运动轨迹进行运动时,目标电子设备与目标物体的相对位置不变。The plurality of electronic devices have communication capability, and one of the electronic devices (target electronic devices) can generate a first motion trajectory according to the movement condition of the target object, and when the target electronic device performs motion according to the first motion trajectory, the target electronic device The relative position to the target object does not change.
多台电子设备中除目标电子设备以外的每台电子设备根据第一运动轨迹和自身相对于目标电子设备的相对位置生成运动轨迹,并按照生成的运动轨迹进行运动,以使得自身与目标物体的相对位置不变。Each electronic device of the plurality of electronic devices except the target electronic device generates a motion trajectory according to the first motion trajectory and its relative position with respect to the target electronic device, and performs motion according to the generated motion trajectory to make itself and the target object The relative position is unchanged.
在第二种方法中,目标电子设备可以是多个电子设备中任意一个,也可以是多个电子设备中计算能力最强的一个。In the second method, the target electronic device may be any one of a plurality of electronic devices, or may be the one with the strongest computing power among the plurality of electronic devices.
多台电子设备中,只有目标电子设备需要检测目标物体的运动情况,其他电子设备都不需要检测目标物体的运动情况,使得电子设备的工作量大大较少。Among the plurality of electronic devices, only the target electronic device needs to detect the movement of the target object, and the other electronic devices do not need to detect the movement of the target object, so that the workload of the electronic device is much less.
由于每台电子设备相对于目标物体都是静止的,所以任意两台电子设备之间也是相对静止的,即,任意两台电子设备在任意一个时刻的相对位置保持不变。目标电子设备计算其余每台电子设备相对于目标电子设备的相对位置可以是实时探测、计算得到的,也可以是在运动过程中的任意时刻探测、计算到的,还可以是在目标物体开始运动之前探测、计算到的,还可以是用户输入的。Since each electronic device is stationary relative to the target object, any two electronic devices are relatively stationary, that is, the relative positions of any two electronic devices at any one time remain unchanged. The target electronic device calculates the relative position of each of the remaining electronic devices relative to the target electronic device, which may be detected or calculated in real time, or may be detected or calculated at any time during the motion, or may be started at the target object. Previously detected and calculated, it can also be input by the user.
多台电子设备中除目标电子设备以外的每台电子设备根据第一运动轨迹和自身相对于目标电子设备的相对位置生成运动轨迹,并按照生成的运动轨迹进行运动。Each of the plurality of electronic devices except the target electronic device generates a motion trajectory according to the first motion trajectory and its relative position with respect to the target electronic device, and performs motion according to the generated motion trajectory.
由于多台电子设备中除目标电子设备以外的每台电子设备相对于目标电子设备静止,目标电子设备相对于目标物体静止,因此,多台电子设备中每台电子设备都相对于目标物体静止。Since each of the plurality of electronic devices except the target electronic device is stationary with respect to the target electronic device, the target electronic device is stationary with respect to the target object, and therefore, each of the plurality of electronic devices is stationary with respect to the target object.
在本发明实施例中,通过多台电子设备自组网络通信,实现协同运动,协同跟随拍摄3D影像,进而合成出全方位3D影像。In the embodiment of the present invention, a plurality of electronic devices are self-organized to communicate with each other to realize coordinated motion, and the 3D images are cooperatively followed to form a full-scale 3D image.
基于上述实施例及优选实施例,由于在本申请的图像处理方法中所涉及的角色中包括目标电子设备(用于合成立体影像的电子设备),以及用于辅助目标电子设备合成立体影像的其余电子设备,为使本申请的图像处理方法中各个角色所执行的操作更为清楚,下面分别对图像处理方法中各个不同角色所执行的操作分别说明。Based on the above embodiments and preferred embodiments, the target electronic device (an electronic device for synthesizing a stereoscopic image) and the remaining image for assisting the target electronic device to synthesize the stereoscopic image are included in the role involved in the image processing method of the present application. In the electronic device, in order to make the operations performed by the respective characters in the image processing method of the present application clearer, the operations performed by the respective roles in the image processing method are separately described below.
基于目标电子设备Target based electronic device
图4是根据本发明实施例的基于目标电子设备的图像处理方法的流程图,如图4所示,该图像处理方法,应用于具备驱动装置的目标电子设备,驱动装置设置为为目标电子设备提供驱动力以使得目标电子设备能够根据目标物体的移动情况移动,其中,目标电子设备还具有图像采集单元,目标电子设备为多台电子设备中的任意一台电子设备,目标电子设备与目标物体之间的相对位置保持不变,多台电子设备中除目标电子设备之外的其余电子设备各自与目标物体之间的相对位置也保持不变,方法包括如下步骤:4 is a flowchart of an image processing method based on a target electronic device according to an embodiment of the present invention. As shown in FIG. 4, the image processing method is applied to a target electronic device having a driving device, and the driving device is configured as a target electronic device. Providing a driving force to enable the target electronic device to move according to the movement condition of the target object, wherein the target electronic device further has an image capturing unit, the target electronic device is any one of the plurality of electronic devices, the target electronic device and the target object The relative position between them remains unchanged, and the relative positions of the remaining electronic devices of the plurality of electronic devices except the target electronic device and the target object remain unchanged, and the method includes the following steps:
步骤S402,目标电子设备获取多台电子设备从不同角度拍摄目标物体得到的多张第一图像;Step S402, the target electronic device acquires a plurality of first images obtained by the plurality of electronic devices capturing the target object from different angles;
步骤S402,目标电子设备将多张第一图像进行合成,得到目标物体的立体影像。Step S402, the target electronic device combines the plurality of first images to obtain a stereoscopic image of the target object.
在本发明实施例中,目标物体是处于运动状态的,目标电子设备能够根据目标物体的移动情况移动,包括目标电子设备和其余电子设备的多台电子设备根据目标物体的运动情况调整自身的运动状态,使得自身与目标物体保持相对静止,每台电子设备从不同角度对目标物体进行拍摄,得到多张图像,由目标电子设备将这多张图像进行合成,得到目标物体的立体影像,解决了现有技术中无法记录运动物体的立体影像的技术问题,达到了记录运动物体的立体影像的技术效果。In the embodiment of the present invention, the target object is in a moving state, and the target electronic device can be moved according to the movement condition of the target object, and the plurality of electronic devices including the target electronic device and the remaining electronic devices adjust the motion of the target object according to the movement condition of the target object. The state keeps itself and the target object relatively stationary, each electronic device shoots the target object from different angles, obtains multiple images, and the target electronic device combines the multiple images to obtain a stereoscopic image of the target object, and solves the problem. In the prior art, the technical problem of the stereoscopic image of the moving object cannot be recorded, and the technical effect of recording the stereoscopic image of the moving object is achieved.
可选地,多台电子设备为N台电子设备,目标电子设备获取多台电子设备从不同角度拍摄目标物体得到的多张第一图像包括:目标电子设备不仅需要自身以相对于目标物体的角度拍摄目标物体,而且还需要获取到除目标电子设备之外的其余电子设备分别以各自相对于目标物体的角度拍摄目标物体得到的第一图像,具体如下:Optionally, the plurality of electronic devices are N electronic devices, and the target electronic device acquires the plurality of first images obtained by capturing the target objects from different angles by the plurality of electronic devices, including: the target electronic device not only needs to be at an angle relative to the target object The target object is photographed, and the first image obtained by taking the target object with respect to the angle of the target object relative to the target object is also acquired as follows:
目标电子设备根据自身的图像采集单元识别目标物体,目标电子设备以目标电子设备相对目标物体的角度拍摄目标物体,得到第一图像;目标电子设备根据多台电子设备自组网络通信的方式,获取其余电子设备从不同角度拍摄目标物体得到的N-1张第一图像,其中,第i台电子设备根据自身的图像采集单元识别目标物体,第i台电子设备以第i角度拍摄目标物体,得到第一图像,其中,第i角度是第i台电子设备相对目标物体的角度,其中,i依次取1至N-1,多台电子设备相对目标物体的N个角度为N个互不相同的角度,N为大于1的整数。The target electronic device identifies the target object according to its own image acquisition unit, and the target electronic device captures the target object with the target electronic device at an angle relative to the target object to obtain a first image; the target electronic device acquires according to the manner of multiple electronic devices self-organizing network communication. The remaining electronic devices capture N-1 first images obtained from the target object from different angles, wherein the i-th electronic device recognizes the target object according to the image acquisition unit of the same, and the i-th electronic device captures the target object at the ith angle, a first image, wherein the ith angle is an angle of the i-th electronic device relative to the target object, wherein i sequentially takes 1 to N-1, and the N angles of the plurality of electronic devices relative to the target object are N different from each other. Angle, N is an integer greater than one.
为使得用于合成立体影像的第一图像均对针对同一时间的,在目标电子设备将多张第一图像进行合成,得到目标物体的立体影像时,目标电子设备可以获取每张第一图像的拍摄时间;之后,目标电子设备将拍摄时间相同的多张第一图像进行合成,得到立体影像。采用上述处理,使得合成的立体影像在时间上是统一的。In order to make the first image for synthesizing the stereoscopic image to be the same time, when the target electronic device combines the plurality of first images to obtain a stereoscopic image of the target object, the target electronic device may acquire each of the first images. The shooting time; after that, the target electronic device synthesizes a plurality of first images of the same shooting time to obtain a stereoscopic image. With the above processing, the synthesized stereoscopic images are unified in time.
为能够有效去除拍摄的第一图像的背景的干扰,在目标电子设备将拍摄时间相同的多张第一图像进行合成,得到立体影像时,可以由目标电子设备去除第一图像中的背景部分,得到背景去除后的第一图像;之后,目标电子设备将拍摄时间相同的多张背景去除后的第一图像进行合成,得到立体影像。In order to effectively remove the interference of the background of the captured first image, when the target electronic device combines the plurality of first images having the same shooting time to obtain a stereoscopic image, the background portion in the first image may be removed by the target electronic device. The first image after the background removal is obtained; after that, the target electronic device combines the first images after the background removal with the same shooting time to obtain a stereoscopic image.
可选地,在目标电子设备获取多台电子设备从不同角度拍摄目标物体得到的多张第一图像之前,可以通过多种方式实现:包括目标电子设备和其余电子设备的多台电子设备依据目标物体的移动情况而运动,例如,可以由多台电子设备分别各自依据自身对目标物体的检测得到目标物体的移动情况,而后依据自身得到的目标物体的移动情况进行运动;也可以由多台电子设备中的一台电子设备(目标电子设备)来依据该目标电子设备对目标物体的检测得到的目标物体的移动情况,而后依据该目标电子设备与其余电子设备之间的相对位置来确定其余电子设备的移动轨迹,而后由其它电子设备依据确定的移动轨迹运动。由于相对于第一种方法而言,在第二种方法中,由于只有目标电子设备需要检测目标物体的运动情况,其他电子设备都不需要检测目标物体的运动情况,使得电子设备的工作量大大较少。Optionally, before the target electronic device acquires the plurality of first images obtained by the plurality of electronic devices capturing the target object from different angles, the method may be implemented in multiple manners: the plurality of electronic devices including the target electronic device and the remaining electronic devices are according to the target The movement of the object moves. For example, multiple electronic devices can respectively obtain the movement of the target object according to the detection of the target object, and then move according to the movement of the target object obtained by itself; or multiple electronic devices An electronic device (target electronic device) in the device determines the movement of the target object according to the detection of the target object by the target electronic device, and then determines the remaining electrons according to the relative position between the target electronic device and the remaining electronic device. The movement trajectory of the device, which is then moved by other electronic devices in accordance with the determined movement trajectory. Compared with the first method, in the second method, since only the target electronic device needs to detect the motion of the target object, other electronic devices do not need to detect the motion of the target object, so that the workload of the electronic device is greatly increased. less.
可选地,上述第二种方法可以采用如下处理:目标电子设备根据目标物体的移动情况生成第一运动轨迹,其中,目标电子设备按照第一运动轨迹进行运动;目标电子设备计算多台电子设备中除目标电子设备以外的其余每台电子设备相对于目标电子设备的相对位置;目标电子设备将相对位置发送给多台电子设备中除目标电子设备以外的其余电子设备;其中,相对位置用于多台电子设备中除目标电子设备以外的每台电子设备结合第一运动轨迹生成运动轨迹,并按照生成的运动轨迹进行运动。Optionally, the foregoing second method may be configured as follows: the target electronic device generates a first motion trajectory according to the movement condition of the target object, wherein the target electronic device performs motion according to the first motion trajectory; and the target electronic device calculates multiple electronic devices. a relative position of each of the electronic devices other than the target electronic device relative to the target electronic device; the target electronic device transmits the relative position to the remaining electronic devices of the plurality of electronic devices other than the target electronic device; wherein, the relative position is used for Each of the plurality of electronic devices except the target electronic device generates a motion trajectory in conjunction with the first motion trajectory, and moves according to the generated motion trajectory.
电子设备中的时间有可能是准确的,也可能是不准确的。如果多台电子设备中的时间不同步,那么在将拍摄时间相同的多张第一图像进行合成,得到立体影像的过程中,就会出现错误,即,将实际拍摄时间不同的多张第一图像进行合成会得到错误的图像。The time in an electronic device may or may not be accurate. If the time in the plurality of electronic devices is not synchronized, in the process of synthesizing a plurality of first images having the same shooting time to obtain a stereoscopic image, an error occurs, that is, a plurality of first images having different actual shooting times The image is synthesized to get the wrong image.
为了避免上述问题,在目标电子设备获取多台电子设备从不同角度拍摄目标物体得到的多张第一图像之前,可以由目标电子设备获取标准时间;之后,由目标电子设备根据标准时间校准多台电子设备中每台电子设备的时间。使用标准时间对多台电子设备中每台电子设备的时间进行校准,使得多台电子设备中的时间同步。In order to avoid the above problem, the target electronic device may acquire the standard time before the target electronic device acquires the plurality of first images obtained by the plurality of electronic devices capturing the target object from different angles; after that, the target electronic device calibrates the plurality of the plurality of units according to the standard time. The time of each electronic device in the electronic device. The time of each electronic device in multiple electronic devices is calibrated using standard time, so that the time in multiple electronic devices is synchronized.
图5是根据本发明实施例的目标电子设备侧的图像处理装置的结构框图,如图5所示,该图像处理装置,应用于具备驱动装置的目标电子设备,驱动装置设置为为目标电子设备提供驱动力以使得电子设备能够根据目标物体的移动情况移动,其中,电子设备还具有图像采集单元,目标电子设备为多台电子设备中的任意一台电子设备, 目标电子设备与目标物体之间的相对位置保持不变,多台电子设备中除目标电子设备之外的其余电子设备各自与目标物体之间的相对位置也保持不变,装置包括:第一获取单元52和第一合成单元54,下面对该装置进行说明。FIG. 5 is a structural block diagram of an image processing apparatus on a target electronic device side according to an embodiment of the present invention. As shown in FIG. 5, the image processing apparatus is applied to a target electronic device having a driving device, and the driving device is configured as a target electronic device. Providing a driving force to enable the electronic device to move according to the movement condition of the target object, wherein the electronic device further has an image capturing unit, the target electronic device is any one of the plurality of electronic devices, and between the target electronic device and the target object The relative position of the electronic device remains unchanged from the target electronic device, and the device includes: the first obtaining unit 52 and the first synthesizing unit 54. The device will be described below.
第一获取单元52,设置为获取多台电子设备从不同角度拍摄目标物体得到的多张第一图像;第一合成单元54,连接至上述第一获取单元52,设置为将多张第一图像进行合成,得到目标物体的立体影像。The first obtaining unit 52 is configured to acquire a plurality of first images obtained by the plurality of electronic devices capturing the target object from different angles; the first synthesizing unit 54 is connected to the first acquiring unit 52, and is configured to set the plurality of first images The synthesis is performed to obtain a stereoscopic image of the target object.
图6是根据本发明实施例的目标电子设备侧的图像处理装置中第一获取单元52的结构框图,如图6所示,该第一获取单元52包括第一拍摄子单元62和第一获取子单元64,其中,多台电子设备为N台电子设备,下面对该第一获取单元52进行说明。FIG. 6 is a structural block diagram of a first acquiring unit 52 in an image processing apparatus on a target electronic device side according to an embodiment of the present invention. As shown in FIG. 6, the first acquiring unit 52 includes a first shooting subunit 62 and a first acquiring unit. The subunit 64, wherein the plurality of electronic devices are N electronic devices, the first obtaining unit 52 will be described below.
第一拍摄子单元62,设置为根据自身的图像采集单元识别目标物体,目标电子设备以目标电子设备相对目标物体的角度拍摄目标物体,得到第一图像;第一获取子单元64,设置为根据多台电子设备自组网络通信的方式,获取其余电子设备从不同角度拍摄目标物体得到的N-1张第一图像,其中,其余电子设备中的第i台电子设备包括:第i识别子单元,设置在第i台电子设备上,设置为根据第i台电子设备的图像采集单元识别目标物体;第i拍摄子单元,设置在第i台电子设备上,设置为以第i角度拍摄目标物体,得到第一图像,其中,第i角度是第i台电子设备相对目标物体的角度,其中,i依次取1至N-1,多台电子设备相对目标物体的N个角度为N个互不相同的角度,N为大于1的整数。The first photographing sub-unit 62 is configured to recognize the target object according to the image acquisition unit of the object, and the target electronic device photographs the target object at an angle of the target electronic device with respect to the target object to obtain a first image; the first acquisition sub-unit 64 is configured according to The plurality of electronic devices are configured to communicate with each other by the network, and obtain the N-1 first images obtained by the remaining electronic devices from the different angles, wherein the i-th electronic device in the remaining electronic devices includes: the i-th recognition sub-unit And being disposed on the i-th electronic device, configured to identify the target object according to the image capturing unit of the i-th electronic device; the i-th shooting sub-unit is disposed on the i-th electronic device, and is set to photograph the target object at the ith angle Obtaining a first image, wherein the ith angle is an angle of the i-th electronic device relative to the target object, wherein i takes 1 to N-1 in sequence, and the N angles of the plurality of electronic devices relative to the target object are N At the same angle, N is an integer greater than one.
图7是根据本发明实施例的目标电子设备侧的图像处理装置中第一合成单元54的结构框图,如图7所示,该第一合成单元54包括:第二获取子单元72和第一合成子单元74,下面对该第一合成单元54进行说明。FIG. 7 is a structural block diagram of a first synthesizing unit 54 in an image processing apparatus on a target electronic device side according to an embodiment of the present invention. As shown in FIG. 7, the first synthesizing unit 54 includes: a second acquiring subunit 72 and a first The synthesis subunit 74 will be described below with respect to the first synthesis unit 54.
第二获取子单元72,设置为获取每张第一图像的拍摄时间;第一合成子单元74,连接至上述第二获取子单元72,设置为将拍摄时间相同的多张第一图像进行合成,得到立体影像。The second obtaining sub-unit 72 is configured to acquire a shooting time of each first image; the first combining sub-unit 74 is connected to the second acquiring sub-unit 72, and is configured to synthesize the plurality of first images with the same shooting time , to get a stereo image.
图8是根据本发明实施例的目标电子设备侧的图像处理装置中第一合成单元54中第一合成子单元74的结构框图,如图8所示,该第一合成子单元74包括:第一去除模块82和第一合成模块84,下面对该第一合成子单元74进行说明。FIG. 8 is a structural block diagram of a first synthesizing subunit 74 in a first synthesizing unit 54 in an image processing apparatus on a target electronic device side according to an embodiment of the present invention. As shown in FIG. 8, the first synthesizing subunit 74 includes: A removal module 82 and a first synthesis module 84 are described below for the first synthesis subunit 74.
第一去除模块82,设置为去除第一图像中的背景部分,得到背景去除后的第一图像;第一合成模块84,连接至上述第一去除模块82,设置为将拍摄时间相同的多张背景去除后的第一图像进行合成,得到立体影像。The first removing module 82 is configured to remove the background portion in the first image to obtain a first image after the background removal; the first combining module 84 is connected to the first removing module 82, and is configured to set a plurality of times with the same shooting time. The first image after the background removal is combined to obtain a stereoscopic image.
图9是根据本发明实施例的目标电子设备侧的图像处理装置的优选结构框图一, 如图9所示,该装置除包括图5所示的所有结构外,还包括:生成单元92,计算单元94和第一发送单元96,下面对该优选结构进行说明。9 is a block diagram of a preferred structure of an image processing apparatus on a target electronic device side according to an embodiment of the present invention. As shown in FIG. 9, the apparatus includes, in addition to all the structures shown in FIG. 5, a generating unit 92, which is calculated. Unit 94 and first transmitting unit 96, the preferred structure will be described below.
生成单元92,设置在多台电子设备中的目标电子设备上,设置为根据目标物体的移动情况生成第一运动轨迹,其中,目标电子设备按照第一运动轨迹进行运动;计算单元94,设置在目标电子设备上,设置为计算多台电子设备中除目标电子设备以外的其余每台电子设备相对于目标电子设备的相对位置;第一发送单元96,连接至上述生成单元92,计算单元94和第一获取单元52,设置在目标电子设备上,设置为将相对位置发送给多台电子设备中除目标电子设备以外的其余电子设备,其中,在多台电子设备中除目标电子设备以外的每台电子设备上设置有控制单元,多台电子设备中除目标电子设备以外的每台电子设备相对于目标电子设备的相对位置用于控制单元结合第一运动轨迹生成运动轨迹,并控制多台电子设备中除目标电子设备以外的每台电子设备按照生成的运动轨迹进行运动。The generating unit 92 is disposed on the target electronic device in the plurality of electronic devices, and is configured to generate a first motion track according to the movement condition of the target object, wherein the target electronic device performs motion according to the first motion track; and the calculating unit 94 is configured to be The target electronic device is configured to calculate a relative position of each of the plurality of electronic devices except the target electronic device with respect to the target electronic device; the first sending unit 96 is connected to the generating unit 92, the calculating unit 94, and The first obtaining unit 52 is disposed on the target electronic device, and is configured to send the relative position to the remaining electronic devices of the plurality of electronic devices except the target electronic device, wherein each of the plurality of electronic devices except the target electronic device The control unit is provided on the electronic device, and the relative positions of each of the plurality of electronic devices except the target electronic device relative to the target electronic device are used by the control unit to generate a motion track in combination with the first motion track, and control multiple electronic devices. Each electronic device in the device except the target electronic device is generated according to Trajectory motion.
图10是根据本发明实施例的目标电子设备侧的图像处理装置的优选结构框图二,如图10所示,该装置除包括图5所示的所有结构外,还包括:第二获取单元102和第一校准单元104,下面对该优选结构进行说明。FIG. 10 is a block diagram of a preferred structure of an image processing apparatus on a target electronic device side according to an embodiment of the present invention. As shown in FIG. 10, the apparatus includes: second acquisition unit 102, in addition to all the structures shown in FIG. And the first calibration unit 104, the preferred structure will be described below.
第二获取单元102,设置为在第一获取单元获取电子设备检测目标物体得到的目标物体的移动情况之前,获取标准时间;第一校准单元104,连接至上述第二获取单元102,设置为根据标准时间校准多台电子设备中每台电子设备的时间。The second obtaining unit 102 is configured to acquire a standard time before the first acquiring unit acquires the moving condition of the target object obtained by the electronic device detecting the target object; the first calibration unit 104 is connected to the second acquiring unit 102, and is configured to be configured according to Standard time to calibrate each electronic device in multiple electronic devices.
基于其余电子设备Based on the rest of the electronic device
图11是根据本发明实施例的基于其余电子设备的图像处理方法的流程图,如图11所示,该图像处理方法应用于具备驱动装置的其余电子设备中,其余电子设备为多台电子设备中除目标电子设备之外的电子设备,驱动装置设置为为其余电子设备提供驱动力以使得其余电子设备能够根据目标物体的移动情况移动,其中,其余电子设备还具有图像采集单元,其余电子设备与目标物体之间的相对位置保持不变,目标电子设备与目标物体之间的相对位置也保持不变,方法包括:11 is a flowchart of an image processing method based on remaining electronic devices according to an embodiment of the present invention. As shown in FIG. 11, the image processing method is applied to other electronic devices having a driving device, and the remaining electronic devices are multiple electronic devices. In the electronic device other than the target electronic device, the driving device is configured to provide a driving force for the remaining electronic devices to enable the remaining electronic devices to move according to the moving condition of the target object, wherein the remaining electronic devices further have an image capturing unit, and the remaining electronic devices The relative position with the target object remains unchanged, and the relative position between the target electronic device and the target object remains unchanged. The method includes:
步骤S1102,其余电子设备以其余电子设备相对于目标物体的角度拍摄目标物体得到第一图像;Step S1102, the remaining electronic devices photograph the target object at an angle of the remaining electronic device with respect to the target object to obtain a first image;
步骤S1104,其余电子设备将得到的第一图像发送给目标电子设备,以使目标电子设备至少根据第一图像合成目标物体的立体影像,以使目标电子设备至少根据第一图像合成目标物体的立体影像。Step S1104: The remaining electronic device sends the obtained first image to the target electronic device, so that the target electronic device synthesizes the stereoscopic image of the target object according to at least the first image, so that the target electronic device synthesizes the stereoscopic target object according to at least the first image. image.
需要说明的是,此处目标电子设备至少根据第一图像合成目标物体的立体影像是 指该目标电子设备除根据上述其余电子设备发送的第一图像外,还根据目标电子设备自身拍摄的第一图像合成该目标物体的立体影像,例如,第一图像用于目标电子设备结合多台电子设备中除其余电子设备之外的电子设备各自与目标物体之间的角度拍摄目标物体得到的第一图像合成目标物体的立体影像。It should be noted that the stereoscopic image of the target electronic device at least according to the first image synthesis target object refers to the first image captured by the target electronic device according to the first electronic image transmitted by the target electronic device. The image is synthesized into a stereoscopic image of the target object, for example, the first image is used by the target electronic device to combine the first image obtained by capturing the target object with an angle between each of the plurality of electronic devices except the remaining electronic devices and the target object. A stereoscopic image of a synthetic target object.
可选地,对应于上述多台电子设备各自分别与目标物体保持相对位置不变的第二种方法,其余电子设备以其余电子设备相对于目标物体的角度拍摄目标物体得到第一图像包括:其余电子设备接收到第一运动轨迹,其中,第一运动轨迹为目标电子设备根据目标物体的移动情况生成的;其余电子设备接收到目标电子设备发送的其余电子设备相对于目标电子设备的相对位置;其余电子设备根据第一运动轨迹和相对位置生成运动轨迹;在其余电子设备按照生成的运动轨迹进行运动的情况下,以其余电子设备相对于目标物体的角度拍摄目标物体得到第一图像。Optionally, corresponding to the second method that each of the plurality of electronic devices respectively maintains a relative position unchanged from the target object, and the remaining electronic devices capture the target object at an angle of the remaining electronic device with respect to the target object to obtain the first image, including: Receiving, by the electronic device, the first motion trajectory, wherein the first motion trajectory is generated by the target electronic device according to the movement condition of the target object; and the remaining electronic devices receive the relative positions of the remaining electronic devices sent by the target electronic device with respect to the target electronic device; The remaining electronic devices generate a motion trajectory according to the first motion trajectory and the relative position; and in the case that the remaining electronic devices move according to the generated motion trajectory, the target image is captured by the remaining electronic device at an angle relative to the target object to obtain a first image.
为使得目标电子设备合成的目标物体的立体影像为同一时间的,可以由其余电子设备记录拍摄目标物体的拍摄时间,例如,其余电子设备记录其余电子设备以其余电子设备相对于目标物体的角度拍摄目标物体的拍摄时间,其中,拍摄时间用于目标电子设备合成目标物体的立体影像。In order to make the stereoscopic image of the target object synthesized by the target electronic device at the same time, the shooting time of the shooting target object may be recorded by the remaining electronic devices, for example, the remaining electronic devices record the remaining electronic devices to shoot at the angle of the remaining electronic devices relative to the target object. The shooting time of the target object, wherein the shooting time is used for the stereoscopic image of the target electronic device to synthesize the target object.
为使得多台电子设备的时间同步,在其余电子设备拍摄目标物体之前,对各个其余电子设备的时间进行同步,例如,在其余电子设备以其余电子设备相对于目标物体的角度拍摄目标物体得到第一图像之前,其余电子设备获取标准时间;其余电子设备根据标准时间校准其余电子设备的时间。In order to synchronize the time of the plurality of electronic devices, the time of each of the remaining electronic devices is synchronized before the remaining electronic devices capture the target object, for example, when the remaining electronic devices shoot the target object at an angle relative to the target object of the remaining electronic devices. Before the image, the remaining electronic devices acquire the standard time; the remaining electronic devices calibrate the time of the remaining electronic devices according to the standard time.
为使得目标电子设备合成目标物体的立体影像避免受背景部分的干扰,其余电子设备将得到的第一图像发送给目标电子设备时:由其余电子设备去除得到的第一图像中的背景部分,得到背景去除后的第一图像;之后,由其余电子设备将背景去除后的第一图像发送给目标电子设备。In order to prevent the target electronic device from synthesizing the stereoscopic image of the target object from interference by the background portion, when the remaining electronic device transmits the obtained first image to the target electronic device: the background portion in the obtained first image is removed by the remaining electronic device, The first image after the background is removed; after that, the first image after the background removal is sent by the remaining electronic devices to the target electronic device.
图12是根据本发明实施例的基于其余电子设备的图像处理装置的结构框图,如图12所示,该图像处理装置,应用于具备驱动装置的其余电子设备中,其余电子设备为多台电子设备中除目标电子设备之外的电子设备,驱动装置设置为为其余电子设备提供驱动力以使得其余电子设备能够根据目标物体的移动情况移动,其中,其余电子设备还具有图像采集单元,其余电子设备与目标物体之间的相对位置保持不变,目标电子设备与目标物体之间的相对位置也保持不变,装置包括:拍摄单元122和第二发送单元124,下面对该装置进行说明。FIG. 12 is a structural block diagram of an image processing apparatus based on remaining electronic devices according to an embodiment of the present invention. As shown in FIG. 12, the image processing apparatus is applied to other electronic devices having a driving device, and the remaining electronic devices are multiple electronic devices. An electronic device other than the target electronic device in the device, the driving device is configured to provide a driving force for the remaining electronic device to enable the remaining electronic device to move according to the moving condition of the target object, wherein the remaining electronic device further has an image collecting unit, and the remaining electronic The relative position between the device and the target object remains unchanged, and the relative position between the target electronic device and the target object remains unchanged. The device includes a photographing unit 122 and a second transmitting unit 124, which will be described below.
拍摄单元122,设置为以其余电子设备相对于目标物体的角度拍摄目标物体得到 第一图像;第二发送单元124,连接至上述拍摄单元122,设置为将得到的第一图像发送给目标电子设备,以使目标电子设备至少根据第一图像合成目标物体的立体影像。The photographing unit 122 is configured to photograph the target object with the angle of the remaining electronic device relative to the target object to obtain a first image; the second sending unit 124 is connected to the photographing unit 122, and is configured to send the obtained first image to the target electronic device. So that the target electronic device synthesizes the stereoscopic image of the target object based on at least the first image.
图13是根据本发明实施例的基于其余电子设备的图像处理装置中拍摄单元122的优选结构框图,如图13所示,该拍摄单元122包括:第一接收模块132,第二接收模块134,生成模块136和拍摄模块138,下面对该拍摄单元122进行说明。FIG. 13 is a block diagram showing a preferred structure of a photographing unit 122 in an image processing apparatus based on the remaining electronic devices. As shown in FIG. 13 , the photographing unit 122 includes a first receiving module 132 and a second receiving module 134. The generating module 136 and the photographing module 138 are described below, and the photographing unit 122 will be described below.
第一接收模块132,设置为接收到第一运动轨迹,其中,第一运动轨迹为目标电子设备根据目标物体的移动情况生成的;第二接收模块134,连接至上述第一接收模块132,设置为接收到目标电子设备发送的其余电子设备相对于目标电子设备的相对位置;生成模块136,连接至上述第二接收模块134,设置为根据第一运动轨迹和相对位置生成运动轨迹;拍摄模块138,连接至上述生成模块136,设置为在按照生成的运动轨迹进行运动的情况下,以其余电子设备相对于目标物体的角度拍摄目标物体得到第一图像。The first receiving module 132 is configured to receive the first motion trajectory, wherein the first motion trajectory is generated by the target electronic device according to the movement condition of the target object; the second receiving module 134 is connected to the first receiving module 132, and is configured. a generating module 136, connected to the second receiving module 134, configured to generate a motion trajectory according to the first motion trajectory and the relative position; the shooting module 138 is configured to receive the relative position of the remaining electronic device sent by the target electronic device relative to the target electronic device; And connected to the generating module 136, configured to capture the target object at an angle of the remaining electronic device relative to the target object to obtain the first image in the case of moving according to the generated motion trajectory.
图14是根据本发明实施例的基于其余电子设备的图像处理装置的优选结构框图一,如图14所示,该优选结构除包括图12所示的所有结构外,还包括:记录单元142,下面对该记录单元142进行说明。FIG. 14 is a block diagram showing a preferred structure of an image processing apparatus based on the remaining electronic devices according to an embodiment of the present invention. As shown in FIG. 14, the preferred structure includes: a recording unit 142 in addition to all the structures shown in FIG. The recording unit 142 will be described below.
记录单元142,设置为记录其余电子设备以其余电子设备相对于目标物体的角度拍摄目标物体的拍摄时间,其中,拍摄时间用于目标电子设备合成目标物体的立体影像。The recording unit 142 is configured to record the shooting time of the remaining electronic device to capture the target object at an angle of the remaining electronic device with respect to the target object, wherein the shooting time is used for the target electronic device to synthesize the stereoscopic image of the target object.
图15是根据本发明实施例的基于其余电子设备的图像处理装置的优选结构框图二,如图15所示,该优选结构除包括图12所示的所有结构外,还包括:第三获取单元152和第二校准单元154,下面对该优选结果进行说明。15 is a block diagram of a preferred structure of an image processing apparatus based on remaining electronic devices according to an embodiment of the present invention. As shown in FIG. 15, the preferred structure includes: a third acquisition unit in addition to all the structures shown in FIG. 152 and second calibration unit 154, the preferred results are described below.
第三获取单元152,设置为在其余电子设备以其余电子设备相对于目标物体的角度拍摄目标物体得到第一图像之前,获取标准时间;第二校准单元154,连接至上述第三获取单元152和拍摄单元122,设置为根据标准时间校准其余电子设备的时间。The third obtaining unit 152 is configured to acquire a standard time before the remaining electronic device photographs the target object at an angle relative to the target object to obtain the first image; the second calibration unit 154 is connected to the third acquiring unit 152 and The photographing unit 122 is configured to calibrate the time of the remaining electronic devices according to the standard time.
图16是根据本发明实施例的基于其余电子设备的图像处理装置中第二发送单元124的优选结构框图,如图16所示,该第二发送单元124包括:第二去除模块162和发送模块164,下面对该第二发送单元124进行说明。16 is a block diagram showing a preferred structure of a second transmitting unit 124 in an image processing apparatus based on the remaining electronic devices. As shown in FIG. 16, the second transmitting unit 124 includes: a second removing module 162 and a transmitting module, according to an embodiment of the present invention. 164. The second transmitting unit 124 will be described below.
第二去除模块162,设置为去除得到的第一图像中的背景部分,得到背景去除后的第一图像;发送模块164,连接至上述第二去除模块162,用于将背景去除后的第一图像发送给目标电子设备。The second removing module 162 is configured to remove the background portion in the obtained first image to obtain a first image after the background removal, and the sending module 164 is connected to the second removing module 162 for removing the background. The image is sent to the target electronic device.
基于目标电子设备和其余电子设备结合的系统System based on combination of target electronic device and remaining electronic devices
图17是根据本发明实施例的基于目标电子设备和其余电子设备的系统的图像处理方法的流程图,如图17所示,该方法应用于包括具备驱动装置的多台电子设备的系统中,驱动装置设置为为多台电子设备提供驱动力以使得多台电子设备能够根据目标物体的移动情况移动,其中,多台电子设备还具有图像采集单元,多台电子设备包括:目标电子设备和除目标电子之外的其余电子设备,目标电子设备为多台电子设备中的任意一台电子设备,多台目标电子设备与目标物体之间的相对位置保持不变,方法包括:17 is a flowchart of an image processing method of a system based on a target electronic device and remaining electronic devices, as shown in FIG. 17, which is applied to a system including a plurality of electronic devices having a driving device, according to an embodiment of the present invention, The driving device is configured to provide a driving force for the plurality of electronic devices to enable the plurality of electronic devices to move according to the movement condition of the target object, wherein the plurality of electronic devices further have an image capturing unit, and the plurality of electronic devices include: the target electronic device and the The remaining electronic devices other than the target electronic device, the target electronic device is any one of the plurality of electronic devices, and the relative positions between the plurality of target electronic devices and the target object remain unchanged, and the method includes:
步骤S1702,目标电子设备以目标电子设备相对目标物体的角度拍摄目标物体,得到第一图像;Step S1702: The target electronic device photographs the target object at an angle of the target electronic device with respect to the target object to obtain a first image.
步骤S1704,其余电子设备以其余电子设备相对于目标物体的角度拍摄目标物体得到第一图像,并将其余电子设备拍摄目标物体得到第一图像发送给目标电子设备;Step S1704, the remaining electronic devices capture the target object with the angle of the remaining electronic device relative to the target object to obtain the first image, and send the first electronic image of the remaining electronic device to obtain the first image to the target electronic device;
步骤S1706,目标电子设备将多台电子设备从不同角度拍摄目标物体得到的多张第一图像进行合成,得到目标物体的立体影像。Step S1706: The target electronic device combines the plurality of first images obtained by capturing the target objects from different angles by the plurality of electronic devices to obtain a stereoscopic image of the target object.
可选地,在目标电子设备将多台电子设备从不同角度拍摄目标物体得到的多张第一图像进行合成,得到目标物体的立体影像之前,还包括:目标电子设备记录以目标电子设备相对目标物体的角度拍摄目标物体的拍摄时间;其余电子设备记录以其余电子设备相对目标物体的角度拍摄目标物体的拍摄时间;目标电子设备将多台电子设备从不同角度拍摄目标物体得到的多张第一图像进行合成,得到目标物体的立体影像包括:目标电子设备将多台电子设备拍摄时间相同的多张第一图像进行合成,得到目标物体的立体影像。Optionally, before the target electronic device combines the plurality of first images obtained by capturing the target object from different angles to obtain the stereoscopic image of the target object, the method further includes: the target electronic device records the target electronic device relative to the target The angle of the object captures the shooting time of the target object; the remaining electronic devices record the shooting time of the target object with the angle of the remaining electronic device relative to the target object; the target electronic device takes multiple electronic devices to capture the target object from different angles. The image is synthesized, and the stereoscopic image of the target object is obtained: the target electronic device combines the plurality of first images with the same shooting time of the plurality of electronic devices to obtain a stereoscopic image of the target object.
可选地,目标电子设备和其余电子设备分别去除各自第一图像中的背景部分,得到背景去除后的第一图像,或者,目标电子设备去除多台电子设备拍摄的第一图像中的背景部分,得到背景去除后的第一图像;目标电子设备将多台电子设备拍摄时间相同的多张第一图像进行合成,得到目标物体的立体影像包括:目标电子设备将拍摄时间相同的多张背景去除后的第一图像进行合成,得到立体影像。Optionally, the target electronic device and the remaining electronic devices respectively remove the background portion in the respective first images to obtain the first image after the background removal, or the target electronic device removes the background portion in the first image captured by the plurality of electronic devices. Obtaining a first image after the background is removed; the target electronic device synthesizes the plurality of first images with the same shooting time of the plurality of electronic devices, and obtaining the stereoscopic image of the target object comprises: removing, by the target electronic device, the plurality of backgrounds with the same shooting time The subsequent first image is synthesized to obtain a stereoscopic image.
可选地,在目标电子设备以目标电子设备相对目标物体的角度拍摄目标物体,得到第一图像,和其余电子设备以其余电子设备相对于目标物体的角度拍摄目标物体得到第一图像之前,还包括:目标电子设备根据目标物体的移动情况生成第一运动轨迹,其中,目标电子设备按照第一运动轨迹进行运动;目标电子设备计算多台电子设备中除目标电子设备以外的其余每台电子设备相对于目标电子设备的相对位置;目标电子 设备将相对位置发送给多台电子设备中除目标电子设备以外的其余电子设备;多台电子设备中除目标电子设备以外的每台电子设备根据第一运动轨迹和自身相对于目标电子设备的相对位置生成运动轨迹,并按照生成的运动轨迹进行运动。Optionally, the target electronic device photographs the target object at an angle of the target electronic device relative to the target object to obtain a first image, and the remaining electronic device photographs the target object at an angle relative to the target object with respect to the target object to obtain the first image, and further The target electronic device generates a first motion trajectory according to the movement condition of the target object, wherein the target electronic device performs motion according to the first motion trajectory; and the target electronic device calculates each of the plurality of electronic devices except the target electronic device. Relative to the target electronic device; the target electronic device transmits the relative position to the remaining electronic devices of the plurality of electronic devices except the target electronic device; each of the plurality of electronic devices except the target electronic device is according to the first The motion trajectory and its relative position relative to the target electronic device generate motion trajectories and move according to the generated motion trajectory.
可选地,在目标电子设备以目标电子设备相对目标物体的角度拍摄目标物体,得到第一图像,和其余电子设备以其余电子设备相对于目标物体的角度拍摄目标物体得到第一图像之前,还包括:目标电子设备和/或其余电子设备获取标准时间;目标电子设备和/或其余电子设备根据标准时间校准多台电子设备中每台电子设备的时间。Optionally, the target electronic device photographs the target object at an angle of the target electronic device relative to the target object to obtain a first image, and the remaining electronic device photographs the target object at an angle relative to the target object with respect to the target object to obtain the first image, and further The method includes: the target electronic device and/or the remaining electronic device acquires a standard time; and the target electronic device and/or the remaining electronic device calibrate the time of each of the plurality of electronic devices according to the standard time.
图18是根据本发明实施例的图像处理系统的结构示意图,如图18所示,该图像处理系统180,包括具备驱动装置的多台电子设备,驱动装置设置为为多台电子设备提供驱动力以使得多台电子设备能够根据目标物体的移动情况移动,其中,多台电子设备还具有图像采集单元,多台电子设备包括:目标电子设备182和除目标电子之外的其余电子设备184,目标电子设备为多台电子设备中的任意一台电子设备,多台目标电子设备与目标物体之间的相对位置保持不变,其中,目标电子设备,设置为以目标电子设备相对目标物体的角度拍摄目标物体,得到第一图像;其余电子设备,设置为以其余电子设备相对于目标物体的角度拍摄目标物体得到第一图像,并将其余电子设备拍摄目标物体得到第一图像发送给目标电子设备;目标电子设备,还设置为将多台电子设备从不同角度拍摄目标物体得到的多张第一图像进行合成,得到目标物体的立体影像。18 is a schematic structural diagram of an image processing system according to an embodiment of the present invention. As shown in FIG. 18, the image processing system 180 includes a plurality of electronic devices including a driving device, and the driving device is configured to provide driving power for a plurality of electronic devices. In order to enable a plurality of electronic devices to move according to the movement of the target object, wherein the plurality of electronic devices further have an image acquisition unit, the plurality of electronic devices including: the target electronic device 182 and the remaining electronic devices 184 other than the target electronic, the target The electronic device is any one of the plurality of electronic devices, and the relative position between the plurality of target electronic devices and the target object remains unchanged, wherein the target electronic device is set to shoot at an angle of the target electronic device relative to the target object. The target object obtains the first image; the remaining electronic device is configured to take the first image by taking the target object at an angle of the remaining electronic device relative to the target object, and send the first electronic image to the target electronic device by the remaining electronic device; Target electronic device, also set to never use multiple electronic devices The plurality of first images obtained by shooting the target object at the same angle are combined to obtain a stereoscopic image of the target object.
可选地,目标电子设备,还设置为在目标电子设备将多台电子设备从不同角度拍摄目标物体得到的多张第一图像进行合成,得到目标物体的立体影像之前,记录以目标电子设备相对目标物体的角度拍摄目标物体的拍摄时间;其余电子设备记录以其余电子设备相对目标物体的角度拍摄目标物体的拍摄时间;目标电子设备,还设置为将多台电子设备从不同角度拍摄目标物体得到的多张第一图像进行合成,得到目标物体的立体影像包括:目标电子设备将多台电子设备拍摄时间相同的多张第一图像进行合成,得到目标物体的立体影像。Optionally, the target electronic device is further configured to combine the plurality of first images obtained by the target electronic device to capture the target object from different angles to obtain a stereoscopic image of the target object, and record the target electronic device relative to the target electronic device. The angle of the target object captures the shooting time of the target object; the remaining electronic devices record the shooting time of the target object with the angle of the remaining electronic device relative to the target object; the target electronic device is also set to capture the target object from different angles of the electronic device. The plurality of first images are combined to obtain a stereoscopic image of the target object, and the target electronic device combines the plurality of first images of the plurality of electronic devices with the same shooting time to obtain a stereoscopic image of the target object.
可选地,目标电子设备和其余电子设备,还设置为分别去除各自第一图像中的背景部分,得到背景去除后的第一图像,或者,目标电子设备,还设置为去除多台电子设备拍摄的第一图像中的背景部分,得到背景去除后的第一图像;目标电子设备,还设置为将多台电子设备拍摄时间相同的多张第一图像进行合成,得到目标物体的立体影像包括:目标电子设备将拍摄时间相同的多张背景去除后的第一图像进行合成,得到立体影像。Optionally, the target electronic device and the remaining electronic devices are further configured to respectively remove the background portion in the respective first images to obtain the first image after the background removal, or the target electronic device is further configured to remove multiple electronic devices. The background image in the first image is obtained as a first image after the background is removed; the target electronic device is further configured to combine the plurality of first images with the same shooting time of the plurality of electronic devices, and obtaining the stereoscopic image of the target object includes: The target electronic device combines the first images after the plurality of backgrounds with the same shooting time to obtain a stereoscopic image.
可选地,目标电子设备,还设置为在目标电子设备以目标电子设备相对目标物体 的角度拍摄目标物体,得到第一图像,和其余电子设备以其余电子设备相对于目标物体的角度拍摄目标物体得到第一图像之前,根据目标物体的移动情况生成第一运动轨迹,其中,目标电子设备按照第一运动轨迹进行运动;目标电子设备,还设置为计算多台电子设备中除目标电子设备以外的其余每台电子设备相对于目标电子设备的相对位置;目标电子设备,还设置为将相对位置发送给多台电子设备中除目标电子设备以外的其余电子设备;多台电子设备中除目标电子设备以外的每台电子设备,还设置为根据第一运动轨迹和自身相对于目标电子设备的相对位置生成运动轨迹,并按照生成的运动轨迹进行运动。Optionally, the target electronic device is further configured to: at the target electronic device, photograph the target object at an angle of the target electronic device relative to the target object to obtain a first image, and the remaining electronic device photographs the target object at an angle of the remaining electronic device relative to the target object. Before the first image is obtained, the first motion trajectory is generated according to the movement condition of the target object, wherein the target electronic device performs motion according to the first motion trajectory; and the target electronic device is further configured to calculate a plurality of electronic devices other than the target electronic device. The relative position of each of the remaining electronic devices relative to the target electronic device; the target electronic device is further configured to transmit the relative position to the remaining electronic devices other than the target electronic device among the plurality of electronic devices; and the target electronic device among the plurality of electronic devices Each of the electronic devices other than the electronic device is further configured to generate a motion trajectory according to the first motion trajectory and its relative position with respect to the target electronic device, and perform motion according to the generated motion trajectory.
可选地,目标电子设备和/或其余电子设备,还设置为在目标电子设备以目标电子设备相对目标物体的角度拍摄目标物体,得到第一图像,和其余电子设备以其余电子设备相对于目标物体的角度拍摄目标物体得到第一图像之前,获取标准时间;目标电子设备和/或其余电子设备,还设置为根据标准时间校准多台电子设备中每台电子设备的时间。Optionally, the target electronic device and/or the remaining electronic device are further configured to: at the target electronic device, capture the target object at an angle of the target electronic device relative to the target object, to obtain a first image, and the remaining electronic devices with respect to the remaining electronic device The angle of the object is taken before the first object is obtained to obtain the standard time; the target electronic device and/or the remaining electronic device are also set to calibrate the time of each of the plurality of electronic devices according to the standard time.
在本发明实施例中还提供了一种存储介质,该存储介质包括存储的程序,其中,在程序运行时控制存储介质所在设备执行上述任意一项的图像处理方法。In the embodiment of the present invention, a storage medium is further provided, where the storage medium includes a stored program, wherein the device in which the storage medium is located controls the image processing method of any one of the above items when the program is running.
在本发明实施例中还提供了一种处理器,该处理器用于运行程序,其中,程序运行时执行上述任意一项的图像处理方法。Also provided in the embodiment of the present invention is a processor for running a program, wherein the image processing method of any one of the above is executed when the program is running.
以机器人为例,说明本发明实施例提供的图像处理方法。Taking an example of a robot, an image processing method provided by an embodiment of the present invention is described.
多台机器人通过网络或其他方式建立连接,保证可以交换信息。机器人通过信息交换确认和调整彼此的方位。定位与调整方位包括但不限于使用视觉,超声,微波等技术。用户触发或其他任何方式让机器人组合开启全方位3D影像记录功能。机器人通过双目视觉识别被摄物体,并结合自身位置进行相互通信,确认被摄物体,同时确认被摄物体和机器人的相对位置。开始记录影像,每台机器人都从当前双目视觉识别出被摄物体,并将背景去除,保留记录时间等信息。当物体开始移动时,通过双目视觉感知物体移动,计算出被摄物体和机器人之间的位置变化。机器人通过自主移动尽可能保持与被摄物体之间的相对位置不变。多台机器人将拍摄的影像,通过记录时间进行校准,并合成出全方位3D影像(立体影像)。Multiple robots establish connections through the network or other means to ensure that information can be exchanged. The robot confirms and adjusts the orientation of each other through information exchange. Positioning and adjusting orientations include, but are not limited to, the use of vision, ultrasound, microwave, and the like. User triggering or any other means allows the robot combination to turn on full 3D image recording. The robot visually recognizes the subject through binocular vision and communicates with each other in conjunction with its own position to confirm the subject and confirm the relative position of the subject and the robot. At the beginning of recording images, each robot visually recognizes the subject from the current binocular, removes the background, and retains information such as recording time. When the object starts moving, the object movement is sensed by binocular vision, and the positional change between the object and the robot is calculated. The robot keeps the relative position with the subject as much as possible by autonomous movement. Multiple robots calibrate the captured images by recording time and synthesize a full range of 3D images (stereo images).
在本发明实施例中,多个机器人之间通过网络或其他方式相互连接,交换信息,在机器人之间相互传递信令,使其能够协同工作,通过合成同一时间的不同角度的3D影像生成全方位的影像,实现了多机器人协作全方位动态3D影像记录。In the embodiment of the present invention, a plurality of robots are connected to each other through a network or other means to exchange information, and signaling is transmitted between the robots so that they can work together to generate a full 3D image at different angles at the same time. The azimuth image realizes multi-robot collaborative omnidirectional dynamic 3D image recording.
根据本发明实施例,还提供了一种图像处理装置。该图像处理装置可以执行上述 图像处理方法,上述图像处理方法也可以通过该图像处理装置实施。According to an embodiment of the present invention, an image processing apparatus is also provided. The image processing apparatus can execute the image processing method described above, and the image processing method can be implemented by the image processing apparatus.
图19是根据本发明实施例的一种图像处理装置的优选示意图。该图像处理装置应设置为具备驱动装置的电子设备,驱动装置设置为为电子设备提供驱动力以使得电子设备能够移动,电子设备还具有图像采集单元。19 is a preferred schematic diagram of an image processing apparatus in accordance with an embodiment of the present invention. The image processing apparatus should be provided as an electronic device having a driving device configured to provide a driving force for the electronic device to enable the electronic device to move, and the electronic device further has an image capturing unit.
如图19所示,该装置包括:第四获取单元10、第五获取单元20、第二合成单元30。As shown in FIG. 19, the apparatus includes: a fourth acquisition unit 10, a fifth acquisition unit 20, and a second synthesis unit 30.
第四获取单元10,设置为获取电子设备检测目标物体得到的目标物体的移动情况,其中,多台电子设备根据目标物体的移动情况进行运动,以保持多台电子设备各自与目标物体之间的相对位置不变。The fourth acquiring unit 10 is configured to acquire a movement condition of the target object obtained by the electronic device detecting the target object, wherein the plurality of electronic devices perform motion according to the movement condition of the target object to maintain the relationship between each of the plurality of electronic devices and the target object. The relative position is unchanged.
第五获取单元20,设置为获取多台电子设备从不同角度拍摄目标物体得到的第一图像,得到多张第一图像。The fifth obtaining unit 20 is configured to acquire a first image obtained by capturing, by the plurality of electronic devices, the target object from different angles, to obtain a plurality of first images.
第二合成单元30,设置为将多张第一图像进行合成,得到目标物体的立体影像。The second synthesizing unit 30 is configured to combine the plurality of first images to obtain a stereoscopic image of the target object.
可选地,多台电子设备为N台电子设备,第五获取单元20包括N个识别子单元和N个拍摄子单元。N个识别子单元分别为第1识别子单元至第N识别子单元。N个拍摄子单元分别为第1拍摄子单元至第N拍摄子单元。第i识别子单元,设置在第i台电子设备上,设置为根据第i台电子设备的图像采集单元识别目标物体。第i拍摄子单元,设置在第i台电子设备上,设置为以第i角度拍摄目标物体,得到第一图像,其中,第i角度是第i台电子设备相对目标物体的角度,其中,i依次取1至N,第1角度至第N角度为N个互不相同的角度,N为大于1的整数。Optionally, the plurality of electronic devices are N electronic devices, and the fifth obtaining unit 20 includes N identification subunits and N shooting subunits. The N identification subunits are the first identification subunit to the Nth identification subunit, respectively. The N shooting subunits are the first to Nth shooting subunits, respectively. The i-th recognition sub-unit is disposed on the i-th electronic device and configured to recognize the target object according to the image acquisition unit of the i-th electronic device. The i-th shooting sub-unit is disposed on the i-th electronic device, and is configured to photograph the target object at the ith angle to obtain a first image, wherein the ith angle is an angle of the i-th electronic device relative to the target object, wherein, i Taking 1 to N in order, the first angle to the Nth angle are N different angles, and N is an integer greater than 1.
可选地,第二合成单元30包括:第三获取子单元、第二合成子单元。第三获取子单元,设置为获取每张第一图像的拍摄时间。第二合成子单元,设置为将拍摄时间相同的多张第一图像进行合成,得到立体影像。Optionally, the second synthesizing unit 30 includes: a third acquiring subunit and a second synthesizing subunit. The third acquisition subunit is configured to acquire a shooting time of each of the first images. The second synthesizing subunit is configured to synthesize a plurality of first images having the same shooting time to obtain a stereoscopic image.
可选地,第二合成子单元包括:第三去除模块、第二合成模块。第三去除模块,设置为去除第一图像中的背景部分,得到背景去除后的第一图像。第二合成模块,设置为将拍摄时间相同的多张背景去除后的第一图像进行合成,得到立体影像。Optionally, the second synthesis subunit includes: a third removal module and a second synthesis module. The third removing module is configured to remove the background portion in the first image to obtain a first image after the background is removed. The second synthesizing module is configured to synthesize the first images after the plurality of backgrounds with the same shooting time are combined to obtain a stereoscopic image.
可选地,第四获取单元包括:生成子单元、计算子单元、发送子单元、控制子单元。生成子单元,设置在多台电子设备中的目标电子设备上,设置为根据目标物体的移动情况生成第一运动轨迹,其中,目标电子设备按照第一运动轨迹进行运动。计算子单元,设置在目标电子设备上,设置为计算多台电子设备中除目标电子设备以外的其余每台电子设备相对于目标电子设备的相对位置。发送子单元,设置在目标电子设 备上,设置为将相对位置发送给多台电子设备中除目标电子设备以外的其余电子设备。控制子单元,设置在多台电子设备中除目标电子设备以外的每台电子设备上,设置为根据第一运动轨迹和多台电子设备中除目标电子设备以外的每台电子设备相对于目标电子设备的相对位置生成运动轨迹,并控制多台电子设备中除目标电子设备以外的每台电子设备按照生成的运动轨迹进行运动。Optionally, the fourth obtaining unit includes: a generating subunit, a calculating subunit, a sending subunit, and a control subunit. The generating subunit is disposed on the target electronic device in the plurality of electronic devices, and is configured to generate a first motion trajectory according to the movement condition of the target object, wherein the target electronic device performs motion according to the first motion trajectory. The calculating subunit is disposed on the target electronic device and configured to calculate a relative position of each of the plurality of electronic devices except the target electronic device with respect to the target electronic device. The transmitting subunit is set on the target electronic device and is set to transmit the relative position to the remaining electronic devices of the plurality of electronic devices except the target electronic device. a control subunit, configured on each of the plurality of electronic devices except the target electronic device, configured to be based on the first motion trajectory and each of the plurality of electronic devices except the target electronic device relative to the target electronic device The relative position of the device generates a motion trajectory, and controls each electronic device of the plurality of electronic devices except the target electronic device to move according to the generated motion trajectory.
可选地,装置还包括:第六获取单元、第三校准单元。第六获取单元,设置为在第四获取单元10获取电子设备检测目标物体得到的目标物体的移动情况之前,获取标准时间。第三校准单元,设置为根据标准时间校准多台电子设备中每台电子设备的时间。Optionally, the device further includes: a sixth obtaining unit and a third calibration unit. The sixth obtaining unit is configured to acquire the standard time before the fourth acquiring unit 10 acquires the movement condition of the target object obtained by the electronic device detecting the target object. The third calibration unit is configured to calibrate the time of each of the plurality of electronic devices according to the standard time.
在本发明的上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其他实施例的相关描述。In the above-mentioned embodiments of the present invention, the descriptions of the various embodiments are different, and the parts that are not detailed in a certain embodiment can be referred to the related descriptions of other embodiments.
在本发明所提供的几个实施例中,应该理解到,所揭露的技术内容,可通过其它的方式实现。其中,以上所描述的装置实施例仅仅是示意性的,例如所述单元的划分,可以为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,单元或模块的间接耦合或通信连接,可以是电性或其它的形式。In the several embodiments provided by the present invention, it should be understood that the disclosed technical contents may be implemented in other manners. The device embodiments described above are only schematic. For example, the division of the unit may be a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, unit or module, and may be electrical or otherwise.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可为个人计算机、服务器或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、移动硬盘、磁碟或者光盘 等各种可以存储程序代码的介质。The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk, and the like. .
以上所述仅是本发明的优选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明原理的前提下,还可以做出若干改进和润饰,这些改进和润饰也应视为本发明的保护范围。The above description is only a preferred embodiment of the present invention, and it should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present invention. It should be considered as the scope of protection of the present invention.

Claims (34)

  1. 一种图像处理方法,应用于具备驱动装置的目标电子设备,所述驱动装置设置为为所述目标电子设备提供驱动力以使得所述目标电子设备能够根据目标物体的移动情况移动,其中,所述目标电子设备还具有图像采集单元,所述目标电子设备为多台电子设备中的任意一台电子设备,所述目标电子设备与所述目标物体之间的相对位置保持不变,多台所述电子设备中除所述目标电子设备之外的其余电子设备各自与所述目标物体之间的相对位置也保持不变,所述方法包括:An image processing method is applied to a target electronic device having a driving device, the driving device being configured to provide a driving force for the target electronic device to enable the target electronic device to move according to a movement condition of the target object, wherein The target electronic device further has an image capturing unit, wherein the target electronic device is any one of the plurality of electronic devices, and the relative position between the target electronic device and the target object remains unchanged, and the plurality of devices The relative position of each of the remaining electronic devices other than the target electronic device in the electronic device and the target object remains unchanged, and the method includes:
    所述目标电子设备获取多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像;The target electronic device acquires a plurality of first images obtained by the plurality of the electronic devices capturing the target object from different angles;
    所述目标电子设备将多张所述第一图像进行合成,得到所述目标物体的立体影像。The target electronic device combines the plurality of the first images to obtain a stereoscopic image of the target object.
  2. 根据权利要求1所述的方法,其中,多台所述电子设备为N台所述电子设备,所述目标电子设备获取多台所述电子设备从不同角度拍摄所述目标物体得到的多张所述第一图像包括:The method according to claim 1, wherein a plurality of said electronic devices are N said electronic devices, and said target electronic device acquires a plurality of said plurality of said electronic devices that capture said target object from different angles The first image includes:
    所述目标电子设备根据自身的图像采集单元识别所述目标物体,所述目标电子设备以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体,得到第一图像;The target electronic device identifies the target object according to its own image acquisition unit, and the target electronic device captures the target object at an angle of the target electronic device relative to the target object to obtain a first image;
    所述目标电子设备根据所述多台所述电子设备自组网络通信的方式,获取所述其余电子设备从不同角度拍摄所述目标物体得到的N-1张第一图像,其中,第i台电子设备根据自身的图像采集单元识别所述目标物体,所述第i台电子设备以第i角度拍摄所述目标物体,得到所述第一图像,其中,所述第i角度是所述第i台电子设备相对所述目标物体的角度,其中,i依次取1至N-1,多台电子设备相对所述目标物体的N个角度为N个互不相同的角度,N为大于1的整数。The target electronic device acquires, according to the manner in which the plurality of electronic devices communicate with the group network, the N-1 first images obtained by the remaining electronic devices capturing the target object from different angles, wherein the i-th station The electronic device identifies the target object according to its own image acquisition unit, and the ith electronic device captures the target object at an ith angle to obtain the first image, wherein the ith angle is the ith The angle of the electronic device relative to the target object, wherein i takes 1 to N-1 in sequence, and the N angles of the plurality of electronic devices with respect to the target object are N different angles, and N is an integer greater than 1. .
  3. 根据权利要求1所述的方法,其中,所述目标电子设备将多张所述第一图像进行合成,得到所述目标物体的立体影像包括:The method of claim 1, wherein the target electronic device synthesizes the plurality of the first images, and obtaining a stereoscopic image of the target object comprises:
    所述目标电子设备获取每张所述第一图像的拍摄时间;Obtaining, by the target electronic device, a shooting time of each of the first images;
    所述目标电子设备将拍摄时间相同的多张所述第一图像进行合成,得到所述立体影像。The target electronic device synthesizes a plurality of the first images having the same shooting time to obtain the stereoscopic image.
  4. 根据权利要求3所述的方法,其中,所述目标电子设备将拍摄时间相同的多张所 述第一图像进行合成,得到所述立体影像包括:The method according to claim 3, wherein the target electronic device synthesizes a plurality of the first images having the same shooting time, and obtaining the stereoscopic image comprises:
    所述目标电子设备去除所述第一图像中的背景部分,得到背景去除后的第一图像;The target electronic device removes a background portion in the first image to obtain a first image after background removal;
    所述目标电子设备将拍摄时间相同的多张背景去除后的第一图像进行合成,得到所述立体影像。The target electronic device synthesizes a plurality of background-removed first images with the same shooting time to obtain the stereoscopic image.
  5. 根据权利要求1所述的方法,其中,在所述目标电子设备获取多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像之前,还包括:The method of claim 1, wherein before the target electronic device acquires the plurality of first images obtained by the plurality of electronic devices from the different angles, the method further comprises:
    所述目标电子设备根据所述目标物体的移动情况生成第一运动轨迹,其中,所述目标电子设备按照所述第一运动轨迹进行运动;The target electronic device generates a first motion trajectory according to the movement condition of the target object, wherein the target electronic device performs motion according to the first motion trajectory;
    所述目标电子设备计算多台所述电子设备中除所述目标电子设备以外的其余每台所述电子设备相对于所述目标电子设备的相对位置;The target electronic device calculates a relative position of each of the plurality of electronic devices other than the target electronic device relative to the target electronic device;
    所述目标电子设备将所述相对位置发送给多台所述电子设备中除所述目标电子设备以外的其余电子设备;其中,所述相对位置用于多台所述电子设备中除所述目标电子设备以外的每台电子设备结合所述第一运动轨迹生成运动轨迹,并按照生成的运动轨迹进行运动。Transmitting, by the target electronic device, the relative position to the remaining electronic devices of the plurality of electronic devices except the target electronic device; wherein the relative position is used by the plurality of the electronic devices except the target Each electronic device other than the electronic device generates a motion trajectory in conjunction with the first motion trajectory and performs motion according to the generated motion trajectory.
  6. 根据权利要求1所述的方法,其中,在所述目标电子设备获取多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像之前,所述方法还包括:The method of claim 1, wherein the method further comprises: before the target electronic device acquires a plurality of first images obtained by the plurality of electronic devices capturing the target object from different angles, the method further comprising:
    所述目标电子设备获取标准时间;The target electronic device acquires a standard time;
    所述目标电子设备根据所述标准时间校准多台所述电子设备中每台所述电子设备的时间。The target electronic device calibrates the time of each of the plurality of the electronic devices according to the standard time.
  7. 一种图像处理装置,应用于具备驱动装置的目标电子设备,所述驱动装置设置为为所述目标电子设备提供驱动力以使得所述电子设备能够根据目标物体的移动情况移动,其中,所述电子设备还具有图像采集单元,所述目标电子设备为多台电子设备中的任意一台电子设备,所述目标电子设备与所述目标物体之间的相对位置保持不变,多台所述电子设备中除所述目标电子设备之外的其余电子设备各自与所述目标物体之间的相对位置也保持不变,所述装置包括:An image processing apparatus applied to a target electronic device having a driving device configured to provide a driving force to the target electronic device to enable the electronic device to move according to a movement condition of a target object, wherein the The electronic device further has an image acquisition unit, the target electronic device is any one of the plurality of electronic devices, the relative position between the target electronic device and the target object remains unchanged, and the plurality of the electronic devices The relative positions of the remaining electronic devices in the device except the target electronic device and the target object are also unchanged, and the device includes:
    第一获取单元,设置为获取多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像;a first acquiring unit, configured to acquire a plurality of first images obtained by the plurality of electronic devices capturing the target object from different angles;
    第一合成单元,设置为将多张所述第一图像进行合成,得到所述目标物体的 立体影像。The first synthesizing unit is configured to synthesize the plurality of the first images to obtain a stereoscopic image of the target object.
  8. 根据权利要求7所述的装置,其中,多台所述电子设备为N台所述电子设备,所述第一获取单元包括:The device according to claim 7, wherein the plurality of the electronic devices are the N electronic devices, and the first obtaining unit comprises:
    第一拍摄子单元,设置为根据自身的图像采集单元识别所述目标物体,所述目标电子设备以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体,得到第一图像;a first photographing subunit, configured to identify the target object according to an image acquisition unit of the same, the target electronic device photographing the target object with an angle of the target electronic device relative to the target object, to obtain a first image;
    第一获取子单元,设置为根据所述多台所述电子设备自组网络通信的方式,获取所述其余电子设备从不同角度拍摄所述目标物体得到的N-1张第一图像,其中,所述其余电子设备中的第i台电子设备包括:第i识别子单元,设置在第i台电子设备上,设置为根据所述第i台电子设备的图像采集单元识别所述目标物体;第i拍摄子单元,设置在所述第i台电子设备上,设置为以第i角度拍摄所述目标物体,得到所述第一图像,其中,所述第i角度是所述第i台电子设备相对所述目标物体的角度,其中,i依次取1至N-1,多台电子设备相对所述目标物体的N个角度为N个互不相同的角度,N为大于1的整数。a first acquisition subunit, configured to acquire, according to the manner in which the plurality of the electronic devices communicate with each other by the group network, the N-1 first images obtained by the remaining electronic devices capturing the target object from different angles, where The i-th electronic device of the remaining electronic device includes: an i-th identification sub-unit, disposed on the i-th electronic device, configured to identify the target object according to an image acquisition unit of the i-th electronic device; a photographing subunit, disposed on the ith electronic device, configured to photograph the target object at an ith angle to obtain the first image, wherein the ith angle is the ith electronic device The angle of the target object, wherein i takes 1 to N-1 in sequence, and the N angles of the plurality of electronic devices with respect to the target object are N different angles, and N is an integer greater than 1.
  9. 根据权利要求7所述的装置,其中,所述第一合成单元包括:The apparatus of claim 7, wherein the first synthesizing unit comprises:
    第二获取子单元,设置为获取每张所述第一图像的拍摄时间;a second acquiring subunit, configured to acquire a shooting time of each of the first images;
    第一合成子单元,设置为将拍摄时间相同的多张所述第一图像进行合成,得到所述立体影像。The first synthesizing subunit is configured to synthesize a plurality of the first images having the same shooting time to obtain the stereoscopic image.
  10. 根据权利要求9所述的装置,其中,所述第一合成子单元包括:The apparatus of claim 9, wherein the first composition subunit comprises:
    第一去除模块,设置为去除所述第一图像中的背景部分,得到背景去除后的第一图像;a first removing module, configured to remove a background portion in the first image to obtain a first image after background removal;
    第一合成模块,设置为将拍摄时间相同的多张背景去除后的第一图像进行合成,得到所述立体影像。The first synthesizing module is configured to synthesize the first images after the plurality of backgrounds with the same shooting time are combined to obtain the stereoscopic images.
  11. 根据权利要求7所述的装置,其中,所述装置还包括:The apparatus of claim 7 wherein said apparatus further comprises:
    生成单元,设置在多台所述电子设备中的所述目标电子设备上,设置为根据所述目标物体的移动情况生成第一运动轨迹,其中,所述目标电子设备按照所述第一运动轨迹进行运动;a generating unit, configured to be disposed on the target electronic device of the plurality of electronic devices, configured to generate a first motion trajectory according to a movement condition of the target object, wherein the target electronic device follows the first motion trajectory Exercise
    计算单元,设置在所述目标电子设备上,设置为计算多台所述电子设备中除所述目标电子设备以外的其余每台所述电子设备相对于所述目标电子设备的相对 位置;a computing unit, configured to calculate, on the target electronic device, a relative position of each of the plurality of electronic devices other than the target electronic device relative to the target electronic device;
    第一发送单元,设置在所述目标电子设备上,设置为将所述相对位置发送给多台所述电子设备中除所述目标电子设备以外的其余电子设备,其中,在多台所述电子设备中除所述目标电子设备以外的每台电子设备上设置有控制单元,多台所述电子设备中除所述目标电子设备以外的每台电子设备相对于所述目标电子设备的相对位置用于所述控制单元结合所述第一运动轨迹生成运动轨迹,并控制多台所述电子设备中除所述目标电子设备以外的每台电子设备按照生成的运动轨迹进行运动。a first sending unit, disposed on the target electronic device, configured to send the relative position to the remaining electronic devices of the plurality of electronic devices except the target electronic device, wherein the plurality of the electronic devices Each of the devices except the target electronic device is provided with a control unit, and the relative positions of each of the plurality of electronic devices other than the target electronic device relative to the target electronic device are used. The control unit generates a motion trajectory in conjunction with the first motion trajectory, and controls each of the plurality of electronic devices except the target electronic device to perform motion according to the generated motion trajectory.
  12. 根据权利要求7所述的装置,其中,所述装置还包括:The apparatus of claim 7 wherein said apparatus further comprises:
    第二获取单元,设置为在所述第一获取单元获取电子设备检测目标物体得到的所述目标物体的移动情况之前,获取标准时间;a second acquiring unit, configured to acquire a standard time before the first acquiring unit acquires a movement condition of the target object obtained by the electronic device detecting the target object;
    第一校准单元,设置为根据所述标准时间校准多台所述电子设备中每台所述电子设备的时间。a first calibration unit configured to calibrate a time of each of the plurality of the electronic devices according to the standard time.
  13. 一种图像处理方法,应用于具备驱动装置的其余电子设备中,所述其余电子设备为多台电子设备中除目标电子设备之外的电子设备,所述驱动装置设置为为所述其余电子设备提供驱动力以使得所述其余电子设备能够根据目标物体的移动情况移动,其中,所述其余电子设备还具有图像采集单元,所述其余电子设备与所述目标物体之间的相对位置保持不变,所述目标电子设备与所述目标物体之间的相对位置也保持不变,所述方法包括:An image processing method is applied to the remaining electronic devices having a driving device, wherein the remaining electronic devices are electronic devices other than the target electronic device among the plurality of electronic devices, and the driving device is configured to be the remaining electronic devices Providing a driving force to enable the remaining electronic device to move according to a movement condition of the target object, wherein the remaining electronic device further has an image acquisition unit, and a relative position between the remaining electronic device and the target object remains unchanged The relative position between the target electronic device and the target object is also unchanged, and the method includes:
    所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像;The remaining electronic device captures the target object at an angle of the remaining electronic device relative to the target object to obtain a first image;
    所述其余电子设备将得到的所述第一图像发送给所述目标电子设备,以使所述目标电子设备至少根据所述第一图像合成所述目标物体的立体影像。And transmitting, by the remaining electronic device, the obtained first image to the target electronic device, so that the target electronic device synthesizes a stereoscopic image of the target object according to at least the first image.
  14. 根据权利要求13所述的方法,其中,所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像包括:The method according to claim 13, wherein the rest of the electronic device photographing the target object at an angle of the remaining electronic device relative to the target object to obtain a first image comprises:
    所述其余电子设备接收到第一运动轨迹,其中,所述第一运动轨迹为所述目标电子设备根据所述目标物体的移动情况生成的;Receiving, by the remaining electronic device, a first motion trajectory, wherein the first motion trajectory is generated by the target electronic device according to a movement condition of the target object;
    所述其余电子设备接收到所述目标电子设备发送的所述其余电子设备相对于所述目标电子设备的相对位置;Receiving, by the remaining electronic device, a relative position of the remaining electronic device sent by the target electronic device with respect to the target electronic device;
    所述其余电子设备根据所述第一运动轨迹和所述相对位置生成运动轨迹;The remaining electronic device generates a motion trajectory according to the first motion trajectory and the relative position;
    在所述其余电子设备按照生成的运动轨迹进行运动的情况下,以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像。In a case where the remaining electronic device moves according to the generated motion trajectory, the target object is captured at an angle of the remaining electronic device with respect to the target object to obtain a first image.
  15. 根据权利要求13所述的方法,其中,所述方法还包括:The method of claim 13 wherein the method further comprises:
    所述其余电子设备记录所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体的拍摄时间,其中,所述拍摄时间用于所述目标电子设备合成所述目标物体的立体影像。Recording, by the remaining electronic device, the photographing time of the remaining electronic device at the angle of the remaining electronic device relative to the target object, wherein the photographing time is used by the target electronic device to synthesize the photographing time A stereoscopic image of the target object.
  16. 根据权利要求13所述的方法,其中,在所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像之前,所述方法还包括:The method according to claim 13, wherein before the remaining electronic device photographs the target object at an angle of the remaining electronic device with respect to the target object to obtain a first image, the method further comprises:
    所述其余电子设备获取标准时间;The remaining electronic devices acquire standard time;
    所述其余电子设备根据所述标准时间校准所述其余电子设备的时间。The remaining electronic devices calibrate the time of the remaining electronic devices according to the standard time.
  17. 根据权利要求13所述的方法,其中,所述其余电子设备将得到的所述第一图像发送给所述目标电子设备包括:The method of claim 13, wherein the sending, by the remaining electronic device, the obtained first image to the target electronic device comprises:
    所述其余电子设备去除得到的所述第一图像中的背景部分,得到背景去除后的第一图像;The remaining electronic device removes the obtained background portion in the first image to obtain a first image after background removal;
    所述其余电子设备将背景去除后的第一图像发送给所述目标电子设备。The remaining electronic device transmits the first image after the background removal to the target electronic device.
  18. 一种图像处理方法,应用于包括具备驱动装置的多台电子设备的系统中,所述驱动装置设置为为多台所述电子设备提供驱动力以使得多台所述电子设备能够根据目标物体的移动情况移动,其中,多台所述电子设备还具有图像采集单元,多台所述电子设备包括:目标电子设备和除所述目标电子之外的其余电子设备,所述目标电子设备为多台所述电子设备中的任意一台电子设备,所述多台目标电子设备与所述目标物体之间的相对位置保持不变,所述方法包括:An image processing method for use in a system including a plurality of electronic devices having a driving device, the driving device being configured to provide a driving force for a plurality of the electronic devices to enable a plurality of the electronic devices to be according to a target object Moving the mobile device, wherein the plurality of the electronic devices further have an image collecting unit, the plurality of the electronic devices comprising: a target electronic device and remaining electronic devices other than the target electronic device, wherein the target electronic device is multiple The electronic device of any one of the electronic devices, the relative position between the plurality of target electronic devices and the target object remains unchanged, and the method includes:
    所述目标电子设备以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体,得到第一图像;The target electronic device photographs the target object at an angle of the target electronic device relative to the target object to obtain a first image;
    所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像,并将所述其余电子设备拍摄所述目标物体得到所述第一图像发送给所述目标电子设备;The remaining electronic device captures the target object at an angle of the remaining electronic device relative to the target object to obtain a first image, and the remaining electronic device captures the target object to obtain the first image to be sent to the Target electronic device;
    所述目标电子设备将多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像进行合成,得到所述目标物体的立体影像。The target electronic device combines a plurality of first images obtained by capturing the target object from different angles by the plurality of electronic devices to obtain a stereoscopic image of the target object.
  19. 根据权利要求18所述的方法,其中,The method of claim 18, wherein
    在所述目标电子设备将多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像进行合成,得到所述目标物体的立体影像之前,还包括:所述目标电子设备记录以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体的拍摄时间;所述其余电子设备记录以所述其余电子设备相对所述目标物体的角度拍摄所述目标物体的拍摄时间;Before the target electronic device combines the plurality of first images obtained by capturing the target object from different angles to obtain a stereoscopic image of the target object, the method further includes: recording, by the target electronic device Taking a shooting time of the target object at an angle of the target electronic device relative to the target object; the remaining electronic device recording a shooting time of capturing the target object at an angle of the remaining electronic device relative to the target object;
    所述目标电子设备将多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像进行合成,得到所述目标物体的立体影像包括:所述目标电子设备将多台所述电子设备拍摄时间相同的多张第一图像进行合成,得到所述目标物体的立体影像。The target electronic device combines a plurality of first images obtained by capturing the target object from different angles by the plurality of electronic devices, and obtaining a stereoscopic image of the target object includes: the target electronic device The plurality of first images of the same time of the electronic device are combined to obtain a stereoscopic image of the target object.
  20. 根据权利要求19所述的方法,其中,The method of claim 19, wherein
    所述目标电子设备和所述其余电子设备分别去除各自第一图像中的背景部分,得到背景去除后的第一图像,或者,所述目标电子设备去除多台所述电子设备拍摄的第一图像中的背景部分,得到背景去除后的第一图像;The target electronic device and the remaining electronic device respectively remove the background portion in the respective first images to obtain a first image after the background removal, or the target electronic device removes the first image captured by the plurality of electronic devices In the background portion of the background, the first image after the background removal is obtained;
    所述目标电子设备将多台所述电子设备拍摄时间相同的多张第一图像进行合成,得到所述目标物体的立体影像包括:所述目标电子设备将拍摄时间相同的多张背景去除后的第一图像进行合成,得到所述立体影像。The target electronic device combines a plurality of first images with the same shooting time of the electronic device, and obtaining a stereoscopic image of the target object includes: removing, by the target electronic device, multiple backgrounds with the same shooting time The first image is synthesized to obtain the stereo image.
  21. 根据权利要求18所述的方法,其中,在所述目标电子设备以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体,得到第一图像,和所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像之前,还包括:The method of claim 18, wherein the target electronic device photographs the target object at an angle of the target electronic device relative to the target object to obtain a first image, and the remaining electronic device Before the remaining electronic device photographs the target object with respect to the angle of the target object to obtain the first image, the method further includes:
    所述目标电子设备根据所述目标物体的移动情况生成第一运动轨迹,其中,所述目标电子设备按照所述第一运动轨迹进行运动;The target electronic device generates a first motion trajectory according to the movement condition of the target object, wherein the target electronic device performs motion according to the first motion trajectory;
    所述目标电子设备计算多台所述电子设备中除所述目标电子设备以外的其余每台所述电子设备相对于所述目标电子设备的相对位置;The target electronic device calculates a relative position of each of the plurality of electronic devices other than the target electronic device relative to the target electronic device;
    所述目标电子设备将所述相对位置发送给多台所述电子设备中除所述目标电子设备以外的其余电子设备;Transmitting, by the target electronic device, the relative position to the remaining electronic devices of the plurality of electronic devices except the target electronic device;
    多台所述电子设备中除所述目标电子设备以外的每台电子设备根据所述第一运动轨迹和自身相对于所述目标电子设备的相对位置生成运动轨迹,并按照生成的运动轨迹进行运动。Each of the plurality of electronic devices except the target electronic device generates a motion trajectory according to the first motion trajectory and a relative position of the electronic device relative to the target electronic device, and performs motion according to the generated motion trajectory. .
  22. 根据权利要求18所述的方法,其中,在所述目标电子设备以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体,得到第一图像,和所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像之前,还包括:The method of claim 18, wherein the target electronic device photographs the target object at an angle of the target electronic device relative to the target object to obtain a first image, and the remaining electronic device Before the remaining electronic device photographs the target object with respect to the angle of the target object to obtain the first image, the method further includes:
    所述目标电子设备和/或所述其余电子设备获取标准时间;The target electronic device and/or the remaining electronic device acquires a standard time;
    所述目标电子设备和/或所述其余电子设备根据所述标准时间校准多台所述电子设备中每台电子设备的时间。The target electronic device and/or the remaining electronic device calibrate the time of each of the plurality of the electronic devices according to the standard time.
  23. 一种图像处理装置,应用于具备驱动装置的其余电子设备中,所述其余电子设备为多台电子设备中除目标电子设备之外的电子设备,所述驱动装置设置为为所述其余电子设备提供驱动力以使得所述其余电子设备能够根据目标物体的移动情况移动,其中,所述其余电子设备还具有图像采集单元,所述其余电子设备与所述目标物体之间的相对位置保持不变,所述目标电子设备与所述目标物体之间的相对位置也保持不变,所述装置包括:An image processing device is applied to a remaining electronic device having a driving device, wherein the remaining electronic device is an electronic device other than the target electronic device among the plurality of electronic devices, and the driving device is configured to be the remaining electronic device Providing a driving force to enable the remaining electronic device to move according to a movement condition of the target object, wherein the remaining electronic device further has an image acquisition unit, and a relative position between the remaining electronic device and the target object remains unchanged The relative position between the target electronic device and the target object also remains unchanged, and the device includes:
    拍摄单元,设置为以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像;a photographing unit configured to photograph the target object at an angle of the remaining electronic device relative to the target object to obtain a first image;
    第二发送单元,设置为将得到的所述第一图像发送给所述目标电子设备,以使所述目标电子设备至少根据所述第一图像合成所述目标物体的立体影像。The second sending unit is configured to send the obtained first image to the target electronic device, so that the target electronic device synthesizes a stereoscopic image of the target object according to at least the first image.
  24. 根据权利要求23所述的装置,其中,所述拍摄单元包括:The apparatus according to claim 23, wherein the photographing unit comprises:
    第一接收模块,设置为接收到第一运动轨迹,其中,所述第一运动轨迹为所述目标电子设备根据所述目标物体的移动情况生成的;a first receiving module, configured to receive a first motion trajectory, wherein the first motion trajectory is generated by the target electronic device according to a movement condition of the target object;
    第二接收模块,设置为接收到所述目标电子设备发送的所述其余电子设备相对于所述目标电子设备的相对位置;a second receiving module, configured to receive a relative position of the remaining electronic device sent by the target electronic device with respect to the target electronic device;
    生成模块,设置为根据所述第一运动轨迹和所述相对位置生成运动轨迹;Generating a module, configured to generate a motion trajectory according to the first motion trajectory and the relative position;
    拍摄模块,设置为在按照生成的运动轨迹进行运动的情况下,以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像。The photographing module is configured to photograph the target object at an angle of the remaining electronic device relative to the target object to obtain a first image in the case of moving according to the generated motion trajectory.
  25. 根据权利要求23所述的装置,其中,所述装置还包括:The device of claim 23, wherein the device further comprises:
    记录单元,设置为记录所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体的拍摄时间,其中,所述拍摄时间用于所述目标电子设备合成所述目标物体的立体影像。a recording unit configured to record a photographing time of the remaining electronic device to photograph the target object at an angle of the remaining electronic device with respect to the target object, wherein the photographing time is used by the target electronic device to synthesize the photographing time A stereoscopic image of the target object.
  26. 根据权利要求23所述的装置,其中,所述装置还包括:The device of claim 23, wherein the device further comprises:
    第三获取单元,设置为在所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像之前,获取标准时间;a third acquiring unit, configured to acquire a standard time before the remaining electronic device captures the target object at an angle of the remaining electronic device with respect to the target object to obtain a first image;
    第二校准单元,设置为根据所述标准时间校准所述其余电子设备的时间。A second calibration unit is arranged to calibrate the time of the remaining electronic devices according to the standard time.
  27. 根据权利要求23所述的装置,其中,所述第二发送单元包括:The apparatus of claim 23, wherein the second transmitting unit comprises:
    第二去除模块,设置为去除得到的所述第一图像中的背景部分,得到背景去除后的第一图像;a second removing module, configured to remove the obtained background portion in the first image to obtain a first image after background removal;
    发送模块,用于将背景去除后的第一图像发送给所述目标电子设备。And a sending module, configured to send the first image after the background removal to the target electronic device.
  28. 一种图像处理系统,包括具备驱动装置的多台电子设备,所述驱动装置设置为为多台所述电子设备提供驱动力以使得多台所述电子设备能够根据目标物体的移动情况移动,其中,多台所述电子设备还具有图像采集单元,多台所述电子设备包括:目标电子设备和除所述目标电子之外的其余电子设备,所述目标电子设备为多台所述电子设备中的任意一台电子设备,所述多台目标电子设备与所述目标物体之间的相对位置保持不变,其中,An image processing system comprising a plurality of electronic devices having a driving device, the driving device being arranged to provide a driving force for a plurality of the electronic devices to enable a plurality of the electronic devices to move according to a movement condition of a target object, wherein The plurality of electronic devices further include an image acquisition unit, and the plurality of the electronic devices include: a target electronic device and remaining electronic devices other than the target electronic device, wherein the target electronic device is among the plurality of the electronic devices Any one of the electronic devices, the relative position between the plurality of target electronic devices and the target object remains unchanged, wherein
    所述目标电子设备,设置为以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体,得到第一图像;The target electronic device is configured to capture the target object at an angle of the target electronic device relative to the target object to obtain a first image;
    所述其余电子设备,设置为以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像,并将所述其余电子设备拍摄所述目标物体得到所述第一图像发送给所述目标电子设备;The remaining electronic device is configured to capture the target object at an angle of the remaining electronic device relative to the target object to obtain a first image, and capture the target object by the remaining electronic device to obtain the first image Sent to the target electronic device;
    所述目标电子设备,还设置为将多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像进行合成,得到所述目标物体的立体影像。The target electronic device is further configured to combine a plurality of first images obtained by capturing the target object from different angles by the plurality of electronic devices to obtain a stereoscopic image of the target object.
  29. 根据权利要求28所述的系统,其中,The system of claim 28, wherein
    所述目标电子设备,还设置为在所述目标电子设备将多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像进行合成,得到所述目标物体的立体影像之前,记录以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体的拍摄时间;所述其余电子设备记录以所述其余电子设备相对所述目标物体的角度拍摄所述目标物体的拍摄时间;The target electronic device is further configured to: after the target electronic device combines the plurality of first images obtained by capturing the target object from different angles by the plurality of electronic devices, to obtain a stereoscopic image of the target object, Recording a shooting time of the target object at an angle of the target electronic device relative to the target object; the remaining electronic device recording a shooting time of the target object at an angle of the remaining electronic device relative to the target object ;
    所述目标电子设备,还设置为将多台所述电子设备从不同角度拍摄所述目标物体得到的多张第一图像进行合成,得到所述目标物体的立体影像包括:所述目 标电子设备将多台所述电子设备拍摄时间相同的多张第一图像进行合成,得到所述目标物体的立体影像。The target electronic device is further configured to combine a plurality of first images obtained by capturing the target object from different angles by the plurality of electronic devices, and obtaining a stereoscopic image of the target object includes: the target electronic device A plurality of the first images of the same time are captured by the plurality of electronic devices to be combined to obtain a stereoscopic image of the target object.
  30. 根据权利要求29所述的系统,其中,The system of claim 29, wherein
    所述目标电子设备和所述其余电子设备,还设置为分别去除各自第一图像中的背景部分,得到背景去除后的第一图像,或者,所述目标电子设备,还设置为去除多台所述电子设备拍摄的第一图像中的背景部分,得到背景去除后的第一图像;The target electronic device and the remaining electronic device are further configured to respectively remove the background portion in the respective first images to obtain a first image after the background removal, or the target electronic device is further configured to remove multiple devices. Depicting a background portion in the first image captured by the electronic device, obtaining a first image after the background is removed;
    所述目标电子设备,还设置为将多台所述电子设备拍摄时间相同的多张第一图像进行合成,得到所述目标物体的立体影像包括:所述目标电子设备将拍摄时间相同的多张背景去除后的第一图像进行合成,得到所述立体影像。The target electronic device is further configured to combine a plurality of first images with the same shooting time of the electronic device, and obtaining a stereoscopic image of the target object includes: the target electronic device adopts multiple times of the same shooting time The first image after the background removal is combined to obtain the stereoscopic image.
  31. 根据权利要求28所述的系统,其中,The system of claim 28, wherein
    所述目标电子设备,还设置为在所述目标电子设备以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体,得到第一图像,和所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像之前,根据所述目标物体的移动情况生成第一运动轨迹,其中,所述目标电子设备按照所述第一运动轨迹进行运动;The target electronic device is further configured to: at the target electronic device, photograph the target object at an angle of the target electronic device relative to the target object, to obtain a first image, and the remaining electronic device to use the remaining electronic device Before the device captures the target object at an angle relative to the target object, the first motion trajectory is generated according to the movement condition of the target object, wherein the target electronic device performs motion according to the first motion trajectory. ;
    所述目标电子设备,还设置为计算多台所述电子设备中除所述目标电子设备以外的其余每台所述电子设备相对于所述目标电子设备的相对位置;The target electronic device is further configured to calculate a relative position of each of the plurality of electronic devices other than the target electronic device relative to the target electronic device;
    所述目标电子设备,还设置为将所述相对位置发送给多台所述电子设备中除所述目标电子设备以外的其余电子设备;The target electronic device is further configured to send the relative position to the remaining electronic devices of the plurality of electronic devices except the target electronic device;
    多台所述电子设备中除所述目标电子设备以外的每台电子设备,还设置为根据所述第一运动轨迹和自身相对于所述目标电子设备的相对位置生成运动轨迹,并按照生成的运动轨迹进行运动。Each of the plurality of electronic devices except the target electronic device is further configured to generate a motion trajectory according to the first motion trajectory and a relative position of the electronic device relative to the target electronic device, and generate the motion trajectory according to the generated The motion track moves.
  32. 根据权利要求28所述的系统,其中,The system of claim 28, wherein
    所述目标电子设备和/或所述其余电子设备,还设置为在所述目标电子设备以所述目标电子设备相对所述目标物体的角度拍摄所述目标物体,得到第一图像,和所述其余电子设备以所述其余电子设备相对于所述目标物体的角度拍摄所述目标物体得到第一图像之前,获取标准时间;The target electronic device and/or the remaining electronic device are further configured to: at the target electronic device, photograph the target object at an angle of the target electronic device relative to the target object, to obtain a first image, and to The remaining electronic device acquires the standard time before the first electronic image is captured by the remaining electronic device with respect to the target object to obtain the first image;
    所述目标电子设备和/或所述其余电子设备,还设置为根据所述标准时间校准 多台所述电子设备中每台电子设备的时间。The target electronic device and/or the remaining electronic device are further configured to calibrate the time of each of the plurality of the electronic devices in accordance with the standard time.
  33. 一种存储介质,所述存储介质包括存储的程序,其中,在所述程序运行时控制所述存储介质所在设备执行权利要求1至6,13至22中任意一项所述的图像处理方法。A storage medium, the storage medium comprising a stored program, wherein the device in which the storage medium is located is controlled to perform the image processing method according to any one of claims 1 to 6, 13 to 22.
  34. 一种处理器,所述处理器用于运行程序,其中,所述程序运行时执行权利要求1至6,13至22中任意一项所述的图像处理方法。A processor for executing a program, wherein the program is executed to execute the image processing method according to any one of claims 1 to 6, 13 to 22.
PCT/CN2017/117151 2016-12-19 2017-12-19 Image processing method and device WO2018113657A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201611178830.9A CN108616702B (en) 2016-12-19 2016-12-19 Image processing method and device
CN201611178830.9 2016-12-19

Publications (1)

Publication Number Publication Date
WO2018113657A1 true WO2018113657A1 (en) 2018-06-28

Family

ID=62624532

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/117151 WO2018113657A1 (en) 2016-12-19 2017-12-19 Image processing method and device

Country Status (2)

Country Link
CN (1) CN108616702B (en)
WO (1) WO2018113657A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022127609A1 (en) * 2020-12-15 2022-06-23 华为技术有限公司 Image processing method and electronic device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1647114A (en) * 2002-02-27 2005-07-27 杰奥·莱有限公司 Method and system for displaying stereoscopic image
CN102289145A (en) * 2011-06-30 2011-12-21 浙江工业大学 Intelligent three-dimensional (3D) camera equipment based on 3D panoramic vision
CN102665087A (en) * 2012-04-24 2012-09-12 浙江工业大学 Automatic shooting parameter adjusting system of three dimensional (3D) camera device
CN102903090A (en) * 2012-01-20 2013-01-30 李文松 Method, device and system for synthesizing panoramic stereograms, and browsing device for panoramic stereograms
CN106162150A (en) * 2016-09-30 2016-11-23 维沃移动通信有限公司 A kind of photographic method and mobile terminal

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100445799B1 (en) * 2001-10-30 2004-08-25 거래주식회사 Method and apparatus for image display
CN100551048C (en) * 2006-12-15 2009-10-14 上海元朔信息科技有限公司 Multiple-camera supervisory control system and tracking thereof based on the three-dimensional video-frequency dynamic tracking
CN104751164A (en) * 2013-12-30 2015-07-01 鸿富锦精密工业(武汉)有限公司 Method and system for capturing movement trajectory of object
CN105245846A (en) * 2015-10-12 2016-01-13 西安斯凯智能科技有限公司 Multi-unmanned aerial vehicle cooperative tracking type shooting system and shooting method
CN105892668B (en) * 2016-04-01 2019-04-02 纳恩博(北京)科技有限公司 Apparatus control method and device
CN105915784A (en) * 2016-04-01 2016-08-31 纳恩博(北京)科技有限公司 Information processing method and information processing device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1647114A (en) * 2002-02-27 2005-07-27 杰奥·莱有限公司 Method and system for displaying stereoscopic image
CN102289145A (en) * 2011-06-30 2011-12-21 浙江工业大学 Intelligent three-dimensional (3D) camera equipment based on 3D panoramic vision
CN102903090A (en) * 2012-01-20 2013-01-30 李文松 Method, device and system for synthesizing panoramic stereograms, and browsing device for panoramic stereograms
CN102665087A (en) * 2012-04-24 2012-09-12 浙江工业大学 Automatic shooting parameter adjusting system of three dimensional (3D) camera device
CN106162150A (en) * 2016-09-30 2016-11-23 维沃移动通信有限公司 A kind of photographic method and mobile terminal

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022127609A1 (en) * 2020-12-15 2022-06-23 华为技术有限公司 Image processing method and electronic device

Also Published As

Publication number Publication date
CN108616702A (en) 2018-10-02
CN108616702B (en) 2021-02-12

Similar Documents

Publication Publication Date Title
JP4160572B2 (en) Image processing apparatus and image processing method
CN114527872B (en) Virtual reality interaction system, method and computer storage medium
KR102105189B1 (en) Apparatus and Method for Selecting Multi-Camera Dynamically to Track Interested Object
CN107471218B (en) Binocular vision-based hand-eye coordination method for double-arm robot
CN110849367A (en) Indoor positioning and navigation method based on visual SLAM fused with UWB
WO2017057054A1 (en) Information processing device, information processing method and program
WO2017166725A1 (en) Photographing control method, device, and system
WO2017087398A1 (en) Facilitating robot positioning
CN110728739B (en) Virtual human control and interaction method based on video stream
JP3732335B2 (en) Image input apparatus and image input method
CN103686131A (en) Monitoring apparatus and system using 3d information of images and monitoring method using the same
KR20160020065A (en) Tracking system and tracking method using the tracking system
JP2021513175A (en) Data processing methods and devices, electronic devices and storage media
KR102084252B1 (en) System and method for simultaneous reconsttuction of initial 3d trajectory and velocity using single camera images
JP2007319938A (en) Robot device and method of obtaining three-dimensional shape of object
KR20160077684A (en) Apparatus and method for tracking object
CN110991306B (en) Self-adaptive wide-field high-resolution intelligent sensing method and system
CN110751685A (en) Depth information determination method, determination device, electronic device and vehicle
WO2018113657A1 (en) Image processing method and device
JP2018038087A5 (en)
Nguyen et al. Real-time obstacle detection for an autonomous wheelchair using stereoscopic cameras
Checka et al. Person tracking using audio-video sensor fusion
CN112291701B (en) Positioning verification method, positioning verification device, robot, external equipment and storage medium
WO2017166081A1 (en) Image registration method and device for terminal, and terminal
KR20140134505A (en) Method for tracking image object

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17884813

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17884813

Country of ref document: EP

Kind code of ref document: A1