WO2016095073A1 - 一种视频处理方法、装置及图像系统 - Google Patents
一种视频处理方法、装置及图像系统 Download PDFInfo
- Publication number
- WO2016095073A1 WO2016095073A1 PCT/CN2014/093787 CN2014093787W WO2016095073A1 WO 2016095073 A1 WO2016095073 A1 WO 2016095073A1 CN 2014093787 W CN2014093787 W CN 2014093787W WO 2016095073 A1 WO2016095073 A1 WO 2016095073A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- target image
- information
- image
- interference
- description information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/682—Vibration or motion blur correction
- H04N23/683—Vibration or motion blur correction performed by a processor, e.g. controlling the readout of an image memory
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64D—EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- B64D47/00—Equipment not otherwise provided for
- B64D47/08—Arrangements of cameras
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/21—Intermediate information storage
- H04N1/2104—Intermediate information storage for one or a few pictures
- H04N1/2112—Intermediate information storage for one or a few pictures using still video cameras
- H04N1/2129—Recording in, or reproducing from, a specific memory area or areas, or recording or reproducing at a specific moment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/681—Motion detection
- H04N23/6812—Motion detection based on additional sensors, e.g. acceleration sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
- H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
Definitions
- the present invention relates to the field of image processing technologies, and in particular, to a video processing method, apparatus, and image system.
- the user When sharing or collecting, the user generally wants to edit the captured image and video, and the user can perform additional editing including subtitles and music, and can further edit the video to remove the picture or video segment with poor picture quality, and retain Better-performing videos make up new videos for sharing or collection.
- Unsmooth maneuvering of the aircraft causes the aircraft to flicker and slow, and the image is prone to unnecessary image information of the aircraft corner frame or the propeller; the carrier for carrying the camera, such as the pan/tilt, cannot be controlled at a constant speed, resulting in a rapid transition of the camera picture.
- the quality is blurred; occasionally camera shake caused by external factors, resulting in poor picture quality.
- the editing of a picture collection or video captured by a user over a period of time is generally performed after capturing a picture collection or video.
- the user needs an image with good picture quality, for the picture collection, the user can view the pictures with poor picture quality and filter out the qualified pictures by using one picture, and for the video, the user needs to pass the professional video editing software. Watch and manually delete video clips with poor picture quality during the browsing of the video.
- the existing editing method consumes a lot of time for the user, and for video editing, video editing by professional video editing software is cumbersome and difficult to implement for most users.
- Embodiments of the present invention provide a video processing method, apparatus, and image system, which can implement a fast video editing operation based on associated interference information.
- an embodiment of the present invention provides an image processing method, including:
- the description information associated with the target image is acquired, where the description information includes interference information that affects image quality that occurs during the shooting of the target image;
- the target image includes: a video, or a set of pictures.
- the method before the obtaining the description information associated with the target image, the method further includes: recording description information of the target image during the shooting of the target image.
- the describing the description information of the target image during the shooting of the target image includes:
- the associated motion data of the shooting module is detected, and the description information is generated according to the detected associated motion data, and the shooting module is configured to capture the target image;
- the associated motion data includes interference data that affects the target image quality
- the interference data that affects the target image quality includes: acceleration data and/or angular acceleration data.
- the interference data that affects the target image quality includes: acceleration of the carrier carrying the imaging module in one or more directions, and/or angular velocity.
- the interference data that affects the target image quality includes: acceleration of the moving object that mounts the shooting module in one or more directions, and/or angular velocity.
- the generating the description information according to the detected associated motion data includes: generating interference information when the detected associated motion data is interference data that affects the target image quality; otherwise, generating smooth information, The interference information and the stationary information constitute description information.
- the generated description information is a motion indication line; in the generated motion indication line, the interference information is represented by a curved line segment, and the stationary information is represented by a straight line segment.
- the image segment associated with each piece of interference information of the description information in the target image is edited to obtain a processed target image, including:
- the target image is subjected to a clipping process, and the determined image segments are deleted to obtain a clipped image.
- the determining, by the image segment associated with each piece of the interference information in the description information, the image of the corresponding time segment in the target image is determined according to an occurrence period of each interference information in the description information. Fragment.
- the method further includes:
- the marker information is added to the image segment corresponding to the interest selection event in the target image.
- the method further includes:
- the image segment is acquired according to the tag information added for the target image
- a new image is obtained based on the acquired image segment editing.
- the image segment associated with each piece of interference information of the description information in the target image is edited to obtain a processed target image, including:
- the target image is subjected to a clipping process, and the determined image segments are deleted to obtain a clipped image.
- an embodiment of the present invention further provides an image processing apparatus, including:
- An acquiring module configured to acquire description information associated with the target image when detecting an edit trigger event for the target image, where the description information includes interference that affects image quality during shooting of the target image information;
- the editing module is configured to perform editing processing on the image segment associated with each interference information of the description information in the target image to obtain a processed target image.
- the method further includes: a recording module, configured to record description information of the target image during the shooting of the target image.
- a recording module configured to record description information of the target image during the shooting of the target image.
- the recording module is configured to detect associated motion data of the shooting module during shooting of the target image, and generate description information according to the detected associated motion data, where the shooting module is configured to capture the target And the associated motion data includes interference data that affects the target image quality, where the interference data that affects the target image quality includes: acceleration data and/or angular acceleration data.
- the interference data that affects the target image quality includes: acceleration of the carrier carrying the imaging module in one or more directions, and/or angular velocity.
- the interference data that affects the target image quality includes: acceleration of the moving object that mounts the shooting module in one or more directions, and/or angular velocity.
- the recording module is configured to: when the detected associated motion data is interference data that affects the target image quality, generate interference information; otherwise, generate smooth information, where the interference information and the smooth information are formed. Description.
- the description information generated by the recording module is a motion indication line; in the generated motion indication line, the interference information is represented by a curved line segment, and the stationary information is represented by a straight line segment.
- the editing module includes:
- a first determining unit configured to determine an image segment associated with each interference information in the description information
- the first deleting unit is configured to perform a clipping process on the target image, and delete the determined image segments to obtain a clipped image.
- the first determining unit is configured to determine, according to an occurrence period of each interference information in the description information, an image segment of the corresponding time segment in the target image.
- the recording module is further configured to: when receiving the interest selection event of the user during the shooting of the target image, adding marker information to the image segment corresponding to the interest selection event in the target image.
- the editing module is further configured to: if the target image is edited based on the tag information in the configured editing rule, acquire the video segment according to the tag information added for the target image; The video clip is edited to get a new image.
- the editing module includes:
- a second determining unit configured to determine an image segment associated with each interference information in the description information and not added with the tag information
- a second deleting unit configured to perform a clipping process on the target image, and delete the determined image segments to obtain a clipped image.
- an embodiment of the present invention further provides an image system, including an imaging device and a processor, where
- the imaging device is configured to capture a target image
- the processor is configured to acquire description information associated with the target image when detecting an edit trigger event for the target image, where the description information includes affecting image quality that occurs during shooting of the target image Interference information; performing editing processing on the video segment associated with each interference information of the description information in the target image to obtain a processed target image.
- the processor is further configured to record description information of the target image during the shooting of the target image.
- the processor is further configured to detect associated motion data of the imaging device during shooting of the target image, and generate description information according to the detected associated motion data; the associated motion data includes an influence The interference data of the target image quality, wherein the interference data affecting the target image quality comprises: acceleration data and/or angular acceleration data.
- the processor is configured to: when the detected associated motion data is interference data that affects the target image quality, generate interference information; otherwise, generate smooth information, where the interference information and the smooth information are configured. Description.
- the description information generated by the processor is a motion indication line; in the generated motion indication line, the interference information is represented by a curved line segment, and the stationary information is represented by a straight line segment.
- the processor is specifically configured to determine an image segment associated with each interference information in the description information, perform a clipping process on the target image, delete the determined image segments, and obtain a clip. After the image.
- the processor is configured to determine, according to an occurrence period of each interference information in the description information, an image segment of a corresponding time segment in the target image.
- the processor is further configured to: when the target image is captured, if the user selects an event of interest selection, the tag information is added to the image segment corresponding to the interest selection event in the target image.
- the processor is further configured to: if the target image is edited based on the tag information in the configured editing rule, acquire the video segment according to the tag information added for the target image; The video clip is edited to get a new image.
- the processor is further configured to determine an image segment that is associated with each interference information in the description information and is not added with tag information; perform editing processing on the target image, and delete the determined Each video clip gets the clipped image.
- the embodiment of the invention can automatically edit the image based on the motion information, and does not require complicated operation steps for the user, and is easy for the user to implement, satisfies the requirements of user automation and intelligence, and saves user time.
- FIG. 1 is a schematic flow chart of an image processing method according to an embodiment of the present invention.
- FIG. 2 is a schematic flowchart diagram of another video processing method according to an embodiment of the present invention.
- FIG. 3 is a schematic flow chart of still another video processing method according to an embodiment of the present invention.
- FIG. 4 is a schematic flow chart of a method for recording motion information of a carrier in an embodiment of the present invention
- FIG. 5 is a schematic flow chart of a method for recording motion information of a moving object according to an embodiment of the present invention
- FIG. 6 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present invention.
- FIG. 7 is a schematic structural diagram of another image processing apparatus according to an embodiment of the present invention.
- FIG. 8 is a schematic structural view of one of the editing modules of FIG. 7;
- FIG. 9 is a schematic structural diagram of an image system according to an embodiment of the present invention.
- the embodiment of the present invention can automatically edit the target image based on the motion information including the interference information associated with the target image, and can automatically and intelligently complete the image editing for the user, such as deleting the shooting operation caused by some users. A poor quality video clip or collection.
- FIG. 1 is a schematic flowchart of an image processing method according to an embodiment of the present invention.
- the method in the embodiment of the present invention may be implemented in an image processor. Specifically, the method includes:
- S101 When detecting an edit trigger event for the target image, acquiring description information associated with the target image, where the description information includes interference information that affects image quality that occurs during the shooting of the target image.
- the description information may specifically be motion related information of an imaging device (such as various cameras) that captures the target image during shooting, and the situation that causes the interference information to be generated includes but is not limited to:
- the carrier may be a pan/tilt device for mounting and fixing a camera, and the pan-tilt device may be a camera rotating in one or more directions to expand the monitoring range of the camera.
- the user can simply drag the target image into the editing interface, or trigger a event by clicking a video editing button to trigger the processing operation on the target image.
- the identifier of the target image may be identified first, and then the stored description information associated with the target image is searched based on the identifier.
- the description information includes at least the interference information, and may of course include other related information other than the interference information, such as smooth information for indicating uniform movement or stationary of the imaging device during shooting.
- the description information is information that is synchronously generated and stored while the target image is being captured. Specifically, the description information can be obtained by searching for data sensed by various sensors (such as acceleration sensors, gyroscopes, etc.) configured in the device.
- the description information may also be an angular velocity or acceleration (angular acceleration or translational acceleration) on the X, Y, and Z axes of the carrier carrying the imaging device, or may be a moving object on which the camera or the carrier is mounted.
- the angular velocity or acceleration (angular acceleration or translational acceleration) of an aircraft such as an aircraft).
- the target image includes: a video, or a set of pictures, wherein the set of pictures mainly refers to a set of pictures obtained in the case of continuous shooting of a plurality of pictures.
- the association between the description information and the target image may be an association based on the identifier, and the corresponding description information may be found based on the theme name of the target image, and the theme name refers to the name of a certain video or a certain time period.
- the description information may be a length of an indicator line for describing a motion condition, and when the photographing module, or the carrier, or the moving object moves at a constant speed and at rest, it appears as a straight line segment, and an angular velocity is generated. Or, after an acceleration in a certain direction, it appears as a curve segment.
- the description information acquired in the S101 may be any one or more of the corresponding description information in the shooting module, the carrier, and the moving object.
- the record description information may be triggered at the time when the user initiates the video capture is detected, or the user manually turns on the trigger, or is always turned on.
- the description information of the corresponding time period may be intercepted according to the time period of occurrence of a certain video or the time period of occurrence of the picture set according to the time association in the S101.
- each time information involved above may uniquely identify the corresponding description information and the shooting time of the target image.
- S102 Perform editing processing on the video segment associated with each interference information of the description information in the target image to obtain a processed target image.
- the editing process mainly includes the editing process of the target image, and deleting the image in the target image in the time period according to the time period corresponding to the interference information in the description information, that is, deleting the affected image in the target image is not good.
- the fragment of the image while retaining the image segment with better image quality, can then synthesize a new video or collection of images.
- the editing process may also be to copy other video segments other than the video segments associated with the interference information in the description information, and combine to obtain a new video or image collection, so that the original video can be retained.
- the embodiment of the invention can automatically edit the captured image based on the description information, and does not require complicated operation steps for the user, which is convenient for the user to operate, meets the requirements of user automation and intelligence, and saves user time.
- FIG. 2 is a schematic flowchart of another video processing method according to an embodiment of the present invention.
- the method in the embodiment of the present invention may be implemented in an image processor.
- the method in the embodiment of the present invention include:
- S201 Recording description information of the target image during shooting of the target image.
- the S201 may be configured to: detect the associated motion data of the shooting module during the shooting of the target image, and generate description information according to the detected associated motion data, where the shooting module is configured to capture the The target image; the associated motion data includes interference data that affects the target image quality, wherein the interference data that affects the target image quality includes: acceleration data and/or angular acceleration data.
- the shooting module may specifically be an imaging device.
- the description information may specifically be motion related information of the imaging device that captures the target image during shooting, and the situation that causes the interference information to be generated includes but is not limited to:
- Unsmooth manipulation of a moving object (such as an aircraft) that mounts the imaging device causes the moving object to move quickly and slowly; the handling of the carrier carrying the imaging device causes the carrier to rotate in different directions The situation; occasionally due to external factors, the imaging device shakes, such as strong winds.
- the target image includes: a video, or a collection of pictures.
- the description information includes at least interference information, and may of course include other related information other than the interference information, such as smooth information for indicating uniform movement or stationary of the imaging device during shooting.
- the description information is information that is synchronously generated and stored while the target image is being captured. Specifically, the description information can be obtained by searching for data sensed by various sensors (such as acceleration sensors, gyroscopes, etc.) configured in the device.
- the description information may also be obtained by collecting the angular velocity or acceleration of the carrier carrying the imaging device on the three axes of X, Y, and Z, or the angular velocity of a moving object (such as an aircraft) that mounts the camera or the carrier or Acceleration.
- a moving object such as an aircraft
- the description information may be a segment of a line for describing motion, which appears as a straight line segment when the camera module, or the carrier, or the moving object moves at a constant speed, and generates angular velocity, or After the acceleration in a certain direction, it appears as a curve.
- Information of any one or more of the imaging device, the carrier, and the corresponding description information in the moving object for capturing the target image may be saved as needed.
- S202 Determine an image segment associated with each interference information in the description information.
- the S202 may specifically include: determining, according to an occurrence period of each interference information in the description information, an image segment of a corresponding time period in the target image. Specifically, the video segment or the subset of pictures captured in the corresponding time period may be determined according to the carrier motion curve in the description information and/or the time period in which the motion curve of the moving object is located.
- S203 Perform a clipping process on the target image, delete the determined image segments, and obtain a clipped image.
- the determined image segments are deleted, leaving only video clips or subsets of pictures that are not affected by the accelerated motion and rotation. Specifically, in the process of rotating or rotating the moving object during the rotation of the carrier and/or the aircraft, the video clip or the subset of pictures captured by the imaging device is deleted.
- the embodiment of the invention can quickly perform a video editing operation for the user based on the description information, saves the user time, and satisfies the user's automatic and intelligent editing requirements for the captured image.
- FIG. 3 is a schematic flowchart of still another video processing method according to an embodiment of the present invention.
- the method in the embodiment of the present invention may be implemented in an image processor.
- the method in the embodiment of the present invention include:
- S301 Recording description information of the target image during shooting of the target image.
- the S301 may specifically include: detecting associated motion data of the shooting module during the shooting of the target image, generating description information according to the detected associated motion data, the shooting module is configured to capture the target image;
- the data includes interference data that affects the quality of the target image, wherein the interference data that affects the quality of the target image includes acceleration data and/or angular acceleration data.
- the photographing module may be an imaging device. Specifically, the recording process of the S301 can refer to the description in the previous embodiment.
- S302 In the process of capturing the target image, if the user selects the event of interest selection, the tag information is added to the image segment corresponding to the interest selection event in the target image.
- the user can perform a marking operation or a rating operation on the currently captured video to indicate the degree of likeness of the segment of the video segment.
- a marking operation or a rating operation on the currently captured video to indicate the degree of likeness of the segment of the video segment.
- the segment of the segment can be marked based on a mark button or a cut button.
- Specific users can add video tags by clicking, double clicking, and long pressing.
- the 10 second image captured before the time point and the 10 second image to be taken later are automatically marked according to the time point when the click is made, and the image segment added with the mark information is obtained. .
- the image segment to which the mark information is added is automatically determined in the S302 based on the time point at the time of the first click and the time point at the time of the second click.
- the image segment to which the mark information is added is automatically determined in the S302 based on the time point at the time of starting the press and the time point at the time of the release.
- the image segment associated with each piece of the interference information of the description information in the target image is edited, and the processed target image is obtained, which specifically includes the following S303 to S304.
- S303 Determine an image segment associated with each interference information in the description information and not added with the tag information.
- the determining the corresponding video segment based on the description information may include: determining, according to the occurrence period of each interference information in the description information, an image segment of the corresponding time segment in the target image. Specifically, the video segment or the subset of pictures captured in the corresponding time period may be determined according to the time period in which the carrier motion curve in the description information and/or the motion curve of the moving object is located.
- the image quality of the segment may not be good, but the user prefers it, so it may not be deleted.
- S304 Perform a clip process on the target image, delete the determined image segments, and obtain a clipped image.
- the identified image segments are deleted, leaving only the unaffected and tagged video or subset of images. Specifically, the video clip or the picture subset captured by the imaging device during the rotation of the carrier and/or the moving object such as the aircraft is accelerated or rotated.
- the video segment may also be determined according to a rule configured by the user, that is, the video segment may be determined only based on the interference information, or the video segment may be jointly determined based on the interference information and the tag information, or only The image segment is determined based on the tag information.
- the editing process may be performed according to the editing rule configured by the user, including: performing: in the configured editing rule
- the target image is edited based on the tag information, and the image segment is acquired according to the tag information added for the target image; and the new image is obtained based on the acquired image segment. If no editing rule is received, the above S303 and S304 are performed.
- the priority of the editing mode can be configured, that is, the editing rule configured by the user has the highest priority.
- the editing is performed according to the editing rule configured by the user.
- the Describe information and mark information for image editing is performed only based on the description information.
- the embodiment of the invention can quickly perform a video editing operation for the user based on the description information and the user's preference, saves the user time, and satisfies the user's automatic and intelligent editing requirements for the captured image.
- FIG. 4 is a schematic flowchart of a method for recording description information of a carrier in an embodiment of the present invention.
- the method in the embodiment of the present invention includes:
- the imaging module may be an imaging device, and the imaging device may be fixed on a carrier.
- the S401 may obtain motion data of a carrier such as a moving speed, an acceleration, an angular velocity, etc. by collecting various motion sensors configured in the carrier.
- the motion data of the carrier is the associated motion data of the imaging device, thereby determining the description information associated with the target image.
- the description information may be generated according to the detected associated motion data, and specifically includes the following S402 to S405.
- S402 determining whether the currently detected motion data of the carrier is interference data that affects the target image, that is, determining whether the motion data of the carrier is: acceleration of the carrier in one or more directions, And / or angular velocity. Under normal circumstances, when the carrier moves and rotates, there will be interference with video shooting.
- the interference data that is, the detected associated motion data is interference data that affects the target image quality, generating interference information.
- the description information may be generated in the form of an indication line, in which the interference information is represented by a curved line segment, and the stationary information is represented by a straight line segment. If there is other description information, for example, there is also description information (indicator line) of the aircraft that fixes the carrier, the two indicator lines may be fitted into a line segment including a straight line and a curve to indicate that the imaging device takes the picture Description information when the target image is used.
- FIG. 5 is a schematic flowchart of a method for recording description information of a moving object according to an embodiment of the present invention, where the method includes:
- the photographing module may be an imaging device mounted on the moving object or mounted on the moving object by a carrier.
- motion data such as moving speed, acceleration, angular velocity, and the like may be obtained by collecting various motion sensors configured in a moving object (such as an aircraft), and the motion data of the aircraft is associated motion data of the imaging device. Further, the description information associated with the target image is obtained.
- the description information may be generated according to the detected associated motion data, and the shooting module is configured to capture the target image, and specifically includes performing S502 to S505 described below.
- S502 Determine whether the detected motion data of the moving object is interference data that affects the target image quality, and the interference data that affects the target image quality includes: acceleration data and/or angular acceleration data.
- the interference data that is, the detected associated motion data is interference data that affects the target image quality, generating interference information.
- the description information may be generated in the form of an indication line, in which the interference information is represented by a curved line segment, and the stationary information is represented by a straight line segment. If there is other description information, for example, there is also description information (indicator line) of the carrier, the two indicator lines can be fitted into a line segment including a straight line and a curve to indicate that the imaging device captures the target image. Description.
- FIG. 6 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present invention.
- the apparatus of the embodiment of the present invention may be configured in various image systems. Specifically, the apparatus includes:
- the acquiring module 1 is configured to acquire description information associated with the target image when detecting an edit trigger event for the target image, where the description information includes image quality that affects image quality during shooting of the target image Interference information;
- the editing module 2 is configured to perform editing processing on the video segment associated with each interference information of the description information in the target image to obtain a processed target image.
- the description information acquired by the acquiring module 1 may specifically be motion related information of the imaging device that captures the target image during shooting, and the situation that causes the interference information to be generated includes but is not limited to:
- Unsmooth manipulation of a moving object (such as an aircraft) that mounts the imaging device causes the moving object to move quickly and slowly; the handling of the carrier carrying the imaging device causes the carrier to rotate in different directions The situation; occasionally due to external factors, the imaging device shakes, such as strong winds.
- the acquiring module 1 may first identify an identifier that identifies the target image, and then search for the stored description information associated with the target image based on the identifier.
- the description information includes at least the interference information, and may of course include other related information other than the interference information, such as smooth information for indicating uniform movement or stationary of the imaging device during shooting.
- the description information is information that is synchronously generated and stored while the target image is being captured. Specifically, the description information can be obtained by searching for data sensed by various sensors (such as acceleration sensors, gyroscopes, etc.) configured in the device.
- the description information may also be obtained by collecting the angular velocity or acceleration of the carrier carrying the imaging device on the three axes of X, Y, and Z, or the angular velocity of a moving object (such as an aircraft) that mounts the camera or the carrier or Acceleration.
- a moving object such as an aircraft
- the target image includes: a video or a set of pictures, wherein the set of pictures mainly refers to a set of pictures obtained in the case of continuous shooting of a plurality of pictures.
- the association between the description information and the target image may be an association based on the identifier, and the acquiring module 1 may find corresponding description information based on the topic name of the target image, where the topic name refers to the name or a certain video of a certain video.
- the acquisition module 1 may find the description information of the corresponding time period in the total description information of the record after the time and the end time of the target image are determined.
- the description information may be a length of an indicator line for describing a motion condition, and when the photographing module, or the carrier, or the moving object moves at a constant speed and at rest, it appears as a straight line segment, and an angular velocity is generated. Or, after an acceleration in a certain direction, it appears as a curve segment.
- the description information acquired by the acquiring module 1 may be any one or more pieces of information in the shooting module, the carrier, and the corresponding description information in the moving object.
- the record description information may be triggered at the time when the user initiates the video capture is detected, or the user manually turns on the trigger, or is always turned on.
- each time information involved above may uniquely identify the corresponding description information and the shooting time of the target image.
- the editing process of the editing module 2 mainly includes the editing process of the target image, and deleting the image in the target image in the time period according to the time period corresponding to the interference information in the description information, that is, deleting the target image A segment of the image with poor image quality is affected, and a segment of the image with good image quality is retained, and a new video or collection of images can be synthesized.
- the editing process of the editing module 2 may also copy other video segments except the video segments associated with the interference information in the description information, and combine to obtain a new video or image collection, so that the original video can be retained.
- the embodiment of the invention can automatically edit the image based on the description information, and does not require complicated operation steps for the user, is easy to implement, meets the requirements of user automation and intelligence, and saves time cost.
- FIG. 7 is a schematic structural diagram of another image processing apparatus according to an embodiment of the present invention.
- the apparatus according to the embodiment of the present invention may be configured in various image systems, and the apparatus includes the obtaining module 1 in the foregoing embodiment.
- the editing module 2 in the embodiment of the present invention, the device may further include:
- the recording module 3 is configured to record description information of the target image during the shooting of the target image.
- the recording module 3 is configured to detect associated motion data of the shooting module during the shooting of the target image, and generate description information according to the detected associated motion data, where the shooting module is configured to capture the target image.
- the associated motion data includes interference data that affects the target image quality, wherein the interference data that affects the target image quality includes: acceleration data and/or angular acceleration data.
- the interference data affecting the target image quality may include acceleration of the carrier carrying the imaging module in one or more directions, and/or angular velocity.
- the interference data affecting the target image quality may also include: acceleration of the moving object that mounts the shooting module in one or more directions, and/or angular velocity.
- the recording module 3 is configured to generate interference information when the detected associated motion data is interference data that affects the target image quality. Otherwise, generate smooth information, where the interference information and the smooth information constitute description information.
- the description information generated by the recording module 3 is a motion indication line; in the generated motion indication line, the interference information is represented by a curved line segment, and the stationary information is represented by a straight line segment.
- the editing module 2 may specifically include:
- a first determining unit 21 configured to determine an image segment associated with each interference information in the description information
- the first deleting unit 22 is configured to perform a clipping process on the target image, and delete the determined image segments to obtain a clipped image.
- the first determining unit 21 is specifically configured to determine, according to an occurrence period of each interference information in the description information, an image segment of a corresponding time segment in the target image.
- the recording module 3 is further configured to: when receiving the interest selection event of the user during the shooting of the target image, adding the marker information to the image segment corresponding to the interest selection event in the target image.
- the editing module 2 is further configured to: if the target image is edited based on the tag information in the configured editing rule, acquire the video segment according to the tag information added for the target image; The captured image clip is edited to get a new image.
- the editing module 2 includes:
- a second determining unit 23 configured to determine an image segment that is associated with each piece of interference information in the description information and that is not added with tag information
- the second deleting unit 24 is configured to perform a clipping process on the target image, and delete the determined image segments to obtain a clipped image.
- the editing module 2 may perform image editing according to an instruction of a user-configured editing rule. If the editing rule indicates that the editing is performed based on the tag information, the editing module directly adds the image according to the target image. The mark information acquires the image segment; the new image is obtained based on the acquired image segment edit. If the instruction is to be edited based on the interference information and the tag information, a new image is obtained by the second determining unit 23 and the second deleting unit 24 described above. If the instruction passes the interference information or the editing rule is not configured, the new image is obtained according to the first determining unit 21 and the first deleting unit 22 described above.
- the priority can be configured.
- the user-configured editing rule has the highest priority.
- the editing is performed according to the editing rule configured by the user.
- the description is based on the description information and the tag information.
- Image editing is performed only based on the description information.
- the editing module 2 may include the combination of the first determining unit 1 and the first deleting unit 22, and the combination of the second determining unit 23 and the second deleting unit 24, which may be specifically configured according to the configuration of the user. Select one of the combinations; you can also include only one of them.
- the embodiment of the invention can quickly perform a video editing operation for the user based on the description information, saves the user time, and satisfies the user's automatic and intelligent editing requirements for the captured image.
- FIG. 10 is a schematic structural diagram of an image system according to an embodiment of the present invention.
- the image system in the embodiment of the present invention may be configured in an aircraft for aerial photography, a remote control robot, and the like, and the specific system is
- the imaging device 100 and the processor 200 are included, wherein
- the imaging device 100 is configured to capture a target image
- the processor 200 is configured to acquire description information associated with the target image when detecting an edit trigger event for the target image, where the description information includes an influence image that occurs during the shooting of the target image
- the quality interference information is edited by the image segment associated with each of the interference information of the description information in the target image to obtain a processed target image.
- the target image includes: a video, or a set of pictures.
- the processor 200 is further configured to record description information of the target image during the shooting of the target image.
- the processor 200 is configured to detect associated motion data of the imaging device 100 during shooting of the target image, and generate description information according to the detected associated motion data;
- the interference data that affects the target image quality is included, wherein the interference data that affects the target image quality includes: acceleration data and/or angular acceleration data.
- the processor 200 is configured to detect motion data for carrying the carrier of the imaging device 100 during the shooting of the target image to obtain associated motion data of the imaging device 100.
- the associated motion data has interference data that affects the target image quality, and the interference data that affects the target image quality includes: acceleration of the carrier in one or more directions, and/or angular velocity.
- the processor 200 is further configured to: during the shooting of the target image, detect motion data for loading the moving object of the imaging device 100 to obtain associated motion data of the imaging device 100; There is interference data in the data that affects the quality of the target image, and the interference data that affects the quality of the target image includes: acceleration of the moving object in one or more directions, and/or angular velocity.
- the processor 200 is specifically configured to determine an image segment associated with each interference information in the description information, perform a clipping process on the target image, and delete the determined image segments to obtain The image after editing.
- the processor 200 is configured to determine, according to an occurrence period of each interference information in the description information, an image segment of a corresponding time segment in the target image.
- the processor 200 is further configured to: when the target image is received, if the user selects an event of interest selection, adding tag information to the image segment corresponding to the interest selection event in the target image.
- the processor 200 is further configured to: if the target image is edited based on the tag information in the configured editing rule, acquire the video segment according to the tag information added for the target image; The captured image clip is edited to get a new image.
- the processor 200 is further configured to determine an image segment that is associated with each interference information in the description information and is not added with tag information; perform editing processing on the target image, and delete the determining Each image segment is output, and the image after the editing is obtained.
- processor 200 in the embodiment of the present invention may refer to the related steps in the foregoing methods and apparatus embodiments, and descriptions of the functional modules and units.
- the embodiment of the invention can quickly perform a video editing operation for the user based on the description information, saves the user time, and satisfies the user's automatic and intelligent editing requirements for the captured image.
- the related apparatus and method disclosed may be implemented in other manners.
- the device embodiments described above are merely illustrative.
- the division of the modules or units is only a logical function division.
- there may be another division manner for example, multiple units or components may be used. Combinations can be integrated into another system, or some features can be ignored or not executed.
- the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
- the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
- each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
- the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
- the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium.
- the technical solution of the present invention which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium.
- a number of instructions are included to cause a computer processor to perform all or part of the steps of the methods described in various embodiments of the present invention.
- the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Aviation & Aerospace Engineering (AREA)
- Television Signal Processing For Recording (AREA)
- Studio Devices (AREA)
Abstract
一种影像处理方法、装置及系统,其中,所述方法包括:在检测到对目标影像的编辑触发事件时,获取与所述目标影像关联的描述信息,所述描述信息中包括在所述目标影像的拍摄过程中发生的影响影像质量的干扰信息;对所述目标影像中与所述描述信息的各个干扰信息关联的影像片段进行编辑处理,得到处理后的目标影像。能够基于运动信息快捷地为用户进行视频剪辑操作,节省用户时间,满足了用户对拍摄到的影像的自动化、智能化的编辑需求。
Description
本发明涉及图像处理技术领域,尤其涉及一种视频处理方法、装置及图像系统。
随着电子技术的发展,各种具有摄像功能的电子设备的普及,人们基本上可以随时随地拍摄感兴趣的图像、视频。对于拍摄到的图像、视频,人们可以根据需要共享给好友,或者进行收藏。
在共享或收藏时,用户一般希望对拍摄到的图像、视频进行编辑,用户可以进行包括字幕、音乐的添加编辑,还可以进一步地对视频进行剪辑,去掉画面质量差的图片或视频段,保留效果较好的视频组成新的视频供共享或收藏。
对导致影像的画面质量不好的原因有多种,具体可以包括以下原因:
不平滑的操控飞行器导致飞行器忽快,忽慢,画面易出现不需要的飞行器角架或者螺旋桨的图像信息;不能匀速操控云台等用于承载相机的承载件,导致相机画面快速转场,画质模糊;偶尔因为外界因素导致的相机抖动,导致画面质量不良。
现有技术中,用户对在一段时间内拍摄得到的图片集合或者视频的编辑,一般是在拍摄得到图片集合或者视频后进行的。在用户需要画质较好的影像时,对于图片集合,用户通过一张张地查看,删除画面质量不良的图片,筛选出合格的图片;而对于视频,用户则需要通过专业的视频剪辑软件,在对视频的浏览过程中观看并手动删除其中画面质量不良的视频片段。
现有的编辑方式会耗费用户大量的时间,且对于视频编辑而言,通过专业的视频编辑软件进行视频编辑对于大多数用户来讲操作较为繁琐,不易实现。
本发明实施例提供了一种视频处理方法、装置及图像系统,可以基于关联的干扰信息实现快捷的视频编辑操作。
一方面,本发明实施例提供了一种影像处理方法,包括:
在检测到对目标影像的编辑触发事件时,获取与所述目标影像关联的描述信息,所述描述信息中包括在所述目标影像的拍摄过程中发生的影响影像质量的干扰信息;
对所述目标影像中与所述描述信息的各个干扰信息关联的影像片段进行编辑处理,得到处理后的目标影像。
其中可选地,所述目标影像包括:视频、或者图片集合。
其中可选地,所述获取与所述目标影像关联的描述信息之前,还包括:在目标影像的拍摄过程中,记录所述目标影像的描述信息。
其中可选地,所述在目标影像的拍摄过程中,记录所述目标影像的描述信息,包括:
在目标影像的拍摄过程中,检测拍摄模块的关联运动数据,根据检测到的关联运动数据生成描述信息,所述拍摄模块用于拍摄所述目标影像;
所述关联运动数据中包括影响所述目标影像质量的干扰数据,其中,所述影响所述目标影像质量的干扰数据包括:加速度数据和/或角加速度数据。
其中可选地,所述影响所述目标影像质量的干扰数据包括:承载所述拍摄模块的承载件在一个或者多个方向上的加速度、和/或角速度。
其中可选地,所述影响所述目标影像质量的干扰数据包括:挂载所述拍摄模块的移动物体在一个或者多个方向上的加速度、和/或角速度。
其中可选地,所述根据检测到的关联运动数据生成描述信息包括:当检测到的关联运动数据为影响所述目标影像质量的干扰数据时,生成干扰信息,否则,生成平稳信息,所述干扰信息和平稳信息构成描述信息。
其中可选地,生成的描述信息为运动指示线;在生成的所述运动指示线中,干扰信息由曲线线段表示,平稳信息由直线线段表示。
其中可选地,所述对所述目标影像中与所述描述信息的各个干扰信息关联的影像片段进行编辑处理,得到处理后的目标影像,包括:
确定出与所述描述信息中各个干扰信息关联的影像片段;
对所述目标影像进行剪辑处理,删除所述确定出的各个影像片段,得到剪辑后的影像。
其中可选地,所述确定出与所述描述信息中各个干扰信息关联的影像片段,包括:根据所述描述信息中各个干扰信息的发生时段,确定出所述目标影像中相应时间段的影像片段。
其中可选地,所述方法还包括:
在目标影像的拍摄过程中,若接收到用户的兴趣选中事件,对目标影像中该兴趣选中事件对应影像段添加标记信息。
其中可选地,所述方法还包括:
若在配置的编辑规则中指示了基于标记信息对所述目标影像进行编辑,则根据为所述目标影像添加的标记信息获取影像片段;
基于获取的影像片段编辑得到新的影像。
其中可选地,所述对所述目标影像中与所述描述信息的各个干扰信息关联的影像片段进行编辑处理,得到处理后的目标影像,包括:
确定出与所述描述信息中各个干扰信息关联、且未被添加标记信息的影像片段;
对所述目标影像进行剪辑处理,删除所述确定出的各个影像片段,得到剪辑后的影像。
另一方面,本发明实施例还提供了一种影像处理装置,包括:
获取模块,用于在检测到对目标影像的编辑触发事件时,获取与所述目标影像关联的描述信息,所述描述信息中包括在所述目标影像的拍摄过程中发生的影响影像质量的干扰信息;
编辑模块,用于对所述目标影像中与所述描述信息的各个干扰信息关联的影像片段进行编辑处理,得到处理后的目标影像。
其中可选地,所述方法还包括:记录模块,用于在目标影像的拍摄过程中,记录所述目标影像的描述信息。
其中可选地,所述记录模块,具体用于在目标影像的拍摄过程中,检测拍摄模块的关联运动数据,根据检测到的关联运动数据生成描述信息,所述拍摄模块用于拍摄所述目标影像;所述关联运动数据中包括影响所述目标影像质量的干扰数据,其中,所述影响所述目标影像质量的干扰数据包括:加速度数据和/或角加速度数据。
其中可选地,所述影响所述目标影像质量的干扰数据包括:承载所述拍摄模块的承载件在一个或者多个方向上的加速度、和/或角速度。
其中可选地,所述影响所述目标影像质量的干扰数据包括:挂载所述拍摄模块的移动物体在一个或者多个方向上的加速度、和/或角速度。
其中可选地,所述记录模块,具体用于当检测到的关联运动数据为影响所述目标影像质量的干扰数据时,生成干扰信息,否则,生成平稳信息,所述干扰信息和平稳信息构成描述信息。
其中可选地,所述记录模块生成的描述信息为运动指示线;在生成的所述运动指示线中,干扰信息由曲线线段表示,平稳信息由直线线段表示。
其中可选地,所述编辑模块包括:
第一确定单元,用于确定出与所述描述信息中各个干扰信息关联的影像片段;
第一删除单元,用于对所述目标影像进行剪辑处理,删除所述确定出的各个影像片段,得到剪辑后的影像。
其中可选地,所述第一确定单元,具体用于根据所述描述信息中各个干扰信息的发生时段,确定出所述目标影像中相应时间段的影像片段。
其中可选地,所述记录模块,还用于在目标影像的拍摄过程中,若接收到用户的兴趣选中事件,对目标影像中该兴趣选中事件对应影像段添加标记信息。
其中可选地,所述编辑模块,还用于若在配置的编辑规则中指示了基于标记信息对所述目标影像进行编辑,则根据为所述目标影像添加的标记信息获取影像片段;基于获取的影像片段编辑得到新的影像。
其中可选地,所述编辑模块包括:
第二确定单元,用于确定出与所述描述信息中各个干扰信息关联、且未被添加标记信息的影像片段;
第二删除单元,用于对所述目标影像进行剪辑处理,删除所述确定出的各个影像片段,得到剪辑后的影像。
再一方面,本发明实施例还提供了一种图像系统,包括成像设备和处理器,其中,
所述成像设备,用于拍摄目标影像;
所述处理器,用于在检测到对目标影像的编辑触发事件时,获取与所述目标影像关联的描述信息,所述描述信息中包括在所述目标影像的拍摄过程中发生的影响影像质量的干扰信息;对所述目标影像中与所述描述信息的各个干扰信息关联的影像片段进行编辑处理,得到处理后的目标影像。
其中可选地,所述处理器,还用于在目标影像的拍摄过程中,记录所述目标影像的描述信息。
其中可选地,所述处理器,还用于在目标影像的拍摄过程中,检测所述成像设备的关联运动数据,根据检测到的关联运动数据生成描述信息;所述关联运动数据中包括影响所述目标影像质量的干扰数据,其中,所述影响所述目标影像质量的干扰数据包括:加速度数据和/或角加速度数据。
其中可选地,所述处理器,具体用于当检测到的关联运动数据为影响所述目标影像质量的干扰数据时,生成干扰信息,否则,生成平稳信息,所述干扰信息和平稳信息构成描述信息。
其中可选地,所述处理器生成的描述信息为运动指示线;在生成的所述运动指示线中,干扰信息由曲线线段表示,平稳信息由直线线段表示。
其中可选地,所述处理器,具体用于确定出与所述描述信息中各个干扰信息关联的影像片段;对所述目标影像进行剪辑处理,删除所述确定出的各个影像片段,得到剪辑后的影像。
其中可选地,所述处理器,具体用于根据所述描述信息中各个干扰信息的发生时段,确定出所述目标影像中相应时间段的影像片段。
其中可选地,所述处理器,还用于在目标影像的拍摄过程中,若接收到用户的兴趣选中事件,对目标影像中该兴趣选中事件对应影像段添加标记信息。
其中可选地,所述处理器,还用于若在配置的编辑规则中指示了基于标记信息对所述目标影像进行编辑,则根据为所述目标影像添加的标记信息获取影像片段;基于获取的影像片段编辑得到新的影像。
其中可选地,所述处理器,还用于确定出与所述描述信息中各个干扰信息关联、且未被添加标记信息的影像片段;对所述目标影像进行剪辑处理,删除所述确定出的各个影像片段,得到剪辑后的影像。
本发明实施例能够自动基于运动信息对影像进行编辑,对于用户来讲并不需要复杂的操作步骤,易于用户实现,满足了用户自动化、智能化的需求,节省了用户时间。
图1是本发明实施例的一种影像处理方法的流程示意图;
图2是本发明实施例的另一种视频处理方法的流程示意图;
图3是本发明实施例的再一种视频处理方法的流程示意图;
图4是本发明实施例中记录承载件的运动信息的方法的流程示意图;
图5是本发明实施例的记录移动物体的运动信息的方法流程示意图;
图6是本发明实施例的一种影像处理装置的结构示意图;
图7是本发明实施例的另一种影像处理装置的结构示意图;
图8是图7中的编辑模块的其中一种结构示意图;
图9是本发明实施例的一种图像系统的结构示意图。
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
本发明实施例可以基于与目标影像关联的包括干扰信息的运动信息来对目标影像进行自动编辑处理,可以自动化、智能化地为用户完成影像编辑,如删除因某些用户的拍摄操作所导致的质量不好的视频片段或图片集。
具体请参见图1,是本发明实施例的一种影像处理方法的流程示意图,本发明实施例的所述方法可以在一个影像处理器中实现,具体的,所述方法包括:
S101:在检测到对目标影像的编辑触发事件时,获取与所述目标影像关联的描述信息,所述描述信息中包括在所述目标影像的拍摄过程中发生的影响影像质量的干扰信息。
所述描述信息具体可以为拍摄所述目标影像的成像设备(如各种摄像机)在拍摄过程中的运动相关信息,而其中导致产生所述干扰信息的情况包括但不限于:
不平滑的操控挂载该成像设备的移动物体(如飞行器)使得该移动物体的移动忽快,忽慢的情况;对承载该成像设备的承载件的操控,使得承载件在不同的方向上转动的情况;偶尔因为外界因素导致的成像设备抖动的情况,例如强风等。其中,所述的承载件可以是用于安装、固定相机的云台设备,该云台设备可以是相机在一个或者多个方向上转动,扩大相机的监视范围。
用户可以简单地将目标影像拖动到编辑界面中、或者通过点击视频编辑按钮等触发事件,来触发对所述目标影像的处理操作,在检测到对目标影像的这些编辑触发事件后,在所述S101中可以先识别确定出该目标影像的标识,然后基于标识查找已存储的与该目标影像关联的描述信息。
所述描述信息至少包括所述的干扰信息,当然也可以包括除干扰信息外的其他相关信息,如用于表示成像设备在拍摄过程中的匀速移动或静止的平稳信息。
所述描述信息是在所述目标影像被拍摄的同时,同步生成并存储的信息。具体可以通过搜集成像设备中配置的各种传感器(如加速度传感器、陀螺仪等)感测的数据可以得到描述信息。
所述描述信息也可以通过搜集承载该成像设备的承载件在X、Y、Z三个轴上的角速度或者加速度(角加速度或平移加速度),也可以是挂载该相机或承载件的移动物体(如飞行器)的角速度或者加速度(角加速度或平移加速度)。
所述目标影像包括:视频、或者图片集合,其中图片集合主要是指多种图片连拍的情况下得到的图片集。所述描述信息与所述目标影像之间的关联可以是基于标识的关联,基于目标影像的主题名称可以找到对应的描述信息,主题名称是指某段视频的名称或者某一个时间段拍摄得到的照片集的名称。也可以是基于时间的关联,确定了所述目标影像的发生时间和结束时间后,可以在记录的总描述信息中找到对应时间段的描述信息。
在一种表现形式中,所述描述信息可以是一段用于描述运动情况的指示线,在所述拍摄模块、或承载件、或移动物体匀速运动和静止时,表现为直线段,产生了角速度、或者在某个方向上的加速度后,则表现为曲线段。在所述S101中获取到的描述信息可以是所述拍摄模块、承载件、移动物体中对应的描述信息中任意一个或者多个信息。
记录描述信息可以是在检测到用户发起视频拍摄的时刻触发、或者是用户手动开启触发,或者是一直开启的。其中,在一直开启的情况下,所述S101中根据时间关联,可以基于某段视频的发生时间段或图片集合的发生时间段截取对应时段的描述信息。
具体的,上述涉及到的各个时间信息可唯一标识出对应描述信息和目标影像的拍摄时间。
S102:对所述目标影像中与所述描述信息的各个干扰信息关联的影像片段进行编辑处理,得到处理后的目标影像。
编辑处理主要包括对所述目标影像的剪辑处理,根据所述描述信息中干扰信息对应的时段,将目标影像中该时段下的影像删除,即删除所述目标影像中被影响的影像质量不好的片段,而保留影像质量较好的影像片段,进而可以合成新的视频或图片集合。
当然,编辑处理也可以是复制出除了与所述描述信息中各个干扰信息关联的影像片段以外的其他影像片段,组合得到新的视频或者图片集合,从而可以保留原始视频。
可以理解的是,接收到用户的视频录制指令或图片连拍指令时同样可以作为对当前录制的视频或者图片(目标影像)的编辑触发事件,也就是说,在影像拍摄的同时,可以执行所述S101至S102,基于获取到的描述信息对当前拍摄的影像进行处理,直接得到编辑处理后的视频或图片。
本发明实施例能够自动基于描述信息对拍摄得到的影像进行编辑,对于用户来讲并不需要复杂的操作步骤,方便用户操作实现,满足了用户自动化、智能化的需求,节省了用户时间。
再请参见图2,是本发明实施例的另一种视频处理方法的流程示意图,本发明实施例的所述方法可以在一个影像处理器中实现,具体的,本发明实施例的所述方法包括:
S201:在目标影像的拍摄过程中,记录所述目标影像的描述信息。
在本发明实施例中,所述S201具体可以为:在目标影像的拍摄过程中,检测拍摄模块的关联运动数据,根据检测到的关联运动数据生成描述信息,所述拍摄模块用于拍摄所述目标影像;关联运动数据中包括影响所述目标影像质量的干扰数据,其中,所述影响所述目标影像质量的干扰数据包括:加速度数据和/或角加速度数据。所述拍摄模块具体可以为成像设备。
所述描述信息具体可以为拍摄所述目标影像的成像设备在拍摄过程中的运动相关信息,导致产生所述干扰信息的情况包括但不限于:
不平滑的操控挂载该成像设备的移动物体(如飞行器)使得该移动物体的移动忽快,忽慢的情况;对承载该成像设备的承载件的操控,使得承载件在不同的方向上转动的情况;偶尔因为外界因素导致的成像设备抖动的情况,例如强风等。
所述目标影像包括:视频、或者图片集合。所述描述信息至少包括干扰信息,当然也可以包括除干扰信息外的其他相关信息,如用于表示成像设备在拍摄过程中的匀速移动或静止的平稳信息。
所述描述信息是在所述目标影像被拍摄的同时,同步生成并存储的信息。具体可以通过搜集成像设备中配置的各种传感器(如加速度传感器、陀螺仪等)感测的数据可以得到描述信息。
所述描述信息也可以通过搜集承载该成像设备的承载件在X、Y、Z三个轴上的角速度或者加速度,也可以是挂载该相机或承载件的移动物体(如飞行器)的角速度或者加速度。
在一种表现形式中,所述描述信息可以是一段用于描述运动的线段,在所述拍摄模块、或承载件、或移动物体匀速运动和静止时,表现为直线段,产生了角速度、或者在某个方向上的加速度后,则表现为曲线。可以根据需要保存用于拍摄所述目标影像的所述成像设备、承载件、移动物体中对应的描述信息中任意一个或者多个的信息。
S202:确定出与所述描述信息中各个干扰信息关联的影像片段。
所述S202具体可以包括:根据所述描述信息中各个干扰信息的发生时段,确定出所述目标影像中相应时间段的影像片段。具体可以是根据描述信息中的承载件运动曲线、和/或移动物体运动曲线所在的时间段,确定出在对应时段内拍摄得到的视频片段或图片子集。
S203:对所述目标影像进行剪辑处理,删除所述确定出的各个影像片段,得到剪辑后的影像。
将确定出来的各个影像片段删除,仅剩下未受到加速运动以及转动的影响的视频片段或图片子集。具体即是将承载件转动过程中和/或飞行器等移动物体加速移动或转动的过程中,成像设备所拍摄到的视频片段或图片子集删除。
本发明实施例能够基于描述信息快捷地为用户进行视频剪辑操作,节省用户时间,满足了用户对拍摄到的影像的自动化、智能化的编辑需求。
再请参见图3,是本发明实施例的再一种视频处理方法的流程示意图,本发明实施例的所述方法可以在一个影像处理器中实现,具体的,本发明实施例的所述方法包括:
S301:在目标影像的拍摄过程中,记录所述目标影像的描述信息。
所述S301具体可以包括:在目标影像的拍摄过程中,检测拍摄模块的关联运动数据,根据检测到的关联运动数据生成描述信息,所述拍摄模块用于拍摄所述目标影像;所述关联运动数据中包括影响所述目标影像质量的干扰数据,其中,所述影响所述目标影像质量的干扰数据包括:加速度数据和/或角加速度数据。所述拍摄模块可以为成像设备。具体的,所述S301的记录过程可参考上一实施例中的描述。
S302:在目标影像的拍摄过程中,若接收到用户的兴趣选中事件,对目标影像中该兴趣选中事件对应影像段添加标记信息。
在目标视频的拍摄过程中,用户对于当前拍摄到的视频可以进行标记操作或者评级操作,以标示对此段影像片段的喜欢程度。具体的,当拍摄记录到某段内容时,用户若喜欢该段内容,可以基于标记按钮或剪辑(cut)按钮等对该段影像片段进行标记。具体用户可以通过单击、双击以及长按等方式来添加视频标记。
在单击了标记按钮后,在所述S302中自动地根据点击时的时间点,标记该时间点之前已拍摄的10秒影像和之后即将拍摄的10秒影像,得到添加了标记信息的影像段。
在双击了标记按钮后,在所述S302中自动地根据第一次点击时的时间点和第二次点击时的时间点,确定出添加了标记信息的影像段。
在长按了标记按钮后,在所述S302中自动地根据开始按下时的时间点和松开时的时间点,确定出添加了标记信息的影像段。
在完成了描述信息以及标记信息的记录后,即执行可对所述目标影像中与所述描述信息的各个干扰信息关联的影像片段进行编辑处理,得到处理后的目标影像,具体包括下述的S303至S304。
S303:确定出与所述描述信息中各个干扰信息关联、且未被添加标记信息的影像片段。
其中基于描述信息确定出对应影像片段具体可以包括:根据所述描述信息中各个干扰信息的发生时段,确定出所述目标影像中相应时间段的影像片段。具体可以是根据描述信息中承载件运动曲线、和/或移动物体运动曲线所在的时间段,确定出对应时段内拍摄得到的视频片段或图片子集。
而对于描述信息中的干扰信息关联的影像片段中,也可能存在被标记的影像片段,也就是说该段的影像质量可能不好,但是用户比较喜欢,因此可以不必删除。
S304:对所述目标影像进行剪辑处理,删除所述确定出的各个影像片段,得到剪辑后的影像。
将确定出来的各个影像片段删除,仅剩下未受影响且被标记的视频或图片子集。具体即是将承载件转动过程中和/或飞行器等移动物体加速移动或转动过程中成像设备所拍摄到的视频片段或图片子集删除。
可以理解的是,在所述S303中,也可以根据用户配置的规则确定出影像片段,即可以仅为基于干扰信息确定出影像片段,或者基于干扰信息和标记信息共同确定出影像片段,或者仅基于标记信息确定出影像片段。
具体的,所述方法在执行了所述S302之后进行编辑时,如果接收到了用户配置的编辑规则,则还可以根据用户配置的编辑规则进行编辑处理,包括执行:若在配置的编辑规则中指示了基于标记信息对所述目标影像进行编辑,则根据为所述目标影像添加的标记信息获取影像片段;基于获取的影像片段编辑得到新的影像。如果没有接收到编辑规则,则执行所述S303和S304。
在具体实施时,可以配置编辑方式优先级,即:用户配置的编辑规则的优先级最高,存在配置的编辑规则时按照用户配置的编辑规则执行编辑;其次,在存在用户标记信息时,则根据描述信息和标记信息进行影像编辑;最后,仅根据描述信息进行影像编辑。
本发明实施例能够基于描述信息、用户的喜好,快捷地为用户进行视频剪辑操作,节省用户时间,满足了用户对拍摄到的影像的自动化、智能化的编辑需求。
其中,请参见图4,是本发明实施例中记录承载件的描述信息的方法的流程示意图,本发明实施例的所述方法包括:
S401:在目标影像的拍摄过程中,检测拍摄模块的关联运动数据。
所述拍摄模块可以为成像设备,所述成像设备可以固定在承载件上,所述S401可以通过搜集承载件中配置的各种运动传感器来得到诸如移动速度、加速度、角速度等承载件的运动数据,该承载件的运动数据即为成像设备的关联运动数据,进而确定出所述目标影像关联的描述信息。
在关联运动数据后,即可根据检测到的关联运动数据生成描述信息,具体包括下述的S402至S405。
S402:判断当前检测到的所述承载件的运动数据是否为影响所述目标影像的干扰数据,即判断该承载件的运动数据是否为:所述承载件在一个或者多个方向上的加速度、和/或角速度。一般情况下,在承载件在加速移动、转动时,会出现对视频拍摄的干扰。
S403:若为干扰数据,即检测到的关联运动数据为影响所述目标影像质量的干扰数据,则生成干扰信息。
S404:否则,生成平稳信息。
S405:在目标影像拍摄结束后得到的干扰信息和平稳信息的组合即为描述信息。
具体的,可以通过指示线的形式生成所述描述信息,所述描述信息中,干扰信息由曲线线段表示,平稳信息由直线线段表示。如果还存在其他的描述信息,例如还存在固定该承载件的飞行器的描述信息(指示线),则可以将两条指示线拟合成一条包括直线和曲线的线段,以表示成像设备拍摄所述目标影像时的描述信息。
其中,再请参见图5,是本发明实施例的记录移动物体的描述信息的方法流程示意图,所述方法包括:
S501:在目标影像的拍摄过程中,检测拍摄模块的关联运动数据。
所述拍摄模块可以为成像设备,该成像设备挂载在所述移动物体上,或者通过承载件挂载在所述移动物体上。所述S501中可以通过搜集移动物体(如飞行器)中配置的各种运动传感器来得到诸如移动速度、加速度、角速度等移动物体的运动数据,该飞行器的运动数据即为成像设备的关联运动数据,进而得到所述目标影像关联的描述信息。
在得到移动物体的运动数据后,即可根据检测到的关联运动数据生成描述信息,所述拍摄模块用于拍摄所述目标影像,具体包括执行下述的S502至S505。
S502:判断检测到的所述移动物体的运动数据是否为影响所述目标影像质量的干扰数据,所述影响所述目标影像质量的干扰数据包括:加速度数据和/或角加速度数据。
S503:若为干扰数据,即检测到的关联运动数据为影响所述目标影像质量的干扰数据,则生成干扰信息。
S504:否则,生成平稳信息。
S505:在目标影像拍摄结束后得到的干扰信息和平稳信息的组合即为描述信息。
具体的,可以通过指示线的形式生成所述描述信息,所述描述信息中,干扰信息由曲线线段表示,平稳信息由直线线段表示。如果还存在其他的描述信息,例如还存在承载件的描述信息(指示线),则可以将两条指示线拟合成一条包括直线和曲线的线段,以表示成像设备拍摄所述目标影像时的描述信息。
一般情况下,承载件及移动物体均存在各种运动传感器,特别是作为航拍使用的飞行器、遥控汽车等,需要通过加速度计、陀螺仪等运动传感器来检测对应运动物体的移动情况,因此,通过图4和图5的方式来确定成像设备拍摄过程中的描述信息,仅需在现有硬件的基础上增加新的功能即可,不会产生额外的硬件成本。
下面对本发明实施例的视频处理装置及图像系统进行详细描述。
请参见图6,是本发明实施例的一种影像处理装置的结构示意图,本发明实施例的所述装置可以配置在各种影像系统中,具体的,所述装置包括:
获取模块1,用于在检测到对目标影像的编辑触发事件时,获取与所述目标影像关联的描述信息,所述描述信息中包括在所述目标影像的拍摄过程中发生的影响影像质量的干扰信息;
编辑模块2,用于对所述目标影像中与所述描述信息的各个干扰信息关联的影像片段进行编辑处理,得到处理后的目标影像。
所述获取模块1所获取的描述信息具体可以为拍摄所述目标影像的成像设备在拍摄过程中的运动相关信息,而其中导致产生所述干扰信息的情况包括但不限于:
不平滑的操控挂载该成像设备的移动物体(如飞行器)使得该移动物体的移动忽快,忽慢的情况;对承载该成像设备的承载件的操控,使得承载件在不同的方向上转动的情况;偶尔因为外界因素导致的成像设备抖动的情况,例如强风等。
用户可以简单地将目标影像拖动到编辑界面中、或者通过点击视频编辑按钮,来触发对所述目标影像的编辑触发事件,在检测到对目标影像的这些编辑触发事件后,所述获取模块1可以先识别确定出该目标影像的标识,然后基于标识查找已存储的与该目标影像关联的描述信息。
所述描述信息至少包括所述的干扰信息,当然也可以包括除干扰信息外的其他相关信息,如用于表示成像设备在拍摄过程中的匀速移动或静止的平稳信息。
所述描述信息是在所述目标影像被拍摄的同时,同步生成并存储的信息。具体可以通过搜集成像设备中配置的各种传感器(如加速度传感器、陀螺仪等)感测的数据可以得到描述信息。
所述描述信息也可以通过搜集承载该成像设备的承载件在X、Y、Z三个轴上的角速度或者加速度,也可以是挂载该相机或承载件的移动物体(如飞行器)的角速度或者加速度。
所述目标影像包括:视频或者图片集合,其中图片集合主要是指多种图片连拍的情况下得到的图片集。所述描述信息与所述目标影像之间的关联可以是基于标识的关联,所述获取模块1基于目标影像的主题名称可以找到对应的描述信息,主题名称是指某段视频的名称或者某一个时间段拍摄得到的照片集的名称。也可以是基于时间的关联,确定了所述目标影像的发生时间和结束时间后,所述获取模块1可以在记录的总的描述信息中找到对应时间段的描述信息。
在一种表现形式中,所述描述信息可以是一段用于描述运动情况的指示线,在所述拍摄模块、或承载件、或移动物体匀速运动和静止时,表现为直线段,产生了角速度、或者在某个方向上的加速度后,则表现为曲线段。所述获取模块1获取到的描述信息可以是所述拍摄模块、承载件、移动物体中对应的描述信息中任意一个或者多个信息。
记录描述信息可以是在检测到用户发起视频拍摄的时刻触发、或者是用户手动开启触发,或者是一直开启的。
具体的,上述涉及到的各个时间信息可唯一标识出对应描述信息和目标影像的拍摄时间。
所述编辑模块2的编辑处理主要包括对所述目标影像的剪辑处理,根据所述描述信息中干扰信息对应的时段,将目标影像中该时段下的影像删除,即删除所述目标影像中被影响的影像质量不好的片段,而保留影像质量较好的影像片段,进而可以合成新的视频或图片集合。
当然,所述编辑模块2的编辑处理也可以是复制出除了与所述描述信息中各个干扰信息关联的影像片段以外的其他影像片段,组合得到新的视频或者图片集合,从而可以保留原始视频。
本发明实施例能够自动基于描述信息对影像进行编辑,对于用户来讲并不需要复杂的操作步骤,易于实现,满足了用户自动化、智能化的需求,节省了时间成本。
再请参见图7,是本发明实施例的另一种影像处理装置的结构示意图,本发明实施例的所述装置可以配置于各种影像系统,所述装置包括上述实施例中的获取模块1的和编辑模块2,在本发明实施例中,所述装置进一步地还可以包括:
记录模块3,用于在目标影像的拍摄过程中,记录所述目标影像的描述信息。
可选地,所述记录模块3具体用于在目标影像的拍摄过程中,检测拍摄模块的关联运动数据,根据检测到的关联运动数据生成描述信息,所述拍摄模块用于拍摄所述目标影像;所述关联运动数据中包括影响所述目标影像质量的干扰数据,其中,所述影响所述目标影像质量的干扰数据包括:加速度数据和/或角加速度数据。
其中,所述影响所述目标影像质量的干扰数据可以包括:承载所述拍摄模块的承载件在一个或者多个方向上的加速度、和/或角速度。
所述影响所述目标影像质量的干扰数据也可以包括:挂载所述拍摄模块的移动物体在一个或者多个方向上的加速度、和/或角速度。
所述记录模块3,具体用于当检测到的关联运动数据为影响所述目标影像质量的干扰数据时,生成干扰信息,否则,生成平稳信息,所述干扰信息和平稳信息构成描述信息。
具体的,在本发明实施例中,所述记录模块3生成的描述信息为运动指示线;在生成的所述运动指示线中,干扰信息由曲线线段表示,平稳信息由直线线段表示。
进一步可选地,如图8所述,所述编辑模块2具体可以包括:
第一确定单元21,用于确定出与所述描述信息中各个干扰信息关联的影像片段;
第一删除单元22,用于对所述目标影像进行剪辑处理,删除所述确定出的各个影像片段,得到剪辑后的影像。
其中具体的,所述第一确定单元21,具体用于根据所述描述信息中各个干扰信息的发生时段,确定出所述目标影像中相应时间段的影像片段。
进一步可选地,所述记录模块3,还用于在目标影像的拍摄过程中,若接收到用户的兴趣选中事件,对目标影像中该兴趣选中事件对应影像段添加标记信息。
进一步可选地,所述编辑模块2,还用于若在配置的编辑规则中指示了基于标记信息对所述目标影像进行编辑,则根据为所述目标影像添加的标记信息获取影像片段;基于获取的影像片段编辑得到新的影像。
进一步可选地,如图8所示,所述编辑模块2包括:
第二确定单元23,用于确定出与所述描述信息中各个干扰信息关联、且未被添加标记信息的影像片段;
第二删除单元24,用于对所述目标影像进行剪辑处理,删除所述确定出的各个影像片段,得到剪辑后的影像。
在具体应用中,所述编辑模块2可以根据用户配置的编辑规则的指示进行影像编辑,如果该编辑规则中指示了基于标记信息来进行编辑,则所述编辑模块直接根据为所述目标影像添加的标记信息获取影像片段;基于获取的影像片段编辑得到新的影像。如果指示基于干扰信息和标记信息进行编辑,则通过上述的第二确定单元23和第二删除单元24来得到新的影像。如果指示通过干扰信息或者没有配置编辑规则,则根据上述的第一确定单元21和第一删除单元22来得到新的影像。
具体可以配置优先级,即:用户配置的编辑规则的优先级最高,存在配置的编辑规则时按照用户配置的编辑规则执行编辑;其次,在存在用户标记信息时,则根据描述信息和标记信息进行影像编辑;最后,仅根据描述信息进行影像编辑。
具体的,所述编辑模块2可以同时包括上述的第一确定单元1、第一删除单元的组合22,和第二确定单元23、第二删除单元24的组合,具体可以根据用户的配置情况来选择其中的组合;也可以仅包括其中的一种组合。
需要说明的是,本发明实施例中所涉及的各个模块、单元的具体实现进一步可参考上述各个方法实施例中相关步骤的描述。
本发明实施例能够基于描述信息快捷地为用户进行视频剪辑操作,节省用户时间,满足了用户对拍摄到的影像的自动化、智能化的编辑需求。
再请参见图10,是本发明实施例的一种图像系统的结构示意图,本发明实施例的所述图像系统可以配置在用于航拍的飞行器中、遥控机器人等设备中,具体的所述系统包括:成像设备100和处理器200,其中,
所述成像设备100,用于拍摄目标影像;
所述处理器200,用于在检测到对目标影像的编辑触发事件时,获取与所述目标影像关联的描述信息,所述描述信息中包括在所述目标影像的拍摄过程中发生的影响影像质量的干扰信息;对所述目标影像中与所述描述信息的各个干扰信息关联的影像片段进行编辑处理,得到处理后的目标影像。
其中可选地,所述目标影像包括:视频、或者图片集合。
其中可选地,所述处理器200,还用于在目标影像的拍摄过程中,记录所述目标影像的描述信息。
其中可选地,所述处理器200,具体用于在目标影像的拍摄过程中,检测所述成像设备100的关联运动数据,根据检测到的关联运动数据生成描述信息;所述关联运动数据中包括影响所述目标影像质量的干扰数据,其中,所述影响所述目标影像质量的干扰数据包括:加速度数据和/或角加速度数据。
其中可选地,所述处理器200,具体用于在所述目标影像的拍摄过程中,检测用于承载所述成像设备100的承载件的运动数据以得到所述成像设备100的关联运动数据。所述关联运动数据中存在影响所述目标影像质量的干扰数据,而影响所述目标影像质量的干扰数据包括:所述承载件在一个或者多个方向上的加速度、和/或角速度。
其中可选地,所述处理器200,还用于在目标影像的拍摄过程中,检测用于挂载成像设备100的移动物体的运动数据以得到成像设备100的关联运动数据;所述关联运动数据中存在影响所述目标影像质量的干扰数据,而影响所述目标影像质量的干扰数据包括:所述移动物体在一个或者多个方向上的加速度、和/或角速度。
其中可选地,所述处理器200,具体用于确定出与所述描述信息中各个干扰信息关联的影像片段;对所述目标影像进行剪辑处理,删除所述确定出的各个影像片段,得到剪辑后的影像。
其中可选地,所述处理器200,具体用于根据所述描述信息中各个干扰信息的发生时段,确定出所述目标影像中相应时间段的影像片段。
其中可选地,所述处理器200,还用于在目标影像的拍摄过程中,若接收到用户的兴趣选中事件,对目标影像中该兴趣选中事件对应影像段添加标记信息。
其中可选地,所述处理器200,还用于若在配置的编辑规则中指示了基于标记信息对所述目标影像进行编辑,则根据为所述目标影像添加的标记信息获取影像片段;基于获取的影像片段编辑得到新的影像。
其中可选地,所述处理器200,还用于确定出与所述描述信息中各个干扰信息关联、且未被添加标记信息的影像片段;对所述目标影像进行剪辑处理,删除所述确定出的各个影像片段,得到剪辑后的影像。
需要说明的是,本发明实施例中的处理器200的具体实现可参考上述各个方法、装置实施例中相关步骤,及功能模块、单元的描述。
本发明实施例能够基于描述信息快捷地为用户进行视频剪辑操作,节省用户时间,满足了用户对拍摄到的影像的自动化、智能化的编辑需求。
在本发明所提供的几个实施例中,应该理解到,所揭露的相关装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得计算机处理器(processor)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述仅为本发明的实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。
Claims (35)
- 一种影像处理方法,其特征在于,包括:在检测到对目标影像的编辑触发事件时,获取与所述目标影像关联的描述信息,所述描述信息中包括在所述目标影像的拍摄过程中发生的影响影像质量的干扰信息;对所述目标影像中与所述描述信息的各个干扰信息关联的影像片段进行编辑处理,得到处理后的目标影像。
- 如权利要求1所述的方法,其特征在于,所述目标影像包括:视频、或者图片集合。
- 如权利要求1所述的方法,其特征在于,所述获取与所述目标影像关联的描述信息之前,还包括:在目标影像的拍摄过程中,记录所述目标影像的描述信息。
- 如权利要求3所述的方法,其特征在于,所述在目标影像的拍摄过程中,记录所述目标影像的描述信息,包括:在目标影像的拍摄过程中,检测拍摄模块的关联运动数据,根据检测到的关联运动数据生成描述信息,所述拍摄模块用于拍摄所述目标影像;所述关联运动数据中包括影响所述目标影像质量的干扰数据,其中,所述影响所述目标影像质量的干扰数据包括:加速度数据和/或角加速度数据。
- 如权利要求4所述的方法,其特征在于,所述影响所述目标影像质量的干扰数据包括:承载所述拍摄模块的承载件在一个或者多个方向上的加速度、和/或角速度。
- 如权利要求4所述的方法,其特征在于,所述影响所述目标影像质量的干扰数据包括:挂载所述拍摄模块的移动物体在一个或者多个方向上的加速度、和/或角速度。
- 如权利要求4所述的方法,其特征在于,所述根据检测到的关联运动数据生成描述信息,包括:当检测到的关联运动数据为影响所述目标影像质量的干扰数据时,生成干扰信息,否则,生成平稳信息,所述干扰信息和平稳信息构成描述信息。
- 如权利要求7所述的方法,其特征在于,所述描述信息为运动指示线;在生成的所述运动指示线中,干扰信息由曲线线段表示,平稳信息由直线线段表示。
- 如权利要求1所述的方法,其特征在于,所述对所述目标影像中与所述描述信息的各个干扰信息关联的影像片段进行编辑处理,得到处理后的目标影像,包括:确定出与所述描述信息中各个干扰信息关联的影像片段;对所述目标影像进行剪辑处理,删除所述确定出的各个影像片段,得到剪辑后的影像。
- 如权利要求9所述的方法,其特征在于,所述确定出与所述描述信息中各个干扰信息关联的影像片段,包括:根据所述描述信息中各个干扰信息的发生时段,确定出所述目标影像中相应时间段的影像片段。
- 如权利要求4所述的方法,其特征在于,还包括:在目标影像的拍摄过程中,若接收到用户的兴趣选中事件,对目标影像中该兴趣选中事件对应影像段添加标记信息。
- 如权利要求11所述的方法,其特征在于,还包括:若在配置的编辑规则中指示了基于标记信息对所述目标影像进行编辑,则根据为所述目标影像添加的标记信息获取影像片段;基于获取的影像片段编辑得到新的影像。
- 如权利要求11所述的方法,其特征在于,所述对所述目标影像中与所述描述信息的各个干扰信息关联的影像片段进行编辑处理,得到处理后的目标影像,包括:确定出与所述描述信息中各个干扰信息关联、且未被添加标记信息的影像片段;对所述目标影像进行剪辑处理,删除所述确定出的各个影像片段,得到剪辑后的影像。
- 一种影像处理装置,其特征在于,包括:获取模块,用于在检测到对目标影像的编辑触发事件时,获取与所述目标影像关联的描述信息,所述描述信息中包括在所述目标影像的拍摄过程中发生的影响影像质量的干扰信息;编辑模块,用于对所述目标影像中与所述描述信息的各个干扰信息关联的影像片段进行编辑处理,得到处理后的目标影像。
- 如权利要求14所述的装置,其特征在于,还包括:记录模块,用于在目标影像的拍摄过程中,记录所述目标影像的描述信息。
- 如权利要求15所述的装置,其特征在于,所述记录模块,具体用于在目标影像的拍摄过程中,检测拍摄模块的关联运动数据,根据检测到的关联运动数据生成描述信息,所述拍摄模块用于拍摄所述目标影像;所述关联运动数据中包括影响所述目标影像质量的干扰数据,其中,所述影响所述目标影像质量的干扰数据包括:加速度数据和/或角加速度数据。
- 如权利要求16所述的装置,其特征在于,所述影响所述目标影像质量的干扰数据包括:承载所述拍摄模块的承载件在一个或者多个方向上的加速度、和/或角速度。
- 如权利要求16所述的装置,其特征在于,所述影响所述目标影像质量的干扰数据包括:挂载所述拍摄模块的移动物体在一个或者多个方向上的加速度、和/或角速度。
- 如权利要求16所述的装置,其特征在于,所述记录模块,具体用于当检测到的关联运动数据为影响所述目标影像质量的干扰数据时,生成干扰信息,否则,生成平稳信息,所述干扰信息和平稳信息构成描述信息。
- 如权利要求19所述的装置,其特征在于,所述记录模块生成的描述信息为运动指示线;在生成的所述运动指示线中,干扰信息由曲线线段表示,平稳信息由直线线段表示。
- 如权利要求14所述的装置,其特征在于,所述编辑模块包括:第一确定单元,用于确定出与所述描述信息中各个干扰信息关联的影像片段;第一删除单元,用于对所述目标影像进行剪辑处理,删除所述确定出的各个影像片段,得到剪辑后的影像。
- 如权利要求21所述的装置,其特征在于,所述第一确定单元,具体用于根据所述描述信息中各个干扰信息的发生时段,确定出所述目标影像中相应时间段的影像片段。
- 如权利要求16所述的装置,其特征在于,所述记录模块,还用于在目标影像的拍摄过程中,若接收到用户的兴趣选中事件,对目标影像中该兴趣选中事件对应影像段添加标记信息。
- 如权利要求23所述的装置,其特征在于,所述编辑模块,还用于若在配置的编辑规则中指示了基于标记信息对所述目标影像进行编辑,则根据为所述目标影像添加的标记信息获取影像片段;基于获取的影像片段编辑得到新的影像。
- 如权利要求23所述的装置,其特征在于,所述编辑模块包括:第二确定单元,用于确定出与所述描述信息中各个干扰信息关联、且未被添加标记信息的影像片段;第二删除单元,用于对所述目标影像进行剪辑处理,删除所述确定出的各个影像片段,得到剪辑后的影像。
- 一种图像系统,其特征在于,包括成像设备和处理器,其中,所述成像设备,用于拍摄目标影像;所述处理器,用于在检测到对目标影像的编辑触发事件时,获取与所述目标影像关联的描述信息,所述描述信息中包括在所述目标影像的拍摄过程中发生的影响影像质量的干扰信息;对所述目标影像中与所述描述信息的各个干扰信息关联的影像片段进行编辑处理,得到处理后的目标影像。
- 如权利要求26所述的系统,其特征在于,所述处理器,还用于在目标影像的拍摄过程中,记录所述目标影像的描述信息。
- 如权利要求27所述的系统,其特征在于:所述处理器,还用于在目标影像的拍摄过程中,检测所述成像设备的关联运动数据,根据检测到的关联运动数据生成描述信息;所述关联运动数据中包括影响所述目标影像质量的干扰数据,其中,所述影响所述目标影像质量的干扰数据包括:加速度数据和/或角加速度数据。
- 如权利要求28所述的系统,其特征在于,所述处理器,具体用于当检测到的关联运动数据为影响所述目标影像质量的干扰数据时,生成干扰信息,否则,生成平稳信息,所述干扰信息和平稳信息构成描述信息。
- 如权利要求29所述的系统,其特征在于,所述处理器生成的描述信息为运动指示线;在生成的所述运动指示线中,干扰信息由曲线线段表示,平稳信息由直线线段表示。
- 如权利要求26所述的系统,其特征在于,所述处理器,具体用于确定出与所述描述信息中各个干扰信息关联的影像片段;对所述目标影像进行剪辑处理,删除所述确定出的各个影像片段,得到剪辑后的影像。
- 如权利要求31所述的系统,其特征在于,所述处理器,具体用于根据所述描述信息中各个干扰信息的发生时段,确定出所述目标影像中相应时间段的影像片段。
- 如权利要求33所述的系统,其特征在于,所述处理器,还用于在目标影像的拍摄过程中,若接收到用户的兴趣选中事件,对目标影像中该兴趣选中事件对应影像段添加标记信息。
- 如权利要求33所述的系统,其特征在于,所述处理器,还用于若在配置的编辑规则中指示了基于标记信息对所述目标影像进行编辑,则根据为所述目标影像添加的标记信息获取影像片段;基于获取的影像片段编辑得到新的影像。
- 如权利要求33所述的系统,其特征在于,所述处理器,还用于确定出与所述描述信息中各个干扰信息关联、且未被添加标记信息的影像片段;对所述目标影像进行剪辑处理,删除所述确定出的各个影像片段,得到剪辑后的影像。
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2014/093787 WO2016095073A1 (zh) | 2014-12-14 | 2014-12-14 | 一种视频处理方法、装置及图像系统 |
| CN201480031347.0A CN105493496B (zh) | 2014-12-14 | 2014-12-14 | 一种视频处理方法、装置及图像系统 |
| US15/622,327 US10447929B2 (en) | 2014-12-14 | 2017-06-14 | Video processing method, device and image system |
| US16/567,501 US10805542B2 (en) | 2014-12-14 | 2019-09-11 | Video processing method, device and image system |
| US17/037,965 US11381744B2 (en) | 2014-12-14 | 2020-09-30 | Video processing method, device and image system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2014/093787 WO2016095073A1 (zh) | 2014-12-14 | 2014-12-14 | 一种视频处理方法、装置及图像系统 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US15/622,327 Continuation US10447929B2 (en) | 2014-12-14 | 2017-06-14 | Video processing method, device and image system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2016095073A1 true WO2016095073A1 (zh) | 2016-06-23 |
Family
ID=55678517
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2014/093787 Ceased WO2016095073A1 (zh) | 2014-12-14 | 2014-12-14 | 一种视频处理方法、装置及图像系统 |
Country Status (3)
| Country | Link |
|---|---|
| US (3) | US10447929B2 (zh) |
| CN (1) | CN105493496B (zh) |
| WO (1) | WO2016095073A1 (zh) |
Families Citing this family (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105493496B (zh) * | 2014-12-14 | 2019-01-18 | 深圳市大疆创新科技有限公司 | 一种视频处理方法、装置及图像系统 |
| US10299017B2 (en) * | 2015-09-14 | 2019-05-21 | Logitech Europe S.A. | Video searching for filtered and tagged motion |
| CA3045286C (en) * | 2016-10-28 | 2024-02-20 | Axon Enterprise, Inc. | Systems and methods for supplementing captured data |
| CN107404482A (zh) * | 2017-07-25 | 2017-11-28 | 闫如月 | 一种多摄像机实时实景视频桌面背景的方法 |
| WO2019075617A1 (zh) * | 2017-10-16 | 2019-04-25 | 深圳市大疆创新科技有限公司 | 一种视频处理方法、控制终端及可移动设备 |
| CN109076194B (zh) * | 2017-11-21 | 2021-04-16 | 深圳市大疆创新科技有限公司 | 一种视频处理方法、设备、飞行器、系统及存储介质 |
| CN108886579A (zh) * | 2017-12-26 | 2018-11-23 | 深圳市大疆创新科技有限公司 | 无人机拍摄视频的处理方法、拍摄相机和遥控器 |
| CN113395416A (zh) * | 2017-12-29 | 2021-09-14 | 深圳市大疆创新科技有限公司 | 视频数据处理方法、设备、系统及存储介质 |
| WO2019140621A1 (zh) * | 2018-01-19 | 2019-07-25 | 深圳市大疆创新科技有限公司 | 视频处理方法及终端设备 |
| CN110622517A (zh) * | 2018-01-19 | 2019-12-27 | 深圳市大疆创新科技有限公司 | 视频处理方法及设备 |
| CN109391849B (zh) * | 2018-09-30 | 2020-11-20 | 联想(北京)有限公司 | 处理方法及系统、多媒体输出装置及存储器 |
| CN109461111A (zh) * | 2018-10-26 | 2019-03-12 | 连尚(新昌)网络科技有限公司 | 影像编辑方法、装置、终端设备及介质 |
| CN111168689A (zh) * | 2018-11-13 | 2020-05-19 | 上海元趣信息技术有限公司 | 一种自动生成儿童成长视频的机器人系统及其工作方法 |
| WO2021112517A1 (en) * | 2019-12-06 | 2021-06-10 | Samsung Electronics Co., Ltd. | Method and electronic device for description parameter based modification of images |
| CN113288049B (zh) * | 2020-02-24 | 2026-01-23 | 华为技术有限公司 | 一种数据采集方法、终端设备及存储介质 |
| CN111787223B (zh) * | 2020-06-30 | 2021-07-16 | 维沃移动通信有限公司 | 视频拍摄方法、装置和电子设备 |
| CN113691729B (zh) * | 2021-08-27 | 2023-08-22 | 维沃移动通信有限公司 | 图像处理方法及装置 |
| CN115002335B (zh) * | 2021-11-26 | 2024-04-09 | 荣耀终端有限公司 | 视频处理方法、装置、电子设备和计算机可读存储介质 |
| CN116208842B (zh) * | 2021-11-30 | 2024-11-29 | 顺丰科技有限公司 | 视频处理方法、装置、设备和计算机可读存储介质 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050231599A1 (en) * | 2004-04-14 | 2005-10-20 | Olympus Corporation | Image capturing apparatus |
| CN102509285A (zh) * | 2011-09-28 | 2012-06-20 | 宇龙计算机通信科技(深圳)有限公司 | 一种拍摄出模糊图片的处理方法、系统及拍摄设备 |
| CN103002330A (zh) * | 2012-12-31 | 2013-03-27 | 合一网络技术(北京)有限公司 | 一种同时同地拍摄的多视频网络编辑方法、客户端、服务器及系统 |
| CN103262169A (zh) * | 2010-12-14 | 2013-08-21 | 高通股份有限公司 | 用于删除失效帧的视频编辑装置 |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5894323A (en) * | 1996-03-22 | 1999-04-13 | Tasc, Inc, | Airborne imaging system using global positioning system (GPS) and inertial measurement unit (IMU) data |
| US20020039138A1 (en) * | 2000-09-29 | 2002-04-04 | Edelson Steven D. | Method and apparatus for automatically adjusting video panning and zoom rates |
| US7734144B2 (en) * | 2002-10-30 | 2010-06-08 | Koninklijke Philips Electronics N.V. | Method and apparatus for editing source video to provide video image stabilization |
| US9262818B2 (en) * | 2007-05-01 | 2016-02-16 | Pictometry International Corp. | System for detecting image abnormalities |
| US20090066799A1 (en) * | 2007-09-11 | 2009-03-12 | Omnivision Technologies, Inc. | Image sensor apparatus and method for embedding image stabilization data into image data |
| US8253812B2 (en) * | 2008-02-23 | 2012-08-28 | Sanyo Electric Co., Ltd. | Video camera which adopts a focal-plane electronic shutter system |
| US8837900B2 (en) * | 2010-05-11 | 2014-09-16 | Cisco Technology, Inc. | Unintended video recording detection in a video recording device |
| US9374532B2 (en) * | 2013-03-15 | 2016-06-21 | Google Inc. | Cascaded camera motion estimation, rolling shutter detection, and camera shake detection for video stabilization |
| US8908102B1 (en) * | 2013-09-03 | 2014-12-09 | Google Inc. | Generating and/or modifying motion compensation parameters for video stabilization |
| EP3764157B1 (en) * | 2013-10-08 | 2025-06-25 | SZ DJI Osmo Technology Co., Ltd. | Apparatus and method for stabilization and vibration reduction |
| US9751639B2 (en) * | 2013-12-02 | 2017-09-05 | Field Of View Llc | System to control camera triggering and visualize aerial imaging missions |
| CN105493496B (zh) * | 2014-12-14 | 2019-01-18 | 深圳市大疆创新科技有限公司 | 一种视频处理方法、装置及图像系统 |
-
2014
- 2014-12-14 CN CN201480031347.0A patent/CN105493496B/zh not_active Expired - Fee Related
- 2014-12-14 WO PCT/CN2014/093787 patent/WO2016095073A1/zh not_active Ceased
-
2017
- 2017-06-14 US US15/622,327 patent/US10447929B2/en not_active Expired - Fee Related
-
2019
- 2019-09-11 US US16/567,501 patent/US10805542B2/en active Active
-
2020
- 2020-09-30 US US17/037,965 patent/US11381744B2/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050231599A1 (en) * | 2004-04-14 | 2005-10-20 | Olympus Corporation | Image capturing apparatus |
| CN103262169A (zh) * | 2010-12-14 | 2013-08-21 | 高通股份有限公司 | 用于删除失效帧的视频编辑装置 |
| CN102509285A (zh) * | 2011-09-28 | 2012-06-20 | 宇龙计算机通信科技(深圳)有限公司 | 一种拍摄出模糊图片的处理方法、系统及拍摄设备 |
| CN103002330A (zh) * | 2012-12-31 | 2013-03-27 | 合一网络技术(北京)有限公司 | 一种同时同地拍摄的多视频网络编辑方法、客户端、服务器及系统 |
Also Published As
| Publication number | Publication date |
|---|---|
| US11381744B2 (en) | 2022-07-05 |
| CN105493496B (zh) | 2019-01-18 |
| US20170280058A1 (en) | 2017-09-28 |
| US20210014422A1 (en) | 2021-01-14 |
| US10805542B2 (en) | 2020-10-13 |
| US10447929B2 (en) | 2019-10-15 |
| US20200007769A1 (en) | 2020-01-02 |
| CN105493496A (zh) | 2016-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2016095073A1 (zh) | 一种视频处理方法、装置及图像系统 | |
| WO2016209020A1 (en) | Image processing apparatus and image processing method | |
| WO2016049905A1 (zh) | 一种飞行任务处理方法、装置及系统 | |
| WO2016032292A1 (en) | Photographing method and electronic device | |
| WO2014148692A1 (en) | Display device and method for controlling the same | |
| WO2019027090A1 (ko) | 이동 단말기 및 그 제어 방법 | |
| EP3152912A1 (en) | Electronic device, control method thereof and system | |
| WO2016006946A1 (ko) | 증강현실 컨텐츠의 생성 및 재생 시스템과 이를 이용한 방법 | |
| WO2018090455A1 (zh) | 一种终端全景图像处理方法、装置及终端 | |
| WO2015016619A1 (en) | Electronic apparatus, method of controlling the same, and image reproducing apparatus and method | |
| WO2015020417A1 (en) | Method for displaying and an electronic device thereof | |
| WO2020054949A1 (en) | Electronic device and method for capturing view | |
| WO2020059925A1 (ko) | 이동 단말기 | |
| WO2017010628A1 (en) | Method and photographing apparatus for controlling function based on gesture of user | |
| WO2020101420A1 (ko) | 증강현실 기기의 광학 특성 측정 방법 및 장치 | |
| WO2017090833A1 (en) | Photographing device and method of controlling the same | |
| WO2017000313A1 (zh) | 图像处理系统、图像数据处理方法、装置及相关设备 | |
| WO2019194544A1 (en) | Method and system for handling 360 degree image content | |
| WO2015105372A1 (en) | Method and system for synchronizing usage information between device and server | |
| WO2015142137A1 (ko) | 전자 장치, 영상 처리 방법, 및 컴퓨터 판독가능 기록매체 | |
| WO2018074768A1 (ko) | 영상 표시 방법 및 그 전자장치 | |
| WO2016126083A1 (ko) | 주변 상황 정보를 통지하기 위한 방법, 전자 장치 및 저장 매체 | |
| WO2018093198A1 (en) | Image processing apparatus and control method thereof | |
| WO2016072538A1 (ko) | 유저 인터페이스를 통한 카메라 장치의 동작 방법 | |
| WO2022231180A1 (ko) | 전자 장치 및 전자 장치의 동작 방법 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| WWE | Wipo information: entry into national phase |
Ref document number: 201480031347.0 Country of ref document: CN |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14908108 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 14908108 Country of ref document: EP Kind code of ref document: A1 |