CN109379537A - Slide Zoom effect implementation method, device, electronic equipment and computer readable storage medium - Google Patents

Slide Zoom effect implementation method, device, electronic equipment and computer readable storage medium Download PDF

Info

Publication number
CN109379537A
CN109379537A CN201811644906.1A CN201811644906A CN109379537A CN 109379537 A CN109379537 A CN 109379537A CN 201811644906 A CN201811644906 A CN 201811644906A CN 109379537 A CN109379537 A CN 109379537A
Authority
CN
China
Prior art keywords
video image
frame video
contour
multiplying power
current frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811644906.1A
Other languages
Chinese (zh)
Inventor
邹启扬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Megvii Technology Co Ltd
Original Assignee
Beijing Megvii Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Megvii Technology Co Ltd filed Critical Beijing Megvii Technology Co Ltd
Priority to CN201811644906.1A priority Critical patent/CN109379537A/en
Publication of CN109379537A publication Critical patent/CN109379537A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals

Abstract

The present invention relates to technical field of image processing, more particularly to a kind of sliding Zoom effect implementation method, device, electronic equipment and computer readable storage medium, this method comprises: obtaining the objects' contour in current frame video image, scaling multiplying power is obtained according to the contour of object of current frame video image, the scaling multiplying power characterizes the variation ratio of the contour of object of current frame video image and the contour of object of history frame video image, and then current frame video image is zoomed in and out to obtain effect frame video image according to the scaling multiplying power, multiple effect frame video images are finally formed into sliding Zoom effect video.It can be seen that this programme can realize the effect of sliding zoom by being equipped with the electronic equipment an of camera or multiple cameras according to this method, not needing complicated device structure or post-processing can be obtained by sliding zoom video.

Description

Slide Zoom effect implementation method, device, electronic equipment and computer-readable storage Medium
Technical field
The present invention relates to technical field of image processing, in particular to a kind of sliding Zoom effect implementation method, dress It sets, electronic equipment and computer readable storage medium.
Background technique
The shooting of sliding zoom video has following several at present: one, for there is the camera of Zoom optic lens, pass through cunning The gimmick of rail, complicated mechanical structure or photographer control zoom according to moving distance, by moving process in moving process Match with zooming procedure;Two, zoom is not used simultaneously recording, and in later stage compilation by way of cutting out, guarantee mesh It is constant to mark article size.Three, by depth camera or 3D reconstruction technique separation front and back scape, keep prospect constant, background goes to carry out Have an X-rayed the simulation of variation.
The ratio between fixed object volumetric pixel height and the total pixel of photo in these methods need to compare to adjust optical zoom More complex bulky zoom lens and the mechanical structure or artificial control for more depending on zoom sliding rail;Based on separation front and back scape Mode, it is difficult to simulation really due to object distance change caused by transparent effect, and if main body be movement, separation front and back scape It is then difficult to reflect this activity.Therefore, realize that the means of sliding Zoom effect are extremely complex at present.
Summary of the invention
The purpose of the present invention is to provide a kind of sliding Zoom effect implementation methods, to realize that simpler means are realized Slide Zoom effect.
Another object of the present invention is to provide a kind of sliding Zoom effect realization devices, to realize with simpler hand Duan Shixian slides Zoom effect.
Another object of the present invention is to provide a kind of electronic equipment, realize that sliding becomes to realize with simpler means Burnt effect.
Another object of the present invention is to provide a kind of computer readable storage mediums, to realize with simpler means Realize sliding Zoom effect.
To achieve the goals above, technical solution used in the embodiment of the present invention is as follows:
In a first aspect, being applied to electronic equipment, institute the embodiment of the invention provides a kind of sliding Zoom effect implementation method It states and camera is installed on electronic equipment, which comprises obtain the objects' contour in current frame video image;According to The contour of object of the current frame video image obtains scaling multiplying power, and the scaling multiplying power characterizes the current frame video image The variation ratio of the contour of object of contour of object and history frame video image;By the current frame video image according to the scaling Multiplying power obtains effect frame video image, objects' contour and the history in the effect frame video image after zooming in and out The area of the contour of object of frame video image is identical;It is regarded based on multiple effect frame video images are obtained sliding Zoom effect Frequently.
Second aspect, the embodiment of the invention also provides a kind of sliding Zoom effect realization devices, are applied to electronic equipment, Camera is installed, described device includes: transceiver module, for obtaining the mesh in current frame video image on the electronic equipment Mark contour of object;Processing module, for obtaining scaling multiplying power, the scaling according to the contour of object of the current frame video image Multiplying power characterizes the variation ratio of the contour of object of the current frame video image and the contour of object of history frame video image;By institute State acquisition effect frame video image, the effect frame video figure after current frame video image is zoomed in and out according to the scaling multiplying power Objects' contour as in is identical as the area of contour of object of the history frame video image;Based on multiple effect frames Video image obtains sliding Zoom effect video.
The third aspect, the embodiment of the invention also provides a kind of electronic equipment, the electronic equipment includes memory, processing Device and at least one camera, for the camera for acquiring video, the memory is described for storing computer program Processor is used to execute the computer program being stored in the memory to realize the sliding Zoom effect implementation method.
Fourth aspect, the embodiment of the invention also provides a kind of computer readable storage mediums, are stored thereon with computer Program realizes the sliding Zoom effect implementation method when computer program is executed by processor.
A kind of sliding Zoom effect implementation method provided in an embodiment of the present invention, device, electronic equipment and computer-readable Storage medium, this method comprises: the objects' contour in current frame video image is obtained, according to the object of current frame video image Body profile obtains scaling multiplying power, which characterizes the contour of object of current frame video image and the object of history frame video image The variation ratio of body profile, and then current frame video image is zoomed in and out according to the scaling multiplying power to obtain effect frame video figure Multiple effect frame video images are finally formed sliding Zoom effect video by picture.It can be seen that this programme can be by being equipped with one The electronic equipment of a camera or multiple cameras realizes the effect of sliding zoom according to this method, does not need complicated equipment knot Structure or post-processing are obtained with sliding zoom video.
To enable the above objects, features and advantages of the present invention to be clearer and more comprehensible, preferred embodiment is cited below particularly, and cooperate Appended attached drawing, is described in detail below.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be to needed in the embodiment attached Figure is briefly described, it should be understood that the following drawings illustrates only certain embodiments of the present invention, therefore is not construed as pair The restriction of range for those of ordinary skill in the art without creative efforts, can also be according to this A little attached drawings obtain other relevant attached drawings.
Fig. 1 shows the structural schematic diagram of a kind of electronic equipment provided in an embodiment of the present invention.
Fig. 2 shows a kind of flow diagrams for sliding Zoom effect implementation method provided in an embodiment of the present invention.
Fig. 3 shows a kind of pair of target object photographed scene schematic diagram provided in an embodiment of the present invention.
Fig. 4 shows another kind provided in an embodiment of the present invention to target object photographed scene schematic diagram.
Fig. 5 shows a kind of process signal of sub-step for sliding Zoom effect implementation method provided in an embodiment of the present invention Figure.
Fig. 6 shows a kind of the functional block diagram for sliding Zoom effect realization device provided in an embodiment of the present invention.
Diagram: 100- electronic equipment;110- camera;120- memory;130- processor;140- communication unit;200- Slide Zoom effect realization device;210- transceiver module;220- processing module.
Specific embodiment
Below in conjunction with attached drawing in the embodiment of the present invention, technical solution in the embodiment of the present invention carries out clear, complete Ground description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.Usually exist The component of the embodiment of the present invention described and illustrated in attached drawing can be arranged and be designed with a variety of different configurations herein.Cause This, is not intended to limit claimed invention to the detailed description of the embodiment of the present invention provided in the accompanying drawings below Range, but it is merely representative of selected embodiment of the invention.Based on the embodiment of the present invention, those skilled in the art are not doing Every other embodiment obtained under the premise of creative work out, shall fall within the protection scope of the present invention.
It should also be noted that similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi It is defined in a attached drawing, does not then need that it is further defined and explained in subsequent attached drawing.Meanwhile of the invention In description, term " first ", " second " etc. are only used for distinguishing description, are not understood to indicate or imply relative importance.
Sliding zoom is a kind of video capture gimmick, i.e., camera carries out zoom close to or far from when shooting main body, to obtain Keep shooting main body position and size in picture constant, but background is constantly in the video data of variation.At present to realize The effect of sliding zoom needs the camera work personnel of profession to shoot using complicated specialized lens, or needs beauty Worker person obtains the general video data of acquisition by post-processing, and therefore, the shooting based on sliding Zoom effect is at present still It cannot be popularized on common electronic equipment.The embodiment of the present invention provides a kind of sliding Zoom effect implementation method as a result, By being synchronously analyzed and processed to image when user shoots, so that also may be implemented to slide on common electronic equipment The shooting of Zoom effect improves the shooting experience of user.
Fig. 1 is please referred to, is the partial structure diagram of a kind of electronic equipment 100 provided in an embodiment of the present invention, the electronics Equipment 100 includes but is not limited to the user equipmenies such as video camera, mobile phone, tablet computer, wearable device.The electronic equipment 100 includes Camera 110, memory 120, processor 130 and communication unit 140, optionally, the camera 110 can be taken the photograph for one As head or camera array, which may include multiple cameras with different optical properties, for example, different Camera has different focal ranges.And multiple cameras can be with one or more image processors (Image Signal Processor, referred to as: ISP) data connection, so that ISP handles image data.Optionally, the function of the ISP can be with It is integrated on processor 130, can also exist as individual devices, the present invention not limits independently of processor 130.With hand For machine, the camera or camera array can be the front camera or rear camera of mobile phone.
The memory 120, processor 130 and each element of communication unit 140 directly or indirectly electrically connect between each other It connects, to realize the transmission or interaction of data.For example, these elements can pass through one or more communication bus or signal between each other Line, which is realized, to be electrically connected.Processor 130 is for executing the executable module stored in memory 120, such as sliding Zoom effect Software function module and computer program that realization device includes etc..
Wherein, memory 120 may be, but not limited to, random access memory (Random Access Memory, RAM), read-only memory (Read Only Memory, ROM), programmable read only memory (Programmable Read-Only Memory, PROM), erasable read-only memory (Erasable Programmable Read-Only Memory, EPROM), Electricallyerasable ROM (EEROM) (Electric Erasable Programmable Read-Only Memory, EEPROM) etc.. Wherein, memory 120 is for storing program, and processor 130 executes described program after receiving and executing instruction.Communication unit 140 communicate to connect for being established by network, and for passing through network sending and receiving data.
Optionally, which can also be comprising other devices, such as battery, I/O interface, touch screen etc., herein Not limit.
Based on electronic equipment 100 shown in FIG. 1, the dynamic Zoom effect that a kind of electronic equipment 100 can execute is given below Implementation method, specifically, being a kind of process for sliding Zoom effect implementation method provided in an embodiment of the present invention referring to figure 2. Schematic diagram, this method comprises:
S110 obtains the objects' contour in current frame video image.
For example, user will hold the electronics and set when carrying out the video capture of sliding Zoom effect using electronic equipment 100 Standby 100 advance (from the distant to the near) or retreat relative to target object is shot (from the near to the distant), which can be full Sufficient user shoots all goods of demand, such as personage, animal.It as shown in Figures 3 and 4, is one kind provided in an embodiment of the present invention Target object photographed scene schematic diagram is equivalent to when user's hand-hold electronic equipments 100 advance relative to target object from figure The situation that 3 situation variation is Fig. 4, i.e., user's hand-hold electronic equipments 100 are at a distance from target object gradually close;When with When family hand-hold electronic equipments 100 are retreated relative to target object, it is equivalent to the situation for being Fig. 3 from the variation of the situation of Fig. 4, that is, is used Family hand-hold electronic equipments 100 are moving away from a distance from target object.While electronic equipment 100 obtains video data, Algorithm in the electronic equipment 100 will in real time be handled each frame video image, processing mode are as follows:
Firstly, the target object region of detection current frame video image, due to shooting obtained each frame video figure As not only including background but also including prospect, therefore target object region (i.e. prospect) is first extracted in whole video image, i.e., Region of interest (Region Of Interest, ROI).In turn, objects' contour is extracted to the target object region (Landmark)。
S120 obtains scaling multiplying power according to the contour of object of current frame video image, which characterizes present frame view The variation ratio of the contour of object of the contour of object and history frame video image of frequency image.
Specifically, since user is when carrying out video capture shot relative to target object forward or backward, Before handling each frame video image, background where the size and target object of the target object in the video image As the distance of user distance target object is gradually changing.In addition, the shooting effect of sliding zoom is to maintain object Body size and location does not change relatively, and the background where target object changes, therefore needs to obtain present frame video figure The variation ratio of the contour of object of the contour of object and history frame video image of picture, current frame video image to be adjusted. The history frame video image be acquisition time in the pervious video image of current frame video image, also i other words, the historical frames Video image includes video image of the multiframe before current video image acquisition.
Sliding Zoom effect implementation method provided in an embodiment of the present invention, by the object wheel for calculating current frame video image Scaling multiplying power of the exterior feature relative to history frame video image, can be obtained the size variation situation of current frame video image, with direct root Current frame video image is adjusted according to the scaling multiplying power, realizes sliding Zoom effect, is set without complicated shooting Standby or post-processing, realization rate are simpler.
Optionally, below for the scaling multiplying power of the current frame video image, a kind of possible implementation is provided, specifically , it is the son of another sliding Zoom effect implementation method provided in an embodiment of the present invention referring to figure 5. on the basis of Fig. 2 The flow diagram of step, the S120 include:
S120-1 selectes the auxiliary frame video image of predetermined frame number from history frame video image.
Specifically, the video image of predetermined frame number is selected from history frame video image, the selected video image definition To assist frame video image, which can be set according to actual needs.Under normal circumstances, the ancillary frame video figure As the first frame video image comprising video acquisition, and the multi-frame video image randomly selected.
S120-2 obtains the face of the objects' contour of each auxiliary frame video image according to N number of object key point respectively Long-pending and the objects' contour in current frame video image area.
Specifically, choosing N number of object key point on the objects' contour of current frame video image, such as 20 objects are closed Key point, the N can be the integer greater than 3, and the same area of the objects' contour in each auxiliary frame video image is same N number of object key point is chosen on ground, and since user is during photographic subjects object, the distance relative to target object is occurring Variation, therefore size of the target object in shooting picture is also changing, the area change of the target object can lead to The area that the multiple key points chosen surround is crossed to be embodied.
S120-3 successively compares the area of the objects' contour of current frame video image and the object of auxiliary frame video image The area of body profile obtains each corresponding size ratio.
Specifically, since auxiliary frame video image includes multiple, and then need to be crucial by the object in current frame video image The size that the size that point surrounds successively is surrounded with the object key point chosen in multiple auxiliary frame video images carries out Compare, to obtain each more corresponding size ratio, i.e., the objects' contour in current frame video image relative to The size variation ratio for the objects' contour in multiple auxiliary frame video images chosen.
S120-4 to multiple sizes variation ratio carries out that scaling times is calculated according to the weighted average rule determined Rate.
And then the multiple sizes variation ratio compared is weighted and averaged according to pre-defined rule and is scaled Multiplying power, the scaling multiplying power are mean change of the current frame video image relative to multiple auxiliary frame video images, the scaling times Rate is the target object in current frame video image relative to the ratio zoomed in or out before.
Further, in the shooting based on sliding Zoom effect, the position of target object is substantially constant relative to background, Or closely moved in a small range, therefore also need to analyze the change in location of target object.Specifically, analysis present frame view Change in location of the N number of key point chosen in frequency image relative to auxiliary frame video image, and then target object is adjusted to working as Within the scope of the predeterminated position of preceding frame video image, so that excessive change does not occur for the displacement of target object.
S130 obtains effect frame video image, the effect after zooming in and out current frame video image according to scaling multiplying power Objects' contour in frame video image is identical as the area of the contour of object of history frame video image.
Specifically, after the scaling multiplying power of the current frame video image is calculated, it will be according to the scaling multiplying power to present frame Video image zooms in and out to obtain effect frame video image.Such as when user shoots relative to target object advance, the mesh Marking size of the object in picture should be the process become larger, then the target object in current frame video image will be greater than Target object in history frame video image, scaling multiplying power at this time is certain multiple, such as 2 times, and then in order to guarantee target object Size in picture does not change, and synchronously amplifies whole picture current frame video image according to scaling multiplying power, i.e., 2 Times, whole picture current frame video image is contracted to size identical with history frame video image again later.
Alternatively, when user relative to target object retreat shoot when, size of the target object in picture should be by Decrescence small process, then the target object in current frame video image will be less than the target object in history frame video image, Scaling multiplying power is certain accounting at this time, such as 1/2, and then in order to guarantee that size of the target object in picture does not change, together Step ground reduces whole picture current frame video image according to scaling multiplying power, that is, is reduced into original 1/2, later again works as whole picture Preceding frame video image is amplified to size identical with history frame video image.
It should be noted that according to the image that zooms in and out of scaling multiplying power being effect frame video by current frame video image Image, the size and location of target object is probably consistent in the multiframe effect frame image, or only changes in a small range, should Background locating for target object is constantly changing.
S140 obtains sliding Zoom effect video based on multiple effect frame video images.
Specifically, will synchronously be handled each frame video image and be imitated during user shoots video Fruit frame video image, and then sliding zoom is can be obtained into multiframe effect frame video image sequential by the timing node of shooting Effect video.In addition, can also be after user carries out shooting completion, according to the above method to successively to each frame of entire video It is handled, obtains sliding Zoom effect video again later and uniformly show in user.
As another embodiment, multiple cameras 110 can also be installed on the electronic equipment 100 simultaneously, needed It is bright, a camera 110 is installed on the electronic equipment 100 or the multiple cameras 110 of installation can be according to above-mentioned method Process realizes the shooting effect of sliding Zoom effect, it is readily appreciated that, if the camera 110 installed on the electronic equipment 100 is got over More, shooting effect is more preferably.If installing single camera 110 on the electronic equipment 100, which be can be but not It is limited to, bugeye lens (Ultra), wide-angle lens (Wide) or telephoto lens (Tele), every kind of camera lens has different focal lengths With different lens coverages, can be applicable according to the far and near selection of distance objective object, such as when distance objective object is closer When, relatively it is suitable for bugeye lens and acquires video, when distance objective object is moderate, is relatively suitable for wide-angle lens and acquires video, When distance objective object is closer, relatively it is suitable for telephoto lens and acquires video.
If being equipped with multiple cameras 110, the camera being installed on electronic equipment 100 on the electronic equipment 100 110 can be the combination of bugeye lens and wide-angle lens, the combination of wide-angle lens and telephoto lens or bugeye lens, wide-angle The combination of camera lens and telephoto lens.The combination of the difference camera lens is applicable to the needs of different coverages, such as bugeye lens With the combination of wide-angle lens, if when the wide-angle lens be applicable in scaling multiplying power be 1-2 range, if be lower than the range, possibility Cause to be imaged it is unclear, and then if desired further acquisition clearly scaling multiplying power be lower than 1 image, wide-angle lens need to be switched For bugeye lens, to realize preferable shooting effect.
In other words, when scaling multiplying power is in the first preset range, control bugeye lens acquires video;When scaling multiplying power Value by the first preset range variation be the second preset range when, switch to wide-angle lens acquisition video;When taking for scaling multiplying power When value by the variation of the second preset range is third preset range, telephoto lens acquisition video, first preset range, the are switched to The corresponding scaling multiplying power of two preset ranges, third preset range is sequentially increased.Such as corresponding scaling multiplying power of first preset range For 0-1, the corresponding scaling multiplying power of second preset range is 1-2, and the corresponding scaling multiplying power of the third preset range is 2-3, into And when scaling multiplying power is in 0-1, control bugeye lens acquires video, when scaling multiplying power variation is 1-2, switches to wide-angle lens Head acquisition video switches to telephoto lens acquisition video, when scaling multiplying power variation is 2-3 with respective according to each camera lens Focal length and visual field coverage area are applicable in acquire the image being more clear.
As on the other hand, when the value for scaling multiplying power changes back the second preset range by third preset range, cut Gain wide-angle lens acquisition video;When the value of scaling multiplying power is the first preset range by the variation of the second preset range, switching Video is acquired to bugeye lens.
Further, when the camera 110 installed on electronic equipment 100 is camera array, due to the camera battle array Multiple cameras in column, there are alternate position spike, are not a continuous magnification lens, and then in its optics on space arrangement The heart is simultaneously misaligned, and there are the factors such as parallax to interfere imaging effect, therefore needs to carry out to take the photograph simultaneously operating more.It is asked in order to avoid above-mentioned Topic, in one possible implementation: in multiple cameras 110 of prior record installation any two camera 110 it Between relative distance and misalignment angle, and then according to difference distance and misalignment angle to the optics of multiple cameras 110 Center is corrected, so that the optical centre of multiple cameras 110 concentrates the seamless switching rank for a little guaranteeing camera 110 It connects.
Further, since during video record, due to the factors such as the hand-held movement of user, the shooting picture of electronic equipment 100 It will appear shake, it is therefore desirable to Video Stabilization processing be carried out to obtained video flowing, to prevent video jitter.I other words detection The jitter parameter of adjacent two frame video image guarantees that the public domain of adjacent two frame video image does not change, to prevent from trembling It is dynamic.Video flowing after being finally disposed then is final sliding Zoom effect video.
Below for being equipped with wide-angle lens and telephoto lens on electronic equipment 100, to being installed on electronic equipment 100 There are multiple cameras 110 to carry out the process of sliding Zoom effect video capture and be illustrated, stream is applied in combination in remaining camera lens Journey is similar.
First in distance objective object different distance, wide-angle lens is controlled respectively and telephoto lens acquires video image, To respectively obtain the video image (wide Preview) that wide-angle lens collects and the video figure that telephoto lens collects As (Tele Preview), and then each frame video image received in real time is analyzed and processed, and guarantees different cameras The 110 video image Time Continuous collected correspond to, i.e. frame synchronization (Frame Sync).
Pair it analyzes treatment process to each frame video image are as follows: extracts the target object in each frame video image, i.e., Each frame video image carries out area-of-interest detection (ROI Detection), and keeps track to the target object (ROITrcaking), it extracts the contour of object of the target object again later, and calculates present frame video according to the contour of object Scaling multiplying power (Zoom&Warp Coefficient Compute) of the image relative to history frame video image, and according to the contracting It puts multiplying power operation is zoomed in and out to entire current frame video image and obtain effect frame video image.It synchronously, will also be in real time to every Effect frame frame video image carries out Video Stabilization processing, i.e. stabilization processing (EIS), to obtain visual effect more stably image, Sliding Zoom effect video is can be obtained into according to time sequencing arrangement in multiple effect frame video images after being disposed.In turn It can be the video format that the electronic equipment 100 is supported by the sliding Zoom effect Video coding (Encoder), such as MP4 format, It is checked so that finally obtained sliding zoom video (Dolly Zoom Video) is shown in user.
It can be seen that a kind of sliding Zoom effect implementation method provided in an embodiment of the present invention, is set by common electronics Standby acquisition video data, and the scaling multiplying power of objects' contour is determined to each frame video image, according to the scaling multiplying power pair Each frame video image is adjusted to obtain effect frame video image, is finally arranged successively multiple effect frame video images i.e. Sliding Zoom effect video can be obtained, can be realized by simple electronic equipment, without complicated capture apparatus or later period Processing, has a wide range of application, and improves the shooting experience of user.
Fig. 6 is please referred to, is a kind of functional module for sliding Zoom effect realization device 200 provided in an embodiment of the present invention Schematic diagram, the device include transceiver module 210 and processing module 220, and the transceiver module 210 and processing module 220 can be by electronics Processor 130 in equipment 100 is realized.
Transceiver module 210, for obtaining the objects' contour in current frame video image.
In embodiments of the present invention, S110 can be executed by transceiver module 210.
Processing module 220, for obtaining scaling multiplying power, the scaling times according to the objects' contour of current frame video image Rate characterizes the variation ratio of the objects' contour of current frame video image and the contour of object of history frame video image;It will be current Frame video image obtains effect frame video image, the object in the effect frame video image after zooming in and out according to scaling multiplying power Body profile is identical as the area of the contour of object of history frame video image;Sliding zoom is obtained based on multiple effect frame video images Effect video.
In embodiments of the present invention, S120, S121-S124, S130 and S140 can be executed by processing module 220.
Due to having been described in sliding Zoom effect implementation method part, details are not described herein.
A kind of computer readable storage medium is further disclosed in the embodiment of the present invention, is stored thereon with computer program, it should The sliding Zoom effect implementation method that the embodiment of the present invention discloses is realized when computer program is executed by processor 130.
In conclusion a kind of sliding Zoom effect implementation method, device, electronic equipment and meter provided in an embodiment of the present invention Calculation machine readable storage medium storing program for executing, this method comprises: the objects' contour in current frame video image is obtained, according to present frame video The contour of object of image obtains scaling multiplying power, which characterizes the contour of object and historical frames video of current frame video image The variation ratio of the contour of object of image, and then current frame video image is zoomed in and out to obtain effect frame according to the scaling multiplying power Multiple effect frame video images are finally formed sliding Zoom effect video by video image.It can be seen that this programme can pass through peace Electronic equipment equipped with a camera or multiple cameras realizes the effect of sliding zoom according to this method, does not need complexity Device structure or post-processing can be obtained by sliding Zoom effect video.
In several embodiments provided herein, it should be understood that disclosed device and method can also pass through Other modes are realized.The apparatus embodiments described above are merely exemplary, for example, flow chart and block diagram in attached drawing Show the device of multiple embodiments according to the present invention, the architectural framework in the cards of method and computer program product, Function and operation.In this regard, each box in flowchart or block diagram can represent the one of a module, section or code Part, a part of the module, section or code, which includes that one or more is for implementing the specified logical function, to be held Row instruction.It should also be noted that function marked in the box can also be to be different from some implementations as replacement The sequence marked in attached drawing occurs.For example, two continuous boxes can actually be basically executed in parallel, they are sometimes It can execute in the opposite order, this depends on the function involved.It is also noted that every in block diagram and or flow chart The combination of box in a box and block diagram and or flow chart can use the dedicated base for executing defined function or movement It realizes, or can realize using a combination of dedicated hardware and computer instructions in the system of hardware.
In addition, each functional module in each embodiment of the present invention can integrate one independent portion of formation together Point, it is also possible to modules individualism, an independent part can also be integrated to form with two or more modules.
It, can be with if the function is realized and when sold or used as an independent product in the form of software function module It is stored in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially in other words The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a People's computer, server or network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention. And storage medium above-mentioned includes: that USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), arbitrary access are deposited The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic or disk.It needs Illustrate, herein, relational terms such as first and second and the like be used merely to by an entity or operation with Another entity or operation distinguish, and without necessarily requiring or implying between these entities or operation, there are any this realities The relationship or sequence on border.Moreover, the terms "include", "comprise" or its any other variant are intended to the packet of nonexcludability Contain, so that the process, method, article or equipment for including a series of elements not only includes those elements, but also including Other elements that are not explicitly listed, or further include for elements inherent to such a process, method, article, or device. In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including the element Process, method, article or equipment in there is also other identical elements.
The foregoing is only a preferred embodiment of the present invention, is not intended to restrict the invention, for the skill of this field For art personnel, the invention may be variously modified and varied.All within the spirits and principles of the present invention, made any to repair Change, equivalent replacement, improvement etc., should all be included in the protection scope of the present invention.It should also be noted that similar label and letter exist Similar terms are indicated in following attached drawing, therefore, once being defined in a certain Xiang Yi attached drawing, are then not required in subsequent attached drawing It is further defined and explained.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain Lid is within protection scope of the present invention.Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (10)

1. a kind of sliding Zoom effect implementation method is applied to electronic equipment, is equipped with camera on the electronic equipment, special Sign is, which comprises
Obtain the objects' contour in current frame video image;
Scaling multiplying power is obtained according to the objects' contour of the current frame video image, the scaling multiplying power characterization is described current The variation ratio of the contour of object of the objects' contour and history frame video image of frame video image;
Effect frame video image, the effect are obtained after the current frame video image is zoomed in and out according to the scaling multiplying power Objects' contour in frame video image is identical as the area of contour of object of the history frame video image;
Sliding Zoom effect video is obtained based on multiple effect frame video images.
2. the method as described in claim 1, which is characterized in that the target object wheel according to the current frame video image Exterior feature obtains scaling multiplying power, and the scaling multiplying power characterizes the objects' contour and historical frames video figure of the current frame video image The step of variation ratio of the contour of object of picture includes:
The auxiliary frame video image of predetermined frame number is selected from history frame video image;
According to N number of object key point, obtain respectively the objects' contour of each auxiliary frame video image area and The area of objects' contour in the current frame video image;
The successively object of the area of the objects' contour of the current frame video image and the auxiliary frame video image The area of profile obtains each corresponding size and changes ratio;
Multiple sizes variation ratio is carried out that the scaling multiplying power is calculated according to scheduled weighted average rule.
3. method according to claim 2, which is characterized in that the method also includes:
Determine that the position in current frame video image and the auxiliary frame video image becomes according to N number of object key point Change;
The target object is adjusted to the predeterminated position of the current frame video image.
4. the method as described in claim 1, which is characterized in that when being equipped with multiple cameras on the electronic equipment, institute State the combination or ultra-wide angle of combination, wide-angle lens and telephoto lens that multiple cameras include bugeye lens and wide-angle lens The combination of camera lens, wide-angle lens and telephoto lens, the method also includes:
When the scaling multiplying power is in the first preset range, control bugeye lens acquires video, and the video includes described current Frame video image and the history frame video image;
When the value of the scaling multiplying power is the second preset range by the variation of the first preset range, wide-angle lens acquisition is switched to Video;
When the value of the scaling multiplying power is third preset range by the variation of the second preset range, telephoto lens acquisition is switched to Video;
When the value of the scaling multiplying power is the second preset range by the variation of third preset range, wide-angle lens acquisition is switched to Video;
When the value of the scaling multiplying power is the first preset range by the variation of the second preset range, switches to bugeye lens and adopt Collect video;
First preset range, the second preset range, third preset range are sequentially increased.
5. method as claimed in claim 4, which is characterized in that the method also includes:
Record the relative distance and misalignment angle in the multiple camera between any two camera;
The optical centre of the multiple camera is corrected according to the relative distance and misalignment angle.
6. the method as described in claim 1, which is characterized in that the method also includes:
Video Stabilization processing is carried out to the sliding Zoom effect video.
7. a kind of sliding Zoom effect realization device is applied to electronic equipment, is equipped with camera on the electronic equipment, special Sign is that described device includes:
Transceiver module, for obtaining the objects' contour in current frame video image;
Processing module, for obtaining scaling multiplying power, the scaling times according to the objects' contour of the current frame video image Rate characterizes the variation ratio of the objects' contour of the current frame video image and the contour of object of history frame video image;
Effect frame video image, the effect are obtained after the current frame video image is zoomed in and out according to the scaling multiplying power Objects' contour in frame video image is identical as the area of contour of object of the history frame video image;
Sliding Zoom effect video is obtained based on multiple effect frame video images.
8. device as claimed in claim 7, which is characterized in that the processing module is also used to:
The auxiliary frame video image of predetermined frame number is selected from history frame video image;
According to N number of object key point, obtain respectively the objects' contour of each auxiliary frame video image area and The area of objects' contour in the current frame video image;
The successively object of the area of the objects' contour of the current frame video image and the auxiliary frame video image The area of profile obtains each corresponding size and changes ratio;
Multiple sizes variation ratio is carried out that the scaling multiplying power is calculated according to scheduled weighted average rule.
9. a kind of electronic equipment, which is characterized in that the electronic equipment includes memory, processor and at least one camera shooting Head, the camera is for acquiring video, and the memory is for storing computer program, and the processor is for executing storage Computer program in the memory is to realize sliding Zoom effect realization side as claimed in any one of claims 1 to 6 Method.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program Sliding Zoom effect implementation method as claimed in any one of claims 1 to 6 is realized when being executed by processor.
CN201811644906.1A 2018-12-30 2018-12-30 Slide Zoom effect implementation method, device, electronic equipment and computer readable storage medium Pending CN109379537A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811644906.1A CN109379537A (en) 2018-12-30 2018-12-30 Slide Zoom effect implementation method, device, electronic equipment and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811644906.1A CN109379537A (en) 2018-12-30 2018-12-30 Slide Zoom effect implementation method, device, electronic equipment and computer readable storage medium

Publications (1)

Publication Number Publication Date
CN109379537A true CN109379537A (en) 2019-02-22

Family

ID=65372033

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811644906.1A Pending CN109379537A (en) 2018-12-30 2018-12-30 Slide Zoom effect implementation method, device, electronic equipment and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN109379537A (en)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110262737A (en) * 2019-06-25 2019-09-20 维沃移动通信有限公司 A kind of processing method and terminal of video data
CN110536057A (en) * 2019-08-30 2019-12-03 Oppo广东移动通信有限公司 Image processing method and device, electronic equipment, computer readable storage medium
CN110611767A (en) * 2019-09-25 2019-12-24 北京迈格威科技有限公司 Image processing method and device and electronic equipment
CN110651466A (en) * 2018-05-31 2020-01-03 深圳市大疆创新科技有限公司 Shooting control method and device for movable platform
CN110751731A (en) * 2019-10-16 2020-02-04 光沦科技(深圳)有限公司 3D reconstruction method and system for structured light
CN111083380A (en) * 2019-12-31 2020-04-28 维沃移动通信有限公司 Video processing method, electronic equipment and storage medium
CN111935398A (en) * 2020-07-07 2020-11-13 北京迈格威科技有限公司 Image processing method and device, electronic equipment and computer readable medium
CN111970438A (en) * 2020-08-03 2020-11-20 Oppo广东移动通信有限公司 Zoom processing method and device, equipment and storage medium
CN112087579A (en) * 2020-09-17 2020-12-15 维沃移动通信有限公司 Video shooting method and device and electronic equipment
CN112365398A (en) * 2020-09-11 2021-02-12 成都旷视金智科技有限公司 Super-resolution network training method, digital zooming method, device and electronic equipment
CN113438508A (en) * 2021-06-23 2021-09-24 北京蜂巢世纪科技有限公司 Video data processing method, device, equipment, medium and program product
CN113747085A (en) * 2020-05-30 2021-12-03 华为技术有限公司 Method and device for shooting video
CN113923486A (en) * 2021-11-12 2022-01-11 北京中联合超高清协同技术中心有限公司 Pre-generated multi-stream ultrahigh-definition video playing system and method
CN113949808A (en) * 2020-07-17 2022-01-18 北京字节跳动网络技术有限公司 Video generation method and device, readable medium and electronic equipment
CN114286003A (en) * 2021-12-28 2022-04-05 维沃移动通信有限公司 Shooting method, shooting device and electronic equipment
CN114697517A (en) * 2020-12-28 2022-07-01 北京小米移动软件有限公司 Video processing method and device, terminal equipment and storage medium
CN114827433A (en) * 2021-01-27 2022-07-29 北京小米移动软件有限公司 Image processing method and device, electronic device and storage medium
EP4037306A1 (en) * 2021-01-27 2022-08-03 Beijing Xiaomi Mobile Software Co., Ltd. Image processing method, apparatus, electronic device and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102694969A (en) * 2011-03-25 2012-09-26 奥林巴斯映像株式会社 Image processing device and image processing method
US20150268666A1 (en) * 2013-07-31 2015-09-24 SZ DJI Technology Co., Ltd Remote control method and terminal
CN105027167A (en) * 2013-02-28 2015-11-04 诺基亚技术有限公司 Method and apparatus for automatically rendering dolly zoom effect
CN105306790A (en) * 2014-07-22 2016-02-03 西安司坤电子科技有限公司 Portable digital camera
CN107392850A (en) * 2017-06-30 2017-11-24 联想(北京)有限公司 Image processing method and its system
CN108234879A (en) * 2018-02-02 2018-06-29 成都西纬科技有限公司 It is a kind of to obtain the method and apparatus for sliding zoom video
CN108702456A (en) * 2017-11-30 2018-10-23 深圳市大疆创新科技有限公司 A kind of focusing method, equipment and readable storage medium storing program for executing

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102694969A (en) * 2011-03-25 2012-09-26 奥林巴斯映像株式会社 Image processing device and image processing method
CN105027167A (en) * 2013-02-28 2015-11-04 诺基亚技术有限公司 Method and apparatus for automatically rendering dolly zoom effect
US20150268666A1 (en) * 2013-07-31 2015-09-24 SZ DJI Technology Co., Ltd Remote control method and terminal
CN105306790A (en) * 2014-07-22 2016-02-03 西安司坤电子科技有限公司 Portable digital camera
CN107392850A (en) * 2017-06-30 2017-11-24 联想(北京)有限公司 Image processing method and its system
CN108702456A (en) * 2017-11-30 2018-10-23 深圳市大疆创新科技有限公司 A kind of focusing method, equipment and readable storage medium storing program for executing
CN108234879A (en) * 2018-02-02 2018-06-29 成都西纬科技有限公司 It is a kind of to obtain the method and apparatus for sliding zoom video

Cited By (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110651466A (en) * 2018-05-31 2020-01-03 深圳市大疆创新科技有限公司 Shooting control method and device for movable platform
CN110262737A (en) * 2019-06-25 2019-09-20 维沃移动通信有限公司 A kind of processing method and terminal of video data
CN110536057A (en) * 2019-08-30 2019-12-03 Oppo广东移动通信有限公司 Image processing method and device, electronic equipment, computer readable storage medium
CN110536057B (en) * 2019-08-30 2021-06-08 Oppo广东移动通信有限公司 Image processing method and device, electronic equipment and computer readable storage medium
CN110611767A (en) * 2019-09-25 2019-12-24 北京迈格威科技有限公司 Image processing method and device and electronic equipment
CN110611767B (en) * 2019-09-25 2021-08-10 北京迈格威科技有限公司 Image processing method and device and electronic equipment
CN110751731A (en) * 2019-10-16 2020-02-04 光沦科技(深圳)有限公司 3D reconstruction method and system for structured light
CN110751731B (en) * 2019-10-16 2023-03-24 光沦科技(深圳)有限公司 3D reconstruction method and system for structured light
CN111083380A (en) * 2019-12-31 2020-04-28 维沃移动通信有限公司 Video processing method, electronic equipment and storage medium
CN111083380B (en) * 2019-12-31 2021-06-11 维沃移动通信有限公司 Video processing method, electronic equipment and storage medium
CN113747085A (en) * 2020-05-30 2021-12-03 华为技术有限公司 Method and device for shooting video
CN113747085B (en) * 2020-05-30 2023-01-06 华为技术有限公司 Method and device for shooting video
WO2022062318A1 (en) * 2020-05-30 2022-03-31 华为技术有限公司 Photographing method and device
CN113747050A (en) * 2020-05-30 2021-12-03 华为技术有限公司 Shooting method and equipment
CN111935398A (en) * 2020-07-07 2020-11-13 北京迈格威科技有限公司 Image processing method and device, electronic equipment and computer readable medium
US11836887B2 (en) 2020-07-17 2023-12-05 Beijing Bytedance Network Technology Co., Ltd. Video generation method and apparatus, and readable medium and electronic device
CN113949808A (en) * 2020-07-17 2022-01-18 北京字节跳动网络技术有限公司 Video generation method and device, readable medium and electronic equipment
WO2022012231A1 (en) * 2020-07-17 2022-01-20 北京字节跳动网络技术有限公司 Video generation method and apparatus, and readable medium and electronic device
CN113949808B (en) * 2020-07-17 2022-12-27 北京字节跳动网络技术有限公司 Video generation method and device, readable medium and electronic equipment
CN111970438B (en) * 2020-08-03 2022-06-28 Oppo广东移动通信有限公司 Zoom processing method and device, equipment and storage medium
CN111970438A (en) * 2020-08-03 2020-11-20 Oppo广东移动通信有限公司 Zoom processing method and device, equipment and storage medium
CN112365398B (en) * 2020-09-11 2024-04-05 成都旷视金智科技有限公司 Super-resolution network training method, digital zooming method, device and electronic equipment
CN112365398A (en) * 2020-09-11 2021-02-12 成都旷视金智科技有限公司 Super-resolution network training method, digital zooming method, device and electronic equipment
CN112087579A (en) * 2020-09-17 2020-12-15 维沃移动通信有限公司 Video shooting method and device and electronic equipment
CN114697517A (en) * 2020-12-28 2022-07-01 北京小米移动软件有限公司 Video processing method and device, terminal equipment and storage medium
CN114827433A (en) * 2021-01-27 2022-07-29 北京小米移动软件有限公司 Image processing method and device, electronic device and storage medium
EP4037306A1 (en) * 2021-01-27 2022-08-03 Beijing Xiaomi Mobile Software Co., Ltd. Image processing method, apparatus, electronic device and storage medium
US11800041B2 (en) 2021-01-27 2023-10-24 Beijing Xiaomi Mobile Software Co., Ltd. Image processing method and apparatus, electronic device, and storage medium
US11856312B2 (en) 2021-01-27 2023-12-26 Beijing Xiaomi Mobile Software Co., Ltd. Image processing method, apparatus, electronic device and storage medium
CN113438508B (en) * 2021-06-23 2022-07-01 北京蜂巢世纪科技有限公司 Video data processing method, device, equipment, medium and program product
CN113438508A (en) * 2021-06-23 2021-09-24 北京蜂巢世纪科技有限公司 Video data processing method, device, equipment, medium and program product
CN113923486B (en) * 2021-11-12 2023-11-07 北京中联合超高清协同技术中心有限公司 Pre-generated multi-stream ultra-high definition video playing system and method
CN113923486A (en) * 2021-11-12 2022-01-11 北京中联合超高清协同技术中心有限公司 Pre-generated multi-stream ultrahigh-definition video playing system and method
CN114286003A (en) * 2021-12-28 2022-04-05 维沃移动通信有限公司 Shooting method, shooting device and electronic equipment

Similar Documents

Publication Publication Date Title
CN109379537A (en) Slide Zoom effect implementation method, device, electronic equipment and computer readable storage medium
CN103988227B (en) The method and apparatus locked for image capturing target
CN107509037B (en) The method and terminal taken pictures using different field angle cameras
US9013477B2 (en) Method and system for producing a virtual output image from data obtained by an array of image capturing devices
US20140267618A1 (en) Capturing and Refocusing Imagery
CN103795934B (en) A kind of image processing method and electronic equipment
CN104159027B (en) A kind of method and device according to picture pace of change automatic camera
CN103795933B (en) A kind of image processing method and electronic equipment
JP6257285B2 (en) Compound eye imaging device
US20130113962A1 (en) Image processing method for producing background blurred image and image capturing device thereof
CN112887609B (en) Shooting method and device, electronic equipment and storage medium
CN108305223B (en) Image background blurring processing method and device
CN109791558B (en) Automatic selection of micro-images
JP2017055231A (en) Image processing apparatus, solid state image sensor, and electronic apparatus
CN111756996A (en) Video processing method, video processing apparatus, electronic device, and computer-readable storage medium
CN106791456A (en) A kind of photographic method and electronic equipment
CN112598628A (en) Image occlusion detection method and device, shooting equipment and medium
JP2012195797A (en) Pan-focus image generating device
KR102003460B1 (en) Device and Method for dewobbling
JP2021072081A (en) Image processing model training method, device, and medium
CN101472064A (en) Filming system and method for processing scene depth
CN110336948A (en) A kind of method, apparatus, storage medium and electronic device that presumptive area focuses
CN112449117B (en) Focusing step length determining method and device, storage medium and electronic device
CN106056532A (en) Method and device of removing background images
CN107392850B (en) Image processing method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190222