CN106507094B - Correct the method and device of panoramic video display view angle - Google Patents
Correct the method and device of panoramic video display view angle Download PDFInfo
- Publication number
- CN106507094B CN106507094B CN201610930116.4A CN201610930116A CN106507094B CN 106507094 B CN106507094 B CN 106507094B CN 201610930116 A CN201610930116 A CN 201610930116A CN 106507094 B CN106507094 B CN 106507094B
- Authority
- CN
- China
- Prior art keywords
- attitude angle
- panoramic
- panoramic picture
- picture
- display body
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/327—Calibration thereof
Abstract
The invention discloses a kind of method and devices for correcting panoramic video display view angle, and the method includes obtaining panoramic video and the corresponding attitude angle data sequence of panoramic video；For each frame panoramic picture of panoramic video, panoramic picture is attached to the surface of scheduled three-dimension geometry solid, obtains panorama display body, and finds out the corresponding attitude angle of panoramic picture from attitude angle data sequence；It is rotated according to panorama display body of the attitude angle found to panoramic picture, is rotated with eliminating image caused by shooting is shaken.The present invention can will pan video when picture weave, shake or the rotation etc. that generate balance out, so that the video pictures played is remained the viewing experience for steadily increasing viewer.
Description
Technical field
The present invention relates to virtual reality technology, espespecially a kind of method and device for correcting panoramic video display view angle.
Background technique
Pan-shot can shoot the video of 360 degree of left and right or more in camera site, allow viewer to have a kind of on the spot in person
Feeling.In the prior art, panorama shooting device acquires external image by two fish eye lenses or multiple wide-angle lens, then
Spliced by algorithm, forms panoramic video.
During carrying out actual photographed, especially under motion state, capture apparatus can occur some shakings or tremble
Dynamic, this results in the video for shooting to show that identical shaking or shake can occur for picture in display, causes the picture played
Face is unstable, and the viewing experience of viewer substantially reduces.
Summary of the invention
In order to solve the above-mentioned technical problem, this application provides a kind of methods and dress for correcting panoramic video display view angle
It sets, the undesirable picture weave introduced in shooting process due to capture apparatus shaking can be eliminated.
In order to reach the object of the invention, the present invention provides a kind of methods for correcting panoramic video display view angle, comprising:
Obtain panoramic video and the corresponding attitude angle data sequence of panoramic video；
For each frame panoramic picture of panoramic video, panoramic picture is attached to the surface of scheduled three-dimension geometry solid,
Panorama display body is obtained, and finds out the corresponding attitude angle of panoramic picture from the attitude angle data sequence；
It is rotated according to panorama display body of the attitude angle found to panoramic picture, to eliminate caused by shooting shaking
Image rotation.
The present invention also provides a kind of devices for correcting panoramic video display view angle, comprising:
One acquiring unit, for obtaining panoramic video and the corresponding attitude angle data sequence of panoramic video；
Panoramic picture is attached to scheduled three-dimensional for being directed to each frame panoramic picture of panoramic video by one panorama unit
The surface of geometrical body obtains panorama display body；
One searching unit, for finding out the corresponding attitude angle of panoramic picture from the attitude angle data sequence；
One correction unit, for being rotated according to the attitude angle found to the panorama display body of panoramic picture, to disappear
Image caused by shaking except shooting rotates.
Compared with prior art, the present invention includes obtaining panoramic video and the corresponding attitude angle data sequence of panoramic video
Column；For each frame panoramic picture of panoramic video, panoramic picture is attached to the surface of scheduled three-dimension geometry solid, is obtained complete
Scape display body, and the corresponding attitude angle of panoramic picture is found out from attitude angle data sequence；According to the attitude angle pair found
The panorama display body of panoramic picture is rotated, and is rotated with eliminating image caused by shooting is shaken.The present invention can be complete by shooting
Picture weave, shake or rotation for generating when scape video etc. balance out, and remain the video pictures played steadily, increase
The viewing experience of viewer.
Other features and advantages of the present invention will be illustrated in the following description, also, partly becomes from specification
It obtains it is clear that understand through the implementation of the invention.The objectives and other advantages of the invention can be by specification, right
Specifically noted structure is achieved and obtained in claim and attached drawing.
Detailed description of the invention
Attached drawing is used to provide to further understand technical solution of the present invention, and constitutes part of specification, with this
The embodiment of application technical solution for explaining the present invention together, does not constitute the limitation to technical solution of the present invention.
Fig. 1 is the flow chart of the method for the correction panoramic video display view angle of the application；
Fig. 2 is the architecture diagram of the device of the correction panoramic video display view angle of the application.
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention clearer, below in conjunction with attached drawing to the present invention
Embodiment be described in detail.It should be noted that in the absence of conflict, in the embodiment and embodiment in the application
Feature can mutual any combination.
Step shown in the flowchart of the accompanying drawings can be in a computer system such as a set of computer executable instructions
It executes.Also, although logical order is shown in flow charts, and it in some cases, can be to be different from herein suitable
Sequence executes shown or described step.
In the prior art, influence of capture apparatus during panning video due to actual photographed scene can occur
Shake or situations such as shake, this picture of panoramic video for resulting in shooting to obtain can exist shaking identical with capture apparatus or
Shake, so that picture is unstable, in playing panoramic video, the shaking or shake of this picture can even make viewer generate dizziness,
Greatly reduce the viewing experience of viewer.
In the application in view of capture apparatus attitude transducer can in real time records photographing equipment in the video that pans
When attitude angle therefore when obtaining panoramic video, also get the corresponding attitude angle data sequence of panoramic video simultaneously.Appearance
Comprising the corresponding attitude angle of panoramic picture in panoramic video in state angular data sequence, panoramic picture is attached to again later scheduled
The surface of three-dimension geometry solid obtains panorama display body, rotates further according to the attitude angle of panoramic picture to panorama display body.
Due to posture when the corresponding attitude angle of panoramic picture can characterize shooting video capture panoramic picture, that is, characterization capture apparatus
The degree for whether shaking and shaking in photographing panorama picture, according to the attitude angle of panoramic picture to panorama display body into
Row rotation when can eliminate photographing panorama picture the image as caused by the shaking of capture apparatus shake, enable panoramic video
Frame stabilization show.
As shown in Figure 1, the method for the correction panoramic video display view angle that one embodiment of the application provides, comprising:
Step 101: obtaining panoramic video and the corresponding attitude angle data sequence of panoramic video；
Step 102: for each frame panoramic picture of panoramic video, panoramic picture being attached to scheduled three-dimension geometry solid
Surface, obtain panorama display body, and the corresponding attitude angle of panoramic picture is found out from attitude angle data sequence；
Step 103: being rotated according to panorama display body of the attitude angle found to panoramic picture, shaken with eliminating shooting
Image caused by dynamic rotates.
The method of the correction panoramic video display view angle of the application can be applied to shoot panorama camera, moving camera etc.
The panoramic video correction display visual angle of equipment shooting is also possible to shoot cinerama, panorama animation etc. by professional equipment and make
Panorama content correction display visual angle of work etc..Panoramic video either collected Video coding save video file with
For playing, being also possible to collected real-time video processing and being broadcast live away later.
The method of the correction panoramic video display view angle of the application, which can be applied, shows the display equipment such as equipment in mobile phone, head
In, the correction to panoramic video display view angle is realized when showing panoramic video by display equipment.It can also apply in panorama phase
In the capture apparatus such as machine, moving camera, after capture apparatus shoots to obtain panoramic video i.e. to the display view angle of panoramic video into
Row correction so that the subsequent display equipment for acquiring panoramic video can directly display out it is calibrated after panoramic video.Certainly,
It equally also can be applied in the professional video equipment of panorama content, the display of panoramic video regarded during post-processing
Angle is corrected.
Firstly, the problem of picture shakiness caused by panoramic video is given in shaking, the shake etc. when in order to eliminate as shooting, need
Get panoramic video and the corresponding attitude angle data sequence of panoramic video.For example, passing through the application on the display device
Method correction display visual angle when, for capture apparatus shooting panoramic video, display equipment can directly be obtained from capture apparatus
Take panoramic video and corresponding attitude angle data sequence.It, can be from capture apparatus when correcting display view angle on capture apparatus
Image acquisition units obtain shooting panoramic video, from the attitude transducer of capture apparatus obtain attitude angle data sequence.
The attitude angle of each frame panoramic picture in attitude angle data sequence comprising panoramic video.Capture apparatus is complete in shooting
During scape video, acquisition attitude angle in real time can be sensed by posture, is recorded as carrying out according to the acquisition moment or frame number etc.
The attitude angle data sequence of index, attitude angle data sequence can be saved together with panoramic video or individually be transmitted by network.
Attitude transducer include but is not limited to gravity sensor, acceleration transducer, gyro sensor and they
Any combination.Attitude transducer can be built in inside capture apparatus, can also pass through conducting wire rigid-connecting device and capture apparatus phase
Connection, allows its collected attitude angle to reflect the attitude angle of capture apparatus in real time.
The form of attitude angle can be intended to indicate that any mathematical of three-dimensional space rotation transformation indicates, including but not limited to
Spin matrix, quaternary number, Eulerian angles etc. are also possible to the form that original angular speed or acceleration add time information.Appearance
The method that state angle transducer obtains attitude angle, includes the necessary working process to initial data, is allowed to become any one
It can be used to indicate that the data under the mathematical form of three-dimensional space rotation transformation.
As described above, can be carried out by the acquisition moment or frame number of attitude angle to attitude angle in attitude angle data sequence
Index, so that according to index corresponding attitude angle can be searched for panoramic picture.The acquisition moment of attitude angle is equal to attitude angle
The shooting time of corresponding panoramic picture, that is, the timestamp of panoramic picture, by timestamp can set up attitude angle with
The corresponding relationship of panoramic picture.Frame number is the unique identification of panoramic picture, be can recognize that by frame number every in panoramic video
One frame panoramic picture.Using frame number as the index of attitude angle, the corresponding relationship of panoramic picture and attitude angle can be equally set up.
The preservation of attitude angle data sequence or transmission mode are not limited to using attitude angle data sequence as individual number
Factually body is saved or is transmitted, such as is saved into independent disk file, but also includes direct in the form of additional data
Add the mode in panoramic video data itself.For example, attitude angle data can be converted to text, in the subtitle of video file
Corresponding to the above-mentioned text of addition at the acquisition moment of the attitude angle as caption information in channel.It is any can by attitude angle with adopt
The method that the corresponding relationship at collection moment is recorded and saved or transmitted can be seen as saving and transmitting the side of attitude angle data sequence
Method, the application do not limit concrete mode.
Secondly, after getting panoramic video and corresponding attitude angle data sequence, for each frame of panoramic video
Panoramic picture is attached to the surface of scheduled three-dimension geometry solid by panoramic picture, obtains panorama display body.In order to pass through rotation
The problem for turning video pictures shakiness caused by eliminating shooting shaking, whether realizes this Shen in display equipment or capture apparatus
Method please is required to for each frame panoramic picture of panoramic video to be attached to the surface of scheduled three geometrical bodies, obtains complete
The panorama display body of scape image, then panorama display body is rotated accordingly.
It certainly, is display aphorama by the surface that panoramic picture is attached to scheduled three geometrical bodies for showing equipment
One of step of frequency.Display equipment is getting panoramic video and corresponding attitude angle data by storage medium or network
After sequence, panoramic video is decoded, obtains the panoramic image sequence of composition panoramic video, then panoramic picture is attached to predetermined
Three-dimension geometry solid surface, obtain panorama display body.For panorama display body, then by the virtual camera direction in imagination
Panorama display body is mapped as two dimensional image according to certain projective transformation, is achieved that the display of panorama content by panorama display body.
Above-mentioned projective transformation includes but is not limited to perspective transform, orthogonal projection transformation etc..Above-mentioned scheduled three-dimension geometry solid include but
It is not limited to sphere, cube, trigone cone etc..
In the application, after obtaining the panorama display body of panoramic picture, need to find out from attitude angle data sequence complete
The corresponding attitude angle of scape image, to be rotated according to the attitude angle found to the panorama display body of panoramic picture, thus
Eliminate shooting shake bring float.
As described above, being using the timestamp of panoramic picture or frame number as the rope of attitude angle in attitude angle data sequence
Draw, it therefore, can be by the timestamp of panoramic picture or frame number in appearance when searching corresponding attitude angle for each frame panoramic picture
It is matched in state angular data sequence, attitude angle corresponding to the identical timestamp or frame number being matched to is panoramic picture pair
The attitude angle answered.
It again, in the panorama display body for obtaining panoramic picture, and is after panoramic picture finds corresponding attitude angle, so that it may
To be rotated according to the attitude angle found to the panorama display body of panoramic picture, turned with eliminating image caused by shooting is shaken
It is dynamic.
Attitude angle in the application in attitude angle data sequence is either the attitude angle transducer of capture apparatus is being shot
The attitude angle of collected capture apparatus when equipment photographing panorama picture is also possible to the attitude angle of capture apparatus relative to benchmark
The rotationally-varying amount of attitude angle.
If attitude angle when what is recorded in attitude angle data sequence is capture apparatus photographing panorama picture, to complete
When the panorama display body of scape image is rotated, need to calculate the corresponding attitude angle of panoramic picture first relative to reference attitude
The rotationally-varying amount at angle carries out the panorama display body of panoramic picture and capture apparatus is being shot according still further to the rotationally-varying amount
Identical rotation is rotated when the frame panoramic picture, achievees the purpose that eliminating image shakes.
For panoramic video, on the surface that panoramic picture is attached to scheduled three-dimension geometry solid after, shown on screen
Be virtual camera centered on the centre of sphere of panorama display body, the collected picture in panorama display body.For not according to
The case where method in the application rotates panorama display body according to the corresponding attitude angle of panoramic picture, due to complete in shooting
When scape image, the shooting visual angle of capture apparatus is shaken, this is resulted in display, and virtual camera acquisition image also can
It shakes, causes the angle of view of display to change, picture is unstable.In the present processes, panorama display body is carried out and is clapped
Taking the photograph the identical rotation of shaking still is able to virtual camera according to complete with former frame in the case where virtual camera is constant
The identical visual angle of scape image acquires image, to eliminate, since shooting is shaken, bring display view angle changes and display picture shakes
It is dynamic.
Said reference attitude angle can be capture apparatus start to pan video when attitude angle.The shape at reference attitude angle
Any one can be used for table made of the attitude angle data that formula can be video capture start time is converted by necessary processing
Show the mathematical form of three-dimensional space rotation transformation.The rotationally-varying amount of panoramic picture is the corresponding attitude angle of panoramic picture and benchmark
The difference result of attitude angle.
If recorded in attitude angle data sequence be shoot the panoramic picture when capture apparatus attitude angle relative to
The rotationally-varying amount at reference attitude angle then needs after the attitude angle for collecting each frame panoramic picture, i.e., to panoramic picture
Difference is done at attitude angle and reference attitude angle, obtains rotationally-varying amount, and by the corresponding rotationally-varying amount of each frame panoramic picture with
The timestamp or frame number of panoramic picture generate attitude angle data sequence.
In this case, it when being rotated according to panorama display body of the attitude angle to panoramic picture, can directly press
According to the corresponding attitude angle of panoramic picture found from attitude angle data sequence, to the panorama display body of panoramic picture carry out with
Capture apparatus rotates identical rotation when shooting the frame panoramic picture, eliminates since bring display view is shaken in shooting
Angle changes and display picture weave.
The attitude angle of capture apparatus is relative to the rotationally-varying of reference attitude angle when rotationally-varying amount is photographing panorama picture
Amount makes it make to acquire the frame with capture apparatus on the rotationally-varying three-dimension geometry solid being attached to applied to panoramic picture
Identical rotation when panoramic picture, the then rotation introduced when shooting are cancelled, and show the visual angle of the panoramic video shown in equipment
It will not shake and change because of shooting, having reached prevents frame stabilization, enhances the effect of frame stabilization.
Further, in the alternative embodiment of the application, in the attitude angle that basis is found to the complete of panoramic picture
After scape display body is rotated, can also by panorama display body it is reinflated be panoramic picture, obtain the correction panorama of panoramic video
Image.The quantity for correcting panoramic picture is identical as the quantity of the original panoramic images of panoramic video, and corresponds.Correct panorama
Image can be kept separately or only save correction panoramic picture, and no longer retain the original panoramic images of panoramic video.School
The presence of positive panoramic picture can enable the subsequent equipment for getting correction panoramic picture directly show that frame out is smoothly complete
Scape video, without doing other processing work again.
As described above, the method for the correction panoramic video display view angle of the application, which both can be applied to mobile phone etc., shows equipment
On, it also can be applied on the capture apparatus such as panorama camera.In the case where being applied to display equipment, shown obtaining panorama
Body, and after being rotated according to attitude angle to panorama display body, the perspective correction to panoramic video is had been realized in, and be completed
Display.It is subsequent, then panorama display body is expanded into panoramic picture, obtained correction panoramic picture can be by display equipment point
Network is enjoyed, downloads and watches for other viewers, or directly shares to other display equipment and is watched for viewer.In the application
Method be applied to capture apparatus in the case where, be similar with display equipment for capture apparatus having a display function；
For not having the capture apparatus of display function, panorama display body is being obtained, and revolve to panorama display body according to attitude angle
It after turning, needs panorama display body expanding into panoramic picture, obtains correction panoramic picture, then correction panoramic picture is exported
It is shown for display equipment, realizes that panorama realizes the correction of display view angle.
It is worth noting that getting aphorama in the method for correction panoramic video display view angle provided by the present application
After frequency and the corresponding attitude angle data sequence of panoramic video, it is corresponding that panoramic picture is found out from the attitude angle data sequence
Attitude angle before, attitude angle data sequence can also be filtered, it is high to retain numerical value change frequency in attitude angle data sequence
In the component of frequency threshold, the component that numerical value change frequency is lower than frequency threshold is filtered out, is shaken when with to shooting to panoramic picture
Panorama display body caused by rotate and offset, retain photographer and change panorama exhibition of the movement of shooting visual angle to panoramic picture
Show rotation caused by body.
The shooting of the panoramic picture in panoramic video can be shaken above by filtering algorithm and divide into two kinds of situations:
(1) it is not intended to the shaking introduced, as capture apparatus shoots shake occurred during exercise, rocks；(2) photographer's active
Change the rotation of capture apparatus caused by shooting visual angle.
For situation (one), the frequency of the variation of the attitude angle of capture apparatus caused by shaking in this case is opposite
It is higher, a frequency threshold can be set according to the actual situation, in attitude angle data sequence, numerical value change frequency is higher than frequency
The component of rate threshold value, it can be assumed that be the panoramic picture corresponding posture captured in the case where undesirable shaking occurs
Angle.It is to need to eliminate visual angle change caused by shaking by rotation for these panoramic pictures, so in attitude angle data sequence
Retain the corresponding attitude angle of these panoramic pictures in column, that is, numerical value change frequency is higher than the component of frequency threshold, so as to
It is adjusted according to panorama display body of the attitude angle to panoramic picture.
It is the change that photographer actively changes display view angle caused by shooting visual angle in this case for situation (two).
In actual photographed, due to photographed scene, the change of photographic subjects, need to change shooting visual angle in many cases.This feelings
Under condition, on the display device and need to reflect that photographer wants the shooting visual angle presented, therefore do not need by complete
Scape display body, which is rotated, comes correction display visual angle.In the case where photographer's active accommodation shooting visual angle, capture apparatus shooting
Attitude angle can't frequently change, and therefore, numerical value change frequency be filtered out from attitude angle data sequence lower than frequency threshold
The corresponding attitude angle of the panoramic picture shot after component, that is, photographer's active accommodation, filters out from attitude angle data sequence
After this partial data component, also would not again the panoramic picture to photographer's active accommodation shooting visual angle panorama display body carry out
Rotation, remains the shooting visual angle of photographer.
The reason of being filtered above by attitude angle data sequence, changing to capture apparatus shooting visual angle carries out area
Point, it more targetedly eliminates the visual angle as caused by undesirable shaking and changes, by being distinguished to panoramic picture
The processing of property, can reach better display effect, enhance the usage experience of user.
It is worth noting that in the method for the correction panoramic video display view angle of the application, if to attitude angle data
Sequence, which is filtered, to be selected according to actual needs.It, can be to bat if be not filtered to attitude angle data sequence
It takes the photograph the change of shaking bring angle of view and the change of photographer's active accommodation shooting visual angle bring angle of view is shown
Show the correction at visual angle.Namely display view angle is remained on visual angle when starting to pan video, is whether occurred
Shooting is shaken or photographer actively changes shooting visual angle and display view angle is maintained on visual angle when shooting starts.This side
In formula, display view angle is remained on same visual angle, adjusts the visual angle of viewing by viewer completely, picture remains steady
Fixed visual angle.
In addition, in the method for the correction panoramic video display view angle of the application, for the posture in attitude angle data sequence
Angle can also receive the modification to attitude angle by interactive man-machine interface, add offset for attitude angle, make panoramic video
It is shown according to artificial expected visual angle.For example, in practice, people may want to video and be shown with a certain visual angle, pass through
Offset is added for attitude angle data, adjusts the size of attitude angle, meets the demand of artificial control panoramic video display view angle,
Panoramic video can be shown in more personalized mode.
As shown in Fig. 2, present invention also provides a kind of devices for correcting panoramic video display view angle, comprising:
One acquiring unit, for obtaining panoramic video and the corresponding attitude angle data sequence of panoramic video；
Panoramic picture is attached to scheduled three-dimensional for being directed to each frame panoramic picture of panoramic video by one panorama unit
The surface of geometrical body obtains panorama display body；
One searching unit, for finding out the corresponding attitude angle of panoramic picture from attitude angle data sequence；
One correction unit, for being rotated according to the attitude angle found to the panorama display body of panoramic picture, to disappear
Image caused by shaking except shooting rotates.
Further, above-mentioned apparatus further include:
One expansion unit, for being carried out in correction unit according to panorama display body of the attitude angle found to panoramic picture
After rotation, panorama display body is expanded into panoramic picture, obtains the correction panoramic picture of panoramic video, so that subsequent get entirely
The equipment of the correction panoramic picture of scape video can show the stable panoramic video of picture.
Further, above-mentioned apparatus further include:
One filter unit, for getting panoramic video and the corresponding attitude angle data sequence of panoramic video in acquiring unit
After column, searching unit is before finding out the corresponding attitude angle of panoramic picture in attitude angle data sequence, to attitude angle data sequence
It is filtered, retains the component that numerical value change frequency in attitude angle data sequence is higher than frequency threshold, filter out numerical value change frequency
Lower than the component of frequency threshold, shakes to rotate caused by the panorama display body of panoramic picture when with shooting and offset, protect
Photographer is stayed to change movement rotation caused by the panorama display body of panoramic picture of shooting visual angle.
Further, the corresponding attitude angle of panoramic picture is the attitude angle of capture apparatus when shooting the panoramic picture；
Correction unit is rotated according to panorama display body of the attitude angle found to panoramic picture, comprising: is calculated complete
Rotationally-varying amount of the corresponding attitude angle of scape image relative to reference attitude angle, according to the rotationally-varying amount, to panoramic picture
Panorama display body carries out and capture apparatus rotates identical rotation when shooting the frame panoramic picture.
Further, the corresponding attitude angle of panoramic picture is the attitude angle of capture apparatus when shooting the panoramic picture relative to base
The rotationally-varying amount of quasi- attitude angle；
Correction unit is rotated according to panorama display body of the attitude angle found to panoramic picture, comprising: according to complete
The corresponding attitude angle of scape image, carries out the panorama display body of panoramic picture and capture apparatus is shooting the frame panoramic picture when institute
Make to rotate identical rotation.
Although disclosed herein embodiment it is as above, the content only for ease of understanding the present invention and use
Embodiment is not intended to limit the invention.Technical staff in any fields of the present invention is taken off not departing from the present invention
Under the premise of the spirit and scope of dew, any modification and variation, but the present invention can be carried out in the form and details of implementation
Scope of patent protection, still should be subject to the scope of the claims as defined in the appended claims.
Claims (10)
1. a kind of method for correcting panoramic video display view angle characterized by comprising
Obtain panoramic video and the corresponding attitude angle data sequence of panoramic video；
For each frame panoramic picture of panoramic video, panoramic picture is attached to the surface of scheduled three-dimension geometry solid, is obtained
Panorama display body, and the corresponding attitude angle of panoramic picture is found out from the attitude angle data sequence；
It is rotated according to panorama display body of the attitude angle found to panoramic picture, to eliminate image caused by shooting is shaken
Rotation；
The corresponding attitude angle of the panoramic picture is the attitude angle of capture apparatus when shooting the panoramic picture；
The attitude angle that the basis is found rotates the panorama display body of panoramic picture, comprising: calculates panoramic picture pair
Rotationally-varying amount of the attitude angle answered relative to reference attitude angle shows the panorama of panoramic picture according to the rotationally-varying amount
Body carries out and capture apparatus rotates identical rotation when shooting the frame panoramic picture.
2. the method according to claim 1, wherein the method also includes:
After being rotated according to the attitude angle found to the panorama display body of panoramic picture, also by the panorama display body exhibition
It opens as panoramic picture, the correction panoramic picture of panoramic video is obtained, so that the subsequent correction panoramic picture for getting panoramic video
Equipment can show the stable panoramic video of picture.
3. method according to claim 1 or 2, which is characterized in that the method also includes:
After getting panoramic video and the corresponding attitude angle data sequence of panoramic video, from the attitude angle data sequence
Before finding out the corresponding attitude angle of panoramic picture, also the attitude angle data sequence is filtered, retains the attitude angle number
It is higher than the component of frequency threshold according to numerical value change frequency in sequence, filters out the component that numerical value change frequency is lower than frequency threshold, with
It shakes to rotate caused by the panorama display body of panoramic picture when shooting and offset, retain photographer and change shooting visual angle
Movement is rotated caused by the panorama display body of panoramic picture.
4. a kind of method for correcting panoramic video display view angle characterized by comprising
Obtain panoramic video and the corresponding attitude angle data sequence of panoramic video；
For each frame panoramic picture of panoramic video, panoramic picture is attached to the surface of scheduled three-dimension geometry solid, is obtained
Panorama display body, and the corresponding attitude angle of panoramic picture is found out from the attitude angle data sequence；
It is rotated according to panorama display body of the attitude angle found to panoramic picture, to eliminate image caused by shooting is shaken
Rotation；
The corresponding attitude angle of the panoramic picture is the attitude angle of capture apparatus when shooting the panoramic picture relative to reference attitude
The rotationally-varying amount at angle；
The attitude angle that the basis is found rotates the panorama display body of panoramic picture, comprising: according to the panorama sketch
As corresponding attitude angle, the panorama display body of panoramic picture is carried out and capture apparatus is revolved when shooting the frame panoramic picture
Turn identical rotation.
5. according to the method described in claim 4, it is characterized in that, the method also includes:
After being rotated according to the attitude angle found to the panorama display body of panoramic picture, also by the panorama display body exhibition
It opens as panoramic picture, the correction panoramic picture of panoramic video is obtained, so that the subsequent correction panoramic picture for getting panoramic video
Equipment can show the stable panoramic video of picture.
6. a kind of device for correcting panoramic video display view angle characterized by comprising
One acquiring unit, for obtaining panoramic video and the corresponding attitude angle data sequence of panoramic video；
Panoramic picture is attached to scheduled three-dimensional geometry for being directed to each frame panoramic picture of panoramic video by one panorama unit
The surface of body obtains panorama display body；
One searching unit, for finding out the corresponding attitude angle of panoramic picture from the attitude angle data sequence；
One correction unit is clapped for being rotated according to the attitude angle found to the panorama display body of panoramic picture with eliminating
Image caused by shaking is taken the photograph to rotate；
The corresponding attitude angle of the panoramic picture is the attitude angle of capture apparatus when shooting the panoramic picture；
The correction unit is rotated according to panorama display body of the attitude angle found to panoramic picture, comprising: is calculated complete
Rotationally-varying amount of the corresponding attitude angle of scape image relative to reference attitude angle, according to the rotationally-varying amount, to panoramic picture
Panorama display body carries out and capture apparatus rotates identical rotation when shooting the frame panoramic picture.
7. device according to claim 6, which is characterized in that described device further include:
One expansion unit, for being carried out in the correction unit according to panorama display body of the attitude angle found to panoramic picture
After rotation, the panorama display body is expanded into panoramic picture, obtains the correction panoramic picture of panoramic video, so that subsequent acquisition
Equipment to the correction panoramic picture of panoramic video can show the stable panoramic video of picture.
8. device according to claim 6 or 7, which is characterized in that described device further include:
One filter unit, for getting panoramic video and the corresponding attitude angle data sequence of panoramic video in the acquiring unit
After column, the searching unit is before finding out the corresponding attitude angle of panoramic picture in the attitude angle data sequence, to the appearance
State angular data sequence is filtered, and retains the component that numerical value change frequency in the attitude angle data sequence is higher than frequency threshold,
The component that numerical value change frequency is lower than frequency threshold is filtered out, is shaken caused by the panorama display body of panoramic picture when with shooting
Rotation is offset, and the movement for retaining photographer's change shooting visual angle is rotated caused by the panorama display body of panoramic picture.
9. a kind of device for correcting panoramic video display view angle characterized by comprising
One acquiring unit, for obtaining panoramic video and the corresponding attitude angle data sequence of panoramic video；
Panoramic picture is attached to scheduled three-dimensional geometry for being directed to each frame panoramic picture of panoramic video by one panorama unit
The surface of body obtains panorama display body；
One searching unit, for finding out the corresponding attitude angle of panoramic picture from the attitude angle data sequence；
One correction unit is clapped for being rotated according to the attitude angle found to the panorama display body of panoramic picture with eliminating
Image caused by shaking is taken the photograph to rotate；
The corresponding attitude angle of the panoramic picture is the attitude angle of capture apparatus when shooting the panoramic picture relative to reference attitude
The rotationally-varying amount at angle；
The correction unit is rotated according to panorama display body of the attitude angle found to panoramic picture, comprising: according to institute
The corresponding attitude angle of panoramic picture is stated, the panorama display body of panoramic picture is carried out and capture apparatus is shooting the frame panoramic picture
Shi Suozuo rotates identical rotation.
10. device according to claim 9, which is characterized in that described device further include:
One expansion unit, for being carried out in the correction unit according to panorama display body of the attitude angle found to panoramic picture
After rotation, the panorama display body is expanded into panoramic picture, obtains the correction panoramic picture of panoramic video, so that subsequent acquisition
Equipment to the correction panoramic picture of panoramic video can show the stable panoramic video of picture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610930116.4A CN106507094B (en) | 2016-10-31 | 2016-10-31 | Correct the method and device of panoramic video display view angle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610930116.4A CN106507094B (en) | 2016-10-31 | 2016-10-31 | Correct the method and device of panoramic video display view angle |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106507094A CN106507094A (en) | 2017-03-15 |
| CN106507094B true CN106507094B (en) | 2019-01-04 |
Family
ID=58319714
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610930116.4A Active CN106507094B (en) | 2016-10-31 | 2016-10-31 | Correct the method and device of panoramic video display view angle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106507094B (en) |
Families Citing this family (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107071279A (en) * | 2017-04-01 | 2017-08-18 | 深圳市圆周率软件科技有限责任公司 | A kind of method and system of panoramic picture frame stabilization |
| CN107040694B (en) | 2017-04-07 | 2019-10-25 | 深圳岚锋创视网络科技有限公司 | A kind of method, system and the portable terminal of panoramic video stabilization |
| JP7009107B2 (en) * | 2017-08-03 | 2022-01-25 | キヤノン株式会社 | Image pickup device and its control method |
| CN111418213B (en) * | 2017-08-23 | 2022-07-01 | 联发科技股份有限公司 | Method and apparatus for signaling syntax for immersive video coding |
| US10827159B2 (en) | 2017-08-23 | 2020-11-03 | Mediatek Inc. | Method and apparatus of signalling syntax for immersive video coding |
| US10569172B2 (en) * | 2017-09-19 | 2020-02-25 | Canon Kabushiki Kaisha | System and method of configuring a virtual camera |
| CN107665250A (en) * | 2017-09-26 | 2018-02-06 | 百度在线网络技术（北京）有限公司 | High definition road overlooks construction method, device, server and the storage medium of map |
| CN108366243B (en) * | 2018-01-23 | 2019-10-29 | 微幻科技(北京)有限公司 | A kind of video jitter removing method and device |
| TWI700000B (en) | 2019-01-29 | 2020-07-21 | 威盛電子股份有限公司 | Image stabilization method and apparatus for panoramic video, and method for evaluating image stabilization algorithm |
| CN110430411B (en) * | 2019-08-08 | 2021-05-25 | 青岛一舍科技有限公司 | Display method and device of panoramic video |
| CN110850977B (en) * | 2019-11-06 | 2023-10-31 | 成都威爱新经济技术研究院有限公司 | Stereoscopic image interaction method based on 6DOF head-mounted display |
| CN111524230B (en) * | 2020-04-01 | 2021-01-26 | 中南大学 | Linkage browsing method for three-dimensional model and unfolded panoramic image and computer system |
| CN111541850A (en) * | 2020-07-13 | 2020-08-14 | 南京泓众电子科技有限公司 | Panoramic electronic pan-tilt correction method and device |
| CN113301249B (en) * | 2021-05-07 | 2023-06-30 | 影石创新科技股份有限公司 | Panoramic video processing method, device, computer equipment and storage medium |
| CN113436113B (en) * | 2021-07-22 | 2023-04-18 | 黑芝麻智能科技有限公司 | Anti-shake image processing method, device, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101231456A (en) * | 2008-01-31 | 2008-07-30 | 北京航空航天大学 | Method for correcting panorama video jitter using angle sensor |
| CN104333675A (en) * | 2014-10-20 | 2015-02-04 | 长春理工大学 | Panoramic electronic image stabilization method based on spherical projection |
| EP2933605A1 (en) * | 2014-04-17 | 2015-10-21 | Nokia Technologies OY | A device orientation correction method for panorama images |
| CN105208247A (en) * | 2015-09-02 | 2015-12-30 | 长春理工大学 | Quaternion-based panoramic image stabilizing method |
| US9277122B1 (en) * | 2015-08-13 | 2016-03-01 | Legend3D, Inc. | System and method for removing camera rotation from a panoramic video |
| CN105975172A (en) * | 2015-12-11 | 2016-09-28 | 乐视网信息技术（北京）股份有限公司 | Method and device for adjustment of panoramic video and mobile terminal |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101586249B1 (en) * | 2013-12-24 | 2016-01-18 | (주)에프엑스기어 | Apparatus and method for processing wide viewing angle image |
-
2016
- 2016-10-31 CN CN201610930116.4A patent/CN106507094B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101231456A (en) * | 2008-01-31 | 2008-07-30 | 北京航空航天大学 | Method for correcting panorama video jitter using angle sensor |
| EP2933605A1 (en) * | 2014-04-17 | 2015-10-21 | Nokia Technologies OY | A device orientation correction method for panorama images |
| CN104333675A (en) * | 2014-10-20 | 2015-02-04 | 长春理工大学 | Panoramic electronic image stabilization method based on spherical projection |
| US9277122B1 (en) * | 2015-08-13 | 2016-03-01 | Legend3D, Inc. | System and method for removing camera rotation from a panoramic video |
| CN105208247A (en) * | 2015-09-02 | 2015-12-30 | 长春理工大学 | Quaternion-based panoramic image stabilizing method |
| CN105975172A (en) * | 2015-12-11 | 2016-09-28 | 乐视网信息技术（北京）股份有限公司 | Method and device for adjustment of panoramic video and mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106507094A (en) | 2017-03-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106507094B (en) | Correct the method and device of panoramic video display view angle | |
| JP5659305B2 (en) | Image generating apparatus and image generating method | |
| JP5659304B2 (en) | Image generating apparatus and image generating method | |
| JP5769813B2 (en) | Image generating apparatus and image generating method | |
| JP4017579B2 (en) | Imaging auxiliary device, image processing method, image processing apparatus, computer program, recording medium storing program | |
| WO2021012855A1 (en) | Panoramic image generating system and panoramic image generating method | |
| JP5865388B2 (en) | Image generating apparatus and image generating method | |
| JP4351996B2 (en) | Method for generating a stereoscopic image from a monoscope image | |
| CN105939481A (en) | Interactive three-dimensional virtual reality video program recorded broadcast and live broadcast method | |
| WO2018133849A1 (en) | Panoramic image photographic method, panoramic image display method, panoramic image photographic device, and panoramic image display device | |
| CN106296589B (en) | Panoramic image processing method and device | |
| US10277890B2 (en) | System and method for capturing and viewing panoramic images having motion parallax depth perception without image stitching | |
| JP7319974B2 (en) | Method for Realizing Bullet Time Shooting Effect and Panoramic Camera | |
| JP2002503893A (en) | Virtual reality camera | |
| US20090273688A1 (en) | Image recording and playback device, and image recording and playback method | |
| CN108347505B (en) | Mobile terminal with 3D imaging function and image generation method | |
| TWI584050B (en) | Panoramic stereoscopic image synthesis method, apparatus and mobile terminal | |
| CN108600729B (en) | Dynamic 3D model generation device and image generation method | |
| CN110291777B (en) | Image acquisition method, device and machine-readable storage medium | |
| CN108614636A (en) | A kind of 3D outdoor scenes VR production methods | |
| KR20200087816A (en) | Image processing apparatus, image processing system, image processing method and recording medium | |
| CN108513122B (en) | Model adjusting method and model generating device based on 3D imaging technology | |
| JP2020096349A (en) | Image processing device, imaging device, moving image reproduction system, method, and program | |
| CN108205236B (en) | Panoramic camera and lens thereof | |
| CN111541850A (en) | Panoramic electronic pan-tilt correction method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |