CN106803994B - Identify the method and system of rectangular pyramid panoramic video - Google Patents
Identify the method and system of rectangular pyramid panoramic video Download PDFInfo
- Publication number
- CN106803994B CN106803994B CN201710196925.1A CN201710196925A CN106803994B CN 106803994 B CN106803994 B CN 106803994B CN 201710196925 A CN201710196925 A CN 201710196925A CN 106803994 B CN106803994 B CN 106803994B
- Authority
- CN
- China
- Prior art keywords
- pixel
- rectangular pyramid
- gap
- panoramic video
- image frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 32
- 238000010586 diagram Methods 0.000 description 9
- 238000013507 mapping Methods 0.000 description 5
- 235000006508 Nelumbo nucifera Nutrition 0.000 description 4
- 240000002853 Nelumbo nucifera Species 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004321 preservation Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- Studio Circuits (AREA)
Abstract
The present invention discloses the method and system of identification rectangular pyramid panoramic video, this method comprises: in player, side pixel variance threshold values for determining rectangular pyramid panoramic video, gap pixel is arranged to variance threshold values；The picture frame of video is obtained from database and calculates the aspect ratio value of picture frame；When the aspect ratio value of picture frame is 1:1, equidistant two pixels in the side midpoint will be arrived in each edge of picture frame as a side pixel pair, and calculate the pixel variance of side pixel pair；On all sides of picture frame, when the pixel variance of side pixel pair is both less than or is equal to side pixel variance threshold values, the gap pixel pair of adjacent both sides midpoint line two sides on picture frame, and the pixel variance of calculated gap pixel pair are obtained；In picture frame, when the pixel variance of all gap pixels pair is both greater than or is equal to gap pixel to variance threshold values, determine that video is rectangular pyramid panoramic video.The present invention realizes the automatic identification of rectangular pyramid panoramic video.
Description
Technical field
The present invention relates to the technical fields of video playing, more particularly, to a kind of side for identifying rectangular pyramid panoramic video
Method and system.
Background technique
Panoramic video, i.e., 720 degree perhaps 360 degree of panoramic videos it be on the technology of 720 degree or 360 degree panoramas
Development extends, and converts dynamic video image for static panoramic pictures, panoramic video can be above and below shooting angle
Dynamic video is arbitrarily watched within the scope of 360 degree of left and right, user is allowed to have a kind of feeling on the spot in person.Make when making panoramic video
It shoots the picture of 360 degree (or 720 degree) simultaneously around shooting point with one group of video camera, and makes after the image mosaic in later period
The video that can show picture around shooting point without distortions at any time.
There is presently no the peculiar formats for saving panoramic video, and existing panoramic video still uses identical as conventional video
Preservation format: panorama player plays are picture on the perspective plane centered on shooting point by splicing, mesh
It is preceding that this projection is inconvenient to store, but the changing picture of projection is usually stored as rectangular image, it is broadcast in panorama player
The rectangular image of storage is remapped to fit in panoramic video playing model when putting the panoramic video and is played.Therefore, existing
It is planar video or panoramic video that video to be played can not be automatically identified in technology, and panoramic video and planar video
Broadcast mode is entirely different, if playing planar video or broadcasting with planar video in the form of the broadcasting of panoramic video
The form of putting, which carrys out playing panoramic video all, can cause the distortion of video pictures.For these reasons, user can only be in the prior art
It was found that manual switching video playing mode is adjusted in the case that video playing mode is not consistent, it is very not square for user
Just, it greatly affected user to the usage experience of product.On the other hand, panoramic video playing model also has sphere model, stands
Point of cube model and tetragonous Based On The Conic Model, if by the panoramic video based on tetragonous Based On The Conic Model with sphere model or cube model
Mode carry out textures broadcasting, it is clear that be unreasonable.
Therefore it provides a kind of method for identifying rectangular pyramid panoramic video is this field urgent problem to be solved.
Summary of the invention
In view of this, solving existing skill the present invention provides a kind of method and system for identifying rectangular pyramid panoramic video
The technical issues of rectangular pyramid panoramic video cannot be identified in art.
In order to solve the above-mentioned technical problem, the present invention proposes a kind of method for identifying rectangular pyramid panoramic video, comprising:
In player, side pixel variance threshold values, the gap pixel other side for determining rectangular pyramid panoramic video are set
Poor threshold value；
The picture frame of video is obtained from database and calculates the aspect ratio value of described image frame；
When the aspect ratio value of described image frame is 1:1, the side midpoint will be arrived in each edge of described image frame apart from phase
Deng two pixels as a side pixel pair, and calculate the pixel variance of the side pixel pair；
On all sides of described image frame, the pixel variance of the side pixel pair is both less than or equal to side pixel side
When poor threshold value, the gap pixel pair of adjacent both sides midpoint line two sides on described image frame is obtained, and calculates the gap pixel
Pair pixel variance；
In described image frame, the pixel variance of all gap pixels pair is both greater than or equal to the gap pixel to variance
When threshold value, determine the video for rectangular pyramid panoramic video.
Further, wherein in described image frame, the pixel variance of all gap pixels pair is both greater than or equal to gap
When pixel is to variance threshold values, determine the video for rectangular pyramid panoramic video, further are as follows:
In described image frame, the pixel variance of all gap pixels pair is both greater than or equal to gap pixel to variance threshold values
When, using the vertex of described image frame as the vertex of rectangular pyramid, the midpoint on two sides where the vertex of the rectangular pyramid is described four
The bottom surface vertex of the bottom surface vertex of pyramid, the vertex of the rectangular pyramid and the rectangular pyramid constitutes the side of the rectangular pyramid, institute
The line for stating the bottom surface vertex of rectangular pyramid and the vertex of the rectangular pyramid constitutes the side of the rectangular pyramid；
On the side of the rectangular pyramid, the parallel pixel for being parallel to the pixel column of side of the rectangular pyramid is obtained, it will
The pixel of the side of the parallel pixel and the rectangular pyramid forms parallel pixel pair, and calculates the picture of every a line parallel pixel pair
Plain variance；
When the pixel variance of the parallel pixel pair with being gradually increased from the near to the distant at a distance from the side, sentence
The fixed video is rectangular pyramid panoramic video.
Further, wherein obtain the gap pixel pair of adjacent both sides midpoint line two sides on described image frame, and calculate
The pixel variance of the gap pixel pair, further are as follows:
It obtains adjacent both sides midpoint line two sides on described image frame and sets number of pixels with midpoint line interval
Pixel be bottom edge gap pixel, using the corresponding bottom edge gap pixel in midpoint line two sides as gap pixel pair,
And calculate the pixel variance of the gap pixel pair.
Further, wherein the number of pixels that sets is 15 pixel.
Further, wherein the side pixel variance threshold values, for less than 80；The bottom edge pixel variance threshold values, are big
In or equal to 80.
On the other hand, the present invention also provides a kind of systems for identifying rectangular pyramid panoramic video, comprising: setup module, video
Picture frame obtains module, computing module and rectangular pyramid panoramic video determination module；
The setup module, for the side pixel variance for determining rectangular pyramid panoramic video to be arranged in player
Threshold value, bottom edge pixel variance threshold values；
The video image frame obtains module, for obtaining the picture frame of video from database；
The computing module, for calculating the aspect ratio value of described image frame；It is 1:1 in the aspect ratio value of described image frame
When, equidistant two pixels in the side midpoint will be arrived in each edge of described image frame as a side pixel pair, and count
Calculate the pixel variance of the side pixel pair；
On all sides of described image frame, the pixel variance of the side pixel pair is both less than or equal to side pixel side
When poor threshold value, the gap pixel pair of adjacent both sides midpoint line two sides on described image frame is obtained, and calculates the gap pixel
Pair pixel variance；
The rectangular pyramid panoramic video determination module is used for the pixel side of all gap pixels pair in described image frame
When difference is both greater than or is equal to the gap pixel to variance threshold values, determine the video for rectangular pyramid panoramic video.
Further, wherein the rectangular pyramid panoramic video determination module is further used for:
In described image frame, the pixel variance of all gap pixels pair is both greater than or equal to gap pixel to variance threshold values
When, using the vertex of described image frame as the vertex of rectangular pyramid, the midpoint on two sides where the vertex of the rectangular pyramid is described four
The bottom surface vertex of the bottom surface vertex of pyramid, the vertex of the rectangular pyramid and the rectangular pyramid constitutes the side of the rectangular pyramid, institute
The line for stating the bottom surface vertex of rectangular pyramid and the vertex of the rectangular pyramid constitutes the side of the rectangular pyramid；
On the side of the rectangular pyramid, the parallel pixel for being parallel to the pixel column of side of the rectangular pyramid is obtained, it will
The pixel of the side of the parallel pixel and the rectangular pyramid forms parallel pixel pair, and calculates the picture of every a line parallel pixel pair
Plain variance；
When the pixel variance of the parallel pixel pair with being gradually increased from the near to the distant at a distance from the side, sentence
The fixed video is rectangular pyramid panoramic video.
Further, wherein the computing module is further used for:
It obtains adjacent both sides midpoint line two sides on described image frame and sets number of pixels with midpoint line interval
Pixel be bottom edge gap pixel, using the corresponding bottom edge gap pixel in midpoint line two sides as gap pixel pair,
And calculate the pixel variance of the gap pixel pair.
Further, wherein the number of pixels that sets is 15 pixel.
Further, wherein the side pixel variance threshold values, for less than 80；The bottom edge pixel variance threshold values, are big
In or equal to 80.
Compared with prior art, the method and system of identification rectangular pyramid panoramic video of the invention, realizing following has
Beneficial effect:
(1) method and system of identification rectangular pyramid panoramic video of the present invention are complete according to the tetragonous Based On The Conic Model of storage
The characteristic of scape video pictures, judge video to be played whether be tetragonous Based On The Conic Model panoramic video, and to the panorama determined
Video carries out rectangular pyramid model pinup picture broadcasting automatically, realizes the automatic identification of panoramic video, improves user experience.
(2) method and system of identification rectangular pyramid panoramic video of the present invention, are also provided with tetragonous Based On The Conic Model panorama
The judgment mechanism of video and planar video, and corresponding broadcast mode is automatically selected for every kind of visual form, simplify user
Operation, while can accurately carry out the broadcasting of various videos.
Certainly, implementing any of the products of the present invention specific needs while must not reach all the above technical effect.
By referring to the drawings to the detailed description of exemplary embodiment of the present invention, other feature of the invention and its
Advantage will become apparent.
Detailed description of the invention
It is combined in the description and the attached drawing for constituting part of specification shows the embodiment of the present invention, and even
With its explanation together principle for explaining the present invention.
Fig. 1 is the flow diagram of the method for identification rectangular pyramid panoramic video described in the embodiment of the present invention 1；
Fig. 2 is the schematic diagram that spherical panoramic video picture described in the embodiment of the present invention 1 is mapped with corresponding rectangular pyramid image
Fig. 3 is the schematic diagram that rectangular pyramid is launched into plane storage figure in Fig. 2；
Fig. 4 is the flow diagram of the method for identification rectangular pyramid panoramic video described in the embodiment of the present invention 2；
Fig. 5 is the structural schematic diagram of the system of identification rectangular pyramid panoramic video described in the embodiment of the present invention 3.
Specific embodiment
Carry out the various exemplary embodiments of detailed description of the present invention now with reference to attached drawing.It should also be noted that unless in addition having
Body explanation, the unlimited system of component and the positioned opposite of step, numerical expression and the numerical value otherwise illustrated in these embodiments is originally
The range of invention.
Be to the description only actually of at least one exemplary embodiment below it is illustrative, never as to the present invention
And its application or any restrictions used.
Technology, method and apparatus known to person of ordinary skill in the relevant may be not discussed in detail, but suitable
In the case of, the technology, method and apparatus should be considered as part of specification.
It is shown here and discuss all examples in, any occurrence should be construed as merely illustratively, without
It is as limitation.Therefore, other examples of exemplary embodiment can have different values.
It should also be noted that similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined in a attached drawing, then in subsequent attached drawing does not need that it is further discussed.
Embodiment 1
As shown in Figure 1, for the flow diagram of the method for identification rectangular pyramid panoramic video described in the present embodiment, the present embodiment
The method solves the technical issues of being unable to automatic identification rectangular pyramid panoramic video in the prior art.It is identified described in the present embodiment
The method of rectangular pyramid panoramic video the following steps are included:
Step 101, in player, side pixel variance threshold values, the bottom edge for determining rectangular pyramid panoramic video are set
Pixel variance threshold values.
Rectangular pyramid panoramic video refers to that the full-view video image that will be taken fits to the panoramic video mapping of tetragonous Based On The Conic Model
On face, the corresponding technology for mapping image and showing broadcasting in playing view window is chosen further according to the view position of user.Rectangular pyramid
Panoramic video has the advantages that storage is small, is conducive to panoramic video relative to sphere panoramic video and cube panoramic video
Transmission, online broadcasting and storage.But area of the rectangular pyramid panoramic video in rectangular pyramid bottom surface is larger, and on rectangular pyramid side
Area is smaller and smaller from lower to upper, will cause the problem fuzzyyer more the image being proximate at the top of rectangular pyramid.It is asked to solve this
Topic, the rectangular pyramid panoramic video of Same Scene is in the form of four (all around relative to viewer) or more image sequence
Storage, user is in viewing, the bottom surface of corresponding rectangular pyramid immediately ahead of vision, and rectangular pyramid side is in the position of user's vision remaining light
It sets, therefore, does not interfere with the clarity that user watches panoramic video.
But there are no automatic identification and the technology of rectangular pyramid panoramic video is played in the prior art, require user hand
Dynamic selection video play mode, trivial operations are unfavorable for user experience.
In the prior art, rectangular pyramid panoramic video is that picture is placed in same picture frame on five binding faces with rectangular pyramid
Form is stored, and as shown in Figures 2 and 3, Fig. 2 is the signal that spherical panoramic video picture is mapped with corresponding rectangular pyramid image
Figure；Fig. 3 is the schematic diagram that rectangular pyramid is launched into plane in Fig. 2.In Fig. 2, the spherical panoramic video picture taken is located at ball O
Surface on, and rectangular pyramid M-ABCD be ball O inscribed rectangular pyramid, the centre of sphere O line of any point P and ball O on the surface ball O
There is unique intersection point Q on the surface of rectangular pyramid M-ABCD, i.e. Q point is mapping point of the P point on the surface rectangular pyramid M-ABCD, such as
This, it will be able to the panoramic video picture on the surface ball O is mapped on the surface rectangular pyramid M-ABCD.
Because video image frame is all the shape with plane currently not yet with the technology of geometric figure store video images frame
Formula storage, is launched into planar graph for rectangular pyramid M-ABCD and is converted in square as shown in Figure 3, wherein vertex M1,
M2, M3 and M4 are that M point is converted to.And the characteristics of rectangular pyramid panoramic video, is: adjacent side (such as M1A and M1D) be all by
Same pixel is converted on spherical surface, therefore the width and Gao Xiangtong of the image plane frame being converted to.
Step 102 obtains the picture frame of video from database and calculates the aspect ratio value of described image frame.
When user sends video playing request, the mark that request plays video, base are carried in video playing request
Corresponding video data can be obtained from video database in the mark of video, parsed video data, can therefrom be analyzed
Whether video image is full-view video image, because panoramic video is identical as common planar video storage format, cannot be used
Conventional means judge whether it is panoramic video.And storage characteristics (width of picture frame and high phase based on rectangular pyramid panoramic video
Together), the aspect ratio value of rectangular pyramid panoramic video must be 1:1.
Step 103, described image frame aspect ratio value be 1:1 when, by each edge of described image frame into the side
Equidistant two pixels of point calculate the pixel variance of the side pixel pair as a side pixel pair.
Step 104, on all sides of described image frame, the pixel variance of the side pixel pair both less than or is equal to side
When the pixel variance threshold values of side, the gap pixel pair of adjacent both sides midpoint line two sides on described image frame is obtained, and described in calculating
The pixel variance of gap pixel pair.
Although the aspect ratio value of rectangular pyramid full-view video image frame be 1:1, meet aspect ratio value be 1:1 not necessarily
It is all rectangular pyramid panoramic video.In rectangular pyramid panoramic video, the side on picture frame is all converted by the same side of rectangular pyramid
It arrives, therefore midpoint when that should be with this on picture frame is arranged at symmetric form.That is, the pixel of side pixel pair should
Identical, it is contemplated that the error in practical operation, the pixel variance of side pixel pair should be in a lesser range.
Step 105, in described image frame, the pixel variances of all gap pixels pair both greater than or is equal to gap pixel pair
When variance threshold values, determine the video for rectangular pyramid panoramic video.
The one-row pixels of bottom surface side junction two sides are gap pixel, bottom surface side junction in rectangular pyramid full-view video image
The corresponding two gap pixels in two sides are gap pixel pair, in tetragonous Based On The Conic Model panoramic video, due to five panoramic videos
Mapping face stitches and fastens, the video image on each mapping face be all it is independent, therefore, the gap pixel on rectangular pyramid
There is larger difference, thus can the gap pixel based on video image to judging whether video is based on tetragonous Based On The Conic Model
Panoramic video.
Step 106, the tetragonous Based On The Conic Model of creation, and the panorama that the video image fits to the tetragonous Based On The Conic Model is mapped
It is played out on face.
Panoramic video based on tetragonous Based On The Conic Model plays, and it is tetragonous to be that the rectangular pyramid video image that will have been pre-processed fits to
The medial surface of Based On The Conic Model, so that user obtains staying the feeling of immersion inside rectangular pyramid panoramic video when watching.
The method that rectangular pyramid panoramic video is identified described in the present embodiment, draws according to the tetragonous Based On The Conic Model panoramic video of storage
The characteristic in face, automatic identification video to be played whether be tetragonous Based On The Conic Model panoramic video, and to the panoramic video determined
It is automatic to carry out the broadcasting of rectangular pyramid model pinup picture, the automatic identification and broadcasting of rectangular pyramid panoramic video are realized, improving user makes
With experience.
Embodiment 2
As shown in figure 4, for the flow diagram of the method for identification rectangular pyramid panoramic video described in the present embodiment, the present embodiment
On the basis of embodiment 1, the characteristic based on rectangular pyramid lateral periphery picture frame is described, rectangular pyramid aphorama is further promoted
The particular content of frequency identification accuracy design.Described in the present embodiment identify rectangular pyramid panoramic video method the following steps are included:
Step 401, in player, side pixel variance threshold values, the bottom edge for determining rectangular pyramid panoramic video are set
Pixel variance threshold values.Optionally, the side pixel variance threshold values, for less than 80；The bottom edge pixel variance threshold values, for greater than
Or it is equal to 80.
Step 402 obtains the picture frame of video from database and calculates the aspect ratio value of described image frame.
Step 403, described image frame aspect ratio value be 1:1 when, by each edge of described image frame into the side
Equidistant two pixels of point calculate the pixel variance of the side pixel pair as a side pixel pair.
Step 404, on all sides of described image frame, the pixel variance of the side pixel pair both less than or is equal to side
When the pixel variance threshold values of side, obtains adjacent both sides midpoint line two sides on described image frame and set with midpoint line interval
The pixel of number of pixels is bottom edge gap pixel, using the corresponding bottom edge gap pixel in midpoint line two sides as gap
Pixel pair, and calculate the pixel variance of the gap pixel pair.
Optionally, the number of pixels that sets is 15 pixel.
Step 405, in described image frame, the pixel variances of all gap pixels pair both greater than or is equal to gap pixel pair
When variance threshold values, using the vertex of described image frame as the vertex of rectangular pyramid, the midpoint on two sides where the vertex of the rectangular pyramid
For the bottom surface vertex of the rectangular pyramid, the bottom surface vertex of the vertex of the rectangular pyramid and the rectangular pyramid constitutes the rectangular pyramid
The line of side, the vertex on the bottom surface vertex and rectangular pyramid of the rectangular pyramid constitutes the side of the rectangular pyramid；
On the side of the rectangular pyramid, the parallel pixel for being parallel to the pixel column of side of the rectangular pyramid is obtained, it will
The pixel of the side of the parallel pixel and the rectangular pyramid forms parallel pixel pair, and calculates the picture of every a line parallel pixel pair
Plain variance.
Step 406, the parallel pixel pair pixel variance at a distance from the side from the near to the distant and gradually
When increase, determine the video for rectangular pyramid panoramic video.
Parallel pixel is to therefore being had certain by consecutive image frame converts in same side on spherical surface
Relevance, and as from the near to the distant, this relevance is smaller and smaller at a distance from the side, therefore this pass can be passed through
Judgment basis of the connection property as rectangular pyramid panoramic video, further to promote the recognition accuracy of rectangular pyramid panoramic video.
In some alternative embodiments, the pixel column for choosing predetermined quantity compares the variance size of parallel pixel pair, can
Selection of land, the predetermined quantity can be 2 to 30 rows.
Step 407, the tetragonous Based On The Conic Model of creation, and the panorama that the video image fits to the tetragonous Based On The Conic Model is mapped
It is played out on face.
The method that rectangular pyramid panoramic video is identified described in the present embodiment, also directed to the characteristic of rectangular pyramid panoramic video, if
It has set the judgment mechanism of rectangular pyramid panoramic video lateral periphery pixel difference, and has automatically selected for every kind of visual form corresponding
Broadcast mode simplifies the operation of user, while can accurately carry out the identification and broadcasting of rectangular pyramid panoramic video.
Embodiment 3
As shown in figure 5, for the structural schematic diagram of the system of identification rectangular pyramid panoramic video described in the present embodiment, the present embodiment
The system is used to implement the method that rectangular pyramid panoramic video is identified described in above-described embodiment.Four are identified described in the present embodiment
The system of pyramid panoramic video includes: setup module 501, video image frame acquisition module 502, computing module 503 and rectangular pyramid
Panoramic video determination module 504.
The setup module 501 obtains 502 phase lotus root of module with the video image frame and connects, for being arranged in player
For determining side pixel variance threshold values, the bottom edge pixel variance threshold values of rectangular pyramid panoramic video.
The video image frame obtains module 502 and connects with the setup module 501 and 503 phase lotus root of computing module, be used for from
The picture frame of video is obtained in database.
The computing module 503 obtains module 502 and rectangular pyramid panoramic video determination module 504 with the video image frame
Phase lotus root connects, for calculating the aspect ratio value of described image frame；When the aspect ratio value of described image frame is 1:1, by described image
To equidistant two pixels in the side midpoint as a side pixel pair in each edge of frame, and calculate the side pixel
Pair pixel variance；
On all sides of described image frame, the pixel variance of the side pixel pair is both less than or equal to side pixel side
When poor threshold value, the gap pixel pair of adjacent both sides midpoint line two sides on described image frame is obtained, and calculates the gap pixel
Pair pixel variance.
The rectangular pyramid panoramic video determination module 504 connects with the 503 phase lotus root of computing module, in described image frame
In, when the pixel variance of all gap pixels pair is both greater than or is equal to gap pixel to variance threshold values, determine that the video is four
Pyramid panoramic video.
Further, the rectangular pyramid panoramic video determination module 504, is used for:
In described image frame, the pixel variance of all gap pixels pair is both greater than or equal to gap pixel to variance threshold values
When, using the vertex of described image frame as the vertex of rectangular pyramid, the midpoint on two sides where the vertex of the rectangular pyramid is described four
The bottom surface vertex of the bottom surface vertex of pyramid, the vertex of the rectangular pyramid and the rectangular pyramid constitutes the side of the rectangular pyramid, institute
The line for stating the bottom surface vertex of rectangular pyramid and the vertex of the rectangular pyramid constitutes the side of the rectangular pyramid；
On the side of the rectangular pyramid, the parallel pixel for being parallel to the pixel column of side of the rectangular pyramid is obtained, it will
The pixel of the side of the parallel pixel and the rectangular pyramid forms parallel pixel pair, and calculates the picture of every a line parallel pixel pair
Plain variance；
When the pixel variance of the parallel pixel pair with being gradually increased from the near to the distant at a distance from the side, sentence
The fixed video is rectangular pyramid panoramic video.
The computing module 503, is used for:
It obtains adjacent both sides midpoint line two sides on described image frame and sets number of pixels with midpoint line interval
Pixel be bottom edge gap pixel, using the corresponding bottom edge gap pixel in midpoint line two sides as gap pixel pair,
And calculate the pixel variance of the gap pixel pair.
In the above-described embodiments, optionally, the number of pixels that sets is 15 pixel.
Optionally, the side pixel variance threshold values, for less than 80；The bottom edge pixel variance threshold values, to be greater than or waiting
In 80.
By above each embodiment it is found that the method and system of identification rectangular pyramid panoramic video of the invention, existing
Beneficial effect is:
(1) method and system of identification rectangular pyramid panoramic video of the present invention are complete according to the tetragonous Based On The Conic Model of storage
The characteristic of scape video pictures, judge video to be played whether be tetragonous Based On The Conic Model panoramic video, and to the panorama determined
Video carries out rectangular pyramid model pinup picture broadcasting automatically, realizes the automatic identification of panoramic video, improves user experience.
(2) method and system of identification rectangular pyramid panoramic video of the present invention, are also provided with tetragonous Based On The Conic Model panorama
The judgment mechanism of video and planar video, and corresponding broadcast mode is automatically selected for every kind of visual form, simplify user
Operation, while can accurately carry out the broadcasting of various videos.
It should be understood by those skilled in the art that, the embodiment of the present invention can provide as method, apparatus or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the present invention, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
Although some specific embodiments of the invention are described in detail by example, the skill of this field
Art personnel it should be understood that example above merely to being illustrated, the range being not intended to be limiting of the invention.The skill of this field
Art personnel are it should be understood that can without departing from the scope and spirit of the present invention modify to above embodiments.This hair
Bright range is defined by the following claims.
Claims (8)
1. a kind of method for identifying rectangular pyramid panoramic video characterized by comprising
In player, side pixel variance threshold values for determining rectangular pyramid panoramic video, gap pixel are set to variance threshold
Value；
The picture frame of video is obtained from database and calculates the aspect ratio value of described image frame；
It is equidistant by the side midpoint is arrived in each edge of described image frame when the aspect ratio value of described image frame is 1:1
Two pixels calculate the pixel variance of the side pixel pair as a side pixel pair；Obtain phase on described image frame
Adjacent both sides midpoint line two sides and the pixel of number of pixels is set as bottom edge gap pixel, by institute with midpoint line interval
The corresponding bottom edge gap pixel in midpoint line two sides is stated as gap pixel pair；
On all sides of described image frame, the pixel variance of the side pixel pair is both less than or equal to side pixel variance threshold
When value, the gap pixel pair of adjacent both sides midpoint line two sides on described image frame is obtained, and calculates the gap pixel pair
Pixel variance；
In described image frame, the pixel variance of all gap pixels pair is both greater than or equal to the gap pixel to variance threshold values
When, determine the video for rectangular pyramid panoramic video.
2. the method for identification rectangular pyramid panoramic video according to claim 1, which is characterized in that in described image frame,
When the pixel variance of all gap pixels pair is both greater than or is equal to gap pixel to variance threshold values, determine the video for rectangular pyramid
Panoramic video, further are as follows:
In described image frame, when the pixel variance of all gap pixels pair is both greater than or is equal to gap pixel to variance threshold values,
Using the vertex of described image frame as the vertex of rectangular pyramid, the midpoint on two sides where the vertex of the rectangular pyramid is the rectangular pyramid
Bottom surface vertex, the bottom surface vertex of the vertex of the rectangular pyramid and the rectangular pyramid constitutes the side of the rectangular pyramid, described four
The line on the vertex on the bottom surface vertex and rectangular pyramid of pyramid constitutes the side of the rectangular pyramid；
On the side of the rectangular pyramid, the parallel pixel for being parallel to the pixel column of side of the rectangular pyramid is obtained, it will be described
The pixel of the side of parallel pixel and the rectangular pyramid forms parallel pixel pair, and calculates the pixel side of every a line parallel pixel pair
Difference；
From the near to the distant and when being gradually increased, institute is determined at a distance from the side in the pixel variance of the parallel pixel pair
Stating video is rectangular pyramid panoramic video.
3. the method for identification rectangular pyramid panoramic video according to claim 1, which is characterized in that the setting number of pixels
For 15 pixels.
4. the method for identification rectangular pyramid panoramic video according to claim 1, which is characterized in that the side pixel variance
Threshold value, for less than 80；The bottom edge pixel variance threshold values, for more than or equal to 80.
5. a kind of system for identifying rectangular pyramid panoramic video characterized by comprising setup module, video image frame obtain mould
Block, computing module and rectangular pyramid panoramic video determination module；
The setup module, in player, be arranged side pixel variance threshold values for determining rectangular pyramid panoramic video,
Bottom edge pixel variance threshold values；
The video image frame obtains module, for obtaining the picture frame of video from database；
The computing module, for calculating the aspect ratio value of described image frame；When the aspect ratio value of described image frame is 1:1,
Equidistant two pixels in the side midpoint will be arrived in each edge of described image frame as a side pixel pair, and calculate institute
State the pixel variance of side pixel pair；Obtain adjacent both sides midpoint line two sides and between the midpoint line on described image frame
Every the pixel for setting number of pixels as bottom edge gap pixel, the corresponding bottom edge gap pixel in midpoint line two sides is made
For gap pixel pair；
On all sides of described image frame, the pixel variance of the side pixel pair is both less than or equal to side pixel variance threshold
When value, the gap pixel pair of adjacent both sides midpoint line two sides on described image frame is obtained, and calculates the gap pixel pair
Pixel variance；
The rectangular pyramid panoramic video determination module, in described image frame, the pixel variance of all gap pixels pair to be all
When more than or equal to the gap pixel to variance threshold values, determine the video for rectangular pyramid panoramic video.
6. the system of identification rectangular pyramid panoramic video according to claim 5, which is characterized in that the rectangular pyramid aphorama
Frequency determination module, is further used for:
In described image frame, when the pixel variance of all gap pixels pair is both greater than or is equal to gap pixel to variance threshold values,
Using the vertex of described image frame as the vertex of rectangular pyramid, the midpoint on two sides where the vertex of the rectangular pyramid is the rectangular pyramid
Bottom surface vertex, the bottom surface vertex of the vertex of the rectangular pyramid and the rectangular pyramid constitutes the side of the rectangular pyramid, described four
The line on the vertex on the bottom surface vertex and rectangular pyramid of pyramid constitutes the side of the rectangular pyramid；
On the side of the rectangular pyramid, the parallel pixel for being parallel to the pixel column of side of the rectangular pyramid is obtained, it will be described
The pixel of the side of parallel pixel and the rectangular pyramid forms parallel pixel pair, and calculates the pixel side of every a line parallel pixel pair
Difference；
From the near to the distant and when being gradually increased, institute is determined at a distance from the side in the pixel variance of the parallel pixel pair
Stating video is rectangular pyramid panoramic video.
7. the system of identification rectangular pyramid panoramic video according to claim 5, which is characterized in that the setting number of pixels
For 15 pixels.
8. the system of identification rectangular pyramid panoramic video according to claim 5, which is characterized in that the side pixel variance
Threshold value, for less than 80；The bottom edge pixel variance threshold values, for more than or equal to 80.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710196925.1A CN106803994B (en) | 2017-03-29 | 2017-03-29 | Identify the method and system of rectangular pyramid panoramic video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710196925.1A CN106803994B (en) | 2017-03-29 | 2017-03-29 | Identify the method and system of rectangular pyramid panoramic video |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106803994A CN106803994A (en) | 2017-06-06 |
| CN106803994B true CN106803994B (en) | 2019-07-26 |
Family
ID=58981559
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710196925.1A Active CN106803994B (en) | 2017-03-29 | 2017-03-29 | Identify the method and system of rectangular pyramid panoramic video |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106803994B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018223318A1 (en) * | 2017-06-07 | 2018-12-13 | 深圳市柔宇科技有限公司 | 360-degree panoramic image and video identification method and electronic device |
| CN111418213B (en) * | 2017-08-23 | 2022-07-01 | 联发科技股份有限公司 | Method and apparatus for signaling syntax for immersive video coding |
| US10827159B2 (en) | 2017-08-23 | 2020-11-03 | Mediatek Inc. | Method and apparatus of signalling syntax for immersive video coding |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6754379B2 (en) * | 1998-09-25 | 2004-06-22 | Apple Computer, Inc. | Aligning rectilinear images in 3D through projective registration and calibration |
| CN103139580A (en) * | 2011-11-29 | 2013-06-05 | 长春理工大学 | Generation method of three-dimensional panoramic space stereo image |
| CN105898254A (en) * | 2016-05-17 | 2016-08-24 | 亿唐都科技（北京）有限公司 | VR (Virtual Reality) panoramic video layout method and device and VR panoramic video presentation method and system capable of saving bandwidth |
| US9503638B1 (en) * | 2013-02-04 | 2016-11-22 | UtopiaCompression Corporation | High-resolution single-viewpoint panoramic camera and method of obtaining high-resolution panoramic images with a single viewpoint |
| CN106162146A (en) * | 2016-07-29 | 2016-11-23 | 暴风集团股份有限公司 | Automatically identify and the method and system of playing panoramic video |
| CN106534974A (en) * | 2016-12-16 | 2017-03-22 | 暴风集团股份有限公司 | Method and system for automatically identifying cubic panoramic video |
-
2017
- 2017-03-29 CN CN201710196925.1A patent/CN106803994B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6754379B2 (en) * | 1998-09-25 | 2004-06-22 | Apple Computer, Inc. | Aligning rectilinear images in 3D through projective registration and calibration |
| CN103139580A (en) * | 2011-11-29 | 2013-06-05 | 长春理工大学 | Generation method of three-dimensional panoramic space stereo image |
| US9503638B1 (en) * | 2013-02-04 | 2016-11-22 | UtopiaCompression Corporation | High-resolution single-viewpoint panoramic camera and method of obtaining high-resolution panoramic images with a single viewpoint |
| CN105898254A (en) * | 2016-05-17 | 2016-08-24 | 亿唐都科技（北京）有限公司 | VR (Virtual Reality) panoramic video layout method and device and VR panoramic video presentation method and system capable of saving bandwidth |
| CN106162146A (en) * | 2016-07-29 | 2016-11-23 | 暴风集团股份有限公司 | Automatically identify and the method and system of playing panoramic video |
| CN106534974A (en) * | 2016-12-16 | 2017-03-22 | 暴风集团股份有限公司 | Method and system for automatically identifying cubic panoramic video |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106803994A (en) | 2017-06-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106162146B (en) | The method and system of automatic identification and playing panoramic video | |
| CN105654471B (en) | Augmented reality AR system and method applied to internet video live streaming | |
| US20180192044A1 (en) | Method and System for Providing A Viewport Division Scheme for Virtual Reality (VR) Video Streaming | |
| CN103559713B (en) | Method and terminal for providing augmented reality | |
| CN106534974B (en) | The method and system of automatic identification cube panoramic video | |
| CN108648257B (en) | Panoramic picture acquisition method and device, storage medium and electronic device | |
| CN106162203B (en) | Panoramic video playback method, player and wear-type virtual reality device | |
| CN107341832B (en) | Multi-view switching shooting system and method based on infrared positioning system | |
| CN106803994B (en) | Identify the method and system of rectangular pyramid panoramic video | |
| CN105898254A (en) | VR (Virtual Reality) panoramic video layout method and device and VR panoramic video presentation method and system capable of saving bandwidth | |
| CN105163158A (en) | Image processing method and device | |
| CN105898344A (en) | Method and device for playing panoramic video | |
| EP3338106B1 (en) | Generating objects in real time panoramic video | |
| CN106447788B (en) | Method and device for indicating viewing angle | |
| CN106028115A (en) | Video playing method and device | |
| US11074759B2 (en) | Apparatus, system, and method of providing a three dimensional virtual local presence | |
| CN108600858A (en) | A kind of video broadcasting method of simultaneous display AR information | |
| CN106713891B (en) | The method and system of cube panoramic video are played based on D3D interfaces | |
| US20220141440A1 (en) | Information processing apparatus, information processing method, and storage medium | |
| CN103020849A (en) | Method and system of moving scene display network sale | |
| CN108810513B (en) | Method and device for displaying picture quality of panoramic video | |
| CN108734791B (en) | Panoramic video processing method and device | |
| US20100295968A1 (en) | Medium adjusting system and method | |
| CN102075689A (en) | Character generator for rapidly making animation | |
| CN104504577B (en) | A kind of method and apparatus for delivering business object |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |