CN106803994A - Recognize the method and system of rectangular pyramid panoramic video - Google Patents

Recognize the method and system of rectangular pyramid panoramic video Download PDF

Info

Publication number
CN106803994A
CN106803994A CN201710196925.1A CN201710196925A CN106803994A CN 106803994 A CN106803994 A CN 106803994A CN 201710196925 A CN201710196925 A CN 201710196925A CN 106803994 A CN106803994 A CN 106803994A
Authority
CN
China
Prior art keywords
pixel
rectangular pyramid
gap
panoramic video
pair
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710196925.1A
Other languages
Chinese (zh)
Other versions
CN106803994B (en
Inventor
李进
朱春明
张鹏宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Storm Group Ltd By Share Ltd
Original Assignee
Storm Group Ltd By Share Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Storm Group Ltd By Share Ltd filed Critical Storm Group Ltd By Share Ltd
Priority to CN201710196925.1A priority Critical patent/CN106803994B/en
Publication of CN106803994A publication Critical patent/CN106803994A/en
Application granted granted Critical
Publication of CN106803994B publication Critical patent/CN106803994B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display

Abstract

The present invention discloses the method and system of identification rectangular pyramid panoramic video, and the method includes:In player, it is provided for judging side pixel variance threshold values, the gap pixel of rectangular pyramid panoramic video to variance threshold values;The picture frame of video is obtained from database and the aspect ratio value of picture frame is calculated;It is 1 in the aspect ratio value of picture frame:When 1, equidistant two pixels in the side midpoint will be arrived in each edge of picture frame as a side pixel pair, and calculate the pixel variance of side pixel pair;On all sides of picture frame, the pixel variance of side pixel pair is both less than or during equal to side pixel variance threshold values, obtains the gap pixel pair of adjacent both sides midpoint line both sides on picture frame, and calculated gap pixel pair pixel variance;In picture frame, the pixel variance of all gap pixels pair be both greater than or equal to gap pixel to variance threshold values when, judge that video is rectangular pyramid panoramic video.The present invention realizes the automatic identification of rectangular pyramid panoramic video.

Description

Recognize the method and system of rectangular pyramid panoramic video
Technical field
The present invention relates to the technical field of video playback, more particularly, to a kind of side for recognizing rectangular pyramid panoramic video Method and system.
Background technology
Panoramic video, i.e., 720 degree or 360 degree of panoramic videos, it is on the 720 degree or 360 degree technologies of panorama Development is extended to, and static panoramic pictures are converted into dynamic video image, and panoramic video can be upper and lower in shooting angle Any viewing dynamic video, allows user to have a kind of sensation on the spot in person in the range of 360 degree of left and right.Make when panoramic video is made 360 degree of pictures of (or 720 degree) are shot simultaneously around shooting point with one group of video camera, and by making after the image mosaic in later stage The video that can without distortions represent picture around shooting point at any time.
There is presently no the peculiar form for preserving panoramic video, existing panoramic video is still using identical with conventional video Preservation form:Panorama player plays are picture on the perspective plane centered on shooting point by splicing, mesh It is preceding that this projection is inconvenient to store, but the changing picture of projection is usually stored as rectangular image, broadcast in panorama player The rectangular image of storage is remapped to be fitted to when putting the panoramic video and played in panoramic video playing model.Therefore, it is existing It is planar video or panoramic video that video to be played cannot be automatically identified in technology, and panoramic video and planar video Broadcast mode is entirely different, if playing planar video or broadcasting with planar video in the broadcasting form of panoramic video The form of putting carrys out playing panoramic video can all cause the distortion of video pictures.For these reasons, user can only be in the prior art It was found that in the case that video playback mode is not corresponded, manual switching video playback mode is adjusted, it is very not square for user Just, greatly affected experience of the user to product.On the other hand, panoramic video playing model also has sphere model, stands Cube model and rectangular pyramid model point, if the panoramic video of rectangular pyramid model will be based on sphere model or cube model Mode carry out textures broadcasting, it is clear that be irrational.
Therefore it provides a kind of method for recognizing rectangular pyramid panoramic video is this area problem demanding prompt solution.
The content of the invention
In view of this, the invention provides a kind of method and system for recognizing rectangular pyramid panoramic video, existing skill is solved The technical problem of rectangular pyramid panoramic video can not be recognized in art.
In order to solve the above-mentioned technical problem, the present invention proposes a kind of method for recognizing rectangular pyramid panoramic video, including:
In player, it is provided for judging side pixel variance threshold values, the gap pixel other side of rectangular pyramid panoramic video Difference limen value;
The picture frame of video is obtained from database and the aspect ratio value of described image frame is calculated;
It is 1 in the aspect ratio value of described image frame:When 1, the side midpoint will be arrived in each edge of described image frame apart from phase Deng two pixels as a side pixel pair, and calculate the pixel variance of the side pixel pair;
On all sides of described image frame, the pixel variance of the side pixel pair is both less than or equal to side pixel side During difference limen value, the gap pixel pair of adjacent both sides midpoint line both sides on described image frame is obtained, and calculate the gap pixel To pixel variance;
In described image frame, the pixel variance of all gap pixels pair is both greater than or equal to the gap pixel to variance During threshold value, judge that the video is rectangular pyramid panoramic video.
Further, wherein, in described image frame, the pixel variance of all gap pixels pair is both greater than or equal to gap When pixel is to variance threshold values, judge that the video is rectangular pyramid panoramic video, further for:
In described image frame, the pixel variance of all gap pixels pair is both greater than or equal to gap pixel to variance threshold values When, the summit with the summit of described image frame as rectangular pyramid, two midpoints on side are described four where the summit of the rectangular pyramid The bottom surface summit of the bottom surface summit of pyramid, the summit of the rectangular pyramid and the rectangular pyramid constitutes the side of the rectangular pyramid, institute The line on the bottom surface summit and the summit of the rectangular pyramid of stating rectangular pyramid constitutes the side of the rectangular pyramid;
On the side of the rectangular pyramid, acquisition, will parallel to the parallel pixel of the pixel column of the side of the rectangular pyramid The parallel pixel constitutes parallel pixel pair with the pixel of the side of the rectangular pyramid, and calculates the picture per a line parallel pixel pair Plain variance;
When the pixel variance of the parallel pixel pair from the close-by examples to those far off and gradually increases with the distance with the side, sentence The fixed video is rectangular pyramid panoramic video.
Further, wherein, obtain the gap pixel pair of adjacent both sides midpoint line both sides on described image frame, and calculate The pixel variance of the gap pixel pair, further for:
Obtain described image frame on adjacent both sides midpoint line both sides and with the midpoint line interval setting number of pixels Pixel be base gap pixel, using the corresponding base gap pixel in the midpoint line both sides as gap pixel pair, And calculate the pixel variance of the gap pixel pair.
Further, wherein, it is described to set number of pixels as 15 pixels.
Further, wherein, the side pixel variance threshold values, are less than 80;The base pixel variance threshold values, are big In or equal to 80.
On the other hand, the present invention also provides a kind of system for recognizing rectangular pyramid panoramic video, including:Setup module, video Picture frame acquisition module, computing module and rectangular pyramid panoramic video determination module;
The setup module, the side pixel variance in player, being provided for judging rectangular pyramid panoramic video Threshold value, base pixel variance threshold values;
The video frame image acquisition module, the picture frame for obtaining video from database;
The computing module, the aspect ratio value for calculating described image frame;It is 1 in the aspect ratio value of described image frame:1 When, equidistant two pixels in the side midpoint will be arrived in each edge of described image frame as a side pixel pair, and count Calculate the pixel variance of the side pixel pair;
On all sides of described image frame, the pixel variance of the side pixel pair is both less than or equal to side pixel side During difference limen value, the gap pixel pair of adjacent both sides midpoint line both sides on described image frame is obtained, and calculate the gap pixel To pixel variance;
The rectangular pyramid panoramic video determination module, in described image frame, the pixel side of all gap pixels pair Difference both greater than or equal to the gap pixel to variance threshold values when, judge that the video is rectangular pyramid panoramic video.
Further, wherein, the rectangular pyramid panoramic video determination module is further used for:
In described image frame, the pixel variance of all gap pixels pair is both greater than or equal to gap pixel to variance threshold values When, the summit with the summit of described image frame as rectangular pyramid, two midpoints on side are described four where the summit of the rectangular pyramid The bottom surface summit of the bottom surface summit of pyramid, the summit of the rectangular pyramid and the rectangular pyramid constitutes the side of the rectangular pyramid, institute The line on the bottom surface summit and the summit of the rectangular pyramid of stating rectangular pyramid constitutes the side of the rectangular pyramid;
On the side of the rectangular pyramid, acquisition, will parallel to the parallel pixel of the pixel column of the side of the rectangular pyramid The parallel pixel constitutes parallel pixel pair with the pixel of the side of the rectangular pyramid, and calculates the picture per a line parallel pixel pair Plain variance;
When the pixel variance of the parallel pixel pair from the close-by examples to those far off and gradually increases with the distance with the side, sentence The fixed video is rectangular pyramid panoramic video.
Further, wherein, the computing module is further used for:
Obtain described image frame on adjacent both sides midpoint line both sides and with the midpoint line interval setting number of pixels Pixel be base gap pixel, using the corresponding base gap pixel in the midpoint line both sides as gap pixel pair, And calculate the pixel variance of the gap pixel pair.
Further, wherein, it is described to set number of pixels as 15 pixels.
Further, wherein, the side pixel variance threshold values, are less than 80;The base pixel variance threshold values, are big In or equal to 80.
Compared with prior art, the method and system of identification rectangular pyramid panoramic video of the invention, realizing following has Beneficial effect:
(1) method and system of identification rectangular pyramid panoramic video of the present invention, the rectangular pyramid model according to storage is complete The characteristic of scape video pictures, judge video to be played whether be rectangular pyramid model panoramic video, and the panorama to determining Video carries out rectangular pyramid model pinup picture broadcasting automatically, realizes the automatic identification of panoramic video, improves user experience.
(2) method and system of identification rectangular pyramid panoramic video of the present invention, are also provided with rectangular pyramid model panorama The judgment mechanism of video and planar video, and corresponding broadcast mode is automatically selected for every kind of visual form, simplify user Operation, while the broadcasting of various videos can be carried out exactly.
Certainly, implement any product of the invention must not specific needs reach all the above technique effect simultaneously.
By referring to the drawings to the detailed description of exemplary embodiment of the invention, further feature of the invention and its Advantage will be made apparent from.
Brief description of the drawings
The accompanying drawing for being combined in the description and constituting a part for specification shows embodiments of the invention, and even It is used to explain principle of the invention together with its explanation.
Fig. 1 is the schematic flow sheet of the method for identification rectangular pyramid panoramic video described in the embodiment of the present invention 1;
Fig. 2 is the schematic diagram that spherical panoramic video picture maps with corresponding rectangular pyramid image described in the embodiment of the present invention 1
Fig. 3 in Fig. 2 rectangular pyramid be launched into plane store figure schematic diagram;
Fig. 4 is the schematic flow sheet of the method for identification rectangular pyramid panoramic video described in the embodiment of the present invention 2;
Fig. 5 is the structural representation of the system of identification rectangular pyramid panoramic video described in the embodiment of the present invention 3.
Specific embodiment
Describe various exemplary embodiments of the invention in detail now with reference to accompanying drawing.It should be noted that:Unless had in addition Body illustrates that the part and the positioned opposite of step, numerical expression and numerical value for otherwise illustrating in these embodiments do not limit this The scope of invention.
The description only actually at least one exemplary embodiment is illustrative below, never as to the present invention And its any limitation applied or use.
May be not discussed in detail for technology, method and apparatus known to person of ordinary skill in the relevant, but suitable In the case of, the technology, method and apparatus should be considered as a part for specification.
In all examples shown here and discussion, any occurrence should be construed as merely exemplary, without It is as limitation.Therefore, other examples of exemplary embodiment can have different values.
It should be noted that:Similar label and letter represents similar terms in following accompanying drawing, therefore, once a certain Xiang Yi It is defined in individual accompanying drawing, then it need not be further discussed in subsequent accompanying drawing.
Embodiment 1
As shown in figure 1, recognizing the schematic flow sheet of the method for rectangular pyramid panoramic video, the present embodiment described in the present embodiment Methods described solves the technical problem for being unable to automatic identification rectangular pyramid panoramic video in the prior art.Recognized described in the present embodiment The method of rectangular pyramid panoramic video is comprised the following steps:
Step 101, in player, be provided for judging side pixel variance threshold values, the base of rectangular pyramid panoramic video Pixel variance threshold values.
Rectangular pyramid panoramic video, refer to the full-view video image that will be taken fit to rectangular pyramid model panoramic video mapping On face, the view position further according to user chooses the technology that corresponding mapping graph picture represents broadcasting in playing view window.Rectangular pyramid Panoramic video has the advantages that storage is small relative to spheroid panoramic video and cube panoramic video, is conducive to panoramic video Transmission, online broadcasting and storage.But, area of the rectangular pyramid panoramic video in rectangular pyramid bottom surface is larger, and on rectangular pyramid side Area is less and less from lower to upper, can cause more to be proximate to the fuzzyyer problem of image at the top of rectangular pyramid.Asked to solve this Topic, the rectangular pyramid panoramic video of Same Scene is in the form of four (relative to beholders all around) or more image sequence Storage, user viewing when, vision front correspondence rectangular pyramid bottom surface, and rectangular pyramid side be in user's vision remaining light position Put, therefore, do not interfere with the definition that user watches panoramic video.
But, also without automatic identification and the technology of rectangular pyramid panoramic video is played in the prior art, it is required for user's hand Dynamic selection video play mode, trivial operations are unfavorable for user experience.
In the prior art, rectangular pyramid panoramic video is that picture is placed in same picture frame on five binding faces with rectangular pyramid Form is stored, and as shown in Figures 2 and 3, Fig. 2 is the signal that spherical panoramic video picture maps with corresponding rectangular pyramid image Figure;Fig. 3 is that rectangular pyramid is launched into the schematic diagram of plane in Fig. 2.In fig. 2, the spherical panoramic video picture for photographing is located at ball O Surface on, and rectangular pyramid M-ABCD is in ball O to connect rectangular pyramid, the centre of sphere O lines of any point P and ball O on ball O surfaces There is unique intersection point Q on the surface of rectangular pyramid M-ABCD, i.e. Q points are mapping point of the P points on rectangular pyramid M-ABCD surfaces, such as This, it becomes possible to the panoramic video picture on ball O surfaces is mapped on rectangular pyramid M-ABCD surfaces.
Because currently there are no with the technology of geometric figure store video images frame, video frame image is all with the shape of plane Formula is stored, in being launched into rectangular pyramid M-ABCD planar graph and be converted to square as shown in Figure 3, wherein, summit M1, M2, M3 and M4 are M points and are converted to.And be the characteristics of rectangular pyramid panoramic video:Adjacent side (such as M1A and M1D) be all by Same pixel is converted on sphere, therefore the width of the image plane frame being converted to is identical with height.
Step 102, obtain from database the picture frame of video and calculate the aspect ratio value of described image frame.
When user sends video playback request, the mark that video is played in request, base are carried in video playback request Corresponding video data can be obtained from video database in the mark of video, video data is parsed, just can therefrom be analyzed Whether video image is full-view video image, because panoramic video is identical with common planar video storage format, it is impossible to use Conventional means determine whether panoramic video.And it is based on the storage characteristics (phase wide and high of picture frame of rectangular pyramid panoramic video Together), the aspect ratio value of rectangular pyramid panoramic video must be 1:1.
Step 103, described image frame aspect ratio value be 1:When 1, by each edge of described image frame in the side Equidistant two pixels of point calculate the pixel variance of the side pixel pair as a side pixel pair.
Step 104, on all sides of described image frame, the pixel variance of the side pixel pair is both less than or equal to side During the pixel variance threshold values of side, the gap pixel pair of adjacent both sides midpoint line both sides on described image frame is obtained, and calculate described The pixel variance of gap pixel pair.
Although the aspect ratio value of rectangular pyramid full-view video image frame is 1:1, but it is 1 to meet aspect ratio value:1 not necessarily All it is rectangular pyramid panoramic video.In rectangular pyramid panoramic video, the side on picture frame is all changed by the same side of rectangular pyramid Arrive, therefore the midpoint when that should be with this on picture frame is arranged into symmetric form.That is, the pixel of side pixel pair should Identical, it is contemplated that the error in practical operation, the pixel variance of side pixel pair should be in a less scope.
Step 105, in described image frame, the pixel variance of all gap pixels pair is both greater than or equal to gap pixel pair During variance threshold values, judge that the video is rectangular pyramid panoramic video.
The one-row pixels of bottom surface side junction both sides are gap pixel, bottom surface side junction in rectangular pyramid full-view video image Two corresponding gap pixels of both sides are gap pixel pair, in rectangular pyramid model panoramic video, due to five panoramic videos Mapping face is stitched together, and the video image on each mapping face is all independent, therefore, the gap pixel on rectangular pyramid Be with larger difference, therefore can be based on video image gap pixel to judging whether video is based on rectangular pyramid model Panoramic video.
Step 106, establishment rectangular pyramid model, and the video image is fitted to the panorama mapping of the rectangular pyramid model Played out on face.
Panoramic video based on rectangular pyramid model is played, and is that the rectangular pyramid video image that will be anticipated fits to four ribs The medial surface of Based On The Conic Model so that user obtains the feeling of immersion stayed inside rectangular pyramid panoramic video when watching.
The method of the identification rectangular pyramid panoramic video described in the present embodiment, the rectangular pyramid model panoramic video according to storage is drawn The characteristic in face, automatic identification video to be played whether be rectangular pyramid model panoramic video, and the panoramic video to determining Automatically rectangular pyramid model pinup picture broadcasting is carried out, realizes automatic identification and the broadcasting of rectangular pyramid panoramic video, improving user makes With experience.
Embodiment 2
As shown in figure 4, recognizing the schematic flow sheet of the method for rectangular pyramid panoramic video, the present embodiment described in the present embodiment On the basis of embodiment 1, the characteristic based on rectangular pyramid lateral periphery picture frame is described, further lifting rectangular pyramid aphorama The particular content of frequency identification accuracy design.Recognize that the method for rectangular pyramid panoramic video is comprised the following steps described in the present embodiment:
Step 401, in player, be provided for judging side pixel variance threshold values, the base of rectangular pyramid panoramic video Pixel variance threshold values.Alternatively, the side pixel variance threshold values, are less than 80;The base pixel variance threshold values, be more than Or equal to 80.
Step 402, obtain from database the picture frame of video and calculate the aspect ratio value of described image frame.
Step 403, described image frame aspect ratio value be 1:When 1, by each edge of described image frame in the side Equidistant two pixels of point calculate the pixel variance of the side pixel pair as a side pixel pair.
Step 404, on all sides of described image frame, the pixel variance of the side pixel pair is both less than or equal to side During the pixel variance threshold values of side, obtain described image frame on adjacent both sides midpoint line both sides and with the midpoint line be spaced set The pixel of number of pixels is base gap pixel, using the corresponding base gap pixel in the midpoint line both sides as gap Pixel pair, and calculate the pixel variance of the gap pixel pair.
Alternatively, it is described to set number of pixels as 15 pixels.
Step 405, in described image frame, the pixel variance of all gap pixels pair is both greater than or equal to gap pixel pair During variance threshold values, the summit with the summit of described image frame as rectangular pyramid, two midpoints on side where the summit of the rectangular pyramid For the bottom surface summit of the rectangular pyramid, the bottom surface summit of the summit of the rectangular pyramid and the rectangular pyramid constitutes the rectangular pyramid Side, the bottom surface summit of the rectangular pyramid constitutes the side of the rectangular pyramid with the line on the summit of the rectangular pyramid;
On the side of the rectangular pyramid, acquisition, will parallel to the parallel pixel of the pixel column of the side of the rectangular pyramid The parallel pixel constitutes parallel pixel pair with the pixel of the side of the rectangular pyramid, and calculates the picture per a line parallel pixel pair Plain variance.
Step 406, the parallel pixel pair pixel variance with the distance with the side from the close-by examples to those far off and gradually During increase, judge that the video is rectangular pyramid panoramic video.
Parallel pixel can have certain to being converted by consecutive image frame in same side on sphere Relevance, and with the distance with the side from the close-by examples to those far off, this relevance is less and less, therefore can be by this pass Connection property as rectangular pyramid panoramic video basis for estimation, further to lift the recognition accuracy of rectangular pyramid panoramic video.
In some optional embodiments, the pixel column for choosing predetermined quantity compares the variance size of parallel pixel pair, can Selection of land, the predetermined quantity can be 2 to 30 rows.
Step 407, establishment rectangular pyramid model, and the video image is fitted to the panorama mapping of the rectangular pyramid model Played out on face.
The method of the identification rectangular pyramid panoramic video described in the present embodiment, also directed to the characteristic of rectangular pyramid panoramic video, if The judgment mechanism of rectangular pyramid panoramic video lateral periphery pixel difference is put, and has been automatically selected for every kind of visual form corresponding Broadcast mode, simplifies the operation of user, while the identification and broadcasting of rectangular pyramid panoramic video can be carried out exactly.
Embodiment 3
As shown in figure 5, recognizing the structural representation of the system of rectangular pyramid panoramic video, the present embodiment described in the present embodiment Described system is used to implement the method that rectangular pyramid panoramic video is recognized described in above-described embodiment.Four are recognized described in the present embodiment The system of pyramid panoramic video includes:Setup module 501, video frame image acquisition module 502, computing module 503 and rectangular pyramid Panoramic video determination module 504.
The setup module 501 connects with the phase lotus root of the video frame image acquisition module 502, in player, setting Side pixel variance threshold values, base pixel variance threshold values for judging rectangular pyramid panoramic video.
The video frame image acquisition module 502 connects with the setup module 501 and the phase lotus root of computing module 503, for from The picture frame of video is obtained in database.
The computing module 503 and the video frame image acquisition module 502 and rectangular pyramid panoramic video determination module 504 Lotus root connects phase, the aspect ratio value for calculating described image frame;It is 1 in the aspect ratio value of described image frame:When 1, by described image To equidistant two pixels in the side midpoint as a side pixel pair in each edge of frame, and calculate the side pixel To pixel variance;
On all sides of described image frame, the pixel variance of the side pixel pair is both less than or equal to side pixel side During difference limen value, the gap pixel pair of adjacent both sides midpoint line both sides on described image frame is obtained, and calculate the gap pixel To pixel variance.
The rectangular pyramid panoramic video determination module 504 connects with the phase lotus root of the computing module 503, in described image frame In, the pixel variance of all gap pixels pair be both greater than or equal to gap pixel to variance threshold values when, judge that the video is four Pyramid panoramic video.
Further, the rectangular pyramid panoramic video determination module 504, is used for:
In described image frame, the pixel variance of all gap pixels pair is both greater than or equal to gap pixel to variance threshold values When, the summit with the summit of described image frame as rectangular pyramid, two midpoints on side are described four where the summit of the rectangular pyramid The bottom surface summit of the bottom surface summit of pyramid, the summit of the rectangular pyramid and the rectangular pyramid constitutes the side of the rectangular pyramid, institute The line on the bottom surface summit and the summit of the rectangular pyramid of stating rectangular pyramid constitutes the side of the rectangular pyramid;
On the side of the rectangular pyramid, acquisition, will parallel to the parallel pixel of the pixel column of the side of the rectangular pyramid The parallel pixel constitutes parallel pixel pair with the pixel of the side of the rectangular pyramid, and calculates the picture per a line parallel pixel pair Plain variance;
When the pixel variance of the parallel pixel pair from the close-by examples to those far off and gradually increases with the distance with the side, sentence The fixed video is rectangular pyramid panoramic video.
The computing module 503, is used for:
Obtain described image frame on adjacent both sides midpoint line both sides and with the midpoint line interval setting number of pixels Pixel be base gap pixel, using the corresponding base gap pixel in the midpoint line both sides as gap pixel pair, And calculate the pixel variance of the gap pixel pair.
In the above-described embodiments, alternatively, it is described to set number of pixels as 15 pixels.
Alternatively, the side pixel variance threshold values, are less than 80;The base pixel variance threshold values, be more than or wait In 80.
Each embodiment more than, the method and system of identification rectangular pyramid panoramic video of the invention, is present Beneficial effect is:
(1) method and system of identification rectangular pyramid panoramic video of the present invention, the rectangular pyramid model according to storage is complete The characteristic of scape video pictures, judge video to be played whether be rectangular pyramid model panoramic video, and the panorama to determining Video carries out rectangular pyramid model pinup picture broadcasting automatically, realizes the automatic identification of panoramic video, improves user experience.
(2) method and system of identification rectangular pyramid panoramic video of the present invention, are also provided with rectangular pyramid model panorama The judgment mechanism of video and planar video, and corresponding broadcast mode is automatically selected for every kind of visual form, simplify user Operation, while the broadcasting of various videos can be carried out exactly.
It should be understood by those skilled in the art that, embodiments of the invention can be provided as method, device or computer program Product.Therefore, the present invention can be using the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware Apply the form of example.And, the present invention can be used and wherein include the computer of computer usable program code at one or more The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) is produced The form of product.
Although being described in detail to some specific embodiments of the invention by example, the skill of this area Art personnel it should be understood that example above is merely to illustrate, rather than in order to limit the scope of the present invention.The skill of this area Art personnel to above example it should be understood that can modify without departing from the scope and spirit of the present invention.This hair Bright scope is defined by the following claims.

Claims (10)

1. it is a kind of recognize rectangular pyramid panoramic video method, it is characterised in that including:
In player, it is provided for judging side pixel variance threshold values, gap pixel other side's difference limen of rectangular pyramid panoramic video Value;
The picture frame of video is obtained from database and the aspect ratio value of described image frame is calculated;
It is 1 in the aspect ratio value of described image frame:When 1, will be equidistant to the side midpoint in each edge of described image frame Two pixels calculate the pixel variance of the side pixel pair as a side pixel pair;
On all sides of described image frame, the pixel variance of the side pixel pair is both less than or equal to side pixel variance threshold During value, the gap pixel pair of adjacent both sides midpoint line both sides on described image frame is obtained, and calculate the gap pixel pair Pixel variance;
In described image frame, the pixel variance of all gap pixels pair is both greater than or equal to the gap pixel to variance threshold values When, judge that the video is rectangular pyramid panoramic video.
2. it is according to claim 1 identification rectangular pyramid panoramic video method, it is characterised in that in described image frame, The pixel variance of all gap pixels pair be both greater than or equal to gap pixel to variance threshold values when, judge that the video is rectangular pyramid Panoramic video, further for:
In described image frame, the pixel variance of all gap pixels pair be both greater than or equal to gap pixel to variance threshold values when, Summit with the summit of described image frame as rectangular pyramid, two midpoints on side are the rectangular pyramid where the summit of the rectangular pyramid Bottom surface summit, the bottom surface summit of the summit of the rectangular pyramid and the rectangular pyramid constitutes the side of the rectangular pyramid, described four One bottom surface summit of pyramid constitutes the side of the rectangular pyramid with the line on the summit of the rectangular pyramid;
On the side of the rectangular pyramid, acquisition, will be described parallel to the parallel pixel of the pixel column of the side of the rectangular pyramid Parallel pixel constitutes parallel pixel pair with the pixel of the side of the rectangular pyramid, and calculates the pixel side per a line parallel pixel pair Difference;
When the pixel variance of the parallel pixel pair from the close-by examples to those far off and gradually increases with the distance with the side, institute is judged Video is stated for rectangular pyramid panoramic video.
3. it is according to claim 1 identification rectangular pyramid panoramic video method, it is characterised in that obtain described image frame on The gap pixel pair of adjacent both sides midpoint line both sides, and calculate the pixel variance of the gap pixel pair, further for:
Obtain described image frame on adjacent both sides midpoint line both sides and with the midpoint line interval setting number of pixels picture Vegetarian refreshments is base gap pixel, using the corresponding base gap pixel in the midpoint line both sides as gap pixel pair, and is counted Calculate the pixel variance of the gap pixel pair.
4. it is according to claim 3 identification rectangular pyramid panoramic video method, it is characterised in that the setting number of pixels It is 15 pixels.
5. it is according to claim 1 identification rectangular pyramid panoramic video method, it is characterised in that the side pixel variance Threshold value, is less than 80;The base pixel variance threshold values, are more than or equal to 80.
6. it is a kind of recognize rectangular pyramid panoramic video system, it is characterised in that including:Setup module, video frame image obtain mould Block, computing module and rectangular pyramid panoramic video determination module;
The setup module, in player, be provided for judging rectangular pyramid panoramic video side pixel variance threshold values, Base pixel variance threshold values;
The video frame image acquisition module, the picture frame for obtaining video from database;
The computing module, the aspect ratio value for calculating described image frame;It is 1 in the aspect ratio value of described image frame:When 1, Equidistant two pixels in the side midpoint will be arrived in each edge of described image frame as a side pixel pair, and calculate institute State the pixel variance of side pixel pair;
On all sides of described image frame, the pixel variance of the side pixel pair is both less than or equal to side pixel variance threshold During value, the gap pixel pair of adjacent both sides midpoint line both sides on described image frame is obtained, and calculate the gap pixel pair Pixel variance;
The rectangular pyramid panoramic video determination module, in described image frame, the pixel variance of all gap pixels pair to be all During more than or equal to the gap pixel to variance threshold values, judge that the video is rectangular pyramid panoramic video.
7. it is according to claim 6 identification rectangular pyramid panoramic video system, it is characterised in that the rectangular pyramid aphorama Frequency determination module, is further used for:
In described image frame, the pixel variance of all gap pixels pair be both greater than or equal to gap pixel to variance threshold values when, Summit with the summit of described image frame as rectangular pyramid, two midpoints on side are the rectangular pyramid where the summit of the rectangular pyramid Bottom surface summit, the bottom surface summit of the summit of the rectangular pyramid and the rectangular pyramid constitutes the side of the rectangular pyramid, described four One bottom surface summit of pyramid constitutes the side of the rectangular pyramid with the line on the summit of the rectangular pyramid;
On the side of the rectangular pyramid, acquisition, will be described parallel to the parallel pixel of the pixel column of the side of the rectangular pyramid Parallel pixel constitutes parallel pixel pair with the pixel of the side of the rectangular pyramid, and calculates the pixel side per a line parallel pixel pair Difference;
When the pixel variance of the parallel pixel pair from the close-by examples to those far off and gradually increases with the distance with the side, institute is judged Video is stated for rectangular pyramid panoramic video.
8. it is according to claim 6 identification rectangular pyramid panoramic video system, it is characterised in that the computing module, enter One step is used for:
Obtain described image frame on adjacent both sides midpoint line both sides and with the midpoint line interval setting number of pixels picture Vegetarian refreshments is base gap pixel, using the corresponding base gap pixel in the midpoint line both sides as gap pixel pair, and is counted Calculate the pixel variance of the gap pixel pair.
9. it is according to claim 8 identification rectangular pyramid panoramic video system, it is characterised in that the setting number of pixels It is 15 pixels.
10. it is according to claim 6 identification rectangular pyramid panoramic video system, it is characterised in that the side pixel side Difference limen value, is less than 80;The base pixel variance threshold values, are more than or equal to 80.
CN201710196925.1A 2017-03-29 2017-03-29 Identify the method and system of rectangular pyramid panoramic video Active CN106803994B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710196925.1A CN106803994B (en) 2017-03-29 2017-03-29 Identify the method and system of rectangular pyramid panoramic video

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710196925.1A CN106803994B (en) 2017-03-29 2017-03-29 Identify the method and system of rectangular pyramid panoramic video

Publications (2)

Publication Number Publication Date
CN106803994A true CN106803994A (en) 2017-06-06
CN106803994B CN106803994B (en) 2019-07-26

Family

ID=58981559

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710196925.1A Active CN106803994B (en) 2017-03-29 2017-03-29 Identify the method and system of rectangular pyramid panoramic video

Country Status (1)

Country Link
CN (1) CN106803994B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108475432A (en) * 2017-06-07 2018-08-31 深圳市柔宇科技有限公司 The recognition methods of 360 degree of panoramic pictures and 360 degree of panoramic videos and electronic device
TWI684359B (en) * 2017-08-23 2020-02-01 聯發科技股份有限公司 Method and apparatus of signalling syntax for immersive video coding
US10827159B2 (en) 2017-08-23 2020-11-03 Mediatek Inc. Method and apparatus of signalling syntax for immersive video coding

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6754379B2 (en) * 1998-09-25 2004-06-22 Apple Computer, Inc. Aligning rectilinear images in 3D through projective registration and calibration
CN103139580A (en) * 2011-11-29 2013-06-05 长春理工大学 Generation method of three-dimensional panoramic space stereo image
CN105898254A (en) * 2016-05-17 2016-08-24 亿唐都科技(北京)有限公司 VR (Virtual Reality) panoramic video layout method and device and VR panoramic video presentation method and system capable of saving bandwidth
US9503638B1 (en) * 2013-02-04 2016-11-22 UtopiaCompression Corporation High-resolution single-viewpoint panoramic camera and method of obtaining high-resolution panoramic images with a single viewpoint
CN106162146A (en) * 2016-07-29 2016-11-23 暴风集团股份有限公司 Automatically identify and the method and system of playing panoramic video
CN106534974A (en) * 2016-12-16 2017-03-22 暴风集团股份有限公司 Method and system for automatically identifying cubic panoramic video

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6754379B2 (en) * 1998-09-25 2004-06-22 Apple Computer, Inc. Aligning rectilinear images in 3D through projective registration and calibration
CN103139580A (en) * 2011-11-29 2013-06-05 长春理工大学 Generation method of three-dimensional panoramic space stereo image
US9503638B1 (en) * 2013-02-04 2016-11-22 UtopiaCompression Corporation High-resolution single-viewpoint panoramic camera and method of obtaining high-resolution panoramic images with a single viewpoint
CN105898254A (en) * 2016-05-17 2016-08-24 亿唐都科技(北京)有限公司 VR (Virtual Reality) panoramic video layout method and device and VR panoramic video presentation method and system capable of saving bandwidth
CN106162146A (en) * 2016-07-29 2016-11-23 暴风集团股份有限公司 Automatically identify and the method and system of playing panoramic video
CN106534974A (en) * 2016-12-16 2017-03-22 暴风集团股份有限公司 Method and system for automatically identifying cubic panoramic video

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108475432A (en) * 2017-06-07 2018-08-31 深圳市柔宇科技有限公司 The recognition methods of 360 degree of panoramic pictures and 360 degree of panoramic videos and electronic device
TWI684359B (en) * 2017-08-23 2020-02-01 聯發科技股份有限公司 Method and apparatus of signalling syntax for immersive video coding
US10827159B2 (en) 2017-08-23 2020-11-03 Mediatek Inc. Method and apparatus of signalling syntax for immersive video coding

Also Published As

Publication number Publication date
CN106803994B (en) 2019-07-26

Similar Documents

Publication Publication Date Title
CN106162146B (en) The method and system of automatic identification and playing panoramic video
US20180192022A1 (en) Method and System for Real-time Rendering Displaying Virtual Reality (VR) On Mobile Using Head-Up Display Devices
CN102917232A (en) Face recognition based 3D (three dimension) display self-adaptive adjusting method and face recognition based 3D display self-adaptive adjusting device
CN106534974B (en) The method and system of automatic identification cube panoramic video
CN105163158A (en) Image processing method and device
US20220329880A1 (en) Video stream processing method and apparatus, device, and medium
CN106803994A (en) Recognize the method and system of rectangular pyramid panoramic video
CN106651764A (en) Panoramic image compression method and apparatus
US20220020220A1 (en) Apparatus, system, and method of providing a three dimensional virtual local presence
CN204440872U (en) U-shapedly immerse display system
CN107134000A (en) A kind of three-dimensional dynamic images generation method and system for merging reality
CN104474710B (en) Based on large scale scene group of subscribers tracking system and the method for Kinect network
CN107197135A (en) A kind of video generation method, player method and video-generating device, playing device
CN113946210B (en) Action interaction display system and method
KR20140114548A (en) Billiards image management system
CN110910489B (en) Monocular vision-based intelligent court sports information acquisition system and method
US20210125349A1 (en) Systems and methods for visualizing ball trajectory in real-time
CN108022204A (en) A kind of method that cylinder panorama video is converted to spherical panoramic video
CN105307032A (en) Method and device for displaying audience voting numbers in real time
CN111104851B (en) Automatic generation method and system for defending area at basketball goal moment
CA2823533C (en) Virtual golf simulation apparatus and method allowing user-definition of golf ball
CN107812368A (en) A kind of basketball stands
CN107316305A (en) A kind of interactive panoramic video scaling method and device based on virtual reality
CN105407387A (en) Method of displaying number of participating team audience votes in real time and apparatus thereof
CN112130667A (en) Interaction method and system for ultra-high definition VR (virtual reality) video

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant