CN105847379A - Tracking method and tracking apparatus for panoramic video moving direction - Google Patents
Tracking method and tracking apparatus for panoramic video moving direction Download PDFInfo
- Publication number
- CN105847379A CN105847379A CN201610232551.XA CN201610232551A CN105847379A CN 105847379 A CN105847379 A CN 105847379A CN 201610232551 A CN201610232551 A CN 201610232551A CN 105847379 A CN105847379 A CN 105847379A
- Authority
- CN
- China
- Prior art keywords
- motion
- video
- visual angle
- panoramic
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
- H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/2387—Stream processing in response to a playback request from an end-user, e.g. for trick-play
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
- H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
Abstract
The invention discloses a tracking method and a tracking apparatus for a panoramic video moving direction. The method is performed through the following steps: determining the moving direction of a camera by conducting pixel tracking to the right lower part of a panoramic video of a spherical model from a cloud terminal or a server terminal, obtaining data on the moving direction, and storing the obtained data on the moving direction in the server terminal or the cloud terminal separately. When a request is made from a user's terminal for a video file containing the data on the moving direction, the server terminal or the cloud terminal sends the video data to the user's terminal in accordance to the request and transmits the data on the moving direction at the same time so that the current playing visual angle can be tuned. According to the invention, the tracking method enables a user to move to a camera, and this means that he or she does not have to slide their fingers or turn around to change a current playing visual angle.
Description
Technical field
The present invention relates to video display arts field, particularly to a kind of panoramic video direction of motion method for tracing
And follow-up mechanism.
Background technology
Panoramic video is, based on 360 panoramic techniques, static panoramic pictures is converted into dynamic video image,
Allowing video viewers have a kind of sensation the most on the spot in person, it is not by time, space and region
Limit, therefore gain great popularity.Currently, in panoramic video, the video positive direction of acquiescence is positioned at video middle,
Player give tacit consent to when playing panoramic video rise broadcast visual angle point to above-mentioned positive direction, then, user need from
Oneself slided by finger or the rotation of user self and change the visual angle of video playback.But, when panorama is taken the photograph
The when that camera being placed on the object of movement or cameraman is moved, user be often desirable to automatically along with
The movement of video camera and move, and prior art can not realize the tracking of video camera moving direction, causes using
Family cannot automatically be moved along with the movement of video camera.
Summary of the invention
In view of this, it is an object of the invention to propose a kind of panoramic video direction of motion method for tracing and tracking
Device, it is achieved with the tracking of panoramic camera moving direction.
Based on above-mentioned purpose, a first aspect of the present invention, it is provided that a kind of panoramic video direction of motion method for tracing,
Comprising:
The position, underface of spherical model panoramic video is carried out pixel tracking, determines the motion side of panoramic camera
To；
Obtaining the direction of motion data of described panoramic camera and store, described direction of motion packet contains video
Frame number and orientation angle；
The playing request reading video file sent in response to client, is sent to corresponding video file
Client plays out, and comprises video data to be played and direction of motion data in described video file.
Panoramic video direction of motion method for tracing according to the present invention, described to spherical model panoramic video just under
Position, side carries out pixel tracking, determines that the step of the direction of motion of panoramic camera specifically includes:
Calculate the motion vector that current video frame is formed in presumptive area with previous frame of video, and by this fortune
Moving vector as current video frame in the direction of motion of panoramic camera.
Panoramic video direction of motion method for tracing according to the present invention, described presumptive area is rectangular area, institute
Stating rectangular area is centered by the Geophysical South Pole of panorama environment spherical model, a width of W, the region of a height of H,
Wherein the value of W Yu H is value set in advance.
Panoramic video direction of motion method for tracing according to the present invention, the fortune of the described panoramic camera of described acquisition
Dynamic bearing data the step stored specifically include:
By the camera motion direction corresponding to the frame number of each frame of video in video image and this frame of video
Server or cloud platform is stored accordingly as direction of motion data.
A second aspect of the present invention, it is provided that another kind of panoramic video direction of motion method for tracing, comprising:
The playing request to video file is sent to server；
Receive the direction of motion data that server transmits, according to described direction of motion data, automatically adjust current
Broadcasting visual angle makes the broadcasting visual angle after adjustment consistent with the motion vector of current video frame, carries out panoramic video
Play.
Panoramic video direction of motion method for tracing according to the present invention, described according to described direction of motion data,
Automatically the broadcasting visual angle after the currently playing visual angle of adjustment makes adjustment is consistent with the motion vector of current video frame,
The step carrying out panoramic video broadcasting specifically includes:
Calculating the currently playing visual angle anglec of rotation around panorama environment spherical model Y-axis, this anglec of rotation is to work as
The angle that front broadcasting visual angle should rotate around the Y-axis of panorama environment spherical model；And
According to the described anglec of rotation calculated, adjust the new visual angle of playing after currently playing visual angle makes adjustment and refer to
To camera motion direction.
A third aspect of the present invention, it is provided that a kind of panoramic video direction of motion follow-up mechanism, comprising:
Direction of motion detection module, for the position, underface of spherical model panoramic video is carried out pixel tracking,
Determine the direction of motion of panoramic camera；
Direction of motion data memory module, for obtaining the direction of motion data of panoramic camera and storing, institute
State direction of motion packet containing video frame number and orientation angle；
Video file delivery module, for the playing request reading video file sent in response to client,
Corresponding video file is sent to client play out, described video file comprises video to be played
Data and direction of motion data.
Panoramic video direction of motion follow-up mechanism according to the present invention, described direction of motion detection module is additionally operable to,
Calculate the motion vector that current video frame and previous frame of video are formed in presumptive area, and by this motion to
Measure as current video frame in the direction of motion of panoramic camera.
Panoramic video direction of motion follow-up mechanism according to the present invention, described presumptive area is rectangular area, institute
Stating rectangular area is centered by the Geophysical South Pole of panorama environment spherical model, a width of W, the region of a height of H,
Wherein the value of W Yu H is value set in advance.
Panoramic video direction of motion follow-up mechanism according to the present invention, described direction of motion data memory module is used
In by the camera motion direction pair corresponding to the frame number of each frame of video in video image and this frame of video
Server or cloud platform should be stored in ground as direction of motion data.
A fourth aspect of the present invention, it is provided that another kind of panoramic video direction of motion follow-up mechanism, comprising:
Playing request sending module, for sending the playing request to video file to server；
Play visual angle adjusting module, for receiving the direction of motion data that server transmits, according to described motion
Bearing data, automatically adjust the motion playing visual angle and current video frame after currently playing visual angle makes adjustment to
Measure consistent, carry out panoramic video broadcasting.
Panoramic video direction of motion follow-up mechanism according to the present invention, described broadcasting visual angle adjusting module is further
Including:
Anglec of rotation calculating sub module, for calculating currently playing visual angle around panorama environment spherical model Y-axis
The anglec of rotation, this anglec of rotation is that currently playing visual angle should rotate around the Y-axis of panorama environment spherical model
Angle；And
Play visual angle and adjust submodule, described in being calculated according to described anglec of rotation calculating sub module
The anglec of rotation, adjusts the new visual angle of playing after currently playing visual angle makes adjustment and points to camera motion direction.
Described above it can be seen that according to the present invention provide panoramic video direction of motion method for tracing and tracking
Device, by beyond the clouds or server end the position, underface of the panoramic video on spherical model carried out pixel with
Track, determines the direction of motion of video camera, and acquired bearing data is stored separately on server end or high in the clouds,
When client sends the request obtaining the video file comprising direction of motion data, server end or high in the clouds
While solicited message according to client sends video data to client, transmit the direction of motion of corresponding time
Data, make it point to the direction of motion of panoramic camera for adjusting currently playing visual angle.Thus, Yong Huneng
Enough automatically move along with the movement of video camera, it is thus achieved that video appreciation effect on the spot in person, it is not necessary to from
Oneself slided by finger or user's own rotation and change the visual angle of video playback.
Accompanying drawing explanation
Fig. 1 is the axonometric chart of the panorama environment spherical model of the embodiment of the present invention；
Fig. 2 is the image shown in screen when playing visual angle and pointing to the spherical model South Pole of the embodiment of the present invention；
Fig. 3 is the enlarged drawing of the Geophysical South Pole of the panorama environment spherical model of the embodiment of the present invention；
Fig. 4 is the flow chart of the panoramic video direction of motion method for tracing of the embodiment of the present invention；
Fig. 5 is to be analyzed for the image of display in screen during the direction of motion detection of the embodiment of the present invention
Figure；
The coordinate of panorama environment spherical model when Fig. 6-1 is the adjustment video playback visual angle representing the embodiment of the present invention
The front view in space；Fig. 6-2 and Fig. 6-3 is full when being the adjustment video playback visual angle representing the embodiment of the present invention
The top view of the coordinate space of scape environment spherical model；
Fig. 7 is the structural representation of the panoramic video direction of motion follow-up mechanism of the present invention.
Detailed description of the invention
For making the object, technical solutions and advantages of the present invention clearer, below in conjunction with specific embodiment,
And referring to the drawings, the present invention is described in more detail.
It should be noted that the statement of all uses " first " and " second " is all in the embodiment of the present invention
The parameter of entity or non-equal in order to distinguish two same names non-equal, it is seen that " first " " second "
Only for the convenience of statement, should not be construed as the restriction to the embodiment of the present invention, subsequent embodiment is to this no longer
Illustrate one by one.
First the embodiment of the present invention provides a kind of panoramic video direction of motion method for tracing, comprising:
The position, underface of spherical model panoramic video is carried out pixel tracking, determines the motion side of panoramic camera
To；
Obtaining the direction of motion data of described panoramic camera and store, described direction of motion packet contains video
Frame number and orientation angle；
The playing request reading video file sent in response to client, is sent to corresponding video file
Client plays out, and comprises video data to be played and direction of motion data in described video file.
The embodiment of the present invention also provides for another kind of panoramic video direction of motion method for tracing, comprising:
The playing request to video file is sent to server；
Receive the direction of motion data that server transmits, according to described direction of motion data, automatically adjust current
Broadcasting visual angle makes the broadcasting visual angle after adjustment consistent with the motion vector of current video frame, carries out panoramic video
Play.
As it is shown in figure 1, be the axonometric chart of the spherical model of the panorama environment of the embodiment of the present invention, this spherical model
South poles can refer to the north that position is this spherical model of the surface top of the south poles of the earth, i.e. spherical model
Pole, and the South Pole that position is this spherical model of the underface top of spherical model.Due in panorama environment just
Lower position, i.e. the spherical model South Pole usually recorded the activity on ground, therefore utilize immediately below panorama environment
Video information can calculate the activity of video camera.
As in figure 2 it is shown, be showing in screen when playing visual angle and pointing to the spherical model South Pole of the embodiment of the present invention
Image, in Fig. 2, red circle part is exactly the Geophysical South Pole of spherical model.
Fig. 3 is the enlarged drawing of the Geophysical South Pole of the panorama environment spherical model of the embodiment of the present invention, is by ball in Fig. 2
The Geophysical South Pole of model amplifies the figure of display.According to this Fig. 3, position shown in cross star is panorama environment
The Geophysical South Pole of spherical model.
As described above, owing to utilizing the video information immediately below panorama environment spherical model can calculate video camera
Activity, therefore in the present invention, by beyond the clouds or the server end underface to the panoramic video on spherical model
Position carries out pixel tracking, determines the direction of motion of video camera, obtains direction of motion data, by acquired
Bearing data is stored separately on server end or high in the clouds；Direction of motion data are comprised when client sends to obtain
The request of video file time, server end or high in the clouds send video according to the solicited message of client to client
While data, transmit the direction of motion data of corresponding time, be used for adjusting currently playing visual angle.The present invention
The tracking of the panoramic camera direction of motion is i.e. realized according to this principle.
As shown in Figure 4, for the flow chart of the panoramic video direction of motion method for tracing of the present invention, the present invention's
Panoramic video direction of motion method for tracing mainly includes direction of motion detecting step S101, direction of motion data
The broadcasting both view angle adjustment step that storing step S102, video file forwarding step S103 and client are carried out
Rapid S104.It is described in detail for above-mentioned variant step below with reference to accompanying drawing.
Step S101: direction of motion detecting step, to the panoramic video on panorama environment spherical model just under
Position, side carries out pixel tracking, determines the direction of motion of panoramic camera.
As it is shown in figure 5, be to enter for the image of display in screen during the direction of motion detection of the embodiment of the present invention
The figure that row is analyzed, in Fig. 5, centered by the Geophysical South Pole of panorama environment spherical model, sets a width of W, high
For the rectangular area of H, wherein the value of W Yu H is value set in advance.
The present embodiment utilizes image motion compensation algorithm, calculates current video frame with previous frame of video at above-mentioned width
For W, the motion vector Vector formed in the rectangular area of a height of H, and by this motion vector Vector
As current video frame in the direction of motion of panoramic camera.Thus, frame of video and panoramic camera are established
The direction of motion between corresponding relation.
Person skilled both knows about, and in estimation, the simplest form of simulated motion is with one
Constant displacement represents, this constant displacement is exactly motion vector, and the basic thought of estimation is by image sequence
Each two field picture of row is divided into the macro block of some overlaps, and each pixel only makees equal translation, so in assuming block
Afterwards according to certain matching principle, find out in a certain given hunting zone in present frame each piece (i.e. when
Front piece) to former frame or most like piece of a later frame, i.e. match block, by the phase para-position of match block with current block
Putting and calculate relative displacement, obtained moving displacement is the motion vector of current block.Such as, if during t
Carve two field picture be present frame f (x, y), the two field picture in t ' moment be reference frame f ' (x, y), reference
Frame in time can in advance or lag behind present frame, when t ' < during t, referred to as forward motion estimation,
As t ' > t time, referred to as backward motion estimation, when searching in present frame t in reference frame t '
When most preferably mating of block, corresponding sports ground d (x can be obtained；T, t+t △), i.e. available current
The motion vector of frame.Therefore, based on above-mentioned thought, the acquisition of the motion vector Vector of the present invention such as may be used
In the following way:
Obtain and there is the motion vector of each macro block in the previous frame of video of motion vector, and according to described each
The motion vector of macro block obtains each macro block described from the movement locus of previous frame of video to current video frame；
Ask for successively described previous frame of video is worked as with described according to linear averaging algorithm and Linear Approximation Algorithm
The match block that in front frame of video, each macro block is corresponding, and obtain the motion of each macro block in described current video frame
Vector.
In step S101, the tracking of the panoramic camera direction of motion is limited to panorama environment spherical model
Centered by Geophysical South Pole, a width of W, carry out in the rectangular area of a height of H.
In the present invention, using rectangular model is for the mating shapes with input video source, and in order to obtain
Good video-see effect, the ratio of width to height of above-mentioned rectangular area is preferably set to and screen playback equipment
The ratio of width to height of video pictures keeps consistent.Generally, the ratio of W with H of this rectangular area can be pre-
First it is set as usual ratio 16:9.
Step S102: direction of motion data storing steps, obtains the direction of motion data of panoramic camera,
Being stored separately on server end or cloud platform, described direction of motion packet contains video frame number and orientation angle.
By the camera motion direction corresponding to the frame number of each frame of video in video image and this frame of video
(that is, orientation angle) stores in server or cloud platform as direction of motion data accordingly, counts
During according to storage, its data structure is (frameNum, Vector), i.e. (frame number, orientation angle).
As described above, motion vector current video frame and previous frame of video formed in rectangular area
Vector, as current video frame in the direction of motion of panoramic camera, and establishes frame of video and takes the photograph with panorama
Corresponding relation between the direction of motion of camera.For convenience of description, frame of video is numbered by the present invention,
And the motion vector Vector correspondingly current video frame and previous frame of video formed in rectangular area
It is also carried out numbering, such as, can set frame of video 1 corresponding motion vector Vector1 (that is, panoramic camera
The direction of motion 1), corresponding motion vector Vector2 (that is, the direction of motion of panoramic camera of frame of video 2
2) ... (n is the nature more than or equal to 1 to frame of video n correspondence motion vector Vector (n) by that analogy
Number), and by data structure (frameNum, the Vector) storage that is consequently formed to server end (or cloud
Platform).
Step S103: video file transfer step, reads broadcasting of video file in response to what client sent
Put request, corresponding video file is sent to client and plays out, described video file comprises and waits to broadcast
The video data put and direction of motion data, described direction of motion data are for adjusting currently broadcasting of panoramic video
Put visual angle.
Alternatively, step S103 can perform the most as follows:
Client (such as, mobile device) sends to server (or cloud platform) and reads broadcasting of video file
Put request, when finding clients request video file, server (or cloud platform) asking according to client
Seek information, to client transmissions video data and for adjusting the motion of the corresponding time at currently playing visual angle
Bearing data, wherein said direction of motion data are to obtain and in above-mentioned steps S102 in above-mentioned steps S101
In be stored in server or cloud platform.
It is as noted previously, as in video file and contains video data and for adjusting the motion side playing visual angle
To data, therefore server is according to the request of client, while having issued corresponding video data, also synchronizes
Issue for adjusting the direction of motion data playing visual angle.
When client from the video source of server (or cloud platform) receive video data play out time, with
Time obtain the direction of motion data that server (or cloud platform) transmits, i.e. each frame of video institute in video content
The direction of motion vector of corresponding panoramic camera.The video file obtained from server is read by client
Take, such as: be played to i-th (i is the natural number more than or equal to 1) frame, the fortune of the i-th frame will be obtained simultaneously
Dynamic direction vector (that is, motion vector) Vector (i).
The most each step S101, S102 and S103 all perform operation at server end (or cloud platform).
Step S104: play visual angle set-up procedure, when client carries out panoramic video broadcasting to video file,
According to the direction of motion data of transmission (transmitting in step S103), automatically adjust currently playing visual angle and make adjustment
After play that visual angle is consistent with the motion vector of current video frame (that is, makes the broadcasting visual angle after adjustment point to
The direction of motion of panoramic camera).
The coordinate of panorama environment spherical model when Fig. 6-1 is the adjustment video playback visual angle representing the embodiment of the present invention
The front view in space；Fig. 6-2 and Fig. 6-3 is full when being the adjustment video playback visual angle representing the embodiment of the present invention
The top view of the coordinate space of scape environment spherical model.
The coordinate of panorama environment spherical model when Fig. 6-1 is the adjustment video playback visual angle representing the embodiment of the present invention
The front view in space, also illustrates the schematic diagram of video playback apparatus display panoramic video in this Fig. 6-1.
After three-dimensional panorama creating environments success, when playing panoramic video on the display screen of video playback apparatus
Time, human eye is positioned at the sphere center position of the panorama environment spherical model shown in Fig. 6-1, and " image projection surface " can
It is considered as the display screen of video playback apparatus；In Fig. 6-1, in image projection surface rectangular pyramid region below
Land portions will be projected to perspective plane, and this spherical calotte is exactly display on video playback apparatus screen
User viewing area, therefore actually user is merely able to watch three-dimensional ball model whole of panorama environment every time
Land portions in a part for sphere, i.e. image projection surface rectangular pyramid region below.
Panorama environment ball mould when Fig. 6-2 and Fig. 6-3 is the adjustment video playback visual angle representing the embodiment of the present invention
The top view of the coordinate space of type.As shown in the top view of Fig. 6-2, X-axis and the intersection point of Z axis, i.e. coordinate
Initial point (for the centre of sphere in three-dimensional ball model) is the position at human eye place.
In step S104 of the present embodiment, play visual angle adjustment and comprise the following steps:
S1041, (that is, the anglec of rotation calculates son around the anglec of rotation of its Y-axis to calculate panorama environment spherical model
Step).
As shown in Fig. 6-3, in the top view of the coordinate space of panorama environment spherical model, respectively illustrate and work as
, there is an angle " β " between the two in front broadcasting visual angle and current frame motion direction vector.Namely
Say, one angle " β " of currently playing visual angle delayed current frame motion direction vector, and this angle " β "
It is the angle that currently playing visual angle should rotate around the Y-axis of panorama environment spherical model.
At currently playing visual angle delayed current frame motion direction vector asynchronous time, will affect panorama play effect
Fruit and the viewing effect of user.In the present invention, calculate the panorama environment spherical model anglec of rotation around its Y-axis
After degree " β ", carry out rotation process and obtain new broadcasting visual angle.
S1042, according to the described anglec of rotation calculated in calculating sub-step in the above-mentioned anglec of rotation, adjusts
Camera motion direction (that is, broadcasting visual angle tune is pointed at new visual angle of playing after whole currently playing visual angle makes adjustment
Whole sub-step).
In order to solve the problem of currently playing visual angle one angle " β " of delayed current frame motion direction vector,
In the present invention, when calculating delayed angle " β ", adjust currently playing visual angle so that it is around panorama environment
The Y-axis anglec of rotation " β " of spherical model, then after rotating the new direction of motion playing visual angle and present frame to
Amount coincides, and i.e. by adjusting currently playing visual angle, makes new broadcasting visual angle point to camera motion direction,
Thus realize user and automatically move along with the movement of video camera.
When adjust after play visual angle reach with the direction of motion of panoramic camera consistent after, user can be realized
Desired panoramic video is play, and the user that is implemented without of said process is in person slided by finger or uses
The rotation at family self and change the visual angle of video playback, it is achieved that user automatically along with video camera movement and
Mobile.
On the other hand, the embodiment of the present invention provides a kind of panoramic video direction of motion follow-up mechanism, comprising:
Direction of motion detection module, for the position, underface of spherical model panoramic video is carried out pixel tracking,
Determine the direction of motion of panoramic camera；
Direction of motion data memory module, for obtaining the direction of motion data of panoramic camera and storing, institute
State direction of motion packet containing video frame number and orientation angle；
Video file delivery module, for the playing request reading video file sent in response to client,
Corresponding video file is sent to client play out, described video file comprises video to be played
Data and direction of motion data.
The embodiment of the present invention also provides for another kind of panoramic video direction of motion follow-up mechanism, comprising:
Playing request sending module, for sending the playing request to video file to server；
Play visual angle adjusting module, for receiving the direction of motion data that server transmits, according to described motion
Bearing data, automatically adjust the motion playing visual angle and current video frame after currently playing visual angle makes adjustment to
Measure consistent, carry out panoramic video broadcasting.
As it is shown in fig. 7, be the structural representation of the panoramic video direction of motion follow-up mechanism of the present invention.This
Bright panoramic video direction of motion follow-up mechanism mainly includes direction of motion detection module 101, direction of motion number
The broadcasting both view angle adjustment mould carried out according to memory module 102, video file sending module 103 and client
Block 104.It is described in detail for above-mentioned variant module below with reference to accompanying drawing.
Direction of motion detection module 101, enters the position, underface of the panoramic video on panorama environment spherical model
Row pixel is followed the tracks of, and determines the direction of motion of panoramic camera.
In the present embodiment, utilizing image motion compensation algorithm, direction of motion detection module 101 calculates works as forward sight
Frequently frame and previous frame of video are at above-mentioned a width of W, the motion vector formed in the rectangular area of a height of H
Vector, and using this motion vector Vector as current video frame in the direction of motion of panoramic camera.By
This, establish the corresponding relation between frame of video and the direction of motion of panoramic camera.
The tracking of the panoramic camera direction of motion is limited to panorama environment by direction of motion detection module 101
Centered by the Geophysical South Pole of spherical model, a width of W, carry out in the rectangular area of a height of H.Use rectangular model
It is for the mating shapes with input video source, and in order to obtain good video-see effect, above-mentioned square
The ratio of width to height in shape region is preferably set to keep consistent with the ratio of width to height of the video pictures of screen playback equipment.
Generally, the ratio of W Yu H of this rectangular area can be redefined for usual ratio 16:9.
Direction of motion data memory module 102, obtains the direction of motion data of panoramic camera, individually stores
In server end or cloud platform, described direction of motion packet contains video frame number and orientation angle.
Frame of video is numbered by the present invention, and correspondingly to current video frame and previous frame of video at rectangle
The motion vector Vector formed in region is also carried out numbering, such as can set the corresponding motion of frame of video 1 to
Amount Vector1 (that is, the direction of motion 1 of panoramic camera), the corresponding motion vector Vector2 of frame of video 2
(that is, the direction of motion 2 of panoramic camera) ... frame of video n correspondence motion vector Vector by that analogy
(n) (n is the natural number more than or equal to 1), the number that direction of motion data memory module 102 will be consequently formed
According to structure (frameNum, Vector) storage to server end (or cloud platform).
Video file delivery module 103, the playing request reading video file sent in response to client,
Corresponding video file is sent to client play out, described video file comprises video to be played
Data and direction of motion data, described direction of motion data are for adjusting the currently playing visual angle of panoramic video.
Alternatively, this video file delivery module 103 performs to operate as follows:
Client (such as, mobile device) sends to server (or cloud platform) and reads broadcasting of video file
Putting request, when finding clients request video file, video file delivery module 103 is according to client
Solicited message, to client transmissions video data and for adjusting the fortune of the corresponding time at currently playing visual angle
Dynamic bearing data.
It is as noted previously, as in video file and contains video data and for adjusting the motion side playing visual angle
To data, therefore video file delivery module 103 is according to the request of client, has issued corresponding video data
While, also synchronize to have issued for adjusting the direction of motion data playing visual angle.
Play visual angle adjusting module 104, when client carries out panoramic video broadcasting to video file, according to regarding
The direction of motion data that frequency file delivery module 103 transmits, after the currently playing visual angle of adjustment makes adjustment automatically
Broadcasting visual angle is consistent with the motion vector of current video frame (that is, makes the broadcasting visual angle after adjustment point to panorama
The direction of motion of video camera).
The broadcasting visual angle adjusting module 104 of the present embodiment farther includes anglec of rotation calculating sub module (does not schemes
Show), for calculating the currently playing visual angle anglec of rotation around panorama environment spherical model Y-axis.
At currently playing visual angle delayed current frame motion direction vector asynchronous time, will affect panorama play effect
Fruit and the viewing effect of user.In the present invention, as shown in Fig. 6-3, anglec of rotation calculating sub module calculates
Panorama environment spherical model is after the anglec of rotation " β " of its Y-axis, and the follow-up rotation process that carries out just can obtain
New broadcasting visual angle.
The broadcasting visual angle adjusting module 104 of the present embodiment also includes that playing visual angle adjusts submodule (not shown),
According to the described anglec of rotation calculated in above-mentioned anglec of rotation calculating sub module, adjust currently playing visual angle
The new visual angle of playing after adjustment is made to point to camera motion direction.
In order to solve the problem of currently playing visual angle one angle " β " of delayed current frame motion direction vector,
In the present invention, when calculating delayed angle " β ", play visual angle adjusting module 104 and adjust currently playing
Visual angle so that it is around the Y-axis anglec of rotation " β " of panorama environment spherical model, then broadcasting visual angle new after rotating
Coincide with the direction of motion vector of present frame, i.e. by adjusting currently playing visual angle, make new broadcasting visual angle
Point to camera motion direction, thus realize user and automatically move along with the movement of video camera.
When adjust after play visual angle reach with the direction of motion of panoramic camera consistent after, user can be realized
Desired panoramic video is play, and the user that is implemented without of said process is in person slided by finger or uses
The rotation at family self and change the visual angle of video playback, it is achieved that user automatically along with video camera movement and
Mobile.
Those of ordinary skill in the field it is understood that the discussion of any of the above embodiment is exemplary only,
It is not intended to imply that the scope of the present disclosure (including claim) is limited to these examples；Think of in the present invention
Under road, can also be combined between the technical characteristic in above example or different embodiment, step can
With with random order realize, and exist the present invention as above different aspect many other change, for
Simple and clear they do not provide in the details.Therefore, all within the spirit and principles in the present invention, done
Any omission, amendment, equivalent, improvement etc., should be included within the scope of the present invention.
Claims (12)
1. a panoramic video direction of motion method for tracing, it is characterised in that including:
The position, underface of spherical model panoramic video is carried out pixel tracking, determines the motion side of panoramic camera
To；
Obtaining the direction of motion data of described panoramic camera and store, described direction of motion packet contains video
Frame number and orientation angle；
The playing request reading video file sent in response to client, is sent to corresponding video file
Client plays out, and comprises video data to be played and direction of motion data in described video file.
Panoramic video direction of motion method for tracing the most according to claim 1, it is characterised in that
The described position, underface to spherical model panoramic video carries out pixel tracking, determines the fortune of panoramic camera
The step in dynamic direction specifically includes:
Calculate the motion vector that current video frame is formed in presumptive area with previous frame of video, and by this fortune
Moving vector as current video frame in the direction of motion of panoramic camera.
Panoramic video direction of motion method for tracing the most according to claim 2, it is characterised in that described pre-
Determining region is rectangular area, and described rectangular area is centered by the Geophysical South Pole of panorama environment spherical model, a width of
W, the region of a height of H, wherein the value of W Yu H is value set in advance.
Panoramic video direction of motion method for tracing the most according to claim 1, it is characterised in that
The direction of motion data of the described panoramic camera of described acquisition the step stored specifically include:
By the camera motion direction corresponding to the frame number of each frame of video in video image and this frame of video
Server or cloud platform is stored accordingly as direction of motion data.
5. a panoramic video direction of motion method for tracing, it is characterised in that including:
The playing request to video file is sent to server；
Receive the direction of motion data that server transmits, according to described direction of motion data, automatically adjust current
Broadcasting visual angle makes the broadcasting visual angle after adjustment consistent with the motion vector of current video frame, carries out panoramic video
Play.
Panoramic video direction of motion method for tracing the most according to claim 5, it is characterised in that described
According to described direction of motion data, automatically adjust the broadcasting visual angle after currently playing visual angle makes adjustment and work as forward sight
Frequently the motion vector of frame is consistent, and the step carrying out panoramic video broadcasting specifically includes:
Calculating the currently playing visual angle anglec of rotation around panorama environment spherical model Y-axis, this anglec of rotation is to work as
The angle that front broadcasting visual angle should rotate around the Y-axis of panorama environment spherical model；And
According to the described anglec of rotation calculated, adjust the new visual angle of playing after currently playing visual angle makes adjustment and refer to
To camera motion direction.
7. a panoramic video direction of motion follow-up mechanism, it is characterised in that including:
Direction of motion detection module, for the position, underface of spherical model panoramic video is carried out pixel tracking,
Determine the direction of motion of panoramic camera；
Direction of motion data memory module, for obtaining the direction of motion data of panoramic camera and storing, institute
State direction of motion packet containing video frame number and orientation angle；
Video file delivery module, for the playing request reading video file sent in response to client,
Corresponding video file is sent to client play out, described video file comprises video to be played
Data and direction of motion data.
Panoramic video direction of motion follow-up mechanism the most according to claim 7, it is characterised in that
Described direction of motion detection module is additionally operable to, and calculates current video frame with previous frame of video in presumptive area
Interior formed motion vector, and using this motion vector as current video frame in the motion side of panoramic camera
To.
Panoramic video direction of motion follow-up mechanism the most according to claim 8, it is characterised in that described
Presumptive area is rectangular area, and described rectangular area is centered by the Geophysical South Pole of panorama environment spherical model, wide
For W, the region of a height of H, wherein the value of W Yu H is value set in advance.
Panoramic video direction of motion follow-up mechanism the most according to claim 7, it is characterised in that
Described direction of motion data memory module is for by the frame number of each frame of video in video image and should
Camera motion direction corresponding to frame of video stores server or cloud as direction of motion data accordingly
Platform.
11. 1 kinds of panoramic video direction of motion follow-up mechanisms, it is characterised in that including:
Playing request sending module, for sending the playing request to video file to server；
Play visual angle adjusting module, for receiving the direction of motion data that server transmits, according to described motion
Bearing data, automatically adjust the motion playing visual angle and current video frame after currently playing visual angle makes adjustment to
Measure consistent, carry out panoramic video broadcasting.
12. panoramic video direction of motion follow-up mechanisms according to claim 11, it is characterised in that institute
State broadcasting visual angle adjusting module to farther include:
Anglec of rotation calculating sub module, for calculating currently playing visual angle around panorama environment spherical model Y-axis
The anglec of rotation, this anglec of rotation is that currently playing visual angle should rotate around the Y-axis of panorama environment spherical model
Angle；And
Play visual angle and adjust submodule, described in being calculated according to described anglec of rotation calculating sub module
The anglec of rotation, adjusts the new visual angle of playing after currently playing visual angle makes adjustment and points to camera motion direction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610232551.XA CN105847379A (en) | 2016-04-14 | 2016-04-14 | Tracking method and tracking apparatus for panoramic video moving direction |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610232551.XA CN105847379A (en) | 2016-04-14 | 2016-04-14 | Tracking method and tracking apparatus for panoramic video moving direction |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105847379A true CN105847379A (en) | 2016-08-10 |
Family
ID=56598090
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610232551.XA Pending CN105847379A (en) | 2016-04-14 | 2016-04-14 | Tracking method and tracking apparatus for panoramic video moving direction |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105847379A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106341600A (en) * | 2016-09-23 | 2017-01-18 | 乐视控股（北京）有限公司 | Panoramic video playing processing method and device |
| CN106961597A (en) * | 2017-03-14 | 2017-07-18 | 深圳Tcl新技术有限公司 | The target tracking display methods and device of panoramic video |
| CN107888939A (en) * | 2016-09-30 | 2018-04-06 | 华为技术有限公司 | A kind of processing method and processing device of video data |
| CN108632631A (en) * | 2017-03-16 | 2018-10-09 | 华为技术有限公司 | The method for down loading and device of video slicing in a kind of panoramic video |
| CN111163267A (en) * | 2020-01-07 | 2020-05-15 | 影石创新科技股份有限公司 | Panoramic video editing method, device, equipment and storage medium |
| CN111510757A (en) * | 2019-01-31 | 2020-08-07 | 华为技术有限公司 | Method, device and system for sharing media data stream |
| WO2021139728A1 (en) * | 2020-01-07 | 2021-07-15 | 影石创新科技股份有限公司 | Panoramic video processing method, apparatus, device, and storage medium |
| CN114401253A (en) * | 2021-11-24 | 2022-04-26 | 江苏龙源振华海洋工程有限公司 | Video transmission method in simulation network based on WebRTC |
| CN115103114A (en) * | 2022-06-16 | 2022-09-23 | 京东方科技集团股份有限公司 | Panoramic video view tracking method, device, equipment and medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101894380A (en) * | 2010-07-14 | 2010-11-24 | 北京航空航天大学 | Method for tracing target object in panoramic video automatically |
| CN103747296A (en) * | 2013-12-31 | 2014-04-23 | 深圳市同洲电子股份有限公司 | Video playing method and system |
| CN104159120A (en) * | 2014-08-21 | 2014-11-19 | 北京奇艺世纪科技有限公司 | Video image stabilization method, device and system |
| CN104602129A (en) * | 2015-01-27 | 2015-05-06 | 三星电子（中国）研发中心 | Playing method and system of interactive multi-view video |
-
2016
- 2016-04-14 CN CN201610232551.XA patent/CN105847379A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101894380A (en) * | 2010-07-14 | 2010-11-24 | 北京航空航天大学 | Method for tracing target object in panoramic video automatically |
| CN103747296A (en) * | 2013-12-31 | 2014-04-23 | 深圳市同洲电子股份有限公司 | Video playing method and system |
| CN104159120A (en) * | 2014-08-21 | 2014-11-19 | 北京奇艺世纪科技有限公司 | Video image stabilization method, device and system |
| CN104602129A (en) * | 2015-01-27 | 2015-05-06 | 三星电子（中国）研发中心 | Playing method and system of interactive multi-view video |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106341600A (en) * | 2016-09-23 | 2017-01-18 | 乐视控股（北京）有限公司 | Panoramic video playing processing method and device |
| CN107888939A (en) * | 2016-09-30 | 2018-04-06 | 华为技术有限公司 | A kind of processing method and processing device of video data |
| CN106961597A (en) * | 2017-03-14 | 2017-07-18 | 深圳Tcl新技术有限公司 | The target tracking display methods and device of panoramic video |
| WO2018166224A1 (en) * | 2017-03-14 | 2018-09-20 | 深圳Tcl新技术有限公司 | Target tracking display method and apparatus for panoramic video, and storage medium |
| CN106961597B (en) * | 2017-03-14 | 2019-07-26 | 深圳Tcl新技术有限公司 | The target tracking display methods and device of panoramic video |
| CN108632631B (en) * | 2017-03-16 | 2020-08-07 | 华为技术有限公司 | Method and device for downloading video fragments in panoramic video |
| CN108632631A (en) * | 2017-03-16 | 2018-10-09 | 华为技术有限公司 | The method for down loading and device of video slicing in a kind of panoramic video |
| CN111510757A (en) * | 2019-01-31 | 2020-08-07 | 华为技术有限公司 | Method, device and system for sharing media data stream |
| CN111163267A (en) * | 2020-01-07 | 2020-05-15 | 影石创新科技股份有限公司 | Panoramic video editing method, device, equipment and storage medium |
| WO2021139728A1 (en) * | 2020-01-07 | 2021-07-15 | 影石创新科技股份有限公司 | Panoramic video processing method, apparatus, device, and storage medium |
| WO2021139731A1 (en) * | 2020-01-07 | 2021-07-15 | 影石创新科技股份有限公司 | Panoramic video clip method, apparatus and device, and storage medium |
| CN111163267B (en) * | 2020-01-07 | 2021-12-21 | 影石创新科技股份有限公司 | Panoramic video editing method, device, equipment and storage medium |
| CN114401253A (en) * | 2021-11-24 | 2022-04-26 | 江苏龙源振华海洋工程有限公司 | Video transmission method in simulation network based on WebRTC |
| CN114401253B (en) * | 2021-11-24 | 2024-03-15 | 江苏龙源振华海洋工程有限公司 | Video transmission method in analog network based on WebRTC |
| CN115103114A (en) * | 2022-06-16 | 2022-09-23 | 京东方科技集团股份有限公司 | Panoramic video view tracking method, device, equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105847379A (en) | Tracking method and tracking apparatus for panoramic video moving direction | |
| US10574889B2 (en) | Information processing device, information processing method, and program | |
| US20200288098A1 (en) | Method, apparatus, medium, terminal, and device for multi-angle free-perspective interaction | |
| US9751015B2 (en) | Augmented reality videogame broadcast programming | |
| US10403044B2 (en) | Telelocation: location sharing for users in augmented and virtual reality environments | |
| US9947139B2 (en) | Method and apparatus for providing hybrid reality environment | |
| CN103608716B (en) | Volumetric video presents | |
| CN106803966A (en) | A kind of many people's live network broadcast methods, device and its electronic equipment | |
| CN110740338B (en) | Bullet screen processing method and device, electronic equipment and storage medium | |
| CN103873453B (en) | Immerse communication customer end, server and the method for obtaining content view | |
| CN112312111A (en) | Virtual image display method and device, electronic equipment and storage medium | |
| CN106534827A (en) | Method and system for playing panoramic video based on user perspective | |
| CN105959675A (en) | Video data processing method and device | |
| US10764493B2 (en) | Display method and electronic device | |
| CN113079364A (en) | Three-dimensional display method, device, medium and electronic equipment for static object | |
| JP2018033107A (en) | Video distribution device and distribution method | |
| AU2018201913A1 (en) | System and method for adjusting an image for a vehicle mounted camera | |
| KR20120046418A (en) | System and method for providing sports game using augmented reality | |
| CN112714324B (en) | Live broadcast service processing method and device | |
| Pereira et al. | Hybrid Conference Experiences in the ARENA | |
| CN113676731A (en) | Method for compressing VR video data | |
| CN117544799A (en) | Video generation method, device, electronic equipment and storage medium | |
| CN116389707A (en) | Multi-mode VR video playing method and system | |
| KR20220125541A (en) | Method for providing mutual interaction service based on augmented reality client according to location linkage between objects in virtual space and real space | |
| CN117547817A (en) | Position adjustment method and device for virtual lens, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160810 |