CN108174240A - Panoramic video playback method and system based on user location - Google Patents
Panoramic video playback method and system based on user location Download PDFInfo
- Publication number
- CN108174240A CN108174240A CN201711473679.6A CN201711473679A CN108174240A CN 108174240 A CN108174240 A CN 108174240A CN 201711473679 A CN201711473679 A CN 201711473679A CN 108174240 A CN108174240 A CN 108174240A
- Authority
- CN
- China
- Prior art keywords
- panoramic
- camera
- user terminal
- camera position
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 56
- 230000009466 transformation Effects 0.000 claims description 10
- 230000000007 visual effect Effects 0.000 abstract description 9
- 230000007812 deficiency Effects 0.000 abstract description 2
- 230000004044 response Effects 0.000 description 11
- 230000005540 biological transmission Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 241000208340 Araliaceae Species 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000010422 painting Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25808—Management of client data
- H04N21/25825—Management of client data involving client display capabilities, e.g. screen resolution of a mobile phone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25808—Management of client data
- H04N21/25841—Management of client data involving the geographical location of the client
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/4508—Management of client data or end-user data
- H04N21/4524—Management of client data or end-user data involving the geographical location of the client
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Graphics (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Social Psychology (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The present invention provides a kind of panoramic video playback methods and system based on user location.This method includes：Obtain user terminal location；One is chosen in multiple camera positions and is used as target camera position, wherein, each in the multiple camera position is respectively equipped with panoramic camera, and the panoramic camera is suitable for acquiring the panoramic video in respective preset range；According to user terminal location and target camera position, the coordinate of the calibration point in the panoramic video captured by the panoramic camera at target camera position is determined；In the panoramic video captured by panoramic camera at the target camera position, video pictures comprising the calibration point, that there is default ken size are chosen, as the video pictures shown by user terminal.By using the above method and system, user, which does not need to manually adjust visual angle when watching panoramic video and can quickly and accurately watch the video of oneself position, shows picture, overcomes the deficiencies in the prior art.
Description
Technical field
The present invention relates to image processing field more particularly to a kind of panoramic video playback method based on user location and it is
System.
Background technology
At present, most video playing terminals have all had panoramic video playing function.It, can be with when user watches panoramic video
The viewing visual angle of panoramic video is adjusted as needed.However, traditional panoramic video is all unified broadcast when playing
Put visual angle, even with free viewing angle, spectators also easily get lost in it is confused in panoramic viewing angle, screen sliding viewing in look for
Less than the target for really wanting viewing.
Invention content
The brief overview about the present invention is given below, in order to provide about the basic of certain aspects of the invention
Understand.It should be appreciated that this general introduction is not the exhaustive general introduction about the present invention.It is not intended to determine the pass of the present invention
Key or pith, nor is it intended to limit the scope of the present invention.Its purpose only provides certain concepts in simplified form,
In this, as the preamble in greater detail discussed later.
In consideration of it, the present invention provides a kind of panoramic video playback method and system based on user location, at least to solve
Certainly user needs the video for manually adjusting visual angle and cannot quickly and accurately watching oneself position when watching panoramic video
The problem of showing picture.
According to an aspect of the invention, there is provided a kind of panoramic video playback method based on user location, this method
Including：Obtain user terminal location；One is chosen in multiple camera positions and is used as target camera position, wherein, it is the multiple
Each in camera position is respectively equipped with panoramic camera, and the panoramic camera is suitable for acquiring complete in respective preset range
Scape video；According to user terminal location and target camera position, determine captured by the panoramic camera at target camera position
The coordinate of calibration point in panoramic video；In the panoramic video captured by panoramic camera at the target camera position, choose
Video pictures comprising the calibration point, that there is default ken size, as the video pictures shown by user terminal.
According to another aspect of the present invention, a kind of panoramic video play system based on user location is additionally provided, this is
System includes：Position acquisition module, suitable for obtaining user terminal location；Selecting module, suitable for choosing one in multiple camera positions
It is a to be used as target camera position, wherein, each in the multiple camera position is respectively equipped with panoramic camera, the panorama
Video camera is suitable for acquiring the panoramic video in respective preset range；Determining module, suitable for being taken the photograph according to user terminal location and target
Image position determines the coordinate of the calibration point in the panoramic video captured by the panoramic camera at target camera position；Calibration mold
Block, suitable in the panoramic video captured by the panoramic camera at target camera position, choosing comprising the calibration point, tool
There are the video pictures of default ken size, as the video pictures shown by user terminal.
User is in the panoramic video playback method and system based on user location for using the present invention, in viewing aphorama
It does not need to manually adjust visual angle during frequency and can quickly and accurately watch the video of oneself position and show picture, overcome existing
There is the deficiency of technology.
Compared with the prior art, panoramic video playback method and system of the invention based on user location, when multiple more
Visual angle panoramic camera is positioned in scenic spot (or other scenes, such as gymnasium) each position, and multiple users are at multiple users end
End can arbitrarily connect some panoramic camera in scenic spot (or other scenes, such as gymnasium) and enter panoramic video picture,
The video pictures of oneself position are quickly positioned at some moment of viewing panoramic video, that is, the video pictures watched are
Video pictures comprising the user terminal location.It should be understood that system deployment site is not limited in scenic spot.It is in addition, complete
Scape video camera, server, user are for example in same LAN.
When multiple various visual angles panoramic cameras are positioned in each position in scenic spot, multiple user terminals can appoint in scenic spot
Meaning connects the panoramic camera viewing panoramic video of a certain position, quickly cuts picture at some moment of viewing panoramic video
Shift to the video pictures for including oneself position.
By the way that below in conjunction with detailed description of the attached drawing to highly preferred embodiment of the present invention, these and other of the invention is excellent
Point will be apparent from.
Description of the drawings
The present invention can be by reference to being better understood, wherein in institute below in association with the description given by attached drawing
Have and the same or similar reference numeral has been used in attached drawing to represent same or similar component.The attached drawing is together with following
The part for including in the present specification and being formed this specification together is described in detail, and for this is further illustrated
The preferred embodiment and explanation the principle of the present invention and advantage of invention.In the accompanying drawings：
Fig. 1 is an exemplary place for schematically showing the panoramic video playback method based on user location of the present invention
The flow chart of reason；
Fig. 2 is an exemplary knot for schematically showing the panoramic video play system based on user location of the present invention
Composition.
It will be appreciated by those skilled in the art that element in attached drawing is just for the sake of showing for the sake of simple and clear,
And be not necessarily drawn to scale.For example, the size of certain elements may be exaggerated relative to other elements in attached drawing, with
Just the understanding to the embodiment of the present invention is helped to improve.
Specific embodiment
The exemplary embodiment of the present invention is described hereinafter in connection with attached drawing.For clarity and conciseness,
All features of actual implementation mode are not described in the description.It should be understood, however, that developing any this actual implementation
It must be made during example much specific to the decision of embodiment, to realize the objectives of developer, for example, symbol
Conjunction and system and those relevant restrictive conditions of business, and these restrictive conditions may have with the difference of embodiment
Changed.In addition, it will also be appreciated that although development is likely to be extremely complex and time-consuming, to having benefited from the disclosure
For those skilled in the art of content, this development is only routine task.
Herein, it is also necessary to which explanation is a bit, in order to avoid because having obscured the present invention during unnecessary details, in the accompanying drawings
The apparatus structure closely related with scheme according to the present invention and/or processing step are illustrate only, and is omitted and the present invention
The little other details of relationship.
The embodiment provides a kind of panoramic video playback method based on user location, this method includes：It obtains
Take user terminal location；One is chosen in multiple camera positions and is used as target camera position, wherein, the multiple camera position
In each be respectively equipped with panoramic camera, the panoramic camera is suitable for acquiring the panoramic video in respective preset range；
According to user terminal location and target camera position, the panoramic video captured by the panoramic camera at target camera position is determined
In calibration point coordinate；In the panoramic video captured by panoramic camera at the target camera position, choose comprising described
Calibration point, there are the video pictures of default ken size, as the video pictures shown by user terminal.
Fig. 1 gives an exemplary process flow of the panoramic video playback method based on user location of the present invention.
In the following, by taking flow shown in Fig. 1 as an example, to describe one embodiment of the present of invention.The panorama based on user location
Video broadcasting method can for example be performed in server end.
As shown in Figure 1, in step s 110, obtain user terminal location.
According to an embodiment of the invention, panoramic video can be accessed in response to user terminal to obtain the user terminal position
It puts.In this way, in the initial time that user accesses panoramic video, just start to be adjusted panoramic video viewing angle.
Wherein, when e.g. server establishes connection with user terminal at the time of " user terminal access panoramic video ".
According to an embodiment of the invention, it oneself can also instruct to obtain the use in response to finding transmitted by user terminal
Family terminal location.In this way, can be when other any time users send adjust instruction, user terminal position be repositioned
To be adjusted to panoramic video viewing angle.
Wherein, user terminal location is for example obtained by the locating module (such as GPS module) on user terminal, such as in user
When terminal access panoramic video or when oneself instruction is found in user terminal transmission, request user terminal is obtained by positioning
Take its current location.
According to an embodiment of the invention, in step s 110, video frame information can also be obtained.
According to a realization method, video frame information can include corresponding timestamp during user terminal access panoramic video
And/or number of frames (i.e. the sequence number of video frame shown by user terminal access panoramic video).
According to another realization method, video frame information be also included within receive user terminal find oneself instruction
When corresponding timestamp and/or number of frames (come when finding oneself instruction of user terminal, user terminal receiving
The sequence number of upper shown video frame).
Wherein, video frame information can for example be obtained from user terminal.For example, user terminal can send the same of position
When, video frame information is also sent together.
In the step s 120, one is chosen in multiple camera positions and is used as target camera position, wherein, multiple camera shooting positions
Each in putting is respectively equipped with panoramic camera, and panoramic camera is suitable for acquiring the panoramic video in respective preset range.
According to an embodiment of the invention, target can be used as to choose one in multiple camera positions according to following processing
Camera position：All panoramic camera numbers are sent to user terminal, so that user terminal selects a panorama wherein
Camera number；According to the selected panoramic camera number of user terminal, which is numbered into corresponding camera shooting position
It puts as target camera position.In this way, being not required to show panoramic camera distribution map in user terminal, only show that panoramic camera is compiled
Number, user terminal independently can select panoramic camera to access, and carry out the adjustment of panoramic video viewing angle.
According to an embodiment of the invention, mesh can also be used as to choose one in multiple camera positions according to following processing
Mark camera position：Part or all of camera position is sent to user terminal, it is with display portion on the subscriber terminal or all complete
The distribution of scape video camera；According to the selected camera position of user terminal, using the camera position as target camera position.
Wherein, " the part or all of camera position " part or all of camera position being sent in user terminal is, for example, all camera shootings
Position can be either that (such as predetermined number or distance are within a predetermined range for the part nearer apart from user terminal location
It is multiple) camera position, etc..In this way, user terminal by showing panoramic camera distribution map, can independently select panoramic shooting
Machine accesses, and carries out the adjustment of panoramic video viewing angle.
In addition, according to an embodiment of the invention, user terminal location can also be based on, distance in multiple camera positions is used
Terminal location nearest camera position in family is as initial default objects camera position.It is in such manner, it is possible to automatic according to user location
The connection panoramic camera nearest apart from user location enters panoramic video, carries out the adjustment of panoramic video viewing angle.
In step s 130, according to user terminal location and target camera position, the panorama at target camera position is determined
The coordinate of calibration point in the panoramic video of shot by camera.
Wherein, each in multiple camera positions is respectively equipped with panoramic camera, and it is respective that panoramic camera is suitable for acquisition
Panoramic video in preset range.
In step S140, in the panoramic video captured by panoramic camera at the target camera position, selection includes
Calibration point, there are the video pictures of default ken size, as the video pictures shown by user terminal.
According to an embodiment of the invention, it is selected in the panoramic video captured by the panoramic camera at the target camera position
The video pictures comprising calibration point, having default ken size taken are regarded from corresponding with timestamp and/or number of frames
Frequency frame starts.That is, when user terminal access panoramic video or when oneself instruction is found in user terminal transmission
When, the above-mentioned processing by the present invention is its progress panoramic video angle adjustment, and the video sent in its terminal after adjusting
Picture, the frame picture finally shown before being adjusted with it can be the same painting face (or can be the next frames of the frame),
To ensure the continuity of its viewing.It should be understood that in other examples, the video pictures that adjustment rear line terminal is sent
The frame picture finally shown with user terminal before adjustment can also be discrete, for example, being shown after adjustment real-time
Picture.
According to an embodiment of the invention, in step s 130, such as (X can be usedw,Yw,Zw) represent user terminal location
Coordinate, in this way, can be according in the panoramic video captured by the panoramic camera at the calculating target camera position of equation below one
Coordinate (the X of calibration point in corresponding panoramic image frame1,Y1)：
Formula one：
Wherein, Zc is scale parameter, and f is the focal length of the panoramic camera at target camera position.
In addition, above-mentioned " choosing video pictures comprising calibration point, having default ken size " is, for example, with calibration point
Centered on and with the video pictures of default ken size.
According to an embodiment of the invention, in step S140, such as can be with calibration point (X1,Y1) it is picture centre, with solid
Be sized the length and width that W and H is rectangular area, wherein, which is default ken size, by the rectangular area into
Row orthographic projection converts, and obtains spherical surface or cylinder display area.The spherical surface of acquisition or cylinder display area are passed through into back project,
The corresponding planar rectangular view of the spherical surface or cylinder display area is obtained, as the video pictures shown by user terminal.
According to a realization method, when by converting when obtaining spherical surface display area, to put down to the orthographic projection of rectangular area
The projective transformation formula of face image coordinate and spherical coordinate can for example refer to equation below two：
Formula two：
Wherein, X', Y' are plane coordinates (X1,Y1) corresponding spherical coordinate.
Wherein, it presets ken size and corresponds to the width of video pictures that the Aspect Ratio of rectangle can such as be played with user terminal
High ratio is consistent.
According to an embodiment of the invention, this method can also include：Obtain the screen length of user terminal and the ratio of width
Example, as with reference to ratio；Default ken size is adjusted by scaling and/or cutting out, so that default after adjustment regards
The length-width ratio of the corresponding rectangular dimension of domain sizes is consistent with reference to ratio.For example, it is assumed that the screen length and width of user terminal
Ratio be 16:9, and Aspect Ratio in this way 4 in the default ken size of initial default:3, it can be cut in default ken size
Determine one 16:9, maximum region, as the default ken size after adjustment, in this way, the default ken size after adjustment is just
It is also 16:9 ratio enables to user terminal not shown under " played in full screen " panoramic video pattern in user terminal
There are upper and lower black surround or left and right black surrounds on screen, realize really full screen display.Alternatively, default ken size can also be carried out
It scales the default ken size length-width ratio (such as by stretching or reducing long side or broadside) and after adjusting and is equal to above-mentioned ginseng
Ratio is examined, to cause user terminal under " played in full screen " panoramic video pattern, will not show on screen exist in user terminal
Upper and lower black surround or left and right black surround.
According to an embodiment of the invention, this method can also include：In response to the request of taking pictures of user terminal, take pictures at this
The image section of interception user terminal institute real-time display in corresponding video frame images is asked, the use is sent to as result of taking pictures
Family terminal.In this way, when user terminal send out take pictures request when, can by displayed image real-time interception in its equipment to user with
It preserves, it is possible thereby to realize the purpose of taking pictures or can realizing self-timer of finding a view.
In addition, according to an embodiment of the invention, multiple camera positions can be fixed or movably.It is in this way, multiple
Panoramic camera at camera position may be entirely fixed position it is constant or be entirely it is moveable or
Possible portion is changeless and another part position is moveable, etc..
Wherein, the corresponding camera position of the fixed panoramic camera in position and/or posture are, for example, to be stored in advance in service
Device end.The corresponding camera position of position-movable panoramic camera and/or posture for example can be corresponding complete by being arranged on
What position sensor and/or attitude transducer on scape video camera obtained in real time.Position sensor for example can be GPS and/or
Barometric altimeter etc..Attitude transducer is such as can be accelerometer and/or gyroscope.
In addition, the embodiment of the present invention additionally provides a kind of panoramic video play system based on user location, the system
Including：Position acquisition module, suitable for obtaining user terminal location；Selecting module, suitable for choosing one in multiple camera positions
As target camera position, wherein, each in multiple camera positions is respectively equipped with panoramic camera, and panoramic camera is suitable for
Acquire the panoramic video in respective preset range；Determining module, suitable for according to user terminal location and target camera position, determining
The coordinate of the calibration point in the panoramic video captured by panoramic camera at target camera position；Demarcating module, suitable in mesh
Mark in the panoramic video captured by the panoramic camera at camera position, choose it is comprising calibration point, there is default ken size
Video pictures, as the video pictures shown by user terminal.
Fig. 2 gives an exemplary structure diagram of the panoramic video play system based on user location, such as Fig. 2 institutes
Show, which includes position acquisition module 210, selecting module 220, determining module 230 and demarcating module 240.
Position acquisition module 210 is used to obtain user terminal location.
Selecting module 220 is used to choose one in multiple camera positions as target camera position, wherein, multiple camera shootings
Each in position is respectively equipped with panoramic camera, and panoramic camera is suitable for acquiring the panoramic video in respective preset range.
Determining module 230 is used for according to user terminal location and target camera position, is determined complete at target camera position
The coordinate of calibration point in the panoramic video of scape shot by camera.
Demarcating module 240 is in the panoramic video captured by the panoramic camera at target camera position, selection to be wrapped
Video pictures containing calibration point, that there is default ken size, as the video pictures shown by user terminal.
According to an embodiment of the invention, the position acquisition included by the above-mentioned panoramic video play system based on user location
Module 210, selecting module 220, determining module 230 and demarcating module 240 can for example be arranged on server end.According to other realities
Example is applied, the above-mentioned panoramic video play system based on user location, can also other than the above-mentioned module for including server end
Including multiple panoramic cameras and/or the one or more user terminals being arranged at multiple camera positions.
According to an embodiment of the invention, determining module 230 can for example use (Xw,Yw,Zw) represent user terminal location seat
It marks, corresponding panoramic image frame in the panoramic video according to captured by formula one calculates the panoramic camera at target camera position
In calibration point coordinate (X1,Y1)。
According to an embodiment of the invention, video pictures comprising calibration point, that there is default ken size described above
E.g. centered on calibration point and with the video pictures of default ken size.
According to an embodiment of the invention, demarcating module 240 for example can be with calibration point (X1,Y1) it is picture centre, with fixation
Size W and H are the length and width of rectangular area, wherein, which is default ken size, which is carried out
Orthographic projection converts, and obtains spherical surface or cylinder display area；By the spherical surface of acquisition or cylinder display area by back project, obtain
The corresponding planar rectangular view of the spherical surface or cylinder display area is obtained, as the video pictures shown by user terminal.
Wherein, formula two for example may be used in flat image coordinate and the projective transformation formula of spherical coordinate.
According to an embodiment of the invention, the Aspect Ratio that default ken size corresponds to rectangle can such as be played with user terminal
The ratio of width to height of video pictures be consistent.
According to an embodiment of the invention, demarcating module 240 can for example obtain the screen length and width of user terminal
Ratio, as with reference to ratio；Default ken size is adjusted by scaling and/or cutting out, so that default after adjustment
The length-width ratio of the corresponding rectangular dimension of ken size is consistent with reference to ratio.
According to an embodiment of the invention, position acquisition module 210 for example can access panoramic video in response to user terminal,
Obtain the user terminal location.
According to an embodiment of the invention, position acquisition module 210 for example can be in response to finding transmitted by user terminal
Oneself instruction, obtains the user terminal location.
According to an embodiment of the invention, all panoramic cameras can for example be numbered and be sent to use by selecting module 220
Family terminal, so that user terminal selects a panoramic camera number wherein；According to the selected panoramic shooting of user terminal
Machine is numbered, which is numbered corresponding camera position as target camera position.
According to an embodiment of the invention, part or all of camera position can be for example sent to user by selecting module 220
Terminal, with display portion on the subscriber terminal or the distribution of whole panoramic cameras；It is taken the photograph according to user terminal is selected
Image position, using the camera position as target camera position.
According to an embodiment of the invention, selecting module 220 can for example be based on user terminal location, by multiple camera positions
The middle camera position nearest apart from user terminal location is as initial default objects camera position.
According to an embodiment of the invention, which can also for example include photo module (not shown), photo module
Such as can be in response to the request of taking pictures of user terminal, the interception user terminal institute in this takes pictures the corresponding video frame images of request
The image section of real-time display is sent to the user terminal as result of taking pictures.
According to an embodiment of the invention, multiple camera positions can be fixed or movably.
According to an embodiment of the invention, the corresponding camera position of the fixed panoramic camera in position and/or posture for example may be used
To be stored in advance in server end.
According to an embodiment of the invention, on position-movable panoramic camera for example can be equipped with position sensor and/
Or attitude transducer, the corresponding camera position of position-movable panoramic camera and/or posture for example can be by being arranged on
Position sensor and/or attitude transducer thereon obtains in real time.
According to an embodiment of the invention, position sensor can for example include GPS module and/or barometric altimeter.
According to an embodiment of the invention, attitude transducer can for example include accelerometer and/or gyroscope.
According to an embodiment of the invention, which can also for example include data obtaining module (not shown), information
Acquisition module can for example obtain video frame information (such as from user terminal), and video frame information is for example complete including user terminal access
During scape video corresponding timestamp and/or number of frames or be included in receive user terminal find oneself instruction when
Corresponding timestamp and/or number of frames.
According to an embodiment of the invention, it is selected in the panoramic video captured by the panoramic camera at the target camera position
The video pictures comprising calibration point, having default ken size taken are, for example, from corresponding with timestamp and/or number of frames
Video frame start.
It should be understood that the present invention the panoramic video play system based on user location be able to carry out it is described above
The panoramic video playback method based on user location processing, and can realize corresponding function and effect, it is no longer superfluous here
It states.
Preferred embodiment
The preferred embodiment that panoramic video visual angle adjustment is carried out in the above method of the invention and system is described below.
In this embodiment, such as can current video frame be determined according to the timestamp of user terminal access panoramic video,
Visual angle adjustment region is determined under current video frame, that is, current time.
Panoramic camera location information at known target camera position, under calibration mode, outside panoramic camera
Parameter and intrinsic parameter are it is known that i.e. known to calibration state figure below principal point, focal length f.
Obtain position information of user's terminal (Xw,Yw,Zw) (such as GPS obtain) in user equipment, according to having demarcated
Outer parameter and intrinsic parameter obtain three dimensions arbitrary point (Xw,Yw,Zw) corresponding image coordinate (X1,Y1), (X1,Y1) it is to scheme
As calibration point (not considering to distort), formula one is seen.Wherein, ZcIt is scale parameter, ZcFor user terminal and panoramic camera line shape
Into direction vector, be oriented panoramic camera to user terminal, can be according to user terminal location and target camera position at
Panoramic camera position calculate obtain.
With (X1,Y1) for picture centre, using fixed dimension W*H as rectangular area length and width, rectangular area length and width are set as and entirely
The ratio of width to height of the video pictures of scape video playback apparatus is consistent；The rectangular area is subjected to orthographic projection transformation, obtains spherical surface
Or cylinder display area；Using back project, planar rectangular view is obtained.Formula two is image coordinate and spherical coordinate
Projective transformation.
Then, user terminal video is adjusted according to the planar rectangular view and shows picture.
To sum up, this application provides following schemes：
Panoramic video playback method of the scheme 1. based on user location, which is characterized in that this method includes：
Obtain user terminal location；
One is chosen in multiple camera positions and is used as target camera position, wherein, it is every in the multiple camera position
One is respectively equipped with panoramic camera, and the panoramic camera is suitable for acquiring the panoramic video in respective preset range；
According to user terminal location and target camera position, determine captured by the panoramic camera at target camera position
The coordinate of calibration point in panoramic video；
In the panoramic video captured by panoramic camera at the target camera position, choose it is comprising the calibration point,
Video pictures with default ken size, as the video pictures shown by user terminal.
Panoramic video playback method of the scheme 2. according to scheme 1, which is characterized in that described according to user terminal location
With target camera position, the coordinate of the calibration point in the panoramic video captured by the panoramic camera at target camera position is determined
The step of include：
With (Xw,Yw,Zw) represent user terminal location coordinate, according to equation below calculate target camera position at it is complete
Coordinate (the X of calibration point in the panoramic video of scape shot by camera in corresponding panoramic image frame1,Y1)：
Wherein, Zc is scale parameter, and f is the focal length of the panoramic camera at target camera position.
Panoramic video playback method of the scheme 3. according to scheme 2, which is characterized in that described includes the calibration point
, the video pictures with default ken size are centered on the calibration point and the video picture with default ken size
Face.
Panoramic video playback method of the scheme 4. according to scheme 2 or 3, which is characterized in that described to image position in target
It puts in the panoramic video captured by the panoramic camera at place, chooses comprising the calibration point, regarding with default ken size
Frequency picture includes as the step of video pictures shown by user terminal：
With calibration point (X1,Y1) it is picture centre, using fixed dimension W and H as the length and width of rectangular area, wherein, the rectangle
Area size is the default ken size, which is carried out orthographic projection transformation, obtains spherical surface or cylinder display area；
By the spherical surface of acquisition or cylinder display area by back project, obtain the spherical surface or cylinder display area corresponds to
Planar rectangular view, as the video pictures shown by user terminal.
Panoramic video playback method of the scheme 5. according to scheme 4, which is characterized in that flat image coordinate and spherical surface are sat
Target projective transformation formula is as follows：
Wherein, X', Y' are plane coordinates (X1,Y1) corresponding spherical coordinate.
Panoramic video playback method of the scheme 6. according to scheme 5, which is characterized in that the default ken size corresponds to
The length-width ratio of rectangle is consistent with the ratio of width to height for the video pictures that user terminal plays.
Panoramic video playback method of the scheme 7. according to scheme 5 or 6, which is characterized in that this method further includes：
The screen length of user terminal and the ratio of width are obtained, as with reference to ratio；
Default ken size is adjusted by scaling and/or cutting out, so that the default ken size pair after adjustment
The length-width ratio for the rectangular dimension answered is consistent with the reference ratio.
Panoramic video playback method of the scheme 8. according to any one of scheme 1-7, which is characterized in that described obtain is used
The step of family terminal location, includes：
Panoramic video is accessed in response to user terminal, obtains the user terminal location.
Panoramic video playback method of the scheme 9. according to any one of scheme 1-7, which is characterized in that described obtain is used
The step of family terminal location, includes：
In response to finding oneself instruction transmitted by user terminal, the user terminal location is obtained.
Panoramic video playback method of the scheme 10. according to any one of scheme 1-9, which is characterized in that described more
One is chosen in a camera position as the step of target camera position to include：
All panoramic camera numbers are sent to user terminal, so that user terminal selects a panorama to take the photograph wherein
Camera is numbered；
According to the selected panoramic camera number of user terminal, which is numbered into corresponding camera position and is made
For target camera position.
Panoramic video playback method of the scheme 11. according to any one of scheme 1-9, which is characterized in that described more
One is chosen in a camera position as the step of target camera position to include：
Part or all of camera position is sent to user terminal, is taken the photograph with display portion on the subscriber terminal or whole panoramas
The distribution of camera；
According to the selected camera position of user terminal, using the camera position as target camera position.
Panoramic video playback method of the scheme 12. according to any one of scheme 1-11, which is characterized in that described more
One is chosen in a camera position as the step of target camera position to include：
Based on user terminal location, camera position nearest apart from user terminal location in the multiple camera position is made
For initial default objects camera position.
Panoramic video playback method of the scheme 13. according to any one of scheme 1-12, which is characterized in that this method is also
Including：
In response to the request of taking pictures of user terminal, the interception user terminal institute in this takes pictures the corresponding video frame images of request
The image section of real-time display is sent to the user terminal as result of taking pictures.
Panoramic video playback method of the scheme 14. according to any one of scheme 1-13, which is characterized in that multiple camera shootings
Position is fixed or moveable.
Panoramic video playback method of the scheme 15. according to scheme 14, which is characterized in that the fixed panoramic shooting in position
The corresponding camera position of machine and/or posture are stored in advance in server end；Position-movable panoramic camera is corresponding
Camera position and/or posture are that position sensor by being arranged on the panoramic camera and/or attitude transducer obtain in real time
It takes.
Panoramic video playback method of the scheme 16. according to any one of scheme 1-15, which is characterized in that this method is also
Including obtain video frame information, the video frame information include user terminal access panoramic video when corresponding timestamp and/or
Number of frames is included in corresponding timestamp and/or the frame sequence when finding oneself instruction for receiving user terminal
Row number.
Panoramic video playback method of the scheme 17. according to scheme 16, which is characterized in that at target camera position
Selected video comprising the calibration point, having default ken size is drawn in panoramic video captured by panoramic camera
Face is since video frame corresponding with the timestamp and/or number of frames.
Panoramic video play system of the scheme 18. based on user location, which is characterized in that the system includes：
Position acquisition module, suitable for obtaining user terminal location；
Selecting module is used as target camera position suitable for choosing one in multiple camera positions, wherein, it is the multiple to take the photograph
Each in image position is respectively equipped with panoramic camera, and the panoramic camera is suitable for acquiring the panorama in respective preset range
Video；
Determining module, suitable for according to user terminal location and target camera position, determining the panorama at target camera position
The coordinate of calibration point in the panoramic video of shot by camera；
Demarcating module, suitable in the panoramic video captured by the panoramic camera at target camera position, selection includes
The calibration point, there are the video pictures of default ken size, as the video pictures shown by user terminal.
Panoramic video play system of the scheme 19. according to scheme 18, which is characterized in that the determining module is suitable for：
With (Xw,Yw,Zw) represent user terminal location coordinate, according to equation below calculate target camera position at panoramic camera
Coordinate (the X of calibration point in captured panoramic video in corresponding panoramic image frame1,Y1)：
Wherein, Zc is scale parameter, and f is the focal length of the panoramic camera at target camera position.
Panoramic video play system of the scheme 20. according to scheme 19, which is characterized in that described includes the calibration
Video pictures putting, with default ken size are centered on the calibration point and the video with default ken size is drawn
Face.
Panoramic video play system of the scheme 21. according to scheme 19 or 20, which is characterized in that the demarcating module is fitted
In：With calibration point (X1,Y1) it is picture centre, using fixed dimension W and H as the length and width of rectangular area, wherein, the rectangular area
Size is the default ken size, which is carried out orthographic projection transformation, obtains spherical surface or cylinder display area；It will obtain
The spherical surface obtained or cylinder display area obtain the corresponding planar rectangular of the spherical surface or cylinder display area and regard by back project
Figure, as the video pictures shown by user terminal.
Panoramic video play system of the scheme 22. according to scheme 21, which is characterized in that flat image coordinate and spherical surface
The projective transformation formula of coordinate is as follows：
Wherein, X', Y' are plane coordinates (X1,Y1) corresponding spherical coordinate.
Panoramic video play system of the scheme 23. according to scheme 22, which is characterized in that the default ken size pair
The length-width ratio for answering rectangle is consistent with the ratio of width to height for the video pictures that user terminal plays.
Panoramic video play system of the scheme 24. according to scheme 22 or 23, which is characterized in that the demarcating module is also
It is suitable for：The screen length of user terminal and the ratio of width are obtained, as with reference to ratio；By scaling and/or cutting out to default
Ken size is adjusted so that adjustment after the corresponding rectangular dimension of default ken size length-width ratio with it is described with reference to than
Value is consistent.
Panoramic video play system of the scheme 25. according to any one of scheme 18-24, which is characterized in that institute's rheme
Acquisition module is put to be suitable for：Panoramic video is accessed in response to user terminal, obtains the user terminal location.
Panoramic video play system of the scheme 26. according to any one of scheme 18-24, which is characterized in that institute's rheme
Acquisition module is put to be suitable for：In response to finding oneself instruction transmitted by user terminal, the user terminal location is obtained.
Panoramic video play system of the scheme 27. according to any one of scheme 18-26, which is characterized in that the choosing
Module is selected to be suitable for：All panoramic camera numbers are sent to user terminal, so that user terminal selects one entirely wherein
Scape camera number；According to the selected panoramic camera number of user terminal, which is numbered into corresponding camera shooting
Position is as target camera position.
Panoramic video play system of the scheme 28. according to any one of scheme 18-26, which is characterized in that the choosing
Module is selected to be suitable for：Part or all of camera position is sent to user terminal, it is with display portion on the subscriber terminal or all complete
The distribution of scape video camera；According to the selected camera position of user terminal, using the camera position as target camera position.
Panoramic video play system of the scheme 29. according to any one of scheme 18-28, which is characterized in that the choosing
Module is selected to be suitable for：Based on user terminal location, by camera shooting position nearest apart from user terminal location in the multiple camera position
It puts as initial default objects camera position.
Panoramic video play system of the scheme 30. according to any one of scheme 18-29, which is characterized in that the system
It further includes：Photo module is adapted for the request of taking pictures of user terminal, is cut in this takes pictures the corresponding video frame images of request
The image section of user terminal institute real-time display is taken, the user terminal is sent to as result of taking pictures.
Panoramic video play system of the scheme 31. according to any one of scheme 18-30, which is characterized in that multiple to take the photograph
Image position is fixed or moveable.
Panoramic video play system of the scheme 32. according to scheme 31, which is characterized in that the fixed panoramic shooting in position
The corresponding camera position of machine and/or posture are stored in advance in server end.
Panoramic video play system of the scheme 33. according to scheme 31, which is characterized in that position-movable panorama is taken the photograph
Camera be equipped with position sensor and/or attitude transducer, the corresponding camera position of position-movable panoramic camera and/or
Posture is that position sensor by being disposed thereon and/or attitude transducer obtain in real time.
Panoramic video play system of the scheme 34. according to scheme 33, which is characterized in that the position sensor includes
GPS module and/or barometric altimeter.
Panoramic video play system of the scheme 35. according to scheme 33 or 34, which is characterized in that the attitude transducer
Including accelerometer and/or gyroscope.
Panoramic video play system of the scheme 36. according to any one of scheme 18-35, which is characterized in that the system
It further includes：Data obtaining module, suitable for obtaining video frame information, the video frame information includes user terminal and accesses panoramic video
When corresponding timestamp and/or number of frames or be included in receive user terminal find oneself instruction when institute it is right
The timestamp and/or number of frames answered.
Panoramic video play system of the scheme 37. according to scheme 36, which is characterized in that at target camera position
Selected video comprising the calibration point, having default ken size is drawn in panoramic video captured by panoramic camera
Face is since video frame corresponding with the timestamp and/or number of frames.
Panoramic video play system of the scheme 38. according to any one of scheme 18-37, which is characterized in that the system
Further include the multiple panoramic cameras being arranged at the multiple camera position.
Panoramic video play system of the scheme 39. according to any one of scheme 18-38, which is characterized in that the system
Further include one or more user terminals.
Although the embodiment according to limited quantity describes the present invention, above description, the art are benefited from
It is interior it is clear for the skilled person that in the scope of the present invention thus described, it can be envisaged that other embodiments.Additionally, it should be noted that
The language that is used in this specification primarily to readable and introduction purpose and select rather than in order to explain or limit
Determine subject of the present invention and select.Therefore, in the case of without departing from the scope and spirit of the appended claims, for this
Many modifications and changes will be apparent from for the those of ordinary skill of technical field.For the scope of the present invention, to this
The done disclosure of invention is illustrative and not restrictive, and it is intended that the scope of the present invention be defined by the claims appended hereto.
Claims (10)
1. the panoramic video playback method based on user location, which is characterized in that this method includes：
Obtain user terminal location；
One is chosen in multiple camera positions and is used as target camera position, wherein, each in the multiple camera position
Panoramic camera is respectively equipped with, the panoramic camera is suitable for acquiring the panoramic video in respective preset range；
According to user terminal location and target camera position, the panorama captured by the panoramic camera at target camera position is determined
The coordinate of calibration point in video；
In the panoramic video captured by panoramic camera at the target camera position, choose it is comprising the calibration point, have
The video pictures of default ken size, as the video pictures shown by user terminal.
2. panoramic video playback method according to claim 1, which is characterized in that described according to user terminal location and mesh
Camera position is marked, determines the step of the coordinate of calibration point in the panoramic video captured by the panoramic camera at target camera position
Suddenly include：
With (Xw,Yw,Zw) represent user terminal location coordinate, according to equation below calculate target camera position at panorama take the photograph
Coordinate (the X of calibration point in panoramic video captured by camera in corresponding panoramic image frame1,Y1)：
Wherein, Zc is scale parameter, and f is the focal length of the panoramic camera at target camera position.
3. panoramic video playback method according to claim 2, which is characterized in that described complete at target camera position
In the panoramic video of scape shot by camera, video pictures comprising the calibration point, that there is default ken size are chosen, are made
Include for the step of video pictures shown by user terminal：
With calibration point (X1,Y1) it is picture centre, using fixed dimension W and H as the length and width of rectangular area, wherein, the rectangular area
Size is the default ken size, which is carried out orthographic projection transformation, obtains spherical surface or cylinder display area；
By the spherical surface of acquisition or cylinder display area by back project, obtain the spherical surface or cylinder display area is corresponding flat
Face rectangular view, as the video pictures shown by user terminal.
4. panoramic video playback method according to claim 3, which is characterized in that flat image coordinate and spherical coordinate
Projective transformation formula is as follows：
Wherein, X', Y' are plane coordinates (X1,Y1) corresponding spherical coordinate.
5. panoramic video playback method according to claim 4, which is characterized in that the default ken size corresponds to rectangle
Length-width ratio it is consistent with the ratio of width to height for the video pictures that user terminal plays.
6. panoramic video playback method according to claim 4 or 5, which is characterized in that this method further includes：
The screen length of user terminal and the ratio of width are obtained, as with reference to ratio；
Default ken size is adjusted by scaling and/or cutting out, so that the default ken size after adjustment is corresponding
The length-width ratio of rectangular dimension is consistent with the reference ratio.
7. the panoramic video playback method according to any one of claim 1-6, which is characterized in that described in multiple camera shootings
One is chosen in position as the step of target camera position to include：
Part or all of camera position is sent to user terminal, with display portion on the subscriber terminal or whole panoramic cameras
Distribution；
According to the selected camera position of user terminal, using the camera position as target camera position.
8. the panoramic video playback method according to any one of claim 1-7, which is characterized in that described in multiple camera shootings
One is chosen in position as the step of target camera position to include：
Based on user terminal location, using camera position nearest apart from user terminal location in the multiple camera position as just
The default objects camera position of beginning.
9. the panoramic video playback method according to any one of claim 1-8, which is characterized in that multiple camera positions are
It is fixed or moveable.
10. the panoramic video play system based on user location, which is characterized in that the system includes：
Position acquisition module, suitable for obtaining user terminal location；
Selecting module is used as target camera position suitable for choosing one in multiple camera positions, wherein, the multiple camera shooting position
Each in putting is respectively equipped with panoramic camera, and the panoramic camera is suitable for acquiring the aphorama in respective preset range
Frequently；
Determining module, suitable for according to user terminal location and target camera position, determining the panoramic shooting at target camera position
The coordinate of the calibration point in panoramic video captured by machine；
Demarcating module, suitable in the panoramic video captured by the panoramic camera at target camera position, choosing comprising described
Calibration point, there are the video pictures of default ken size, as the video pictures shown by user terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711473679.6A CN108174240B (en) | 2017-12-29 | 2017-12-29 | Panoramic video playing method and system based on user position |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711473679.6A CN108174240B (en) | 2017-12-29 | 2017-12-29 | Panoramic video playing method and system based on user position |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108174240A true CN108174240A (en) | 2018-06-15 |
| CN108174240B CN108174240B (en) | 2020-07-10 |
Family
ID=62519726
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711473679.6A Active CN108174240B (en) | 2017-12-29 | 2017-12-29 | Panoramic video playing method and system based on user position |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108174240B (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109040846A (en) * | 2018-07-13 | 2018-12-18 | 北京幻鲸数字科技有限公司 | Panoramic video playback method and device |
| CN109379455A (en) * | 2018-09-27 | 2019-02-22 | 维沃移动通信有限公司 | A kind of image-recognizing method and device based on mobile terminal |
| CN110267026A (en) * | 2019-07-05 | 2019-09-20 | 浙江开奇科技有限公司 | Data processing method, mobile terminal and system based on 5G network |
| CN110365900A (en) * | 2019-07-16 | 2019-10-22 | 中国三峡建设管理有限公司 | A kind of panoramic shooting system |
| CN111669604A (en) * | 2019-03-07 | 2020-09-15 | 阿里巴巴集团控股有限公司 | Acquisition equipment setting method and device, terminal, acquisition system and equipment |
| CN113055587A (en) * | 2019-12-27 | 2021-06-29 | 财团法人工业技术研究院 | Panoramic video processing method, panoramic video processing device and panoramic video system |
| CN113596544A (en) * | 2021-07-26 | 2021-11-02 | 王博 | Video generation method and device, electronic equipment and storage medium |
| CN114500846A (en) * | 2022-02-12 | 2022-05-13 | 北京蜂巢世纪科技有限公司 | Method, device and equipment for switching viewing angles of live action and readable storage medium |
| CN114830676A (en) * | 2019-12-24 | 2022-07-29 | 皇家Kpn公司 | Video processing device and manifest file for video streaming |
| CN115278193A (en) * | 2021-04-30 | 2022-11-01 | 中国移动通信集团河北有限公司 | Panoramic video distribution method, device, equipment and computer storage medium |
| US11521347B2 (en) | 2019-03-07 | 2022-12-06 | Alibaba Group Holding Limited | Method, apparatus, medium, and device for generating multi-angle free-respective image data |
| CN117278733A (en) * | 2023-11-22 | 2023-12-22 | 潍坊威龙电子商务科技有限公司 | Display method and system of panoramic camera in VR head display |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014008185A1 (en) * | 2012-07-02 | 2014-01-09 | Sony Computer Entertainment Inc. | Methods and systems for interaction with an expanded information space |
| JP2015231114A (en) * | 2014-06-04 | 2015-12-21 | 日本電信電話株式会社 | Video display device |
| US20160323559A1 (en) * | 2015-04-29 | 2016-11-03 | Panasonic Intellectual Property Management Co., Ltd. | Method for selecting cameras and image distribution system capable of appropriately selecting cameras |
| CN106447788A (en) * | 2016-09-26 | 2017-02-22 | 北京疯景科技有限公司 | Watching angle indication method and device |
| US20170061696A1 (en) * | 2015-08-31 | 2017-03-02 | Samsung Electronics Co., Ltd. | Virtual reality display apparatus and display method thereof |
| CN106657923A (en) * | 2017-01-10 | 2017-05-10 | 哈尔滨市舍科技有限公司 | Scene changing shared viewing system based on position |
| CN107135207A (en) * | 2017-04-19 | 2017-09-05 | 中国电子科技集团公司电子科学研究院 | A kind of panorama meeting live broadcasting method and system |
| CN107155065A (en) * | 2017-06-28 | 2017-09-12 | 哈尔滨市舍科技有限公司 | A kind of virtual photograph device and method |
| CN107318008A (en) * | 2016-04-27 | 2017-11-03 | 深圳看到科技有限公司 | Panoramic video player method and playing device |
-
2017
- 2017-12-29 CN CN201711473679.6A patent/CN108174240B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014008185A1 (en) * | 2012-07-02 | 2014-01-09 | Sony Computer Entertainment Inc. | Methods and systems for interaction with an expanded information space |
| JP2015231114A (en) * | 2014-06-04 | 2015-12-21 | 日本電信電話株式会社 | Video display device |
| US20160323559A1 (en) * | 2015-04-29 | 2016-11-03 | Panasonic Intellectual Property Management Co., Ltd. | Method for selecting cameras and image distribution system capable of appropriately selecting cameras |
| US20170061696A1 (en) * | 2015-08-31 | 2017-03-02 | Samsung Electronics Co., Ltd. | Virtual reality display apparatus and display method thereof |
| CN107318008A (en) * | 2016-04-27 | 2017-11-03 | 深圳看到科技有限公司 | Panoramic video player method and playing device |
| CN106447788A (en) * | 2016-09-26 | 2017-02-22 | 北京疯景科技有限公司 | Watching angle indication method and device |
| CN106657923A (en) * | 2017-01-10 | 2017-05-10 | 哈尔滨市舍科技有限公司 | Scene changing shared viewing system based on position |
| CN107135207A (en) * | 2017-04-19 | 2017-09-05 | 中国电子科技集团公司电子科学研究院 | A kind of panorama meeting live broadcasting method and system |
| CN107155065A (en) * | 2017-06-28 | 2017-09-12 | 哈尔滨市舍科技有限公司 | A kind of virtual photograph device and method |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109040846B (en) * | 2018-07-13 | 2021-06-18 | 北京幻鲸数字科技有限公司 | Panoramic video playing method and device |
| CN109040846A (en) * | 2018-07-13 | 2018-12-18 | 北京幻鲸数字科技有限公司 | Panoramic video playback method and device |
| CN109379455A (en) * | 2018-09-27 | 2019-02-22 | 维沃移动通信有限公司 | A kind of image-recognizing method and device based on mobile terminal |
| CN109379455B (en) * | 2018-09-27 | 2021-07-30 | 维沃移动通信有限公司 | Image identification method and device based on mobile terminal |
| US11521347B2 (en) | 2019-03-07 | 2022-12-06 | Alibaba Group Holding Limited | Method, apparatus, medium, and device for generating multi-angle free-respective image data |
| CN111669604A (en) * | 2019-03-07 | 2020-09-15 | 阿里巴巴集团控股有限公司 | Acquisition equipment setting method and device, terminal, acquisition system and equipment |
| CN110267026A (en) * | 2019-07-05 | 2019-09-20 | 浙江开奇科技有限公司 | Data processing method, mobile terminal and system based on 5G network |
| CN110365900A (en) * | 2019-07-16 | 2019-10-22 | 中国三峡建设管理有限公司 | A kind of panoramic shooting system |
| CN114830676A (en) * | 2019-12-24 | 2022-07-29 | 皇家Kpn公司 | Video processing device and manifest file for video streaming |
| CN113055587A (en) * | 2019-12-27 | 2021-06-29 | 财团法人工业技术研究院 | Panoramic video processing method, panoramic video processing device and panoramic video system |
| CN115278193A (en) * | 2021-04-30 | 2022-11-01 | 中国移动通信集团河北有限公司 | Panoramic video distribution method, device, equipment and computer storage medium |
| CN113596544A (en) * | 2021-07-26 | 2021-11-02 | 王博 | Video generation method and device, electronic equipment and storage medium |
| CN114500846A (en) * | 2022-02-12 | 2022-05-13 | 北京蜂巢世纪科技有限公司 | Method, device and equipment for switching viewing angles of live action and readable storage medium |
| CN114500846B (en) * | 2022-02-12 | 2024-04-02 | 北京蜂巢世纪科技有限公司 | Live action viewing angle switching method, device, equipment and readable storage medium |
| CN117278733A (en) * | 2023-11-22 | 2023-12-22 | 潍坊威龙电子商务科技有限公司 | Display method and system of panoramic camera in VR head display |
| CN117278733B (en) * | 2023-11-22 | 2024-03-19 | 潍坊威龙电子商务科技有限公司 | Display method and system of panoramic camera in VR head display |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108174240B (en) | 2020-07-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108174240A (en) | Panoramic video playback method and system based on user location | |
| EP3356887B1 (en) | Method for stitching together images taken through fisheye lens in order to produce 360-degree spherical panorama | |
| US10425638B2 (en) | Equipment and method for promptly performing calibration and verification of intrinsic and extrinsic parameters of a plurality of image capturing elements installed on electronic device | |
| US9215383B2 (en) | System for enhancing video from a mobile camera | |
| WO2016165488A1 (en) | Photo processing method and device | |
| JP5659305B2 (en) | Image generating apparatus and image generating method | |
| US8605174B2 (en) | Apparatus, method, and system of image processing, and recording medium storing image processing control program | |
| CN102550015B (en) | Multiple views imaging control device and multiple views filming control method | |
| US20060181610A1 (en) | Method and device for generating wide image sequences | |
| US20150147000A1 (en) | Method and apparatus for fusion of images | |
| CN104519340B (en) | Panoramic video joining method based on many depth images transformation matrix | |
| WO2013069047A1 (en) | Image generation device, and image generation method | |
| US20060165310A1 (en) | Method and apparatus for a virtual scene previewing system | |
| JP2016096487A (en) | Imaging system | |
| JPWO2013069049A1 (en) | Image generating apparatus and image generating method | |
| WO2016131217A1 (en) | Image correction method and device | |
| WO2017218834A1 (en) | System and method for capturing and viewing panoramic images having motion parralax depth perception without images stitching | |
| CN106447735A (en) | Panoramic camera geometric calibration processing method | |
| CN108933896A (en) | The method and system of the steady picture of panoramic video based on Inertial Measurement Unit | |
| CN112995638A (en) | Naked eye 3D acquisition and display system and method capable of automatically adjusting parallax | |
| JP2000112019A (en) | Electronic triplet lens camera apparatus | |
| CN107743222B (en) | Image data processing method based on collector and three-dimensional panorama VR collector | |
| Ikeda et al. | Calibration method for an omnidirectional multicamera system | |
| JP2009141508A (en) | Television conference device, television conference method, program, and recording medium | |
| EP0601208B1 (en) | Method and equipment for printing 3-d stereograph |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 266100 Block C 200-43, Chuangke Street, Qingdao, 306 Ningxia Road, Laoshan District, Qingdao City, Shandong Province Applicant after: QINGDAO YISPACE TECHNOLOGY Co.,Ltd. Address before: 150016 Heilongjiang Province, Harbin Economic Development Zone haping Road District Dalian road and Xingkai road junction Applicant before: HARBIN YISHE TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240726 Address after: 150001 No. 92 West straight street, Nangang District, Heilongjiang, Harbin Patentee after: HARBIN INSTITUTE OF TECHNOLOGY Country or region after: China Address before: Room 200-43, block C, Qingdao maker street, 306 Ningxia road, Laoshan District, Qingdao City, Shandong Province 266100 Patentee before: QINGDAO YISPACE TECHNOLOGY Co.,Ltd. Country or region before: China |