CN108650500B - A kind of panoramic video processing method and processing device - Google Patents
A kind of panoramic video processing method and processing device Download PDFInfo
- Publication number
- CN108650500B CN108650500B CN201810283639.3A CN201810283639A CN108650500B CN 108650500 B CN108650500 B CN 108650500B CN 201810283639 A CN201810283639 A CN 201810283639A CN 108650500 B CN108650500 B CN 108650500B
- Authority
- CN
- China
- Prior art keywords
- sight
- panoramic video
- coordinate system
- focus information
- spherical coordinate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
Abstract
The embodiment of the invention provides a kind of panoramic video processing method and processing device, method includes: the first sight focus information determined when obtaining user using panoramic video terminal viewing source panoramic video；Determine the first sight focus information corresponding second sight focus information in preset second panorama spherical coordinate system, wherein the second panorama spherical coordinate system is using the time of broadcast source panoramic video as axis；According to the second sight focus information, the Eye-controlling focus map of source panoramic video is determined；Source panoramic video is handled according to Eye-controlling focus map, obtains target panoramic video.The embodiment of the present invention is handled the content of source panoramic video according to Eye-controlling focus map, so as to which the position that user is accustomed to viewing is arranged in excellent video content, video production side is provided and meets the panoramic video that user watches habit, improves user's viewing experience.
Description
Technical field
The present invention relates to technical field of video processing, more particularly to a kind of panoramic video processing method and processing device.
Background technique
With the development of video processing technique, panoramic video is more and more applied, and panoramic video is a kind of full side
The video of 360 degree of position, user can arbitrarily adjust video and be watched up and down when watching video.
In the prior art, video production side is when making panoramic video, often only according to the plot content of video, complete
The crucial plot content of the different zones setting of scape video.
However, those skilled in the art have found during studying above-mentioned technical proposal, user is in viewing panoramic video
When, synchronization is only capable of watching limited content, and often will appear: video production side is in the well-designed key of some regions
Content is not seen by the user, and while wasting video production side's video production resource, seriously affects the viewing experience of user.
Summary of the invention
In view of the above problems, it proposes the embodiment of the present invention and overcomes the above problem or at least partly in order to provide one kind
A kind of panoramic video processing method and processing device to solve the above problems.
According to the first aspect of the invention, a kind of panoramic video processing method is provided, which comprises
The the first sight focus information determined when obtaining user using panoramic video terminal viewing source panoramic video；
Determine the first sight focus information corresponding second sight focus in preset second panorama spherical coordinate system
Information, wherein the second panorama spherical coordinate system is to play the time of the source panoramic video as axis；
According to the second sight focus information, the Eye-controlling focus map of the source panoramic video is determined；
The source panoramic video is handled according to the Eye-controlling focus map, obtains target panoramic video.
According to the second aspect of the invention, a kind of panoramic video processing unit is provided, described device includes:
First sight focus information obtains module, when for obtaining user using panoramic video terminal viewing source panoramic video
The first determining sight focus information；
Second sight focus information determining module, for determining the first sight focus information in preset second panorama
Corresponding second sight focus information in spherical coordinate system, wherein the second panorama spherical coordinate system is to play the source aphorama
The time of frequency is axis；
Eye-controlling focus map determining module, for determining the source panoramic video according to the second sight focus information
Eye-controlling focus map；
Target panoramic video determining module, for according to the Eye-controlling focus map to the source panoramic video at
Reason, obtains target panoramic video.
The embodiment of the present invention includes following advantages: the embodiment of the present invention was preset with the time of broadcast source panoramic video
The aphorama is obtained when user watches source panoramic video by panoramic video terminal for the second panorama spherical coordinate system of axis
The first sight focus information that frequency terminal determines；And determine that the first sight focus information is corresponding in the second panorama spherical coordinate system
Second sight focus information can determine the source panorama then according to the second sight focus information of the second panorama spherical coordinate system
The Eye-controlling focus map of video, when handling source panoramic video, according to Eye-controlling focus map in the panoramic video of source
Appearance is handled, and so as to realize that the viewing according to user is accustomed to, excellent video content setting is accustomed to watching in user
Position, there is no need to waste of resource, and a large amount of contents are arranged accordingly in the region being not concerned with for user, therefore, so that video system
Work side, which can provide, meets the panoramic video that user watches habit, while saving production side's video production resource, improves
User's viewing experience.
The above description is only an overview of the technical scheme of the present invention, in order to better understand the technical means of the present invention,
And can be implemented in accordance with the contents of the specification, and in order to allow above-mentioned technical proposal of the invention and other purposes, feature and
Advantage can be more clearly understood, and the followings are specific embodiments of the present invention.
Detailed description of the invention
By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field
Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the present invention
Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings:
Fig. 1 is a kind of flow chart of panoramic video processing method provided in an embodiment of the present invention；
Fig. 2 is a kind of specific flow chart of panoramic video processing method provided in an embodiment of the present invention；
Fig. 3 is a kind of block diagram of panoramic video processing unit provided in an embodiment of the present invention；
Fig. 4 is a kind of specific block diagram of panoramic video processing unit provided in an embodiment of the present invention.
Specific embodiment
In order to make the foregoing objectives, features and advantages of the present invention clearer and more comprehensible, with reference to the accompanying drawing and specific real
Applying mode, the present invention is described in further detail.
It should be appreciated that described herein, specific examples are only used to explain the present invention, and only present invention a part is real
Example is applied, instead of all the embodiments, is not intended to limit the present invention.
Embodiment one
Referring to Fig.1, a kind of flow chart of panoramic video processing method is shown.
It should be noted that the embodiment of the present invention can be applied to server end, which can be WEB (World
Wide Web, WWW) server, it is also possible to the server of other forms, server end can be watched according to a user
Viewing habit when the panoramic video of source, determines Eye-controlling focus map, and then handle source panoramic video, obtains for the use
The customization target panoramic video at family, in order to obtain better viewing experience when the user again viewing；Server end can also
Be accustomed to viewing when watching source panoramic video according to multiple users, determine Eye-controlling focus map, so to source panoramic video into
Row processing obtains the target panoramic video for meeting most users viewing habit, to promote the viewing experience of user.
Certainly, the embodiment of the present invention can also be applied to panoramic video terminal, which can be VR
(Virtual Reality, virtual reality) glasses etc. can watch the terminal device of panoramic video, and panoramic video terminal can root
Watch the viewing habit when panoramic video of source according to user, determine Eye-controlling focus map, so to source panoramic video at
Reason obtains the customization target panoramic video for the user, obtains better viewing body when repeating viewing in order to the user
It tests；Viewing when panoramic video terminal can also watch source panoramic video according to multiple users is accustomed to, and determines Eye-controlling focus map,
And then source panoramic video is handled, the target panoramic video for meeting most users viewing habit is obtained, to promote user
Viewing experience；Number of users corresponding to the equipment of application and when obtaining data of the embodiment of the present invention is not particularly limited.
The panoramic video processing method can specifically include following steps:
Step 101: the first sight focus determined when obtaining user using panoramic video terminal viewing source panoramic video is believed
Breath.
In the embodiment of the present invention, source panoramic video is concept corresponding with target panoramic video, it is possible to understand that are as follows: source is complete
Scape video is available to user's viewing, and for acquiring the panoramic video of user's sight focus information, target panoramic video is to use
The method of the embodiment of the present invention is to the source panoramic video for meeting user and watching habit obtained after the processing of source panoramic video.
In concrete application, when user is using panoramic video terminal viewing source panoramic video, in source, panoramic video is played
In the process, each playing time, the sight of user can pay close attention to a band of position of source panoramic video, pass through panoramic video end
The Eye-controlling focus equipment being arranged in end or application, available user each moment when watching panoramic video corresponding original view
Line focus information, the raw eye focus information specifically can be, the corresponding position in the panoramic video of source of the sight focus of user
Confidence breath.
First sight focus information of the embodiment of the present invention, can be raw eye focus information；It is also possible to aphorama
Frequency terminal is according to each raw eye focus information, the sight focus being depicted as by several raw eye focus informations determined
Time map, the embodiment of the present invention to the particular content of the first sight focus information of acquisition with no restrictions.
In concrete application, the first determining sight focus when obtaining user using panoramic video terminal viewing source panoramic video
The method of information specifically may is that when user is using panoramic video terminal viewing source panoramic video, obtain each moment in real time
The first sight focus information that panoramic video terminal determines；It is also possible to watch source aphorama using panoramic video terminal as user
When frequency, the first sight focus information at each moment that the fetching portion at interval or whole panoramic video terminals determine；The present invention is real
Apply example to obtain the first sight focus information specific method with no restrictions.
It is appreciated that the mode that triggering obtains operation can be set when obtaining the first sight focus information, for example,
When panoramic video terminal is determined to the first sight focus information, automatic trigger obtains operation；Alternatively, being sent out to panoramic video terminal
Out after acquisition request, triggering obtains operation, and the embodiment of the present invention obtains the specific method of the first sight focus information not to triggering
It is limited.
Step 102: determining the first sight focus information corresponding second in preset second panorama spherical coordinate system
Sight focus information, wherein the second panorama spherical coordinate system is to play the time of the source panoramic video as axis.
In the embodiment of the present invention, the second sight focus information may is that the location information in the second panorama spherical coordinate system, tool
Body can be position coordinates.
One source panoramic video can correspond to a second panorama spherical coordinate system, and the second panorama spherical coordinate system is with broadcast source
The time of panoramic video is axis, and the corresponding second panorama ball of each playing time, the second panorama ball is for recording source
The coordinate of the video content belonging positions of panoramic video, then with the broadcasting of source panoramic video, the second panorama spherical coordinate system can be with
Show the second panorama ball set using play time as axis.It is appreciated that the embodiment of the present invention is complete to play the source
The time of scape video is axis, it is not required that must be using play time as axis, as long as being sequence along the time of broadcasting
Axis, for example, play time be 00 point 00 second, 00 point 01 second, 00 point 02 second etc., then 00 can be used on time axis
It point 00 second, 00 point is labeled within 02 second etc. within 01 second, 00 point, it can also be using the specific time at current time as initial value, according to broadcasting
Putting the time successively increases, for example, on 2 10th, 2,018 30 points 15 seconds, on 2 10th, 2,018 30 points 16 seconds, on 2 10th, 2018
30 points 17 seconds etc., the embodiment of the present invention is not particularly limited this.
In concrete application, the first sight focus information that panoramic video terminal determines, with preset second panorama spherical coordinates
System has corresponding relationship, can determine that the first sight focus information is corresponding in the second panoramic coordinates system according to the corresponding relationship
Second sight focus information.As an example it is assumed that corresponding source panoramic video is 4000 pixels in the second panorama spherical coordinate system, and
Panoramic video terminal may be influenced due to equipment performance, network performance etc., when broadcast source panoramic video, can only be broadcast with 720 pixels
It puts, then, in the identical band of position of source panoramic video, the position for the first sight focus information that panoramic video terminal determines
Information may only have 25, and the location information in the second panorama spherical coordinate system may have 50, the corresponding position coordinates of the two
Also can be variant, it therefore, can be according to the pixel source aphorama corresponding with the second panorama spherical coordinate system of panoramic video terminal
The relationship of the pixel of frequency determines the first sight focus information corresponding second sight focus letter in the second panoramic coordinates system
Breath.Certainly, those skilled in the art can determine the first sight focus information preset second according to actual application scenarios
Corresponding second sight focus information, the embodiment of the present invention are not particularly limited this in panorama spherical coordinate system.
Step 103: according to the second sight focus information, determining the Eye-controlling focus map of the source panoramic video.
It, can be complete second by the second sight focus information after the second sight focus information has been determined in concrete application
It is labeled, draws out using source panoramic video play time as the Eye-controlling focus map of axis, which chases after in scape spherical coordinate system
Track map can reflect user when using panoramic video terminal viewing source panoramic video, and each moment user sight is actually fallen
Focus reflects viewing habit when user watches the source panoramic video.
Step 104: the source panoramic video being handled according to the Eye-controlling focus map, obtains target aphorama
Frequently.
In the embodiment of the present invention, being handled according to the Eye-controlling focus map the source panoramic video specifically can be with
It is: when handling source panoramic video, user's sight that Eye-controlling focus map is reflected actually is fallen into focal position, is determined
It is accustomed to the position of viewing for user, more excellent video content or sound effect etc. is set in the position, to be met
User watches the target panoramic video of habit.
In conclusion the embodiment of the present invention is preset with the second panorama using the time of broadcast source panoramic video as axis
Spherical coordinate system obtains the panoramic video terminal determines first when user watches source panoramic video by panoramic video terminal
Sight focus information；And determine the first sight focus information corresponding second sight focus letter in the second panorama spherical coordinate system
Breath, in this way, can determine that the sight of the source panoramic video chases after according to the second sight focus information of the second panorama spherical coordinate system
Track map is handled the content of source panoramic video according to Eye-controlling focus map when handling source panoramic video, from
And may be implemented according to user viewing be accustomed to, by excellent video content be arranged in user be accustomed to viewing position, for
The region that family is not concerned with is arranged a large amount of contents there is no need to waste of resource accordingly and therefore video production side is provided
Meet the panoramic video that user watches habit out, while saving production side's video production resource, improves user's viewing experience.
Embodiment two
Referring to Fig. 2, a kind of specific flow chart of panoramic video processing method is shown, can specifically include following steps:
Step 201: when panoramic video terminal watches source panoramic video according to user, the sight focus of user is preset the
Position in one panorama spherical coordinate system obtains the first sight focus information；
Wherein, the first panorama spherical coordinate system is to play the time of the source panoramic video as axis；Described first is complete
Scape spherical coordinate system is mapped to obtain by the second panorama spherical coordinate system according to preset rules.
In the embodiment of the present invention, it is preferable that determine that the first sight focus information, i.e. panoramic video are whole by panoramic video terminal
Sight of the responsible record user in end when watching source panoramic video is practical to fall focus, carries out step 202 to step by server end
The first sight focus information when 205 operation, i.e. server end are responsible for according to the user's viewing source panoramic video got is true
Determine Eye-controlling focus map, and source panoramic video is handled, then can carry out simultaneously user's view to avoid by panoramic video terminal
When the operation such as line focus acquisition of information and source video processing, inefficiency problem caused by panoramic video terminal burden is excessive,
Reduce the requirement to the configuration of panoramic video terminal.
In concrete application, the first panorama spherical coordinate system is preset in panoramic video terminal, the first panorama spherical coordinate system
It is the corresponding first panorama ball of each playing time using the time of broadcast source panoramic video as axis, the first panorama ball
For recording the coordinate of the video content belonging positions of source panoramic video, then with the broadcasting of source panoramic video, the first panorama ball
Coordinate system can show the first panorama ball set using play time as axis.
In the embodiment of the present invention, the first panorama spherical coordinate system is mapped by the second panorama spherical coordinate system according to preset rules
It arrives.Specifically, due to needing to determine panoramic video corresponding Eye-controlling focus map in source by the second panorama spherical coordinate system, because
The source panoramic video pixel value of this second panorama spherical coordinate system setting is usually higher, and the first panorama spherical coordinate system is arranged complete
Scape video terminal, for panoramic video terminal because of device configuration or network cause, the pixel value that source panoramic video is usually arranged is lower；
Therefore, the preset rules of the embodiment of the present invention, which can be, sets according to the pixel value of panoramic video terminal with the second panorama spherical coordinate system
The proportionate relationship of fixed pixel value determines, is also possible to those skilled in the art and is determined according to practical application scene, the present invention is real
Example is applied to be not particularly limited preset rules.
As a kind of preferred embodiment of the embodiment of the present invention, the sight focus corresponds at least one basic sight element；
The basic sight element is determined according to the screen size and pixel density of the panoramic video terminal；It is described to be watched according to user
When the source panoramic video, position of the sight focus of user in preset first panorama spherical coordinate system obtains the first sight
The step of focus information includes:
Step A1: when user watches the source panoramic video, by the corresponding basic sight element of the sight focus of user
It is determined as effective sight element.
In concrete application, since different panoramic video terminal screen pixel density difference is larger, need according to aphorama
The specific screen size of frequency terminal and pixel density establish the size of basic sight element, define the panoramic video terminal plays
Basic sight element when the panoramic video of source, for example, being to be broadcast under panoramic video terminal current screen by basic sight element definition
Basic element size when video is put, an independent pixel is specifically can be, is also possible to the set of several pixels；
For user when watching source panoramic video, the focus that actually falls of user's sight is usually a region, and it is basic to correspond at least one
The corresponding basic sight element of user's sight focus is determined as effective sight element by sight element, only according to effective sight
Element determines the first sight focus information.
Step A2: according to position of the effective sight element in the first panorama spherical coordinate system, have described in determination
Sight element is imitated in the first sight focus information of the first panorama spherical coordinate system.
In concrete application, panoramic video terminal can be according to position of effective sight element in the first panorama spherical coordinate system
It sets, determines effective sight element in the first sight focus information of the first panorama spherical coordinate system.
As another preferred embodiment of the embodiment of the present invention, each corresponding sight central point of the sight focus,
Sight element is put centered on the corresponding basic sight element of the sight central point, the method also includes:
Step B1: the weight of each effective sight element is determined respectively；Wherein, the weight of effective sight element by
The corresponding each basic sight element of the sight focus, the positional relationship of central point sight element corresponding with the sight focus
It determines.
In concrete application, according to the sight focus of user, the corresponding sight center of the sight focus can be determined
Point, specifically, in the position of sight focus centre, corresponding is exactly the sight central point of the sight focus.
In the embodiment of the present invention, according to the corresponding each basic sight element of sight focus it is corresponding with the sight focus in
The positional relationship of heart point sight element can determine the weight of each effective sight element, for example, as shown in table 1, it is assumed that in table 1
The corresponding basic sight element of one grid, whole table 1 constitute the corresponding effective view of sight focus of user at a time
Line element, corresponding most intermediate grid is central point sight element, assigns central point sight element to highest weighted value, example
If the weighted value of central point sight element is set as 10, around central point sight element first around effective sight element assign it is low
The weighted value of level-one, such as weighted value can be set to 9, and effective sight element that central point sight element second week surrounds assigns
The weighted value of lower level-one, such as weighted value can be set to 8, and so on, around third around effective sight element weights
Value can be set to 7, and effective sight element weights value that 4th week surrounds can be set to 6, that is, positional distance central point sight
The remoter effective sight element of element, corresponding weighted value is smaller, in practical application, can by with the field angle of sight focus not
Sight more than 5 °, corresponding sight element carry out weight assignment, and the field angle with sight focus is more than 5 ° of sight part, lead to
It is often the inaccessiable part of user's eyesight, can consider.
| 6 | 6 | 6 | 6 | 6 | 6 | 6 | 6 | 6 |
| 6 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 6 |
| 6 | 7 | 8 | 8 | 8 | 8 | 8 | 7 | 6 |
| 6 | 7 | 8 | 9 | 9 | 9 | 8 | 7 | 6 |
| 6 | 7 | 8 | 9 | 10 | 9 | 8 | 7 | 6 |
| 6 | 7 | 8 | 9 | 9 | 9 | 8 | 7 | 6 |
| 6 | 7 | 8 | 8 | 8 | 8 | 8 | 7 | 6 |
| 6 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 6 |
| 6 | 6 | 6 | 6 | 6 | 6 | 6 | 6 | 6 |
Table 1
Step B2: according to the weight of effective sight element, determine effective sight element in first panorama
The weight of the first sight focus information in spherical coordinate system.
In the embodiment of the present invention, the weighted value of effective sight element, indirect assignment can be existed to effective sight element
The first sight focus information in first panorama spherical coordinate system, the weight as the first sight focus information；Can also will have
Imitate sight element weighted value, by certain change process, for example, proportionally, plus-minus scheduling algorithm to effective sight element
Power after weighted value is calculated, as first sight focus information of the effective sight element in the first panorama spherical coordinate system
Weight, it will be understood that those skilled in the art can set the weight of the first sight focus information according to actual application scenarios, this
Inventive embodiments are not particularly limited this.
Step B3: by the weight of the first sight focus information, it is corresponding that mapping obtains the first sight focus information
The second sight focus information weight.
In the embodiment of the present invention, the weighted value of the first sight focus information, indirect assignment can be given first sight burnt
The corresponding second sight focus information of point information, the weight as the second sight focus information；It can also be by the first sight coke
Point information weighted value, by certain change process, for example, proportionally, plus-minus scheduling algorithm to the first sight focus information
Weight after weighted value is calculated, as the corresponding second sight focus information of the first sight focus information, it will be understood that
Those skilled in the art can set the weight of the second sight focus information, the embodiment of the present invention pair according to actual application scenarios
This is not particularly limited.
In the embodiment of the present invention, it is contemplated that sight central point is usually the position that user most pays close attention to, apart from sight central point
Remote position is usually the remaining light part of user's sight, and remaining light part is little to reflection user's viewing habit role, because
This, the positional relationship according to each effective sight element and sight central point determines the weight of each effective sight element, and final
Determine the weight of the second sight focus information, then it, can be with when determining Eye-controlling focus map according to the second sight focus information
Will according to the second sight focus information, and, the weight of the second sight focus information determines the source panoramic video
Eye-controlling focus map, the second big sight focus information of weight obtains display outstanding in Eye-controlling focus map, for example, subsequent
The cumulative summation of the weighted value of several spectators sight element in each moment or each frame is obtained under the moment or the particular frame
Eye-controlling focus map signal value forms the Eye-controlling focus map of entire panoramic video in the second panorama spherical coordinate system, so that view
Line tracking map can more accurately reflect the viewing habit of user.
As another preferred embodiment of the embodiment of the present invention, the first sight focus information includes: the first sight coke
Point time map；When the viewing source panoramic video according to user, the sight focus of user is in preset first panorama ball
Position in coordinate system, the step of obtaining the first sight focus information include:
Step C1: when determining that user watches the source panoramic video, the sight focus of user is in institute within a preset period of time
The motion track in the first panorama spherical coordinate system is stated, the first sight focus map is obtained.
In the embodiment of the present invention, panoramic video terminal is according to the sight focus of user in preset time period in the first panorama ball
Motion track in coordinate system determines the first sight focus map, which is continuous in a period of time
The first sight focus information set.
Correspondingly, the mapping relations according to the second panorama spherical coordinate system and the first panorama spherical coordinate system,
Determine the first sight focus information corresponding second sight focus information in the preset second panorama spherical coordinate system
The step of include: mapping relations according to the second panorama spherical coordinate system and the first panorama spherical coordinate system, determine described in
First sight focus time map corresponding second sight focus information in the preset second panorama spherical coordinate system.
In the embodiment of the present invention, the first sight focus map that panoramic video terminal determines is continuous the in a period of time
One sight focus information set, compared to the set of original first sight focus information, server end is according to continuous first view
When line focus information aggregate determines the second sight focus information, do not need to judge the corresponding broadcasting of each first sight focus information
Moment, it is only necessary to know the corresponding playing time of first the first sight focus information in the first sight focus map, so that it may
Other first sight focus informations in sequential processes the first sight focus map, can greatly promote and determine the second sight focus letter
The efficiency of breath.
Step 202: the first sight focus determined when obtaining user using panoramic video terminal viewing source panoramic video is believed
Breath.
Step 203: according to the mapping relations of the second panorama spherical coordinate system and the first panorama spherical coordinate system, determining
The first sight focus information corresponding second sight focus information in the preset second panorama spherical coordinate system；Its
In, the second panorama spherical coordinate system is to play the time of the source panoramic video as axis.
In the embodiment of the present invention, according to the second panorama spherical coordinate system and the first panorama spherical coordinate system set in step 201
Mapping relations, can determine that the first sight focus information corresponding second sight in preset second panorama spherical coordinate system is burnt
Point information.Such as the proportionate relationship of the pixel value set according to the pixel value of full video terminal and the second panorama spherical coordinate system, really
Fixed first sight focus information corresponding second sight focus information in preset second panorama spherical coordinate system；Certainly, may be used
To be that those skilled in the art are determining according to practical application scene, the embodiment of the present invention is not particularly limited this.
Step 204: according to the second sight focus information, determining the Eye-controlling focus map of the source panoramic video.
As a kind of preferred embodiment of the embodiment of the present invention, in the power for determining the second realization focus information by step B3
Described according to the second sight focus information after weight, the step of determining the Eye-controlling focus map of the source panoramic video, includes:
According to the second sight focus information, and, the weight of the second sight focus information determines the view of the source panoramic video
Line tracks map.
In concrete application, server can by several spectators in each moment or each frame the second sight focus information
The cumulative summation of weighted value, obtains Eye-controlling focus map signal value under the moment or the particular frame, thus in the second panorama spherical coordinates
In system, the Eye-controlling focus map of entire panoramic video is formed, Eye-controlling focus map is enabled more accurately to reflect user's
Viewing habit.
Step 205 is handled the source panoramic video according to the Eye-controlling focus map, obtains target panoramic video.
In the embodiment of the present invention, it is preset with the second panorama spherical coordinates using the time of broadcast source panoramic video as axis
It is burnt to obtain the first sight that the panoramic video terminal determines when user watches source panoramic video by panoramic video terminal for system
Point information；And determine the first sight focus information corresponding second sight focus information in the second panorama spherical coordinate system, then root
According to the second sight focus information of the second panorama spherical coordinate system, the Eye-controlling focus map of the source panoramic video can be determined, when
When handling source panoramic video, the content of source panoramic video is handled according to Eye-controlling focus map, so as to reality
Now depending on the viewing habit of user, the position that user is accustomed to viewing is arranged in excellent video content, user is not concerned with
Region a large amount of contents are set there is no need to waste of resource accordingly therefore video production side are provided and meets use
The panoramic video of family viewing habit improves user's viewing experience while saving production side's video production resource.
It should be noted that for simple description, therefore, it is stated as a series of action groups for embodiment of the method
It closes, but those skilled in the art should understand that, embodiment of that present invention are not limited by the describe sequence of actions, because according to
According to the embodiment of the present invention, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art also should
Know, the embodiments described in the specification are all preferred embodiments, and the related movement not necessarily present invention is implemented
Necessary to example.
Embodiment three
Referring to Fig. 3, a kind of block diagram of panoramic video processing unit is shown, which can specifically include:
First sight focus information obtains module 310, watches source aphorama using panoramic video terminal for obtaining user
The the first sight focus information determined when frequency.
Second sight focus information determining module 320, for determining the first sight focus information preset second
Corresponding second sight focus information in panorama spherical coordinate system, wherein the second panorama spherical coordinate system is complete to play the source
The time of scape video is axis.
Eye-controlling focus map determining module 330, for determining the source aphorama according to the second sight focus information
The Eye-controlling focus map of frequency.
Target panoramic video determining module 340, for being carried out according to the Eye-controlling focus map to the source panoramic video
Processing, obtains target panoramic video.
Preferably, referring to Fig. 4, a kind of specific block diagram of panoramic video processing unit is shown on the basis of Fig. 3.
Described device further include:
First sight focus information determining module 350, when for watching the source panoramic video according to user, the view of user
Position of the line focus in preset first panorama spherical coordinate system, obtains the first sight focus information；Wherein, first panorama
Spherical coordinate system is to play the time of the source panoramic video as axis；The first panorama spherical coordinate system is by the second panorama ball
Coordinate system maps to obtain according to preset rules.
The second sight focus information determining module 350 of described device includes:
Second sight focus information determines submodule 1, for according to the second panorama spherical coordinate system and described the
The mapping relations of one panorama spherical coordinate system determine the first sight focus information in the preset second panorama spherical coordinate system
In corresponding second sight focus information.
Preferably, the sight focus of described device corresponds at least one basic sight element；The basic sight member
Element is determined according to the screen size and pixel density of the panoramic video terminal；
The first sight focus information determining module 350 includes:
Effective sight element determines submodule, is used for when user watches the source panoramic video, and the sight of user is burnt
The corresponding basic sight element of point is determined as effective sight element；
First sight focus information determines submodule, for being sat according to effective sight element in the first panorama ball
Position in mark system, determines effective sight element in the first sight focus information of the first panorama spherical coordinate system.
Preferably, the corresponding sight central point of each of described device sight focus, the sight central point pair
Sight element, described device are put centered on the basic sight element answered further include:
Effective sight element weights determining module, for determining the weight of each effective sight element respectively；Wherein, institute
The weight of effective sight element is stated by the corresponding each basic sight element of the sight focus, it is corresponding with the sight focus in
The positional relationship of heart point sight element determines；
First sight focus information weight determination module, for the weight according to effective sight element, determine described in
The weight of effective first sight focus information of the sight element in the first panorama spherical coordinate system；
Second sight focus information weight determination module is mapped for the weight by the first sight focus information
To the weight of the corresponding second sight focus information of the first sight focus information；
The Eye-controlling focus map determining module 330 includes:
Eye-controlling focus map determines submodule, is used for according to the second sight focus information, and, second sight is burnt
The weight of point information, determines the Eye-controlling focus map of the source panoramic video.
Preferably, the first sight focus information of described device includes: the first sight focus time map；
The first sight focus information determining module 350 includes:
First sight focus map determines submodule, when for determining that user watches the source panoramic video, when default
Between in section user motion track of the sight focus in the first panorama spherical coordinate system, obtain the first sight focus map；
The second sight focus information determining module 320 includes:
Second sight focus information determines submodule two, for complete with described first according to the second panorama spherical coordinate system
The mapping relations of scape spherical coordinate system determine the first sight focus time map in the preset second panorama spherical coordinate system
In corresponding second sight focus information.
In the embodiment of the present invention, it is preset with the second panorama spherical coordinates using the time of broadcast source panoramic video as axis
System, when user watches source panoramic video by panoramic video terminal, the first sight focus information obtains the acquisition of module 310, and this is complete
The first sight focus information that scape video terminal determines；Second sight focus information determining module 320 determines the first sight focus
Information corresponding second sight focus information in the second panorama spherical coordinate system, then 330 basis of Eye-controlling focus map determining module
Second sight focus information of the second panorama spherical coordinate system, can determine the Eye-controlling focus map of the source panoramic video, when right
When source panoramic video is handled, target panoramic video determining module 340 is according to Eye-controlling focus map in the panoramic video of source
Appearance is handled, and so as to realize that the viewing according to user is accustomed to, excellent video content setting is accustomed to watching in user
Position, there is no need to waste of resource, and a large amount of contents are arranged accordingly in the region being not concerned with for user, therefore, so that video system
Work side, which can provide, meets the panoramic video that user watches habit, while saving production side's video production resource, improves
User's viewing experience.
For device embodiment, since it is basically similar to the method embodiment, related so being described relatively simple
Place illustrates referring to the part of embodiment of the method.
All the embodiments in this specification are described in a progressive manner, the highlights of each of the examples are with
The difference of other embodiments, the same or similar parts between the embodiments can be referred to each other.
It should be understood by those skilled in the art that, the embodiment of the embodiment of the present invention can provide as method, apparatus or calculate
Machine program product.Therefore, the embodiment of the present invention can be used complete hardware embodiment, complete software embodiment or combine software and
The form of the embodiment of hardware aspect.Moreover, the embodiment of the present invention can be used one or more wherein include computer can
With in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code
The form of the computer program product of implementation.
In a typical configuration, the computer equipment includes one or more processors (CPU), input/output
Interface, network interface and memory.Memory may include the non-volatile memory in computer-readable medium, random access memory
The forms such as device (RAM) and/or Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is to calculate
The example of machine readable medium.Computer-readable medium includes that permanent and non-permanent, removable and non-removable media can be with
Realize that information is stored by any method or technique.Information can be computer readable instructions, data structure, the module of program or
Other data.The example of the storage medium of computer includes, but are not limited to phase change memory (PRAM), static random access memory
(SRAM), dynamic random access memory (DRAM), other kinds of random access memory (RAM), read-only memory
(ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory techniques, CD-ROM are read-only
Memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage or
Other magnetic storage devices or any other non-transmission medium, can be used for storage can be accessed by a computing device information.According to
Herein defines, and computer-readable medium does not include non-persistent computer readable media (transitory media), such as
The data-signal and carrier wave of modulation.
The embodiment of the present invention be referring to according to the method for the embodiment of the present invention, terminal device (system) and computer program
The flowchart and/or the block diagram of product describes.It should be understood that flowchart and/or the block diagram can be realized by computer program instructions
In each flow and/or block and flowchart and/or the block diagram in process and/or box combination.It can provide these
Computer program instructions are whole to general purpose computer, special purpose computer, Embedded Processor or other programmable panoramic video processing
The processor of end equipment is to generate a machine, so that passing through computer or other programmable panoramic video processing terminal equipments
The instruction that processor executes generates for realizing in one box of one or more flows of the flowchart and/or block diagram or more
The device for the function of being specified in a box.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable panoramic video processing terminals
In equipment computer-readable memory operate in a specific manner, so that instruction stored in the computer readable memory produces
Raw includes the manufacture of command device, which realizes in one or more flows of the flowchart and/or block diagram one
The function of being specified in a box or multiple boxes.
These computer program instructions can also be loaded into computer or other programmable panoramic video processing terminal equipments,
So that on computer or other programmable terminal equipments execute series of operation steps to generate computer implemented processing, from
And the instruction that executes on computer or other programmable terminal equipments is provided for realizing in one process of flow chart or multiple
The step of function of being specified in process and/or one or more blocks of the block diagram.
Although the preferred embodiment of the embodiment of the present invention has been described, once a person skilled in the art knows bases
This creative concept, then additional changes and modifications can be made to these embodiments.So the following claims are intended to be interpreted as
Including preferred embodiment and fall into all change and modification of range of embodiment of the invention.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by
One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation
Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning
Covering non-exclusive inclusion, so that process, method, article or terminal device including a series of elements not only wrap
Those elements are included, but also including other elements that are not explicitly listed, or further includes for this process, method, article
Or the element that terminal device is intrinsic.In the absence of more restrictions, being wanted by what sentence "including a ..." limited
Element, it is not excluded that there is also other identical elements in process, method, article or the terminal device for including the element.
Above to a kind of panoramic video processing method provided by the present invention and a kind of panoramic video processing unit, carry out
It is discussed in detail, used herein a specific example illustrates the principle and implementation of the invention, above embodiments
Illustrate to be merely used to help understand method and its core concept of the invention；At the same time, for those skilled in the art, according to
According to thought of the invention, there will be changes in the specific implementation manner and application range, in conclusion the content of the present specification
It should not be construed as limiting the invention.
Claims (10)
1. a kind of panoramic video processing method, which is characterized in that the described method includes:
The the first sight focus information determined when obtaining user using panoramic video terminal viewing source panoramic video；
Determine the first sight focus information corresponding second sight focus information in preset second panorama spherical coordinate system,
Wherein, the second panorama spherical coordinate system is to play the time of the source panoramic video as axis；
According to the second sight focus information, the Eye-controlling focus map of the source panoramic video is determined；
The source panoramic video is handled according to the Eye-controlling focus map, obtains target panoramic video；
Wherein, the first determining sight focus information when the user is using panoramic video terminal viewing source panoramic video, specifically
It is determined by following steps:
When watching the source panoramic video according to user, position of the sight focus of user in preset first panorama spherical coordinate system
It sets, obtains the first sight focus information；
Determination the first sight focus information corresponding second sight focus in preset second panorama spherical coordinate system
The step of information includes:
According to the mapping relations of the second panorama spherical coordinate system and the first panorama spherical coordinate system, first sight is determined
Focus information corresponding second sight focus information in the preset second panorama spherical coordinate system.
2. the method according to claim 1, wherein the first panorama spherical coordinate system is to play the source panorama
The time of video is axis；The first panorama spherical coordinate system is mapped by the second panorama spherical coordinate system according to preset rules
It arrives.
3. the method according to claim 1, wherein
The sight focus corresponds at least one basic sight element；The basic sight element is according to the panoramic video terminal
Screen size and pixel density determine；
When the viewing source panoramic video according to user, the sight focus of user is in preset first panorama spherical coordinate system
Position, the step of obtaining the first sight focus information includes:
When user watches the source panoramic video, the corresponding basic sight element of the sight focus of user is determined as effectively regarding
Line element；
According to position of the effective sight element in the first panorama spherical coordinate system, determine that effective sight element exists
First sight focus information of the first panorama spherical coordinate system.
4. according to the method described in claim 3, it is characterized in that, the corresponding sight central point of each sight focus,
Sight element is put centered on the corresponding basic sight element of the sight central point, the method also includes:
The weight of each effective sight element is determined respectively；Wherein, the weight of effective sight element is burnt by the sight
The positional relationship of the corresponding each basic sight element of point, central point sight element corresponding with the sight focus determines；
According to the weight of effective sight element, determine effective sight element in the first panorama spherical coordinate system
The weight of first sight focus information；
By the weight of the first sight focus information, it is burnt that mapping obtains corresponding second sight of the first sight focus information
The weight of point information；
It is described according to the second sight focus information, the step of determining the Eye-controlling focus map of the source panoramic video includes:
According to the second sight focus information, and, the weight of the second sight focus information determines the source panoramic video
Eye-controlling focus map.
5. the method according to claim 1, wherein the first sight focus information includes: the first sight coke
Point time map；
When the viewing source panoramic video according to user, the sight focus of user is in preset first panorama spherical coordinate system
Position, the step of obtaining the first sight focus information includes:
When determining that user watches the source panoramic video, the sight focus of user is in the first panorama ball within a preset period of time
Motion track in coordinate system obtains the first sight focus map；
The mapping relations according to the second panorama spherical coordinate system and the first panorama spherical coordinate system, determine described first
Sight focus information includes: the step of corresponding second sight focus information in the preset second panorama spherical coordinate system
According to the mapping relations of the second panorama spherical coordinate system and the first panorama spherical coordinate system, first sight is determined
Focus time map corresponding second sight focus information in the preset second panorama spherical coordinate system.
6. a kind of panoramic video processing unit, which is characterized in that described device includes:
First sight focus information obtains module, determines when for obtaining user using panoramic video terminal viewing source panoramic video
The first sight focus information；
Second sight focus information determining module, for determining that the first sight focus information is sat in preset second panorama ball
Corresponding second sight focus information in mark system, wherein the second panorama spherical coordinate system is to play the source panoramic video
Time is axis；
Eye-controlling focus map determining module, for determining the view of the source panoramic video according to the second sight focus information
Line tracks map；
Target panoramic video determining module is obtained for being handled according to the Eye-controlling focus map the source panoramic video
To target panoramic video；
First sight focus information determining module, when for watching the source panoramic video according to user, the sight focus of user
Position in preset first panorama spherical coordinate system obtains the first sight focus information；
The second sight focus information determining module includes:
Second sight focus information determines submodule one, for according to the second panorama spherical coordinate system and the first panorama ball
The mapping relations of coordinate system determine that the first sight focus information is corresponding in the preset second panorama spherical coordinate system
Second sight focus information.
7. device according to claim 6, which is characterized in that
The first panorama spherical coordinate system is to play the time of the source panoramic video as axis；The first panorama spherical coordinate system
It maps to obtain according to preset rules by the second panorama spherical coordinate system.
8. device according to claim 6, which is characterized in that the sight focus corresponds at least one basic sight member
Element；The basic sight element is determined according to the screen size and pixel density of the panoramic video terminal；
The first sight focus information determining module includes:
Effective sight element determines submodule, is used for when user watches the source panoramic video, by the sight focus pair of user
The basic sight element answered is determined as effective sight element；
First sight focus information determines submodule, is used for according to effective sight element in the first panorama spherical coordinate system
In position, determine effective sight element in the first sight focus information of the first panorama spherical coordinate system.
9. device according to claim 8, which is characterized in that each corresponding sight central point of the sight focus,
Sight element, described device are put centered on the corresponding basic sight element of the sight central point further include:
Effective sight element weights determining module, for determining the weight of each effective sight element respectively；Wherein, described to have
The weight of sight element is imitated by the corresponding each basic sight element of the sight focus, central point corresponding with the sight focus
The positional relationship of sight element determines；
First sight focus information weight determination module determines described effective for the weight according to effective sight element
The weight of first sight focus information of the sight element in the first panorama spherical coordinate system；
Second sight focus information weight determination module, for the weight by the first sight focus information, mapping obtains institute
State the weight of the corresponding second sight focus information of the first sight focus information；
The Eye-controlling focus map determining module includes:
Eye-controlling focus map determines submodule, is used for according to the second sight focus information, and, the second sight focus letter
The weight of breath determines the Eye-controlling focus map of the source panoramic video.
10. device according to claim 6, which is characterized in that the first sight focus information includes: the first sight coke
Point time map；
The first sight focus information determining module includes:
First sight focus map determines submodule, when for determining that user watches the source panoramic video, in preset time period
Motion track of the sight focus of interior user in the first panorama spherical coordinate system obtains the first sight focus map；
The second sight focus information determining module includes:
Second sight focus information determines submodule two, for according to the second panorama spherical coordinate system and the first panorama ball
The mapping relations of coordinate system determine that the first sight focus time map is right in the preset second panorama spherical coordinate system
The the second sight focus information answered.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810283639.3A CN108650500B (en) | 2018-04-02 | 2018-04-02 | A kind of panoramic video processing method and processing device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810283639.3A CN108650500B (en) | 2018-04-02 | 2018-04-02 | A kind of panoramic video processing method and processing device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108650500A CN108650500A (en) | 2018-10-12 |
| CN108650500B true CN108650500B (en) | 2019-11-22 |
Family
ID=63745253
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810283639.3A Active CN108650500B (en) | 2018-04-02 | 2018-04-02 | A kind of panoramic video processing method and processing device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108650500B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112162638B (en) * | 2020-10-09 | 2023-09-19 | 咪咕视讯科技有限公司 | Information processing method and server in Virtual Reality (VR) viewing |
| CN114449319A (en) * | 2020-11-04 | 2022-05-06 | 深圳Tcl新技术有限公司 | Video picture dynamic adjustment method and device, intelligent terminal and storage medium |
| US11647294B2 (en) | 2021-05-25 | 2023-05-09 | Shanghai Bilibili Technology Co., Ltd. | Panoramic video data process |
| CN113313735B (en) * | 2021-05-25 | 2023-04-07 | 上海哔哩哔哩科技有限公司 | Panoramic video data processing method and device |
| CN115103114A (en) * | 2022-06-16 | 2022-09-23 | 京东方科技集团股份有限公司 | Panoramic video view tracking method, device, equipment and medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102572217A (en) * | 2011-12-29 | 2012-07-11 | 华为技术有限公司 | Visual-attention-based multimedia processing method and device |
| CN106814846A (en) * | 2016-10-24 | 2017-06-09 | 上海青研科技有限公司 | A kind of eye movement analysis method based on sight line and collision body intersection point in VR |
| CN106954093A (en) * | 2017-03-15 | 2017-07-14 | 北京小米移动软件有限公司 | Panoramic video processing method, apparatus and system |
| CN107633241A (en) * | 2017-10-23 | 2018-01-26 | 三星电子（中国）研发中心 | A kind of method and apparatus of panoramic video automatic marking and tracking object |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101788452B1 (en) * | 2016-03-30 | 2017-11-15 | 연세대학교 산학협력단 | Apparatus and method for replaying contents using eye tracking of users |
-
2018
- 2018-04-02 CN CN201810283639.3A patent/CN108650500B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102572217A (en) * | 2011-12-29 | 2012-07-11 | 华为技术有限公司 | Visual-attention-based multimedia processing method and device |
| CN106814846A (en) * | 2016-10-24 | 2017-06-09 | 上海青研科技有限公司 | A kind of eye movement analysis method based on sight line and collision body intersection point in VR |
| CN106954093A (en) * | 2017-03-15 | 2017-07-14 | 北京小米移动软件有限公司 | Panoramic video processing method, apparatus and system |
| CN107633241A (en) * | 2017-10-23 | 2018-01-26 | 三星电子（中国）研发中心 | A kind of method and apparatus of panoramic video automatic marking and tracking object |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108650500A (en) | 2018-10-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108650500B (en) | A kind of panoramic video processing method and processing device | |
| US20170302714A1 (en) | Methods and systems for conversion, playback and tagging and streaming of spherical images and video | |
| CN110012302A (en) | A kind of network direct broadcasting monitoring method and device, data processing method | |
| CN104301769B (en) | Method, terminal device and the server of image is presented | |
| US10506221B2 (en) | Field of view rendering control of digital content | |
| US11151791B2 (en) | R-snap for production of augmented realities | |
| CN109905732A (en) | The method and device of product placement in video | |
| CN104683852B (en) | The method and apparatus for handling broadcast message | |
| CN110876079B (en) | Video processing method, device and equipment | |
| CN109495686A (en) | Image pickup method and equipment | |
| CN110458820A (en) | A kind of multimedia messages method for implantation, device, equipment and storage medium | |
| CN110996097A (en) | VR multimedia experience quality determination method and device | |
| US20240038274A1 (en) | 3d media elements in 2d video | |
| CN112118472A (en) | Method and apparatus for playing multimedia | |
| CN109729338B (en) | Display data processing method, device and system | |
| CN113965665A (en) | Method and equipment for determining virtual live broadcast image | |
| CN109116718A (en) | The method and apparatus of alarm clock is set | |
| CN109978945A (en) | A kind of information processing method and device of augmented reality | |
| CN108833971A (en) | A kind of method for processing video frequency and device | |
| CN108449646B (en) | Method, equipment and medium for establishing social relationship through barrage | |
| CN110222056A (en) | A kind of localization method, system and equipment | |
| CN108960130A (en) | Video file intelligent processing method and device | |
| CN110493609B (en) | Live broadcast method, terminal and computer readable storage medium | |
| CN114245907A (en) | Auto-exposure ray tracing | |
| CN106844366A (en) | The display methods and device of geographical thermodynamic chart |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |