CN110312170A - A kind of video broadcasting method and device at adjustment visual angle - Google Patents
A kind of video broadcasting method and device at adjustment visual angle Download PDFInfo
- Publication number
- CN110312170A CN110312170A CN201910628917.9A CN201910628917A CN110312170A CN 110312170 A CN110312170 A CN 110312170A CN 201910628917 A CN201910628917 A CN 201910628917A CN 110312170 A CN110312170 A CN 110312170A
- Authority
- CN
- China
- Prior art keywords
- visual angle
- user
- panoramic video
- video
- play
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
- H04N21/4662—Learning process for intelligent management, e.g. learning user preferences for recommending movies characterized by learning algorithms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
- H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- User Interface Of Digital Computer (AREA)
- Television Signal Processing For Recording (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The present invention provides the video broadcasting methods and device at a kind of adjustment visual angle.Video broadcasting method includes: to obtain panoramic video data；Panoramic video data are learnt using intelligent algorithm；And when receive instruct visual angle play instruction when, according to the trigger time of the instruction to panoramic video play in user perspective carry out adjustment.Video play device is used to execute the processing of above-mentioned video broadcasting method.The visual angle that user watches panoramic video can be adjusted to excellent visual angle by above-mentioned video broadcasting method of the invention and device, and the visual angle that family viewing panoramic video can be used obtains the change of similar professional photographer's shooting skill or panoramic video post-processing skill.
Description
Technical field
The present invention relates to video processing technique more particularly to a kind of video broadcasting methods and device at adjustment visual angle.
Background technique
In general, intelligent terminal, in playing panoramic video, what playing device played is some direction in panoramic video
Part picture.In fact, panoramic video is rotated a circle around fixed point comprehensive 360 degree observed centered on observer
Visual field scene.When playing, intelligent terminal can slide screen or mobile hardware equipment by user to determine display panorama
Which parts of images in video current frame image, the parts of images are equivalent to user as observer and are watched with certain observation visual angle
The parts of images seen when panoramic video, this observation visual angle are the broadcasting visual angle of current video.
However, user can be carried out mutually when watching panoramic video by certain hardware device and panoramic video playing device
Dynamic, real-time input viewing angle control information is to realize freely converting for visual angle, and this watching mode has the following disadvantages, aphorama
In shooting or recording there is no the artistic editing that photographer or producer is added, user can not grasp full frequency in viewing
Excellent picture in scape video frame, therefore it is easy to miss excellent visual angle corresponding to Highlight, causing should be very excellent
A video work but there is no to user bring due excellent presentation.
Summary of the invention
It has been given below about brief overview of the invention, in order to provide about the basic of certain aspects of the invention
Understand.It should be appreciated that this summary is not an exhaustive overview of the invention.It is not intended to determine key of the invention
Or pith, it is also not intended to limit the scope of the invention.Its purpose only provides certain concepts in simplified form, with this
As the preamble in greater detail discussed later.
In consideration of it, the present invention provides the video broadcasting method and device at a kind of adjustment visual angle, it is existing at least to solve
There is technology to be easy the problem of missing excellent visual angle in playing panoramic video.
The present invention provides a kind of video broadcasting method at adjustment visual angle, the video broadcasting method includes: to obtain
Panoramic video data；Panoramic video data are learnt using intelligent algorithm；And visual angle is instructed to play when receiving
When instruction, adjustment is carried out to the user perspective in panoramic video broadcasting according to the trigger time of the instruction.
Further, the intelligent algorithm is deep learning algorithm or pattern matching algorithm.
Further, described the step of being learnt using intelligent algorithm to panoramic video data includes: from described
Multiple scenario objects and corresponding excellent visual angle are extracted in the panoramic video frame of panoramic video data, to learn each scene
Corresponding excellent visual angle.
It further, is that retrieval window extracts scenario objects with display window size.
Further, when receiving when instructing visual angle play instruction of user, whether user can be judged according to following methods
Trigger and instruct visual angle play instruction: if user slides screen, viewing panoramic video is more than not interact with playing device for n seconds,
Then automatic trigger instructs visual angle play instruction；Or user slides and is referred to when screen watches panoramic video by clicking button and triggering manually
Guide angle play instruction.
Further, it is described when receive instruct visual angle play instruction when according to the trigger time of the instruction to aphorama
User perspective when the step of user perspective in frequency broadcasting carries out adjustment comprises determining that trigger time and triggering；According to
Scenic picture corresponding to user perspective when determining trigger time is compared with the scene sample of training study, confirms
Scene sample corresponding to scenic picture corresponding to user perspective when the trigger time；According to the scene sample institute of confirmation
Corresponding excellent visual angle adjusts the user perspective at the time point, with the intelligence in the case where user does not trigger any other play instruction
The user perspective of next each frame can be adjusted.
Further, in the following way come the institute of scenic picture corresponding to user perspective when determining the trigger time
Corresponding scene sample: judging and search in the panoramic video frame of the trigger time display area corresponding to user perspective with
The corresponding scene sample of the maximum value is determined as the triggered time by the maximum value of the lap of all scenario objects samples
Scene sample corresponding to scenic picture corresponding to user perspective when point.
Further, if display area corresponding to the user perspective of all trigger times found and all fields
The lap of scape object samples is 0, exports corresponding prompt information.
Further, user panoramic video enter instruct visual angle to play when, at any time by with playing device interact into
Enter panoramic video sliding screen to play.
Further, user perspective and/or excellent visual angle are using following any form of expression: coordinate, attitude angle or space
Vector.
According to another aspect of the present invention, a kind of video play device at adjustment visual angle, the video are additionally provided
Playing device includes: video acquisition unit, is used to obtain panoramic video data；Processing unit is used for using artificial intelligence
Algorithm learns panoramic video data；And broadcast unit, be used for when receive instruct visual angle play instruction when, according to
Instruction triggers time point carries out adjustment to the user perspective in panoramic video broadcasting.
Further, the intelligent algorithm is deep learning algorithm or pattern matching algorithm.
Further, the processing unit is suitable for: extracting in the panoramic video frame of the panoramic video data multiple
Scenario objects and corresponding excellent visual angle, to learn excellent visual angle corresponding to each scene.
Further, the processing unit is suitable for being that retrieval window extracts scenario objects with display window size.
Further, the broadcast unit is suitable for: if it is more than not fill with broadcasting for n seconds that user, which slides screen viewing panoramic video,
It sets and is interacted, then automatic trigger instructs visual angle play instruction；Or it is slided when screen watches panoramic video and is passed through a little by user
It hits button and triggers manually and instruct visual angle play instruction.
Further, the broadcast unit is suitable for: user perspective when determining trigger time and triggering；According to determining touching
Scenic picture corresponding to user perspective when sending out time point is compared with the scene sample of training study, confirms the triggering
Scene sample corresponding to scenic picture corresponding to user perspective when time point；According to essence corresponding to the scene sample of confirmation
Color angle adjusts the user perspective at the time point, in the case where user does not trigger any other play instruction adjustment connect
The user perspective of each frame to get off.
Further, the broadcast unit is suitable in the following way come user perspective institute when determining the trigger time
Scene sample corresponding to corresponding scenic picture: judging and searches user perspective institute in the panoramic video frame of the trigger time
The maximum value of the lap of corresponding display area and all scenario objects samples, the corresponding scene sample of the maximum value is true
Scene sample corresponding to scenic picture corresponding to user perspective when being set to the trigger time.
Further, the broadcast unit is suitable for: if corresponding to the user perspective of all trigger times found
Display area and the laps of all scenario objects samples be 0, export corresponding prompt information.
Further, the broadcast unit panoramic video enter instruct visual angle to play when, when detect user and play
Enter panoramic video sliding screen when the interaction of device to play.
Further, user perspective and/or excellent visual angle are using following any form of expression: coordinate, attitude angle or space
Vector.
User can be watched panoramic video by the video broadcasting method and device at a kind of adjustment visual angle of the invention
Visual angle is adjusted to excellent visual angle, can be used family viewing panoramic video visual angle obtain similar professional photographer's shooting skill or
The change of panoramic video post-processing skill.
By the detailed description below in conjunction with attached drawing to highly preferred embodiment of the present invention, these and other of the invention is excellent
Point will be apparent from.
Detailed description of the invention
The present invention can be by reference to being better understood, wherein in institute below in association with description given by attached drawing
Have and has used the same or similar appended drawing reference in attached drawing to indicate same or similar component.The attached drawing is together with following
It is described in detail together comprising in the present specification and forming a part of this specification, and is used to that this is further illustrated
The preferred embodiment and explanation the principle of the present invention and advantage of invention.Wherein:
Fig. 1 is the process for showing a kind of a kind of exemplary process of video broadcasting method at adjustment visual angle of the invention
Figure；
Fig. 2 is the flow chart for showing a kind of possible processing of the step S3 in Fig. 1；
Fig. 3 is an exemplary structural block diagram for showing a kind of video play device at adjustment visual angle of the invention；
Fig. 4 is the block diagram for showing a kind of possible structure of the broadcast unit in Fig. 3.
It will be appreciated by those skilled in the art that element in attached drawing is just for the sake of showing for the sake of simple and clear,
And be not necessarily drawn to scale.For example, the size of certain elements may be exaggerated relative to other elements in attached drawing, with
Just the understanding to the embodiment of the present invention is helped to improve.
Specific embodiment
Exemplary embodiment of the invention is described hereinafter in connection with attached drawing.For clarity and conciseness,
All features of actual implementation mode are not described in the description.It should be understood, however, that developing any this actual implementation
Much decisions specific to embodiment must be made during example, to realize the objectives of developer, for example, symbol
Restrictive condition those of related to system and business is closed, and these restrictive conditions may have with the difference of embodiment
Changed.In addition, it will also be appreciated that although development is likely to be extremely complex and time-consuming, to having benefited from the present invention
For those skilled in the art of content, this development is only routine task.
Here, and also it should be noted is that, in order to avoid having obscured the present invention because of unnecessary details, in the accompanying drawings
Illustrate only with closely related apparatus structure and/or processing step according to the solution of the present invention, and be omitted and the present invention
The little other details of relationship.
Fig. 1 shows a kind of a kind of exemplary process of the video broadcasting method at above-mentioned adjustment visual angle.
It should be noted that in an embodiment of the present invention, excellent visual angle refers to that excellent picture institute is right in panoramic video frame
The broadcasting visual angle answered, wherein excellent picture be, for example, include specified object picture, specified object be, for example, some sight spot,
Some object (such as statue, building) and someone etc..In addition, the quantity for the specified object for including in excellent picture can be with
It is one, is also possible to multiple.
As shown in Figure 1, in step sl, obtaining panoramic video data.Then, step S2 is executed.
In step s 2, panoramic video data are learnt using intelligent algorithm.Then, step S3 is executed.
Wherein, intelligent algorithm employed in step S2 for example can be deep learning algorithm or pattern match is calculated
Method.
As an example, in step s 2, such as several scenario objects and correspondence can be extracted in panoramic video frame
Excellent visual angle, wherein can with display window size be retrieval window extract scenario objects；Then, by a certain number of
Scene and visual angle object samples learn excellent visual angle corresponding to each scene.
After executing the step S2, when receiving when instructing visual angle play instruction of user, it can broadcast in step s3
It puts device and adjustment is carried out to user perspective according to instruction triggers time point.
As an example, (playing device for example can be playing device when receiving when instructing visual angle play instruction of user
The smart phone etc. of user) it can judge whether user triggers according to following methods and instruct visual angle play instruction, such as user is sliding
It is not interacted for a long time with playing device when dynamic screen viewing panoramic video, then it is defeated twice by being set in free way
Enter interval time n second (n is, for example, 2 seconds, 3 seconds, 5 seconds or 10 seconds etc.) of instruction to judge, if user is more than n seconds not to broadcasting
Device is operated, then automatic trigger instructs visual angle play instruction；In another example user, which slides screen, watches panoramic video Shi Kedian
It hits button and triggers manually and instruct visual angle play instruction.
For example, step S3 for example may include step S31~S34 as shown in Figure 2.
As shown in Fig. 2, in step S31, user perspective when determining trigger time and triggering.
Then, in step s 32, the scene according to corresponding to user perspective when the trigger time determined in step S31
Picture is compared with the scene sample of training study, confirms as any scene or closest any scene.
Then, in step S33, which is adjusted according to excellent visual angle corresponding to the scene sample of step S32 confirmation
The user perspective of point.
In this way, in step S34, under the premise of user does not trigger any other play instruction (such as sliding screen),
Next each frame continues the excellent visual angle confirmed according to previous step and above-mentioned steps adjustment user perspective.
As an example, in step s 32, according to display scenic picture corresponding to the trigger time user perspective,
It is compared with the scene sample of training study, confirms as any scene or the method closest to any scene are as follows: sentence
Break and searches display area S0 corresponding to user perspective and all scenario objects samples in the panoramic video frame of the trigger time
The maximum value of the lap of this (S1, S2 ..., SN).Optionally, when lap is 0, prompt can be provided.
Wherein, N indicates the quantity of scenario objects sample.
For example, instructing field-of-view mode to play if user plays initial selected in panoramic video, user perspective is thrown to spherical surface
The spherical surface attitude angle of shadow, user's first frame when field-of-view mode is instructed in triggering is (70 °, 25 °), and corresponding display area is
S0；S0 and all scenario objects samples (S1, S2 ... ..., SN) are compared, if the lap of S1 and S0 is 30%, S2
The lap that lap with S0 is 50%, S3 and S0 is 80%, and the lap of remaining scene sample and S0 are 0,
Then confirm that scene sample S3 is immediate scene, excellent visual angle corresponding to S3 is spherical surface attitude angle (80 °, 30 °), then will work as
Preceding user perspective is adjusted to (80 °, 30 °)；Continue according to spherical surface attitude angle (80 °, 30 °) in next each frame according to above-mentioned
Step adjustment user perspective.
It should be noted that user panoramic video enter instruct visual angle to play when, can at any time by with playing device
Interaction enter panoramic video free way (as sliding screen) play.
It should be noted that many forms, such as coordinate, attitude angle, sky can be used in user perspective and excellent visual angle
Between vector etc..
It follows that same user instructs visual angle mould in different angle and different moments triggering in the same panoramic video of viewing
The scenic picture watched when formula is different；Due to not making any modification to video source file, and only play dress
It sets and viewing visual angle is adjusted according to different triggering modes accordingly, enhance interest and experience that user watches panoramic video
Sense.
In addition, the embodiments of the present invention also provide a kind of video play devices at adjustment visual angle.
Fig. 3 shows an exemplary structural block diagram of the video play device at above-mentioned adjustment visual angle.
As shown in figure 3, the video play device at adjustment visual angle include video acquisition unit 310, processing unit 320 with
And broadcast unit 330.
As shown in figure 3, the available panoramic video data of video acquisition unit 310.Then, processing unit 320 can be used
Intelligent algorithm learns panoramic video data.Wherein, intelligent algorithm used by processing unit 320 for example may be used
To be deep learning algorithm or pattern matching algorithm.
As an example, processing unit 320 can for example extract several scenario objects and correspondence in panoramic video frame
Excellent visual angle, wherein can with display window size be retrieval window extract scenario objects；Then, by a certain number of
Scene and visual angle object samples learn excellent visual angle corresponding to each scene.
In this way, when receiving when instructing visual angle play instruction of user, broadcast unit 330 can be according to the instruction triggers time
Point carries out adjustment to user perspective.
As an example, broadcast unit 330 can be sentenced according to following methods when receiving when instructing visual angle play instruction of user
Whether disconnected user, which triggers, is instructed visual angle play instruction, for example, user slide screen viewing panoramic video when for a long time not with broadcast
It puts device to be interacted, then by interval time n second for inputting instruction twice for setting in free way, (n is, for example, 2 seconds, 3
Second, 5 seconds or 10 seconds etc.) judge, if user is more than not operate to playing device for n seconds, automatic trigger instructs visual angle
Play instruction；Visual angle play instruction is instructed in another example button can be clicked when user's sliding screen viewing panoramic video and triggered manually.
As an example, broadcast unit 330 can have structure as shown in Figure 4.
As shown in figure 4, broadcast unit 330 is for example including determining module 410, comparison module 420 and adjustment module 430.
User perspective when determining module 410 can determine trigger time and triggering.
Then, the scenic picture according to corresponding to user perspective when the trigger time that determining module 410 determines, compares mould
Block 420 can be compared with the scene sample of training study, confirm as any scene or closest any scene.
Then, adjustment module 430 excellent visual angle adjustment according to corresponding to the scene sample that comparison module 420 confirms
The user perspective at the time point.In this way, under the premise of user does not trigger any other play instruction (such as sliding screen), adjustment
Module 430 can continue according to the excellent visual angle and manner described above of confirmation in next each frame come adjustment use
Family visual angle.
As an example, comparison module 420 for example can be with: judging and search user in the panoramic video frame of the trigger time
The maximum value of the lap of display area S0 corresponding to visual angle and all scenario objects samples (S1, S2 ..., SN).It can
Choosing, when lap is 0, prompt can be provided.
For example, instructing field-of-view mode to play if user plays initial selected in panoramic video, user perspective is thrown to spherical surface
The spherical surface attitude angle of shadow, user's first frame when field-of-view mode is instructed in triggering is (70 °, 25 °), and corresponding display area is
S0；S0 and all scenario objects samples (S1, S2 ... ..., SN) are compared, if the lap of S1 and S0 is 30%, S2
The lap that lap with S0 is 50%, S3 and S0 is 80%, and the lap of remaining scene sample and S0 are 0,
Then confirm that scene sample S3 is immediate scene, excellent visual angle corresponding to S3 is spherical surface attitude angle (80 °, 30 °), then will work as
Preceding user perspective is adjusted to (80 °, 30 °)；Continue according to spherical surface attitude angle (80 °, 30 °) in next each frame according to above-mentioned
Step adjustment user perspective.
It should be noted that user panoramic video enter instruct visual angle to play when, can at any time by with playing device
Interaction enter panoramic video free way (as sliding screen) play.
It should be noted that many forms, such as coordinate, attitude angle, sky can be used in user perspective and excellent visual angle
Between vector etc..
It follows that same user instructs visual angle mould in different angle and different moments triggering in the same panoramic video of viewing
The scenic picture watched when formula is different；Due to not making any modification to video source file, and only play dress
It sets and viewing visual angle is adjusted according to different triggering modes accordingly, enhance interest and experience that user watches panoramic video
Sense.
Finally, it should be noted that above embodiments are only to exemplary illustration technical solution of the present invention, rather than it is limited
System；Although the present invention and bring beneficial effect of the present invention are described in detail with reference to the foregoing embodiments, this field
Those of ordinary skill is it is understood that it is still possible to modify the technical solutions described in the foregoing embodiments or right
Part of technical characteristic is equivalently replaced；And these are modified or replaceed, it does not separate the essence of the corresponding technical solution
The range of the claims in the present invention.
To sum up, the embodiment provides following scheme:
The video broadcasting method at a kind of adjustment visual angle of scheme 1., which is characterized in that the video broadcasting method includes:
Obtain panoramic video data；
Panoramic video data are learnt using intelligent algorithm；And
When receive instruct visual angle play instruction when, according to the trigger time of the instruction to panoramic video play in use
Family visual angle carries out adjustment.
The video broadcasting method according to scheme 1 of scheme 2., which is characterized in that the intelligent algorithm is depth
Practise algorithm or pattern matching algorithm.
The video broadcasting method according to scheme 1 or 2 of scheme 3., which is characterized in that described to use intelligent algorithm
The step of learning to panoramic video data includes: to extract multiple fields in the panoramic video frame of the panoramic video data
Scape object and corresponding excellent visual angle, to learn excellent visual angle corresponding to each scene.
The video broadcasting method according to scheme 3 of scheme 4., which is characterized in that with display window size be retrieval window
Extract scenario objects.
The video broadcasting method according to any one of scheme 1-4 of scheme 5., which is characterized in that when receiving user's
When instructing visual angle play instruction, it can judge whether user triggers according to following methods and instruct visual angle play instruction:
If user slides screen, viewing panoramic video is more than not interact with playing device for n seconds, automatic trigger guidance
Visual angle play instruction；Or
User is triggered manually by click button when sliding screen viewing panoramic video and instructs visual angle play instruction.
The video broadcasting method according to any one of scheme 1-5 of scheme 6., which is characterized in that described to receive finger
Adjustment is carried out to the user perspective in panoramic video broadcasting according to the trigger time of the instruction when play instruction of guide angle
The step of include:
User perspective when determining trigger time and triggering；According to corresponding to user perspective when determining trigger time
Scenic picture is compared, field corresponding to user perspective when confirming the trigger time with the scene sample of training study
Scene sample corresponding to scape picture；The excellent visual angle according to corresponding to the scene sample of confirmation adjusts user's view at the time point
Angle, with the user perspective of the next each frame of adjustment in the case where user does not trigger any other play instruction.
Scheme 7. video broadcasting method according to scheme 6, which is characterized in that determine the touching in the following way
Scene sample corresponding to scenic picture corresponding to user perspective when sending out time point: judge and search the complete of the trigger time
The maximum value of the lap of display area corresponding to user perspective and all scenario objects samples in scape video frame, most by this
It is worth corresponding scene sample greatly and is determined as scene corresponding to scenic picture corresponding to user perspective when the trigger time
Sample.
The video broadcasting method according to scheme 7 of scheme 8., which is characterized in that if all triggered times found
The lap of display area corresponding to the user perspective of point and all scenario objects samples is 0, exports corresponding prompt
Information.
The video broadcasting method according to any one of scheme 1-8 of scheme 9., which is characterized in that user is in panoramic video
Into when visual angle being instructed to play, at any time by interacting to enter panoramic video and slide screen and playing with playing device.
The video broadcasting method according to any one of scheme 1-9 of scheme 10., which is characterized in that user perspective and/or
Excellent visual angle is using following any form of expression: coordinate, attitude angle or space vector.
A kind of video play device at the adjustment visual angle of scheme 11., which is characterized in that the video play device packet
It includes:
Video acquisition unit is used to obtain panoramic video data；
Processing unit is used to learn panoramic video data using intelligent algorithm；And
Broadcast unit, be used for when receive instruct visual angle play instruction when, according to instruction triggers time point to aphorama
User perspective in frequency broadcasting carries out adjustment.
The video play device according to scheme 11 of scheme 12., which is characterized in that the intelligent algorithm is depth
Learning algorithm or pattern matching algorithm.
The video play device according to scheme 11 or 12 of scheme 13., which is characterized in that the processing unit is suitable for:
Multiple scenario objects and corresponding excellent visual angle are extracted in the panoramic video frame of the panoramic video data, it is each to learn
Excellent visual angle corresponding to kind scene.
The video play device according to scheme 13 of scheme 14., which is characterized in that the processing unit is suitable for display
Window size is that retrieval window extracts scenario objects.
The video play device according to any one of scheme 11-14 of scheme 15., which is characterized in that the broadcasting is single
Member is suitable for:
If user slides screen, viewing panoramic video is more than not interact with playing device for n seconds, automatic trigger guidance
Visual angle play instruction；Or
It slides to trigger manually by click button when screen watches panoramic video by user and instructs visual angle play instruction.
The video play device according to any one of scheme 11-15 of scheme 16., which is characterized in that the broadcasting is single
Member is suitable for:
User perspective when determining trigger time and triggering；According to corresponding to user perspective when determining trigger time
Scenic picture is compared, field corresponding to user perspective when confirming the trigger time with the scene sample of training study
Scene sample corresponding to scape picture；The excellent visual angle according to corresponding to the scene sample of confirmation adjusts user's view at the time point
Angle, with the user perspective of the next each frame of adjustment in the case where user does not trigger any other play instruction.
The video play device according to scheme 16 of scheme 17., which is characterized in that the broadcast unit is suitable for by such as
Under type is come scene sample corresponding to scenic picture corresponding to user perspective when determining the trigger time: judging and looks into
Look for display area corresponding to user perspective in the panoramic video frame of the trigger time overlapping with all scenario objects samples
Partial maximum value, field corresponding to user perspective when the corresponding scene sample of the maximum value is determined as the trigger time
Scene sample corresponding to scape picture.
The video play device according to scheme 17 of scheme 18., which is characterized in that the broadcast unit is suitable for: if looking into
The lap of display area corresponding to the user perspective of all trigger times found and all scenario objects samples
It is 0, exports corresponding prompt information.
The video play device according to any one of scheme 11-18 of scheme 19., which is characterized in that the broadcasting is single
Member panoramic video enter instruct visual angle to play when, when detect user and playing device enters panoramic video sliding when interacting
Screen plays.
The video play device according to any one of scheme 11-19 of scheme 20., which is characterized in that user perspective and/
Or excellent visual angle is using following any form of expression: coordinate, attitude angle or space vector.
Claims (10)
1. a kind of video broadcasting method at adjustment visual angle, which is characterized in that the video broadcasting method includes:
Obtain panoramic video data；
Panoramic video data are learnt using intelligent algorithm；And
When receive instruct visual angle play instruction when, according to the trigger time of the instruction to panoramic video play in user regard
Angle carries out adjustment.
2. video broadcasting method according to claim 1, which is characterized in that the intelligent algorithm is deep learning calculation
Method or pattern matching algorithm.
3. video broadcasting method according to claim 1 or 2, which is characterized in that described to use intelligent algorithm to complete
The step of scape video data is learnt includes: to extract multiple scenes pair in the panoramic video frame of the panoramic video data
As and corresponding excellent visual angle, to learn excellent visual angle corresponding to each scene.
4. video broadcasting method according to claim 3, which is characterized in that extracted with display window size for retrieval window
Scenario objects.
5. video broadcasting method described in any one of -4 according to claim 1, which is characterized in that when the guidance for receiving user
When the play instruction of visual angle, it can judge whether user triggers according to following methods and instruct visual angle play instruction:
If user slides screen, viewing panoramic video is more than not interact with playing device for n seconds, and automatic trigger instructs visual angle
Play instruction；Or
User is triggered manually by click button when sliding screen viewing panoramic video and instructs visual angle play instruction.
6. video broadcasting method according to any one of claims 1-5, which is characterized in that described to receive guidance view
Carry out the step of adjustment when the play instruction of angle to the user perspective in panoramic video broadcasting according to the trigger time of the instruction
Suddenly include:
User perspective when determining trigger time and triggering；According to scene corresponding to user perspective when determining trigger time
Picture is compared with the scene sample of training study, and scene corresponding to user perspective is drawn when confirming the trigger time
Scene sample corresponding to face；The excellent visual angle according to corresponding to the scene sample of confirmation adjusts the user perspective at the time point,
With the user perspective of the next each frame of adjustment in the case where user does not trigger any other play instruction.
7. video broadcasting method according to claim 6, which is characterized in that in the following way come when determining the triggering
Between scene sample corresponding to scenic picture corresponding to user perspective when putting: judge and search the aphorama of the trigger time
The maximum value of the lap of display area corresponding to user perspective and all scenario objects samples in frequency frame, by the maximum value
Corresponding scene sample is determined as scene sample corresponding to scenic picture corresponding to user perspective when the trigger time.
8. video broadcasting method according to claim 7, which is characterized in that if all trigger times found
The lap of display area corresponding to user perspective and all scenario objects samples is 0, exports corresponding prompt information.
9. video broadcasting method according to claim 1 to 8, which is characterized in that user enters in panoramic video
When visual angle being instructed to play, at any time by entering panoramic video sliding screen broadcasting with interacting for playing device.
10. a kind of video play device at adjustment visual angle, which is characterized in that the video play device includes:
Video acquisition unit is used to obtain panoramic video data；
Processing unit is used to learn panoramic video data using intelligent algorithm；And
Broadcast unit, be used for when receive instruct visual angle play instruction when, panoramic video is broadcast according to instruction triggers time point
User perspective in putting carries out adjustment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910628917.9A CN110312170B (en) | 2019-07-12 | 2019-07-12 | Video playing method and device capable of intelligently adjusting visual angle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910628917.9A CN110312170B (en) | 2019-07-12 | 2019-07-12 | Video playing method and device capable of intelligently adjusting visual angle |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110312170A true CN110312170A (en) | 2019-10-08 |
| CN110312170B CN110312170B (en) | 2022-03-04 |
Family
ID=68080053
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910628917.9A Active CN110312170B (en) | 2019-07-12 | 2019-07-12 | Video playing method and device capable of intelligently adjusting visual angle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110312170B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106060515A (en) * | 2016-07-14 | 2016-10-26 | 腾讯科技（深圳）有限公司 | Panoramic media file push method and apparatus |
| CN106331732A (en) * | 2016-09-26 | 2017-01-11 | 北京疯景科技有限公司 | Method for generating panoramic content, method for displaying panoramic content and corresponding devices |
| CN106358036A (en) * | 2016-08-31 | 2017-01-25 | 杭州当虹科技有限公司 | Method for watching virtual reality video at preset view angle |
| CN106447788A (en) * | 2016-09-26 | 2017-02-22 | 北京疯景科技有限公司 | Watching angle indication method and device |
| US20170195561A1 (en) * | 2016-01-05 | 2017-07-06 | 360fly, Inc. | Automated processing of panoramic video content using machine learning techniques |
| CN107483920A (en) * | 2017-08-11 | 2017-12-15 | 北京理工大学 | A kind of panoramic video appraisal procedure and system based on multi-layer quality factor |
| CN107749945A (en) * | 2017-09-27 | 2018-03-02 | 深圳岚锋创视网络科技有限公司 | A kind of method, apparatus and portable terminal for adjusting full-view image viewing visual angle |
| CN108769640A (en) * | 2018-09-11 | 2018-11-06 | 深圳众赢时代科技有限公司 | Automatically adjust visual angle shadow casting technique |
-
2019
- 2019-07-12 CN CN201910628917.9A patent/CN110312170B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170195561A1 (en) * | 2016-01-05 | 2017-07-06 | 360fly, Inc. | Automated processing of panoramic video content using machine learning techniques |
| CN106060515A (en) * | 2016-07-14 | 2016-10-26 | 腾讯科技（深圳）有限公司 | Panoramic media file push method and apparatus |
| CN106358036A (en) * | 2016-08-31 | 2017-01-25 | 杭州当虹科技有限公司 | Method for watching virtual reality video at preset view angle |
| CN106331732A (en) * | 2016-09-26 | 2017-01-11 | 北京疯景科技有限公司 | Method for generating panoramic content, method for displaying panoramic content and corresponding devices |
| CN106447788A (en) * | 2016-09-26 | 2017-02-22 | 北京疯景科技有限公司 | Watching angle indication method and device |
| CN107483920A (en) * | 2017-08-11 | 2017-12-15 | 北京理工大学 | A kind of panoramic video appraisal procedure and system based on multi-layer quality factor |
| CN107749945A (en) * | 2017-09-27 | 2018-03-02 | 深圳岚锋创视网络科技有限公司 | A kind of method, apparatus and portable terminal for adjusting full-view image viewing visual angle |
| CN108769640A (en) * | 2018-09-11 | 2018-11-06 | 深圳众赢时代科技有限公司 | Automatically adjust visual angle shadow casting technique |
Non-Patent Citations (1)
| Title |
|---|
| 杨露菁: "《智能图像处理及应用》", 31 March 2019 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110312170B (en) | 2022-03-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111556278B (en) | Video processing method, video display device and storage medium | |
| CN111540055B (en) | Three-dimensional model driving method, three-dimensional model driving device, electronic equipment and storage medium | |
| CN101552890B (en) | Information processing apparatus, information processing method | |
| CN102801924B (en) | Television program host interaction system based on Kinect | |
| CN101552874B (en) | Image processing apparatus, display control method, program, and storage medium | |
| WO2020076356A1 (en) | Systems and methods for providing feedback for artificial intelligence-based image capture devices | |
| CN104427252B (en) | Method and its electronic equipment for composograph | |
| CN113596552B (en) | Display device and information display method | |
| CN110225402B (en) | Method and device for intelligently keeping interesting target time display in panoramic video | |
| CN105898133A (en) | Video shooting method and device | |
| CN205622745U (en) | Real -time synthesis system of virtual reality true man | |
| CN105847937A (en) | Method and device for displaying video | |
| CN103533285A (en) | Image capturing apparatus, image processing apparatus, control method thereof and program | |
| CN108900764A (en) | Image pickup method and electronic device and filming control method and server | |
| CN110324640A (en) | A kind of intelligent panoramic video broadcasting method and device | |
| CN113655887A (en) | Virtual reality equipment and static screen recording method | |
| CN114363689A (en) | Live broadcast control method and device, storage medium and electronic equipment | |
| CN116097120A (en) | Display method and display device | |
| CN110225401A (en) | A kind of video broadcasting method and device of adjustable viewing angle | |
| CN110324641A (en) | The method and device of targets of interest moment display is kept in panoramic video | |
| CN111757138A (en) | Close-up display method and device based on single-shot live video | |
| CN106896923A (en) | Virtual interacting method and device | |
| CN110312170A (en) | A kind of video broadcasting method and device at adjustment visual angle | |
| Méndez et al. | New distributed virtual TV set architecture for a synergistic operation of sensors and improved interaction between real and virtual worlds | |
| CN114339029B (en) | Shooting method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |