CN105843541A - Target tracking and displaying method and device in panoramic video - Google Patents
Target tracking and displaying method and device in panoramic video Download PDFInfo
- Publication number
- CN105843541A CN105843541A CN201610166633.9A CN201610166633A CN105843541A CN 105843541 A CN105843541 A CN 105843541A CN 201610166633 A CN201610166633 A CN 201610166633A CN 105843541 A CN105843541 A CN 105843541A
- Authority
- CN
- China
- Prior art keywords
- panoramic video
- screen
- video
- interest
- targets
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
Abstract
The invention discloses a target tracking and displaying method and device in a panoramic video. The method comprises the following steps: receiving an operation instruction of a user and confirming the operation position of the operation instruction on a current display screen; confirming an interesting target of the user in the panoramic video according to the operation position and the video displayed on the current display screen; and tracking the interesting target in the panoramic video and displaying part of interesting target-centered videos in the panoramic video on the display screen. By means of the method, the target in the panoramic video can be automatically tracked according to the user intention and displayed on the display screen of an intelligent terminal.
Description
Technical field
The present invention relates to panoramic video technical field, particularly relate to the target tracking in a kind of panoramic video
Display packing and device.
Background technology
Image is the main path that the mankind obtain visual information.Generally we can obtain reality easily
The separate picture of a series of local in the world, but the image information that these are separated synthesizes " panorama
The world " then will provide information more comprehensively for us.Panoramic view refers to centered by observer, around
Fixing point rotates a circle the presentation technology of visual field scene of viewed 360 degree or 720 degree, and it is one
Plant brand-new image information enterprise schema, the environmental information of complete surrounding can be expressed.
And intelligent terminal, such as smart mobile phone, panel computer, intelligent television, telephone, wireless electricity
Words, mobile or portable radio etc. are because of its intelligent, portability, or the advantage such as communication capacity
Obtain using the most widely.Intelligent terminal has colorful display screen, and this is intelligent terminal's
Panoptic visualization provides possibility.
Although the method having occurred in that the display screen display panoramic video intelligent terminal in prior art,
But, it was found by the inventors of the present invention that the most this display packing can not meet entering of user
One step demand: when user wishes certain moving target of continuous observation, owing to display screen is only able to display panorama
The sub-fraction of video, then, user has to manual paddling screen, will comprise this target constantly
Picture drag to the centre of screen and watch.Obviously, this method is highly detrimental to the user tracking phase
The target hoped.
Therefore, it is necessary to propose a kind of automatically to carry out panoramic video on the display screen of intelligent terminal
In target tracking display packing and device.
Summary of the invention
In view of this, it is an object of the invention to the target tracking display packing proposing in a kind of panoramic video
And device so that can be according to the target being intended in automatic tracing panoramic video of user and intelligent terminal
Display screen on show.
Based on above-mentioned purpose, the target tracking display packing in a kind of panoramic video that the present invention provides, answer
For the terminal unit with touch screen, including:
Receive the operational order of user, determine the described operational order operating position at currently displaying screen；
According to described operating position, and the video of currently displaying screen display, determine in panoramic video and use
The targets of interest at family；
Described targets of interest is followed the trail of, with institute in described display screen display panoramic video in panoramic video
State the partial video centered by targets of interest.
It is preferred that described according to described operational order, and the video of currently displaying screen display, determine
The targets of interest of user in panoramic video, specifically includes:
According to described operational order, determine the screen coordinate value of user's operating position on described display screen；
According to the video of described currently displaying screen display, determine the broadcasting visual angle of described panoramic video；
According to the screen coordinate value of described operating position, and the broadcasting visual angle of described panoramic video, determine
The targets of interest of user position in panoramic video.
Wherein, described operational order is specially touch information；According to described operational order, determine that user is described
The screen coordinate value of the operating position on display screen, specifically includes:
According to described touch information, obtain the screen coordinate value screen as described operating position of touch location
Curtain coordinate figure；.
Or,
Described operational order is specially paddling information；And
According to described operational order, determine the screen coordinate value of user's operating position on described display screen,
Specifically include:
According to paddling information, obtain the screen coordinate value screen as described operating position in paddling final position
Curtain coordinate figure.
Or,
Described operational order is specially and amplifies display information；And
According to described operational order, determine the screen coordinate value of user's operating position on described display screen,
Specifically include:
According to amplifying display information, obtain the screen coordinate value at center of enlarged display area as described behaviour
Make the screen coordinate value of position.
It is preferred that the described screen coordinate value according to described operating position, and described broadcasting visual angle, really
Make described targets of interest position coordinates in panoramic video, specifically include:
According to the screen coordinate value of operating position described in currently displaying video, and described panoramic video
Broadcasting visual angle, determine that panoramic video corresponding to the screen coordinate value screen coordinate value of described operating position is sat
Scale value；
Point coordinates value centered by described panoramic video coordinate figure, with R as radius, determines in panoramic video
Target area；Wherein, R is setting value；
Video object tracing algorithm is utilized to follow the trail of target area in panoramic video, and by described target area
Center as targets of interest.
In panoramic video, described targets of interest is followed the trail of it is preferred that described, complete in described display screen display
Partial video centered by described viewpoint in scape video, specifically includes:
Determine the position coordinates that described targets of interest is current in panoramic video；
Described targets of interest is mapped at the position coordinates of panoramic video the center of described display screen
After screen coordinate, obtain mapping matrix；
Centered by the position coordinates that described targets of interest is current in panoramic video, obtain in panoramic video
Take a length of L, the rectangular area of a width of W, according to described mapping matrix, described rectangular area is mapped to aobvious
Display screen also shows at described display screen；
Wherein, L, W determine according to the pixels across of display screen and longitudinal pixel respectively.
In another aspect of this invention, additionally provide the target tracking display device in a kind of panoramic video,
Including:
Targets of interest determines module, for receiving the operational order of user, determines that described operational order is being worked as
The operating position of front display screen；According to described operating position, and the video of currently displaying screen display,
Determine the targets of interest of user in panoramic video；
Target tracking module, for following the trail of described targets of interest in panoramic video；
Video display module, for described targets of interest being in described display screen display panoramic video
The partial video at center.
It is preferred that described targets of interest determines that module includes:
Focus determines unit, for according to described operational order, determines that user is on described display screen
The screen coordinate value of operating position；
Play visual angle and determine unit, for the video according to described currently displaying screen display, determine institute
State the broadcasting visual angle of panoramic video；
Target determination unit, for the screen coordinate value according to described operating position, and described aphorama
The broadcasting visual angle of frequency, determines the targets of interest of the user position in panoramic video.
It is preferred that described focus determines that unit specifically for the display screen operation information inputted as user is
During touch information, obtain the screen coordinate value screen coordinate value as described operating position of touch location；
Or
Described focus determines that unit is touch paddling specifically for the display screen operation information inputted as user
During information, obtain the screen coordinate value screen coordinate value as described operating position in paddling final position；
Or
Described focus determines that unit shows for amplifying specifically for the display screen operation information inputted as user
During information, the screen coordinate value at the center of acquisition enlarged display area is sat as the screen of described operating position
Scale value.
It is preferred that described target determination unit specifically includes:
Panoramic video coordinate determines subelement, for according to operating position described in currently displaying video
Screen coordinate value, and the broadcasting visual angle of described panoramic video, determine corresponding complete of described screen coordinate value
Scape video coordinates value；
Target area determines subelement, is used for point coordinates value centered by described panoramic video coordinate figure, with
R is radius, determines the target area in panoramic video；Wherein, R is setting value；
Targets of interest follows the trail of subelement, is used for utilizing video object tracing algorithm to follow the trail of mesh in panoramic video
Mark region, and using the center of described target area as targets of interest.
It is preferred that described video display module specifically includes:
Target location determines unit, for determining described targets of interest position in panoramic video present frame
Coordinate；
Mapping matrix computing unit, for being mapped to described targets of interest at the position coordinates of panoramic video
After the screen coordinate of the center of described display screen, obtain mapping matrix；
Viewing area determines unit, for the position coordinates current in panoramic video with described targets of interest
Centered by, panoramic video obtains a length of L, the rectangular area of a width of W；Wherein, L, W are respectively
Pixels across according to display screen and longitudinal pixel determine；
Play visual angle computing unit, according to targets of interest currently in the position of panoramic video, calculate broadcasting and regard
Angle；
Map display unit, be used for according to described mapping matrix, and described broadcasting visual angle computing unit meter
The broadcasting visual angle calculated, enters at described display screen after described rectangular area is mapped to the screen coordinate of display screen
Row display.
In technical scheme, intelligent terminal, can be defeated according to user when playing panoramic video
The broadcasting visual angle of video in display screen the operation information, and currently displaying screen entered, automatic decision goes out panorama
The targets of interest of user in video；And then in panoramic video, follow the trail of this targets of interest constantly, meanwhile,
Using this targets of interest as viewpoint, show the part centered by this viewpoint in panoramic video on a display screen
Video, thus reach being intended to automatic tracing and showing the purpose of target according to user.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of the target tracking display packing embodiment in a kind of panoramic video of the present invention；
Fig. 2,3 to be that the present invention is a kind of determine the flow process of the embodiment of the method for user interest target in panoramic video
Schematic diagram；
Fig. 4 is that the method for a kind of partial video shown in panoramic video centered by viewpoint of the present invention is implemented
Example schematic flow sheet；
Fig. 5 is the internal structure frame of the target tracking display device embodiment in a kind of panoramic video of the present invention
Figure；
Fig. 6 is the internal structure block diagram that the targets of interest of an embodiment of the present invention determines module；
Fig. 7 is the internal structure block diagram of the target determination unit of an embodiment of the present invention；
Fig. 8 is the internal structure block diagram of the video display module of an embodiment of the present invention.
Detailed description of the invention
For making the object, technical solutions and advantages of the present invention clearer, below in conjunction with being embodied as
Example, and referring to the drawings, the present invention is described in more detail.
Embodiments of the invention are described below in detail, and the example of described embodiment is shown in the drawings, its
In the most same or similar label represent same or similar element or there is same or like merit
The element of energy.The embodiment described below with reference to accompanying drawing is exemplary, is only used for explaining this
Bright, and be not construed as limiting the claims.
Those skilled in the art of the present technique are appreciated that unless expressly stated, singulative used herein
" one ", " one ", " described " and " being somebody's turn to do " may also comprise plural form.Should manage further
Solve, the wording used in the description of the present invention " include " referring to existing described feature, integer,
Step, operation, element and/or assembly, but it is not excluded that existence or add one or more other
Feature, integer, step, operation, element, assembly and/or their group.It should be understood that when me
Claim element to be " connected " or during " coupled " to another element, it can be directly connected or coupled to
Other elements, or intermediary element can also be there is.Additionally, " connection " used herein or " coupling
Connect " wireless connections can be included or wireless couple.Wording "and/or" used herein includes one
Or more be associated list the whole of item or any cell and all combinations.
The main thought of the present invention is, intelligent terminal, can be according to user when playing panoramic video
The broadcasting visual angle of video in display screen the operation information, and currently displaying screen of input, automatic decision goes out entirely
The targets of interest of user in scape video；And then in panoramic video, follow the trail of this targets of interest constantly, meanwhile,
Using this targets of interest as viewpoint, show the part centered by this viewpoint in panoramic video on a display screen
Video, reaches being intended to from motion tracking the purpose that shows targets of interest according to user.
It is true that panoramic video enriches due to visual information, multiple moving target may be comprised simultaneously,
Now, applying technical scheme, user can be to interested by operation on a display screen
Target carry out of short duration manual trace or confirmation, and intelligent terminal is according to user's on a display screen short
Follow the trail of temporarily or affirming conduct, specifically which target of user's current interest can be automatically captured,
Then keep track for this target: although this target may be constantly more in panoramic video
Change place, say, that this target position coordinates in panoramic video converts constantly, but intelligence
Energy terminal, can be all the time with this target as viewpoint after keeping track this targets of interest, at display screen
Upper display panoramic video comprises the video pictures of this viewpoint, and viewpoint is placed in display screen as far as possible
Heart position, thus reach the desired target of automatic tracing user, and show on intelligent terminal
Purpose.
Describe technical scheme below in conjunction with the accompanying drawings in detail.
Target tracking display packing in the panoramic video that the embodiment of the present invention provides, idiographic flow such as Fig. 1
Shown in, comprise the steps:
Step S101: intelligent terminal, in the playing process of panoramic video, receives the operational order of user.
Specifically, intelligent terminal obtains panoramic video resource by network from server, according to default setting
Or the mode recommended shows the partial video image in panoramic video on a display screen.
Generally the display screen of intelligent terminal is touch screen, user by touch screen input operational order
Can be following display screen operate information: touch information, paddling information or with touch manner input
Amplification display information.
It is true that user is when watching image or video by intelligent terminal, touch manner can be passed through
Input the information zooming in or out display, zoom in or out currently displaying figure with indicating intelligent terminal
Picture or video.
Step S102: video on the operational order that intelligent terminal inputs according to user, and currently displaying screen
Play angle, determine the targets of interest of user in panoramic video.
Step S103: intelligent terminal follows the trail of described targets of interest in panoramic video, and with described interest mesh
It is denoted as viewpoint, partial video centered by described viewpoint in described display screen display panoramic video.
Specifically, the display screen operation information that in above-mentioned steps S102, intelligent terminal inputs according to user, with
And the video of currently displaying screen display, determine the concrete grammar of the targets of interest of user in panoramic video,
Flow process is as in figure 2 it is shown, comprise the steps:
Step S201: the display screen operation information that intelligent terminal inputs according to user, determines that user is described
The screen coordinate value of the operating position on display screen.
Specifically, when the display screen operation information of user's input is touch information, can be according to touching letter
Breath, obtains the screen coordinate value screen coordinate value as described operating position of touch location, that is conduct
The screen coordinate value of focus；
Or, when user input display screen operation information be paddling information time, can according to paddling information,
Obtain the screen coordinate value screen coordinate value as described operating position in paddling final position, that is conduct
The screen coordinate value of focus；
Or, when the display screen operation information of user's input is for amplifying display information, according to amplifying display
Information, the screen coordinate value at the center of acquisition enlarged display area is as the screen coordinate of described operating position
Value, that is as the screen coordinate value of focus.
Step S202: intelligent terminal, according to the video of currently displaying screen display, determines panoramic video
Play visual angle.
Generally intelligent terminal is when playing panoramic video, and what current screen was play is not whole panoramas
Video signal, but certain in panoramic video signal towards video signal.It is true that panoramic video
Being centered by observer, rotate a circle the visual field scene of observed to comprehensive 360 degree around fixing point.
Intelligent terminal obtains panoramic video resource by network from server；The full-view video image of usual each frame
Size be both greater than the display size of intelligent terminal's screen, say, that what user saw on screen works as
Front picture is a part for panoramic video current frame image.So, when playing, intelligent terminal is permissible
Give tacit consent to or recommend or determine to show any portion in panoramic video current frame image according to the selection of user
Partial image.The part image shown then is equivalent to user to be watched with certain observation visual angle as observer
The a part of image seen during panoramic video, this observation visual angle is the broadcasting visual angle of current video.
Therefore, according to currently playing video, it may be determined that go out currently playing be in panoramic video which
Play the video content at visual angle.
Step S203: intelligent terminal is according to the screen coordinate value of operating position, and the broadcasting of panoramic video
Visual angle, determines the targets of interest of user in panoramic video.
Specifically, as shown in the flow process of Fig. 3, determining operating position, i.e. the screen of the focus of user
After coordinate figure, and the broadcasting visual angle of current panorama video, panoramic video can be determined according to following method
The targets of interest of middle user, comprises the steps:
Step S301: according to the screen coordinate value of operating position in currently displaying video, and described in broadcast
Put visual angle, determine the panoramic video coordinate figure that described screen coordinate value is corresponding.
In this step, intelligent terminal can be according to operating position, i.e. focus in currently displaying video
Screen coordinate value, and the broadcasting visual angle of currently playing panoramic video, determine the screen coordinate of focus
The panoramic video coordinate figure that value is corresponding.Concrete how according to screen coordinate value, broadcasting visual angle, determine and screen
The technology of the panoramic video coordinate figure that curtain coordinate figure is corresponding is well known to those skilled in the art, the most no longer
Repeat.
Step S302: point coordinates value centered by the panoramic video coordinate figure that above-mentioned steps S301 is determined,
With R as radius, determine the target area in panoramic video；Wherein, R is setting value, art technology
Personnel can rule of thumb or practical situation is set.
Specifically, point coordinates value centered by the panoramic video coordinate figure that above-mentioned steps S301 is determined, with
R is radius, determines the region (i.e. target area) carrying out target tracking in panoramic video.
Step S303: utilize video object tracing algorithm to follow the trail of target area, Jin Erjian in panoramic video
Measure the targets of interest in target area.
Specifically, utilize video object tracing algorithm (such as: frame difference method), keep track target area and working as
Position in next frame of video of the frame of video of front broadcasting.In the target constantly following the trail of, updating position coordinates
In region, using the center of target area that currently tracks as targets of interest.So, fortune can be followed the trail of
Targets of interest in moving or changing.
Flow process as shown in Figure 4, in the display panoramic video mentioned in above-mentioned steps S103 with viewpoint being
The concrete grammar of the partial video of the heart, comprises the steps:
Step S401: determine the position coordinates that targets of interest is current in panoramic video.
Specifically, after detecting targets of interest, such as, the comparison in difference method utilizing consecutive frame determines this
The position coordinates that targets of interest is current in panoramic video.
Step S402: described targets of interest is mapped at the position coordinates of panoramic video the center of display screen
Position calculation mapping matrix, and recalculate the broadcasting visual angle of video.
In this step, according to targets of interest at the position coordinates of panoramic video, and the centre bit of display screen
Mapping relations between the screen coordinate put try to achieve the mapping matrix of coordinate transform.Additionally, due to correspond to
The position coordinates of the panoramic video of the center of display screen has been changed, therefore, it is also desirable to redefine
The broadcasting visual angle of video.
Step S403: according to the mapping matrix calculated, and the broadcasting visual angle recalculated, by described emerging
Interest target is mapped to the center of display screen at the position coordinates of panoramic video.
Display screen is a length of L, the rectangular area of a width of W.The size in this region and display device resolution
Size matches.Length-width ratio L/W of display screen should be (false equal to length-width ratio L0/W0 of display device pixel
If display device a length of L0 pixel, a width of W0 pixel).The reflection obtained according to above-mentioned steps S403
The mapping matrix of mapping relations between panoramic video position coordinates and screen coordinate, reflects whole rectangular area
After being mapped to the screen coordinate of display screen, show the video content in rectangular area on a display screen.
Owing to the intelligent terminal of the embodiment of the present invention is when playing panoramic video, can input according to user
Display screen operation information, and currently displaying screen on the broadcasting visual angle of video, automatic decision goes out aphorama
The targets of interest of user in Pin；And then in panoramic video, follow the trail of this targets of interest constantly, meanwhile, with
This targets of interest as viewpoint, shows in panoramic video that the part centered by this viewpoint regards on a display screen
Frequently, thus reach being intended to automatic tracing and showing the purpose of target according to user.
Based on said method, the target tracking being arranged in the panoramic video in intelligent terminal of the present invention shows
Device, internal structure is as it is shown in figure 5, include: targets of interest determines module 501, target tracking module
502, video display module 503.
Targets of interest determine module 501 for during intelligent terminal's playing panoramic video, if receiving
The operational order of user, it is determined that described operational order is at the operating position of currently displaying screen；According to described
Operating position, and the video of currently displaying screen display, determine the targets of interest of user in panoramic video；
Wherein, user input display screen operation information can be specifically touch information, paddling information or with
The amplification display information of touch manner input.
Target tracking module 502 is used for after targets of interest determines that module 501 determines targets of interest, entirely
Scape video is followed the trail of described targets of interest.
Video display module 503 is used in described display screen display panoramic video with described targets of interest
Centered by partial video.Specifically, video display module 503 is real-time for target tracking module 502
Follow the trail of result, using described targets of interest as viewpoint, with institute in described display screen display panoramic video
State the partial video centered by viewpoint.
As shown in Figure 6, specifically can include such as lower unit during targets of interest determines module 501: focus
Determine that unit 601, broadcasting visual angle determine unit 602, target determination unit 603.
Focus determines that unit 601, for according to described operational order, determines that user is on described display screen
The screen coordinate value of operating position；Specifically, focus determines that unit 601 is when the display of user's input
When screen operation information is touch information, obtain the screen coordinate value of touch location as described operating position
Screen coordinate value；Or, when the display screen operation information of user's input is for touching paddling information, obtain
The screen coordinate value in paddling final position is as the screen coordinate value of described operating position；Or, work as user
When the display screen operation information of input is for amplifying display information, obtain the screen at the center of enlarged display area
Coordinate figure is as the screen coordinate value of described operating position.
Play visual angle and determine that unit 602, for the video according to currently displaying screen display, determines panorama
The broadcasting visual angle of video.
Target determination unit 603 for determining the screen of operating position that unit 601 determines according to focus
Coordinate figure, and play the broadcasting visual angle of the panoramic video that visual angle determines that unit 602 determines, determine panorama
The targets of interest of user in video.
As it is shown in fig. 7, target determination unit 603 specifically can include following subelement: panoramic video
Coordinate determines that subelement 701, target area determine that subelement 702, targets of interest follow the trail of subelement 703.
Panoramic video coordinate determines that subelement 701 is for according to operating position described in currently displaying video
Screen coordinate value, and described broadcasting visual angle, determine that panoramic video corresponding to described screen coordinate value is sat
Scale value.
Target area determines that subelement 702 is for determining what subelement 701 was determined with panoramic video coordinate
Point coordinates value centered by panoramic video coordinate figure, with R as radius, determines the target area in panoramic video；
Wherein, R is setting value, and those skilled in the art can rule of thumb or practical situation is set or adjusts
Whole.
Targets of interest follows the trail of subelement 703 for utilizing the comparison in difference method of consecutive frame to determine in target area
The target area that subelement 702 is determined detects targets of interest.
As shown in Figure 8, video display module 503 specifically can include such as lower unit: target location is true
Cell 801, viewing area determine unit 802, mapping matrix computing unit 803, map display unit
804, visual angle computing unit 805 is play.
Target location determines that unit 801 is for determining the position that described targets of interest is current in panoramic video
Coordinate；
Play visual angle computing unit 805 to be used for according to targets of interest currently in the position of panoramic video, calculate
Play visual angle.
By target location, mapping matrix computing unit 803 is for determining that the targets of interest that unit 801 determines exists
After the screen coordinate of the center that the position coordinates of panoramic video is mapped to described display screen, mapped
Matrix.
Viewing area determines with target location, unit 802 is for determining that the targets of interest that unit 801 determines exists
Centered by position coordinates current in panoramic video, panoramic video obtains a length of L, the square of a width of W
Shape region；Wherein, L, W determine according to the pixels across of display screen and longitudinal pixel respectively.
Map the mapping matrix that display unit 804 is used for obtaining according to mapping matrix computing unit 803, with
And the broadcasting visual angle that described broadcasting visual angle computing unit calculates, described rectangular area is mapped to display screen
Show at display screen after screen coordinate.
Each module in said apparatus, the concrete function of unit can refer to above-mentioned as shown in Fig. 1-4 flow process
Method, here is omitted.
In technical scheme, intelligent terminal, can be defeated according to user when playing panoramic video
The display screen operation information entered, and the video of currently displaying screen display, automatic decision goes out panoramic video
The targets of interest of middle user；And then in panoramic video, follow the trail of this targets of interest constantly, meanwhile, with this
Targets of interest, as viewpoint, shows the partial video centered by this viewpoint in panoramic video on a display screen,
Thus reach being intended to automatic tracing and showing the purpose of target according to user.
Those skilled in the art of the present technique are appreciated that the present invention includes relating to performing described herein
One or more equipment in operation.These equipment can be required purpose and specialized designs and manufacture,
Or the known device in general purpose computer can also be included.These equipment have storage calculating within it
Machine program, these computer programs optionally activate or reconstruct.Such computer program can be deposited
Store up in equipment (such as, computer) computer-readable recording medium or be stored in and be suitable to store e-command difference
Being coupled in any kind of medium of bus, described computer-readable medium includes but not limited to any class
The dish (including floppy disk, hard disk, CD, CD-ROM and magneto-optic disk) of type, ROM (Read-Only
Memory, read only memory), RAM (Random Access Memory, memorizer immediately),
EPROM (Erasable Programmable Read-Only Memory, the read-only storage of erasable programmable
Device), (Electrically Erasable Programmable Read-Only Memory, electricity can for EEPROM
EPROM), flash memory, magnetic card or light card.It is, computer-readable recording medium includes
By equipment (such as, computer) with the form storage that can read or any medium of transmission information.
Those skilled in the art of the present technique are appreciated that and can realize these structures with computer program instructions
Frame in each frame in figure and/or block diagram and/or flow graph and these structure charts and/or block diagram and/or flow graph
Combination.Those skilled in the art of the present technique are appreciated that and can be supplied to by these computer program instructions
The processor of general purpose computer, special purpose computer or other programmable data processing methods realizes, thus
Structure chart disclosed by the invention is performed by the processor of computer or other programmable data processing methods
And/or the scheme specified in block diagram and/or the frame of flow graph or multiple frame.
Those skilled in the art of the present technique be appreciated that the present invention had discussed various operations, method,
Step in flow process, measure, scheme can be replaced, changed, combined or deleted.Further, tool
There are the various operations discussed in the present invention, method, other steps in flow process, measure, scheme
Can also be replaced, changed, reset, decomposed, combined or deleted.Further, of the prior art
Have with the step in the various operations disclosed in the present invention, method, flow process, measure, scheme can also
Replaced, changed, reset, decomposed, combined or deleted.
Those of ordinary skill in the field are it is understood that the discussion of any of the above embodiment is merely illustrative
, it is not intended that hint the scope of the present disclosure (including claim) is limited to these examples；At this
Under bright thinking, can also be combined between the technical characteristic in above example or different embodiment,
Step can realize with random order, and exist the present invention as above different aspect many other
Change, for they not offers in details simple and clear.Therefore, all the spirit and principles in the present invention it
In, any omission of being made, amendment, equivalent, improvement etc., should be included in the protection of the present invention
Within the scope of.
Claims (10)
1. the target tracking display packing in a panoramic video, it is characterised in that including:
Receive the operational order of user, determine the described operational order operating position at currently displaying screen；
According to described operating position, and the video of currently displaying screen display, determine in panoramic video and use
The targets of interest at family；
Described targets of interest is followed the trail of, with institute in described display screen display panoramic video in panoramic video
State the partial video centered by targets of interest.
Method the most according to claim 1, it is characterised in that described according to described operational order,
And the video of currently displaying screen display, determine the targets of interest of user in panoramic video, specifically include:
According to described operational order, determine the screen coordinate value of user's operating position on described display screen；
According to the video of described currently displaying screen display, determine the broadcasting visual angle of described panoramic video；
According to the screen coordinate value of described operating position, and the broadcasting visual angle of described panoramic video, determine
The targets of interest of user position in panoramic video.
Method the most according to claim 2, it is characterised in that described operational order is specially touch information；
According to described operational order, determine the screen coordinate value of user's operating position on described display screen, tool
Body includes:
According to described touch information, obtain the screen coordinate value screen as described operating position of touch location
Curtain coordinate figure；.
Or,
Described operational order is specially paddling information；And
According to described operational order, determine the screen coordinate value of user's operating position on described display screen,
Specifically include:
According to paddling information, obtain the screen coordinate value screen as described operating position in paddling final position
Curtain coordinate figure.
Or,
Described operational order is specially and amplifies display information；And
According to described operational order, determine the screen coordinate value of user's operating position on described display screen,
Specifically include:
According to amplifying display information, obtain the screen coordinate value at center of enlarged display area as described behaviour
Make the screen coordinate value of position.
4. according to the arbitrary described method of claim 2, it is characterised in that described according to described operative position
The screen coordinate value put, and described broadcasting visual angle, determine that described targets of interest is in panoramic video
Position coordinates, specifically includes:
According to the screen coordinate value of operating position described in currently displaying video, and described panoramic video
Broadcasting visual angle, determine that panoramic video corresponding to the screen coordinate value screen coordinate value of described operating position is sat
Scale value；
Point coordinates value centered by described panoramic video coordinate figure, with R as radius, determines in panoramic video
Target area；Wherein, R is setting value；
Video object tracing algorithm is utilized to follow the trail of target area in panoramic video, and by described target area
Center as targets of interest.
5. the method stated according to claim 1, it is characterised in that described follow the trail of in panoramic video described
Targets of interest, partial video centered by described viewpoint in described display screen display panoramic video,
Specifically include:
Determine the position coordinates that described targets of interest is current in panoramic video；
Described targets of interest is mapped at the position coordinates of panoramic video the center of described display screen
After screen coordinate, obtain mapping matrix；
Centered by the position coordinates that described targets of interest is current in panoramic video, obtain in panoramic video
Take a length of L, the rectangular area of a width of W, according to described mapping matrix, described rectangular area is mapped to aobvious
Display screen also shows at described display screen；
Wherein, L, W determine according to the pixels across of display screen and longitudinal pixel respectively.
6. the target tracking display device in a panoramic video, it is characterised in that including:
Targets of interest determines module, for receiving the operational order of user, determines that described operational order is being worked as
The operating position of front display screen；According to described operating position, and the video of currently displaying screen display,
Determine the targets of interest of user in panoramic video；
Target tracking module, for following the trail of described targets of interest in panoramic video；
Video display module, for described targets of interest being in described display screen display panoramic video
The partial video at center.
Device the most according to claim 6, it is characterised in that described targets of interest determines module bag
Include:
Focus determines unit, for according to described operational order, determines that user is on described display screen
The screen coordinate value of operating position；
Play visual angle and determine unit, for the video according to described currently displaying screen display, determine institute
State the broadcasting visual angle of panoramic video；
Target determination unit, for the screen coordinate value according to described operating position, and described aphorama
The broadcasting visual angle of frequency, determines the targets of interest of the user position in panoramic video.
Device the most according to claim 7, it is characterised in that
Described focus determines that unit is touch information specifically for the display screen operation information inputted as user
Time, obtain the screen coordinate value screen coordinate value as described operating position of touch location；Or
Described focus determines that unit is touch paddling specifically for the display screen operation information inputted as user
During information, obtain the screen coordinate value screen coordinate value as described operating position in paddling final position；
Or
Described focus determines that unit shows for amplifying specifically for the display screen operation information inputted as user
During information, the screen coordinate value at the center of acquisition enlarged display area is sat as the screen of described operating position
Scale value.
Device the most according to claim 7, it is characterised in that described target determination unit specifically wraps
Include:
Panoramic video coordinate determines subelement, for according to operating position described in currently displaying video
Screen coordinate value, and the broadcasting visual angle of described panoramic video, determine corresponding complete of described screen coordinate value
Scape video coordinates value；
Target area determines subelement, is used for point coordinates value centered by described panoramic video coordinate figure, with
R is radius, determines the target area in panoramic video；Wherein, R is setting value；
Targets of interest follows the trail of subelement, is used for utilizing video object tracing algorithm to follow the trail of mesh in panoramic video
Mark region, and using the center of described target area as targets of interest.
10. according to the arbitrary described device of claim 6-9, it is characterised in that described video display mould
Block specifically includes:
Target location determines unit, for determining described targets of interest position in panoramic video present frame
Coordinate；
Mapping matrix computing unit, for being mapped to described targets of interest at the position coordinates of panoramic video
After the screen coordinate of the center of described display screen, obtain mapping matrix；
Viewing area determines unit, for the position coordinates current in panoramic video with described targets of interest
Centered by, panoramic video obtains a length of L, the rectangular area of a width of W；Wherein, L, W are respectively
Pixels across according to display screen and longitudinal pixel determine；
Play visual angle computing unit, according to targets of interest currently in the position of panoramic video, calculate broadcasting and regard
Angle；
Map display unit, be used for according to described mapping matrix, and described broadcasting visual angle computing unit meter
The broadcasting visual angle calculated, enters at described display screen after described rectangular area is mapped to the screen coordinate of display screen
Row display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610166633.9A CN105843541A (en) | 2016-03-22 | 2016-03-22 | Target tracking and displaying method and device in panoramic video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610166633.9A CN105843541A (en) | 2016-03-22 | 2016-03-22 | Target tracking and displaying method and device in panoramic video |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105843541A true CN105843541A (en) | 2016-08-10 |
Family
ID=56582964
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610166633.9A Pending CN105843541A (en) | 2016-03-22 | 2016-03-22 | Target tracking and displaying method and device in panoramic video |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105843541A (en) |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106303706A (en) * | 2016-08-31 | 2017-01-04 | 杭州当虹科技有限公司 | The method realizing following visual angle viewing virtual reality video with leading role based on face and item tracking |
| CN106331732A (en) * | 2016-09-26 | 2017-01-11 | 北京疯景科技有限公司 | Method for generating panoramic content, method for displaying panoramic content and corresponding devices |
| CN106534827A (en) * | 2016-12-19 | 2017-03-22 | 暴风集团股份有限公司 | Method and system for playing panoramic video based on user perspective |
| CN106961597A (en) * | 2017-03-14 | 2017-07-18 | 深圳Tcl新技术有限公司 | The target tracking display methods and device of panoramic video |
| CN108024094A (en) * | 2016-11-04 | 2018-05-11 | 安华高科技通用Ip(新加坡)公司 | 360 degree of videographs and playback are carried out with Object tracking |
| WO2018171487A1 (en) * | 2017-03-23 | 2018-09-27 | 华为技术有限公司 | Panoramic video playback method and client terminal |
| CN108628913A (en) * | 2017-03-24 | 2018-10-09 | 上海交通大学 | The processing method and processing device of video |
| CN109845274A (en) * | 2016-10-25 | 2019-06-04 | 索尼公司 | Sending device, sending method, receiving device and method of reseptance |
| CN110178155A (en) * | 2017-01-25 | 2019-08-27 | 深圳看到科技有限公司 | Panorama method of adjustment and panorama adjust device |
| CN110225402A (en) * | 2019-07-12 | 2019-09-10 | 青岛一舍科技有限公司 | Intelligence keeps the method and device of targets of interest moment display in panoramic video |
| CN110324648A (en) * | 2019-07-17 | 2019-10-11 | 咪咕文化科技有限公司 | Live streaming shows method and system |
| CN110858907A (en) * | 2018-08-22 | 2020-03-03 | 晨星半导体股份有限公司 | Picture block layout reconstruction method capable of adapting to size of decoding frame buffer and related video decoding device |
| CN110998566A (en) * | 2017-06-30 | 2020-04-10 | Pcms控股公司 | Method and apparatus for generating and displaying360 degree video based on eye tracking and physiological measurements |
| CN111182218A (en) * | 2020-01-07 | 2020-05-19 | 影石创新科技股份有限公司 | Panoramic video processing method, device, equipment and storage medium |
| CN111327823A (en) * | 2020-02-28 | 2020-06-23 | 深圳看到科技有限公司 | Video generation method and device and corresponding storage medium |
| CN111684795A (en) * | 2017-12-15 | 2020-09-18 | Pcms控股公司 | Method for using viewing path in 360 ° video navigation |
| CN113099245A (en) * | 2021-03-04 | 2021-07-09 | 广州方硅信息技术有限公司 | Panoramic video live broadcast method, system and computer readable storage medium |
| CN113284339A (en) * | 2021-05-13 | 2021-08-20 | 恒大新能源汽车投资控股集团有限公司 | Vehicle information reminding method, storage medium and vehicle information reminding system |
| CN113473244A (en) * | 2020-06-23 | 2021-10-01 | 青岛海信电子产业控股股份有限公司 | Free viewpoint video playing control method and device |
| CN115396741A (en) * | 2022-07-29 | 2022-11-25 | 北京势也网络技术有限公司 | Panoramic video playing method and device, electronic equipment and readable storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080066000A1 (en) * | 2006-08-25 | 2008-03-13 | Microsoft Corporation | Panoramic ring user interface |
| CN102148965A (en) * | 2011-05-09 | 2011-08-10 | 上海芯启电子科技有限公司 | Video monitoring system for multi-target tracking close-up shooting |
| CN102214054A (en) * | 2010-04-01 | 2011-10-12 | 英业达股份有限公司 | System and method for executing input operation in magnifying display area |
| CN102929508A (en) * | 2012-10-11 | 2013-02-13 | 中兴通讯股份有限公司 | Touch method and device for electronic map |
| CN104010225A (en) * | 2014-06-20 | 2014-08-27 | 合一网络技术(北京)有限公司 | Method and system for displaying panoramic video |
| CN104199594A (en) * | 2014-09-28 | 2014-12-10 | 厦门幻世网络科技有限公司 | Target position positioning method and device based on touch screen |
-
2016
- 2016-03-22 CN CN201610166633.9A patent/CN105843541A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080066000A1 (en) * | 2006-08-25 | 2008-03-13 | Microsoft Corporation | Panoramic ring user interface |
| CN102214054A (en) * | 2010-04-01 | 2011-10-12 | 英业达股份有限公司 | System and method for executing input operation in magnifying display area |
| CN102148965A (en) * | 2011-05-09 | 2011-08-10 | 上海芯启电子科技有限公司 | Video monitoring system for multi-target tracking close-up shooting |
| CN102929508A (en) * | 2012-10-11 | 2013-02-13 | 中兴通讯股份有限公司 | Touch method and device for electronic map |
| CN104010225A (en) * | 2014-06-20 | 2014-08-27 | 合一网络技术(北京)有限公司 | Method and system for displaying panoramic video |
| CN104199594A (en) * | 2014-09-28 | 2014-12-10 | 厦门幻世网络科技有限公司 | Target position positioning method and device based on touch screen |
Cited By (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106303706A (en) * | 2016-08-31 | 2017-01-04 | 杭州当虹科技有限公司 | The method realizing following visual angle viewing virtual reality video with leading role based on face and item tracking |
| CN106331732A (en) * | 2016-09-26 | 2017-01-11 | 北京疯景科技有限公司 | Method for generating panoramic content, method for displaying panoramic content and corresponding devices |
| CN106331732B (en) * | 2016-09-26 | 2019-11-12 | 北京疯景科技有限公司 | Generate, show the method and device of panorama content |
| CN109845274A (en) * | 2016-10-25 | 2019-06-04 | 索尼公司 | Sending device, sending method, receiving device and method of reseptance |
| CN108024094A (en) * | 2016-11-04 | 2018-05-11 | 安华高科技通用Ip(新加坡)公司 | 360 degree of videographs and playback are carried out with Object tracking |
| CN108024094B (en) * | 2016-11-04 | 2021-01-15 | 安华高科技股份有限公司 | 360degree video recording and playback with object tracking |
| CN106534827A (en) * | 2016-12-19 | 2017-03-22 | 暴风集团股份有限公司 | Method and system for playing panoramic video based on user perspective |
| CN110178155A (en) * | 2017-01-25 | 2019-08-27 | 深圳看到科技有限公司 | Panorama method of adjustment and panorama adjust device |
| CN106961597A (en) * | 2017-03-14 | 2017-07-18 | 深圳Tcl新技术有限公司 | The target tracking display methods and device of panoramic video |
| CN106961597B (en) * | 2017-03-14 | 2019-07-26 | 深圳Tcl新技术有限公司 | The target tracking display methods and device of panoramic video |
| WO2018171487A1 (en) * | 2017-03-23 | 2018-09-27 | 华为技术有限公司 | Panoramic video playback method and client terminal |
| CN108632674A (en) * | 2017-03-23 | 2018-10-09 | 华为技术有限公司 | A kind of playback method and client of panoramic video |
| US11303881B2 (en) | 2017-03-23 | 2022-04-12 | Huawei Technologies Co., Ltd. | Method and client for playing back panoramic video |
| CN108632674B (en) * | 2017-03-23 | 2021-09-21 | 华为技术有限公司 | Panoramic video playing method and client |
| CN108628913A (en) * | 2017-03-24 | 2018-10-09 | 上海交通大学 | The processing method and processing device of video |
| CN110998566B (en) * | 2017-06-30 | 2024-04-12 | 交互数字Vc控股公司 | Method and apparatus for generating and displaying 360 degree video based on eye tracking and physiological measurements |
| CN110998566A (en) * | 2017-06-30 | 2020-04-10 | Pcms控股公司 | Method and apparatus for generating and displaying360 degree video based on eye tracking and physiological measurements |
| CN111684795A (en) * | 2017-12-15 | 2020-09-18 | Pcms控股公司 | Method for using viewing path in 360 ° video navigation |
| CN115499686B (en) * | 2017-12-15 | 2024-03-08 | Pcms控股公司 | Method for using viewing path in 360 ° video navigation |
| CN115499686A (en) * | 2017-12-15 | 2022-12-20 | Pcms控股公司 | Method for using viewing path in 360 ° video navigation |
| US11451881B2 (en) | 2017-12-15 | 2022-09-20 | Interdigital Madison Patent Holdings, Sas | Method for using viewing paths in navigation of 360 degree videos |
| CN111684795B (en) * | 2017-12-15 | 2022-08-12 | Pcms控股公司 | Method for using viewing path in 360 ° video navigation |
| CN110858907A (en) * | 2018-08-22 | 2020-03-03 | 晨星半导体股份有限公司 | Picture block layout reconstruction method capable of adapting to size of decoding frame buffer and related video decoding device |
| CN110225402A (en) * | 2019-07-12 | 2019-09-10 | 青岛一舍科技有限公司 | Intelligence keeps the method and device of targets of interest moment display in panoramic video |
| CN110225402B (en) * | 2019-07-12 | 2022-03-04 | 青岛一舍科技有限公司 | Method and device for intelligently keeping interesting target time display in panoramic video |
| CN110324648B (en) * | 2019-07-17 | 2021-08-06 | 咪咕文化科技有限公司 | Live broadcast display method and system |
| CN110324648A (en) * | 2019-07-17 | 2019-10-11 | 咪咕文化科技有限公司 | Live streaming shows method and system |
| WO2021139728A1 (en) * | 2020-01-07 | 2021-07-15 | 影石创新科技股份有限公司 | Panoramic video processing method, apparatus, device, and storage medium |
| CN111182218A (en) * | 2020-01-07 | 2020-05-19 | 影石创新科技股份有限公司 | Panoramic video processing method, device, equipment and storage medium |
| WO2021170123A1 (en) * | 2020-02-28 | 2021-09-02 | 深圳看到科技有限公司 | Video generation method and device, and corresponding storage medium |
| CN111327823A (en) * | 2020-02-28 | 2020-06-23 | 深圳看到科技有限公司 | Video generation method and device and corresponding storage medium |
| CN113473244A (en) * | 2020-06-23 | 2021-10-01 | 青岛海信电子产业控股股份有限公司 | Free viewpoint video playing control method and device |
| CN113099245A (en) * | 2021-03-04 | 2021-07-09 | 广州方硅信息技术有限公司 | Panoramic video live broadcast method, system and computer readable storage medium |
| CN113284339B (en) * | 2021-05-13 | 2022-08-02 | 恒大新能源汽车投资控股集团有限公司 | Vehicle information reminding method, storage medium and vehicle information reminding system |
| CN113284339A (en) * | 2021-05-13 | 2021-08-20 | 恒大新能源汽车投资控股集团有限公司 | Vehicle information reminding method, storage medium and vehicle information reminding system |
| CN115396741A (en) * | 2022-07-29 | 2022-11-25 | 北京势也网络技术有限公司 | Panoramic video playing method and device, electronic equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105843541A (en) | Target tracking and displaying method and device in panoramic video | |
| CN110072087B (en) | Camera linkage method, device, equipment and storage medium based on 3D map | |
| CN110288036B (en) | Image restoration method and device and electronic equipment | |
| US20180357245A1 (en) | Animated Seek Preview for Panoramic Videos | |
| CN107067447B (en) | Integrated video monitoring method for large spatial region | |
| CN106101610B (en) | Image display system, information processing equipment and image display method | |
| CN105828206A (en) | Multi-video on-demand method and device | |
| US20120148106A1 (en) | Terminal and method for providing augmented reality | |
| WO2017133147A1 (en) | Live-action map generation method, pushing method and device for same | |
| CN107645620A (en) | System, device and related method for editing preview image | |
| CN103902788A (en) | Electric map layer drawing method and device | |
| CN111091584B (en) | Target tracking method, device, equipment and storage medium | |
| CN110120087B (en) | Label marking method and device for three-dimensional virtual sand table and terminal equipment | |
| CN104767975A (en) | Method for achieving interactive panoramic video stream map | |
| CN110288549A (en) | Video repairing method, device and electronic equipment | |
| CN109120901B (en) | Method for switching pictures among cameras | |
| CN114387400A (en) | Three-dimensional scene display method, display device, electronic equipment and server | |
| KR20210040294A (en) | Method, device, electronic equipment and storage medium for querying historical street view | |
| CN111372036B (en) | Video monitoring method and system | |
| CN113905211B (en) | Video patrol method, device, electronic equipment and storage medium | |
| WO2012004622A1 (en) | An augmented reality method, and a corresponding system and software | |
| CN106325667A (en) | Method and device for quickly locating target object | |
| CN105917329B (en) | Information display device and information display program | |
| CN104821007A (en) | System for directly performing quick-look display on three-dimensional earth | |
| CN114625983B (en) | House source information display method and device, electronic equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160810 |
|
| WD01 | Invention patent application deemed withdrawn after publication |