CN106961597B - The target tracking display methods and device of panoramic video - Google Patents
The target tracking display methods and device of panoramic video Download PDFInfo
- Publication number
- CN106961597B CN106961597B CN201710153172.6A CN201710153172A CN106961597B CN 106961597 B CN106961597 B CN 106961597B CN 201710153172 A CN201710153172 A CN 201710153172A CN 106961597 B CN106961597 B CN 106961597B
- Authority
- CN
- China
- Prior art keywords
- target tracking
- tracking object
- display screen
- panoramic video
- pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/398—Synchronisation thereof; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Databases & Information Systems (AREA)
- Controls And Circuits For Display Device (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses a kind of target tracking display methods of panoramic video, this method comprises: instructing the target tracking object determined in panoramic video according to the user's choice;The identification information of the target tracking object is generated according to preset rules;The target tracking object is tracked in the panoramic video according to the identification information of generation, so that the target tracking object is maintained in current display screen and shows.The invention also discloses a kind of target tracking display devices of panoramic video.The automatic tracing that the present invention can be realized target object in panoramic video is shown, to simplify user's operation, promotes the viewing experience of user.
Description
Technical field
The present invention relates to ntelligent television technolog field more particularly to the target tracking display methods and device of panoramic video.
Background technique
In recent years, VR (Virtual Reality, virtual reality) technology has begun and is used in smart television.Panorama
Video is the Fundamentals of VR video, is to convert dynamic video image for static panoramic pictures, user can be any
The dynamic video within the scope of panoramic camera shooting angle is watched, to generate sense on the spot in person.
Currently, when user watches panoramic video by smart television, since the smart television a certain moment is only able to display entirely
Part visual angle in scape video, when the target object that user wants viewing is moved to another view from a visual angle of panoramic video
When angle, target object will be disappeared in the visual angle currently shown, and user needs remote controller adjustment visual angle to realize at this time
Target tracking, and target object is movably more frequent, the remote control operation of user also can be more frequent, and it is not only cumbersome, while
Affect the viewing experience of user.
Summary of the invention
It is a primary object of the present invention to propose the target tracking display methods and device of a kind of panoramic video, it is intended to realize
The automatic tracing of target object is shown in panoramic video, to simplify user's operation, promotes the viewing experience of user.
To achieve the above object, the present invention provides a kind of target tracking display methods of panoramic video, the method includes
Following steps:
The target tracking object determined in panoramic video is instructed according to the user's choice;
The identification information of the target tracking object is generated according to preset rules;
The target tracking object is tracked in the panoramic video according to the identification information of generation, so that the mesh
Mark tracking object, which is maintained in current display screen, to be shown.
Optionally, described that the target tracking pair is tracked in the panoramic video according to the identification information of generation
As so that the target tracking object is maintained at the step of showing in current display screen includes:
Being detected in the predeterminable area of current display platen edge according to the identification information of generation whether there is the target
Track object;
If so, the visual angle that the display screen is currently shown is adjusted according to preset rules, so that the target tracking object
It is maintained in current display screen and shows.
Optionally, described currently to show in the predeterminable area of platen edge whether deposit according to the identification information judgment of generation
Before the target tracking object the step of, further includes:
Calculate pixel space size shared by the target tracking object;
The target tracking object is set in the display platen edge according to the pixel space size being calculated
Detection area.
Optionally, described that the visual angle that the display screen is currently shown is adjusted according to preset rules, so that the target tracking
Object is maintained at the step of showing in current display screen and includes:
Obtain location information of the target tracking object in the predeterminable area of the display platen edge;
The visual angle that the display screen is currently shown is adjusted according to the location information got, so that the target tracking
Object is maintained in current display screen and shows.
Optionally, the step of identification information that the target tracking object is generated according to preset rules includes:
Obtain the color component value of each pixel in the target tracking object;
Color is carried out to the target tracking object according to the color component value got to negate, and obtains each pixel
Negated color component value;
The negated color component value of each pixel is added up according to color type correspondence, the color point after adding up
Mark of the magnitude as the target tracking object.
In addition, to achieve the above object, the present invention also provides a kind of target tracking display device of panoramic video, the dresses
It sets and includes:
Determining module, for instructing the target tracking object in determining panoramic video according to the user's choice;
Generation module, for generating the identification information of the target tracking object according to preset rules;
Display module is tracked, the target is tracked in the panoramic video for the identification information according to generation and chases after
Track object, so that the target tracking object is maintained in current display screen and shows.
Optionally, the tracking display module includes:
Detecting unit, in the predeterminable area for detecting current display platen edge according to the identification information of generation whether
There are the target tracking objects;
Adjustment unit, if there are the target tracking object in predeterminable area for currently showing platen edge, according to
Preset rules adjust the visual angle that the display screen is currently shown, show so that the target tracking object is maintained in current display screen
Show.
Optionally, the tracking display module further include:
Computing unit, for calculating pixel space size shared by the target tracking object;
Setting unit, for the mesh to be arranged in the display platen edge according to the pixel space size being calculated
The detection area of mark tracking object.
Optionally, the adjustment unit is also used to:
Obtain location information of the target tracking object in the predeterminable area of the display platen edge;
The visual angle that the display screen is currently shown is adjusted according to the location information got, so that the target tracking
Object is maintained in current display screen and shows.
Optionally, the generation module includes:
Acquiring unit, for obtaining the color component value of each pixel in the target tracking object;
Color negates unit, for carrying out color to the target tracking object according to the color component value got
It negates, obtains the negated color component value of each pixel;
Summing elements will for the negated color component value of each pixel to add up according to color type correspondence
Mark of the color component value as the target tracking object after cumulative.
The present invention instructs the target tracking object determined in panoramic video according to the user's choice;It is generated according to preset rules
The identification information of the target tracking object;The target is tracked in the panoramic video according to the identification information of generation
Object is tracked, so that the target tracking object is maintained in current display screen and shows.By the above-mentioned means, working as target tracking pair
When as being moved in panoramic video, display terminal can according to the identification information automatic tracing target object of target tracking object,
User need not continually manually adjust the display view angle of display screen, to simplify user's operation, improve the viewing body of user
It tests.
Detailed description of the invention
Fig. 1 is the flow diagram of the target tracking display methods first embodiment of panoramic video of the present invention;
Fig. 2 is the flow diagram of the target tracking display methods second embodiment of panoramic video of the present invention;
Fig. 3 is the flow diagram of the target tracking display methods 3rd embodiment of panoramic video of the present invention;
Fig. 4 is that there are the display interface schematic diagrames of target tracking object in the predeterminable area of the display screen of the invention top edge;
Fig. 5 is the refinement step schematic diagram of step S20 in Fig. 1;
Fig. 6 is the functional block diagram of one embodiment of target tracking display device of panoramic video of the present invention;
Fig. 7 is the refinement the functional block diagram that display module is tracked in Fig. 6;
Fig. 8 is another refinement the functional block diagram that display module is tracked in Fig. 6;
Fig. 9 is the refinement the functional block diagram of generation module in Fig. 6.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The present invention provides a kind of target tracking display methods of panoramic video.
Referring to Fig.1, Fig. 1 is the flow diagram of the target tracking display methods first embodiment of panoramic video of the present invention.
Described method includes following steps:
Step S10 instructs the target tracking object determined in panoramic video according to the user's choice;
The application scenarios of the present embodiment can be with are as follows: and smart television obtains panoramic video resource by network or other modes,
And the panoramic video resource got is played using related playing program, the visual angle that panoramic video is initially defaulted with one is shown
Show, during playing panoramic video, user watches and find its interested mobile object, is chosen to be target tracking
Object, the movement of smart television, that is, automatic tracing object, shows that the object in display screen always.
Specifically, smart television can by the way that the object of shift action may be generated in profile automatic identification panoramic video,
Such as personage, animal, vehicle, then, user send selection instruction to smart television by remote control, and smart television is receiving use
Determine the jobbie in broadcasting pictures as target tracking object after the selection instruction at family;In addition, supporting to touch in smart television
When screen operation, user also directly can send selection instruction to smart television by touch operation, and smart television can be used by identification
The operation such as click, sliding, the amplification of family based on display screen, to determine target tracking object from the panoramic video of broadcasting.
Step S20 generates the identification information of the target tracking object according to preset rules;
After object is tracked in selected target, smart television generates the identification information of target tracking object according to preset rules,
The identification information is used for unique identification target tracking object, may include number, title, the class of character and target tracking object
Type etc..For example, smart television can obtain the image of target tracking object, then calculated using hash algorithm (such as md5 algorithm)
To mark of the cryptographic Hash as target tracking object of the image;For another example, the face of each pixel in target tracking object can be obtained
Colouring component value carries out color to target tracking object according to the color component value got and negates, and obtains after each pixel negates
Color component value, the negated color component value of each pixel is added up according to color type correspondence, will be cumulative after
Mark of the color component value as the target tracking object.It is of course also possible to use target tracking is calculated in other algorithms
The mark of object.In this way, subsequent when being tracked to target tracking object, it will be able to quickly be judged by identification information currently aobvious
It whether there is target tracking object in the panoramic video that display screen is shown.
Step S30 tracks the target tracking object according to the identification information of generation in the panoramic video, with
The target tracking object is maintained in current display screen to show.
After the identification information for generating the target tracking object, smart television is according to the identification information of generation in aphorama
Target tracking object is tracked in frequency, is shown so that target tracking object is maintained in current display screen.Specifically, smart television can
Detect whether target tracking object is moved into display platen edge according to identification information, if so, adjust automatically is shown at this time
Shield the visual angle currently shown, for example, the visual angle for the panoramic video that smart television is currently shown is the shooting view of panoramic camera 1
Angle, smart television detect target tracking object and are moved to display screen left frame, the view at this time automatically currently showing display screen
Angle is adjusted to the shooting visual angle of panoramic camera 2, and the shooting visual angle of panoramic camera 2 is counterclockwise relative to panoramic camera 1
Predetermined angular is rotated, is to ensure that target tracking object shows in display screen always and is unlikely to disappear in display as a result,
In screen.Certainly, smart television can also obtain the moving direction and moving distance of target tracking object in preset duration, according to
The visual angle of moving direction and the corresponding adjustment display screen of moving distance, so that target tracking object is always held at the center of display screen
Position is shown, flexible setting can be carried out in specific implementation.
In the present embodiment, the target tracking object determined in panoramic video is instructed according to the user's choice;According to default
Rule generates the identification information of the target tracking object;It is tracked in the panoramic video according to the identification information of generation
The target tracking object, so that the target tracking object is maintained in current display screen and shows.By the above-mentioned means, working as mesh
When mark tracking object moves in panoramic video, display terminal can be according to the identification information automatic tracing mesh of target tracking object
Object is marked, user need not continually manually adjust the display view angle of display screen, to simplify user's operation, improve user's
Viewing experience.
It further, is the stream of the target tracking display methods second embodiment of panoramic video of the present invention referring to Fig. 2, Fig. 2
Journey schematic diagram.Based on above-mentioned embodiment shown in FIG. 1, step S30 may include:
Step S31, being detected according to the identification information of generation whether there is in the predeterminable area of current display platen edge
The target tracking object;
Step S32, if currently there are the target tracking objects in the predeterminable area of display platen edge, according to default rule
The visual angle that the display screen is currently shown then is adjusted, so that the target tracking object is maintained in current display screen and shows.
In the present embodiment, smart television is believed after the identification information for generating target tracking object according to the mark of generation
It whether there is target tracking object in the predeterminable area of the current display platen edge of breath detecting;If the currently preset areas of display platen edge
There are target tracking objects in domain, then the visual angle currently shown according to preset rules adjustment display screen, so that target tracking object
It is maintained in current display screen and shows.For example, smart television, which at a time detects target tracking object, is moved to display screen
In the predeterminable area of left edge, which probably continues to be moved to the left, and should correspond to adjustment display screen at this time and work as
The visual angle of preceding display is shown so that target tracking object is maintained in current display screen.
In above-mentioned steps, smart television is detected in the current predeterminable area for showing platen edge according to identification information whether there is
The specific steps of target tracking object can be with are as follows: a certain moment smart television determine the target tracking object in panoramic video and by
Its ident value is calculated according to preset rules, and subsequent time smart television is obtained and all in the predeterminable area of display platen edge may be produced
The object of raw shift action simultaneously calculates separately its ident value according to identical rule, by the ident value being calculated and target tracking
The ident value of object is matched, if successful match, can determine that target tracking object is moved into the pre- of display platen edge
If in region.
Further, step S32 may include:
Step S321 obtains location information of the target tracking object in the predeterminable area of the display platen edge;
Step S322 adjusts the visual angle that the display screen is currently shown according to the location information got, so that institute
It states target tracking object and is maintained in current display screen and show.
There are when target tracking object in the predeterminable area for detecting current display platen edge, smart television is further obtained
Location information of the target tracking object in the predeterminable area of display platen edge is taken, then according to the location information adjustment got
The visual angle that display screen is currently shown is shown so that target tracking object is maintained in current display screen.For example, if getting target
Object is tracked in the predeterminable area of display screen left edge, then the corresponding visual angle for currently showing display screen is moved to the left;If obtaining
Target tracking object is got on a display screen in the predeterminable area at edge, then is corresponded to visual angle that display screen is currently shown to moving up
It is dynamic.Wherein, visual angle is mobile or the range of rotation can be configured in advance, can also according to the moving distance of target tracking object and
It is fixed.
The present embodiment whether there is target tracking object in the predeterminable area by detecting display platen edge, can be to target
The situation of movement of tracking object is effectively determined that, when target tracking object is in display platen edge, adjustment display screen is current
The visual angle of display can guarantee that target tracking object is maintained in current display screen and show and be unlikely to disappear in display screen,
Improve the viewing experience of user.
It further, is the stream of the target tracking display methods 3rd embodiment of panoramic video of the present invention referring to Fig. 3, Fig. 3
Journey schematic diagram.Based on above-mentioned embodiment shown in Fig. 2, before step S31, can also include:
Step S33 calculates pixel space size shared by the target tracking object;
Step S34 is arranged the target in the display platen edge according to the pixel space size being calculated and chases after
The detection area of track object.
In the present embodiment, since the detection area of target tracking object should not be arranged too small, should not also be arranged
Greatly, too small will lead to is set and detects fall short tracking object in predeterminable area, conference, which was arranged, then will increase smart television
Operand.For the reasonability for guaranteeing the setting of detection area range, current display screen side is being detected according to the identification information of generation
With the presence or absence of before target tracking object in the predeterminable area of edge, smart television can be calculated first shared by target tracking object
Pixel space size, then according to the pixel space size being calculated in the display platen edge setting target tracking object
Detection area.
It is that there are the display interfaces of target tracking object in the predeterminable area of the display screen of the invention top edge referring to Fig. 4, Fig. 4
Schematic diagram.For example, it is that 60 × 80 (horizontal direction is long that pixel space size shared by target tracking object, which is calculated, in smart television
Degree is 60 pixels, and vertical direction height is 80 pixels), then the detection area of the target tracking object at each edge of display screen is set
Length in the horizontal direction should be not less than 60 pixels, and should be not less than 80 pixels in the height of vertical direction, on this basis
The size of detection area can carry out flexible setting according to actual needs.
The detection area of target tracking object is arranged in the present embodiment pixel space size according to shared by target tracking object,
It can guarantee the reasonability of detection area range setting, so as to reduce the operand of smart television, improve detecting efficiency.
It further, is the refinement step schematic diagram of step S20 in Fig. 1 referring to Fig. 5, Fig. 5.Based on the above embodiments,
Step S20 may include:
Step S21 obtains the color component value of each pixel in the target tracking object;
Step S22 carries out color to the target tracking object according to the color component value got and negates, obtains
Each negated color component value of pixel;
Step S23 adds up the negated color component value of each pixel according to color type correspondence, after cumulative
Mark of the color component value as the target tracking object.
Since each pixel of composition target tracking object has its corresponding color, and the color of pixel its be all
It is generated after being mixed by three kinds of colors of red, green, blue, therefore, the color of each pixel can use three kinds of face of red, green, blue
Colouring component indicates.If (100,200,100) can indicate that the beauty's colouring component for forming the pixel is 100, green color component is 200,
Blue color component is 100.
The present embodiment smart television can be in such a way that preset rules generate the identification information of target tracking object are as follows:
After object is tracked in user's selected target, the color component value of each pixel in target tracking object is obtained, then basis is got
Color component value to target tracking object carry out color negate, obtain the negated color component value of each pixel, then will be every
A negated color component value of pixel adds up according to color type correspondence, and the color component value after adding up is as target
Track the mark of object.
For example, a white pixel point (0,0,0) is carried out color and is negated, i.e., each face is individually subtracted with 255
Colouring component value then obtains a black pixel point (255,255,255).If smart television gets each in target tracking object
The color component value of pixel be respectively (100,200,100), (100,150,100) ... ..., then by the target tracking object into
Row color obtains the negated color component value of each pixel, i.e. (155,55,155) after negating, (155,105,155) ... ...,
The negated color component value of each pixel is added up according to color type correspondence, i.e., (155+155+ ..., 55+105+ ...,
155+155+ ...), if the cumulative color component value that obtains is (a, b, c), then the mark by (a, b, c) as target tracking object.
For certain target tracking objects (such as automobile), the color of group pixel is usually constant, thus is passed through
The color component value that above-mentioned calculation obtains can be used as the mark of target tracking object, the mobile object in display screen compared with
When more, target tracking object and other mobile objects can quickly be distinguished by the matching of color component value.
The present invention also provides a kind of target tracking display devices of panoramic video.
Referring to the functional module signal that Fig. 6, Fig. 6 are one embodiment of target tracking display device of panoramic video of the present invention
Figure.Described device includes:
Determining module 10, for instructing the target tracking object in determining panoramic video according to the user's choice;
The application scenarios of the present embodiment can be with are as follows: and smart television obtains panoramic video resource by network or other modes,
And the panoramic video resource got is played using related playing program, the visual angle that panoramic video is initially defaulted with one is shown
Show, during playing panoramic video, user watches and find its interested mobile object, is chosen to be target tracking
Object, the movement of smart television, that is, automatic tracing object, shows that the object in display screen always.
Specifically, smart television can by the way that the object of shift action may be generated in profile automatic identification panoramic video,
Such as personage, animal, vehicle, then, user send selection instruction to smart television by remote control, and determining module 10 is receiving
Determine the jobbie in broadcasting pictures as target tracking object after the selection instruction of user;In addition, being supported in smart television
When contact action, user also directly can send selection instruction to smart television by touch operation, and determining module 10 can pass through knowledge
The operation such as click, sliding, the amplification of other user based on display screen, to determine target tracking pair from the panoramic video of broadcasting
As.
Generation module 20, for generating the identification information of the target tracking object according to preset rules;
After object is tracked in selected target, generation module 20 is believed according to the mark that preset rules generate target tracking object
Breath, the identification information are used for unique identification target tracking object, may include number, the name of character and target tracking object
Title, type etc..For example, generation module 20 can obtain the image of target tracking object, then hash algorithm (such as md5 algorithm) is used
Mark of the cryptographic Hash of the image as target tracking object is calculated;For another example, generation module 20 can obtain target tracking pair
The color component value of each pixel as in carries out color to target tracking object according to the color component value got and negates, obtains
To the negated color component value of each pixel, the negated color component value of each pixel is carried out according to color type is corresponding
Cumulative, the color component value after adding up is as the mark of the target tracking object.It is of course also possible to use other algorithm meters
Calculation obtains the mark of target tracking object.In this way, subsequent when being tracked to target tracking object, it will be able to pass through identification information
Quickly judge in panoramic video that current display screen is shown with the presence or absence of target tracking object.
Display module 30 is tracked, for tracking the target in the panoramic video according to the identification information of generation
Object is tracked, so that the target tracking object is maintained in current display screen and shows.
After the identification information that generation module 20 generates the target tracking object, display module 30 is tracked according to generation
Identification information tracks target tracking object in panoramic video, shows so that target tracking object is maintained in current display screen.
Specifically, tracking display module 30 can detect whether target tracking object is moved into display platen edge according to identification information,
If so, the visual angle that adjust automatically display screen is currently shown at this time, for example, the visual angle for the panoramic video that smart television is currently shown
It is the shooting visual angle of panoramic camera 1, tracking display module 30 detects target tracking object and is moved to display screen left frame, this
The visual angle that Shi Zidong currently shows display screen is adjusted to the shooting visual angle of panoramic camera 2, and the shooting view of panoramic camera 2
Angle rotates predetermined angular relative to panoramic camera 1 counterclockwise, is to ensure that target tracking object always in display screen as a result,
It is middle display and be unlikely to disappear in display screen.Certainly, tracking display module 30 can also obtain target in preset duration and chase after
The moving direction and moving distance of track object, according to the visual angle of moving direction and the corresponding adjustment display screen of moving distance, so that mesh
The center that mark tracking object is always held at display screen is shown, flexible setting can be carried out in specific implementation.
In the present embodiment, determining module 10 instructs the target tracking pair determined in panoramic video according to the user's choice
As;Generation module 20 generates the identification information of the target tracking object according to preset rules;Display module 30 is tracked according to life
At the identification information target tracking object is tracked in the panoramic video so that the target tracking object keep
It is shown in current display screen.By the above-mentioned means, display terminal can when target tracking object moves in panoramic video
According to the identification information automatic tracing target object of target tracking object, user need not continually manually adjust the display of display screen
Visual angle improves the viewing experience of user to simplify user's operation.
It further, is the refinement the functional block diagram that display module is tracked in Fig. 6 referring to Fig. 7, Fig. 7.Based on above-mentioned
Embodiment shown in fig. 6, tracking display module 30 may include:
Detecting unit 31, for being in the predeterminable area according to the current display platen edge of the identification information of generation detecting
It is no that there are the target tracking objects;
Adjustment unit 32, if for, there are the target tracking object, being pressed in the currently predeterminable area of display platen edge
The visual angle that the display screen is currently shown is adjusted according to preset rules, so that the target tracking object is maintained in current display screen
Display.
In the present embodiment, generation module 20 is after the identification information for generating target tracking object, 31 basis of detecting unit
It whether there is target tracking object in the predeterminable area of the current display platen edge of identification information detecting of generation;If current display screen
There are target tracking objects in the predeterminable area at edge, then adjustment unit 32 is currently shown according to preset rules adjustment display screen
Visual angle is shown so that target tracking object is maintained in current display screen.For example, detecting unit 31 at a time detects mesh
Mark tracking object is moved in the predeterminable area of display screen left edge, which probably continues to be moved to the left,
Adjustment unit 32 should correspond to the visual angle that adjustment display screen is currently shown at this time, so that target tracking object is maintained at current display screen
Middle display.
In above-mentioned steps, whether detecting unit 31 is detected in the current predeterminable area for showing platen edge according to identification information and is deposited
The specific steps of target tracking object can be with are as follows: a certain moment determines the target tracking object in panoramic video and according to default
Rule calculates its ident value, and subsequent time obtains all objects that may generate shift action in the predeterminable area of display platen edge
Body simultaneously calculates separately its ident value according to identical rule, by the ident value of the ident value being calculated and target tracking object into
Row matching can determine that target tracking object is moved into the predeterminable area of display platen edge if successful match.
Further, the adjustment unit 32 is also used to: obtaining the target tracking object in the display platen edge
Location information in predeterminable area;The visual angle that the display screen is currently shown is adjusted according to the location information got, with
The target tracking object is maintained in current display screen to show.
There are when target tracking object in the predeterminable area that detecting unit 31 detects current display platen edge, adjustment is single
Member 32 further obtains location information of the target tracking object in the predeterminable area of display platen edge, and then basis is got
The visual angle that location information adjustment display screen is currently shown, shows so that target tracking object is maintained in current display screen.For example,
If getting target tracking object in the predeterminable area of display screen left edge, the corresponding visual angle for currently showing display screen to
It moves left;If getting target tracking object on a display screen in the predeterminable area at edge, correspondence currently shows display screen
Visual angle move up.Wherein, the range of visual angle movement or rotation can be configured in advance, can also be according to target tracking object
Depending on moving distance.
The present embodiment whether there is target tracking object in the predeterminable area by detecting display platen edge, can be to target
The situation of movement of tracking object is effectively determined that, when target tracking object is in display platen edge, adjustment display screen is current
The visual angle of display can guarantee that target tracking object is maintained in current display screen and show and be unlikely to disappear in display screen,
Improve the viewing experience of user.
It further, is another refinement the functional block diagram that display module is tracked in Fig. 6 referring to Fig. 8, Fig. 8.It is based on
Above-mentioned embodiment shown in Fig. 7, tracking display module 30 can also include:
Computing unit 33, for calculating pixel space size shared by the target tracking object;
Setting unit 34, described in being arranged according to the pixel space size being calculated in the display platen edge
The detection area of target tracking object.
In the present embodiment, since the detection area of target tracking object should not be arranged too small, should not also be arranged
Greatly, too small will lead to is set and detects fall short tracking object in predeterminable area, conference, which was arranged, then will increase smart television
Operand.For the reasonability for guaranteeing the setting of detection area range, worked as in detecting unit 31 according to the detecting of the identification information of generation
With the presence or absence of before target tracking object in the predeterminable area of preceding display platen edge, computing unit 33 can calculate first target and chase after
Pixel space size shared by track object, then setting unit 34 is according to the pixel space size being calculated in the display screen
The detection area of edge setting target tracking object.
It is that there are the display interfaces of target tracking object in the predeterminable area of the display screen of the invention top edge referring to Fig. 4, Fig. 4
Schematic diagram.For example, it is 60 × 80 (horizontal directions that pixel space size shared by target tracking object, which is calculated, in computing unit 33
Length is 60 pixels, and vertical direction height is 80 pixels), then the target tracking pair at each edge of display screen is arranged in setting unit 34
The length of the detection area of elephant in the horizontal direction should be not less than 60 pixels, and should be not less than 80 pictures in the height of vertical direction
Element, the size of detection area can carry out flexible setting according to actual needs on this basis.
The detection area of target tracking object is arranged in the present embodiment pixel space size according to shared by target tracking object,
It can guarantee the reasonability of detection area range setting, so as to reduce the operand of smart television, improve detecting efficiency.
It further, is the refinement the functional block diagram of generation module in Fig. 6 referring to Fig. 9, Fig. 9.Based on above-mentioned reality
Example is applied, generation module 20 may include:
Acquiring unit 21, for obtaining the color component value of each pixel in the target tracking object;
Color negates unit 22, for carrying out face to the target tracking object according to the color component value got
Color negates, and obtains the negated color component value of each pixel;
Summing elements 23, for the negated color component value of each pixel to be added up according to color type correspondence,
Color component value after will be cumulative is as the mark of the target tracking object.
Since each pixel of composition target tracking object has its corresponding color, and the color of pixel its be all
It is generated after being mixed by three kinds of colors of red, green, blue, therefore, the color of each pixel can use three kinds of face of red, green, blue
Colouring component indicates.If (100,200,100) can indicate that the beauty's colouring component for forming the pixel is 100, green color component is 200,
Blue color component is 100.
The present embodiment generation module 20 can be in such a way that preset rules generate the identification information of target tracking object are as follows:
After object is tracked in user's selected target, acquiring unit 21 obtains the color component value of each pixel in target tracking object, face
Color negates unit 22 and is negated according to the color component value got to target tracking object progress color, obtains each pixel and negates
Color component value afterwards, summing elements 23 again carry out the negated color component value of each pixel according to color type correspondence tired
Add, the color component value after adding up is as the mark of target tracking object.
For example, a white pixel point (0,0,0) is carried out color and is negated, i.e., each face is individually subtracted with 255
Colouring component value then obtains a black pixel point (255,255,255).If acquiring unit 21 gets every in target tracking object
The color component value of a pixel is respectively (100,200,100), and (100,150,100) ... ..., then color negates unit 22 for institute
Target tracking object is stated to carry out obtaining the negated color component value of each pixel, i.e. (155,55,155) after color negates,
(155,105,155) ... ..., summing elements 23 carry out the negated color component value of each pixel according to color type is corresponding
It is cumulative, i.e., (155+155+ ..., 55+105+ ..., 155+155+ ...), if the cumulative color component value that obtains is (a, b, c), then will
The mark of (a, b, c) as target tracking object.
For certain target tracking objects (such as automobile), the color of group pixel is usually constant, thus is passed through
The color component value that above-mentioned calculation obtains can be used as the mark of target tracking object, the mobile object in display screen compared with
When more, target tracking object and other mobile objects can quickly be distinguished by the matching of color component value.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (6)
1. a kind of target tracking display methods of panoramic video, which is characterized in that described method includes following steps:
The target tracking object determined in panoramic video is instructed according to the user's choice;
The identification information of the target tracking object is generated according to preset rules, the identification information is according to the target tracking pair
The color component value of each pixel is calculated as in;
The target tracking object is tracked in the panoramic video according to the identification information of generation, so that the target chases after
Track object is maintained in current display screen and shows;
Wherein, the identification information according to generation tracks the target tracking object in the panoramic video, so that
The target tracking object is maintained at the step of showing in current display screen
Calculate pixel space size shared by the target tracking object;
The detection area of the target tracking object is set according to the pixel space size being calculated in display platen edge;
Being detected in the predeterminable area of current display platen edge according to the identification information of generation whether there is the target tracking
Object;
If so, the visual angle that the display screen is currently shown is adjusted according to preset rules, so that the target tracking object is kept
It is shown in current display screen.
2. the target tracking display methods of panoramic video as described in claim 1, which is characterized in that described according to preset rules
The visual angle that the display screen is currently shown is adjusted, so that the target tracking object is maintained at the step of showing in current display screen
Include:
Obtain location information of the target tracking object in the predeterminable area of the display platen edge;
The visual angle that the display screen is currently shown is adjusted according to the location information got, so that the target tracking object
It is maintained in current display screen and shows.
3. the target tracking display methods of panoramic video as claimed in claim 1 or 2, which is characterized in that described according to default
Rule generates the step of identification information of the target tracking object and includes:
Obtain the color component value of each pixel in the target tracking object;
Color is carried out to the target tracking object according to the color component value got to negate, and is obtained each pixel and is negated
Color component value afterwards;
The negated color component value of each pixel is added up according to color type correspondence, the color component value after adding up
Mark as the target tracking object.
4. a kind of target tracking display device of panoramic video, which is characterized in that described device includes:
Determining module, for instructing the target tracking object in determining panoramic video according to the user's choice;
Generation module, for generating the identification information of the target tracking object according to preset rules, the identification information according to
The color component value of each pixel is calculated in the target tracking object;
Display module is tracked, for tracking the target tracking pair in the panoramic video according to the identification information of generation
As so that the target tracking object is maintained in current display screen and shows;
Wherein, the tracking display module includes:
Computing unit, for calculating pixel space size shared by the target tracking object;
Setting unit, for the target tracking pair to be arranged in display platen edge according to the pixel space size being calculated
The detection area of elephant;
Detecting unit whether there is for being detected in the current predeterminable area for showing platen edge according to the identification information of generation
The target tracking object;
Adjustment unit, if for there are the target tracking objects in the currently predeterminable area of display platen edge, according to default
The visual angle that display screen described in rule adjustment is currently shown, so that the target tracking object is maintained in current display screen and shows.
5. the target tracking display device of panoramic video as claimed in claim 4, which is characterized in that the adjustment unit is also used
In:
Obtain location information of the target tracking object in the predeterminable area of the display platen edge;
The visual angle that the display screen is currently shown is adjusted according to the location information got, so that the target tracking object
It is maintained in current display screen and shows.
6. the target tracking display device of panoramic video as described in claim 4 or 5, which is characterized in that the generation module
Include:
Acquiring unit, for obtaining the color component value of each pixel in the target tracking object;
Color negates unit, takes for carrying out color to the target tracking object according to the color component value got
Instead, the negated color component value of each pixel is obtained;
Summing elements will add up for the negated color component value of each pixel to add up according to color type correspondence
Mark of the color component value afterwards as the target tracking object.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710153172.6A CN106961597B (en) | 2017-03-14 | 2017-03-14 | The target tracking display methods and device of panoramic video |
PCT/CN2017/109937 WO2018166224A1 (en) | 2017-03-14 | 2017-11-08 | Target tracking display method and apparatus for panoramic video, and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710153172.6A CN106961597B (en) | 2017-03-14 | 2017-03-14 | The target tracking display methods and device of panoramic video |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106961597A CN106961597A (en) | 2017-07-18 |
CN106961597B true CN106961597B (en) | 2019-07-26 |
Family
ID=59470840
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710153172.6A Active CN106961597B (en) | 2017-03-14 | 2017-03-14 | The target tracking display methods and device of panoramic video |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN106961597B (en) |
WO (1) | WO2018166224A1 (en) |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106961597B (en) * | 2017-03-14 | 2019-07-26 | 深圳Tcl新技术有限公司 | The target tracking display methods and device of panoramic video |
CN107633241B (en) * | 2017-10-23 | 2020-11-27 | 三星电子(中国)研发中心 | Method and device for automatically marking and tracking object in panoramic video |
CN109034000A (en) * | 2018-07-04 | 2018-12-18 | 广州视源电子科技股份有限公司 | Control method, device, storage medium and the advertisement machine of advertisement machine screen motion |
CN111376832A (en) * | 2018-12-28 | 2020-07-07 | 奥迪股份公司 | Image display method, image display device, computer equipment and storage medium |
CN110225402B (en) * | 2019-07-12 | 2022-03-04 | 青岛一舍科技有限公司 | Method and device for intelligently keeping interesting target time display in panoramic video |
CN110324641B (en) * | 2019-07-12 | 2021-09-03 | 青岛一舍科技有限公司 | Method and device for keeping interest target moment display in panoramic video |
CN111163267B (en) * | 2020-01-07 | 2021-12-21 | 影石创新科技股份有限公司 | Panoramic video editing method, device, equipment and storage medium |
CN111182218A (en) * | 2020-01-07 | 2020-05-19 | 影石创新科技股份有限公司 | Panoramic video processing method, device, equipment and storage medium |
CN111413904B (en) * | 2020-04-02 | 2021-12-21 | 深圳创维-Rgb电子有限公司 | Display scene switching method, intelligent display screen and readable storage medium |
CN112135046B (en) * | 2020-09-23 | 2022-06-28 | 维沃移动通信有限公司 | Video shooting method, video shooting device and electronic equipment |
CN112788425A (en) * | 2020-12-28 | 2021-05-11 | 深圳Tcl新技术有限公司 | Dynamic area display method, device, equipment and computer readable storage medium |
CN115396741A (en) * | 2022-07-29 | 2022-11-25 | 北京势也网络技术有限公司 | Panoramic video playing method and device, electronic equipment and readable storage medium |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104252629A (en) * | 2013-06-26 | 2014-12-31 | 范钦雄 | Target Detection And Tracking Method And System |
CN105847379A (en) * | 2016-04-14 | 2016-08-10 | 乐视控股(北京)有限公司 | Tracking method and tracking apparatus for panoramic video moving direction |
CN105843541A (en) * | 2016-03-22 | 2016-08-10 | 乐视网信息技术(北京)股份有限公司 | Target tracking and displaying method and device in panoramic video |
CN106446002A (en) * | 2016-08-01 | 2017-02-22 | 三峡大学 | Moving target-based video retrieval method for track in map |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002064812A (en) * | 2000-08-17 | 2002-02-28 | Sharp Corp | Moving target tracking system |
CN101477792B (en) * | 2009-01-21 | 2011-06-08 | 华为终端有限公司 | Method for displaying overlapped pattern on the background picture and display apparatus thereof |
CN102843617B (en) * | 2012-09-26 | 2016-08-10 | 天津游奕科技有限公司 | A kind of method realizing panoramic video dynamic hot spot |
CN106303706A (en) * | 2016-08-31 | 2017-01-04 | 杭州当虹科技有限公司 | The method realizing following visual angle viewing virtual reality video with leading role based on face and item tracking |
CN106331732B (en) * | 2016-09-26 | 2019-11-12 | 北京疯景科技有限公司 | Generate, show the method and device of panorama content |
CN106961597B (en) * | 2017-03-14 | 2019-07-26 | 深圳Tcl新技术有限公司 | The target tracking display methods and device of panoramic video |
-
2017
- 2017-03-14 CN CN201710153172.6A patent/CN106961597B/en active Active
- 2017-11-08 WO PCT/CN2017/109937 patent/WO2018166224A1/en active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104252629A (en) * | 2013-06-26 | 2014-12-31 | 范钦雄 | Target Detection And Tracking Method And System |
CN105843541A (en) * | 2016-03-22 | 2016-08-10 | 乐视网信息技术(北京)股份有限公司 | Target tracking and displaying method and device in panoramic video |
CN105847379A (en) * | 2016-04-14 | 2016-08-10 | 乐视控股(北京)有限公司 | Tracking method and tracking apparatus for panoramic video moving direction |
CN106446002A (en) * | 2016-08-01 | 2017-02-22 | 三峡大学 | Moving target-based video retrieval method for track in map |
Also Published As
Publication number | Publication date |
---|---|
WO2018166224A1 (en) | 2018-09-20 |
CN106961597A (en) | 2017-07-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106961597B (en) | The target tracking display methods and device of panoramic video | |
KR101764372B1 (en) | Apparatus and method for compositing image in a portable terminal | |
CN104796594B (en) | Method for instantly presenting special effect of preview interface and terminal equipment | |
KR101337204B1 (en) | Enhanced handheld screen-sensing pointer | |
EP3120494B1 (en) | Sharing physical whiteboard content in electronic conference | |
RU2642344C2 (en) | Method and device for adjusting and displaying image | |
US10600169B2 (en) | Image processing system and image processing method | |
EP3379525A1 (en) | Image processing device and image generation method | |
CN109274977B (en) | Virtual item allocation method, server and client | |
US20110025818A1 (en) | System and Method for Controlling Presentations and Videoconferences Using Hand Motions | |
US20110227827A1 (en) | Interactive Display System | |
JP2015524951A (en) | Manipulating computing devices by detecting round objects in images | |
CN108304063A (en) | Information processing unit, information processing method and computer-readable medium | |
CN106210699B (en) | Information processing unit, the control method of information processing unit and image processing system | |
CN111614905A (en) | Image processing method, image processing device and electronic equipment | |
CN106161945A (en) | Take pictures treating method and apparatus | |
CN111832538A (en) | Video processing method and device and storage medium | |
WO2018014517A1 (en) | Information processing method, device and storage medium | |
TW201439981A (en) | Image processing device, image processing method, and recording medium | |
US11003062B2 (en) | Information processing device, method of information processing, and image display system | |
CN114339029B (en) | Shooting method and device and electronic equipment | |
CN114650370A (en) | Image shooting method and device, electronic equipment and readable storage medium | |
KR20040088159A (en) | Input system based upon movement in space | |
JP2017072945A (en) | Image processor, image processing method | |
JP2007287093A (en) | Program, method and device for detecting mobile object |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |