CN106961597B - The target tracking display methods and device of panoramic video - Google Patents

The target tracking display methods and device of panoramic video Download PDF

Info

Publication number
CN106961597B
CN106961597B CN201710153172.6A CN201710153172A CN106961597B CN 106961597 B CN106961597 B CN 106961597B CN 201710153172 A CN201710153172 A CN 201710153172A CN 106961597 B CN106961597 B CN 106961597B
Authority
CN
China
Prior art keywords
target tracking
tracking object
display screen
panoramic video
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710153172.6A
Other languages
Chinese (zh)
Other versions
CN106961597A (en
Inventor
王云华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen TCL New Technology Co Ltd
Original Assignee
Shenzhen TCL New Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen TCL New Technology Co Ltd filed Critical Shenzhen TCL New Technology Co Ltd
Priority to CN201710153172.6A priority Critical patent/CN106961597B/en
Publication of CN106961597A publication Critical patent/CN106961597A/en
Priority to PCT/CN2017/109937 priority patent/WO2018166224A1/en
Application granted granted Critical
Publication of CN106961597B publication Critical patent/CN106961597B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/398Synchronisation thereof; Control thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration
    • H04N21/4858End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Studio Devices (AREA)

Abstract

The invention discloses a kind of target tracking display methods of panoramic video, this method comprises: instructing the target tracking object determined in panoramic video according to the user's choice;The identification information of the target tracking object is generated according to preset rules;The target tracking object is tracked in the panoramic video according to the identification information of generation, so that the target tracking object is maintained in current display screen and shows.The invention also discloses a kind of target tracking display devices of panoramic video.The automatic tracing that the present invention can be realized target object in panoramic video is shown, to simplify user's operation, promotes the viewing experience of user.

Description

The target tracking display methods and device of panoramic video
Technical field
The present invention relates to ntelligent television technolog field more particularly to the target tracking display methods and device of panoramic video.
Background technique
In recent years, VR (Virtual Reality, virtual reality) technology has begun and is used in smart television.Panorama Video is the Fundamentals of VR video, is to convert dynamic video image for static panoramic pictures, user can be any The dynamic video within the scope of panoramic camera shooting angle is watched, to generate sense on the spot in person.
Currently, when user watches panoramic video by smart television, since the smart television a certain moment is only able to display entirely Part visual angle in scape video, when the target object that user wants viewing is moved to another view from a visual angle of panoramic video When angle, target object will be disappeared in the visual angle currently shown, and user needs remote controller adjustment visual angle to realize at this time Target tracking, and target object is movably more frequent, the remote control operation of user also can be more frequent, and it is not only cumbersome, while Affect the viewing experience of user.
Summary of the invention
It is a primary object of the present invention to propose the target tracking display methods and device of a kind of panoramic video, it is intended to realize The automatic tracing of target object is shown in panoramic video, to simplify user's operation, promotes the viewing experience of user.
To achieve the above object, the present invention provides a kind of target tracking display methods of panoramic video, the method includes Following steps:
The target tracking object determined in panoramic video is instructed according to the user's choice;
The identification information of the target tracking object is generated according to preset rules;
The target tracking object is tracked in the panoramic video according to the identification information of generation, so that the mesh Mark tracking object, which is maintained in current display screen, to be shown.
Optionally, described that the target tracking pair is tracked in the panoramic video according to the identification information of generation As so that the target tracking object is maintained at the step of showing in current display screen includes:
Being detected in the predeterminable area of current display platen edge according to the identification information of generation whether there is the target Track object;
If so, the visual angle that the display screen is currently shown is adjusted according to preset rules, so that the target tracking object It is maintained in current display screen and shows.
Optionally, described currently to show in the predeterminable area of platen edge whether deposit according to the identification information judgment of generation Before the target tracking object the step of, further includes:
Calculate pixel space size shared by the target tracking object;
The target tracking object is set in the display platen edge according to the pixel space size being calculated Detection area.
Optionally, described that the visual angle that the display screen is currently shown is adjusted according to preset rules, so that the target tracking Object is maintained at the step of showing in current display screen and includes:
Obtain location information of the target tracking object in the predeterminable area of the display platen edge;
The visual angle that the display screen is currently shown is adjusted according to the location information got, so that the target tracking Object is maintained in current display screen and shows.
Optionally, the step of identification information that the target tracking object is generated according to preset rules includes:
Obtain the color component value of each pixel in the target tracking object;
Color is carried out to the target tracking object according to the color component value got to negate, and obtains each pixel Negated color component value;
The negated color component value of each pixel is added up according to color type correspondence, the color point after adding up Mark of the magnitude as the target tracking object.
In addition, to achieve the above object, the present invention also provides a kind of target tracking display device of panoramic video, the dresses It sets and includes:
Determining module, for instructing the target tracking object in determining panoramic video according to the user's choice;
Generation module, for generating the identification information of the target tracking object according to preset rules;
Display module is tracked, the target is tracked in the panoramic video for the identification information according to generation and chases after Track object, so that the target tracking object is maintained in current display screen and shows.
Optionally, the tracking display module includes:
Detecting unit, in the predeterminable area for detecting current display platen edge according to the identification information of generation whether There are the target tracking objects;
Adjustment unit, if there are the target tracking object in predeterminable area for currently showing platen edge, according to Preset rules adjust the visual angle that the display screen is currently shown, show so that the target tracking object is maintained in current display screen Show.
Optionally, the tracking display module further include:
Computing unit, for calculating pixel space size shared by the target tracking object;
Setting unit, for the mesh to be arranged in the display platen edge according to the pixel space size being calculated The detection area of mark tracking object.
Optionally, the adjustment unit is also used to:
Obtain location information of the target tracking object in the predeterminable area of the display platen edge;
The visual angle that the display screen is currently shown is adjusted according to the location information got, so that the target tracking Object is maintained in current display screen and shows.
Optionally, the generation module includes:
Acquiring unit, for obtaining the color component value of each pixel in the target tracking object;
Color negates unit, for carrying out color to the target tracking object according to the color component value got It negates, obtains the negated color component value of each pixel;
Summing elements will for the negated color component value of each pixel to add up according to color type correspondence Mark of the color component value as the target tracking object after cumulative.
The present invention instructs the target tracking object determined in panoramic video according to the user's choice;It is generated according to preset rules The identification information of the target tracking object;The target is tracked in the panoramic video according to the identification information of generation Object is tracked, so that the target tracking object is maintained in current display screen and shows.By the above-mentioned means, working as target tracking pair When as being moved in panoramic video, display terminal can according to the identification information automatic tracing target object of target tracking object, User need not continually manually adjust the display view angle of display screen, to simplify user's operation, improve the viewing body of user It tests.
Detailed description of the invention
Fig. 1 is the flow diagram of the target tracking display methods first embodiment of panoramic video of the present invention;
Fig. 2 is the flow diagram of the target tracking display methods second embodiment of panoramic video of the present invention;
Fig. 3 is the flow diagram of the target tracking display methods 3rd embodiment of panoramic video of the present invention;
Fig. 4 is that there are the display interface schematic diagrames of target tracking object in the predeterminable area of the display screen of the invention top edge;
Fig. 5 is the refinement step schematic diagram of step S20 in Fig. 1;
Fig. 6 is the functional block diagram of one embodiment of target tracking display device of panoramic video of the present invention;
Fig. 7 is the refinement the functional block diagram that display module is tracked in Fig. 6;
Fig. 8 is another refinement the functional block diagram that display module is tracked in Fig. 6;
Fig. 9 is the refinement the functional block diagram of generation module in Fig. 6.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The present invention provides a kind of target tracking display methods of panoramic video.
Referring to Fig.1, Fig. 1 is the flow diagram of the target tracking display methods first embodiment of panoramic video of the present invention. Described method includes following steps:
Step S10 instructs the target tracking object determined in panoramic video according to the user's choice;
The application scenarios of the present embodiment can be with are as follows: and smart television obtains panoramic video resource by network or other modes, And the panoramic video resource got is played using related playing program, the visual angle that panoramic video is initially defaulted with one is shown Show, during playing panoramic video, user watches and find its interested mobile object, is chosen to be target tracking Object, the movement of smart television, that is, automatic tracing object, shows that the object in display screen always.
Specifically, smart television can by the way that the object of shift action may be generated in profile automatic identification panoramic video, Such as personage, animal, vehicle, then, user send selection instruction to smart television by remote control, and smart television is receiving use Determine the jobbie in broadcasting pictures as target tracking object after the selection instruction at family;In addition, supporting to touch in smart television When screen operation, user also directly can send selection instruction to smart television by touch operation, and smart television can be used by identification The operation such as click, sliding, the amplification of family based on display screen, to determine target tracking object from the panoramic video of broadcasting.
Step S20 generates the identification information of the target tracking object according to preset rules;
After object is tracked in selected target, smart television generates the identification information of target tracking object according to preset rules, The identification information is used for unique identification target tracking object, may include number, title, the class of character and target tracking object Type etc..For example, smart television can obtain the image of target tracking object, then calculated using hash algorithm (such as md5 algorithm) To mark of the cryptographic Hash as target tracking object of the image;For another example, the face of each pixel in target tracking object can be obtained Colouring component value carries out color to target tracking object according to the color component value got and negates, and obtains after each pixel negates Color component value, the negated color component value of each pixel is added up according to color type correspondence, will be cumulative after Mark of the color component value as the target tracking object.It is of course also possible to use target tracking is calculated in other algorithms The mark of object.In this way, subsequent when being tracked to target tracking object, it will be able to quickly be judged by identification information currently aobvious It whether there is target tracking object in the panoramic video that display screen is shown.
Step S30 tracks the target tracking object according to the identification information of generation in the panoramic video, with The target tracking object is maintained in current display screen to show.
After the identification information for generating the target tracking object, smart television is according to the identification information of generation in aphorama Target tracking object is tracked in frequency, is shown so that target tracking object is maintained in current display screen.Specifically, smart television can Detect whether target tracking object is moved into display platen edge according to identification information, if so, adjust automatically is shown at this time Shield the visual angle currently shown, for example, the visual angle for the panoramic video that smart television is currently shown is the shooting view of panoramic camera 1 Angle, smart television detect target tracking object and are moved to display screen left frame, the view at this time automatically currently showing display screen Angle is adjusted to the shooting visual angle of panoramic camera 2, and the shooting visual angle of panoramic camera 2 is counterclockwise relative to panoramic camera 1 Predetermined angular is rotated, is to ensure that target tracking object shows in display screen always and is unlikely to disappear in display as a result, In screen.Certainly, smart television can also obtain the moving direction and moving distance of target tracking object in preset duration, according to The visual angle of moving direction and the corresponding adjustment display screen of moving distance, so that target tracking object is always held at the center of display screen Position is shown, flexible setting can be carried out in specific implementation.
In the present embodiment, the target tracking object determined in panoramic video is instructed according to the user's choice;According to default Rule generates the identification information of the target tracking object;It is tracked in the panoramic video according to the identification information of generation The target tracking object, so that the target tracking object is maintained in current display screen and shows.By the above-mentioned means, working as mesh When mark tracking object moves in panoramic video, display terminal can be according to the identification information automatic tracing mesh of target tracking object Object is marked, user need not continually manually adjust the display view angle of display screen, to simplify user's operation, improve user's Viewing experience.
It further, is the stream of the target tracking display methods second embodiment of panoramic video of the present invention referring to Fig. 2, Fig. 2 Journey schematic diagram.Based on above-mentioned embodiment shown in FIG. 1, step S30 may include:
Step S31, being detected according to the identification information of generation whether there is in the predeterminable area of current display platen edge The target tracking object;
Step S32, if currently there are the target tracking objects in the predeterminable area of display platen edge, according to default rule The visual angle that the display screen is currently shown then is adjusted, so that the target tracking object is maintained in current display screen and shows.
In the present embodiment, smart television is believed after the identification information for generating target tracking object according to the mark of generation It whether there is target tracking object in the predeterminable area of the current display platen edge of breath detecting;If the currently preset areas of display platen edge There are target tracking objects in domain, then the visual angle currently shown according to preset rules adjustment display screen, so that target tracking object It is maintained in current display screen and shows.For example, smart television, which at a time detects target tracking object, is moved to display screen In the predeterminable area of left edge, which probably continues to be moved to the left, and should correspond to adjustment display screen at this time and work as The visual angle of preceding display is shown so that target tracking object is maintained in current display screen.
In above-mentioned steps, smart television is detected in the current predeterminable area for showing platen edge according to identification information whether there is The specific steps of target tracking object can be with are as follows: a certain moment smart television determine the target tracking object in panoramic video and by Its ident value is calculated according to preset rules, and subsequent time smart television is obtained and all in the predeterminable area of display platen edge may be produced The object of raw shift action simultaneously calculates separately its ident value according to identical rule, by the ident value being calculated and target tracking The ident value of object is matched, if successful match, can determine that target tracking object is moved into the pre- of display platen edge If in region.
Further, step S32 may include:
Step S321 obtains location information of the target tracking object in the predeterminable area of the display platen edge;
Step S322 adjusts the visual angle that the display screen is currently shown according to the location information got, so that institute It states target tracking object and is maintained in current display screen and show.
There are when target tracking object in the predeterminable area for detecting current display platen edge, smart television is further obtained Location information of the target tracking object in the predeterminable area of display platen edge is taken, then according to the location information adjustment got The visual angle that display screen is currently shown is shown so that target tracking object is maintained in current display screen.For example, if getting target Object is tracked in the predeterminable area of display screen left edge, then the corresponding visual angle for currently showing display screen is moved to the left;If obtaining Target tracking object is got on a display screen in the predeterminable area at edge, then is corresponded to visual angle that display screen is currently shown to moving up It is dynamic.Wherein, visual angle is mobile or the range of rotation can be configured in advance, can also according to the moving distance of target tracking object and It is fixed.
The present embodiment whether there is target tracking object in the predeterminable area by detecting display platen edge, can be to target The situation of movement of tracking object is effectively determined that, when target tracking object is in display platen edge, adjustment display screen is current The visual angle of display can guarantee that target tracking object is maintained in current display screen and show and be unlikely to disappear in display screen, Improve the viewing experience of user.
It further, is the stream of the target tracking display methods 3rd embodiment of panoramic video of the present invention referring to Fig. 3, Fig. 3 Journey schematic diagram.Based on above-mentioned embodiment shown in Fig. 2, before step S31, can also include:
Step S33 calculates pixel space size shared by the target tracking object;
Step S34 is arranged the target in the display platen edge according to the pixel space size being calculated and chases after The detection area of track object.
In the present embodiment, since the detection area of target tracking object should not be arranged too small, should not also be arranged Greatly, too small will lead to is set and detects fall short tracking object in predeterminable area, conference, which was arranged, then will increase smart television Operand.For the reasonability for guaranteeing the setting of detection area range, current display screen side is being detected according to the identification information of generation With the presence or absence of before target tracking object in the predeterminable area of edge, smart television can be calculated first shared by target tracking object Pixel space size, then according to the pixel space size being calculated in the display platen edge setting target tracking object Detection area.
It is that there are the display interfaces of target tracking object in the predeterminable area of the display screen of the invention top edge referring to Fig. 4, Fig. 4 Schematic diagram.For example, it is that 60 × 80 (horizontal direction is long that pixel space size shared by target tracking object, which is calculated, in smart television Degree is 60 pixels, and vertical direction height is 80 pixels), then the detection area of the target tracking object at each edge of display screen is set Length in the horizontal direction should be not less than 60 pixels, and should be not less than 80 pixels in the height of vertical direction, on this basis The size of detection area can carry out flexible setting according to actual needs.
The detection area of target tracking object is arranged in the present embodiment pixel space size according to shared by target tracking object, It can guarantee the reasonability of detection area range setting, so as to reduce the operand of smart television, improve detecting efficiency.
It further, is the refinement step schematic diagram of step S20 in Fig. 1 referring to Fig. 5, Fig. 5.Based on the above embodiments, Step S20 may include:
Step S21 obtains the color component value of each pixel in the target tracking object;
Step S22 carries out color to the target tracking object according to the color component value got and negates, obtains Each negated color component value of pixel;
Step S23 adds up the negated color component value of each pixel according to color type correspondence, after cumulative Mark of the color component value as the target tracking object.
Since each pixel of composition target tracking object has its corresponding color, and the color of pixel its be all It is generated after being mixed by three kinds of colors of red, green, blue, therefore, the color of each pixel can use three kinds of face of red, green, blue Colouring component indicates.If (100,200,100) can indicate that the beauty's colouring component for forming the pixel is 100, green color component is 200, Blue color component is 100.
The present embodiment smart television can be in such a way that preset rules generate the identification information of target tracking object are as follows: After object is tracked in user's selected target, the color component value of each pixel in target tracking object is obtained, then basis is got Color component value to target tracking object carry out color negate, obtain the negated color component value of each pixel, then will be every A negated color component value of pixel adds up according to color type correspondence, and the color component value after adding up is as target Track the mark of object.
For example, a white pixel point (0,0,0) is carried out color and is negated, i.e., each face is individually subtracted with 255 Colouring component value then obtains a black pixel point (255,255,255).If smart television gets each in target tracking object The color component value of pixel be respectively (100,200,100), (100,150,100) ... ..., then by the target tracking object into Row color obtains the negated color component value of each pixel, i.e. (155,55,155) after negating, (155,105,155) ... ..., The negated color component value of each pixel is added up according to color type correspondence, i.e., (155+155+ ..., 55+105+ ..., 155+155+ ...), if the cumulative color component value that obtains is (a, b, c), then the mark by (a, b, c) as target tracking object.
For certain target tracking objects (such as automobile), the color of group pixel is usually constant, thus is passed through The color component value that above-mentioned calculation obtains can be used as the mark of target tracking object, the mobile object in display screen compared with When more, target tracking object and other mobile objects can quickly be distinguished by the matching of color component value.
The present invention also provides a kind of target tracking display devices of panoramic video.
Referring to the functional module signal that Fig. 6, Fig. 6 are one embodiment of target tracking display device of panoramic video of the present invention Figure.Described device includes:
Determining module 10, for instructing the target tracking object in determining panoramic video according to the user's choice;
The application scenarios of the present embodiment can be with are as follows: and smart television obtains panoramic video resource by network or other modes, And the panoramic video resource got is played using related playing program, the visual angle that panoramic video is initially defaulted with one is shown Show, during playing panoramic video, user watches and find its interested mobile object, is chosen to be target tracking Object, the movement of smart television, that is, automatic tracing object, shows that the object in display screen always.
Specifically, smart television can by the way that the object of shift action may be generated in profile automatic identification panoramic video, Such as personage, animal, vehicle, then, user send selection instruction to smart television by remote control, and determining module 10 is receiving Determine the jobbie in broadcasting pictures as target tracking object after the selection instruction of user;In addition, being supported in smart television When contact action, user also directly can send selection instruction to smart television by touch operation, and determining module 10 can pass through knowledge The operation such as click, sliding, the amplification of other user based on display screen, to determine target tracking pair from the panoramic video of broadcasting As.
Generation module 20, for generating the identification information of the target tracking object according to preset rules;
After object is tracked in selected target, generation module 20 is believed according to the mark that preset rules generate target tracking object Breath, the identification information are used for unique identification target tracking object, may include number, the name of character and target tracking object Title, type etc..For example, generation module 20 can obtain the image of target tracking object, then hash algorithm (such as md5 algorithm) is used Mark of the cryptographic Hash of the image as target tracking object is calculated;For another example, generation module 20 can obtain target tracking pair The color component value of each pixel as in carries out color to target tracking object according to the color component value got and negates, obtains To the negated color component value of each pixel, the negated color component value of each pixel is carried out according to color type is corresponding Cumulative, the color component value after adding up is as the mark of the target tracking object.It is of course also possible to use other algorithm meters Calculation obtains the mark of target tracking object.In this way, subsequent when being tracked to target tracking object, it will be able to pass through identification information Quickly judge in panoramic video that current display screen is shown with the presence or absence of target tracking object.
Display module 30 is tracked, for tracking the target in the panoramic video according to the identification information of generation Object is tracked, so that the target tracking object is maintained in current display screen and shows.
After the identification information that generation module 20 generates the target tracking object, display module 30 is tracked according to generation Identification information tracks target tracking object in panoramic video, shows so that target tracking object is maintained in current display screen. Specifically, tracking display module 30 can detect whether target tracking object is moved into display platen edge according to identification information, If so, the visual angle that adjust automatically display screen is currently shown at this time, for example, the visual angle for the panoramic video that smart television is currently shown It is the shooting visual angle of panoramic camera 1, tracking display module 30 detects target tracking object and is moved to display screen left frame, this The visual angle that Shi Zidong currently shows display screen is adjusted to the shooting visual angle of panoramic camera 2, and the shooting view of panoramic camera 2 Angle rotates predetermined angular relative to panoramic camera 1 counterclockwise, is to ensure that target tracking object always in display screen as a result, It is middle display and be unlikely to disappear in display screen.Certainly, tracking display module 30 can also obtain target in preset duration and chase after The moving direction and moving distance of track object, according to the visual angle of moving direction and the corresponding adjustment display screen of moving distance, so that mesh The center that mark tracking object is always held at display screen is shown, flexible setting can be carried out in specific implementation.
In the present embodiment, determining module 10 instructs the target tracking pair determined in panoramic video according to the user's choice As;Generation module 20 generates the identification information of the target tracking object according to preset rules;Display module 30 is tracked according to life At the identification information target tracking object is tracked in the panoramic video so that the target tracking object keep It is shown in current display screen.By the above-mentioned means, display terminal can when target tracking object moves in panoramic video According to the identification information automatic tracing target object of target tracking object, user need not continually manually adjust the display of display screen Visual angle improves the viewing experience of user to simplify user's operation.
It further, is the refinement the functional block diagram that display module is tracked in Fig. 6 referring to Fig. 7, Fig. 7.Based on above-mentioned Embodiment shown in fig. 6, tracking display module 30 may include:
Detecting unit 31, for being in the predeterminable area according to the current display platen edge of the identification information of generation detecting It is no that there are the target tracking objects;
Adjustment unit 32, if for, there are the target tracking object, being pressed in the currently predeterminable area of display platen edge The visual angle that the display screen is currently shown is adjusted according to preset rules, so that the target tracking object is maintained in current display screen Display.
In the present embodiment, generation module 20 is after the identification information for generating target tracking object, 31 basis of detecting unit It whether there is target tracking object in the predeterminable area of the current display platen edge of identification information detecting of generation;If current display screen There are target tracking objects in the predeterminable area at edge, then adjustment unit 32 is currently shown according to preset rules adjustment display screen Visual angle is shown so that target tracking object is maintained in current display screen.For example, detecting unit 31 at a time detects mesh Mark tracking object is moved in the predeterminable area of display screen left edge, which probably continues to be moved to the left, Adjustment unit 32 should correspond to the visual angle that adjustment display screen is currently shown at this time, so that target tracking object is maintained at current display screen Middle display.
In above-mentioned steps, whether detecting unit 31 is detected in the current predeterminable area for showing platen edge according to identification information and is deposited The specific steps of target tracking object can be with are as follows: a certain moment determines the target tracking object in panoramic video and according to default Rule calculates its ident value, and subsequent time obtains all objects that may generate shift action in the predeterminable area of display platen edge Body simultaneously calculates separately its ident value according to identical rule, by the ident value of the ident value being calculated and target tracking object into Row matching can determine that target tracking object is moved into the predeterminable area of display platen edge if successful match.
Further, the adjustment unit 32 is also used to: obtaining the target tracking object in the display platen edge Location information in predeterminable area;The visual angle that the display screen is currently shown is adjusted according to the location information got, with The target tracking object is maintained in current display screen to show.
There are when target tracking object in the predeterminable area that detecting unit 31 detects current display platen edge, adjustment is single Member 32 further obtains location information of the target tracking object in the predeterminable area of display platen edge, and then basis is got The visual angle that location information adjustment display screen is currently shown, shows so that target tracking object is maintained in current display screen.For example, If getting target tracking object in the predeterminable area of display screen left edge, the corresponding visual angle for currently showing display screen to It moves left;If getting target tracking object on a display screen in the predeterminable area at edge, correspondence currently shows display screen Visual angle move up.Wherein, the range of visual angle movement or rotation can be configured in advance, can also be according to target tracking object Depending on moving distance.
The present embodiment whether there is target tracking object in the predeterminable area by detecting display platen edge, can be to target The situation of movement of tracking object is effectively determined that, when target tracking object is in display platen edge, adjustment display screen is current The visual angle of display can guarantee that target tracking object is maintained in current display screen and show and be unlikely to disappear in display screen, Improve the viewing experience of user.
It further, is another refinement the functional block diagram that display module is tracked in Fig. 6 referring to Fig. 8, Fig. 8.It is based on Above-mentioned embodiment shown in Fig. 7, tracking display module 30 can also include:
Computing unit 33, for calculating pixel space size shared by the target tracking object;
Setting unit 34, described in being arranged according to the pixel space size being calculated in the display platen edge The detection area of target tracking object.
In the present embodiment, since the detection area of target tracking object should not be arranged too small, should not also be arranged Greatly, too small will lead to is set and detects fall short tracking object in predeterminable area, conference, which was arranged, then will increase smart television Operand.For the reasonability for guaranteeing the setting of detection area range, worked as in detecting unit 31 according to the detecting of the identification information of generation With the presence or absence of before target tracking object in the predeterminable area of preceding display platen edge, computing unit 33 can calculate first target and chase after Pixel space size shared by track object, then setting unit 34 is according to the pixel space size being calculated in the display screen The detection area of edge setting target tracking object.
It is that there are the display interfaces of target tracking object in the predeterminable area of the display screen of the invention top edge referring to Fig. 4, Fig. 4 Schematic diagram.For example, it is 60 × 80 (horizontal directions that pixel space size shared by target tracking object, which is calculated, in computing unit 33 Length is 60 pixels, and vertical direction height is 80 pixels), then the target tracking pair at each edge of display screen is arranged in setting unit 34 The length of the detection area of elephant in the horizontal direction should be not less than 60 pixels, and should be not less than 80 pictures in the height of vertical direction Element, the size of detection area can carry out flexible setting according to actual needs on this basis.
The detection area of target tracking object is arranged in the present embodiment pixel space size according to shared by target tracking object, It can guarantee the reasonability of detection area range setting, so as to reduce the operand of smart television, improve detecting efficiency.
It further, is the refinement the functional block diagram of generation module in Fig. 6 referring to Fig. 9, Fig. 9.Based on above-mentioned reality Example is applied, generation module 20 may include:
Acquiring unit 21, for obtaining the color component value of each pixel in the target tracking object;
Color negates unit 22, for carrying out face to the target tracking object according to the color component value got Color negates, and obtains the negated color component value of each pixel;
Summing elements 23, for the negated color component value of each pixel to be added up according to color type correspondence, Color component value after will be cumulative is as the mark of the target tracking object.
Since each pixel of composition target tracking object has its corresponding color, and the color of pixel its be all It is generated after being mixed by three kinds of colors of red, green, blue, therefore, the color of each pixel can use three kinds of face of red, green, blue Colouring component indicates.If (100,200,100) can indicate that the beauty's colouring component for forming the pixel is 100, green color component is 200, Blue color component is 100.
The present embodiment generation module 20 can be in such a way that preset rules generate the identification information of target tracking object are as follows: After object is tracked in user's selected target, acquiring unit 21 obtains the color component value of each pixel in target tracking object, face Color negates unit 22 and is negated according to the color component value got to target tracking object progress color, obtains each pixel and negates Color component value afterwards, summing elements 23 again carry out the negated color component value of each pixel according to color type correspondence tired Add, the color component value after adding up is as the mark of target tracking object.
For example, a white pixel point (0,0,0) is carried out color and is negated, i.e., each face is individually subtracted with 255 Colouring component value then obtains a black pixel point (255,255,255).If acquiring unit 21 gets every in target tracking object The color component value of a pixel is respectively (100,200,100), and (100,150,100) ... ..., then color negates unit 22 for institute Target tracking object is stated to carry out obtaining the negated color component value of each pixel, i.e. (155,55,155) after color negates, (155,105,155) ... ..., summing elements 23 carry out the negated color component value of each pixel according to color type is corresponding It is cumulative, i.e., (155+155+ ..., 55+105+ ..., 155+155+ ...), if the cumulative color component value that obtains is (a, b, c), then will The mark of (a, b, c) as target tracking object.
For certain target tracking objects (such as automobile), the color of group pixel is usually constant, thus is passed through The color component value that above-mentioned calculation obtains can be used as the mark of target tracking object, the mobile object in display screen compared with When more, target tracking object and other mobile objects can quickly be distinguished by the matching of color component value.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills Art field, is included within the scope of the present invention.

Claims (6)

1. a kind of target tracking display methods of panoramic video, which is characterized in that described method includes following steps:
The target tracking object determined in panoramic video is instructed according to the user's choice;
The identification information of the target tracking object is generated according to preset rules, the identification information is according to the target tracking pair The color component value of each pixel is calculated as in;
The target tracking object is tracked in the panoramic video according to the identification information of generation, so that the target chases after Track object is maintained in current display screen and shows;
Wherein, the identification information according to generation tracks the target tracking object in the panoramic video, so that The target tracking object is maintained at the step of showing in current display screen
Calculate pixel space size shared by the target tracking object;
The detection area of the target tracking object is set according to the pixel space size being calculated in display platen edge;
Being detected in the predeterminable area of current display platen edge according to the identification information of generation whether there is the target tracking Object;
If so, the visual angle that the display screen is currently shown is adjusted according to preset rules, so that the target tracking object is kept It is shown in current display screen.
2. the target tracking display methods of panoramic video as described in claim 1, which is characterized in that described according to preset rules The visual angle that the display screen is currently shown is adjusted, so that the target tracking object is maintained at the step of showing in current display screen Include:
Obtain location information of the target tracking object in the predeterminable area of the display platen edge;
The visual angle that the display screen is currently shown is adjusted according to the location information got, so that the target tracking object It is maintained in current display screen and shows.
3. the target tracking display methods of panoramic video as claimed in claim 1 or 2, which is characterized in that described according to default Rule generates the step of identification information of the target tracking object and includes:
Obtain the color component value of each pixel in the target tracking object;
Color is carried out to the target tracking object according to the color component value got to negate, and is obtained each pixel and is negated Color component value afterwards;
The negated color component value of each pixel is added up according to color type correspondence, the color component value after adding up Mark as the target tracking object.
4. a kind of target tracking display device of panoramic video, which is characterized in that described device includes:
Determining module, for instructing the target tracking object in determining panoramic video according to the user's choice;
Generation module, for generating the identification information of the target tracking object according to preset rules, the identification information according to The color component value of each pixel is calculated in the target tracking object;
Display module is tracked, for tracking the target tracking pair in the panoramic video according to the identification information of generation As so that the target tracking object is maintained in current display screen and shows;
Wherein, the tracking display module includes:
Computing unit, for calculating pixel space size shared by the target tracking object;
Setting unit, for the target tracking pair to be arranged in display platen edge according to the pixel space size being calculated The detection area of elephant;
Detecting unit whether there is for being detected in the current predeterminable area for showing platen edge according to the identification information of generation The target tracking object;
Adjustment unit, if for there are the target tracking objects in the currently predeterminable area of display platen edge, according to default The visual angle that display screen described in rule adjustment is currently shown, so that the target tracking object is maintained in current display screen and shows.
5. the target tracking display device of panoramic video as claimed in claim 4, which is characterized in that the adjustment unit is also used In:
Obtain location information of the target tracking object in the predeterminable area of the display platen edge;
The visual angle that the display screen is currently shown is adjusted according to the location information got, so that the target tracking object It is maintained in current display screen and shows.
6. the target tracking display device of panoramic video as described in claim 4 or 5, which is characterized in that the generation module Include:
Acquiring unit, for obtaining the color component value of each pixel in the target tracking object;
Color negates unit, takes for carrying out color to the target tracking object according to the color component value got Instead, the negated color component value of each pixel is obtained;
Summing elements will add up for the negated color component value of each pixel to add up according to color type correspondence Mark of the color component value afterwards as the target tracking object.
CN201710153172.6A 2017-03-14 2017-03-14 The target tracking display methods and device of panoramic video Active CN106961597B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201710153172.6A CN106961597B (en) 2017-03-14 2017-03-14 The target tracking display methods and device of panoramic video
PCT/CN2017/109937 WO2018166224A1 (en) 2017-03-14 2017-11-08 Target tracking display method and apparatus for panoramic video, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710153172.6A CN106961597B (en) 2017-03-14 2017-03-14 The target tracking display methods and device of panoramic video

Publications (2)

Publication Number Publication Date
CN106961597A CN106961597A (en) 2017-07-18
CN106961597B true CN106961597B (en) 2019-07-26

Family

ID=59470840

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710153172.6A Active CN106961597B (en) 2017-03-14 2017-03-14 The target tracking display methods and device of panoramic video

Country Status (2)

Country Link
CN (1) CN106961597B (en)
WO (1) WO2018166224A1 (en)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106961597B (en) * 2017-03-14 2019-07-26 深圳Tcl新技术有限公司 The target tracking display methods and device of panoramic video
CN107633241B (en) * 2017-10-23 2020-11-27 三星电子(中国)研发中心 Method and device for automatically marking and tracking object in panoramic video
CN109034000A (en) * 2018-07-04 2018-12-18 广州视源电子科技股份有限公司 Control method, device, storage medium and the advertisement machine of advertisement machine screen motion
CN111376832A (en) * 2018-12-28 2020-07-07 奥迪股份公司 Image display method, image display device, computer equipment and storage medium
CN110225402B (en) * 2019-07-12 2022-03-04 青岛一舍科技有限公司 Method and device for intelligently keeping interesting target time display in panoramic video
CN110324641B (en) * 2019-07-12 2021-09-03 青岛一舍科技有限公司 Method and device for keeping interest target moment display in panoramic video
CN111163267B (en) * 2020-01-07 2021-12-21 影石创新科技股份有限公司 Panoramic video editing method, device, equipment and storage medium
CN111182218A (en) * 2020-01-07 2020-05-19 影石创新科技股份有限公司 Panoramic video processing method, device, equipment and storage medium
CN111413904B (en) * 2020-04-02 2021-12-21 深圳创维-Rgb电子有限公司 Display scene switching method, intelligent display screen and readable storage medium
CN112135046B (en) * 2020-09-23 2022-06-28 维沃移动通信有限公司 Video shooting method, video shooting device and electronic equipment
CN112788425A (en) * 2020-12-28 2021-05-11 深圳Tcl新技术有限公司 Dynamic area display method, device, equipment and computer readable storage medium
CN115396741A (en) * 2022-07-29 2022-11-25 北京势也网络技术有限公司 Panoramic video playing method and device, electronic equipment and readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104252629A (en) * 2013-06-26 2014-12-31 范钦雄 Target Detection And Tracking Method And System
CN105847379A (en) * 2016-04-14 2016-08-10 乐视控股(北京)有限公司 Tracking method and tracking apparatus for panoramic video moving direction
CN105843541A (en) * 2016-03-22 2016-08-10 乐视网信息技术(北京)股份有限公司 Target tracking and displaying method and device in panoramic video
CN106446002A (en) * 2016-08-01 2017-02-22 三峡大学 Moving target-based video retrieval method for track in map

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002064812A (en) * 2000-08-17 2002-02-28 Sharp Corp Moving target tracking system
CN101477792B (en) * 2009-01-21 2011-06-08 华为终端有限公司 Method for displaying overlapped pattern on the background picture and display apparatus thereof
CN102843617B (en) * 2012-09-26 2016-08-10 天津游奕科技有限公司 A kind of method realizing panoramic video dynamic hot spot
CN106303706A (en) * 2016-08-31 2017-01-04 杭州当虹科技有限公司 The method realizing following visual angle viewing virtual reality video with leading role based on face and item tracking
CN106331732B (en) * 2016-09-26 2019-11-12 北京疯景科技有限公司 Generate, show the method and device of panorama content
CN106961597B (en) * 2017-03-14 2019-07-26 深圳Tcl新技术有限公司 The target tracking display methods and device of panoramic video

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104252629A (en) * 2013-06-26 2014-12-31 范钦雄 Target Detection And Tracking Method And System
CN105843541A (en) * 2016-03-22 2016-08-10 乐视网信息技术(北京)股份有限公司 Target tracking and displaying method and device in panoramic video
CN105847379A (en) * 2016-04-14 2016-08-10 乐视控股(北京)有限公司 Tracking method and tracking apparatus for panoramic video moving direction
CN106446002A (en) * 2016-08-01 2017-02-22 三峡大学 Moving target-based video retrieval method for track in map

Also Published As

Publication number Publication date
WO2018166224A1 (en) 2018-09-20
CN106961597A (en) 2017-07-18

Similar Documents

Publication Publication Date Title
CN106961597B (en) The target tracking display methods and device of panoramic video
KR101764372B1 (en) Apparatus and method for compositing image in a portable terminal
CN104796594B (en) Method for instantly presenting special effect of preview interface and terminal equipment
KR101337204B1 (en) Enhanced handheld screen-sensing pointer
EP3120494B1 (en) Sharing physical whiteboard content in electronic conference
RU2642344C2 (en) Method and device for adjusting and displaying image
US10600169B2 (en) Image processing system and image processing method
EP3379525A1 (en) Image processing device and image generation method
CN109274977B (en) Virtual item allocation method, server and client
US20110025818A1 (en) System and Method for Controlling Presentations and Videoconferences Using Hand Motions
US20110227827A1 (en) Interactive Display System
JP2015524951A (en) Manipulating computing devices by detecting round objects in images
CN108304063A (en) Information processing unit, information processing method and computer-readable medium
CN106210699B (en) Information processing unit, the control method of information processing unit and image processing system
CN111614905A (en) Image processing method, image processing device and electronic equipment
CN106161945A (en) Take pictures treating method and apparatus
CN111832538A (en) Video processing method and device and storage medium
WO2018014517A1 (en) Information processing method, device and storage medium
TW201439981A (en) Image processing device, image processing method, and recording medium
US11003062B2 (en) Information processing device, method of information processing, and image display system
CN114339029B (en) Shooting method and device and electronic equipment
CN114650370A (en) Image shooting method and device, electronic equipment and readable storage medium
KR20040088159A (en) Input system based upon movement in space
JP2017072945A (en) Image processor, image processing method
JP2007287093A (en) Program, method and device for detecting mobile object

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant