CN106792096B - A kind of augmented reality method and its system based on barrage - Google Patents
A kind of augmented reality method and its system based on barrage Download PDFInfo
- Publication number
- CN106792096B CN106792096B CN201611232407.2A CN201611232407A CN106792096B CN 106792096 B CN106792096 B CN 106792096B CN 201611232407 A CN201611232407 A CN 201611232407A CN 106792096 B CN106792096 B CN 106792096B
- Authority
- CN
- China
- Prior art keywords
- terminal
- barrage
- information
- barrage information
- glasses
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 27
- 238000000034 method Methods 0.000 title claims abstract description 27
- 239000011521 glass Substances 0.000 claims abstract description 52
- 238000004891 communication Methods 0.000 claims abstract description 13
- 238000001514 detection method Methods 0.000 claims description 13
- 230000011218 segmentation Effects 0.000 claims description 13
- 238000010586 diagram Methods 0.000 description 5
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
- H04N21/4756—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for rating content, e.g. scoring a recommended movie
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Theoretical Computer Science (AREA)
- Optics & Photonics (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
A kind of augmented reality method and its system based on barrage, including display terminal, AR glasses；Its working principle is that: the corresponding barrage information of the video frame is sent to the AR glasses that wireless data communication is established with terminal when detecting presentation of video frames corresponding with any one barrage information by the terminal for showing barrage information；The AR glasses enable the reality imagery that terminal picture is carried towards the first camera intake of terminal after receiving barrage information, and barrage information is incident upon above terminal as virtual information and is shown；The augmented reality method and its system based on barrage provided through the invention, solve barrage information content it is excessive when, caused barrage movement speed is too fast or footprint area is excessive and the problem of influence the viewing experience of viewer in screen.
Description
Technical field
The present invention relates to augmented reality field, in particular to a kind of augmented reality method and its system based on barrage.
Background technique
Barrage (barrage), Chinese vogue word, original meaning, which refers to, provides intensive bombardment with a large amount of or a small amount of cannon；The present invention
The phenomenon that barrage is referred to the comment largely shown with subtitle pop-up form while sailed on the screen.Barrage can give spectators
The illusion of a kind of " real-time interactive ", although the sending time different from of different barrages, it only can be specific in video
One time point occurs, therefore in the barrage mutually sent in the same time substantially also theme having the same, just when participating in comment
Have the illusion commented on simultaneously with other spectators.And traditional player Commentary Systems are independently of except player, therefore
The content of comment is centered around mostly on entire video, and topic is not strong, does not also have the feeling of " real-time interactive ".
But barrage also has the disadvantage for blocking video content, some out of season barrages can also reduce spectators for video
Attention.Originally the video as comment transmission target is put the cart before the horse instead at supporting role.Such as barrage covers broadcasting picture
The majority or barrage information movement speed in face are too fast, these barrage phenomenons can all influence the viewing experience of viewer.
Summary of the invention
Goal of the invention: it is directed to above situation, in order to overcome the disadvantage in background technique, the embodiment of the invention provides one
Augmented reality method and its system of the kind based on barrage, the problem of can be effectively solved involved in above-mentioned background technique.
Technical solution: a kind of augmented reality system based on barrage, including for showing the terminal and AR of barrage information
Glasses, the terminal include barrage information sending module, for detecting that video frame corresponding with any one barrage information broadcasts
When putting, the corresponding barrage information of the video frame is sent to the AR glasses that wireless data communication is established with terminal；The AR glasses
Include: reality imagery acquisition module, is carried for receiving the first camera intake enabled after barrage information towards terminal
The reality imagery of terminal picture；Virtual information projection module, for being incident upon terminal using barrage information as virtual information
Fang Jinhang is shown.
As a kind of preferred embodiment of the invention, the AR glasses further include information back module, for returning display letter
It ceases to the terminal；The terminal further includes barrage information hiding module, for corresponding with video frame according to display information control
Barrage information be hidden.
As a kind of preferred embodiment of the invention, the AR glasses further include: eye image acquisition module, for enabling court
The image of user's eye is carried to the intake of the second camera of user；Blink detection module, for being blinked to user's eye
Eye detection, and judge whether frequency of wink reaches predeterminated frequency when detecting blink.
As a kind of preferred embodiment of the invention, the terminal further includes barrage information segmentation module, for believing barrage
Breath is split according to the play time node of video frame, and the barrage information after segmentation carries the play time of corresponding video frame
Node；
The AR glasses further include: barrage information searching module is looked into for obtaining the play time node of terminal video frame
Look for barrage information corresponding with play time node；Submodule is projected, is used for barrage information according to corresponding play time section
Point, which is incident upon above terminal, synchronizes display.
As a kind of preferred embodiment of the invention, the terminal further include: barrage data obtaining module, for obtaining video
The barrage information that frame is shown when playing；Barrage signal judgement module, for judging it is pre- whether the movement speed of barrage information exceeds
If Su Du is He ∕ or judge whether barrage information exceeds preset area in the footprint area of screen.
A kind of augmented reality method based on barrage, uses augmented reality system as claimed in claim 6, the method packet
Include following steps:
Step1, for showing that the terminal of barrage information is detecting presentation of video frames corresponding with any one barrage information
When, the corresponding barrage information of the video frame is sent to the AR glasses that wireless data communication is established with terminal；
Step2, the AR glasses receive the first camera intake enabled after barrage information towards terminal and carry end
The reality imagery for holding picture, barrage information is incident upon above terminal as virtual information and is shown.
As a kind of preferred embodiment of the invention, carried out in the top that barrage information is incident upon terminal as virtual information
After display, further includes:
The AR glasses passback displays information to the terminal；
The terminal controls barrage information corresponding with video frame according to display information and is hidden.
As a kind of preferred embodiment of the invention, it is incident upon above terminal and is shown as virtual information in barrage information
Before showing, further includes:
The AR glasses enable the image that user's eye is carried towards the second camera intake of user；
Blink detection is carried out to user's eye, and judges whether frequency of wink reaches predeterminated frequency when detecting blink；
If reaching, step is continued to execute, otherwise will terminate process.
As a kind of preferred embodiment of the invention, nothing is established with terminal being sent to the corresponding barrage information of the video frame
Before the AR glasses of line data communication, further includes:
Barrage information is split by the terminal according to the play time node of video frame, and the barrage information after segmentation is taken
Play time node with corresponding video frame；
Barrage information is incident upon above terminal as virtual information and is shown, comprising:
The AR glasses obtain the play time node of terminal video frame, search barrage letter corresponding with play time node
Breath；
Barrage information is incident upon above terminal according to corresponding play time node and synchronizes display
As a kind of preferred embodiment of the invention, nothing is established with terminal being sent to the corresponding barrage information of the video frame
Before the AR glasses of line data communication, further includes:
The terminal obtains the barrage information shown when presentation of video frames；
Judge whether the movement speed of barrage information exceeds pre-set velocity He ∕ or judging that barrage information occupies face in screen
Whether product exceeds preset area；
If exceeding, step is continued to execute, otherwise will terminate process.
The present invention realizes following the utility model has the advantages that passing through the barrage data obtaining module of the terminal, when acquisition video playing
The barrage information of display, the barrage information that then will acquire are sent to barrage signal judgement module, judge the movement of barrage information
The footprint area of speed and barrage information in screen.If judge it beyond preset value, barrage information is sent to AR eyes, it will
Barrage information is shown in above terminal, and the information of display is hidden on terminal video picture.It is therefore seen that the present invention avoids
Barrage information mobile excessive velocities or the larger situation of footprint area on video pictures, to reduce barrage information pair
The viewing of viewer influences.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the disclosure
Example, and consistent with the instructions for explaining the principles of this disclosure.Fig. 1 is a kind of augmented reality based on barrage provided by the invention
System structure diagram；
Fig. 2 is a kind of augmented reality method flow schematic diagram based on barrage provided by the invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.
Fig. 1 is please referred to, Fig. 1 is a kind of augmented reality system structure diagram based on barrage provided by the invention.
Specifically, the present embodiment provides a kind of augmented reality system based on barrage, including for showing barrage information
Terminal 1 and AR glasses 2, the terminal 1 includes barrage information sending module 3, for detecting and any one barrage information
When corresponding presentation of video frames, the corresponding barrage information of the video frame is sent to the AR that wireless data communication is established with terminal 1
Glasses 2；The AR glasses 2 include: reality imagery acquisition module 4, for receiving enable after barrage information towards terminal the
One camera 16 absorbs the reality imagery for carrying terminal picture；Virtual information projection module 5, for using barrage information as void
Quasi- information projection is shown in the top of terminal 1.
As a kind of preferred embodiment of the invention, the AR glasses 2 further include information back module 6, for returning display
Information gives the terminal 1；The terminal 1 further includes barrage information hiding module 7, for according to the control of display information and video frame
Corresponding barrage information is hidden.
As a kind of preferred embodiment of the invention, the AR glasses further include: eye image acquisition module 8, for enabling
The image for carrying user's eye is absorbed towards the second camera 9 of user；Blink detection module 10, for user's eye into
Row blink detection, and judge whether frequency of wink reaches predeterminated frequency when detecting blink.
As a kind of preferred embodiment of the invention, the terminal further includes barrage information segmentation module 11, is used for barrage
Information is split according to the play time node of video frame, when the barrage information after segmentation carries the broadcasting of corresponding video frame
Intermediate node；
The AR glasses further include: barrage information searching module 12, for obtaining the play time node of terminal video frame,
Search barrage information corresponding with play time node；Submodule 13 is projected, when for by barrage information according to corresponding broadcasting
Intermediate node, which is incident upon above terminal, synchronizes display.
As a kind of preferred embodiment of the invention, the terminal further include: barrage data obtaining module 14, for obtaining view
The barrage information that frequency frame is shown when playing；Barrage signal judgement module 15, for judging whether the movement speed of barrage information surpasses
Pre-set velocity is He ∕ or judge whether barrage information exceeds preset area in the footprint area of screen out.
Specifically, the 1 barrage signal judgement module 15 of terminal described first carries out the barrage information in terminal video picture
Monitoring in real time, i.e. monitoring in real time judge that the footprint area of the movement speed or barrage information of barrage information in screen is
It is no to exceed preset value.When the movement speed of barrage information or the footprint area in screen exceed preset value, will exceed pre-
If the barrage information in a period of time of value carries out virtual reality using AR glasses 2.Wherein for the movement speed of barrage information
And its area judgement occupied in screen, it can be carried out according to the video frame quantity in a period of time, including barrage information
Judgement.For example, be set as in 1 second in this implementation include barrage information number of video frames amount be 20, can recognize more than 20
For in screen barrage information movement speed or footprint area exceed preset value.
Further, after barrage signal judgement module 15 has carried out judgement, barrage data obtaining module 14 exceeds to all
Barrage information in the time of preset value is obtained.The mode of acquisition is to pass through detection beyond in the time range of preset value
Video frame is detected, and is detected when including the presentation of video frames of barrage information, by the video frame and corresponding barrage information
It records.For example, barrage signal judgement module judges play time for the barrage information movement speed in 1 point 30 seconds to 2 points
Or footprint area exceeds preset value, then any one barrage information in the time that barrage data obtaining module 14 will test
When corresponding presentation of video frames, the video frame, presentation of video frames node and corresponding barrage information are recorded.
In addition, the barrage information segmentation module 11 that the terminal 1 includes, barrage information the broadcasting according to video frame that will acquire
It puts timing node to be split, the barrage information after segmentation carries corresponding presentation of video frames timing node.
Such as in the present embodiment, the video frame information with timing node after the segmentation of the information that will acquire is specific as follows
Shown in table:
Video frame presentation of video frames node barrage information
11 points of 32 seconds this films are very good-looking！
21 points of 40 seconds leading ladies are very beautiful！
31 points 44 seconds I be exactly aim at male No.1 come！
41 points 51 seconds it is plain, it is weak！
Further, after barrage information segmentation module 11 segments barrage information and its corresponding video frame, will divide
The information formed after cutting sends AR glasses 2 to by barrage information sending module.After AR glasses 2 receive above- mentioned information, super
Out in the time range of preset value, the real shadow that terminal video picture is had towards the first camera 16 intake of terminal is enabled
Picture.The first camera 16 intake terminal picture is by the way of scanning video recording in the present embodiment.
Further, while the first camera 16 absorbs terminal video picture, the barrage information that AR glasses 2 include is looked into
Module 12 is looked for, according to the play time node of the terminal picture reality imagery of intake, finds out corresponding video frame and corresponding bullet
Curtain information, and its barrage information is sent to virtual information projection module 5.In actual implementation process, barrage information searching
Module 12 can be according to play time node real in the picture of intake, as the foundation for judging terminal plays node.
Such as in this implementation in, real play time in the reality imagery in the terminal picture of the first camera 16 intake
Node be 1 point 32 seconds, then barrage information searching module will search 1 point of 32 seconds corresponding video frame and corresponding bullet in the video frame
Curtain information, i.e., " this film is very good-looking！"
Further, virtual information projection module 5 carries out the barrage information received according to the broadcast nodes of video frame
It is incident upon above the terminal picture of intake and is shown in real time.
For example, in the present embodiment, when presentation of video frames was by 1 point and 32 seconds, on the terminal picture of the first camera 16 intake
" this film is very good-looking by Fang Huiyou！" printed words appearance.
Further, this is virtually shown beyond the corresponding barrage information of video frame in the time in AR glasses 2
While, by information back module 6, the corresponding video frame of barrage information of virtual reality is sent to terminal 1 as signal.
The terminal 1 receive in the signal be video frame information after, using barrage information hiding module, to the video frame pair
The barrage information answered is hidden.
Such as video frame 1 divides the corresponding barrage information of video frame of timing node when playing to be that " this film is true 32 seconds
It is good-looking！", after this barrage information is virtually shown by AR glasses 2, the information back module 6 of AR glasses, by 1 point of 32 seconds view
Frequency frame is sent to terminal 1 as feedback information, and terminal 1 utilizes barrage information hiding module 7 when video playing was to 1 point and 32 seconds
It is that the corresponding barrage information of video frame is hidden to this, to will not be shown on the video pictures of terminal.
Embodiment two
Fig. 1 is please referred to, Fig. 1 is a kind of augmented reality system structure diagram based on barrage provided by the invention.
It is and big described in embodiment one specifically, a kind of augmented reality system based on barrage provided by embodiment two
Body is similar, the difference is that AR glasses 2 further include in embodiment two: eye image acquisition module 8, for enabling towards use
The second camera intake at family carries the image of user's eye；Blink detection module 9, for carrying out blink inspection to user's eye
It surveys, and judges whether frequency of wink reaches predeterminated frequency when detecting blink.And whether exceed preset value according to frequency of wink,
Barrage is virtually shown.Even reach, carry out virtual display, otherwise without virtually showing.
Specifically, imaging acquisition module 8 when reading barrage using the AR glasses 2 according to user by eye and locking
The eye image of user using blink detection module 9, carries out real-time blink detection to user's eye, and sentence after locking
Whether disconnected frequency of wink reaches predeterminated frequency.It is last whether to exceed preset value according to frequency of wink, barrage is virtually shown.
Even reach, carry out virtual display, otherwise without virtually showing.
Embodiment three
Referring to FIG. 2, Fig. 2 is a kind of augmented reality method flow schematic diagram based on barrage provided by the invention.Specifically
, the augmented reality method based on barrage that the present embodiment provides a kind of uses augmented reality system as claimed in claim 6, institute
State method the following steps are included:
Step1, for showing that the terminal of barrage information is detecting presentation of video frames corresponding with any one barrage information
When, the corresponding barrage information of the video frame is sent to the AR glasses that wireless data communication is established with terminal；
Step2, the AR glasses receive the first camera intake enabled after barrage information towards terminal and carry end
The reality imagery for holding picture, barrage information is incident upon above terminal as virtual information and is shown.
As a kind of preferred embodiment of the invention, carried out in the top that barrage information is incident upon terminal as virtual information
After display, further includes:
The AR glasses passback displays information to the terminal；
The terminal controls barrage information corresponding with video frame according to display information and is hidden.
As a kind of preferred embodiment of the invention, it is incident upon above terminal and is shown as virtual information in barrage information
Before showing, further includes:
The AR glasses enable the image that user's eye is carried towards the second camera intake of user；
Blink detection is carried out to user's eye, and judges whether frequency of wink reaches predeterminated frequency when detecting blink；
If reaching, step is continued to execute, otherwise will terminate process.
As a kind of preferred embodiment of the invention, nothing is established with terminal being sent to the corresponding barrage information of the video frame
Before the AR glasses of line data communication, further includes:
Barrage information is split by the terminal according to the play time node of video frame, and the barrage information after segmentation is taken
Play time node with corresponding video frame；
Barrage information is incident upon above terminal as virtual information and is shown, comprising:
The AR glasses obtain the play time node of terminal video frame, search barrage letter corresponding with play time node
Breath；
Barrage information is incident upon above terminal according to corresponding play time node and synchronizes display
As a kind of preferred embodiment of the invention, nothing is established with terminal being sent to the corresponding barrage information of the video frame
Before the AR glasses of line data communication, further includes:
The terminal obtains the barrage information shown when presentation of video frames；
Judge whether the movement speed of barrage information exceeds pre-set velocity He ∕ or judging that barrage information occupies face in screen
Whether product exceeds preset area；
If exceeding, step is continued to execute, otherwise will terminate process.
It should be understood that the process that embodiment three implements can be corresponding with the description of embodiment one, embodiment two, herein not
It is described in detail again.
The above embodiments merely illustrate the technical concept and features of the present invention, and the purpose is to allow the skill for being familiar with the technical field
Art personnel can understand the content of the present invention and implement it accordingly, and can not be limited the scope of the invention with this.All bases
Equivalent changes or modifications made by spirit of the invention, should be covered by the protection scope of the present invention.
Claims (8)
1. a kind of augmented reality method based on barrage, which comprises the following steps:
For showing the terminal of barrage information when detecting presentation of video frames corresponding with any one barrage information, by the video
The corresponding barrage information of frame is sent to the AR glasses that wireless data communication is established with terminal；
The AR glasses receive the first camera intake enabled after barrage information towards terminal and carry showing for terminal picture
Barrage information is incident upon above terminal as virtual information and shows by real image；
Wherein, before the corresponding barrage information of the video frame is sent to the AR glasses for establishing wireless data communication with terminal,
Further include:
Barrage information is split by the terminal according to the play time node of video frame, and the barrage information after segmentation carries
The play time node of corresponding video frame；
Barrage information is incident upon above terminal as virtual information and is shown, comprising:
The AR glasses obtain the play time node of terminal video frame, search barrage information corresponding with play time node；
Barrage information is incident upon above terminal according to corresponding play time node and synchronizes display；
Wherein, the AR glasses obtain the play time node of terminal video frame by the reality imagery of the terminal picture of intake.
2. a kind of augmented reality method based on barrage according to claim 1, which is characterized in that make by barrage information
It is incident upon for virtual information after being shown above terminal, further includes:
The AR glasses passback displays information to the terminal；
The terminal controls barrage information corresponding with video frame according to display information and is hidden.
3. a kind of augmented reality method based on barrage according to claim 1, which is characterized in that in barrage information conduct
Virtual information is incident upon shown above terminal before, further includes:
The AR glasses enable the image that user's eye is carried towards the second camera intake of user；
Blink detection is carried out to user's eye, and judges whether frequency of wink reaches predeterminated frequency when detecting blink；
If reaching, step is continued to execute, otherwise will terminate process.
4. a kind of augmented reality method based on barrage according to claim 1, which is characterized in that by the video frame pair
The barrage information answered is sent to before the AR glasses for establishing wireless data communication with terminal, further includes:
The terminal obtains the barrage information shown when presentation of video frames；
Judge whether the movement speed of barrage information exceeds pre-set velocity He ∕ or judging that barrage information is in the footprint area of screen
It is no to exceed preset area；
If exceeding, step is continued to execute, otherwise will terminate process.
5. a kind of augmented reality system based on barrage, which is characterized in that including for showing the terminal and AR of barrage information
Glasses, the terminal include barrage information sending module, for detecting that video frame corresponding with any one barrage information broadcasts
When putting, the corresponding barrage information of the video frame is sent to the AR glasses that wireless data communication is established with terminal；The AR glasses
Include: reality imagery acquisition module, is carried for receiving the first camera intake enabled after barrage information towards terminal
The reality imagery of terminal picture；Virtual information projection module, for being incident upon terminal using barrage information as virtual information
Fang Jinhang is shown；The terminal further includes barrage information segmentation module, for the play time by barrage information according to video frame
Node is split, and the barrage information after segmentation carries the play time node of corresponding video frame；
The AR glasses further include: barrage information searching module, for obtaining the play time node of terminal video frame, search with
The corresponding barrage information of play time node；Submodule is projected, for throwing barrage information according to corresponding play time node
It penetrates above terminal and synchronizes display；
Wherein, the barrage information searching module obtains the broadcasting of terminal video frame by the reality imagery of the terminal picture of intake
Timing node.
6. a kind of augmented reality system based on barrage according to claim 5, which is characterized in that the AR glasses also wrap
Information back module is included, displays information to the terminal for returning；The terminal further includes barrage information hiding module, is used for
Barrage information corresponding with video frame is controlled according to display information to be hidden.
7. a kind of augmented reality system based on barrage according to claim 5, which is characterized in that the AR glasses also wrap
It includes: eye image acquisition module, for enabling the image for carrying user's eye towards the second camera intake of user；Blink
Detection module for carrying out blink detection to user's eye, and judges whether frequency of wink reaches default when detecting blink
Frequency.
8. according to a kind of augmented reality system based on barrage described in claim 5, which is characterized in that the terminal further include:
Barrage data obtaining module, the barrage information shown when for obtaining presentation of video frames；Barrage signal judgement module, for judging
The movement speed of barrage information whether exceeds pre-set velocity He ∕ or to judge whether barrage information exceeds in the footprint area of screen pre-
If area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611232407.2A CN106792096B (en) | 2016-12-28 | 2016-12-28 | A kind of augmented reality method and its system based on barrage |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611232407.2A CN106792096B (en) | 2016-12-28 | 2016-12-28 | A kind of augmented reality method and its system based on barrage |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106792096A CN106792096A (en) | 2017-05-31 |
| CN106792096B true CN106792096B (en) | 2019-06-21 |
Family
ID=58921370
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611232407.2A Active CN106792096B (en) | 2016-12-28 | 2016-12-28 | A kind of augmented reality method and its system based on barrage |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106792096B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107300972A (en) * | 2017-06-15 | 2017-10-27 | 北京小鸟看看科技有限公司 | The method of comment in display device is worn, device and wear display device |
| CN108347657B (en) * | 2018-03-07 | 2021-04-20 | 北京奇艺世纪科技有限公司 | Method and device for displaying bullet screen information |
| CN111225264A (en) * | 2018-11-23 | 2020-06-02 | 上海哔哩哔哩科技有限公司 | Bullet screen display method and system based on augmented reality |
| CN109391854A (en) * | 2018-11-30 | 2019-02-26 | 努比亚技术有限公司 | Barrage display methods, system, mobile terminal and readable storage medium storing program for executing |
| CN110719493A (en) * | 2019-11-07 | 2020-01-21 | 广州虎牙科技有限公司 | Barrage display method and device, electronic equipment and readable storage medium |
| WO2021179499A1 (en) * | 2020-03-12 | 2021-09-16 | 深圳捷径观察咨询有限公司 | Vr deep reader having anti-distraction reminding function, and reading method |
| CN112596609A (en) * | 2020-12-25 | 2021-04-02 | 维沃移动通信有限公司 | Display processing method, display processing device and wearable equipment |
| CN113791708A (en) * | 2021-08-13 | 2021-12-14 | 维沃移动通信有限公司 | Screen privacy protection method and device and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104602131A (en) * | 2015-02-16 | 2015-05-06 | 腾讯科技（北京）有限公司 | Barrage processing method and system |
| CN104602098A (en) * | 2015-01-04 | 2015-05-06 | 深圳市同洲电子股份有限公司 | Video barrage display method and equipment thereof |
| CN105095378A (en) * | 2015-06-30 | 2015-11-25 | 北京奇虎科技有限公司 | Method and device for loading web page pop-up comments |
| CN105992021A (en) * | 2016-06-29 | 2016-10-05 | 乐视控股（北京）有限公司 | Video bullet screen method, video bullet screen device and video bullet screen system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016004859A1 (en) * | 2014-07-07 | 2016-01-14 | 乐视网信息技术（北京）股份有限公司 | Method and device for video barrage display |
-
2016
- 2016-12-28 CN CN201611232407.2A patent/CN106792096B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104602098A (en) * | 2015-01-04 | 2015-05-06 | 深圳市同洲电子股份有限公司 | Video barrage display method and equipment thereof |
| CN104602131A (en) * | 2015-02-16 | 2015-05-06 | 腾讯科技（北京）有限公司 | Barrage processing method and system |
| CN105095378A (en) * | 2015-06-30 | 2015-11-25 | 北京奇虎科技有限公司 | Method and device for loading web page pop-up comments |
| CN105992021A (en) * | 2016-06-29 | 2016-10-05 | 乐视控股（北京）有限公司 | Video bullet screen method, video bullet screen device and video bullet screen system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106792096A (en) | 2017-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106792096B (en) | A kind of augmented reality method and its system based on barrage | |
| CN104394400B (en) | Draw filter antagonism project dummy emulation system and the method for display based on solid more | |
| JP5801812B2 (en) | Virtual insert into 3D video | |
| Lelyveld | Virtual reality primer with an emphasis on camera-captured VR | |
| CN105939481A (en) | Interactive three-dimensional virtual reality video program recorded broadcast and live broadcast method | |
| CN201308742Y (en) | Running machine with real scene | |
| US8291328B2 (en) | System and method for synchronizing a real-time performance with a virtual object | |
| CN106550239A (en) | 360 degree of panoramic video live broadcast systems and its implementation | |
| KR101883018B1 (en) | Method and device for providing supplementary content in 3d communication system | |
| AU2012203858B2 (en) | Automatic camera identification from a multi-camera video stream | |
| CN106296686A (en) | One is static and dynamic camera combines to moving object three-dimensional reconstruction method frame by frame | |
| GB2555410A (en) | Video content synchronisation method and apparatus | |
| EP2366226A1 (en) | Method and device for processing video frames | |
| CN107454438A (en) | Panoramic video preparation method | |
| CN106658030A (en) | Method and device for playing composite video comprising single-path audio and multipath videos | |
| TW201044868A (en) | Method for scaling video content according to bandwidth rate | |
| CN106792072B (en) | The method and its system of barrage and video are shown under a kind of separating medium | |
| CN108134928A (en) | VR display methods and device | |
| GB2552150A (en) | Augmented reality system and method | |
| Bickerstaff | Case study: the introduction of stereoscopic games on the Sony PlayStation 3 | |
| CN105629654B (en) | A kind of novel dreamlike arenas based on augmented reality | |
| CA2983741C (en) | Method of video enhancement | |
| Mikami et al. | Immersive Previous Experience in VR for Sports Performance Enhancement | |
| TWI792723B (en) | Image analysis method and image analysis device using the same | |
| CN114500773B (en) | Rebroadcasting method, system and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20190531 Address after: Room 315, Room 33, Xiya Road, China (Shanghai) Free Trade Pilot Area, Pudong New Area, Shanghai, 200120 Applicant after: SHANGHAI XINDING NETWORK TECHNOLOGY Co.,Ltd. Address before: 215400 6 Beijing West Road, Taicang Economic Development Zone, Suzhou, Jiangsu Applicant before: SUZHOU SHANGXINBAO INFORMATION TECHNOLOGY CO.,LTD. |
|
| TA01 | Transfer of patent application right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A Method and System of Augmented Reality Based on Bullet Curtain Effective date of registration: 20230509 Granted publication date: 20190621 Pledgee: Industrial Bank Co.,Ltd. Shanghai pilot Free Trade Zone Lingang New District sub branch Pledgor: SHANGHAI XINDING NETWORK TECHNOLOGY Co.,Ltd. Registration number: Y2023310000170 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right |