CN106792096A - A kind of augmented reality method and its system based on barrage - Google Patents
A kind of augmented reality method and its system based on barrage Download PDFInfo
- Publication number
- CN106792096A CN106792096A CN201611232407.2A CN201611232407A CN106792096A CN 106792096 A CN106792096 A CN 106792096A CN 201611232407 A CN201611232407 A CN 201611232407A CN 106792096 A CN106792096 A CN 106792096A
- Authority
- CN
- China
- Prior art keywords
- barrage
- terminal
- information
- barrage information
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 29
- 238000000034 method Methods 0.000 title claims abstract description 19
- 239000011521 glass Substances 0.000 claims abstract description 51
- 238000001514 detection method Methods 0.000 claims description 13
- 230000011218 segmentation Effects 0.000 claims description 11
- 238000010586 diagram Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
- H04N21/4756—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for rating content, e.g. scoring a recommended movie
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Theoretical Computer Science (AREA)
- Optics & Photonics (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
A kind of augmented reality method and its system based on barrage, including display terminal, AR glasses；Its operation principle is：For showing that the terminal of barrage information, when presentation of video frames corresponding with any one barrage information is detected, the corresponding barrage information of the frame of video is sent to the AR glasses that RFDC is set up with terminal；The AR glasses receive the reality imagery that the first camera intake enabled after barrage information towards terminal carries terminal picture, barrage information is incident upon above terminal as virtual information and is shown；The augmented reality method and its system based on barrage provided by the present invention, solve barrage information content it is excessive when, the barrage translational speed for causing is too fast or footprint area is excessive and influence the problem of the viewing experience of beholder in screen.
Description
Technical field
The present invention relates to augmented reality field, more particularly to a kind of augmented reality method and its system based on barrage.
Background technology
Barrage（barrage）, Chinese vogue word, original meaning refer to a large amount of or a small amount of cannon provide intensive bombardment；The present invention
The barrage refers to the comment for largely being shown in captions ejection form while the phenomenon sailed on screen.Barrage can give spectators
The illusion of a kind of " real-time interactive ", although the transmission time of different barrages is otherwise varied, but it can be specific in video
One time point occurs, therefore the barrage sent in the same time in phase substantially also has identical theme, when comment is participated in just
Have the illusion commented on simultaneously with other spectators.And traditional player Commentary Systems are independently of outside player, therefore
The content of comment is centered around on whole video mostly, and topic is not strong, the sensation for also not having " real-time interactive ".
But barrage also has the disadvantage for blocking video content, some out of season barrages can also reduce spectators for video
Notice.Originally the video of target is sent on the contrary into supporting role as comment, put the cart before the horse.Such as barrage covers broadcasting picture
The majority or barrage information translational speed in face are too fast, and these barrage phenomenons can all have influence on the viewing experience of beholder.
The content of the invention
Goal of the invention：For above-mentioned situation, in order to overcome the shortcoming in background technology, one is the embodiment of the invention provides
Augmented reality method and its system based on barrage are planted, can effectively solve the problems, such as to be related in above-mentioned background technology.
Technical scheme：A kind of augmented reality system based on barrage, including for showing the terminal and AR of barrage information
Glasses, the terminal includes barrage information sending module, for broadcasting detecting frame of video corresponding with any one barrage information
When putting, the corresponding barrage information of the frame of video is sent to the AR glasses that RFDC is set up with terminal；The AR glasses
Including：Reality imagery acquisition module, carries for receiving to enable after barrage information towards the first camera intake of terminal
The reality imagery of terminal picture；Virtual information projection module, for barrage information to be incident upon into terminal as virtual information
Fang Jinhang shows.
Used as a kind of preferred embodiment of the invention, the AR glasses also include information back module, for returning display letter
Cease to the terminal；The terminal also includes barrage information hiding module, corresponding with frame of video for being controlled according to display information
Barrage information be hidden.
Used as a kind of preferred embodiment of the invention, the AR glasses also include：Eye image acquisition module, for enabling court
The image of user's eye is carried to the second camera intake of user；Blink detection module, for being blinked to user's eye
Eye detection, and judge whether frequency of wink reaches predeterminated frequency when blink is detected.
Used as a kind of preferred embodiment of the invention, the terminal also includes that barrage information splits module, for barrage to be believed
Breath is split according to the reproduction time node of frame of video, and the barrage information after segmentation carries the reproduction time of correspondence frame of video
Node；
The AR glasses also include：Barrage information searching module, the reproduction time node for obtaining terminal video frame, search with
The corresponding barrage information of reproduction time node；Projection submodule, for barrage information to be thrown according to corresponding reproduction time node
Penetrate above terminal and synchronize display.
Used as a kind of preferred embodiment of the invention, the terminal also includes：Barrage data obtaining module, for obtaining video
The barrage information that frame shows when playing；Barrage signal judgement module, for judging the translational speed of barrage information whether beyond pre-
If whether Su Du are He ∕ or judge footprint area of the barrage information in screen beyond preset area.
A kind of augmented reality method based on barrage, the augmented reality system described in usage right requirement 6, methods described bag
Include following steps：
Step1, for showing the terminal of barrage information when presentation of video frames corresponding with any one barrage information is detected, will
The corresponding barrage information of the frame of video is sent to the AR glasses that RFDC is set up with terminal；
Step2, the AR glasses receive the first camera intake enabled after barrage information towards terminal and carry terminal to be drawn
The reality imagery in face, barrage information is incident upon above terminal as virtual information and is shown.
As a kind of preferred embodiment of the invention, carried out barrage information is incident upon above terminal as virtual information
After display, also include：
The AR glasses passback displays information to the terminal；
The terminal controls barrage information corresponding with frame of video to be hidden according to display information.
As a kind of preferred embodiment of the invention, it is incident upon above terminal as virtual information in barrage information and is shown
Before showing, also include：
The AR glasses are enabled towards the second camera intake of user and carry the image of user's eye；
Blink detection is carried out to user's eye, and judges whether frequency of wink reaches predeterminated frequency when blink is detected；
If reaching, step is continued executing with, will otherwise terminate flow.
As a kind of preferred embodiment of the invention, nothing is set up with terminal the corresponding barrage information of the frame of video is sent to
Before the AR glasses of line data communication, also include：
The terminal is split barrage information according to the reproduction time node of frame of video, and the barrage information after segmentation is carried
The reproduction time node of correspondence frame of video；
Barrage information is incident upon above terminal as virtual information and is shown, including：
The AR glasses obtain the reproduction time node of terminal video frame, search barrage information corresponding with reproduction time node；
Barrage information is incident upon above terminal according to corresponding reproduction time node and synchronizes display
As a kind of preferred embodiment of the invention, set up without line number with terminal the corresponding barrage information of the frame of video is sent to
Before AR glasses according to communication, also include：
The terminal obtains the barrage information shown during presentation of video frames；
Judge barrage information translational speed whether beyond pre-set velocity He ∕ or judging that barrage information is in the footprint area of screen
It is no beyond preset area；
If exceeding, step is continued executing with, will otherwise terminate flow.
The present invention realizes following beneficial effect：By the barrage data obtaining module of the terminal, when obtaining video playback
The barrage information of display, is then sent to barrage signal judgement module by the barrage information of acquisition, judges the movement of barrage information
The footprint area of speed and barrage information in screen.If judge that it exceeds preset value, barrage information is sent to AR eyes, will
Barrage presentation of information is above terminal, and the information that will be shown is hidden on terminal video picture.It is therefore seen that the present invention is avoided
Barrage information translational speed on video pictures is too fast or the larger situation of footprint area, so as to reducing barrage information pair
The viewing influence of beholder.
Brief description of the drawings
Accompanying drawing herein is merged in specification and constitutes the part of this specification, shows the implementation for meeting the disclosure
Example, and it is used to explain the principle of the disclosure together in specification.A kind of augmented reality based on barrage that Fig. 1 is provided for the present invention
System structure diagram；
A kind of augmented reality method flow schematic diagram based on barrage that Fig. 2 is provided for the present invention.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.
Refer to Fig. 1, a kind of augmented reality system structure diagram based on barrage that Fig. 1 is provided for the present invention.
Specifically, the present embodiment provides a kind of augmented reality system based on barrage, including for showing barrage information
Terminal 1 and AR glasses 2, the terminal 1 include barrage information sending module 3, for detecting and any one barrage information
During corresponding presentation of video frames, the corresponding barrage information of the frame of video is sent to the AR that RFDC is set up with terminal 1
Glasses 2；The AR glasses 2 include：Reality imagery acquisition module 4, for receive enable after barrage information towards terminal
One camera 16 absorbs the reality imagery for carrying terminal picture；Virtual information projection module 5, for using barrage information as void
Intend information projection to be shown in the top of terminal 1.
Used as a kind of preferred embodiment of the invention, the AR glasses 2 also include information back module 6, are shown for returning
Information gives the terminal 1；The terminal 1 also includes barrage information hiding module 7, for according to display information control and frame of video
Corresponding barrage information is hidden.
Used as a kind of preferred embodiment of the invention, the AR glasses also include：Eye image acquisition module 8, for enabling
The image for carrying user's eye is absorbed towards the second camera 9 of user；Blink detection module 10, for entering to user's eye
Row blink detection, and judge whether frequency of wink reaches predeterminated frequency when blink is detected.
Used as a kind of preferred embodiment of the invention, the terminal also includes that barrage information splits module 11, for by barrage
Information is split according to the reproduction time node of frame of video, when the barrage information after segmentation carries the broadcasting of correspondence frame of video
Intermediate node；
The AR glasses also include：Barrage information searching module 12, the reproduction time node for obtaining terminal video frame is searched
Barrage information corresponding with reproduction time node；Projection submodule 13, for by barrage information according to corresponding reproduction time section
Point is incident upon above terminal and synchronizes display.
Used as a kind of preferred embodiment of the invention, the terminal also includes：Barrage data obtaining module 14, regards for obtaining
The barrage information that frequency frame shows when playing；Whether barrage signal judgement module 15, the translational speed for judging barrage information surpasses
Go out pre-set velocity He ∕ or judging footprint area of the barrage information in screen whether beyond preset area.
Specifically, the barrage signal judgement module 15 of terminal 1 described first is carried out to the barrage information in terminal video picture
Monitoring in real time, i.e. monitoring in real time judge that the footprint area of the translational speed or barrage information of barrage information in screen is
It is no beyond preset value.When footprint area when the translational speed of barrage information or in screen exceeds preset value, will be beyond pre-
If the barrage information in a period of time of value carries out virtual reality using AR glasses 2.Wherein for the translational speed of barrage information
And its area occupied in screen judges, can be according in a period of time, the frame of video quantity for including barrage information is carried out
Judge.For example, the number of video frames amount for being set as in 1 second including barrage information in this implementation is 20, can recognize more than 20
For the barrage information translational speed or footprint area in screen exceed preset value.
Further, after barrage signal judgement module 15 has carried out judgement, barrage data obtaining module 14 pairs is all to be exceeded
Barrage information in the time of preset value is obtained.The mode of acquisition is to be exceeded in the time range of preset value by detection
Frame of video is detected, when detecting the presentation of video frames for including barrage information, by the frame of video and corresponding barrage information
Record.For example, barrage signal judgement module judges that reproduction time is the barrage information translational speed in 1 point 30 seconds to 2 points
Or footprint area exceeds preset value, then any one barrage information in the time that barrage data obtaining module 14 will be detected
During corresponding presentation of video frames, the frame of video, presentation of video frames node and corresponding barrage information record are got off.
In addition, the barrage information segmentation module 11 that the terminal 1 includes, by barrage information the broadcasting according to frame of video of acquisition
Put timing node to be split, the barrage information after segmentation carries corresponding presentation of video frames timing node.
For example in the present embodiment, the video frame information with timing node after the information segmentation that will be obtained is specific as follows
Shown in table：
Frame of video presentation of video frames node barrage information
11 points of 32 seconds this films are very good-looking！
21 points of 40 seconds leading ladies are very beautiful！
31 points 44 seconds I aim at man No. one come！
41 points 51 seconds it is plain, it is weak！
Further, after barrage information segmentation module 11 segments barrage information and its corresponding frame of video, after segmentation
The information of formation sends AR glasses 2 to by barrage information sending module.After AR glasses 2 receive above- mentioned information, beyond pre-
If in the time range of value, enabling reality imagery of the intake with terminal video picture of the first camera 16 towards terminal.This
The intake terminal picture of the first camera 16 is by the way of video recording is scanned in embodiment.
Further, while the first camera 16 absorbs terminal video picture, the barrage information that AR glasses 2 are included is looked into
Module 12 is looked for, the reproduction time node of the terminal picture reality imagery according to intake finds out corresponding frame of video and corresponding bullet
Curtain information, and its barrage information is sent to virtual information projection module 5.In actual implementation process, barrage information searching
Module 12 can be according to the reproduction time node of reality in the picture of intake, as the foundation for judging terminal plays node.
For example in this implementation in, the reproduction time of reality in the reality imagery in the terminal picture of the intake of the first camera 16
Node be 1 point 32 seconds, then barrage information searching module will in the video frame search 1 point of 32 seconds corresponding frame of video and corresponding bullet
Curtain information, i.e., " this film is very good-looking！”
Further, the barrage information that virtual information projection module 5 will be received is carried out in real time according to the broadcast nodes of frame of video
Be incident upon intake terminal picture top shown.
For example, in the present embodiment, when presentation of video frames was by 1 point and 32 seconds, on the terminal picture of the intake of the first camera 16
" this film is very good-looking for Fang Huiyou！" printed words appearance.
Further, virtually shown for the corresponding barrage information of frame of video within the time in AR glasses 2
While, by information back module 6, the corresponding frame of video of barrage information of virtual reality is sent to terminal 1 as signal.
The terminal 1 in receiving the signal be video frame information after, using barrage information hiding module, to the frame of video pair
The barrage information answered is hidden.
For example when frame of video 1 point is played for 32 seconds the corresponding barrage information of frame of video of the timing node is for " this film is true
It is good-looking！", after this barrage information is virtually shown by AR glasses 2, the information back module 6 of AR glasses, by 1 point of 32 seconds regards
Frequency frame is sent to terminal 1 as feedback information, terminal 1 when video playback was to 1 point and 32 seconds, using barrage information hiding module 7
It is that the corresponding barrage information of frame of video is hidden to this, so as to will not be shown on the video pictures of terminal.
Embodiment two
Refer to Fig. 1, a kind of augmented reality system structure diagram based on barrage that Fig. 1 is provided for the present invention.
Specifically, a kind of augmented reality system based on barrage that embodiment two is provided, big with described in embodiment one
Body is similar to, and during difference is embodiment two, AR glasses 2 are further included：Eye image acquisition module 8, for enabling towards use
The second camera intake at family carries the image of user's eye；Blink detection module 9, for carrying out blink inspection to user's eye
Survey, and judge whether frequency of wink reaches predeterminated frequency when blink is detected.And whether exceed preset value according to frequency of wink,
Barrage is virtually shown.Even reach, carry out virtual display, do not shown virtually otherwise.
Specifically, when reading barrage using the AR glasses 2 according to user, imaging acquisition module 8 by eye and locking
The eye image of user, after locking, using blink detection module 9, carries out real-time blink detection, and sentence to user's eye
Whether disconnected frequency of wink reaches predeterminated frequency.It is last whether to exceed preset value according to frequency of wink, barrage is virtually shown.
Even reach, carry out virtual display, do not shown virtually otherwise.
Embodiment three
Refer to Fig. 2, a kind of augmented reality method flow schematic diagram based on barrage that Fig. 2 is provided for the present invention.Specifically, this
Embodiment provides a kind of augmented reality method based on barrage, the augmented reality system described in usage right requirement 6, methods described
Comprise the following steps：
Step1, for showing the terminal of barrage information when presentation of video frames corresponding with any one barrage information is detected, will
The corresponding barrage information of the frame of video is sent to the AR glasses that RFDC is set up with terminal；
Step2, the AR glasses receive the first camera intake enabled after barrage information towards terminal and carry terminal to be drawn
The reality imagery in face, barrage information is incident upon above terminal as virtual information and is shown.
As a kind of preferred embodiment of the invention, carried out barrage information is incident upon above terminal as virtual information
After display, also include：
The AR glasses passback displays information to the terminal；
The terminal controls barrage information corresponding with frame of video to be hidden according to display information.
As a kind of preferred embodiment of the invention, it is incident upon above terminal as virtual information in barrage information and is shown
Before showing, also include：
The AR glasses are enabled towards the second camera intake of user and carry the image of user's eye；
Blink detection is carried out to user's eye, and judges whether frequency of wink reaches predeterminated frequency when blink is detected；
If reaching, step is continued executing with, will otherwise terminate flow.
As a kind of preferred embodiment of the invention, nothing is set up with terminal the corresponding barrage information of the frame of video is sent to
Before the AR glasses of line data communication, also include：
The terminal is split barrage information according to the reproduction time node of frame of video, and the barrage information after segmentation is carried
The reproduction time node of correspondence frame of video；
Barrage information is incident upon above terminal as virtual information and is shown, including：
The AR glasses obtain the reproduction time node of terminal video frame, search barrage information corresponding with reproduction time node；
Barrage information is incident upon above terminal according to corresponding reproduction time node and synchronizes display
As a kind of preferred embodiment of the invention, set up without line number with terminal the corresponding barrage information of the frame of video is sent to
Before AR glasses according to communication, also include：
The terminal obtains the barrage information shown during presentation of video frames；
Judge barrage information translational speed whether beyond pre-set velocity He ∕ or judging that barrage information is in the footprint area of screen
It is no beyond preset area；
If exceeding, step is continued executing with, will otherwise terminate flow.
It should be understood that the process that embodiment three is implemented can be corresponding with the description of embodiment one, embodiment two, herein not
Describe in detail again.
The above embodiments merely illustrate the technical concept and features of the present invention, and the skill of the technical field is familiar with the purpose is to allow
Art personnel will appreciate that present disclosure and implement according to this, can not be limited the scope of the invention with this.All bases
Equivalents or modification done by spirit of the invention, should all be included within the scope of the present invention.
Claims (10)
1. a kind of augmented reality method based on barrage, it is characterised in that comprise the following steps：
For showing the terminal of barrage information when presentation of video frames corresponding with any one barrage information is detected, by the video
The corresponding barrage information of frame is sent to the AR glasses that RFDC is set up with terminal；
The AR glasses are received to enable after barrage information towards the first camera intake of terminal and carry showing for terminal picture
Real image, barrage information is incident upon above terminal as virtual information and is shown.
2. a kind of augmented reality method based on barrage according to claim 1, it is characterised in that make by barrage information
After being incident upon and shown above terminal for virtual information, also include：
The AR glasses passback displays information to the terminal；
The terminal controls barrage information corresponding with frame of video to be hidden according to display information.
3. a kind of augmented reality method based on barrage according to claim 1, it is characterised in that in barrage information conduct
Virtual information is incident upon before being shown above terminal, is also included：
The AR glasses are enabled towards the second camera intake of user and carry the image of user's eye；
Blink detection is carried out to user's eye, and judges whether frequency of wink reaches predeterminated frequency when blink is detected；
If reaching, step is continued executing with, will otherwise terminate flow.
4. a kind of augmented reality method based on barrage according to claim 1, it is characterised in that by the frame of video pair
The barrage information answered is sent to before setting up the AR glasses of RFDC with terminal, is also included：
The terminal is split barrage information according to the reproduction time node of frame of video, and the barrage information after segmentation is carried
The reproduction time node of correspondence frame of video；
Barrage information is incident upon above terminal as virtual information and is shown, including：
The AR glasses obtain the reproduction time node of terminal video frame, search barrage information corresponding with reproduction time node；
Barrage information is incident upon above terminal according to corresponding reproduction time node and synchronizes display.
5. a kind of augmented reality method based on barrage according to claim 1, it is characterised in that by the frame of video pair
The barrage information answered is sent to before setting up the AR glasses of RFDC with terminal, is also included：
The terminal obtains the barrage information shown during presentation of video frames；
Judge barrage information translational speed whether beyond pre-set velocity He ∕ or judging that barrage information is in the footprint area of screen
It is no beyond preset area；
If exceeding, step is continued executing with, will otherwise terminate flow.
6. a kind of augmented reality system based on barrage, it is characterised in that including terminal and AR for showing barrage information
Glasses, the terminal includes barrage information sending module, for broadcasting detecting frame of video corresponding with any one barrage information
When putting, the corresponding barrage information of the frame of video is sent to the AR glasses that RFDC is set up with terminal；The AR glasses
Including：Reality imagery acquisition module, carries for receiving to enable after barrage information towards the first camera intake of terminal
The reality imagery of terminal picture；Virtual information projection module, for barrage information to be incident upon into terminal as virtual information
Fang Jinhang shows.
7. a kind of augmented reality system based on barrage according to claim 6, it is characterised in that the AR glasses are also wrapped
Information back module is included, the terminal is displayed information to for returning；The terminal also includes barrage information hiding module, is used for
Barrage information corresponding with frame of video is controlled to be hidden according to display information.
8. a kind of augmented reality system based on barrage according to claim 6, it is characterised in that the AR glasses are also wrapped
Include：Eye image acquisition module, the second camera intake for enabling towards user carries the image of user's eye；Blink
Detection module, for carrying out blink detection to user's eye, and it is default to judge whether frequency of wink reaches when blink is detected
Frequency.
9. a kind of augmented reality system based on barrage according to claim 6, it is characterised in that the terminal also includes
Barrage information splits module, for barrage information to be split according to the reproduction time node of frame of video, the barrage after segmentation
Information carries the reproduction time node of correspondence frame of video；
The AR glasses also include：Barrage information searching module, the reproduction time node for obtaining terminal video frame, search with
The corresponding barrage information of reproduction time node；Projection submodule, for barrage information to be thrown according to corresponding reproduction time node
Penetrate above terminal and synchronize display.
10. according to a kind of augmented reality system based on barrage described in claim 6, it is characterised in that the terminal also includes：
Barrage data obtaining module, for obtaining the barrage information shown during presentation of video frames；Barrage signal judgement module, for judging
The translational speed of barrage information whether exceed pre-set velocity He ∕ or judge barrage information screen footprint area whether beyond in advance
If area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611232407.2A CN106792096B (en) | 2016-12-28 | 2016-12-28 | A kind of augmented reality method and its system based on barrage |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611232407.2A CN106792096B (en) | 2016-12-28 | 2016-12-28 | A kind of augmented reality method and its system based on barrage |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106792096A true CN106792096A (en) | 2017-05-31 |
| CN106792096B CN106792096B (en) | 2019-06-21 |
Family
ID=58921370
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611232407.2A Active CN106792096B (en) | 2016-12-28 | 2016-12-28 | A kind of augmented reality method and its system based on barrage |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106792096B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107300972A (en) * | 2017-06-15 | 2017-10-27 | 北京小鸟看看科技有限公司 | The method of comment in display device is worn, device and wear display device |
| CN108347657A (en) * | 2018-03-07 | 2018-07-31 | 北京奇艺世纪科技有限公司 | A kind of method and apparatus of display barrage information |
| CN109391854A (en) * | 2018-11-30 | 2019-02-26 | 努比亚技术有限公司 | Barrage display methods, system, mobile terminal and readable storage medium storing program for executing |
| CN110719493A (en) * | 2019-11-07 | 2020-01-21 | 广州虎牙科技有限公司 | Barrage display method and device, electronic equipment and readable storage medium |
| CN111225264A (en) * | 2018-11-23 | 2020-06-02 | 上海哔哩哔哩科技有限公司 | Bullet screen display method and system based on augmented reality |
| WO2021179499A1 (en) * | 2020-03-12 | 2021-09-16 | 深圳捷径观察咨询有限公司 | Vr deep reader having anti-distraction reminding function, and reading method |
| CN113791708A (en) * | 2021-08-13 | 2021-12-14 | 维沃移动通信有限公司 | Screen privacy protection method and device and electronic equipment |
| WO2022135409A1 (en) * | 2020-12-25 | 2022-06-30 | 维沃移动通信有限公司 | Display processing method, display processing apparatus, and wearable device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104602131A (en) * | 2015-02-16 | 2015-05-06 | 腾讯科技（北京）有限公司 | Barrage processing method and system |
| CN104602098A (en) * | 2015-01-04 | 2015-05-06 | 深圳市同洲电子股份有限公司 | Video barrage display method and equipment thereof |
| CN105095378A (en) * | 2015-06-30 | 2015-11-25 | 北京奇虎科技有限公司 | Method and device for loading web page pop-up comments |
| CN105992021A (en) * | 2016-06-29 | 2016-10-05 | 乐视控股（北京）有限公司 | Video bullet screen method, video bullet screen device and video bullet screen system |
| US20160366466A1 (en) * | 2014-07-07 | 2016-12-15 | Le Holdings(Beijing)Co., Ltd. | Method for displaying bullet screen of video, and electronic device |
-
2016
- 2016-12-28 CN CN201611232407.2A patent/CN106792096B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160366466A1 (en) * | 2014-07-07 | 2016-12-15 | Le Holdings(Beijing)Co., Ltd. | Method for displaying bullet screen of video, and electronic device |
| CN104602098A (en) * | 2015-01-04 | 2015-05-06 | 深圳市同洲电子股份有限公司 | Video barrage display method and equipment thereof |
| CN104602131A (en) * | 2015-02-16 | 2015-05-06 | 腾讯科技（北京）有限公司 | Barrage processing method and system |
| CN105095378A (en) * | 2015-06-30 | 2015-11-25 | 北京奇虎科技有限公司 | Method and device for loading web page pop-up comments |
| CN105992021A (en) * | 2016-06-29 | 2016-10-05 | 乐视控股（北京）有限公司 | Video bullet screen method, video bullet screen device and video bullet screen system |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107300972A (en) * | 2017-06-15 | 2017-10-27 | 北京小鸟看看科技有限公司 | The method of comment in display device is worn, device and wear display device |
| CN108347657A (en) * | 2018-03-07 | 2018-07-31 | 北京奇艺世纪科技有限公司 | A kind of method and apparatus of display barrage information |
| CN108347657B (en) * | 2018-03-07 | 2021-04-20 | 北京奇艺世纪科技有限公司 | Method and device for displaying bullet screen information |
| CN111225264A (en) * | 2018-11-23 | 2020-06-02 | 上海哔哩哔哩科技有限公司 | Bullet screen display method and system based on augmented reality |
| CN109391854A (en) * | 2018-11-30 | 2019-02-26 | 努比亚技术有限公司 | Barrage display methods, system, mobile terminal and readable storage medium storing program for executing |
| CN110719493A (en) * | 2019-11-07 | 2020-01-21 | 广州虎牙科技有限公司 | Barrage display method and device, electronic equipment and readable storage medium |
| WO2021179499A1 (en) * | 2020-03-12 | 2021-09-16 | 深圳捷径观察咨询有限公司 | Vr deep reader having anti-distraction reminding function, and reading method |
| WO2022135409A1 (en) * | 2020-12-25 | 2022-06-30 | 维沃移动通信有限公司 | Display processing method, display processing apparatus, and wearable device |
| CN113791708A (en) * | 2021-08-13 | 2021-12-14 | 维沃移动通信有限公司 | Screen privacy protection method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106792096B (en) | 2019-06-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106792096B (en) | A kind of augmented reality method and its system based on barrage | |
| US8291328B2 (en) | System and method for synchronizing a real-time performance with a virtual object | |
| CN105120325B (en) | A kind of information transferring method and system | |
| CN104394400B (en) | Draw filter antagonism project dummy emulation system and the method for display based on solid more | |
| US9082214B2 (en) | 3D drawing system for providing a real time, personalized, and immersive artistic experience | |
| CN201308742Y (en) | Running machine with real scene | |
| US20100225734A1 (en) | Stereoscopic three-dimensional interactive system and method | |
| CN105939481A (en) | Interactive three-dimensional virtual reality video program recorded broadcast and live broadcast method | |
| CN105812768B (en) | Playback method and system of a kind of 3D videos in VR equipment | |
| CN106028078A (en) | Personalized content creating method, personalized content creating device, personalized content play method and personalized content play device | |
| US20150040165A1 (en) | Multi-source video navigation | |
| JP2013535889A (en) | Method and apparatus for providing auxiliary content in a three-dimensional communication system | |
| CN106658030A (en) | Method and device for playing composite video comprising single-path audio and multipath videos | |
| US20120194656A1 (en) | System and method for displaying multiple exclusive video streams on one monitor | |
| TW201044868A (en) | Method for scaling video content according to bandwidth rate | |
| CN110012264A (en) | A kind of video handles synthesis system and method in real time | |
| CN106792072B (en) | The method and its system of barrage and video are shown under a kind of separating medium | |
| CN105191298B (en) | Use the multi-dimensional content service provider system of 2D 3D multi-dimensional content files, the service providing method and the multi-dimensional content file | |
| Ndalianis | The Frenzy of the Visible: Spectacle and Motion in the Era of the Digital | |
| Bickerstaff | Case study: the introduction of stereoscopic games on the Sony PlayStation 3 | |
| US8375311B2 (en) | System and method for determining placement of a virtual object according to a real-time performance | |
| CN100480849C (en) | Method of photographing signal treating and broadcasting and viewing stereoimage | |
| US20100295968A1 (en) | Medium adjusting system and method | |
| Mayer | New options and considerations for creating enhanced viewing experiences | |
| EP3043569A1 (en) | Temporal relationships of media streams |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20190531 Address after: Room 315, Room 33, Xiya Road, China (Shanghai) Free Trade Pilot Area, Pudong New Area, Shanghai, 200120 Applicant after: SHANGHAI XINDING NETWORK TECHNOLOGY Co.,Ltd. Address before: 215400 6 Beijing West Road, Taicang Economic Development Zone, Suzhou, Jiangsu Applicant before: SUZHOU SHANGXINBAO INFORMATION TECHNOLOGY CO.,LTD. |
|
| TA01 | Transfer of patent application right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A Method and System of Augmented Reality Based on Bullet Curtain Effective date of registration: 20230509 Granted publication date: 20190621 Pledgee: Industrial Bank Co.,Ltd. Shanghai pilot Free Trade Zone Lingang New District sub branch Pledgor: SHANGHAI XINDING NETWORK TECHNOLOGY Co.,Ltd. Registration number: Y2023310000170 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right |