CN105898521A - Bullet screen adding device and bullet screen adding method - Google Patents
Bullet screen adding device and bullet screen adding method Download PDFInfo
- Publication number
- CN105898521A CN105898521A CN201610225333.3A CN201610225333A CN105898521A CN 105898521 A CN105898521 A CN 105898521A CN 201610225333 A CN201610225333 A CN 201610225333A CN 105898521 A CN105898521 A CN 105898521A
- Authority
- CN
- China
- Prior art keywords
- image
- barrage
- pixel
- dot matrix
- recognition data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
- H04N21/4756—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for rating content, e.g. scoring a recommended movie
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4314—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
- H04N21/4621—Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/488—Data services, e.g. news ticker
- H04N21/4884—Data services, e.g. news ticker for displaying subtitles
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention discloses a bullet screen adding device and a bullet screen adding method. The bullet screen adding device comprises a bullet screen rendering module and an image channel module, which are connected together by a digital logic circuit. The bullet screen rendering module is used for receiving the comment content, and is used for rendering the comment content to generate a dot matrix image. In the dot matrix image, the comment content is expressed by the nontransparent pixel, and the parts except the comment content are expressed by the pixels different from the nontransparent pixel. The image channel module is used for receiving the original image from the signal source, and receiving the dot matrix image from the bullet screen rendering module, and is used to replace the pixel of the position corresponding to the original image by the nontransparent pixel in the dot matrix image to generate the image comprising the bullet screen. The above mentioned device and the above mentioned method are directly used for processing and correcting the image signals, and can be used to solve the problem that the original image cannot be covered by the bullet screen provided by the conventional bullet screen adding software on the same display device, and therefore the visibility of the bullet screen can be guaranteed.
Description
Technical field
The present invention relates to image processing field, be specifically related to a kind of barrage adding set and method.
Background technology
" barrage " is the roll titles above a kind of image being superimposed on such as frame of video, and its content is often
It it is video viewers's comment for video.At present, a lot of Online Video websites all have employed " barrage "
This form made comments, it is liked by young crowd deeply.Traditional " barrage " is often employed
Under the scene of video request program, the pattern shown after therefore can taking first to collect comment.Show large-scale
In the activity of field, in order to enliven on-the-spot atmosphere, transfer spectators' enthusiasm, can take to enter with " barrage " form
The way of row spectators scene comment.Specifically, collected the real-time comments of spectators by certain channel, and will
The comment collected with the form of " barrage " project/be superimposed on the on-the-spot screen for playing video content it
On, show.
Existing " barrage " adding technique, generally utilizes software to realize, wherein generally transparent by adding
" barrage layer " realizes superposition barrage on the video content play." barrage layer " display should be placed in
The window of top layer.But, due to the restriction of the relevant interface of computer operating system, some is calculated
Machine software, such as full frame 3-dimensional (3D) Games Software, partial video playout software etc., above-mentioned technical side
Although " barrage layer " is brought to Front by case statement, but actually can be covered by the picture of above-mentioned software, nothing
Method realizes barrage superposition.Additionally, this kind of scheme is generally realized by software, and this software needs to operate in spy
In fixed operating system, the operating system for other then cannot be compatible.
Summary of the invention
In view of the above problems, it is proposed that the present invention is to provide one to overcome the problems referred to above or at least partly
Ground solves barrage adding set and the method for the problems referred to above.
According to one aspect of the present invention, it is provided that a kind of barrage adding set, including via Digital Logic
The barrage rendering module of circuit connection and image channel module, wherein,
Described barrage rendering module is used for receiving comment content and rendering, described comment content with life
Becoming dot matrix image, in described dot matrix image, described comment content represents by nontransparent pixel, institute's commentary
Part beyond opinion content represents by the pixel different from described nontransparent pixel；
Described image channel module, for receiving original image from signal source, connects from described barrage rendering module
Receive described dot matrix image, and substitute described original image by the described nontransparent pixel in described dot matrix image
The pixel of correspondence position, to generate the image including barrage.
Alternatively, described image channel module farther includes buffer storage, for using described dot matrix
Before the pixel of the correspondence position that the described nontransparent pixel in image substitutes described original image, caching
Described dot matrix image.
Alternatively, described barrage adding set farther includes:
, for detecting whether there is the display being connected to described barrage adding set in display device detector unit
Equipment；
, for when there is described display device, from described display in expanded display recognition data delivery unit
Equipment obtains expanded display recognition data, and the expanded display recognition data acquired in storage, for described
Signal source reads.
Alternatively, described expanded display recognition data delivery unit is further used in storage described acquired
Expanded display recognition data before, revise described acquired expanded display recognition data.
Alternatively, described barrage adding set farther includes expanded display recognition data and forces manifolding switch
With expanded display recognition data signal generating unit, wherein,
Described expanded display recognition data force manifolding switch be used for selecting described display device detector unit and
Both described expanded display recognition data delivery units start simultaneously or select described extension display to identify
Data generating unit starts；
Described expanded display recognition data signal generating unit is used for generating and storing expanded display recognition data, uses
Read in described signal source.
Alternatively, described barrage adding set farther includes blank screen unit, for described image path
Module output blank screen signal；
Described image channel module is further used for generating blank screen image according to described blank screen signal, is used for showing
Show.
Alternatively, described barrage adding set farther includes debugging unit, for described image path
Module output debugging signal；
Described image channel module is further used for, according to described debugging signal output debugging image, being used for showing
Show.
Alternatively, described image channel module farther includes:
First input interface, is used for receiving described dot matrix image；
Second input interface, for receiving described original image from described signal source；
Pixel processing unit, for for different from described nontransparent pixel described in described dot matrix image
Pixel, exports the respective pixel in described original image；For the nontransparent pixel in described dot matrix image,
Directly output, to include the image of barrage described in generation；And
First output interface, is used for including described in exporting the image of barrage.
Alternatively, described image channel module farther includes enumerator and the second output interface,
Described enumerator is for detecting the resolution of described original image；
Described second output interface is for sending described resolution to described via described Digital Logical Circuits
Barrage rendering module；
Described barrage rendering module is further used for receiving described original image from described image channel module
Resolution, and according to described resolution, described comment content is rendered, to generate and described resolution
The dot matrix image that rate adapts.
According to a further aspect in the invention, it is provided that a kind of barrage adding method, including:
Original image is received from signal source；
Receive comment content and described comment content rendered, to generate dot matrix image, at described point
In system of battle formations picture, described comment content represents by nontransparent pixel, the part beyond described comment content with
The pixel that described nontransparent pixel is different represents；And
The picture of the correspondence position of described original image is substituted by the described nontransparent pixel in described dot matrix image
Element, to generate the image including barrage.
Barrage adding set and method according to the present invention directly process and revise picture signal, thus solve
On same display device, existing barrage adds the barrage lid of software and does not lives the problem of original image, from
And ensure that the visuality of barrage.
Described above is only the general introduction of technical solution of the present invention, in order to better understand the skill of the present invention
Art means, and can being practiced according to the content of description, and in order to allow, the present invention's is above and other
Objects, features and advantages can become apparent, below especially exemplified by the detailed description of the invention of the present invention.
Accompanying drawing explanation
By reading the detailed description of hereafter preferred implementation, various other advantage and benefit for this
Field those of ordinary skill will be clear from understanding.Accompanying drawing is only used for illustrating the purpose of preferred implementation,
And it is not considered as limitation of the present invention.And in whole accompanying drawing, be denoted by the same reference numerals
Identical parts.In the accompanying drawings:
Fig. 1 shows the schematic block diagram of barrage adding set according to an embodiment of the invention；
Fig. 2 shows the schematic block diagram of image channel module according to an embodiment of the invention；
Fig. 3 shows the schematic block diagram of barrage adding set according to another embodiment of the present invention；
Fig. 4 shows the indicative flowchart of barrage adding method according to an embodiment of the invention；With
And
Fig. 5 shows the indicative flowchart of barrage adding method in accordance with another embodiment of the present invention.
Detailed description of the invention
It is more fully described the exemplary embodiment of the disclosure below with reference to accompanying drawings.Although accompanying drawing shows
The exemplary embodiment of the disclosure, it being understood, however, that may be realized in various forms the disclosure and not
Should be limited by embodiments set forth here.On the contrary, it is provided that these embodiments are able to more thoroughly
Understand the disclosure, and complete for the scope of the present disclosure can be conveyed to those skilled in the art.
In order to avoid occurring barrage lid not live the problem of original image, and then the visuality of guarantee barrage, root
According to one aspect of the present invention, it is provided that a kind of barrage adding set.Fig. 1 shows according to the present invention one
The schematic block diagram of the barrage adding set 100 of individual embodiment.
The real-time barrage that barrage adding set 100 takes the mode of signal processing to realize image adds.Optional
Ground, image can be the broadcasting image etc. of frame of video, PowerPoint document.In application scenarios, should
Barrage adding set 100 can be connected to the signal source (signal such as such as computer, video disc player, enlarger
Source) and display device (such as display, television set, projector etc.) between.Barrage adding set 100
First original image can be received at signal source；Then, the original image received is overlapped barrage
Process, and export to display device, to be shown by it.In application scenarios, such as computer
Signal source this barrage adding set 100 can be identified as display device, and for display device,
This barrage adding set 100 can be identified as signal source by it.
As it is shown in figure 1, this barrage adding set 100 includes barrage rendering module 110 and image path mould
Block 120, and connect the Digital Logical Circuits of the two.
This Digital Logical Circuits can be unidirectional or bi-directional data path.Exemplarily, this Digital Logic electricity
Road includes quick peripheral component interconnection (PCI-E) bus.PCI-E bus is universal serial bus, is suitable to
Point-to-point transmission is carried out between barrage rendering module 110 and image channel module 120.Total via PCI-E
The speed that line is transmitted data by barrage rendering module 110 to image channel module 120 reaches as high as
65MB/s, meets the requirement of barrage refresh rate.
Barrage rendering module 110 is used for receiving comment content.Such as, it is from specific comment dissemination system warp
By Network Capture review information.This network such as cable network or wireless network.Can be commented by long poll
The mode of opinion dissemination system obtains review information, to ensure the real-time of review information.Alternatively, give
Every acquired comment content is numbered, in order to barrage rendering module 110 and comment dissemination system this
Communicating pair synchronizes.The most such as, barrage rendering module 110 obtains at user via input equipment
Review information.Review information can include the content viewables such as word, picture, emoticon.
Above-mentioned comment content is rendered by barrage rendering module 110, to generate dot matrix image.
Exemplarily, can first every comment content be rendered as pixel-matrix.Alternatively, at several
Color is chosen a kind of color carry out commenting on rendering of content.
Preferably, any one during the kind of alternate color is 1 to 8.Suitably alternate color kind
The data volume that number enables to dot matrix image is suitable, which ensure that barrage rendering module 110 and image lead to
Data communication speed in Digital Logical Circuits between road module 120, additionally, also assures that
When image channel module 120 carries out image procossing, the speed of the data reading dot matrix image can meet figure
The pixel clock frequency of picture.
Alternatively, when every comment content is rendered as pixel-matrix, add and himself color for it
Differ the edge of bigger color, in order to all can preferably be watched when adding barrage on multiple image
Effect.
Then, the most rendered comment content for pixel-matrix can be arranged.This arrangement refers to comment
Which discuss content arrangement at particular location of dot matrix image and to dispose in which way.Alternatively, according to
Comment on the length of content, the publisher of comment content, the significance level of comment content and currently expect for every
Comment content is arranged by the various information such as bar number occurring in the comment content on screen.Such as, right
In longer comment content, can arrange in the way of two row.Comment content is after arrangement, permissible
Generate the dot matrix image including commenting on content.In described dot matrix image, described comment content is with nontransparent
Pixel represents, the part beyond described comment content represents by the pixel different from described nontransparent pixel.
Wherein, nontransparent pixel represents that this pixel has color.In the examples described above, the color of this pixel is
Selected color.In one example, the pixel that described and nontransparent pixel is different can be transparent pixels.
In another example, the pixel right and wrong transparent pixels different colours that described and nontransparent pixel is different
Pixel.Such as, nontransparent pixel only includes redness, blueness and yellow pixel.And with nontransparent pixel not
It is black picture element with the pixel of color.It will appreciated by the skilled person that above-mentioned example is only shown
Meaning, as long as representing that the pixel of comment content represents by different pixels from other parts in dot matrix image,
It is thus possible to distinguish the two.
Barrage rendering module 110 can constantly repeat the process of above-mentioned generation dot matrix image, thus obtains one
Series dot matrix image.These dot matrix images can be constantly sent to image channel module 120.
Exemplarily, barrage rendering module 110 can realize with any computing unit with computing capability,
Such as CPU (CPU), Graphics Processing Unit (GPU) etc..In one example, adopt
Realize with the x86CPU of standard.On this basis, it is mounted with (SuSE) Linux OS.According to the limit
Stress test, when network is unobstructed, barrage rendering module 110 at most can obtain 12531 and comment each second
Opinion content, at most can render 1324 Chinese characters each second, can meet the requirement rendering comment content completely.
Use programmable, to have high-speed computation ability device (such as CPU) to realize barrage to render
Module so that the render process of barrage more flexibility and changeability, reduces the difficulty and complexity realized, simultaneously
Enhance vigorousness and the stability of barrage adding set.
Image channel module 120 is for receiving original image from signal source.As it was previously stated, this signal source can
To be the various image signal sources of such as video signal source.Correspondingly, this original image can be such as to connect
The arbitrary images such as continuous frame of video, it is the image of barrage to be added.
Image channel module 120 is additionally operable to receive, from barrage rendering module 110, the dot matrix image generated,
And the picture of the correspondence position of described original image is substituted by the described nontransparent pixel in described dot matrix image
Element, to generate the image including barrage.In the application scenarios of barrage adding set 100, this includes bullet
The image of curtain can export the display device being connected with barrage adding set 100, for by display device
Show.Original image be continuous print frame of video example in, this includes that the image of barrage is also even
Continuous frame of video.
It is appreciated that the pixel in dot matrix image and original image is one to one for position angle.
Such as, for when dot matrix image is the same with original image resolution, then come from position angle
Say that the pixel in the two is one to one.For dot matrix image resolution less than original image resolution
For situation, then for position angle, a pixel in dot matrix image may with in original image
Multiple pixels corresponding.
Exemplarily, for described dot matrix image represents the nontransparent pixel of comment content, image path
Module 120 exports this nontransparent pixel, to replace the pixel of the correspondence position of original image.For described
Commenting on the pixel of part beyond content in dot matrix image, image channel module 120 can directly export original
The pixel of the correspondence position of image.
Be appreciated that original image be successive video frames example in, image channel module 120 is permissible
Receive dot matrix image the most continuously, and process frame of video based on dot matrix image, thus realize in video
Add the effect of the constantly barrage of movement.
Exemplarily, image channel module 120 can realize with integrated circuit, and this integrated circuit includes existing
Field programmable gate array (FPGA).
Barrage adding set according to the present invention directly processes and revises such as frame of video original image, thus
Barrage can be added in real time for original image.Thus solve on same display device, existing barrage
The barrage lid adding software does not lives the problem of original image, thus ensure that the visuality of barrage.
Additionally, barrage adding set whole use Digital Logical Circuits carries out the process of digital signal, permissible
The greatly delay between reduction output signal and input signal, and stopped the loss of image quality, and permissible
Process the picture signal of high-resolution.
Fig. 2 shows image channel module 120 according to an embodiment of the invention.This image channel module
120 farther include first input interface the 121, second input interface 122, pixel processing unit 123 and
Output interface 124.
First input interface 121 is for receiving described dot matrix image from barrage rendering module 110.This is first years old
Input interface 121 e.g. PCI-E interface.
Second input interface 122 is for receiving original image from signal source.This second input interface 122 example
Digital signal shows (DVI, HDMI) interface in this way, and image channel module 120 can be via itself and letter
Number source is connected.
Pixel processing unit 123, for for the nontransparent pixel in dot matrix image, directly exports, for point
The pixel different from above-mentioned nontransparent pixel in system of battle formations picture, such as transparent pixels, in output original image
Respective pixel；To generate the image including barrage.Current according to original image of pixel processing unit 123
Pixel type of respective pixel in dot matrix image makes a choice, and replaces by the respective pixel in dot matrix image
Current pixel or do not replace current pixel.Thus, corresponding with comment content in original image position
Will be replaced with comment content.This pixel processing unit 123 can realize with FPGA.
First output interface 124 includes the image of barrage described in export.First output interface 124 can
To connect display device, the image including barrage is exported display device.First output interface 124 can
To be Video Graphics Array (VGA) interface or DVI interface.
Exemplarily, image channel module 120 can also include enumerator 125 and the second output interface 126.
This enumerator 125, for after image channel module 120 receives original image, detects original image
Resolution.This resolution may be used for barrage rendering module 110 and generates dot matrix image, it is also possible to is used for scheming
The picture corresponding with the specific pixel location in dot matrix image in original image is determined as channel module 120
Element.Second output interface 126 sends to barrage rendering module 110 for the resolution information that will be detected,
Such as, 1920 × 1080.Second output interface 126 can be such as PCI-E interface etc..
Barrage rendering module 110 is further used for from two-way via therebetween of image channel module 120
Data path receives the resolution of above-mentioned original image.Then, according to this resolution, comment content is carried out
Render, the dot matrix image adapted with described resolution with generation.The dot matrix image of such as this resolution or
The dot matrix image etc. compatible with this resolution.
Barrage rendering module 110 generates the dot matrix image that the resolution with original image adapts, and is conducive to
Image channel module 120 correctly processes original image, thus ensure that the image including barrage generated
Quality.
Alternatively, image channel module 120 can also include buffer storage 127, is utilizing a little for it
Before system of battle formations picture processes for the pixel in original image, such as, with described in dot matrix image
Before the pixel of the correspondence position that nontransparent pixel substitutes described original image, cache barrage rendering module
The dot matrix image generated.The existence of buffer storage so that barrage rendering module 110 generates dot matrix image
The refresh rate of original image that frame per second there is no need with image channel module 120 receives completely the same, and
Can render with relatively low frequency and generate dot matrix image, reach basic gratifying barrage simultaneously
Appreciation effect.Additionally, also reached to reduce the effect of the traffic.Such as, the resolution of original image is
1920 × 1080, refresh rate is 60Hz.If not using buffer storage, then need barrage rendering module
Synchronously render 60 width dot matrix images each second, just can get caught up in the refresh rate of original image.If made
By buffer storage, can render with arbitrarily low frequency the most in principle, without causing barrage
Interpolation goes wrong.If but dot matrix image renders underfrequency, then the viewing effect of barrage can be caused to become
Difference, produces the effect of " jumps ".Therefore to ensure the viewing effect of barrage, preferably add at barrage
In the range of module can reach, render dot matrix image to altofrequency as far as possible.
Such as, barrage rendering module 110 generates the time of a dot matrix image equal to image channel module 120
Receive the time of 4 original images.So can in the processing procedure of these 4 original images, all from
Buffer storage obtains this same dot matrix image.Thus ensure that in the case of the less traffic,
User still is able to the moment and watches the image including barrage.
Exemplarily, buffer storage 127 can utilize Synchronous Dynamic Random Access Memory (SDRAM)
Realize.
In one example, above-mentioned pixel processing unit 123, enumerator 125 and buffer storage 127
FPGA can be used to realize.Configurable logic block (CLB) in FPGA and digital dock management module
(DCM) ensure that the logic realization of pixel processing unit 123 sum counter 125, and ensure that place
Reason speed.Embedded block random access memory (RAM) in FPGA can be used for realizing buffer-stored
Device 127.In an example of the present invention, perfection can process resolution in real time and be up to 1920 × 1080,
Refresh rate is the video signal of 60Hz.
The fully utilized hardware circuit of barrage adding set including above-mentioned image channel module 120 realizes, and keeps away
Exempt from the problem that the operating system of existing barrage interpolation software is incompatible.
Exemplarily, barrage adding set farther includes display device detector unit and extension display identifies
Data (EDID) delivery unit.
For detecting whether there is the display device being connected to barrage adding set in display device detector unit.
When expanded display recognition data delivery unit for being connected to the display device of barrage adding set when existence,
Obtain the expanded display recognition data of this display device from this display device, and the extension acquired in storage shows
Show identification data, read for described signal source.
Expanded display recognition data is the data representing display device specifications parameter.Generally extension display identifies
Data are stored in the EEPROM (EEPROM) of display device.When barrage adds
After the display device detector unit of feeder apparatus detects that display device connects barrage adding set, extension display
Identify that data transfer unit, by by the client cables between barrage adding set and display device, accesses aobvious
Show the expanded display recognition data in the EEPROM of equipment.This client cables can be the display line of standard
Cable.The transmission of expanded display recognition data can be realized by the signal specific pin of this client cables.Expand
Exhibition display identifies that data can include the information such as the resolution of display device, refresh rate, manufacturer, model.When
When display device detector unit detects the presence of the display device being connected to barrage adding set, extension display
Identify that data transfer unit can send the signal that there is display device to signal source.Signal source receives this
After signal, read this expanded display recognition data from expanded display recognition data delivery unit, thus, can
Know the video signal that display device can accept.So, signal source can export the original image of adaptation,
For adding barrage.It is connected to the aobvious of barrage adding set when display device detector unit detects not exist
When showing equipment, expanded display recognition data delivery unit can stop sending to signal source there is display device
Signal, and no longer back-signalling source read expanded display recognition data trial.So, signal source
Can correctly know the already off connection of display device, thus make correct process.
As described above, the existence of expanded display recognition data delivery unit, it is ensured that barrage adding set
Can be adaptive with various display devices and signal source, such as there is the display device of different resolution, thus
Ensure that barrage adding set can normally be operated in various application scenarios.
Alternatively, above-mentioned expanded display recognition data delivery unit is additionally operable to show in the extension acquired in storage
Before showing identification data, revise described expanded display recognition data.Such as, amendment extension display identifies number
According to 0x14 skew at position 7 be 1 so that signal source output digit signals.The most such as, amendment extension
Display identifies that the vendor code at 0x8,0x09 skew of data is " THU ".The most such as, amendment is expanded
Exhibition display identifies date of manufacture at 0x10,0x11 skew of data etc..Number is identified by extension display
According to information such as the manufacturer of display device in delivery unit amendment expanded display recognition data, titles, not only
Ensure that barrage adding set is normally operated in various application scenarios, it is also possible to make that sees in signal source to show
Show that equipment is barrage adding set.
Alternatively, described barrage adding set also includes that expanded display recognition data is forced manifolding switch and expands
Exhibition display identifies data generating unit.
Expanded display recognition data forces manifolding switch can have two duties, such as, open or close.
It is when different duties, selects different expanded display recognition data associated components to start.Such as,
When expanded display recognition data forces manifolding switch to be opened, start expanded display recognition data signal generating unit
And force to stop both display device detector unit and expanded display recognition data delivery unit work simultaneously
Make.When expanded display recognition data forces manifolding switch to be closed, start display device detector unit and expansion
Exhibition display identifies both data transfer unit and stops the work of expanded display recognition data signal generating unit.
Expanded display recognition data signal generating unit is for generating what expanded display recognition data storing was generated
Expanded display recognition data.Signal source can read stored expanded display recognition data.
If it is to say, expanded display recognition data force manifolding switch open, regardless of whether exist with
The display device that barrage adding set connects, all can send, to signal source, the signal that display device exists by force.
When signal source attempts reading expanded display recognition data, expanded display recognition data signal generating unit will be read
The expanded display recognition data generated.So, under special circumstances, the extension display of display device is known
When other data occur abnormal, still can send to signal source and be preset at the expansion in barrage adding set in advance
Exhibition display identifies data, it is ensured that basic display function can be used.
Exemplarily, barrage adding set may further include blank screen unit.Blank screen unit is for figure
As channel module exports blank screen signal.After image channel module receives blank screen signal, it is additionally operable to root
Blank screen image is generated, for being shown by display device according to blank screen signal.In some application scenarios, Ke Nengxi
Hope shielding original image.Such as when party is broadcast live, for the time between different programs,
It is generally desirable to shield photographic head acquired image.At this point it is possible to start blackscreen unit so that barrage adds
Feeder apparatus generates blank screen image, to be shown by display device, reaches shield effectiveness.The existence of blank screen unit
Can facilitate user on the premise of not interrupting showing signal, cover signal source with full frame black picture rapidly
Original image.The existence of blank screen unit significantly improves Consumer's Experience.
Exemplarily, barrage adding set may further include debugging unit.Debugging unit is for figure
As channel module output debugging signal.After image channel module receives debugging signal, Start-up and Adjustment
Pattern.Image channel module is according to debugging signal output debugging image, for being shown by display device.Adjust
Attempt as being pre-stored in the buffer storage of image channel module.It is appreciated that in one example,
After image channel module receives debugging signal, when i.e. it is in debugging mode, directly from the debugging that prestores
The buffer storage read pixel point of image also exports this pixel.When image channel module is in normal work
During operation mode, it can be from the buffer storage read pixel point of caching dot matrix image, and according to being read
Pixel generate and include the image of barrage.The coded format of debugging image can be with the coding of dot matrix image
Form is identical.
Debugging unit can make user test the working condition of barrage adding set at any time, improves user's body
Test.
It is appreciated that above-mentioned display device detector unit, expanded display recognition data delivery unit, extension
Display identifies that data transfer unit, expanded display recognition data force manifolding switch, extension display to identify number
A control module can be integrated according to one or more in signal generating unit, blank screen unit and debugging unit
In.
Fig. 3 shows the schematic block diagram of barrage adding set 300 according to another embodiment of the present invention.
As it is shown on figure 3, this barrage adding set 300 includes barrage rendering module 310, image channel module 320
With control module 330.Wherein, the basic function of barrage rendering module 310 and image channel module 320 is divided
Similar with the corresponding module in aforementioned barrage adding set 100, for sake of simplicity, do not repeat them here.
It is single that this control module 330 includes that aforementioned display device detector unit, expanded display recognition data transmit
Unit, expanded display recognition data delivery unit, expanded display recognition data force manifolding switch, extension aobvious
Show identification data generating unit, blank screen unit and debugging unit.This control module 330 can be by general
Input/output interface is connected with image channel module 320.Control module 330 and image channel module 320
Between can be communicated by this universal input/output interface.
Alternatively, this control module can also include power subsystem.This power subsystem may be used for directly connecting
Connect external dc power, and power for image channel module and barrage rendering module.
Alternatively, this control module can also include main switch.When main switch is opened, barrage adds dress
Put startup.Control module starts to power for whole barrage adding set.When main switch is closed, barrage adds
Feeder apparatus quits work.Control module stops powering for whole barrage adding set.It is appreciated that and always opens
Pass can be manually opened by user or by controlling organization time opening.
Alternatively, this control module can also include that barrage enables switch.This barrage enables switch and can use
In the startup and the operation of image channel module that control barrage rendering module.When barrage enable switch is opened,
Barrage rendering module starts, and image channel module performs to add the operation of barrage for original image.When
When barrage enables switch closedown, barrage rendering module quits work, and image channel module can perform
Play the operation of original image, blank screen operation or debugging operations.Alternatively, this barrage enables to switch and also may be used
Do not exist, for original image add barrage operation or play original image operation in any one, black
Screen operation and debugging operations can determine whether to perform according to priority.
Additionally, control module can also include blank screen switch and/or debugging switch, it is used, respectively, to initiate above-mentioned
Blank screen unit and debugging unit.As it has been described above, after blank screen unit starting, then output blank screen signal；Debugging
After unit starting, then output debugging signal.
It is appreciated that above-mentioned barrage enables switch, blank screen switch and debugging switch and manually can be opened by user
Open or by controlling organization time opening.
According to a further aspect of the invention, a kind of barrage adding method is additionally provided.Fig. 4 shows according to this
The indicative flowchart of the barrage adding method 400 of one embodiment of invention.As shown in Figure 4, this barrage
Adding method 400 includes step S410, step S430 and step S450.
In step S410, receive original image from signal source.
In step S430, receive comment content and described comment content is rendered, to generate dot matrix
Image, in described dot matrix image, described comment content represents by nontransparent pixel, described comment content
Part in addition represents by the pixel different from above-mentioned nontransparent pixel.
In step S450, substitute described original image by the described nontransparent pixel in described dot matrix image
The pixel of correspondence position, to generate the image including barrage, be used for showing.Exemplarily, step S450
Realize with field programmable gate array.
Fig. 5 shows the indicative flowchart of barrage adding method 500 according to another embodiment of the present invention.
Wherein step 510, step S530 and step S550 respectively with above-mentioned steps 410, step S430 and step
The basic function of rapid S450 is similar to, for sake of simplicity, do not repeat them here.
Exemplarily, before described step S530, described barrage adding method 500 also includes step S515,
Detect the resolution of described original image.Exemplarily, step S515 field programmable gate array realizes.
In described step S530, described comment content is rendered always according to described resolution, to generate and institute
State the dot matrix image that resolution adapts.
Exemplarily, before step S550, described barrage adding method 500 farther includes step
S540, caches described dot matrix image.Exemplarily, step S540 field programmable gate array realizes.
Exemplarily, before step S510, described barrage adding method 500 farther includes step
S501 and step S503.
In step S501, detect whether to there is the display device being connected to barrage adding set.
In step S503, when there is described display device, obtain extension display from described display device
Identify data, and the expanded display recognition data acquired in storage, read for described signal source.
Exemplarily, before the described acquired expanded display recognition data of storage, step S503 enters one
Step includes: revise described expanded display recognition data.So, the extension display that signal source is read identifies
Data are modified expanded display recognition data.
Alternatively, before step S510, described barrage adding method 500 may further include: by
Barrage adding set generates and stores expanded display recognition data, reads for described signal source.This step
Not shown in FIG. 5.
Exemplarily, described barrage adding method 500 farther includes: generate blank screen according to blank screen signal
Image, is used for showing.
Exemplarily, described barrage adding method 500 farther includes: according to debugging signal output debugging
Image, is used for showing.
As described above, construct the structure required by this kind of barrage adding set to be apparent from.
The present invention is not for any certain programmed language.It is understood that, it is possible to use various programming languages realize
This present disclosure described, and the description above done language-specific is to disclose the present invention
Preferred forms.
In description mentioned herein, illustrate a large amount of detail.It is to be appreciated, however, that this
Bright embodiment can be put into practice in the case of not having these details.In some instances, the most in detail
Known method, structure and technology are carefully shown, in order to do not obscure the understanding of this description.
Similarly, it will be appreciated that in order to simplify the disclosure help to understand in each inventive aspect one or
Multiple, above in the description of the exemplary embodiment of the present invention, each feature of the present invention sometimes by
It is grouped into together in single embodiment, figure or descriptions thereof.But, should be by the disclosure
Method is construed to reflect an intention that i.e. the present invention for required protection requires that ratio is in each claim
The more feature of feature being expressly recited.More precisely, as the following claims reflect
Like that, inventive aspect is all features less than single embodiment disclosed above.Therefore, it then follows tool
Claims of body embodiment are thus expressly incorporated in this detailed description of the invention, and the most each right is wanted
Ask itself all as the independent embodiment of the present invention.
Those skilled in the art are appreciated that and can carry out the module in the device in embodiment certainly
Change adaptively and they are arranged in one or more equipment different from this embodiment.Permissible
Module in embodiment or unit are combined into a module or unit, and can put them in addition
Multiple submodules or subelement.Except at least some in such feature and/or process or unit is phase
Outside repelling mutually, can use any combination to this specification (include adjoint claim, summary and
Accompanying drawing) disclosed in all features and so disclosed any method or all processes of equipment or list
Unit is combined.Unless expressly stated otherwise, this specification (include adjoint claim, summary and
Accompanying drawing) disclosed in each feature can be carried out generation by providing identical, equivalent or the alternative features of similar purpose
Replace.
Although additionally, it will be appreciated by those of skill in the art that embodiments more described herein include other
Some feature included in embodiment rather than further feature, but the combination of the feature of different embodiment
Mean to be within the scope of the present invention and formed different embodiments.Such as, in following right
In claim, one of arbitrarily can mode using in any combination of embodiment required for protection.
The present invention will be described rather than limits the invention to it should be noted above-described embodiment, and
And those skilled in the art can design replacement enforcement without departing from the scope of the appended claims
Example.In the claims, any reference marks that should not will be located between bracket is configured to claim
Restriction.Word " comprises " and does not excludes the presence of the element or step not arranged in the claims.It is positioned at unit
Word "a" or "an" before part does not excludes the presence of multiple such element.The present invention can borrow
Help include the hardware of some different elements and realize by means of properly programmed computer.At row
If having lifted in the unit claim of equipment for drying, several in these devices can be by same firmly
Part item specifically embodies.Word first, second and third use do not indicate that any order.Can
It is title by these word explanations.
Claims (10)
1. a barrage adding set, including the barrage rendering module connected via Digital Logical Circuits and figure
As channel module, wherein,
Described barrage rendering module is used for receiving comment content and rendering, described comment content with life
Becoming dot matrix image, in described dot matrix image, described comment content represents by nontransparent pixel, institute's commentary
Part beyond opinion content represents by the pixel different from described nontransparent pixel；
Described image channel module, for receiving original image from signal source, connects from described barrage rendering module
Receive described dot matrix image, and substitute described original image by the described nontransparent pixel in described dot matrix image
The pixel of correspondence position, to generate the image including barrage.
2. barrage adding set as claimed in claim 1, it is characterised in that described image channel module
Farther include:
Buffer storage, for substituting described former with the described nontransparent pixel in described dot matrix image
Before the pixel of the correspondence position of beginning image, cache described dot matrix image.
3. barrage adding set as claimed in claim 1 or 2, it is characterised in that described barrage adds
Device farther includes:
, for detecting whether there is the display being connected to described barrage adding set in display device detector unit
Equipment；
, for when there is described display device, from described display in expanded display recognition data delivery unit
Equipment obtains expanded display recognition data, and the expanded display recognition data acquired in storage, for described
Signal source reads.
4. barrage adding set as claimed in claim 3, it is characterised in that described extension display identifies
Data transfer unit is further used for before the described acquired expanded display recognition data of storage, amendment
Described acquired expanded display recognition data.
5. barrage adding set as claimed in claim 3, it is characterised in that described barrage adding set
Farther include expanded display recognition data and force manifolding switch and expanded display recognition data signal generating unit,
Wherein,
Described expanded display recognition data force manifolding switch be used for selecting described display device detector unit and
Both described expanded display recognition data delivery units start simultaneously or select described extension display to identify
Data generating unit starts；
Described expanded display recognition data signal generating unit is used for generating and storing expanded display recognition data, uses
Read in described signal source.
6. barrage adding set as claimed in claim 1 or 2, it is characterised in that described barrage adds
Device farther includes blank screen unit, for exporting blank screen signal to described image channel module；
Described image channel module is further used for generating blank screen image according to described blank screen signal, is used for showing
Show.
7. barrage adding set as claimed in claim 1 or 2, it is characterised in that described barrage adds
Device farther includes debugging unit, for described image channel module output debugging signal；
Described image channel module is further used for, according to described debugging signal output debugging image, being used for showing
Show.
8. barrage adding set as claimed in claim 1 or 2, it is characterised in that described image path
Module farther includes:
First input interface, is used for receiving described dot matrix image；
Second input interface, for receiving described original image from described signal source；
Pixel processing unit, for for different from described nontransparent pixel described in described dot matrix image
Pixel, exports the respective pixel in described original image；For the nontransparent pixel in described dot matrix image,
Directly output, to include the image of barrage described in generation；And
First output interface, is used for including described in exporting the image of barrage.
9. barrage adding set as claimed in claim 1 or 2, it is characterised in that
Described image channel module farther includes enumerator and the second output interface,
Described enumerator is for detecting the resolution of described original image；
Described second output interface is for sending described resolution to described via described Digital Logical Circuits
Barrage rendering module；
Described barrage rendering module is further used for receiving described original image from described image channel module
Resolution, and according to described resolution, described comment content is rendered, to generate and described resolution
The dot matrix image that rate adapts.
10. a barrage adding method, including:
Receive comment content and described comment content rendered, to generate dot matrix image, at described point
In system of battle formations picture, described comment content represents by nontransparent pixel, the part beyond described comment content with
The pixel that described nontransparent pixel is different represents；
Original image is received from signal source；And
The picture of the correspondence position of described original image is substituted by the described nontransparent pixel in described dot matrix image
Element, to generate the image including barrage.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610225333.3A CN105898521A (en) | 2016-04-12 | 2016-04-12 | Bullet screen adding device and bullet screen adding method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610225333.3A CN105898521A (en) | 2016-04-12 | 2016-04-12 | Bullet screen adding device and bullet screen adding method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105898521A true CN105898521A (en) | 2016-08-24 |
Family
ID=57012303
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610225333.3A Pending CN105898521A (en) | 2016-04-12 | 2016-04-12 | Bullet screen adding device and bullet screen adding method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105898521A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106303725A (en) * | 2016-08-25 | 2017-01-04 | 暴风集团股份有限公司 | HOOK is utilized to realize the method and device of barrage in renderer |
| CN107135427A (en) * | 2017-03-28 | 2017-09-05 | 武汉斗鱼网络科技有限公司 | A kind of method and system for showing barrage information |
| WO2018161709A1 (en) * | 2017-03-06 | 2018-09-13 | 武汉斗鱼网络科技有限公司 | Method and device for rendering overlay comment |
| CN109218845A (en) * | 2017-07-01 | 2019-01-15 | 武汉斗鱼网络科技有限公司 | Optimize method, storage medium, electronic equipment and the system of barrage display effect |
| CN112866777A (en) * | 2019-11-27 | 2021-05-28 | 西安诺瓦星云科技股份有限公司 | Layer moving method and device, video processing equipment system and storage medium |
| WO2021175054A1 (en) * | 2020-03-06 | 2021-09-10 | Oppo广东移动通信有限公司 | Image data processing method, and related apparatus |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2015057896A (en) * | 2006-12-11 | 2015-03-26 | 株式会社ドワンゴ | Comment distribution system, terminal device, comment distribution method, and program |
| CN104935997A (en) * | 2015-06-01 | 2015-09-23 | 上海幻电信息科技有限公司 | Method and device for customizing high-level barrage for a viewer |
| CN105187891A (en) * | 2015-09-09 | 2015-12-23 | 上海微令信息科技有限公司 | Transparent-browser-based video comment screen display system and method and device with system |
| CN105338410A (en) * | 2014-07-07 | 2016-02-17 | 乐视网信息技术（北京）股份有限公司 | Method and device for displaying barrage of video |
-
2016
- 2016-04-12 CN CN201610225333.3A patent/CN105898521A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2015057896A (en) * | 2006-12-11 | 2015-03-26 | 株式会社ドワンゴ | Comment distribution system, terminal device, comment distribution method, and program |
| CN105338410A (en) * | 2014-07-07 | 2016-02-17 | 乐视网信息技术（北京）股份有限公司 | Method and device for displaying barrage of video |
| CN104935997A (en) * | 2015-06-01 | 2015-09-23 | 上海幻电信息科技有限公司 | Method and device for customizing high-level barrage for a viewer |
| CN105187891A (en) * | 2015-09-09 | 2015-12-23 | 上海微令信息科技有限公司 | Transparent-browser-based video comment screen display system and method and device with system |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106303725A (en) * | 2016-08-25 | 2017-01-04 | 暴风集团股份有限公司 | HOOK is utilized to realize the method and device of barrage in renderer |
| WO2018161709A1 (en) * | 2017-03-06 | 2018-09-13 | 武汉斗鱼网络科技有限公司 | Method and device for rendering overlay comment |
| CN107135427A (en) * | 2017-03-28 | 2017-09-05 | 武汉斗鱼网络科技有限公司 | A kind of method and system for showing barrage information |
| CN107135427B (en) * | 2017-03-28 | 2021-01-01 | 武汉斗鱼网络科技有限公司 | Method and system for displaying bullet screen information |
| CN109218845A (en) * | 2017-07-01 | 2019-01-15 | 武汉斗鱼网络科技有限公司 | Optimize method, storage medium, electronic equipment and the system of barrage display effect |
| CN109218845B (en) * | 2017-07-01 | 2020-09-04 | 武汉斗鱼网络科技有限公司 | Method, storage medium, electronic device and system for optimizing bullet screen display effect |
| CN112866777A (en) * | 2019-11-27 | 2021-05-28 | 西安诺瓦星云科技股份有限公司 | Layer moving method and device, video processing equipment system and storage medium |
| CN112866777B (en) * | 2019-11-27 | 2022-12-09 | 西安诺瓦星云科技股份有限公司 | Layer moving method and device, video processing equipment system and storage medium |
| WO2021175054A1 (en) * | 2020-03-06 | 2021-09-10 | Oppo广东移动通信有限公司 | Image data processing method, and related apparatus |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105898521A (en) | Bullet screen adding device and bullet screen adding method | |
| CN104917990B (en) | Video frame rate compensation is carried out by adjusting vertical blanking | |
| US9570036B2 (en) | Method and device for processing video image | |
| US10574937B2 (en) | Method for high-definition image processing, method for high-definition image playback and related apparatus and system | |
| CA2227257C (en) | 3d stereoscopic video display system | |
| US6816163B2 (en) | Updating image frames on a screen comprising memory | |
| KR102344545B1 (en) | Image processing apparatus and control method thereof | |
| US20100302352A1 (en) | Video data signal, system and method for controlling shutter glasses | |
| US10291814B2 (en) | Transmission of encrypted image data | |
| KR102505197B1 (en) | Display device and driving method thereof | |
| US20160255315A1 (en) | Digital movie projection system and method | |
| US20220345769A1 (en) | Image data processing device and method, and display device | |
| GB2538797B (en) | Managing display data | |
| CN103747191A (en) | Network interaction high-definition character superimposition system | |
| CN204650502U (en) | Image bridging device and image output system | |
| CN113099212A (en) | 3D display method, device, computer equipment and storage medium | |
| JP2019047916A (en) | Game machine | |
| US9865226B2 (en) | Image color correction for electronic displays | |
| CN207530948U (en) | A kind of Video Character Superpose system | |
| CN105472467A (en) | Interface display method and system | |
| CN203675196U (en) | Network control 3G-SDI high-definition characters superimposer | |
| CN114245108B (en) | DisplayPort test system supporting custom extension | |
| TW201408042A (en) | Stereo image output apparatus and associated stereo image output method | |
| CN105185350A (en) | Fractal scanning display control system supporting gamma correction | |
| CN105100670B (en) | Implement the method and its electronic device of mobile high definition transmission technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160824 |
|
| RJ01 | Rejection of invention patent application after publication |