CN109309878A - The generation method and device of barrage - Google Patents
The generation method and device of barrage Download PDFInfo
- Publication number
- CN109309878A CN109309878A CN201710630190.9A CN201710630190A CN109309878A CN 109309878 A CN109309878 A CN 109309878A CN 201710630190 A CN201710630190 A CN 201710630190A CN 109309878 A CN109309878 A CN 109309878A
- Authority
- CN
- China
- Prior art keywords
- gesture
- barrage
- user
- expression
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention is suitable for technical field of television sets, provides the generation method and device of barrage, comprising: the gesture and expression of user are identified by Gesture Recognition Algorithm or Expression Recognition algorithm；User instruction is determined according to the gesture of user and expression；Barrage content corresponding with the user instruction is searched in preset barrage library；So that user does not need keyboard and can input barrage content, the application range of barrage is expanded, improves the convenience for generating barrage.
Description
Technical field
The invention belongs to technical field of television sets more particularly to the generation methods and device of barrage.
Background technique
With the rapid development of Internet technology, the information sharing between Internet user becomes more and more closely, with this
The mode that information is shared simultaneously is also more and more interesting, wherein barrage is exactly a kind of information sharing very with interest
Mode.User in networking one section of video of viewing or live streaming, can input oneself think word or expression as barrage content,
If subsequent other users also watch this section of video, so that it may see the barrage content.
However it is current, barrage mainly still applies the terminal for having text input function in computer or mobile phone etc., and due to
Television set lacks the hardware device for text or expression input, refers to typically only by some simple controls of remote controler input
It enables, therefore barrage function difficult to use.In addition, active user needs to input in corresponding barrage by keyboard type equipment
Hold, therefore is not very flexibly, when inputting barrage content, to need to disperse a part of attention and arrive when user is using barrage function
On keyboard, the viewing of normal video is influenced.
It can be seen that current barrage function, which is difficult to input in the poor equipment of informational function in television set etc., to be made
With there are smaller scope of application, use inflexible problem.
Summary of the invention
In view of this, the embodiment of the invention provides the generation method of barrage and device, to solve the generation of existing barrage
Problem poor for applicability existing for method.
The first aspect of the embodiment of the present invention provides a kind of generation method of barrage, comprising: identify user gesture and/
Or the expression of the user, and user instruction is determined according to the gesture and/or the expression；It is searched in preset barrage library
Barrage content corresponding with the user instruction.
The second aspect of the embodiment of the present invention provides a kind of generating means of barrage, comprising: identification module, for identification
The gesture of user and/or the expression of the user, and user instruction is determined according to the gesture and/or the expression；Search for mould
Block, for searching for barrage content corresponding with the user instruction in preset barrage library.
The third aspect of the embodiment of the present invention provides a kind of generating means of barrage, comprising: memory, processor and
Store the computer program that can be run in the memory and on the processor, which is characterized in that the processor is held
It is realized when the row computer program such as the step of any one of claim 1 to 5 the method.
The fourth aspect of the embodiment of the present invention provides a kind of computer readable storage medium, the computer-readable storage
Media storage has computer program, which is characterized in that when the computer program is executed by processor realize as claim 1 to
The step of any one of 5 the method.
Existing beneficial effect is the embodiment of the present invention compared with prior art: being known by Gesture Recognition Algorithm or expression
The gesture and expression of other algorithm identification user；User instruction is determined according to the gesture of user and expression；In preset barrage library
Search for barrage content corresponding with the user instruction；So that user does not need keyboard and can input barrage content, expand
The application range of barrage improves the convenience for generating barrage.
Detailed description of the invention
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to embodiment or description of the prior art
Needed in attached drawing be briefly described, it should be apparent that, the accompanying drawings in the following description is only of the invention some
Embodiment for those of ordinary skill in the art without any creative labor, can also be according to these
Attached drawing obtains other attached drawings.
Fig. 1 is the implementation flow chart of the generation method of barrage provided in an embodiment of the present invention；
Fig. 2 is the specific implementation flow chart of the generation method S101 of barrage provided in an embodiment of the present invention；
Fig. 3 is the correspondence diagram of barrage content and user instruction provided in an embodiment of the present invention；
Fig. 4 is the implementation flow chart of barrage content selection provided in an embodiment of the present invention；
Fig. 5 is the structural block diagram of the generating means of barrage provided in an embodiment of the present invention；
Fig. 6 is the schematic diagram of the generating means of barrage provided in an embodiment of the present invention.
Specific embodiment
In being described below, for illustration and not for limitation, the tool of such as particular system structure, technology etc is proposed
Body details, to understand thoroughly the embodiment of the present invention.However, it will be clear to one skilled in the art that there is no these specific
The present invention also may be implemented in the other embodiments of details.In other situations, it omits to well-known system, device, electricity
The detailed description of road and method, in case unnecessary details interferes description of the invention.
In order to illustrate technical solutions according to the invention, the following is a description of specific embodiments.
Fig. 1 shows the implementation process of the generation method of barrage provided in an embodiment of the present invention, and details are as follows:
In S101, the gesture of user and/or the expression of the user are identified, and according to the gesture and/or the table
Feelings determine user instruction.
In embodiments of the present invention, it is different from traditional method by keyboard input text to generate barrage, using hand
The method of gesture identification and Expression Recognition identifies the gesture of user and the corresponding user instruction of expression.
In embodiments of the present invention, user instruction refers to the instruction that user issues for generating different barrages.Such as user
Thumb is stretched out, can indicate the user instruction for generating " thumbing up ".
It is to be appreciated that method involved in the embodiment of the present invention can be using in a television set.Due to general TV
Machine lacks the keypad function of mobile phone or computer, so a large amount of text information can not be inputted, although there is some TVs to have key
Disk function, but the speed for generally requiring that corresponding letter could be selected by the keyboard of remote control control television set, therefore inputting
Degree also can it is very slow and extremely not aspect.It can be seen that the method for current text input barrage information is not suitable on a television set
It uses.
It is to be appreciated that the important references of the gesture and expression of user as reaction user mood and impression, it can be by
It is introduced into the embodiment of the present invention, as two reference frames for generating barrage content.Optionally, known by Gesture Recognition Algorithm
Not Chu user the corresponding user instruction of gesture, the corresponding user instruction of expression of user is identified by Expression Recognition algorithm.
After getting user instruction, so that it may determine the particular content of barrage according to preset corresponding relationship.It is to be appreciated that with
In the corresponding relationship that the gesture identification database of Gesture Recognition Algorithm identification includes gesture and user instruction, pass through gesture identification number
The classifier of gesture identification can be trained according to library, to realize gesture classification.Expression for the identification of Expression Recognition algorithm is known
Other database includes the corresponding relationship of expression and user instruction, and point of Expression Recognition can be trained by Expression Recognition database
Class device, to realize expression classification.
Optionally, in embodiments of the present invention, it can be used alone the gesture of Gesture Recognition Algorithm identification user, with determination
User instruction.
Optionally, in embodiments of the present invention, it can be used alone the expression of Expression Recognition algorithm identification user, with determination
User instruction.
Optionally, in embodiments of the present invention, Gesture Recognition Algorithm and Expression Recognition algorithm can be used cooperatively, with
Determine user instruction.It is to be appreciated that more practical feelings can be coped in conjunction with Gesture Recognition Algorithm and Expression Recognition algorithm
In addition more, barrage content more abundant also can be generated in condition, be conducive to improve user's impression.
Fig. 2 shows the specific implementation flows of the generation method S101 of barrage provided in an embodiment of the present invention, and details are as follows:
In S201, whether detection user makes gesture.
Optionally, in embodiments of the present invention, the user instruction of user's sending is determined by Gesture Recognition Algorithm first, then
The user instruction that user issues is determined by Expression Recognition algorithm.But there are a kind of possibility, i.e., user and non-selected pass through hand
Gesture issues user instruction, but only issues user instruction by expression, therefore calculate the time by saving and avoid based on waste
The reason of calculating resource, in embodiments of the present invention, whether detection user is made that gesture first, and is not to call directly gesture
Gesture identification classifier in recognizer analyzes the gesture of user.
It is to be appreciated that whether detection user makes gesture, it is only necessary to detect user's arm in predeterminable area or finger
Whether displacement is greater than preset threshold value, if the displacement of user's arm or finger is greater than preset threshold value in predeterminable area, determines
User makes gesture；If the displacement of user's arm or finger is not more than preset threshold value in predeterminable area, determine that user does not have
Make gesture.It can be seen that not needing specifically containing for analysis user gesture during whether detection user makes gesture
Justice, therefore difficulty in computation is smaller than gesture identification.If user does not make any gesture, be conducive to rapidly carry out subsequent
Step.
In S202, if detecting that user makes gesture in preset first time period, pass through Gesture Recognition Algorithm
It identifies the gesture, and user instruction is determined according to the gesture.
It is to be appreciated that if the displacement of user's arm or finger is greater than preset threshold value in predeterminable area, at this
In inventive embodiments, determines that user is made that gesture, need to be analyzed by gesture of the Gesture Recognition Algorithm to user with true
Determine user instruction.
Optionally, it in embodiments of the present invention in order to preferably identify gesture and expression, is used using depth camera
The acquisition of family gesture and expression, it is possible to understand that ground, depth camera can acquire 3-dimensional image.
It is alternatively possible to carry out gesture identification based on maximum likelihood distance.Specifically, it is adopted first to by depth camera
Images of gestures in the predeterminable area of collection carries out binary conversion treatment, then carries out contour feature extraction to the images of gestures, obtains
Contour feature point point, contour feature point include the location point for referring to root and finger tip.It is finally based on preset gesture identification database, is led to
The Hausdorff distance for crossing maximum-likelihood criterion identifies gesture.
It is to be appreciated that including the corresponding relationship of gesture and gesture meaning in gesture identification database, of the invention real
It applies in example, gesture meaning is exactly user instruction, therefore by the analysis to user gesture, the user that available user sends refers to
It enables, and determines barrage content according to user instructions.
Optionally, in embodiments of the present invention, depth camera can also be acquired by common gesture identification software
User gesture identified.
Optionally, in embodiments of the present invention, refer in the user for identifying that user gesture represents by Gesture Recognition Algorithm
After order, it can also continue to carry out user instruction of the Expression Recognition to determine the representative of user's expression.
Although it is to be appreciated that the displacement of user's arm or finger is greater than preset threshold value in predeterminable area, simultaneously
User is not represented and is made that gesture present in gesture identification database, therefore exists can not identify use in embodiments of the present invention
The case where user instruction that family gesture represents.
In S203, if not detecting in preset first time period, user makes gesture, or is detecting use
Family is made in the second time period after gesture, does not identify the corresponding user instruction of the gesture, then passes through expression and know
The expression of other algorithm identification user, and user instruction is determined according to the gesture.
Optionally, start to detect in the first time period after whether user makes gesture in system, if do not detected
User makes gesture, then directly carries out Expression Recognition without gesture identification, can be to avoid the waste unnecessary time in hand
In gesture identification.
Optionally, in the second time period after detecting that user makes gesture, if identifying the gesture not yet
Corresponding user instruction then no longer carries out gesture identification, then carries out Expression Recognition.
It is to be appreciated that by above-mentioned two condition for executing Expression Recognition it follows that in embodiments of the present invention, from
Whether detection user, which makes gesture, starts, and longest adds second time period by preset first time period, is bound to start to hold
Row Expression Recognition algorithm.
Optionally, in embodiments of the present invention, the facial image acquired by depth camera is pre-processed first.
Optionally, pretreatment includes that the facial image is normalized, by the size of the facial image, brightness and color pair
Preset parameter is adjusted to than degree.It is then based on preset human face expression tranining database, by supporting vector machine model to the people
Face image is identified.It is to be appreciated that in embodiments of the present invention, the face figure that will be identified by supporting vector machine model
As corresponding expression parameter is as user instruction.For example, identifying that the corresponding expression of the facial image of user is " laugh ", then exist
In the embodiment of the present invention, which is interpreted as to the user instruction of transmitting " laugh " barrage.
In S102, barrage content corresponding with the user instruction is searched in preset barrage library.
In embodiments of the present invention, barrage content refers to text, expression or the animation that can really present on television screen
Etc. contents.
It is to be appreciated that in embodiments of the present invention, needing using at least three databases, first is known for gesture
The gesture tranining database of other algorithm；Second is expression tranining database for Expression Recognition algorithm；Third is to be used for
The barrage library of the mapping relations of user instruction and barrage content is described.
It is to be appreciated that above three data are independent from each other, therefore pass through the identification to gesture and expression, Zhi Nengshi
Not Chu gesture user instruction corresponding with expression, and be unable to get the barrage content really shown on television screen.
Therefore it needs barrage library as an intermediary, gesture and expression is got up with barrage content link.
It is to be appreciated that the embodiment of the present invention may search for out barrage content corresponding with user instruction by barrage library.
In embodiments of the present invention, as shown in figure 3, barrage library includes barrage content and user corresponding with barrage content
Instruction.It is to be appreciated that the corresponding a kind of barrage classification of a user instruction, and a barrage classification may correspond in a barrage
Appearance or multiple barrage contents.
Further, store barrage information, the barrage information include the barrage content and with the barrage content pair
The video time answered, the video time are the time value of video playing progress when the barrage content is shown in video.
In embodiments of the present invention, the final step that barrage generates is to combine a barrage content with a video time
It rises as barrage information and stores, so that the video is when playing next time, the barrage is shown when being played to the video time
Content.
It is to be appreciated that being mentioned in example above, identifying the gesture of user by Gesture Recognition Algorithm and/or passing through table
First step of the expression of feelings recognizer identification user is: whether detection user makes gesture.However in real life,
In order to make television set when user is not desired to using barrage function, different straight row generates the relevant calculation of barrage information, so electric
It is in barrage unactivated state, in this state, user in normal conditions depending on machine although can sell in predeterminable area
Gesture, although general gesture, by the camera detection and identification of television set, but television set will not generate corresponding barrage
Content will not store barrage information.
Further, based on the above reasons, the embodiment of the present invention provides the step of an activation barrage function for television set
Suddenly.
Optionally, the gesture of preset areas intra domain user is detected, if the gesture is preset activation gesture, activates barrage function
Energy.
It is to be appreciated that the predeterminable area refers to the region that camera takes, user is only in this predeterminable area
The gesture and expression inside made, relevant recognizer could identify gesture or expression.
It is to be appreciated that being only activation hand in the gesture for identifying preset areas intra domain user by Gesture Recognition Algorithm
Gesture can just activate barrage function, hereafter carry out the operation that normal barrage information is generated and stored.
It is to be appreciated that activation barrage function can also be completed by other modes such as remote control controls, however it is not limited to
Activation gesture is made in predeterminable area.
Further, the image in the predeterminable area is shown, to prompt user to make gesture in the predeterminable area
Movement.
Since the computing capability of general television set CPU is usually weaker, interference should be provided for Expression Recognition algorithm
Lesser images to be recognized.As described above, predeterminable area is the region that camera takes, it is assumed that the average length of face
Degree is L, mean breadth W, then the region of a 2L*4W is delineated in front of camera as predeterminable area.User is only at this
The gesture and expression made in a predeterminable area, relevant recognizer just can be carried out identification.
It, can when user is when watching video or live streaming it is to be appreciated that in order to make user make gesture in predeterminable area
To pop up a wicket, which can show the image in predeterminable area, and such user can be readily apparent that certainly
Whether oneself makes gesture in predeterminable area, to adjust the position of do-it-yourself gesture at any time, can also check the gesture of oneself
It whether consistent with the original intention of oneself acts.
As described above, a user instruction may correspond to multiple barrage contents in barrage library, therefore user can be with
Barrage content is further selected by modes such as remote control controls.
Fig. 4 shows the implementation process of barrage content selection provided in an embodiment of the present invention, and details are as follows:
In S401, all candidate barrage contents for meeting user instruction in preset barrage library are shown.
Optionally, if it is a barrage content that a user instruction is corresponding, only one candidate barrage content,
In the embodiment of the present invention, the barrage content can be shown, so that user determines to give up or retain the barrage content；It can not also show
Show the barrage content, by the barrage content directly as the data of subsequent calculating.
Optionally, if it is multiple a barrage contents that a user instruction is corresponding, there are multiple candidate barrage contents,
In the embodiment of the present invention, all candidate barrage contents can be shown, to be supplied to, user is abundant and complete options；It can also be with
According to historical data, display portion candidate's barrage content, these shown barrage contents are that user once selected, and was chosen
Select the barrage content that number is greater than preset times threshold value.
In S402, selection of the user to the candidate barrage content is received, as final barrage content.
It is to be appreciated that through the embodiment of the present invention, user can control the generation of barrage, this hair by gesture and expression
Method involved in bright embodiment can be used on all terminal devices with camera, therefore strong applicability.User
When using this method, do not need to dig-in keyboard, thus use it is very convenient.
Corresponding to application upgrade method described in foregoing embodiments, Fig. 5 shows barrage provided in an embodiment of the present invention
The structural block diagram of generating means, for ease of description, only parts related to embodiments of the present invention are shown.
Referring to Fig. 5, which includes:
Identification module 501, identifies the gesture of user and/or the expression of the user, and according to the gesture and/or described
Expression determines user instruction；
Search module 502, for searching for barrage content corresponding with the user instruction in preset barrage library；
Optionally, described device further include:
Detection module, for detecting and identifying the gesture of preset areas intra domain user.
Active module activates barrage function if being preset activation gesture for the gesture.
First display module, for showing the image in the predeterminable area, to prompt user in the predeterminable area
Make gesture motion.
Memory module, for storing barrage information, the barrage information include the barrage content and in the barrage
Hold corresponding video time, the video time is the time value of video playing progress when the barrage content is shown in video.
Further, the identification module 501, comprising:
Gestures detection submodule, for detecting whether user makes gesture；
First implementation sub-module, if passing through hand for detecting that user makes gesture in preset first time period
Gesture recognizer identifies the gesture, and determines user instruction according to the gesture；
Second implementation sub-module, if for not detecting that user makes gesture in preset first time period, or
In the second time period after detecting that user makes gesture, the corresponding user instruction of the gesture is not identified, then
The expression of user is identified by Expression Recognition algorithm, and user instruction is determined according to the expression.
Optionally, described device further include:
Second display module, for showing all candidate barrage contents for meeting user instruction in preset barrage library；
Selecting module, for receiving user to the selection information of the candidate barrage content, and according to the selection information
Determine final barrage content.
Fig. 6 is the schematic diagram of the generating means for the barrage that one embodiment of the invention provides.As shown in fig. 6, the embodiment
The generating means of barrage include: processor 60, memory 61 and are stored in the memory 61 and can be in the processor
The computer program 62 run on 60, such as the generation program of barrage.When the processor 60 executes the computer program 62
Realize the step in the generation method embodiment of above-mentioned each barrage, such as step S101 to S102 shown in FIG. 1.Alternatively, institute
The function that each module/unit in above-mentioned each Installation practice is realized when processor 60 executes the computer program 62 is stated, such as
The function of module 501 to 502 shown in Fig. 6.
Illustratively, the computer program 62 can be divided into one or more module/units, it is one or
Multiple module/units are stored in the memory 61, and are executed by the processor 60, to complete the present invention.Described one
A or multiple module/units can be the series of computation machine program instruction section that can complete specific function, which is used for
Implementation procedure of the computer program 62 in the generating means 6 of the barrage is described.
The generating means 6 of the barrage can be the meter such as desktop PC, notebook, palm PC and cloud server
Calculate equipment.Generating means/device of the barrage may include, but be not limited only to, processor 60, memory 61.Art technology
Personnel are appreciated that Fig. 6 is only the example of the generating means 6 of barrage, do not constitute the restriction to the generating means 6 of barrage,
It may include than illustrating more or fewer components perhaps combining certain components or different components, such as the barrage
Generating means can also include input-output equipment, network access equipment, bus etc..
Alleged processor 60 can be central processing unit (Central Processing Unit, CPU), can also be
Other general processors, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit
(Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field-
Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic,
Discrete hardware components etc..General processor can be microprocessor or the processor is also possible to any conventional processor
Deng.
The memory 61 can be the internal storage unit of the generating means of the barrage, such as the generating means of barrage
6 hard disk or memory.The memory 61 is also possible to the External memory equipment of generating means/device 6 of the barrage, such as
The plug-in type hard disk being equipped on generating means/device 6 of the barrage, intelligent memory card (Smart Media Card, SMC),
Secure digital (Secure Digital, SD) card, flash card (Flash Card) etc..Further, the memory 61 may be used also
With the internal storage unit of generating means/device 6 both including the barrage or including External memory equipment.The memory 61
Other programs and data needed for generating means/device for storing the computer program and the barrage.It is described to deposit
Reservoir 61 can be also used for temporarily storing the data that has exported or will export.Those skilled in the art can be clear
Recognize to Chu, for convenience of description and succinctly, is only carried out with the division of above-mentioned each functional unit, module for example, real
In the application of border, it can according to need and complete above-mentioned function distribution by different functional units, module, i.e., by described device
Internal structure is divided into different functional unit or module, to complete all or part of the functions described above.In embodiment
Each functional unit, module can integrate in one processing unit, be also possible to each unit and physically exist alone, can also be with
Two or more units are integrated in one unit, and above-mentioned integrated unit both can take the form of hardware realization,
It can realize in the form of software functional units.In addition, the specific name of each functional unit, module is also only to facilitate phase
It mutually distinguishes, the protection scope being not intended to limit this application.The specific work process of unit in above system, module, Ke Yican
The corresponding process in embodiment of the method is stated before examination, and details are not described herein.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, is not described in detail or remembers in some embodiment
The part of load may refer to the associated description of other embodiments.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure
Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician
Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed
The scope of the present invention.
In embodiment provided by the present invention, it should be understood that disclosed device/device and method can pass through
Other modes are realized.For example, device/Installation practice described above is only schematical, for example, the module or
The division of unit, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units
Or component can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, institute
Display or the mutual coupling or direct-coupling or communication connection discussed can be through some interfaces, device or unit
INDIRECT COUPLING or communication connection can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated module/unit be realized in the form of SFU software functional unit and as independent product sale or
In use, can store in a computer readable storage medium.Based on this understanding, the present invention realizes above-mentioned implementation
All or part of the process in example method, can also instruct relevant hardware to complete, the meter by computer program
Calculation machine program can be stored in a computer readable storage medium, the computer program when being executed by processor, it can be achieved that on
The step of stating each embodiment of the method.Wherein, the computer program includes computer program code, the computer program
Code can be source code form, object identification code form, executable file or certain intermediate forms etc..Computer-readable Jie
Matter may include: can carry the computer program code any entity or device, recording medium, USB flash disk, mobile hard disk,
Magnetic disk, CD, computer storage, read-only memory (ROM, Read-Only Memory), random access memory (RAM,
Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It should be noted that described
The content that computer-readable medium includes can carry out increasing appropriate according to the requirement made laws in jurisdiction with patent practice
Subtract, such as does not include electric carrier signal and electricity according to legislation and patent practice, computer-readable medium in certain jurisdictions
Believe signal.
Embodiment described above is merely illustrative of the technical solution of the present invention, rather than its limitations；Although referring to aforementioned reality
Applying example, invention is explained in detail, those skilled in the art should understand that: it still can be to aforementioned each
Technical solution documented by embodiment is modified or equivalent replacement of some of the technical features；And these are modified
Or replacement, the spirit and scope for technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution should all
It is included within protection scope of the present invention.
Claims (10)
1. a kind of generation method of barrage characterized by comprising
It identifies the gesture of user and/or the expression of the user, and determines that user refers to according to the gesture and/or the expression
It enables；
Barrage content corresponding with the user instruction is searched in preset barrage library.
2. the generation method of barrage as described in claim 1, which is characterized in that gesture and/or institute in the identification user
State the expression of user, and before determining user instruction according to the gesture and/or the expression, further includes:
Detect and identify the gesture of preset areas intra domain user；
If the gesture is preset activation gesture, barrage function is activated.
3. the generation method of barrage as described in claim 1, which is characterized in that search and the institute in preset barrage library
After stating the corresponding barrage content of user instruction, further includes:
Barrage information is stored, the barrage information includes the barrage content and video time corresponding with the barrage content,
The video time is the time value of video playing progress when the barrage content is shown in video.
4. the generation method of barrage as described in claim 1, which is characterized in that the identification gesture of user and/or described
The expression of user, and determine that user instruction includes: according to the gesture and/or the expression
Whether detection user makes gesture；
If detecting that user makes gesture in preset first time period, which is identified by Gesture Recognition Algorithm, and
User instruction is determined according to the gesture；
If not detecting in preset first time period, user makes gesture, or after detecting that user makes gesture
In second time period, the corresponding user instruction of the gesture is not identified, then user is identified by Expression Recognition algorithm
Expression, and user instruction is determined according to the expression.
5. the generation method of barrage as claimed in claim 3, which is characterized in that before the storage barrage information, also wrap
It includes:
Show all candidate barrage contents for meeting the user instruction in preset barrage library；
User is received to the selection information of the candidate barrage content, and is determined in final barrage according to the selection information
Hold.
6. a kind of generating means of barrage characterized by comprising
Identification module, the gesture of user and/or the expression of the user for identification, and according to the gesture and/or the table
Feelings determine user instruction；
Search module, for searching for barrage content corresponding with the user instruction in preset barrage library.
7. the generating means of barrage as claimed in claim 6, which is characterized in that further include:
Detection module, for detecting and identifying the gesture of preset areas intra domain user；
Active module activates barrage function if being preset activation gesture for the gesture.
8. the generating means of barrage as claimed in claim 7, which is characterized in that the identification module includes:
Gestures detection submodule, for detecting whether user makes gesture；
First implementation sub-module, if being known for detecting that user makes gesture in preset first time period by gesture
Other algorithm identifies the gesture, and determines user instruction according to the gesture；
Second implementation sub-module, if for not detecting that user makes gesture in preset first time period, or examining
It measures in the second time period after user makes gesture, does not identify the corresponding user instruction of the gesture, then pass through
Expression Recognition algorithm identifies the expression of user, and determines user instruction according to the expression.
9. a kind of generating means of barrage, including memory, processor and storage are in the memory and can be at the place
The computer program run on reason device, which is characterized in that realized when the processor executes the computer program as right is wanted
The step of seeking any one of 1 to 5 the method.
10. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, and feature exists
In when the computer program is executed by processor the step of any one of such as claim 1 to 5 of realization the method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710630190.9A CN109309878A (en) | 2017-07-28 | 2017-07-28 | The generation method and device of barrage |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710630190.9A CN109309878A (en) | 2017-07-28 | 2017-07-28 | The generation method and device of barrage |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109309878A true CN109309878A (en) | 2019-02-05 |
Family
ID=65205054
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710630190.9A Pending CN109309878A (en) | 2017-07-28 | 2017-07-28 | The generation method and device of barrage |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109309878A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109951742A (en) * | 2019-03-05 | 2019-06-28 | 浙江强脑科技有限公司 | Barrage sending method, terminal and computer readable storage medium |
| CN110519617A (en) * | 2019-07-18 | 2019-11-29 | 平安科技（深圳）有限公司 | Video comments processing method, device, computer equipment and storage medium |
| CN110636377A (en) * | 2019-09-20 | 2019-12-31 | 北京达佳互联信息技术有限公司 | Video processing method, device, storage medium, terminal and server |
| CN110740387A (en) * | 2019-10-30 | 2020-01-31 | 深圳Tcl数字技术有限公司 | bullet screen editing method, intelligent terminal and storage medium |
| CN111459396A (en) * | 2020-03-30 | 2020-07-28 | 北京小唱科技有限公司 | Playing method, device and system based on intelligent terminal |
| CN112118491A (en) * | 2020-09-25 | 2020-12-22 | 深圳创维－Rgb电子有限公司 | Bullet screen generation method and device and computer readable storage medium |
| CN112565824A (en) * | 2020-12-03 | 2021-03-26 | 腾讯科技（深圳）有限公司 | Method, device, terminal and storage medium for generating bullet screen |
| CN112655177A (en) * | 2018-06-27 | 2021-04-13 | 脸谱公司 | Asynchronous co-viewing |
| CN112667081A (en) * | 2020-12-28 | 2021-04-16 | 北京大米科技有限公司 | Bullet screen display method and device, storage medium and terminal |
| CN113038280A (en) * | 2019-12-09 | 2021-06-25 | 上海幻电信息科技有限公司 | Video interaction method and device and storage medium |
| CN114786057A (en) * | 2022-03-29 | 2022-07-22 | 广州埋堆堆科技有限公司 | Video bullet screen generation system based on deep learning and expression package data set |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101853561A (en) * | 2009-04-03 | 2010-10-06 | 玴荣科技股份有限公司 | Gesture-controlled remote control system |
| CN101853562A (en) * | 2009-04-03 | 2010-10-06 | 玴荣科技股份有限公司 | Method for controlling gesture-controlled remote control unit |
| CN102595212A (en) * | 2010-12-16 | 2012-07-18 | 微软公司 | Simulated group interaction with multimedia content |
| CN104244101A (en) * | 2013-06-21 | 2014-12-24 | 三星电子（中国）研发中心 | Method and device for commenting multimedia content |
| CN104750387A (en) * | 2015-03-24 | 2015-07-01 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN106303634A (en) * | 2016-10-10 | 2017-01-04 | 武汉斗鱼网络科技有限公司 | A kind of TV equipment barrage sends system and method |
-
2017
- 2017-07-28 CN CN201710630190.9A patent/CN109309878A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101853561A (en) * | 2009-04-03 | 2010-10-06 | 玴荣科技股份有限公司 | Gesture-controlled remote control system |
| CN101853562A (en) * | 2009-04-03 | 2010-10-06 | 玴荣科技股份有限公司 | Method for controlling gesture-controlled remote control unit |
| CN102595212A (en) * | 2010-12-16 | 2012-07-18 | 微软公司 | Simulated group interaction with multimedia content |
| CN104244101A (en) * | 2013-06-21 | 2014-12-24 | 三星电子（中国）研发中心 | Method and device for commenting multimedia content |
| CN104750387A (en) * | 2015-03-24 | 2015-07-01 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN106303634A (en) * | 2016-10-10 | 2017-01-04 | 武汉斗鱼网络科技有限公司 | A kind of TV equipment barrage sends system and method |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112655177A (en) * | 2018-06-27 | 2021-04-13 | 脸谱公司 | Asynchronous co-viewing |
| CN109951742A (en) * | 2019-03-05 | 2019-06-28 | 浙江强脑科技有限公司 | Barrage sending method, terminal and computer readable storage medium |
| CN110519617A (en) * | 2019-07-18 | 2019-11-29 | 平安科技（深圳）有限公司 | Video comments processing method, device, computer equipment and storage medium |
| CN110636377A (en) * | 2019-09-20 | 2019-12-31 | 北京达佳互联信息技术有限公司 | Video processing method, device, storage medium, terminal and server |
| CN110740387A (en) * | 2019-10-30 | 2020-01-31 | 深圳Tcl数字技术有限公司 | bullet screen editing method, intelligent terminal and storage medium |
| CN113038280A (en) * | 2019-12-09 | 2021-06-25 | 上海幻电信息科技有限公司 | Video interaction method and device and storage medium |
| CN111459396A (en) * | 2020-03-30 | 2020-07-28 | 北京小唱科技有限公司 | Playing method, device and system based on intelligent terminal |
| CN111459396B (en) * | 2020-03-30 | 2021-06-22 | 北京小唱科技有限公司 | Playing method, device and system based on intelligent terminal |
| CN112118491A (en) * | 2020-09-25 | 2020-12-22 | 深圳创维－Rgb电子有限公司 | Bullet screen generation method and device and computer readable storage medium |
| CN112565824A (en) * | 2020-12-03 | 2021-03-26 | 腾讯科技（深圳）有限公司 | Method, device, terminal and storage medium for generating bullet screen |
| CN112667081A (en) * | 2020-12-28 | 2021-04-16 | 北京大米科技有限公司 | Bullet screen display method and device, storage medium and terminal |
| CN114786057A (en) * | 2022-03-29 | 2022-07-22 | 广州埋堆堆科技有限公司 | Video bullet screen generation system based on deep learning and expression package data set |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109309878A (en) | The generation method and device of barrage | |
| US20180088677A1 (en) | Performing operations based on gestures | |
| CN104798104B (en) | The gesture of video flowing is pre-processed using marked region | |
| CN110503124A (en) | Vision like numeral image is identified based on the perceptual property that user selects using based on deep neural network model | |
| CN111709470B (en) | Image generation method, device, equipment and medium | |
| CN109816441A (en) | Tactful method for pushing, system and relevant apparatus | |
| JP7342062B2 (en) | Image processing methods, devices, electronic devices and storage media | |
| CN111259671B (en) | Semantic description processing method, device and equipment for text entity | |
| Huang et al. | RGB-D salient object detection by a CNN with multiple layers fusion | |
| CN109215037A (en) | Destination image partition method, device and terminal device | |
| CN109190654A (en) | The training method and device of human face recognition model | |
| CN111400473A (en) | Method and device for training intention recognition model, storage medium and electronic equipment | |
| CN110070551A (en) | Rendering method, device and the electronic equipment of video image | |
| CN108965981A (en) | Video broadcasting method, device, storage medium and electronic equipment | |
| CN111539897A (en) | Method and apparatus for generating image conversion model | |
| CN108038246A (en) | For generating the method and device of visualization view | |
| US20210150243A1 (en) | Efficient image sharing | |
| CN109934631A (en) | Question and answer information processing method, device and computer equipment | |
| CN116229188B (en) | Image processing display method, classification model generation method and equipment thereof | |
| CN108985215A (en) | A kind of image processing method, picture processing unit and terminal device | |
| CN109829033A (en) | Method for exhibiting data and terminal device | |
| CN110069996A (en) | Headwork recognition methods, device and electronic equipment | |
| CN110069126A (en) | The control method and device of virtual objects | |
| CN109492249A (en) | Rapid generation, device and the terminal device of design drawing | |
| CN108932704A (en) | Image processing method, picture processing unit and terminal device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190205 |
|
| RJ01 | Rejection of invention patent application after publication |