CN106454481B - A kind of method and device of live broadcast of mobile terminal interaction - Google Patents
A kind of method and device of live broadcast of mobile terminal interaction Download PDFInfo
- Publication number
- CN106454481B CN106454481B CN201610878194.4A CN201610878194A CN106454481B CN 106454481 B CN106454481 B CN 106454481B CN 201610878194 A CN201610878194 A CN 201610878194A CN 106454481 B CN106454481 B CN 106454481B
- Authority
- CN
- China
- Prior art keywords
- human body
- attribute
- interaction
- human
- face
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
- H04L65/611—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for multicast or broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44222—Analytics of user selections, e.g. selection of programs or purchase activity
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/488—Data services, e.g. news ticker
- H04N21/4882—Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Databases & Information Systems (AREA)
- Social Psychology (AREA)
- Computer Networks & Wireless Communication (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention discloses a kind of method and devices of live broadcast of mobile terminal interaction, for solving in the prior art, spectators user carries out in interactive process with main broadcaster on mobile terminals, due to mobile terminal can display area it is limited, interactive interface when carrying out interactive operation will necessarily shelter from current live picture, influence spectators' viewing experience, and spectators user carries out interactive operation and need to complete multiple operations can successfully carrying out interacting with main broadcaster, the technical issues of process is cumbersome, inefficiency.The method comprise the steps that obtaining live streaming picture, analysis live streaming picture carries out interaction mode classification prompt corresponding with characteristics of human body's attribute according to characteristics of human body's attribute that live streaming picture is met；The interaction instruction for receiving the interaction mode classification prompt of user's confirmation, is interacted.
Description
Technical field
A kind of interacted the present invention relates to mobile multimedia terminal technical field more particularly to live broadcast of mobile terminal method and
Device.
Background technique
With the development of internet, live streaming user can on video living transmission system by creation net cast room come to
Spectators perform or show intelligence and art.Video living transmission system includes: direct broadcast server, main broadcaster end client and each user
The client used.In general, main broadcaster user and spectators user are in the same room in same channel.
And during main broadcaster user performs to spectators user by net cast room or shows intelligence and art, it sees
Many users can interact with main broadcaster, such as give virtual objects as present or to main broadcaster to main broadcaster user by user terminal
User leaves a message, thumbs up.For example, spectators user clicks present icon in user terminal, it is clear that user terminal pops up available present
Single, user selects to want the present given in present inventory, then clicks ACK button and can just succeed gifts.For example,
Spectators user clicks chat box in user terminal, and user terminal pops up chat input frame, and user keys in chat input frame and master
The language of interaction is broadcast, then click ACK button just can successfully leave a message.
Currently, in the prior art, spectators user carries out in interactive process with main broadcaster on mobile terminals, due to mobile terminal
Can display area it is limited, carry out interactive operation when interactive interface will necessarily shelter from current live picture, influence spectators viewing
Experience, and spectators user carries out interactive operation and needs to complete multiple operations can successfully carrying out interacting with main broadcaster, process is cumbersome,
Inefficiency.
Summary of the invention
The embodiment of the invention provides a kind of method and devices of live broadcast of mobile terminal interaction, solve in the prior art,
Spectators user on mobile terminals and main broadcaster carry out interactive process in, due to mobile terminal can display area it is limited, interacted
Interactive interface when operation will necessarily shelter from current live picture, influence spectators' viewing experience, and spectators user's gifts
The technical issues of needing to complete multiple operations can succeed gifts, and process is cumbersome, inefficiency.
The embodiment of the invention provides a kind of live broadcast of mobile terminal interaction method, comprising:
Acquisition live streaming picture, analysis live streaming picture, according to characteristics of human body's attribute that live streaming picture is met, progress and human body
The corresponding interaction mode classification prompt of characteristic attribute；
The interaction instruction corresponding with the prompt of interaction mode classification for receiving user's confirmation, is interacted.
Preferably, live streaming picture, analysis live streaming picture are obtained, comprising:
Live streaming picture is obtained, whether meets human face profile every time piecewise analysis live streaming picture, if so, will symbol
The live streaming picture area integration for closing human face profile is appointed as facial contour region.
Preferably, live streaming picture is obtained, analysis live streaming picture specifically includes:
Live streaming picture is obtained, whether meets human face profile every time piecewise analysis live streaming picture, if so, will symbol
The live streaming picture area integration for closing human face profile is appointed as facial contour region；
Face characteristic position in facial contour region is determined, judge face characteristic position occupy screen area and/
Or width whether meet it is preset occupy screen area and/or width, if so, preset occupying screen area and/or width to meeting
The face characteristic position of degree carries out whether the duration meets the judgement of preset time period, if so, face characteristic position is specified
For the first face position.
Preferably, the characteristics of human body's attribute met according to live streaming picture, carries out interaction corresponding with characteristics of human body's attribute
The prompt of mode classification, comprising:
According to the attribute at face position belonging to the first face position, show it is corresponding with the first face position by text and/
Or the interaction prompt of image construction.
Preferably, the interaction instruction corresponding with the prompt of interaction mode classification for receiving user's confirmation, is interacted, comprising:
User is received by referring in the interaction corresponding with the prompt of interaction mode classification of screen taps or slide confirmation
It enables, is interacted.
Preferably, the interaction instruction corresponding with the prompt of interaction mode classification for receiving user's confirmation, after being interacted, packet
It includes:
It, will interaction mode text corresponding with the first face position according to the attribute at face position belonging to the first face position
And/or image superposition is in screen on corresponding position.
A kind of live broadcast of mobile terminal interactive device provided in an embodiment of the present invention, comprising:
Acquiring unit, analytical unit, display unit, receiving unit, superpositing unit；
Acquiring unit, for obtaining live streaming picture；
Analytical unit, the characteristics of human body's attribute met for analyzing live streaming picture；
Display unit, characteristics of human body's attribute for being met according to live streaming picture, carries out corresponding with characteristics of human body's attribute
Interaction mode classification prompt；
Receiving unit is interacted for receiving the interaction instruction corresponding with the prompt of interaction mode classification of user's confirmation；
Superpositing unit, characteristics of human body's attribute for being met according to live streaming picture, will be corresponding with characteristics of human body's attribute
Interaction mode image superposition is in screen on corresponding position.
Preferably, analytical unit, comprising:
Timing analysis subelement integrates specified subelement, the first analysis subelement, judges specified subelement；
Timing analysis subelement, for whether meeting human face profile every time piecewise analysis live streaming picture；
Specified subelement is integrated, for the live streaming picture area integration for meeting human face profile to be appointed as facial contour
Region；
First analysis subelement judges face characteristic for being determined to face characteristic position in facial contour region
Position occupies screen area and/or whether width meets and preset occupy screen area and/or width；
Specified subelement is judged, for carrying out to meeting the preset face characteristic position for occupying screen area and/or width
Whether the duration meets the judgement of preset time period, if so, face characteristic position is appointed as the first face position.
Preferably, display unit is specifically used for the attribute at the face position according to belonging to the first face position, display and first
Face position is corresponding to be prompted by the interaction of text and/or image construction.
Preferably, superpositing unit be specifically used for the face position according to belonging to the first face position attribute, will with it is the first
Face's corresponding interaction mode text in position and/or image superposition are in screen on corresponding position.
As can be seen from the above technical solutions, the embodiment of the present invention has the advantage that
The embodiment of the invention provides a kind of method and devices of live broadcast of mobile terminal interaction, comprising: live streaming picture is obtained,
Analysis live streaming picture carries out interaction side corresponding with characteristics of human body's attribute according to characteristics of human body's attribute that live streaming picture is met
The prompt of formula classification；The interaction instruction for receiving the interaction mode classification prompt of user's confirmation, is interacted, solves the prior art
In, spectators user carries out in interactive process with main broadcaster on mobile terminals, due to mobile terminal can display area it is limited, carry out mutual
Interactive interface when dynamic operation will necessarily shelter from current live picture, influence spectators' viewing experience, and spectators user carries out mutually
The technical issues of dynamic operation, which needs to complete multiple operations, can successfully carry out interacting with main broadcaster, and process is cumbersome, inefficiency.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention without any creative labor, may be used also for those of ordinary skill in the art
To obtain other attached drawings according to these attached drawings.
Fig. 1 is a kind of one embodiment process signal of the method for live broadcast of mobile terminal interaction provided in an embodiment of the present invention
Figure；
Fig. 2 is that a kind of another embodiment process of the method for live broadcast of mobile terminal interaction provided in an embodiment of the present invention is shown
It is intended to；
Fig. 3 is a kind of one embodiment structural representation of live broadcast of mobile terminal interactive device provided in an embodiment of the present invention
Figure；
Fig. 4 is a kind of another example structure signal of live broadcast of mobile terminal interactive device provided in an embodiment of the present invention
Figure；
Fig. 5 is that main broadcaster guides interaction to prompt schematic diagram of a scenario of giving gifts；
Fig. 6 is that spectators send out present effect diagram；
Fig. 7 is that main broadcaster guides interaction to prompt another schematic diagram of scene of giving gifts；
Fig. 8 is that spectators send out another schematic diagram of present effect.
Specific embodiment
The embodiment of the invention provides a kind of method and devices of live broadcast of mobile terminal interaction, for solving the prior art
In, spectators user carries out in interactive process with main broadcaster on mobile terminals, due to mobile terminal can display area it is limited, carry out mutual
Interactive interface when dynamic operation will necessarily shelter from current live picture, influence spectators' viewing experience, and spectators user carries out mutually
The technical issues of dynamic operation, which needs to complete multiple operations, can successfully carry out interacting with main broadcaster, and process is cumbersome, inefficiency.
In order to make the invention's purpose, features and advantages of the invention more obvious and easy to understand, below in conjunction with the present invention
Attached drawing in embodiment, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that disclosed below
Embodiment be only a part of the embodiment of the present invention, and not all embodiment.Based on the embodiments of the present invention, this field
Those of ordinary skill's all other embodiment obtained without making creative work, belongs to protection of the present invention
Range.
Referring to Fig. 1, one of a kind of method of live broadcast of mobile terminal interaction provided in an embodiment of the present invention is embodiment
Include:
101, obtain live streaming picture, analysis live streaming picture, according to characteristics of human body's attribute for being met of live streaming picture, carry out with
The corresponding interaction mode classification prompt of characteristics of human body's attribute.
The embodiment of the present invention is suitable for existing mobile terminal with touch-screen-enabled, including tablet computer, mobile phone etc..It is first
First, the picture in mobile terminal in ongoing live streaming is first got, screenshotss or frame-grab etc. can be used in the mode of acquisition
Method.
After picture in being broadcast live, the live streaming picture of acquisition is analyzed, judges whether it meets and presets
Characteristics of human body's attribute.If live streaming picture meets pre-set characteristics of human body's attribute conditions, live streaming picture is analyzed and determined
The condition that face is met belongs to what type of characteristics of human body's attribute conditions, wherein characteristics of human body's attribute conditions include face, eye
Eyeball, neck, palm etc. show interaction mode in user terminal, carry out then further according to characteristics of human body's attribute belonging to live streaming picture
To the automatic prompt of the interaction mode of user.Wherein, above-mentioned interaction mode includes: to leave a message to main broadcaster's gifts, to main broadcaster
Or it is thumbed up to main broadcaster, but be not limited only to this.
102, the interaction instruction corresponding with the prompt of interaction mode classification for receiving user's confirmation, is interacted.
User terminal carried out the interaction mode classification that can be quickly interacted prompt after, receive confirmed by user with it is mutual
Flowing mode classification prompts corresponding interaction instruction, and the instruction of the confirmation interaction prompt then issued according to user is interacted, such as
It leaves a message to main broadcaster's gifts, to main broadcaster or is thumbed up to main broadcaster.
By obtaining live streaming picture, analysis live streaming picture, the human body met according to live streaming picture in the embodiment of the present invention
Characteristic attribute carries out interaction mode classification prompt corresponding with characteristics of human body's attribute；Receive user confirmation with the side of interaction
Formula classification prompts corresponding interaction instruction, is interacted, is solved in the prior art, spectators user on mobile terminals with main broadcaster
Carry out interactive process in, due to mobile terminal can display area it is limited, carry out interactive operation when interactive interface will necessarily block
Firmly current live picture influences spectators' viewing experience, and spectators user's gifts need to complete multiple operations and can successfully give
It gives gifts object, the technical issues of process is cumbersome, inefficiency.
The above are a kind of one embodiment of the method for live broadcast of mobile terminal interaction provided in an embodiment of the present invention, below will
It is described in detail for the detailed process of live broadcast of mobile terminal interactive approach.
Referring to Fig. 2, a kind of another embodiment of the method for live broadcast of mobile terminal interaction provided in an embodiment of the present invention
Include:
201, live streaming picture is obtained, whether meets human face profile every time piecewise analysis live streaming picture, if so,
The live streaming picture area for meeting human face profile integration is appointed as facial contour region.
The embodiment of the present invention is suitable for existing mobile terminal with touch-screen-enabled, including tablet computer, mobile phone etc..It is first
First, the picture in mobile terminal in ongoing live streaming, the method that screenshotss or frame-grab can be used in the mode of acquisition are got.
After picture in being broadcast live, it is timed analysis identification live streaming picture, such as main broadcaster of every 200 milliseconds calculating
Face feature.Since technically system identification main broadcaster behavior needs to expend client cpu, it is not recommended that the too close inspection of real-time intervals
It surveys, the embodiment of the present invention is taken every 200 milliseconds to extract primary live streaming picture and tested and analyzed, and can reduce performance consumption to the greatest extent
And guarantee the accuracy of identification.Whether meet preset human body complexion condition according to the color in live streaming picture, if satisfied, then will
The area image for meeting preset human body complexion condition thinks a part of human body.Then, then by the area image analyze,
Judge whether it meets human face contour feature.According to human face feature, such as dark eyes, nose and mouth etc. are carried out
The area image for meeting human face contour feature is integrated, and specifies it for face contour area.
In addition, also preset human body complexion condition can be met in the color in live streaming picture, and human face wheel is not met
In the case where wide feature, carry out further identifying the people that the live streaming regional display for meeting preset human body complexion condition is met
Body appointed part.For example, carrying out discriminance analysis to the live streaming regional display, palm or the head or neck et al. of human body are identified
Body characteristics, and specifying the regional display is the first human region image.
202, face characteristic position in facial contour region is determined, judges that face characteristic position occupies screen area
And/or width whether meet it is preset occupy screen area and/or width, if so, to meet it is preset occupy screen area and/or
The face characteristic position of width carries out whether the duration meets the judgement of preset time period, if so, face characteristic position is referred to
It is set to the first face position.
It obtains carrying out further dividing to facial contour area image after integrating specified facial contour area image
Analysis, determines human face feature concrete position therein, such as positive face, side face, eyes.According to identified human face feature
Each concrete position, analyze and determine each concrete position of human face feature occupy screen area and/or width whether meet it is pre-
It sets and occupies screen area and/or width.As side face laterally accounts for 80% or more screen area width；Eyes central point linear distance,
80% or more etc. of screen transverse width is accounted for, that is, is considered as to meet and preset occupies screen area and/or width.
Analyze human face feature concrete position occupies screen area and/or width meets and preset occupies screen area
And/or after width, carry out to meeting whether the preset face characteristic position duration for occupying screen area and/or width meets
The judgement of preset time period.As side face laterally accounts for 80% or more screen area, and the duration 2 seconds or more；Or, eyes central point is straight
Linear distance accounts for 80% or more of screen transverse width, and the duration 2 seconds or more, then its duration meets preset time period.
If it is above-mentioned meet it is preset occupy screen area and/or the face characteristic position duration of width also meets preset time period, will
The face characteristic portion is appointed as the first face position.
In addition, being the first human region image if obtaining, according to the spy of human body belonging to the first human region image
Levy type, analyze and determine human body characteristic type occupy screen area and/or width whether meet it is preset occupy screen area and/
Or width.If neck laterally accounts for 80% or more screen area width, palm lateral length account for the 80% of screen transverse width with
On, that is, it can be considered that human body characteristic type occupies screen area and/or width meets and preset occupies screen area and/or width.
Analyze above-mentioned characteristics of human body's type occupy screen area and/or width meet it is preset occupy screen area and/
Or after width, carry out to meet the preset face characteristic position duration for occupying screen area and/or width whether meet it is pre-
Set the judgement of duration.As neck laterally accounts for 80% or more screen area width, and the duration 2 seconds or more；Or, palm is laterally long
Degree accounts for 80% or more of screen transverse width, and the duration 2 seconds or more, then its duration meets preset time period.On if
State meet it is preset occupy screen area and/or the first human region image persistence of width also meets preset time period, then will
The first human region image is appointed as the second human region image.
203, the attribute at the face position according to belonging to the first face position is shown corresponding by text with the first face position
And/or the interaction prompt of image construction.
After specifying certain specific face characteristic portion and being appointed as the first face position, according to belonging to the first face position
The attribute at face position, such as positive face, side face, eyes show specifically with text and/or image construction user terminal
Interaction mode message is specific such as " click and fast send glasses present ", " clicking close present of fast escorting the bride to the groom's home or the wedding hall ", " click fast thumbs up "
Deng.Fig. 5 and Fig. 7 are please referred to, guides interaction to prompt schematic diagram of a scenario of giving gifts for main broadcaster.Wherein, Fig. 5 is that main broadcaster guides interaction prompt
Glasses present schematic diagram is sent, Fig. 7 is that main broadcaster guides interaction to prompt close present schematic diagram of escorting the bride to the groom's home or the wedding hall.
In addition, after specifying the first human region image and being the second human region image, according to the second human region figure
The attribute of specific characteristics of human body as in, such as neck, palm, head, to user terminal shown specifically with text and/or
The interaction mode message of image construction, specific such as " click and fast send pendant present ", " are clicked " click and fast send ring present "
Fast thumb up " etc., it is not especially limited herein.
204, the interaction instruction that user is prompted by the interaction mode classification confirmed in screen taps or slide is received,
It is interacted.
After illustrating interaction prompt to user by user terminal, confirmation interaction instruction input by user is received, wherein
The confirmation interaction instruction can confirm interaction instruction for rapid double tap screen or slide etc., be not especially limited herein.It is connecing
After receiving user's confirmation interactive information, carry out confirming interaction mode classification to server communication, and interacted in user terminal
Operation.
205, the attribute at the face position according to belonging to the first face position, will interaction mode corresponding with the first face position
Image superposition is in screen on corresponding position.
Receive user by screen taps or slide confirmation interaction mode classification prompt interaction instruction after,
According to the attribute at face position belonging to the first face position, such as positive face, side face, eyes；Or according to the second human region image
In specific characteristics of human body attribute, such as neck, palm, head will present images corresponding with the first face position, text
Image thumbs up image, such as glasses, the presents image such as relative's lip, or with the specific characteristics of human body in the second human region image
Corresponding present image, character image thumb up image, are superimposed in screen on corresponding position, such as glasses present image superposition
On eyes, relative's lip present image superposition is on side face, and pendant present image superposition is in the first-class of neck, herein not
Make specific limit.Fig. 6 and Fig. 8 are please referred to, sends out present effect diagram for spectators.Wherein, Fig. 6 is that spectators send out glasses present
Effect diagram, Fig. 8 are that spectators send out relative's present effect diagram.
By obtaining live streaming picture, analysis live streaming picture, the human body met according to live streaming picture in the embodiment of the present invention
Characteristic attribute carries out interaction mode classification prompt corresponding with characteristics of human body's attribute；Receive the interaction mode classification of user's confirmation
The interaction instruction of prompt, is interacted, and is solved in the prior art, and spectators user interacted with main broadcaster on mobile terminals
Cheng Zhong, due to mobile terminal can display area it is limited, carry out interactive operation when interactive interface will necessarily shelter from current live
Picture influences spectators' viewing experience, and spectators user's progress interactive operation needs to complete multiple operations and can successfully carry out and master
The technical issues of interaction broadcast, process is cumbersome, inefficiency.
The above are the detailed description that the detailed process of the method interacted to live broadcast of mobile terminal is carried out, below for
Live broadcast of mobile terminal interactive device provided in an embodiment of the present invention is described.
Referring to Fig. 3, a kind of one embodiment of live broadcast of mobile terminal interactive device provided in an embodiment of the present invention includes:
Acquiring unit 301, for obtaining live streaming picture；
Analytical unit 302, the characteristics of human body's attribute met for analyzing live streaming picture；
Display unit 303, characteristics of human body's attribute for being met according to live streaming picture, carries out and characteristics of human body's attribute pair
The interaction mode classification prompt answered；
Receiving unit 304, the interaction instruction of the interaction mode classification prompt for receiving user's confirmation, is interacted；
Superpositing unit 305, characteristics of human body's attribute for being met according to live streaming picture, will be corresponding with characteristics of human body's attribute
Interaction mode image superposition in screen on corresponding position.
It is carried out the above are one embodiment to a kind of live broadcast of mobile terminal interactive device provided in an embodiment of the present invention
Description, below by being specifically partially described in detail to live broadcast of mobile terminal interactive device provided in an embodiment of the present invention.
Referring to Fig. 4, a kind of another embodiment packet of live broadcast of mobile terminal interactive device provided in an embodiment of the present invention
It includes:
Acquiring unit 401, for obtaining live streaming picture.
Analytical unit 402, specifically includes: timing analysis subelement 4021, integrates specified subelement 4022, the first analysis
Unit 4023 judges specified subelement 4024.
Timing analysis subelement 4021, for every a time piecewise analysis live streaming picture whether meet human face profile or
Other human body appointed parts.
Specified subelement 4022 is integrated, for the live streaming picture area integration for meeting human face profile to be appointed as face
The regional display for meeting human body appointed part is appointed as the first human region image by contour area.
First analysis subelement 4023 is analyzed and determined for being determined to face characteristic position in facial contour region
Face characteristic position occupies screen area and/or width whether meet it is preset occupy screen area and/or width, to the first human body
Human body appointed part in area image is determined, and analyzes and determines that the human body appointed part in the first human region image occupies
Whether screen area and/or width, which meet, preset occupies screen area and/or width.
Specified subelement 4024 is judged, for meeting the preset face characteristic position for occupying screen area and/or width
Or the first human body appointed part in human region image, the judgement whether duration meet preset time period is carried out, if so,
Face characteristic position is appointed as the first face position, the first human region image is appointed as the second human region image.
Display unit 403, for the attribute at the face position according to belonging to the first face position, display and the first face position
It is corresponding to be prompted by the interaction of text and/or image construction, or according to the specific characteristics of human body's in the second human region image
Attribute is shown corresponding with the attribute of specific characteristics of human body in the second human region image by text and/or image construction
Interaction prompt.
Receiving unit 404, the interaction instruction of the interaction mode classification prompt for receiving user's confirmation, is interacted.
Superpositing unit 405 will be right with the first face position for the attribute at the face position according to belonging to the first face position
The interaction mode image superposition answered is or special according to the specific human body in the second human region image in screen on corresponding position
The attribute of sign, by interaction mode image superposition corresponding with the attribute of specific characteristics of human body in the second human region image in screen
In curtain on corresponding position.
It is above then to a kind of specific part progress of live broadcast of mobile terminal interactive device provided in an embodiment of the present invention
Detailed description.
Live streaming picture, the analysis live streaming picture of analytical unit 402, root are obtained by acquiring unit 401 in the embodiment of the present invention
According to characteristics of human body's attribute that live streaming picture is met, interaction mode classification prompt corresponding with characteristics of human body's attribute is carried out；It receives
Unit 404 receives the interaction instruction of the interaction mode classification prompt of user's confirmation, is interacted, and solves in the prior art, sees
Many users on mobile terminals and main broadcaster carry out interactive process in, due to mobile terminal can display area it is limited, carry out interaction behaviour
Interactive interface when making will necessarily shelter from current live picture, influence spectators' viewing experience, and spectators user carries out interaction behaviour
The technical issues of needing to complete multiple operations can successfully carry out interacting with main broadcaster, and process is cumbersome, inefficiency.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed system, device and method can be with
It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit
It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components
It can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, it is shown or
The mutual coupling, direct-coupling or communication connection discussed can be through some interfaces, the indirect coupling of device or unit
It closes or communicates to connect, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated unit is realized in the form of SFU software functional unit and sells or use as independent product
When, it can store in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially
The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words
It embodies, which is stored in a storage medium, including some instructions are used so that a computer
Equipment (can be personal computer, server or the network equipment etc.) executes the complete of each embodiment the method for the present invention
Portion or part steps.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only
Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. are various can store journey
The medium of sequence code.
The above, the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although referring to before
Stating embodiment, invention is explained in detail, those skilled in the art should understand that: it still can be to preceding
Technical solution documented by each embodiment is stated to modify or equivalent replacement of some of the technical features；And these
It modifies or replaces, the spirit and scope for technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution.
Claims (7)
1. a kind of method of live broadcast of mobile terminal interaction characterized by comprising
Obtain live streaming picture, analyze the live streaming picture, according to characteristics of human body's attribute for being met of live streaming picture, carry out with
The corresponding interaction mode classification prompt of characteristics of human body's attribute；
The interaction instruction corresponding with the interaction mode classification prompt for receiving user's confirmation, is interacted；
It, will interaction mode figure corresponding with characteristics of human body's attribute according to characteristics of human body's attribute that the live streaming picture is met
As being superimposed in screen on corresponding position；
Picture is broadcast live in the acquisition, analyzes the live streaming picture, specifically includes:
Live streaming picture is obtained, whether the live streaming picture described in the time piecewise analysis meets human face profile, if so, will symbol
The live streaming picture area integration for closing the human face profile is appointed as facial contour region；
Face characteristic position in the facial contour region is determined, judges that the face characteristic position occupies screen area
And/or width whether meet it is preset occupy screen area and/or width, if so, described preset occupying screen area to meeting
And/or whether the face characteristic position progress duration of width meets the judgement of preset time period, if so, by the people
Face characteristic portion is appointed as the first face position；
Or,
Live streaming picture is obtained, whether the live streaming picture described in the time piecewise analysis meets other human body appointed parts, if so,
The regional display for meeting other human body appointed parts is then appointed as the first human region image；
According to characteristics of human body's type belonging to the first human region image, analyze and determine that human body characteristic type occupies screen
Whether area and/or width, which meet, preset occupies screen area and/or width；If so, described preset occupying screen to meeting
The first human region image of area and/or width carries out the judgement for the duration whether meeting preset time period, if so,
The first human region image is appointed as the second human region image.
2. the method for live broadcast of mobile terminal interaction according to claim 1, which is characterized in that described according to the live streaming picture
Characteristics of human body's attribute that face is met carries out interaction mode classification prompt corresponding with characteristics of human body's attribute, comprising:
According to the attribute at face position belonging to first face position, show corresponding with first face position by text
And/or the interaction prompt of image construction；
Or, according to the attribute of the specific characteristics of human body in the second human region image, display and second human region
The attribute of specific characteristics of human body in image is corresponding to be prompted by the interaction of text and/or image construction.
3. the method for live broadcast of mobile terminal interaction according to claim 1, which is characterized in that described to receive what user confirmed
Interaction instruction corresponding with the interaction mode classification prompt, is interacted, comprising:
User is received by referring in the interaction corresponding with the interaction mode classification prompt of screen taps or slide confirmation
It enables, is interacted.
4. the method for live broadcast of mobile terminal interaction according to claim 1, which is characterized in that described to receive what user confirmed
Interaction instruction corresponding with the interaction mode classification prompt, after being interacted, comprising:
It, will interaction mode corresponding with first face position according to the attribute at face position belonging to first face position
Image superposition is in the screen on corresponding position；
Or, according to the attribute of the specific characteristics of human body in the second human region image, it will be with the second human region figure
The corresponding interaction mode image superposition of attribute of specific characteristics of human body as in is in the screen on corresponding position.
5. a kind of live broadcast of mobile terminal interactive device characterized by comprising
Acquiring unit, analytical unit, display unit, receiving unit, superpositing unit；
The acquiring unit, for obtaining live streaming picture；
The analytical unit, the characteristics of human body's attribute met for analyzing the live streaming picture；
Display unit, characteristics of human body's attribute for being met according to live streaming picture, carries out corresponding with characteristics of human body's attribute
Interaction mode classification prompt；
Receiving unit is interacted for receiving the interaction instruction corresponding with the interaction mode classification prompt of user's confirmation；
Superpositing unit, characteristics of human body's attribute for being met according to the live streaming picture, will be with characteristics of human body's attribute pair
The interaction mode image superposition answered is in screen on corresponding position；
The analytical unit, comprising:
Timing analysis subelement integrates specified subelement, the first analysis subelement, judges specified subelement；
Whether the timing analysis subelement meets human face profile for the live streaming picture described in the time piecewise analysis,
Or, for whether meeting other human body appointed parts every time piecewise analysis live streaming picture；
It is described to integrate specified subelement, for the live streaming picture area integration for meeting the human face profile to be appointed as face
Contour area, or, for the regional display for meeting human body appointed part to be appointed as the first human region image；
The first analysis subelement, for being determined to face characteristic position in the facial contour region, described in judgement
Face characteristic position occupies screen area and/or width whether meet it is preset occupy screen area and/or width, or, for pair
Human body appointed part in the first human region image is determined, and is analyzed and determined in the first human region image
Human body appointed part occupies screen area and/or whether width meets and preset occupy screen area and/or width；
It is described to judge specified subelement, for meeting the preset face characteristic for occupying screen area and/or width
Position carries out whether the duration meets the judgement of preset time period, if so, the face characteristic position is appointed as the first
Face position, or, for holding to meeting preset the first human region image for occupying screen area and/or width
Whether the continuous time meets the judgement of preset time period, if so, the first human region image is appointed as the second human region
Image.
6. live broadcast of mobile terminal interactive device according to claim 5, which is characterized in that the display unit is specifically used for
According to the attribute at face position belonging to first face position, show it is corresponding with first face position by text and/
Or the interaction prompt of image construction；
Or, according to the attribute of the specific characteristics of human body in the second human region image, display and second human region
The attribute of specific characteristics of human body in image is corresponding to be prompted by the interaction of text and/or image construction.
7. live broadcast of mobile terminal interactive device according to claim 5, which is characterized in that the superpositing unit is specifically used for
It, will interaction mode text corresponding with first face position according to the attribute at face position belonging to first face position
And/or image superposition is in the screen on corresponding position；
Or, according to the attribute of the specific characteristics of human body in the second human region image, it will be with the second human region figure
The corresponding interaction mode image superposition of attribute of specific characteristics of human body as in is in the screen on corresponding position.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610878194.4A CN106454481B (en) | 2016-09-30 | 2016-09-30 | A kind of method and device of live broadcast of mobile terminal interaction |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610878194.4A CN106454481B (en) | 2016-09-30 | 2016-09-30 | A kind of method and device of live broadcast of mobile terminal interaction |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106454481A CN106454481A (en) | 2017-02-22 |
| CN106454481B true CN106454481B (en) | 2019-08-23 |
Family
ID=58172306
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610878194.4A Active CN106454481B (en) | 2016-09-30 | 2016-09-30 | A kind of method and device of live broadcast of mobile terminal interaction |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106454481B (en) |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107222754A (en) * | 2017-05-27 | 2017-09-29 | 武汉斗鱼网络科技有限公司 | Present gives Notification Method, device and server |
| CN107564038B (en) * | 2017-08-28 | 2021-11-30 | 北京小米移动软件有限公司 | Offset parameter determination method and device and offset control method and device |
| CN108401173B (en) * | 2017-12-21 | 2020-11-17 | 平安科技（深圳）有限公司 | Mobile live broadcast interactive terminal, method and computer readable storage medium |
| CN108391174B (en) * | 2018-03-22 | 2021-08-20 | 卓米私人有限公司 | Live broadcast interaction method and device and electronic equipment |
| CN108536492B (en) * | 2018-04-08 | 2021-09-07 | 武汉斗鱼网络科技有限公司 | Method, device, equipment and storage medium for acquiring attribute information of live broadcast room |
| CN108924661B (en) * | 2018-07-12 | 2020-02-18 | 北京微播视界科技有限公司 | Data interaction method, device, terminal and storage medium based on live broadcast room |
| CN109286835A (en) * | 2018-09-05 | 2019-01-29 | 武汉斗鱼网络科技有限公司 | Direct broadcasting room interactive element display methods, storage medium, equipment and system |
| CN111131127B (en) * | 2018-10-30 | 2022-04-12 | 武汉斗鱼网络科技有限公司 | Communication method based on live broadcast platform and related device |
| CN112019906A (en) * | 2019-05-30 | 2020-12-01 | 上海哔哩哔哩科技有限公司 | Live broadcast method, computer equipment and readable storage medium |
| CN110830811B (en) * | 2019-10-31 | 2022-01-18 | 广州酷狗计算机科技有限公司 | Live broadcast interaction method, device, system, terminal and storage medium |
| CN111698523B (en) * | 2019-12-06 | 2021-11-12 | 广州方硅信息技术有限公司 | Method, device, equipment and storage medium for presenting text virtual gift |
| CN115767164A (en) * | 2021-03-15 | 2023-03-07 | 北京城市网邻信息技术有限公司 | Information display method, client, electronic equipment and storage medium |
| CN115079911A (en) * | 2022-06-14 | 2022-09-20 | 北京字跳网络技术有限公司 | Data processing method, device, equipment and storage medium |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105334963A (en) * | 2015-10-29 | 2016-02-17 | 广州华多网络科技有限公司 | Method and system for displaying virtual article |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4254873B2 (en) * | 2007-02-16 | 2009-04-15 | ソニー株式会社 | Image processing apparatus, image processing method, imaging apparatus, and computer program |
| CN101478629B (en) * | 2008-01-04 | 2010-09-22 | 华晶科技股份有限公司 | Image processing process for regulating human face ratio |
| CN102055912B (en) * | 2009-10-29 | 2014-10-29 | 北京中星微电子有限公司 | Video application system, video special effect processing system and method |
| TWI545947B (en) * | 2011-04-08 | 2016-08-11 | 南昌歐菲光電技術有限公司 | Display device with image capture and analysis module |
| CN103108248B (en) * | 2013-01-06 | 2016-04-27 | 王汝迟 | A kind of implementation method of interactive video and system |
| CN104363471A (en) * | 2014-11-21 | 2015-02-18 | 广州华多网络科技有限公司 | Interaction method based on live video and relevant device and system |
| CN105049911B (en) * | 2015-07-10 | 2017-12-29 | 西安理工大学 | A kind of special video effect processing method based on recognition of face |
| CN105187930B (en) * | 2015-09-18 | 2019-09-06 | 广州酷狗计算机科技有限公司 | Interactive approach and device based on net cast |
| CN105451029B (en) * | 2015-12-02 | 2019-04-02 | 广州华多网络科技有限公司 | A kind of processing method and processing device of video image |
| CN105872442A (en) * | 2016-03-30 | 2016-08-17 | 宁波三博电子科技有限公司 | Instant bullet screen gift giving method and instant bullet screen gift giving system based on face recognition |
-
2016
- 2016-09-30 CN CN201610878194.4A patent/CN106454481B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105334963A (en) * | 2015-10-29 | 2016-02-17 | 广州华多网络科技有限公司 | Method and system for displaying virtual article |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106454481A (en) | 2017-02-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106454481B (en) | A kind of method and device of live broadcast of mobile terminal interaction | |
| CN106231434B (en) | A kind of living broadcast interactive special efficacy realization method and system based on Face datection | |
| CN107197384B (en) | The multi-modal exchange method of virtual robot and system applied to net cast platform | |
| CN109478097B (en) | Method and system for providing information and computer program product | |
| CN105334963B (en) | A kind of virtual objects methods of exhibiting and system | |
| US10264870B2 (en) | Makeup application assistance device, makeup application assistance system, and makeup application assistance method | |
| Gunes et al. | A bimodal face and body gesture database for automatic analysis of human nonverbal affective behavior | |
| US9329677B2 (en) | Social system and method used for bringing virtual social network into real life | |
| CN109176535B (en) | Interaction method and system based on intelligent robot | |
| US20180308114A1 (en) | Method, device and system for evaluating product recommendation degree | |
| CN110460899B (en) | Bullet screen content display method, terminal equipment and computer readable storage medium | |
| CN106303354B (en) | Face special effect recommendation method and electronic equipment | |
| CN105335465B (en) | A kind of method and apparatus showing main broadcaster's account | |
| CN110418095B (en) | Virtual scene processing method and device, electronic equipment and storage medium | |
| CN107124664A (en) | Exchange method and device applied to net cast | |
| CN104777911B (en) | A kind of intelligent interactive method based on holographic technique | |
| CN106815555B (en) | Augmented reality method and system for distributed scene target recognition | |
| JP2016537922A (en) | Pseudo video call method and terminal | |
| CN107343225B (en) | The method, apparatus and terminal device of business object are shown in video image | |
| CN110674664A (en) | Visual attention recognition method and system, storage medium and processor | |
| CN110472099B (en) | Interactive video generation method and device and storage medium | |
| CN104102409A (en) | Scenario adaptation device and method for user interface | |
| US20220214797A1 (en) | Virtual image control method, apparatus, electronic device and storage medium | |
| CN110210449A (en) | A kind of face identification system and method for virtual reality friend-making | |
| CN105575198B (en) | The methods of exhibiting and device of instructional video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20210111 Address after: 510000 3108, 79 Wanbo 2nd Road, Nancun Town, Panyu District, Guangzhou City, Guangdong Province Patentee after: GUANGZHOU CUBESILI INFORMATION TECHNOLOGY Co.,Ltd. Address before: 511449 Wanda Plaza, Nancun Town, Panyu District, Guangzhou City, Guangdong Province Patentee before: GUANGZHOU HUADUO NETWORK TECHNOLOGY Co.,Ltd. |