CN106454481A - Live broadcast interaction method and apparatus of mobile terminal - Google Patents

Live broadcast interaction method and apparatus of mobile terminal Download PDF

Info

Publication number
CN106454481A
CN106454481A CN201610878194.4A CN201610878194A CN106454481A CN 106454481 A CN106454481 A CN 106454481A CN 201610878194 A CN201610878194 A CN 201610878194A CN 106454481 A CN106454481 A CN 106454481A
Authority
CN
China
Prior art keywords
face
live
interaction
attribute
mobile terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610878194.4A
Other languages
Chinese (zh)
Other versions
CN106454481B (en
Inventor
肖鸿亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Cubesili Information Technology Co Ltd
Original Assignee
Guangzhou Huaduo Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Huaduo Network Technology Co Ltd filed Critical Guangzhou Huaduo Network Technology Co Ltd
Priority to CN201610878194.4A priority Critical patent/CN106454481B/en
Publication of CN106454481A publication Critical patent/CN106454481A/en
Application granted granted Critical
Publication of CN106454481B publication Critical patent/CN106454481B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/61Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/611Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for multicast or broadcast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44222Analytics of user selections, e.g. selection of programs or purchase activity
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/488Data services, e.g. news ticker
    • H04N21/4882Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Social Psychology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the invention discloses a live broadcast interaction method and apparatus of a mobile terminal. The following technical problem in the prior art is solved: when an audience user interacts with an anchor on the mobile terminal, due to the limited display area of the mobile terminal, an interactive interference will absolutely shield the current live broadcast image in an interactive operation, thereby affecting the watching experience of the audience, and the audience user needs to complete multiple operations during the interactive operation to successfully interact with the anchor, so the process is tedious and the efficiency is low. The method disclosed by the embodiment of the invention comprises the following steps: obtaining the live broadcast image, analyzing the live broadcast image, and providing an interactive mode category prompt corresponding to human body feature attributes according to the human body feature attributes satisfying the live broadcast image; and receiving an interaction instruction of the interactive mode category prompt and confirmed by the user to perform interaction.

Description

A kind of interactive method and device of live broadcast of mobile terminal
Technical field
The present invention relates to mobile multimedia terminal technical field, the interactive method of more particularly, to a kind of live broadcast of mobile terminal and Device.
Background technology
With the development of internet, live user can on video living transmission system by create net cast room come to Spectators are performed or are shown intelligence and art.Video living transmission system includes:Direct broadcast server, main broadcaster end client and each user The client using.Generally, main broadcaster user and spectators user are in the same room in same channel.
And during main broadcaster user is performed or shown intelligence and art to spectators user by net cast room, see Many users can carry out interaction with main broadcaster, and such as giving virtual objects by user side to main broadcaster user is used as present or to main broadcaster User's message, point are praised.Such as, spectators user clicks on present icon in user side, and it is clear that user side ejects available present Single, user selects the present being wanted to give in present inventory, then click on ACK button just can success gifts.Such as, Spectators user clicks on chat box in user side, and user side ejects chat input frame, and user keys in and main in chat input frame Broadcast the language of interaction, then click on ACK button and just can successfully leave a message.
At present, in prior art, spectators user carries out in interactive process with main broadcaster on mobile terminals, due to mobile terminal Can viewing area limited, carry out interactive interface during interactive operation and will necessarily shelter from current live picture, impact spectators' viewing Experience, and spectators user carries out interactive operation and needs to complete the interaction that multiple operations can successfully carry out with main broadcaster, process is loaded down with trivial details, Inefficiency.
Content of the invention
Embodiments provide a kind of interactive method and device of live broadcast of mobile terminal, solve in prior art, Spectators user is carried out in interactive process with main broadcaster on mobile terminals, due to mobile terminal can viewing area limited, carry out interaction Interactive interface during operation will necessarily shelter from current live picture, affects spectators' viewing experience, and spectators user's gifts Need to complete multiple operations can successful gifts, process is loaded down with trivial details, the technical problem of inefficiency.
A kind of method of the live broadcast of mobile terminal interaction embodiments providing, including:
Obtain live picture, analyze live picture, the characteristics of human body's attribute being met according to live picture, carry out and human body Characteristic attribute corresponding interaction mode classification is pointed out;
What receive user confirmed points out corresponding interaction instruction with interaction mode classification, carries out interaction.
Preferably, obtain live picture, analyze live picture, including:
Obtain live picture, whether meet human face profile every the live picture of time piecewise analysis, if so, then will accord with The live picture area integration closing human face profile is appointed as facial contour region.
Preferably, obtain live picture, analyze live picture, specifically include:
Obtain live picture, whether meet human face profile every the live picture of time piecewise analysis, if so, then will accord with The live picture area integration closing human face profile is appointed as facial contour region;
Face characteristic position in facial contour region is determined, judge face characteristic position occupy screen area and/ Or width whether meet preset occupy screen area and/or width, if so, then preset occupy screen area and/or width to meeting The judgement whether line duration meets preset time period is entered at the face characteristic position of degree, if so, then specifies face characteristic position For the first face position.
Preferably, the characteristics of human body's attribute being met according to live picture, carries out interaction corresponding with characteristics of human body's attribute Mode classification is pointed out, including:
The attribute at face position according to belonging to the first face position, display corresponding with the first face position by word and/ Or the interactive prompting of image construction.
Preferably, what receive user confirmed points out corresponding interaction instruction with interaction mode classification, carries out interaction, including:
Receive user points out corresponding interaction to refer to by confirm in screen taps or slide with interaction mode classification Order, carries out interaction.
Preferably, what receive user confirmed points out corresponding interaction instruction with interaction mode classification, after carrying out interaction, bag Include:
The attribute at face position according to belonging to the first face position, will interaction mode word corresponding with the first face position And/or on imaging importing corresponding position in the screen.
A kind of live broadcast of mobile terminal interactive device provided in an embodiment of the present invention, including:
Acquiring unit, analytic unit, display unit, receiving unit, superpositing unit;
Acquiring unit, for obtaining live picture;
Analytic unit, for analyzing characteristics of human body's attribute that live picture meets;
Display unit, for the characteristics of human body's attribute being met according to live picture, carries out corresponding with characteristics of human body's attribute Interaction mode classification prompting;
Receiving unit, confirm for receive user points out corresponding interaction instruction with interaction mode classification, carries out interaction;
Superpositing unit, for the characteristics of human body's attribute being met according to live picture, will be corresponding with characteristics of human body's attribute On interaction mode imaging importing corresponding position in the screen.
Preferably, analytic unit, including:
Timing analysis subelement, integration are specified subelement, the first analysis subelement, are judged to specify subelement;
Whether timing analysis subelement, for meeting human face profile every the live picture of time piecewise analysis;
Integrate and specify subelement, be appointed as facial contour for integrating the live picture area meeting human face profile Region;
First analysis subelement, for being determined to face characteristic position in facial contour region, judges face characteristic Position occupies screen area and/or whether width meets and preset occupy screen area and/or width;
Judge to specify subelement, for preset occupying screen area and/or the face characteristic position of width is carried out to meeting Whether the duration meets the judgement of preset time period, if so, then face characteristic position is appointed as the first face position.
Preferably, display unit is specifically for the attribute at face position according to belonging to the first face position, display and first The corresponding interactive prompting by word and/or image construction in face position.
Preferably, superpositing unit is specifically for the attribute at face position according to belonging to the first face position, will with the first On face position corresponding interaction mode word and/or imaging importing corresponding position in the screen.
As can be seen from the above technical solutions, the embodiment of the present invention has advantages below:
Embodiments provide a kind of interactive method and device of live broadcast of mobile terminal, including:Obtain live picture, Analyze live picture, the characteristics of human body's attribute being met according to live picture, carry out interaction side corresponding with characteristics of human body's attribute Formula classification is pointed out;The interaction instruction of the interaction mode classification prompting that receive user confirms, carries out interaction, solves prior art In, spectators user is carried out in interactive process with main broadcaster on mobile terminals, due to mobile terminal can viewing area limited, carry out mutually Interactive interface during dynamic operation will necessarily shelter from current live picture, affects spectators' viewing experience, and spectators user is carried out mutually Dynamic operation needs to complete the interaction that multiple operations can successfully carry out with main broadcaster, and process is loaded down with trivial details, the technical problem of inefficiency.
Brief description
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing Have technology description in required use accompanying drawing be briefly described it should be apparent that, drawings in the following description be only this Some embodiments of invention, for those of ordinary skill in the art, without having to pay creative labor, also may be used So that other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is that an a kind of embodiment flow process of the interactive method of live broadcast of mobile terminal provided in an embodiment of the present invention is illustrated Figure;
Fig. 2 is that another embodiment flow process of the interactive method of a kind of live broadcast of mobile terminal provided in an embodiment of the present invention is shown It is intended to;
Fig. 3 is that an a kind of example structure of live broadcast of mobile terminal interactive device provided in an embodiment of the present invention is illustrated Figure;
Fig. 4 is that another example structure of a kind of live broadcast of mobile terminal interactive device provided in an embodiment of the present invention is illustrated Figure;
Fig. 5 is the interactive schematic diagram of a scenario of pointing out to give a present of main broadcaster's guiding;
Fig. 6 sends present effect diagram for spectators;
Fig. 7 is interactive another schematic diagram of scene of pointing out to give a present of main broadcaster's guiding;
Fig. 8 sends another schematic diagram of present effect for spectators.
Specific embodiment
Embodiments provide a kind of interactive method and device of live broadcast of mobile terminal, for solving prior art In, spectators user is carried out in interactive process with main broadcaster on mobile terminals, due to mobile terminal can viewing area limited, carry out mutually Interactive interface during dynamic operation will necessarily shelter from current live picture, affects spectators' viewing experience, and spectators user is carried out mutually Dynamic operation needs to complete the interaction that multiple operations can successfully carry out with main broadcaster, and process is loaded down with trivial details, the technical problem of inefficiency.
For enabling the goal of the invention of the present invention, feature, advantage more obvious and understandable, below in conjunction with the present invention Accompanying drawing in embodiment, is clearly and completely described it is clear that disclosed below to the technical scheme in the embodiment of the present invention Embodiment be only a part of embodiment of the present invention, and not all embodiment.Based on the embodiment in the present invention, this area All other embodiment that those of ordinary skill is obtained under the premise of not making creative work, broadly falls into present invention protection Scope.
Refer to Fig. 1, one of a kind of interactive method of live broadcast of mobile terminal provided in an embodiment of the present invention is embodiment Including:
101st, obtain live picture, analyze live picture, the characteristics of human body's attribute being met according to live picture, carry out with Characteristics of human body's attribute corresponding interaction mode classification is pointed out.
The embodiment of the present invention is applied to the existing mobile terminal with touch-screen-enabled, including panel computer, mobile phone etc..First First, first get in mobile terminal ongoing live in picture, the mode of acquisition can adopt screenshotss or frame-grab etc. Method.
After picture in acquisition is live, the live picture obtaining is analyzed, judges whether it meets and preset Characteristics of human body's attribute.If live picture meets pre-set characteristics of human body's attribute conditions, analysis judges live picture What face was met condition belongs to what type of characteristics of human body's attribute conditions, and wherein, characteristics of human body's attribute conditions include face, eye Eyeball, neck, palm etc., then further according to the characteristics of human body's attribute belonging to live picture, show interaction mode in user side, carry out Automatic prompting to the interaction mode of user.Wherein, above-mentioned interaction mode includes:To main broadcaster's gifts, to main broadcaster's message Or praise to main broadcaster's point, but it is not limited only to this.
What the 102nd, receive user confirmed points out corresponding interaction instruction with interaction mode classification, carries out interaction.
After user side has carried out quickly carrying out the interaction mode classification prompting of interaction, receive confirmed by user with mutual Flowing mode classification points out corresponding interaction instruction, the instruction confirming interactive prompting then being sent according to user, carries out interaction, such as Praise to main broadcaster's gifts, to main broadcaster's message or to main broadcaster's point.
Pass through in the embodiment of the present invention to obtain live picture, analyze live picture, the human body being met according to live picture Characteristic attribute, carries out interaction mode classification prompting corresponding with characteristics of human body's attribute;Receive user confirm with described interaction side Formula classification point out corresponding interaction instruction, carry out interaction, solve in prior art, spectators user on mobile terminals with main broadcaster Carry out in interactive process, due to mobile terminal can viewing area limited, carrying out interactive interface during interactive operation will necessarily block Live current live picture, affect spectators' viewing experience, and spectators user's gifts need to complete multiple operations successfully to give Give a present thing, process is loaded down with trivial details, the technical problem of inefficiency.
It is an a kind of embodiment of the interactive method of live broadcast of mobile terminal provided in an embodiment of the present invention above, below will Detailed process for live broadcast of mobile terminal interactive approach is described in detail.
Refer to Fig. 2, another embodiment of the interactive method of a kind of live broadcast of mobile terminal provided in an embodiment of the present invention Including:
201st, obtain live picture, whether meet human face profile every the live picture of time piecewise analysis, if so, then The live picture area meeting human face profile is integrated and is appointed as facial contour region.
The embodiment of the present invention is applied to the existing mobile terminal with touch-screen-enabled, including panel computer, mobile phone etc..First First, get in mobile terminal ongoing live in picture, the mode of acquisition can be using the method for screenshotss or frame-grab.
After picture in acquisition is live, it is timed analysis and identifies live picture, such as main broadcaster of every 200 milliseconds of calculating Face feature.Because technically system identification main broadcaster behavior needs expend client cpu it is not recommended that the too close inspection of real-time intervals Survey, the embodiment of the present invention is taken every 200 milliseconds to extract once live picture and tested and analyzed, and can reduce performance consumption as far as possible And ensure the accuracy identifying.Whether preset human body complexion condition is met according to the color in live picture, if meeting, will The area image meeting preset human body complexion condition thinks a part for human body.Then, then by this area image it is analyzed, Judge whether it meets human face contour feature.According to human face feature, such as dark eyes, nose, and face etc., carry out The area image meeting human face contour feature is integrated, and specifies it to be face contour area.
Additionally, also the color in live picture preset human body complexion condition can be met, and do not meet human face wheel In the case of wide feature, further identified and met the people that the live regional display of preset human body complexion condition is met Body appointed part.Such as, this live regional display is identified analyzing, identifies palm or the head or neck et al. of human body Body characteristicses, and specify this regional display to be the first human region image.
202nd, face characteristic position in facial contour region is determined, judges that face characteristic position occupies screen area And/or width whether meet preset occupy screen area and/or width, if so, then to meet preset occupy screen area and/or The judgement whether line duration meets preset time period is entered at the face characteristic position of width, if so, then refers to face characteristic position It is set to the first face position.
Obtain, through integrating after the facial contour area image specified, carrying out dividing further to facial contour area image Analysis, determines human face feature concrete position therein, such as positive face, side face, eyes etc..According to determined by human face feature Each concrete position, analysis judge each concrete position of human face feature occupy screen area and/or width whether meet pre- Put and occupy screen area and/or width.As side face laterally accounts for screen area width more than 80%;Eyes central point air line distance, Account for more than 80% of screen transverse width etc., that is, be considered as meeting and preset occupy screen area and/or width.
Analyze human face feature concrete position occupies screen area and/or width meets and preset occupies screen area And/or after width, carry out preset occupying screen area and/or whether the face characteristic position duration of width meets to meeting The judgement of preset time period.As side face laterally accounts for screen area more than 80%, and more than 2 seconds duration;Or, eyes central point is straight Linear distance, accounts for more than the 80% of screen transverse width, and more than 2 seconds duration, then its duration meet preset time period. If above-mentioned meet preset occupy screen area and/or the face characteristic position duration of width also meets preset time period, will This face characteristic position is appointed as the first face position.
If additionally, obtain for the first human region image, the human body according to belonging to this first human region image is special Levy type, analysis judge this characteristics of human body's type occupy screen area and/or width whether meet preset occupy screen area with/ Or width.As neck laterally accounts for screen area width more than 80%, palm lateral length account for the 80% of screen transverse width with On, you can it is considered as that this characteristics of human body's type occupies screen area and/or width meets and preset occupies screen area and/or width.
Analyze above-mentioned characteristics of human body's type occupy screen area and/or width meet preset occupy screen area and/ Or after width, carry out to meet the preset face characteristic position duration occupying screen area and/or width whether meet pre- Put the judgement of duration.As neck laterally accounts for screen area width more than 80%, and more than 2 seconds duration;Or, palm is laterally long Degree account for more than the 80% of screen transverse width, and more than 2 seconds duration, then its duration meet preset time period.If on State meet preset occupy screen area and/or the first human region image persistence of width also meets preset time period, then will This first human region image is appointed as the second human region image.
203rd, according to belonging to the first face position face position attribute, display corresponding with the first face position by word And/or the interactive prompting of image construction.
After specifying certain face characteristic portion concrete and being appointed as the first face position, according to belonging to the first face position The attribute at face position, such as positive face, side face, eyes etc., carry out to user side showing specifically with word and/or image construction Interaction mode message, concrete such as " glasses present is fast sent in click ", " clicking on close present of fast escorting the bride to the groom's home or the wedding hall ", " clicking on quick putting to praise " Deng.Refer to Fig. 5 and Fig. 7, be the interactive schematic diagram of a scenario of pointing out to give a present of main broadcaster's guiding.Wherein, Fig. 5 is the interactive prompting of main broadcaster's guiding Send glasses present schematic diagram, Fig. 7 is the interactive close present schematic diagram of pointing out to escort the bride to the groom's home or the wedding hall of main broadcaster's guiding.
Additionally, specify the first human region image be the second human region image after, according to the second human region figure As in concrete characteristics of human body attribute, such as neck, palm, head etc., user side is carried out show specifically with word and/or The interaction mode message of image construction, concrete such as " pendant present is fast sent in click ", " click on and fast send ring present ", " click Quick point is praised " etc., it is not especially limited herein.
204th, the interaction instruction that the interaction mode classification that receive user passes through to confirm in screen taps or slide is pointed out, Carry out interaction.
After interactive prompting is illustrated by user side to user, receive by the confirmation interaction instruction of user input, wherein This confirmation interaction instruction can confirm interaction instruction for rapid double tap screen or slide etc., be not especially limited herein.Connecing After receiving user's confirmation interactive information, carry out confirming interaction mode classification to server communication, and carry out interaction in user side Operation.
205th, according to belonging to the first face position face position attribute, will interaction mode corresponding with the first face position On imaging importing corresponding position in the screen.
In receive user after the interaction instruction in the interaction mode classification prompting that screen taps or slide confirm, The attribute at face position according to belonging to the first face position, such as positive face, side face, eyes etc.;Or according to the second human region image In concrete characteristics of human body attribute, such as neck, palm, head etc., will present image corresponding with the first face position, word Image or point praise image, such as glasses, the present image such as relative's lip, or with the second human region image in concrete characteristics of human body Corresponding present image, character image or point praise image, are superimposed on corresponding position in screen, such as glasses present imaging importing On eyes, on the face of side, pendant present imaging importing is first-class in neck, herein not for relative's lip present imaging importing Make concrete restriction.Refer to Fig. 6 and Fig. 8, be that spectators send present effect diagram.Wherein, Fig. 6 sends glasses present for spectators Effect diagram, Fig. 8 sends relative's present effect diagram for spectators.
Pass through in the embodiment of the present invention to obtain live picture, analyze live picture, the human body being met according to live picture Characteristic attribute, carries out interaction mode classification prompting corresponding with characteristics of human body's attribute;The interaction mode classification that receive user confirms The interaction instruction of prompting, carries out interaction, solves in prior art, spectators user carries out interactive mistake with main broadcaster on mobile terminals Cheng Zhong, due to mobile terminal can viewing area limited, carry out interactive interface during interactive operation and will necessarily shelter from current live Picture, affects spectators' viewing experience, and spectators user carry out interactive operation need to complete multiple operations can successfully carry out with main The interaction broadcast, process is loaded down with trivial details, the technical problem of inefficiency.
The detailed description more than being carried out by the detailed process of the method interactive to live broadcast of mobile terminal, below for Live broadcast of mobile terminal interactive device provided in an embodiment of the present invention is described.
Refer to Fig. 3, an a kind of embodiment of live broadcast of mobile terminal interactive device provided in an embodiment of the present invention includes:
Acquiring unit 301, for obtaining live picture;
Analytic unit 302, for analyzing characteristics of human body's attribute that live picture meets;
Display unit 303, for the characteristics of human body's attribute being met according to live picture, is carried out and characteristics of human body's attribute pair The interaction mode classification prompting answered;
Receiving unit 304, the interaction instruction of the interaction mode classification prompting confirming for receive user, carry out interaction;
Superpositing unit 305, for the characteristics of human body's attribute being met according to live picture, will be corresponding with characteristics of human body's attribute Interaction mode imaging importing corresponding position in the screen on.
It is more than that an embodiment to a kind of live broadcast of mobile terminal interactive device provided in an embodiment of the present invention is carried out Description, partly will be described in detail to the concrete of live broadcast of mobile terminal interactive device provided in an embodiment of the present invention below.
Refer to Fig. 4, another embodiment bag of a kind of live broadcast of mobile terminal interactive device provided in an embodiment of the present invention Include:
Acquiring unit 401, for obtaining live picture.
Analytic unit 402, specifically includes:Timing analysis subelement 4021, integrates and specifies subelement 4022, the first analysis Unit 4023, judges to specify subelement 4024.
Timing analysis subelement 4021, for every the live picture of time piecewise analysis whether meet human face profile or Other human body appointed part.
Integrate and specify subelement 4022, be appointed as face for integrating the live picture area meeting human face profile Contour area, the regional display meeting human body appointed part is appointed as the first human region image.
First analysis subelement 4023, for being determined to face characteristic position in facial contour region, analysis judges Face characteristic position occupies screen area and/or whether width meets and preset occupy screen area and/or width, to the first human body Human body appointed part in area image is determined, and analysis judges that the human body appointed part in the first human region image occupies Whether screen area and/or width meet preset occupies screen area and/or width.
Judge to specify subelement 4024, for meeting the preset face characteristic position occupying screen area and/or width Or the first human body appointed part in human region image, enter the judgement whether line duration meets preset time period, if so, then Face characteristic position is appointed as the first face position, the first human region image is appointed as the second human region image.
Display unit 403, for the attribute at face position according to belonging to the first face position, display and the first face position The corresponding interactive prompting by word and/or image construction, or according to the concrete characteristics of human body's in the second human region image Attribute, display corresponding with the attribute of the concrete characteristics of human body in the second human region image by word and/or image construction Interactive prompting.
Receiving unit 404, the interaction instruction of the interaction mode classification prompting confirming for receive user, carry out interaction.
Superpositing unit 405, for the attribute at face position according to belonging to the first face position, will be right with the first face position On the interaction mode imaging importing answered corresponding position in the screen or special according to the concrete human body in the second human region image The attribute levied, by with the attribute corresponding interaction mode imaging importing of the concrete characteristics of human body in the second human region image in screen On corresponding position in curtain.
Below it is then that a kind of the concrete of live broadcast of mobile terminal interactive device provided in an embodiment of the present invention is partly carried out Detailed description.
In the embodiment of the present invention, live picture is obtained by acquiring unit 401, analytic unit 402 analyzes live picture, root The characteristics of human body's attribute being met according to live picture, carries out interaction mode classification prompting corresponding with characteristics of human body's attribute;Receive The interaction instruction of the interaction mode classification prompting that unit 404 receive user confirms, carries out interaction, solves in prior art, see Many users are carried out in interactive process with main broadcaster on mobile terminals, due to mobile terminal can viewing area limited, carry out interactive behaviour Interactive interface when making will necessarily shelter from current live picture, affects spectators' viewing experience, and spectators user carries out interactive behaviour Need to complete the interaction that multiple operations can successfully carry out with main broadcaster, process is loaded down with trivial details, the technical problem of inefficiency.
Those skilled in the art can be understood that, for convenience and simplicity of description, the system of foregoing description, Device and the specific work process of unit, may be referred to the corresponding process in preceding method embodiment, will not be described here.
It should be understood that disclosed system in several embodiments provided herein, apparatus and method are permissible Realize by another way.For example, device embodiment described above is only schematically, for example, described unit Divide, only a kind of division of logic function, actual can have other dividing mode when realizing, for example multiple units or assembly Can in conjunction with or be desirably integrated into another system, or some features can be ignored, or does not execute.Another, shown or The coupling each other discussing or direct-coupling or communication connection can be by some interfaces, the indirect coupling of device or unit Close or communicate to connect, can be electrical, mechanical or other forms.
The described unit illustrating as separating component can be or may not be physically separate, show as unit The part showing can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple On NE.The mesh to realize this embodiment scheme for some or all of unit therein can be selected according to the actual needs 's.
In addition, can be integrated in a processing unit in each functional unit in each embodiment of the present invention it is also possible to It is that unit is individually physically present it is also possible to two or more units are integrated in a unit.Above-mentioned integrated list Unit both can be to be realized in the form of hardware, it would however also be possible to employ the form of SFU software functional unit is realized.
If described integrated unit is realized and as independent production marketing or use using in the form of SFU software functional unit When, can be stored in a computer read/write memory medium.Based on such understanding, technical scheme is substantially The part in other words prior art being contributed or all or part of this technical scheme can be in the form of software products Embody, this computer software product is stored in a storage medium, including some instructions with so that a computer Equipment (can be personal computer, server, or network equipment etc.) executes the complete of each embodiment methods described of the present invention Portion or part steps.And aforesaid storage medium includes:USB flash disk, portable hard drive, read-only storage (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. are various can store journey The medium of sequence code.
The above, above example only in order to technical scheme to be described, is not intended to limit;Although with reference to front State embodiment the present invention has been described in detail, it will be understood by those within the art that:It still can be to front State the technical scheme described in each embodiment to modify, or equivalent is carried out to wherein some technical characteristics;And these Modification or replacement, do not make the essence of appropriate technical solution depart from the spirit and scope of various embodiments of the present invention technical scheme.

Claims (10)

1. a kind of interactive method of live broadcast of mobile terminal is it is characterised in that include:
Obtain live picture, analyze described live picture, the characteristics of human body's attribute being met according to described live picture, carry out with The corresponding interaction mode classification prompting of described characteristics of human body's attribute;
What receive user confirmed points out corresponding interaction instruction with described interaction mode classification, carries out interaction.
2. the interactive method of live broadcast of mobile terminal according to claim 1 is it is characterised in that the live picture of described acquisition, Analyze described live picture, including:
Obtain live picture, whether meet human face profile every picture live described in time piecewise analysis, if so, then will accord with The live picture area integration closing described human face profile is appointed as facial contour region.
3. the interactive method of live broadcast of mobile terminal according to claim 2 is it is characterised in that the live picture of described acquisition, Analyze described live picture, specifically include:
Obtain live picture, whether meet human face profile every picture live described in time piecewise analysis, if so, then will accord with The live picture area integration closing described human face profile is appointed as facial contour region;
Face characteristic position in described facial contour region is determined, judges that described face characteristic position occupies screen area And/or width whether meet preset occupy screen area and/or width, if so, then described preset occupy screen area to meeting And/or the described face characteristic position of width enters the judgement whether line duration meets preset time period, if so, then by described people Face characteristic portion is appointed as the first face position.
4. the interactive method of live broadcast of mobile terminal according to claim 3 it is characterised in that described according to described live picture Characteristics of human body's attribute that face is met, carries out interaction mode classification prompting corresponding with described characteristics of human body's attribute, including:
The attribute at face position according to belonging to described first face position, display corresponding with described first face position by word And/or the interactive prompting of image construction.
5. the interactive method of live broadcast of mobile terminal according to claim 1 is it is characterised in that what described receive user confirmed Point out corresponding interaction instruction with described interaction mode classification, carry out interaction, including:
Receive user points out corresponding interaction to refer to by confirm in screen taps or slide with described interaction mode classification Order, carries out interaction.
6. the interactive method of live broadcast of mobile terminal according to claim 3 is it is characterised in that what described receive user confirmed Point out corresponding interaction instruction with described interaction mode classification, after carrying out interaction, including:
The attribute at face position according to belonging to described first face position, will interaction mode corresponding with described first face position On imaging importing corresponding position in the described screen.
7. a kind of live broadcast of mobile terminal interactive device is it is characterised in that include:
Acquiring unit, analytic unit, display unit, receiving unit, superpositing unit;
Described acquiring unit, for obtaining live picture;
Described analytic unit, for analyzing characteristics of human body's attribute that described live picture meets;
Display unit, for the characteristics of human body's attribute being met according to live picture, carries out corresponding with described characteristics of human body's attribute Interaction mode classification prompting;
Receiving unit, confirm for receive user points out corresponding interaction instruction with described interaction mode classification, carries out interaction;
Superpositing unit, for the characteristics of human body's attribute being met according to described live picture, will be with described characteristics of human body's attribute pair On the interaction mode imaging importing answered corresponding position in the described screen.
8. live broadcast of mobile terminal interactive device according to claim 7 is it is characterised in that described analytic unit, including:
Timing analysis subelement, integration are specified subelement, the first analysis subelement, are judged to specify subelement;
Whether described timing analysis subelement, for meeting human face profile every picture live described in time piecewise analysis;
Described integration specifies subelement, is appointed as face for integrating the live picture area meeting described human face profile Contour area;
Described first analysis subelement, for being determined to face characteristic position in described facial contour region, judges described Face characteristic position occupies screen area and/or whether width meets and preset occupy screen area and/or width;
Described judge to specify subelement, for meeting the described preset described face characteristic occupying screen area and/or width The judgement whether line duration meets preset time period is entered at position, is if so, then appointed as described face characteristic position the first Face position.
9. live broadcast of mobile terminal interactive device according to claim 7 it is characterised in that described display unit specifically for The attribute at face position according to belonging to described first face position, display corresponding with described first face position by word and/ Or the interactive prompting of image construction.
10. live broadcast of mobile terminal interactive device according to claim 7 is it is characterised in that described superpositing unit is specifically used In the attribute at face position according to belonging to described first face position, will interaction mode literary composition corresponding with described first face position On word and/or imaging importing corresponding position in the described screen.
CN201610878194.4A 2016-09-30 2016-09-30 A kind of method and device of live broadcast of mobile terminal interaction Active CN106454481B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610878194.4A CN106454481B (en) 2016-09-30 2016-09-30 A kind of method and device of live broadcast of mobile terminal interaction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610878194.4A CN106454481B (en) 2016-09-30 2016-09-30 A kind of method and device of live broadcast of mobile terminal interaction

Publications (2)

Publication Number Publication Date
CN106454481A true CN106454481A (en) 2017-02-22
CN106454481B CN106454481B (en) 2019-08-23

Family

ID=58172306

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610878194.4A Active CN106454481B (en) 2016-09-30 2016-09-30 A kind of method and device of live broadcast of mobile terminal interaction

Country Status (1)

Country Link
CN (1) CN106454481B (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107222754A (en) * 2017-05-27 2017-09-29 武汉斗鱼网络科技有限公司 Present gives Notification Method, device and server
CN107564038A (en) * 2017-08-28 2018-01-09 北京小米移动软件有限公司 Offset parameter determines method and apparatus and skew control method and device
CN108391174A (en) * 2018-03-22 2018-08-10 乐蜜有限公司 Living broadcast interactive method, apparatus and electronic equipment
CN108401173A (en) * 2017-12-21 2018-08-14 平安科技(深圳)有限公司 Interactive terminal, method and the computer readable storage medium of mobile live streaming
CN108536492A (en) * 2018-04-08 2018-09-14 武汉斗鱼网络科技有限公司 A kind of direct broadcasting room attribute information acquiring method, device, equipment and storage medium
CN108924661A (en) * 2018-07-12 2018-11-30 北京微播视界科技有限公司 Data interactive method, device, terminal and storage medium based on direct broadcasting room
CN109286835A (en) * 2018-09-05 2019-01-29 武汉斗鱼网络科技有限公司 Direct broadcasting room interactive element display methods, storage medium, equipment and system
CN110830811A (en) * 2019-10-31 2020-02-21 广州酷狗计算机科技有限公司 Live broadcast interaction method, device, system, terminal and storage medium
CN111131127A (en) * 2018-10-30 2020-05-08 武汉斗鱼网络科技有限公司 Communication method based on live broadcast platform and related device
CN112019906A (en) * 2019-05-30 2020-12-01 上海哔哩哔哩科技有限公司 Live broadcast method, computer equipment and readable storage medium
WO2021109652A1 (en) * 2019-12-06 2021-06-10 广州华多网络科技有限公司 Method and apparatus for giving character virtual gift, device, and storage medium
CN112969087A (en) * 2021-03-15 2021-06-15 北京城市网邻信息技术有限公司 Information display method, client, electronic equipment and storage medium
CN115079911A (en) * 2022-06-14 2022-09-20 北京字跳网络技术有限公司 Data processing method, device, equipment and storage medium

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101246541A (en) * 2007-02-16 2008-08-20 索尼株式会社 Image-processing device and image-processing method, image-pickup device, and computer program
CN101478629A (en) * 2008-01-04 2009-07-08 华晶科技股份有限公司 Image processing process for regulating human face ratio
CN102055912A (en) * 2009-10-29 2011-05-11 北京中星微电子有限公司 Video application system, video special effect processing system and method
CN103024338A (en) * 2011-04-08 2013-04-03 数字光学欧洲有限公司 Display device with image capture and analysis module
CN103108248A (en) * 2013-01-06 2013-05-15 王汝迟 Interactive video implement method and system using the same
CN105049911A (en) * 2015-07-10 2015-11-11 西安理工大学 Video special effect processing method based on face identification
CN105187930A (en) * 2015-09-18 2015-12-23 广州酷狗计算机科技有限公司 Video live broadcasting-based interaction method and device
CN105334963A (en) * 2015-10-29 2016-02-17 广州华多网络科技有限公司 Method and system for displaying virtual article
CN105451029A (en) * 2015-12-02 2016-03-30 广州华多网络科技有限公司 Video image processing method and device
WO2016078189A1 (en) * 2014-11-21 2016-05-26 广州华多网络科技有限公司 Interaction method and related device, system based on video living broadcast
CN105872442A (en) * 2016-03-30 2016-08-17 宁波三博电子科技有限公司 Instant bullet screen gift giving method and instant bullet screen gift giving system based on face recognition

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101246541A (en) * 2007-02-16 2008-08-20 索尼株式会社 Image-processing device and image-processing method, image-pickup device, and computer program
CN101478629A (en) * 2008-01-04 2009-07-08 华晶科技股份有限公司 Image processing process for regulating human face ratio
CN102055912A (en) * 2009-10-29 2011-05-11 北京中星微电子有限公司 Video application system, video special effect processing system and method
CN103024338A (en) * 2011-04-08 2013-04-03 数字光学欧洲有限公司 Display device with image capture and analysis module
CN103108248A (en) * 2013-01-06 2013-05-15 王汝迟 Interactive video implement method and system using the same
WO2016078189A1 (en) * 2014-11-21 2016-05-26 广州华多网络科技有限公司 Interaction method and related device, system based on video living broadcast
CN105049911A (en) * 2015-07-10 2015-11-11 西安理工大学 Video special effect processing method based on face identification
CN105187930A (en) * 2015-09-18 2015-12-23 广州酷狗计算机科技有限公司 Video live broadcasting-based interaction method and device
CN105334963A (en) * 2015-10-29 2016-02-17 广州华多网络科技有限公司 Method and system for displaying virtual article
CN105451029A (en) * 2015-12-02 2016-03-30 广州华多网络科技有限公司 Video image processing method and device
CN105872442A (en) * 2016-03-30 2016-08-17 宁波三博电子科技有限公司 Instant bullet screen gift giving method and instant bullet screen gift giving system based on face recognition

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107222754A (en) * 2017-05-27 2017-09-29 武汉斗鱼网络科技有限公司 Present gives Notification Method, device and server
CN107564038A (en) * 2017-08-28 2018-01-09 北京小米移动软件有限公司 Offset parameter determines method and apparatus and skew control method and device
CN107564038B (en) * 2017-08-28 2021-11-30 北京小米移动软件有限公司 Offset parameter determination method and device and offset control method and device
CN108401173B (en) * 2017-12-21 2020-11-17 平安科技(深圳)有限公司 Mobile live broadcast interactive terminal, method and computer readable storage medium
CN108401173A (en) * 2017-12-21 2018-08-14 平安科技(深圳)有限公司 Interactive terminal, method and the computer readable storage medium of mobile live streaming
WO2019119643A1 (en) * 2017-12-21 2019-06-27 平安科技(深圳)有限公司 Interaction terminal and method for mobile live broadcast, and computer-readable storage medium
CN108391174A (en) * 2018-03-22 2018-08-10 乐蜜有限公司 Living broadcast interactive method, apparatus and electronic equipment
CN108391174B (en) * 2018-03-22 2021-08-20 卓米私人有限公司 Live broadcast interaction method and device and electronic equipment
CN108536492A (en) * 2018-04-08 2018-09-14 武汉斗鱼网络科技有限公司 A kind of direct broadcasting room attribute information acquiring method, device, equipment and storage medium
CN108536492B (en) * 2018-04-08 2021-09-07 武汉斗鱼网络科技有限公司 Method, device, equipment and storage medium for acquiring attribute information of live broadcast room
CN108924661A (en) * 2018-07-12 2018-11-30 北京微播视界科技有限公司 Data interactive method, device, terminal and storage medium based on direct broadcasting room
WO2020010819A1 (en) * 2018-07-12 2020-01-16 北京微播视界科技有限公司 Live broadcast room-based data interaction method and device, terminal, and storage medium
CN109286835A (en) * 2018-09-05 2019-01-29 武汉斗鱼网络科技有限公司 Direct broadcasting room interactive element display methods, storage medium, equipment and system
CN111131127A (en) * 2018-10-30 2020-05-08 武汉斗鱼网络科技有限公司 Communication method based on live broadcast platform and related device
CN111131127B (en) * 2018-10-30 2022-04-12 武汉斗鱼网络科技有限公司 Communication method based on live broadcast platform and related device
CN112019906A (en) * 2019-05-30 2020-12-01 上海哔哩哔哩科技有限公司 Live broadcast method, computer equipment and readable storage medium
CN110830811A (en) * 2019-10-31 2020-02-21 广州酷狗计算机科技有限公司 Live broadcast interaction method, device, system, terminal and storage medium
WO2021109652A1 (en) * 2019-12-06 2021-06-10 广州华多网络科技有限公司 Method and apparatus for giving character virtual gift, device, and storage medium
CN112969087A (en) * 2021-03-15 2021-06-15 北京城市网邻信息技术有限公司 Information display method, client, electronic equipment and storage medium
CN115079911A (en) * 2022-06-14 2022-09-20 北京字跳网络技术有限公司 Data processing method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN106454481B (en) 2019-08-23

Similar Documents

Publication Publication Date Title
CN106454481A (en) Live broadcast interaction method and apparatus of mobile terminal
CN108322788B (en) Advertisement display method and device in live video
CN108234591B (en) Content data recommendation method and device based on identity authentication device and storage medium
CN107197384B (en) The multi-modal exchange method of virtual robot and system applied to net cast platform
CN110460899B (en) Bullet screen content display method, terminal equipment and computer readable storage medium
CN102710991B (en) Messaging device, information processing method and program
CN105975980A (en) Method of monitoring image mark quality and apparatus thereof
CN106231434A (en) A kind of living broadcast interactive specially good effect realization method and system based on Face datection
CN106303354B (en) Face special effect recommendation method and electronic equipment
CN106921868A (en) A kind of barrage dissemination method and device
CN110674664A (en) Visual attention recognition method and system, storage medium and processor
CN106302477A (en) A kind of net cast method of testing and system
CN112188220A (en) Method and device for prompting information in live broadcast, storage medium and electronic device
CN105892635A (en) Image capture realization method and apparatus as well as electronic device
CN106354777A (en) Question searching method and device applied to electronic terminal
CN114245155A (en) Live broadcast method and device and electronic equipment
CN113163269A (en) Live broadcast room entering method and device, electronic equipment and storage medium
US11800217B2 (en) Multimedia data processing method and apparatus
CN109344726A (en) A kind of advertisement placement method and device
CN109409759B (en) Data mining system and method based on coal mine safety training game
CN114051116A (en) Video monitoring method, device and system for driving test vehicle
CN106844780A (en) Picture sending method and picture send system
CN107343221B (en) Online multimedia interaction system and method
CN104049833A (en) Terminal screen image displaying method based on individual biological characteristics and terminal screen image displaying device based on individual biological characteristics
CN110971924B (en) Method, device, storage medium and system for beautifying in live broadcast process

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20210111

Address after: 510000 3108, 79 Wanbo 2nd Road, Nancun Town, Panyu District, Guangzhou City, Guangdong Province

Patentee after: GUANGZHOU CUBESILI INFORMATION TECHNOLOGY Co.,Ltd.

Address before: 511449 Wanda Plaza, Nancun Town, Panyu District, Guangzhou City, Guangdong Province

Patentee before: GUANGZHOU HUADUO NETWORK TECHNOLOGY Co.,Ltd.

TR01 Transfer of patent right