CN109120985A - Image display method, apparatus and storage medium in live streaming - Google Patents

Image display method, apparatus and storage medium in live streaming Download PDF

Info

Publication number
CN109120985A
CN109120985A CN201811185967.6A CN201811185967A CN109120985A CN 109120985 A CN109120985 A CN 109120985A CN 201811185967 A CN201811185967 A CN 201811185967A CN 109120985 A CN109120985 A CN 109120985A
Authority
CN
China
Prior art keywords
main broadcaster
virtual role
image display
movement
control parameter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811185967.6A
Other languages
Chinese (zh)
Other versions
CN109120985B (en
Inventor
蓝永峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Huya Information Technology Co Ltd
Original Assignee
Guangzhou Huya Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Huya Information Technology Co Ltd filed Critical Guangzhou Huya Information Technology Co Ltd
Priority to CN202110615701.6A priority Critical patent/CN113286186B/en
Priority to CN201811185967.6A priority patent/CN109120985B/en
Publication of CN109120985A publication Critical patent/CN109120985A/en
Application granted granted Critical
Publication of CN109120985B publication Critical patent/CN109120985B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174Facial expression recognition
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

This application involves the image display method, apparatus and storage medium in network direct broadcasting technical field more particularly to a kind of live streaming.Image display method in the live streaming, comprising: obtain the corresponding control parameter of image display of main broadcaster;Movement is executed according to the corresponding virtual role of control parameter control main broadcaster;The client end interface that the execution movement of the virtual role is sent to spectators is shown.Using scheme provided by the present application, interacted using virtual role with spectators convenient for main broadcaster user.

Description

Image display method, apparatus and storage medium in live streaming
Technical field
This application involves network direct broadcasting technical fields, specifically, this application involves the image display sides in a kind of live streaming Method, device and storage medium.
Background technique
The advantage that internet was drawn and continued to network direct broadcasting utilizes internet for the user for having live broadcast demand With advanced multimedia communication technology, by the net building one collection audio, video, Desktop Share, document sharing, mutual rotating ring Save the multifunctional network live streaming platform being integrated, enterprise or personal comprehensive friendship that voice, video, data can be carried out with direct-on-line It flows and interacts.
In the live streaming of existing internet, in order to spectators have it is preferable interact, main broadcaster is big, and more options directly enter mirror, in spectators When giving virtual present etc. main broadcaster being needed to provide response, the main broadcaster for entering mirror can be by sound, facial expression or body language come table Show thanks, for some main broadcasters being reluctant into mirror or inconvenient immigration, covers or be blurred with other images often through by main broadcaster Etc. modes handle, after handling via this mode, main broadcaster can not accurately convey the feedback information of spectators, and interaction effect is bad, Viewer experience is had a greatly reduced quality.
Apply for content
The application is directed to existing the shortcomings that can not well being interacted with spectators, proposes the image display in a kind of live streaming Method, apparatus and storage medium, are interacted using virtual role with spectators convenient for main broadcaster user.
The embodiment of the present application proposes a kind of image display method in live streaming first, includes the following steps:
Obtain the corresponding control parameter of image display of main broadcaster;
Movement is executed according to the corresponding virtual role of control parameter control main broadcaster;
The client end interface that the execution movement of the virtual role is sent to spectators is shown.
Preferably, the step of image display corresponding control parameter for obtaining main broadcaster, comprising:
Identify the facial image of main broadcaster;
The posture feature information of main broadcaster is obtained according to the facial image;
The posture feature information is converted to the control parameter for controlling the image display of the main broadcaster.
Preferably, the step of image display corresponding control parameter for obtaining main broadcaster, comprising:
Obtain the control instruction of main broadcaster's input;Wherein, the control instruction is to be associated in advance with virtual role, and be supplied to The instruction that main broadcaster is inputted;
The control instruction is converted to the control parameter of the image display of the main broadcaster.
Preferably, it is described according to the control parameter control main broadcaster selection virtual role execution act the step of it Before, comprising:
Multiple virtual roles are showed to the client end interface of main broadcaster;
According to selection operation of the main broadcaster on the client end interface, determine the virtual role that the main broadcaster selects for needs The virtual role of displaying.
Preferably, it is described according to the control parameter control main broadcaster selection virtual role execution act the step of it Before, comprising:
Multiple background frames are showed to the client end interface of main broadcaster;
According to selection operation of the main broadcaster on the client end interface, the background of current anchor direct broadcasting room is replaced with described The background frame of main broadcaster's selection.
Preferably, described that the execution movement of the virtual role is sent to the step that the client end interface of spectators is shown Suddenly, comprising:
It detects the virtual role and whether has executed and described execute movement;
If it is not, identifying the current action that the virtual role is carrying out, the current action being carrying out is carried out Gradual change processing, splice the current action and it is described execute movement, control that virtual role execution is described to execute movement.
Preferably, described that the execution movement of the virtual role is sent to the step that the client end interface of spectators is shown After rapid, further includes:
After the virtual role completes the execution movement, whether detection current time, which receives next execution movement, refers to It enables;
If not receiving next execution action command, controls the virtual role and execute deliberate action.
Further, the embodiment of the present application also provides the image display devices in a kind of live streaming, comprising:
Obtain module, the corresponding control parameter of image display for obtaining main broadcaster;
Control module, for executing movement according to the corresponding virtual role of control parameter control main broadcaster;
Display module, the client end interface for the execution movement of the virtual role to be sent to spectators are shown.
Further, the embodiment of the present application also provides a kind of computer readable storage medium, it is stored thereon with computer The step of program, which realizes the image display method in live streaming described in aforementioned any one when being executed by processor.
Further, the embodiment of the present application also provides a kind of computer equipment, the computer equipment includes:
One or more processors;
Storage device, for storing one or more programs,
When one or more of programs are executed by one or more of processors, so that one or more of processing Device realizes the step of image display method in live streaming described in above-mentioned any one technical solution.
Compared with prior art, the application at least have it is following the utility model has the advantages that
The embodiment of the present application provides a kind of image display method in live streaming, passes through the corresponding control of the image display of main broadcaster Parameter processed executes movement control virtual role, and the virtual role is executed action demonstration in the client end interface of spectators On, show that the virtual role of characterization main broadcaster's image, the virtual role are joined according to the control of main broadcaster on the client end interface of spectators Several variations and change, not only met the needs of main broadcaster's not appearance, but also can interact with the virtual role flexibly changed with spectators, Interaction effect is improved, user experience is promoted.
The additional aspect of the application and advantage will be set forth in part in the description, these will become from the following description It obtains obviously, or recognized by the practice of the application.
Detailed description of the invention
The application is above-mentioned and/or additional aspect and advantage will become from the following description of the accompanying drawings of embodiments Obviously and it is readily appreciated that, in which:
Fig. 1 is the flow diagram of the image display method in the live streaming that one embodiment of the application provides;
Fig. 2 is the process signal of the corresponding control parameter of image display for the acquisition main broadcaster that one embodiment of the application provides Figure;
Fig. 3 is the procedure Procedure of the corresponding control parameter of image display for the acquisition main broadcaster that another embodiment of the application provides Figure;
Fig. 4 is the schematic diagram of a scenario of the application embodiment illustrated in fig. 3;
Fig. 5 is the client that the execution movement of the virtual role is sent to spectators that a kind of embodiment of the application provides The flow diagram that interface is shown;
Fig. 6 is the structural schematic diagram of the image display device in a kind of live streaming that embodiment provides of the application;
Fig. 7 is a kind of structural schematic diagram for the computer equipment that embodiment provides of the application.
Specific embodiment
Embodiments herein is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached The embodiment of figure description is exemplary, and is only used for explaining the application, and cannot be construed to the limitation to the application.
Those skilled in the art of the present technique are appreciated that unless expressly stated, singular " one " used herein, " one It is a ", " described " and "the" may also comprise plural form.It is to be further understood that being arranged used in specification of the invention Diction " comprising " refer to that there are the feature, integer, step, operation, element and/or component, but it is not excluded that in the presence of or addition Other one or more features, integer, step, operation, element, component and/or their group.
It is appreciated that term " first " used in the present invention, " second " etc. can be used to describe various elements herein, But these elements should not be limited by these terms.These terms are only used to distinguish the first element from the other element.Citing comes It says, without departing from the scope of the invention, the first live video image can be known as to the second live video image, and Similarly, the second live video image can be known as the first live video image.First live video image and the second live streaming view Frequency image both live video image, but it is not the same live video image.
Those skilled in the art of the present technique are appreciated that unless otherwise defined, all terms used herein (including technology art Language and scientific term), there is meaning identical with the general understanding of those of ordinary skill in fields of the present invention.Should also Understand, those terms such as defined in the general dictionary, it should be understood that have in the context of the prior art The consistent meaning of meaning, and unless idealization or meaning too formal otherwise will not be used by specific definitions as here To explain.
It includes setting for wireless signal receiver that those skilled in the art of the present technique, which are appreciated that client used herein above both, It is standby, only have the equipment of the wireless signal receiver of non-emissive ability, and the equipment including receiving and emitting hardware, has The reception of two-way communication on bidirectional communication link, can be executed and emit the equipment of hardware.This equipment may include: honeycomb Or other communication equipments, with single line display or multi-line display or without the honeycomb of multi-line display or other Communication equipment;PCS (Personal Communications Service, PCS Personal Communications System), can be with combine voice, number According to processing, fax and/or communication ability;PDA (Personal Digital Assistant, personal digital assistant), It may include radio frequency receiver, pager, the Internet/intranet access, web browser, notepad, calendar and/or GPS (Global Positioning System, global positioning system) receiver;Conventional laptop and/or palmtop computer or Other equipment, have and/or the conventional laptop including radio frequency receiver and/or palmtop computer or other equipment.This In used client can be it is portable, can transport, be mounted in the vehicles (aviation, sea-freight and/or land), or Person is suitable for and/or is configured in local runtime, and/or with distribution form, operates in any other position in the earth and/or space Set operation.
Present invention firstly provides a kind of image display method in live streaming, this method is suitable in main broadcaster's client executing, In a kind of embodiment, the method comprising the steps of S11, S12, S13, flow diagram is as shown in Figure 1, specifically include following step It is rapid:
S11 obtains the corresponding control parameter of image display of main broadcaster.
The image display includes the information such as expression, movement, form, the clothes of main broadcaster, and main broadcaster described herein is it His spectators show the user of oneself, including being main broadcaster that spectators show intelligence and art between main broadcaster, also may include into direct broadcasting room and The background of direct broadcasting room is set as scene of game, traditional main broadcaster and spectators by the spectators that can be seen by other spectators, such as traditional main broadcaster The corresponding virtual role for finding oneself enters the scene, and in this scenario, the virtual role of traditional main broadcaster and spectators are both needed to reality When make a response, traditional main broadcaster and spectators at this time all can be main broadcaster described herein.
In a kind of embodiment, the corresponding control parameter step of image display for obtaining main broadcaster, flow diagram is such as Shown in Fig. 2, including following sub-step:
S21 identifies the facial image of main broadcaster;
In a kind of embodiment, before the facial image of the identification main broadcaster, further includes: obtain the facial image of main broadcaster. Facial image is identified using image recognition technology.To the facial image for carrying out accurately identifying main broadcaster, multiple available masters The facial image broadcast establishes the identification model of main broadcaster using a large amount of training samples, improves the accuracy rate and speed of identification main broadcaster.
S22 obtains the posture feature information of main broadcaster according to the facial image.
Facial image is parsed by image recognition algorithm, main broadcaster is extracted and exists in the characteristic information for doing various postures, such as main broadcaster Laugh, smile, the expressions such as forced smile when, obtain the bending degree of its eye, eyebrow, the shape of mouth, number toothy or The characteristic informations such as area, so as to the control such as subsequent expression, form, movement for controlling main broadcaster's image according to the characteristic information Parameter.
The posture feature information is converted to the control parameter for controlling the image display of the main broadcaster by S23.
Using the posture feature information of the step S22 main broadcaster obtained, the current posture feature information of main broadcaster is converted into control The control parameter of the image display of main broadcaster processed, such as obtaining the current posture of main broadcaster is to smile, then according to this feature information acquisition master The control parameter for the image display broadcast, the posture feature information of main broadcaster are that eyes crooked radian is 10 °, and the corners of the mouth raises up 15 °, are exposed 6 teeth etc., according to the incidence relation between the posture feature information of the main broadcaster and the control parameter of the image display of main broadcaster, The corresponding control parameter for determining the image display, the virtual role as main broadcaster selects is a kitten, the image display of main broadcaster Control parameter be eyes crooked radian be 10 °, the corners of the mouth raises up 15 °, exposes the control parameter of the corresponding virtual role of 6 teeth Are as follows: the eyes bending degree of kitten is 45 °, and the corners of the mouth raises up 30 °.
Scheme provided by the embodiments of the present application, by the facial image of intelligent recognition main broadcaster, according to the posture feature of main broadcaster Information controls the control parameter of the image display of main broadcaster, the control parameter of adjust automatically main broadcaster image is realized, so as to according to Control parameter controls the movement of virtual role, without manually adjusting the control parameter of image display, promotes user experience.
In a kind of embodiment, the corresponding control parameter of image display for obtaining main broadcaster, moreover it is possible to pass through following sub-step It realizes, specifically includes following sub-step:
S31 obtains the control instruction of main broadcaster's input;Wherein, the control instruction is to be associated in advance with virtual role, and mention The instruction that supply main broadcaster is inputted.
The virtual role is the estoverman in the moon in pre-set creativity works, image or is customized according to main broadcaster's image Cartoon figure, main broadcaster input control instruction it is associated with the virtual role that it is selected, each movement of virtual role is right An individual control element is answered, is triggered by main broadcaster, each movement is provided with control panel, which can be with one The form of knob or progress bar characterization, by taking progress bar as an example, each movement of virtual role corresponds to a progress bar, and number is arranged Value is that 0, which represents the movement, is not triggered between 0~1, and 1, which represents the movement, is in triggering state.When a movement is in triggering shape When state, the progress bar is slided, which can occur the variation of movement range size, and schematic diagram of a scenario provided in this embodiment is as schemed Shown in 4.
Preferably, when detecting that the progress bar is designated as 0, the identification operation for doing the movement is not needed, at this moment to mention High efficiency saves resource.
In a kind of application scenarios, when detecting that progress bar is directed toward 1, i.e. the movement is in triggering state, can receive use The control instruction or identification operation at family, identify the posture feature information of main broadcaster.Using specific algorithm combination product demand, find Corresponding action module is needed, as the sound of main broadcaster's sending " hello " or movement think this when " hello " is detected Movement needs to be triggered.If the movement has been triggered, do not deal with, otherwise, first stop identification maneuver, triggering is not dynamic Make, then find the movement currently triggered, gradual-change animation is done to it, natural transition between two movements is allowed to switch.
When be in 0 state when, progress bar does not start to slide, show at this time and the inactive progress bar characterization movement, At this moment background action controller is reoriented to the movement currently identified, and reset controller size and the layout one currently identified It causes, the corresponding animation of display virtual role identifies the movement being currently up, and show the movement in viewer end.
The control instruction is converted to the control parameter of the image display of the main broadcaster by S32.
The control instruction that user issues is converted into the control parameter of the image display of main broadcaster, before the step S32, also It include: the mapping relations pre-established between the control parameter of the image display of the control instruction and the main broadcaster, with after an action of the bowels The control instruction that continuous basis currently obtains obtains rapidly the control parameter of the image display of corresponding main broadcaster.
The embodiment of the present application is converted to the control parameter of the image display of main broadcaster by instructing main broadcaster's input control, makes to lead The main broadcaster for being presented in viewer end image can be manually controlled by broadcasting, and without acquiring the facial image of main broadcaster in real time, reduce the processing of system Complexity and system energy consumption.
S12 executes movement according to the virtual role of control parameter control main broadcaster's selection.
Before the execution movement for receiving the virtual role of control parameter control main broadcaster's selection, further includes: will be multiple Virtual role shows the client end interface of main broadcaster;According to selection operation of the main broadcaster on the client end interface, determines and need The virtual role of displaying.
Specifically, there are when multiple virtual roles, the multiple virtual role is showed to the client of main broadcaster, to lead Broadcast the image that oneself is shown according to the hobby selection virtual role of oneself.As main broadcaster can choose kitten, doggie as oneself shape As the virtual role of displaying.
In a kind of embodiment, the step of being acted according to the execution that the control parameter controls the virtual role of main broadcaster's selection it Before, comprising: multiple background frames are showed to the client end interface of main broadcaster;According to selection of the main broadcaster on the client end interface Operation, replaces with the selected background frame for the background frame of current anchor direct broadcasting room.
Main broadcaster can select suitable background according to current live theme, the theme such as: music, it is sound that background, which may be selected, Happy hall etc., the background include but is not limited to the backgrounds such as scene of game, star show, Outdoor Scene, bring the experience of user's immersion.
In a kind of embodiment, before step S12, further includes: establish the image display of main broadcaster control parameter and virtual angle Incidence relation between the control parameter of color.
In a kind of embodiment, the historical behavior data of main broadcaster and virtual role are obtained, it is true according to the historical behavior data Under fixed same posture, the incidence relation between the control parameter of the image display of main broadcaster and the control parameter of virtual role, as above Described in one example, main broadcaster determines that characterizing the virtual role of its image display is kitten, detects that the posture feature information of main broadcaster is Eyes crooked radian is 10 °, and the corners of the mouth raises up 15 °, exposes 6 teeth, shows the current posture of main broadcaster to smile, by virtual angle The limitation of color design, the kitten in virtual role may deposit without design tooth, the posture feature information that kitten is smiled with main broadcaster In larger difference, then the control parameter of kitten can be determined according to the incidence relation that historical data is established are as follows: eyes bending Degree is 45 °, and the corners of the mouth raises up 30 °.
The incidence relation between the control parameter of the image display of main broadcaster and the control parameter of virtual role is pre-established, is had Conducive to the control parameter for obtaining virtual role rapidly according to the control parameter of the image display of current anchor, have in virtual role more When kind of selection, pre-establish that the incidence relation is particularly important, it can be fast according to the current posture feature information of current anchor Speed control virtual role makes corresponding feedback information.
In a kind of embodiment, the pass between the control parameter of the image display of main broadcaster and the control parameter of virtual role is established Connection relationship can establish the control parameter of the image display of main broadcaster and the control parameter of virtual role by a large amount of training samples Between identification model, can quickly and accurately be obtained according to the posture feature information of the main broadcaster currently obtained its selection it is virtual The control parameter of role.
The client end interface that the execution movement of the virtual role is sent to spectators is shown by S13.
The virtual role of main broadcaster's selection is shown into its movement, a kind of implementation in the client of spectators according to execution movement In example, step S13 includes following sub-step, and flow diagram is as shown in figure 5, detailed process is as follows:
Whether S51, detect the virtual role and executed and described execute movement.
Detect whether the virtual role is responding instruction relevant to execution movement, if so, continuing to execute The movement, if the execution movement be a series of continuous actions, obtain virtual role current action whether with current time into Spend it is corresponding movement match, if matching, it is determined that the virtual role be carrying out it is described execute movement, if mismatch, really The fixed virtual role, which is not carried out, described executes movement.
S52, if it is not, the current action that the virtual role is carrying out is identified, to the current action being carrying out Carry out gradual change processing, splice the current action and it is described execute movement, control that virtual role execution is described to execute movement.
If the virtual traveling of user's selection be not carried out it is current execute movement, identify what the virtual role was carrying out Current action obtains the current action being currently executing, and the characteristic information of the current action and execution movement is obtained, according to two The characteristic information of kind splices the current action and executes movement with described, carries out gradual change processing to the current action being carrying out, After the completion of the current action, oneself that the virtual role execution is described to execute movement, acts with two kinds of execution of realization is controlled Right transition.
In a kind of embodiment, after the step S13, further includes: after the virtual role completes the execution movement, inspection Survey whether current time receives next execution action command;If not receiving next execution action command, the void is controlled Quasi- role executes deliberate action.
Specifically, after the completion of virtual role execution movement, whether detection current time has next execution action command, And if next execution action command is not detected, enter standby action state, the standby action state can be Deliberate action, as the smile of kitten acts.Scheme provided by the present application executes deliberate action automatically, has when no execution acts Conducive to the flexible state for keeping virtual role.
Image display scheme in live streaming provided by the embodiments of the present application passes through the image display associated control parameters of main broadcaster Movement is executed control virtual role, by the execution action demonstration of the virtual role on the client end interface of spectators, is seen Show the virtual role for characterizing main broadcaster's image on many client end interfaces, the virtual role is according to the change of the control parameter of main broadcaster Change and change, not only met the needs of main broadcaster is unable to appearance, but also can interact with the virtual role flexibly changed with spectators, is promoted User experience.
Further, the embodiment of the invention also provides the image display devices in a kind of live streaming, and structural schematic diagram is such as Shown in Fig. 6, comprising: obtain module 61, control module 62, display module 63, the function of each module is specific as follows:
Obtain module 61, the corresponding control parameter of image display for obtaining main broadcaster;
Control module 62, the virtual role for controlling main broadcaster's selection according to the control parameter execute movement;
Display module 63, the client end interface for the execution movement of the virtual role to be sent to spectators are opened up Show.
About the image display device in the live streaming in above-described embodiment, wherein modules, unit execute the tool of operation Body mode is described in detail in the embodiment of the method, and no detailed explanation will be given here.
Further, the embodiment of the present invention also provides a kind of computer readable storage medium, is stored thereon with computer journey Sequence, the program realize the image display method in live streaming described in above-mentioned any one when being executed by processor.Wherein, described to deposit Storage media includes but is not limited to any kind of disk (including floppy disk, hard disk, CD, CD-ROM and magneto-optic disk), ROM (Read- Only Memory, read-only memory), RAM (Random AcceSS Memory, immediately memory), EPROM (EraSable Programmable Read-Only Memory, Erarable Programmable Read only Memory), EEPROM (Electrically EraSable Programmable Read-Only Memory, Electrically Erasable Programmable Read-Only Memory), flash memory, magnetic card Or light card.It is, storage medium includes the form storage or transmission information by equipment (for example, computer) can read Any medium.It can be read-only memory, disk or CD etc..
Further, the embodiment of the present invention also provides a kind of computer equipment, and the computer equipment can be service Device, the computer equipment include:
One or more processors;
Storage device, for storing one or more programs,
When one or more of programs are executed by one or more of processors, so that one or more of processing Device realizes the image display method in live streaming described in above-mentioned any one technical solution.
Fig. 7 is the structural schematic diagram of computer equipment of the present invention, including processor 720, storage device 730, input unit The devices such as 740 and display unit 750.It will be understood by those skilled in the art that the structure devices shown in Fig. 7 are not constituted to institute There is the restriction of computer equipment, may include than illustrating more or fewer components, or the certain components of combination.Storage device 730 can be used for storing application program 710 and each functional module, and processor 720 runs the application journey for being stored in storage device 730 Sequence 710, thereby executing the various function application and data processing of equipment.Storage device 730 can be built-in storage or external memory Reservoir, or including both built-in storage and external memory.Built-in storage may include read-only memory, programming ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory or random storage Device.External memory may include hard disk, floppy disk, ZIP disk, USB flash disk, tape etc..Storage device disclosed in this invention includes but not It is limited to the storage device of these types.Storage device 730 disclosed in this invention is only used as example rather than as restriction.
Input unit 740 is used to receive the input of signal, and input unit 740 may include that touch panel and other inputs are set It is standby.Touch panel collects the touch operation of user on it or nearby, and (for example user is any suitable using finger, stylus etc. The operation of object or attachment on touch panel or near touch panel), and driving is corresponding according to a pre-set procedure Attachment device;Other input equipments can include but is not limited to physical keyboard, function key (such as play control button, switch press Key etc.), trace ball, mouse, one of operating stick etc. or a variety of.Display unit 750 can be used for showing the information of user's input Or it is supplied to the information of user and the various menus of computer equipment.Liquid crystal display, You Jifa can be used in display unit 750 The forms such as optical diode.Processor 720 is the control centre of computer equipment, utilizes various interfaces and the entire computer of connection Various pieces, by running or execute the software program and/or module that are stored in storage device 730, and call storage Data in storage device perform various functions and handle data.
In one embodiment, computer equipment includes one or more processors 720, and one or more storage dresses 730 are set, one or more application program 710, wherein one or more of application programs 710 are stored in storage device 730 In and be configured as being executed by one or more of processors 720, one or more of application programs 710 are configured to hold Image display method in live streaming described in row above embodiments.
It should be understood that although each step in the flow chart of attached drawing is successively shown according to the instruction of arrow, These steps are not that the inevitable sequence according to arrow instruction successively executes.Unless expressly stating otherwise herein, these steps Execution there is no stringent sequences to limit, can execute in the other order.Moreover, at least one in the flow chart of attached drawing Part steps may include that perhaps these sub-steps of multiple stages or stage are not necessarily in synchronization to multiple sub-steps Completion is executed, but can be executed at different times, execution sequence, which is also not necessarily, successively to be carried out, but can be with other At least part of the sub-step or stage of step or other steps executes in turn or alternately.
It should be understood that each functional unit in various embodiments of the present invention can be integrated in a processing module, It can be physically existed alone, can also be integrated in two or more units in a module with each unit.It is above-mentioned integrated Module both can take the form of hardware realization, can also be realized in the form of software function module.
The above is only some embodiments of the application, it is noted that for the ordinary skill people of the art For member, under the premise of not departing from the application principle, several improvements and modifications can also be made, these improvements and modifications are also answered It is considered as the protection scope of the application.

Claims (10)

1. a kind of image display method in live streaming characterized by comprising
Obtain the corresponding control parameter of image display of main broadcaster;
Movement is executed according to the corresponding virtual role of control parameter control main broadcaster;
The client end interface that the execution movement of the virtual role is sent to spectators is shown.
2. the image display method in live streaming according to claim 1, which is characterized in that the vivid exhibition for obtaining main broadcaster The step of showing corresponding control parameter, comprising:
Identify the facial image of main broadcaster;
The posture feature information of main broadcaster is obtained according to the facial image;
The posture feature information is converted to the control parameter for controlling the image display of the main broadcaster.
3. the image display method in live streaming according to claim 1, which is characterized in that the vivid exhibition for obtaining main broadcaster The step of showing corresponding control parameter, comprising:
Obtain the control instruction of main broadcaster's input;Wherein, the control instruction is to be associated in advance with virtual role, and be supplied to main broadcaster The instruction inputted;
The control instruction is converted to the control parameter of the image display of the main broadcaster.
4. the image display method in live streaming according to claim 1, which is characterized in that described according to the control parameter Before the step of controlling the execution movement of the virtual role of main broadcaster's selection, comprising:
Multiple virtual roles are showed to the client end interface of main broadcaster;
According to selection operation of the main broadcaster on the client end interface, the virtual role that the main broadcaster selects is determined to need to show Virtual role.
5. the image display method in live streaming according to claim 1, which is characterized in that described according to the control parameter Before the step of controlling the execution movement of the virtual role of main broadcaster's selection, comprising:
Multiple background frames are showed to the client end interface of main broadcaster;
According to selection operation of the main broadcaster on the client end interface, the background of current anchor direct broadcasting room is replaced with into the main broadcaster The background frame of selection.
6. the image display method in live streaming according to claim 1, which is characterized in that described by the virtual role The step of client end interface that execution movement is sent to spectators is shown, comprising:
It detects the virtual role and whether has executed and described execute movement;
If it is not, identifying the current action that the virtual role is carrying out, gradual change is carried out to the current action being carrying out Processing, splice the current action and it is described execute movement, control that virtual role execution is described to execute movement.
7. the image display method in live streaming according to claim 1, which is characterized in that described by the virtual role After the step of client end interface that execution movement is sent to spectators is shown, further includes:
After the virtual role completes the execution movement, whether detection current time receives next execution action command;
If not receiving next execution action command, controls the virtual role and execute deliberate action.
8. the image display device in a kind of live streaming characterized by comprising
Obtain module, the corresponding control parameter of image display for obtaining main broadcaster;
Control module, for executing movement according to the corresponding virtual role of control parameter control main broadcaster;
Display module, the client end interface for the execution movement of the virtual role to be sent to spectators are shown.
9. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is held by processor The step of image display method in live streaming as claimed in any of claims 1 to 7 in one of claims is realized when row.
10. a kind of computer equipment, which is characterized in that the computer equipment includes:
One or more processors;
Storage device, for storing one or more programs,
When one or more of programs are executed by one or more of processors, so that one or more of processors are real Now as claimed in any of claims 1 to 7 in one of claims live streaming in image display method the step of.
CN201811185967.6A 2018-10-11 2018-10-11 Image display method and device in live broadcast and storage medium Active CN109120985B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202110615701.6A CN113286186B (en) 2018-10-11 2018-10-11 Image display method, device and storage medium in live broadcast
CN201811185967.6A CN109120985B (en) 2018-10-11 2018-10-11 Image display method and device in live broadcast and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811185967.6A CN109120985B (en) 2018-10-11 2018-10-11 Image display method and device in live broadcast and storage medium

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202110615701.6A Division CN113286186B (en) 2018-10-11 2018-10-11 Image display method, device and storage medium in live broadcast

Publications (2)

Publication Number Publication Date
CN109120985A true CN109120985A (en) 2019-01-01
CN109120985B CN109120985B (en) 2021-07-23

Family

ID=64857918

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202110615701.6A Active CN113286186B (en) 2018-10-11 2018-10-11 Image display method, device and storage medium in live broadcast
CN201811185967.6A Active CN109120985B (en) 2018-10-11 2018-10-11 Image display method and device in live broadcast and storage medium

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN202110615701.6A Active CN113286186B (en) 2018-10-11 2018-10-11 Image display method, device and storage medium in live broadcast

Country Status (1)

Country Link
CN (2) CN113286186B (en)

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109788345A (en) * 2019-03-29 2019-05-21 广州虎牙信息科技有限公司 Live-broadcast control method, device, live streaming equipment and readable storage medium storing program for executing
CN109905724A (en) * 2019-04-19 2019-06-18 广州虎牙信息科技有限公司 Live video processing method, device, electronic equipment and readable storage medium storing program for executing
CN109922355A (en) * 2019-03-29 2019-06-21 广州虎牙信息科技有限公司 Virtual image live broadcasting method, virtual image live broadcast device and electronic equipment
CN110062267A (en) * 2019-05-05 2019-07-26 广州虎牙信息科技有限公司 Live data processing method, device, electronic equipment and readable storage medium storing program for executing
CN110072116A (en) * 2019-05-06 2019-07-30 广州虎牙信息科技有限公司 Virtual newscaster's recommended method, device and direct broadcast server
CN110308792A (en) * 2019-07-01 2019-10-08 北京百度网讯科技有限公司 Control method, device, equipment and the readable storage medium storing program for executing of virtual role
CN110784676A (en) * 2019-10-28 2020-02-11 深圳传音控股股份有限公司 Data processing method, terminal device and computer readable storage medium
CN111541908A (en) * 2020-02-27 2020-08-14 北京市商汤科技开发有限公司 Interaction method, device, equipment and storage medium
CN111641844A (en) * 2019-03-29 2020-09-08 广州虎牙信息科技有限公司 Live broadcast interaction method and device, live broadcast system and electronic equipment
CN111970522A (en) * 2020-07-31 2020-11-20 北京琳云信息科技有限责任公司 Processing method and device of virtual live broadcast data and storage medium
CN112135160A (en) * 2020-09-24 2020-12-25 广州博冠信息科技有限公司 Virtual object control method and device in live broadcast, storage medium and electronic equipment
CN112241203A (en) * 2020-10-21 2021-01-19 广州博冠信息科技有限公司 Control device and method for three-dimensional virtual character, storage medium and electronic device
CN112535867A (en) * 2020-12-15 2021-03-23 网易(杭州)网络有限公司 Game progress information processing method and device and electronic equipment
CN112788359A (en) * 2020-12-30 2021-05-11 北京达佳互联信息技术有限公司 Live broadcast processing method and device, electronic equipment and storage medium
CN113289332A (en) * 2021-06-17 2021-08-24 广州虎牙科技有限公司 Game interaction method and device, electronic equipment and computer-readable storage medium
CN113457171A (en) * 2021-06-24 2021-10-01 网易(杭州)网络有限公司 Live broadcast information processing method, electronic equipment and storage medium
CN113518239A (en) * 2021-07-09 2021-10-19 珠海云迈网络科技有限公司 Live broadcast interaction method and system, computer equipment and storage medium thereof
WO2021212733A1 (en) * 2020-04-23 2021-10-28 深圳追一科技有限公司 Video adjustment method and apparatus, electronic device, and storage medium
CN113824982A (en) * 2021-09-10 2021-12-21 网易(杭州)网络有限公司 Live broadcast method and device, computer equipment and storage medium
CN114168018A (en) * 2021-12-08 2022-03-11 北京字跳网络技术有限公司 Data interaction method, data interaction device, electronic equipment, storage medium and program product
CN114363685A (en) * 2021-12-20 2022-04-15 咪咕文化科技有限公司 Video interaction method and device, computing equipment and computer storage medium
WO2022095516A1 (en) * 2020-11-09 2022-05-12 北京达佳互联信息技术有限公司 Livestreaming interaction method and apparatus
CN114693294A (en) * 2022-03-04 2022-07-01 支付宝(杭州)信息技术有限公司 Interaction method and device based on electronic certificate and electronic equipment

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113435431B (en) * 2021-08-27 2021-12-07 北京市商汤科技开发有限公司 Posture detection method, training device and training equipment of neural network model
CN114245155A (en) * 2021-11-30 2022-03-25 北京百度网讯科技有限公司 Live broadcast method and device and electronic equipment
WO2023178640A1 (en) * 2022-03-25 2023-09-28 云智联网络科技(北京)有限公司 Method and system for realizing live-streaming interaction between virtual characters
CN117289791A (en) * 2023-08-22 2023-12-26 杭州空介视觉科技有限公司 Meta universe artificial intelligence virtual equipment data generation method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106937154A (en) * 2017-03-17 2017-07-07 北京蜜枝科技有限公司 Process the method and device of virtual image
CN106993195A (en) * 2017-03-24 2017-07-28 广州创幻数码科技有限公司 Virtual portrait role live broadcasting method and system
CN107154069A (en) * 2017-05-11 2017-09-12 上海微漫网络科技有限公司 A kind of data processing method and system based on virtual role
CN107170030A (en) * 2017-05-31 2017-09-15 珠海金山网络游戏科技有限公司 A kind of virtual newscaster's live broadcasting method and system
CN107194979A (en) * 2017-05-11 2017-09-22 上海微漫网络科技有限公司 The Scene Composition methods and system of a kind of virtual role
CN107750005A (en) * 2017-09-18 2018-03-02 迈吉客科技(北京)有限公司 Virtual interactive method and terminal

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102478960B (en) * 2010-11-29 2015-11-18 国际商业机器公司 Human-computer interaction device and this equipment is used for the apparatus and method of virtual world
CN107180446B (en) * 2016-03-10 2020-06-16 腾讯科技(深圳)有限公司 Method and device for generating expression animation of character face model
US10546406B2 (en) * 2016-05-09 2020-01-28 Activision Publishing, Inc. User generated character animation
CN106878820B (en) * 2016-12-09 2020-10-16 北京小米移动软件有限公司 Live broadcast interaction method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106937154A (en) * 2017-03-17 2017-07-07 北京蜜枝科技有限公司 Process the method and device of virtual image
CN106993195A (en) * 2017-03-24 2017-07-28 广州创幻数码科技有限公司 Virtual portrait role live broadcasting method and system
CN107154069A (en) * 2017-05-11 2017-09-12 上海微漫网络科技有限公司 A kind of data processing method and system based on virtual role
CN107194979A (en) * 2017-05-11 2017-09-22 上海微漫网络科技有限公司 The Scene Composition methods and system of a kind of virtual role
CN107170030A (en) * 2017-05-31 2017-09-15 珠海金山网络游戏科技有限公司 A kind of virtual newscaster's live broadcasting method and system
CN107750005A (en) * 2017-09-18 2018-03-02 迈吉客科技(北京)有限公司 Virtual interactive method and terminal

Cited By (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109922355B (en) * 2019-03-29 2020-04-17 广州虎牙信息科技有限公司 Live virtual image broadcasting method, live virtual image broadcasting device and electronic equipment
CN109922355A (en) * 2019-03-29 2019-06-21 广州虎牙信息科技有限公司 Virtual image live broadcasting method, virtual image live broadcast device and electronic equipment
CN111641844B (en) * 2019-03-29 2022-08-19 广州虎牙信息科技有限公司 Live broadcast interaction method and device, live broadcast system and electronic equipment
CN109788345A (en) * 2019-03-29 2019-05-21 广州虎牙信息科技有限公司 Live-broadcast control method, device, live streaming equipment and readable storage medium storing program for executing
CN111641844A (en) * 2019-03-29 2020-09-08 广州虎牙信息科技有限公司 Live broadcast interaction method and device, live broadcast system and electronic equipment
CN109788345B (en) * 2019-03-29 2020-03-10 广州虎牙信息科技有限公司 Live broadcast control method and device, live broadcast equipment and readable storage medium
CN109905724A (en) * 2019-04-19 2019-06-18 广州虎牙信息科技有限公司 Live video processing method, device, electronic equipment and readable storage medium storing program for executing
CN110062267A (en) * 2019-05-05 2019-07-26 广州虎牙信息科技有限公司 Live data processing method, device, electronic equipment and readable storage medium storing program for executing
CN110072116A (en) * 2019-05-06 2019-07-30 广州虎牙信息科技有限公司 Virtual newscaster's recommended method, device and direct broadcast server
CN110308792A (en) * 2019-07-01 2019-10-08 北京百度网讯科技有限公司 Control method, device, equipment and the readable storage medium storing program for executing of virtual role
CN110308792B (en) * 2019-07-01 2023-12-12 北京百度网讯科技有限公司 Virtual character control method, device, equipment and readable storage medium
CN110784676A (en) * 2019-10-28 2020-02-11 深圳传音控股股份有限公司 Data processing method, terminal device and computer readable storage medium
CN110784676B (en) * 2019-10-28 2023-10-03 深圳传音控股股份有限公司 Data processing method, terminal device and computer readable storage medium
CN111541908A (en) * 2020-02-27 2020-08-14 北京市商汤科技开发有限公司 Interaction method, device, equipment and storage medium
WO2021212733A1 (en) * 2020-04-23 2021-10-28 深圳追一科技有限公司 Video adjustment method and apparatus, electronic device, and storage medium
CN111970522A (en) * 2020-07-31 2020-11-20 北京琳云信息科技有限责任公司 Processing method and device of virtual live broadcast data and storage medium
CN112135160A (en) * 2020-09-24 2020-12-25 广州博冠信息科技有限公司 Virtual object control method and device in live broadcast, storage medium and electronic equipment
CN112241203A (en) * 2020-10-21 2021-01-19 广州博冠信息科技有限公司 Control device and method for three-dimensional virtual character, storage medium and electronic device
WO2022095516A1 (en) * 2020-11-09 2022-05-12 北京达佳互联信息技术有限公司 Livestreaming interaction method and apparatus
CN112535867A (en) * 2020-12-15 2021-03-23 网易(杭州)网络有限公司 Game progress information processing method and device and electronic equipment
CN112535867B (en) * 2020-12-15 2024-05-10 网易(杭州)网络有限公司 Game progress information processing method and device and electronic equipment
CN112788359A (en) * 2020-12-30 2021-05-11 北京达佳互联信息技术有限公司 Live broadcast processing method and device, electronic equipment and storage medium
CN113289332A (en) * 2021-06-17 2021-08-24 广州虎牙科技有限公司 Game interaction method and device, electronic equipment and computer-readable storage medium
CN113457171A (en) * 2021-06-24 2021-10-01 网易(杭州)网络有限公司 Live broadcast information processing method, electronic equipment and storage medium
CN113518239A (en) * 2021-07-09 2021-10-19 珠海云迈网络科技有限公司 Live broadcast interaction method and system, computer equipment and storage medium thereof
CN113824982A (en) * 2021-09-10 2021-12-21 网易(杭州)网络有限公司 Live broadcast method and device, computer equipment and storage medium
CN114168018A (en) * 2021-12-08 2022-03-11 北京字跳网络技术有限公司 Data interaction method, data interaction device, electronic equipment, storage medium and program product
CN114363685A (en) * 2021-12-20 2022-04-15 咪咕文化科技有限公司 Video interaction method and device, computing equipment and computer storage medium
CN114693294A (en) * 2022-03-04 2022-07-01 支付宝(杭州)信息技术有限公司 Interaction method and device based on electronic certificate and electronic equipment

Also Published As

Publication number Publication date
CN113286186B (en) 2023-07-18
CN113286186A (en) 2021-08-20
CN109120985B (en) 2021-07-23

Similar Documents

Publication Publication Date Title
CN109120985A (en) Image display method, apparatus and storage medium in live streaming
US11450350B2 (en) Video recording method and apparatus, video playing method and apparatus, device, and storage medium
CN205788149U (en) Electronic equipment and for showing the device of image
CN104796781B (en) Video clip extracting method and device
CN106227441A (en) For capturing digitally enhanced image and the equipment interacted and method
US11432049B2 (en) Subtitle splitter
CN112199016B (en) Image processing method, image processing device, electronic equipment and computer readable storage medium
CN111930994A (en) Video editing processing method and device, electronic equipment and storage medium
US20230419582A1 (en) Virtual object display method and apparatus, electronic device, and medium
US20220210337A1 (en) Trimming video in association with multi-video clip capture
CN106200917B (en) A kind of content display method of augmented reality, device and mobile terminal
KR20230133404A (en) Displaying augmented reality content in messaging application
CN108965977A (en) Methods of exhibiting, device, storage medium, terminal and the system of present is broadcast live
US20240040236A1 (en) Trimming video within a messaging system
CN113806570A (en) Image generation method and generation device, electronic device and storage medium
CN109165072A (en) A kind of expression packet generation method and device
WO2024011181A1 (en) Dynamically switching between rgb and ir capture
CN116016817A (en) Video editing method, device, electronic equipment and storage medium
CN205942662U (en) Electronic equipment with be used for device that divides into groups to a plurality of images
CN113794799A (en) Video processing method and device
WO2024051467A1 (en) Image processing method and apparatus, electronic device, and storage medium
CN114363549B (en) Intelligent script running and showing recording processing method, device and system
CN116708899B (en) Video processing method, device and storage medium applied to virtual image synthesis
CN113658213B (en) Image presentation method, related device and computer program product
CN116708920B (en) Video processing method, device and storage medium applied to virtual image synthesis

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant