WO2022121557A1 - 一种直播互动方法、装置、设备及介质 - Google Patents

一种直播互动方法、装置、设备及介质 Download PDF

Info

Publication number
WO2022121557A1
WO2022121557A1 PCT/CN2021/128072 CN2021128072W WO2022121557A1 WO 2022121557 A1 WO2022121557 A1 WO 2022121557A1 CN 2021128072 W CN2021128072 W CN 2021128072W WO 2022121557 A1 WO2022121557 A1 WO 2022121557A1
Authority
WO
WIPO (PCT)
Prior art keywords
live
virtual object
interactive
information
comment information
Prior art date
Application number
PCT/CN2021/128072
Other languages
English (en)
French (fr)
Inventor
杨沐
王骁玮
Original Assignee
北京字跳网络技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京字跳网络技术有限公司 filed Critical 北京字跳网络技术有限公司
Publication of WO2022121557A1 publication Critical patent/WO2022121557A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00—Speech synthesis; Text to speech systems
    • G10L13/02—Methods for producing synthetic speech; Speech synthesisers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/233—Processing of audio elementary streams
    • H04N21/2335—Processing of audio elementary streams involving reformatting operations of audio signals, e.g. by converting from one coding standard to another
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H04N21/2355—Processing of additional data, e.g. scrambling of additional data or processing content descriptors involving reformatting operations of additional data, e.g. HTML pages
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H04N21/4355—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream involving reformatting operations of additional data, e.g. HTML pages on a television screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/437—Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • H04N21/4725—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content using interactive regions of the image, e.g. hot spots
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Definitions

  • the present disclosure relates to the field of live broadcast technology, and in particular, to a live broadcast interactive method, device, device, and medium.
  • Live broadcast is the abbreviation of online live broadcast, which is the public broadcast of real-time images on the Internet.
  • the "person” performing or hosting in the instant video is generally referred to as the "host of the live broadcast” and the "host”, and the “person” who enters the live broadcast room to watch the above-mentioned instant video is called the “audience”.
  • the biggest difference between live broadcast and video recording is that the “viewer” can instantly interact with the host by leaving a message, and the "host” can adjust the live broadcast content in real time according to the "viewer”'s feedback on the live broadcast content to meet the needs of the "viewer”.
  • virtual objects can be used to replace live broadcasters for live broadcasts.
  • the interaction form of the above-mentioned virtual objects is single, and users cannot deeply participate in the live content corresponding to the virtual objects, and the interaction effect is general, which affects the user experience.
  • the present disclosure provides a live interactive method, apparatus, device and medium.
  • An embodiment of the present disclosure provides a live broadcast interaction method, the method includes:
  • the interactive content of the virtual object for target comment information is played in the live broadcast interface; wherein, the target comment information is one or more of the comment information.
  • the embodiment of the present disclosure also provides a live interactive device, the device includes:
  • the drawing live module is used to play the live content corresponding to the drawing topic, display the drawing board in the first area of the live interface in response to the first drawing action of the virtual object, and present the drawing board corresponding to the first drawing action drawing trajectory map;
  • a comment display module configured to display the comment information of the live audience on the drawing trajectory map in the second area of the live interface
  • a reply live broadcast module configured to play the interactive content of the virtual object with respect to the target comment information in the live broadcast interface; wherein the target comment information is one or more of the comment information.
  • An embodiment of the present disclosure further provides an electronic device, the electronic device includes: a processor; a memory for storing instructions executable by the processor; the processor for reading the memory from the memory The instructions can be executed, and the instructions can be executed to implement the live interaction method provided by the embodiments of the present disclosure.
  • An embodiment of the present disclosure further provides a computer-readable storage medium, where the storage medium stores a computer program, and the computer program is used to execute the live interaction method provided by the embodiment of the present disclosure.
  • the live content corresponding to the drawing topic is played, the drawing board is displayed in the first area of the live interface in response to the first drawing action of the virtual object, and the drawing board corresponding to the first drawing action is displayed on the drawing board.
  • the drawing trajectory map ; display the comment information of the live audience on the drawing trajectory map in the second area of the live broadcast interface; play the interactive content of the virtual object for the target comment information in the live broadcast interface; wherein, the target comment information is one or more of the comment information. indivual.
  • the user can guess the question according to the drawing trajectory map of the live painting of the virtual object, and reply according to the comment information input by the user, so as to realize the interactive game of guessing between the virtual object and the user, and improve the performance of the virtual object.
  • the diversity and interest of live broadcasts enhances the user's interactive experience.
  • FIG. 1 is a schematic flowchart of a live interactive method according to an embodiment of the present disclosure
  • FIG. 2 is a schematic diagram of a first live broadcast interaction provided by an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of a second type of live interaction provided by an embodiment of the present disclosure.
  • FIG. 4 is a schematic diagram of a third type of live interaction provided by an embodiment of the present disclosure.
  • FIG. 5 is a schematic diagram of a fourth type of live broadcast interaction provided by an embodiment of the present disclosure.
  • FIG. 6 is a schematic diagram of a fifth type of live interaction provided by an embodiment of the present disclosure.
  • FIG. 7 is a schematic diagram of a sixth type of live broadcast interaction provided by an embodiment of the present disclosure.
  • FIG. 8 is a schematic structural diagram of a live interactive device according to an embodiment of the present disclosure.
  • FIG. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
  • the term “including” and variations thereof are open-ended inclusions, ie, "including but not limited to”.
  • the term “based on” is “based at least in part on.”
  • the term “one embodiment” means “at least one embodiment”; the term “another embodiment” means “at least one additional embodiment”; the term “some embodiments” means “at least some embodiments”. Relevant definitions of other terms will be given in the description below.
  • FIG. 1 is a schematic flowchart of a live interactive method according to an embodiment of the present disclosure.
  • the method can be executed by a live interactive device, where the device can be implemented by software and/or hardware, and can generally be integrated into an electronic device.
  • the method is applied to the terminal of the user entering the live room of the virtual object, including:
  • Step 101 Play the live content corresponding to the painting topic, display the drawing board in the first area of the live interface in response to the first drawing action of the virtual object, and present the drawing track map corresponding to the first drawing action on the drawing board.
  • the virtual object can be a three-dimensional model pre-created based on artificial intelligence (Artificial Intelligence, AI) technology
  • a controllable digital object can be set for the computer, and the body movements and facial information of the real person can be obtained through the motion capture device and the face capture device.
  • the specific types of virtual objects may include multiple types, and different virtual objects may have different appearances.
  • the virtual objects may specifically be virtual animals or virtual characters with different styles.
  • virtual objects through the combination of artificial intelligence technology and live video technology, virtual objects can replace real people to realize live video.
  • playing the live content corresponding to the painting topic may include: acquiring video data and audio data of at least one painting topic of the virtual object, wherein the video data includes motion image data corresponding to the painting topic and scenes of multiple scenes The image data and the action image data are used to generate the first painting action, the painting trajectory map and the interactive action; based on the video data and audio data, the live content corresponding to the painting topic is generated and played.
  • the scene of the live content and/or the action of the virtual object are switched as the live content changes.
  • the video data and audio data of the painting topic refer to the data preconfigured by the server to realize the live painting of virtual objects.
  • the number of painting topics is not limited, and each painting topic has corresponding video data and audio data.
  • a question bank may be preset, and the question bank includes video data and audio data of a plurality of painting questions, and the specific number may be set according to the actual situation. It can be understood that the repetition degree and frequency of occurrence of painting topics in the question bank can be updated based on the actual situation to meet the needs of users.
  • the video data may include action image data corresponding to the painting topic and scene image data of multiple scenes.
  • the action image data may include the picture data of the facial expressions and/or body movements of the virtual object, and the action image data may be used to generate the first painting action of the virtual object, the painting trajectory map representing the painting topic, and the interactive action of the virtual object. Drawing actions, drawing trajectory graphs, and interactive actions can be matched to drawing topics.
  • the scene corresponding to the above-mentioned scene image data may include the environmental scene when the virtual object is broadcast live and the scene of the screen perspective, the screen perspective may be the perspective when the virtual object is captured by different lenses, the display size and/or the display direction of the scene image corresponding to the different screen perspectives, etc. different.
  • the scene can correspond to the painting topic, or it can correspond to the link of live painting or live reply.
  • the terminal after detecting the user's live-broadcast triggering operation on the virtual object, the terminal can obtain the video data and audio data of at least one painting topic of the virtual object in the server, and can generate the video data and audio data by decoding the video data and the audio data.
  • the live content corresponding to the painting topic, and the live content of the live painting of the virtual object for the painting topic is played in the live interface.
  • the specific form of the above-mentioned live broadcast trigger operation is not limited.
  • Triggering operations may include one or more of single-click, double-click, swipe, and voice commands.
  • the drawing board is displayed in the first area of the live broadcast interface, and the drawing track map corresponding to the first drawing action is presented on the drawing board.
  • the drawing board is used to display the drawing track map corresponding to the drawing topic on the live interface.
  • the action of the virtual object can be switched from the first action to the second action with the change of the live content, and based on the scene image data of multiple scenes, The scene of the live broadcast content can be switched from the first scene to the second scene as the live broadcast content changes.
  • the virtual object can switch to different actions, and the scene of the live content can also switch to different scenes.
  • the virtual object can also switch actions without switching scenes, or switch scenes without switching actions.
  • Text information based on the audio data, the video content that the virtual object replies to the interactive information is generated and played on the live page.
  • the virtual object can intersperse and reply to the interactive information of the audience without stopping the painting action.
  • the virtual object can play the game of guessing and guess between the users and the interactive chat can be carried out at the same time. The superposition further improves the user's participation and increases the fun of the interaction between the user and the virtual object.
  • FIG. 2 is a schematic diagram of a first live broadcast interaction provided by an embodiment of the present disclosure.
  • a live broadcast interface of a virtual object 11 is shown in the figure, and the virtual object 11 is shown in the live broadcast interface for drawing.
  • a live broadcast screen during the action the virtual object 11 holds the drawing board in the hand, and the drawing board 16 is displayed in the first area of the live broadcast interface.
  • the drawing board 16 presents the drawing trajectory map corresponding to the drawing action, such as half a bottle in the figure , and the prompt information of the current painting topic, as shown in the figure, the prompt information is "three words, food".
  • the upper left corner of the live broadcast interface in FIG. 2 also displays the avatar and name of the virtual object 11 , which is named “Little A”, and the focus button 12 .
  • FIG. 3 is a schematic diagram of a second type of live interaction provided by the embodiment of the present disclosure.
  • FIG. 3 shows a drawing trajectory graph that is gradually generated by the current drawing topic as the first drawing action progresses.
  • the lower part of the bottle in the figure is With the further addition of the first drawing action, a complete bottle is formed, and as the first drawing action of the virtual object proceeds, more clues can be provided to improve the correct rate of the user's answer.
  • the virtual object In the process of live painting of virtual objects, with the change of the live content corresponding to the painting topic, the virtual object can switch to different actions, and the scene of the live content can also be switched to different scenes.
  • the live content of the virtual anchor is related to the painting topic. Matching and correlation are high, so that the effect of the virtual object live broadcast is better, the variety and interest of the virtual object display are improved, and the user experience effect in the virtual object live broadcast painting is improved.
  • Step 102 Display multiple comment information of the live audience in the second area of the live broadcast interface.
  • the comment information refers to the interactive information input by the live viewer when viewing the drawing trajectory map of the virtual object.
  • the comment information is comment information for the above-mentioned conversation track graph.
  • the second area refers to the area set in the live broadcast interface for displaying comment information. The location of the second area is not particularly limited, and the second area can be displayed in the form of a floating layer or a pop-up window on the live broadcast interface.
  • the terminal in the process of playing the live content corresponding to the painting topic, may receive multiple comment information from multiple live viewers, and display the multiple comment information in the second area of the live broadcast interface.
  • the comment information may include answering information for the drawing trajectory map of the virtual object, so that the user can guess the question in real time during the drawing process of the virtual object.
  • the terminal can only display the answer information on the answer interface that the live viewers who support answering can browse by themselves, and other viewers cannot watch it, so as to improve the fairness of guessing the question, which can be set according to the actual scene.
  • a second area is set at the lower left of the live broadcast interface, and the second area displays comment information sent by different live viewers watching the live painting of virtual objects, for example, "You draw” sent by user A in the figure. It's not bad", “You have the talent for drawing” sent by user B, and “You can't draw well” sent by user C.
  • the bottom of the live broadcast interface also shows the editing area 13 for the current user to send comment information and other function buttons, such as the interactive button 14 and the activity and reward button 15 in the figure. Different function buttons have different functions.
  • Step 103 Play the interactive content of the virtual object with respect to the target comment information on the live interface, and hide the drawing board; wherein, the target comment information is one or more pieces of comment information.
  • playing the interactive content of the virtual object with respect to the target comment information in the live broadcast interface includes: receiving reply audio data and reply text information corresponding to the target comment information; displaying the target comment information and reply in the third area of the live broadcast interface Text information; based on the reply audio data, the interactive content of the virtual object for the target comment information is generated and played in the live broadcast interface.
  • the target comment information is one or more pieces of comment information that the server determines based on the preset scheme and needs to be responded to.
  • the preset scheme can be set according to the actual situation, for example, it can be a live broadcast based on sending comment information.
  • the audience's points determine the target comment information; or find the target comment information matching the preset keywords, wherein the preset keywords can be mined and extracted according to the hot information in advance, or can be keywords related to the painting topic; or the comment information Semantic recognition is performed, and comment information with similar meanings is clustered to obtain several information sets.
  • the set with the most comment information is the hottest topic of live audience interaction, and the comment information corresponding to this set is used as the target comment information.
  • the reply text information refers to the reply content that matches the target comment information determined by the server based on the corpus, and the reply audio data is to convert the text into the natural speech data of the virtual object in real time through the Text To Speech (TTS) technology.
  • the terminal can receive the reply audio data and reply text information corresponding to the target comment information, and can generate the interactive content of the reply based on the reply audio data and the video data of the current painting topic, and then the terminal can display the target comment information and the target comment information in the third area of the live broadcast interface. Reply to the text message, and play the interactive content of the virtual object replying to the target comment message in the live broadcast interface.
  • FIG. 4 is a schematic diagram of a third type of live broadcast interaction provided by an embodiment of the present disclosure.
  • the third area 17 in the live broadcast interface displays the current target comment information and the reply text information of the virtual object,
  • the target comment information is "Your drawing is good” sent by user A
  • the reply text information of the virtual object is "Scratch a picture”
  • the audio content corresponding to the reply text information is played at the same time.
  • the terminal can play the interactive content of the virtual object's reply to the comment information in the live interface, and display the current comment information and the corresponding reply text information, so that the user can know which user's interactive content the virtual object is replying to, and further.
  • the depth of interaction between users and virtual objects is improved, and the interactive interaction experience is improved.
  • the live interaction method may further include: in response to the second drawing action of the virtual object, displaying a drawing trajectory map corresponding to the second drawing action on the drawing board.
  • the second painting action is a subsequent action of the first painting action, and the first painting action and the second painting action are used to jointly complete painting for a painting topic.
  • the comment information includes answering information for the drawing trajectory map of the first drawing action, and the second drawing action is triggered when there is no correct answer corresponding to the drawing question in the answering information.
  • the second drawing action is a new drawing action of the virtual object when the live audience cannot guess the answer, which may be the same as or different from the above-mentioned first drawing action, depending on the action portrait data sent by the server.
  • the virtual object starts to perform the second painting action, and the drawing board is displayed again in the first area of the live interface.
  • the drawing track map that has been completed in step S101 on the drawing board, that is, the drawing track map corresponding to the first drawing action, and continuously update the drawing track map along with the second drawing action of the virtual object, and the updated drawing track map is The drawing track image corresponding to the second drawing action.
  • Live viewers can continue to enter comments to answer based on the updated drawing trajectory. That is to say, the game between virtual objects and users can be divided into multiple segments, and one drawing topic can correspond to at least one drawing trajectory, which makes the game interaction between users and virtual objects more in-depth and more relevant.
  • FIG. 5 is a schematic diagram of a fourth type of live broadcast interaction provided by an embodiment of the present disclosure.
  • the drawing board 16 of the live broadcast interface displays the drawing track after the current drawing topic is updated with the second drawing action.
  • the picture, the bottle including "chili" in the picture is further added in the drawing trajectory graph in Figure 3, which provides more clues to improve the correct rate of the user's answer.
  • playing the interactive content of the virtual object with respect to the target comment information in the live interface includes: receiving audio data corresponding to the correct answer, wherein the correct answer is received when the game time of the virtual object reaches a preset time threshold; playing Interactive live content where virtual objects generated based on audio data announce correct answers.
  • the server can obtain the game time of the virtual object, and if the game time of the virtual object reaches the preset time threshold, and/or when there is no correct answer in the answer information, it can send the audio data and/or text information corresponding to the correct answer to the terminal .
  • the terminal After receiving the audio data and/or text information of the correct answer, the terminal can generate interactive live content based on the audio data and the video data of the painting title, and play the interactive live content of the virtual object announcing the correct answer in the live interface, and/or on the live broadcast interface.
  • the textual information showing the correct answer in the interface.
  • the live interaction method may further include: displaying feedback text information corresponding to the answer information on the live broadcast interface, the feedback text information is used to represent the answer result of the answer information, and the feedback text information is based on the comparison between the answer information and the correct answer. The result is ok.
  • the feedback text information refers to the text information determined by the server according to the comparison result between the answer information and the correct answer, which can indicate whether the answer of the answer information is correct. If the server determines that the answer information is the same as the correct answer, it can determine that the answer is correct, and the feedback text information is the text information of the correct answer, otherwise the feedback text information is the text information of the wrong answer. After receiving the feedback text information, the terminal may display the feedback text information on the live broadcast interface.
  • the terminal may receive the feedback audio data, and generate a virtual object based on the feedback frequency data to give feedback to the answer information.
  • content and play it in the live interface For example, users can watch interactive content in which a virtual object says "You didn't answer this question correctly.”
  • FIG. 6 is a schematic diagram of the fifth type of live broadcast interaction provided by the embodiment of the present disclosure, as shown in FIG. 6 , feedback text information can be displayed in the feedback area 18 in the live broadcast interface, such as “You are right” in the figure, and Corresponding special motion effects are also added to the feedback text information. User C's answer "chili sauce” in the picture is correct.
  • the server can send the answer reward to the corresponding user, and return the answer reward information to the user end, and the user end displays the answer reward information to the user.
  • the reward for answering the question may include rewards in various ways, such as points, virtual items or virtual currency, etc., which are not limited in particular.
  • the feedback area 18 of the live interface also displays the reward information for answering the question, such as the virtual item "+100" and points "+50" in the figure.
  • the server can sort them based on the time when the users answered the questions, and the preset number of users who are ranked first can send additional answer rewards.
  • the terminal can display the additional answer rewards. Answer bonus information. Additional reward for answering questions may also include rewards in various ways, which are not limited in specificity.
  • the preset number can be set according to the actual situation. For example, the server can send double points as an additional reward for answering the top 5 users.
  • the virtual object can perform live painting, and the real-time painting trajectory graph is displayed in the live broadcast interface.
  • the live viewer can input answer information to answer the drawing trajectory graph. If the answer is correct, you can receive a reward, which realizes the virtual object and the virtual object.
  • the drawing board 16 when the interactive content of the virtual object with respect to the target comment information is played in the live interface, the drawing board 16 can also be hidden, so that the user can view the interactive content of the virtual object with respect to the target comment information more intuitively.
  • the step of hiding the drawing pad 16 may not be performed, so that the audience can watch the interactive content of the virtual object while viewing the drawing pad 16 .
  • the live content corresponding to the drawing topic is played, the drawing board is displayed in the first area of the live interface in response to the first drawing action of the virtual object, and the drawing board corresponding to the first drawing action is displayed on the drawing board.
  • the drawing trajectory map of the live broadcast interface multiple comments of the live audience are displayed in the second area of the live broadcast interface; the interactive content of the virtual object for the target comment information is played in the live broadcast interface, and the drawing board is hidden; wherein, the target comment information is the comment information of the comment information. one or more.
  • the user can guess the question according to the drawing trajectory map of the live painting of the virtual object, and reply according to the comment information input by the user, so as to realize the interactive game of guessing between the virtual object and the user, and improve the performance of the virtual object.
  • the diversity and interest of live broadcasts enhances the user's interactive experience.
  • the live interactive method may further include: acquiring interactive video data of the virtual object; and playing interactive live content between the virtual object and the live audience in the live broadcast interface based on the interactive video data.
  • the interactive video data may be video data in which a virtual object actively initiates a topic to interact with live viewers, and the interactive video data may correspond to multiple topic texts.
  • the server does not receive the comment information sent by the live viewer within the set time, it can send the interactive video data of the virtual object to the terminal, and the terminal can generate interactive live content based on the interactive video data, and display it in the live interface. Play interactive live content where virtual objects interact with live viewers.
  • the above set time can be set according to the actual situation, for example, the set time can be 5 seconds.
  • the server can send interactive video data to the terminal, so that the terminal can play the interactive live content of the virtual object speaking the preset speaking script, such as the virtual object saying "Why are you ignoring me?", "It's so boring” and so on.
  • the virtual object and the live audience can actively interact. , mobilize the user's enthusiasm for interaction, and improve the user's interaction effect when the virtual object is broadcast live.
  • the links in which the virtual object and the user interact and chat can be switched, and different links can be switched with each other, which further improves the fun of the interaction between the user and the virtual object, and improves the user's interactive experience effect.
  • the live interactive method may further include: displaying an interactive panel in the fourth area of the live streaming interface, wherein the interactive panel includes at least one virtual resource; and displaying a corresponding virtual resource on the virtual object based on the user's triggering of the virtual resource special effects, and the duration indicator of the special effects is displayed in the fifth area of the live broadcast interface.
  • the virtual resources may be displayed in the interactive panel by means of image logos of preset shapes, for example, multiple virtual resources displayed in the interactive panel may be logos of different special effects.
  • the interactive panel supports the user's touch operation, such as clicking, long pressing, etc., so that the user generates a trigger operation for at least one virtual resource.
  • the virtual resources may correspond to special effects of virtual objects, and the special effects may include at least one of the following: special effects of clothing transformation, special effects of dress transformation, special effects of body transformation, and special effects of scene prop transformation.
  • the duration identifier of the special effect is used to prompt the user for the remaining display time of the special effect displayed on the current live broadcast interface.
  • the duration identification can be realized in the form of image identification or text.
  • an interactive panel including multiple virtual resources can be displayed. Based on the user's triggering of the virtual resources, the corresponding special effects can be displayed on the virtual objects, and the current special effects can be displayed in the fifth area of the live broadcast interface.
  • the corresponding duration identifier to remind the user of the remaining display time of the special effect.
  • FIG. 7 is a schematic diagram of the sixth type of live interaction provided by the embodiment of the present disclosure.
  • the interactive panel 19 displays 7 virtual resources, including freezing, feeding snacks, cat ears, drinking, blowing hair, and changing clothes. and feeding sweets, just for example.
  • the live broadcast interface of FIG. 7 after the user triggers the cat ears in the virtual resource, after the special effects corresponding to the cat ears are displayed on the virtual object, the user can see that the cat ears grow on the head of the virtual object.
  • the figure also shows the duration mark 20 corresponding to the special effect of the cat ear.
  • the circular area on the duration mark 20 can be continuously filled clockwise to achieve the special effect of the cat ear. After the preset display duration, the circular area is completely filled, and the duration indicator 20 can disappear from the live broadcast interface.
  • the virtual object can display specific dynamic effects based on the user's trigger during the live broadcast process, which enriches the live broadcast interaction method in the virtual live broadcast scene, and improves the live broadcast interest.
  • the duration indicator By displaying the duration indicator, the user can understand the special effect effect. to improve the friendliness of live broadcast interaction.
  • FIG. 8 is a schematic structural diagram of a live interactive device according to an embodiment of the present disclosure.
  • the device may be implemented by software and/or hardware, and may generally be integrated into an electronic device. As shown in Figure 8, the device includes:
  • the drawing live module 301 is used to play the live content corresponding to the drawing topic, display the drawing board in the first area of the live interface in response to the first drawing action of the virtual object, and present the first drawing action on the drawing board Corresponding drawing trajectory map;
  • a reply live broadcast module 303 is configured to play the interactive content of the virtual object with respect to the target comment information in the live broadcast interface, wherein the target comment information is one or more of the comment information.
  • the reply live broadcast module 303 is specifically used for:
  • the target comment information and the reply text information are displayed in the third area of the live broadcast interface, and based on the reply audio data, interactive content of the virtual object for the target comment information is generated and played in the live broadcast interface.
  • the device also includes a painting update module for:
  • the drawing track map corresponding to the second drawing action is displayed on the drawing board.
  • the comment information includes answering information for the drawing trajectory map of the first drawing action, and the second drawing action is triggered when there is no correct answer corresponding to the drawing question in the answering information.
  • the reply live broadcast module 303 is specifically used for:
  • the device further includes a feedback module for:
  • the feedback text information corresponding to the answer information is displayed on the live interface, the feedback text information is used to represent the answer result of the answer information, and the feedback text information is based on the ratio of the answer information to the correct answer. OK with the result.
  • the painting live broadcast module 301 is specifically used for:
  • Video data includes action image data corresponding to the painting topic and scene image data of multiple scenes, and the action image data is used to generate the first drawing action, the drawing trajectory map and the interactive action;
  • live content corresponding to the painting topic is generated and played.
  • the scene of the live content and/or the action of the virtual object switches as the live content changes.
  • the device further includes an interactive live broadcast module for:
  • the interactive live content between the virtual object and the live audience is played in the live interface based on the interactive video data.
  • the device also includes a special effect module for:
  • the corresponding special effect is displayed on the virtual object, and the duration identifier of the special effect is displayed in the fifth area of the live broadcast interface.
  • the live interactive device provided by the embodiment of the present disclosure can execute the live interactive method provided by any embodiment of the present disclosure, and has functional modules and beneficial effects corresponding to the execution method.
  • FIG. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. Referring specifically to FIG. 9 below, it shows a schematic structural diagram of an electronic device 400 suitable for implementing an embodiment of the present disclosure.
  • the electronic device 400 in the embodiment of the present disclosure may include, but is not limited to, such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle-mounted terminal ( For example, mobile terminals such as car navigation terminals) and the like, and stationary terminals such as digital TVs, desktop computers, and the like.
  • the electronic device shown in FIG. 9 is only an example, and should not impose any limitation on the function and scope of use of the embodiments of the present disclosure.
  • an electronic device 400 may include a processing device (eg, a central processing unit, a graphics processor, etc.) 401 that may be loaded into random access according to a program stored in a read only memory (ROM) 402 or from a storage device 408 Various appropriate actions and processes are executed by the programs in the memory (RAM) 403 . In the RAM 403, various programs and data required for the operation of the electronic device 400 are also stored.
  • the processing device 401, the ROM 402, and the RAM 403 are connected to each other through a bus 404.
  • An input/output (I/O) interface 405 is also connected to bus 404 .
  • I/O interface 405 input devices 406 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speakers, vibration An output device 407 of a computer, etc.; a storage device 408 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 409. Communication means 409 may allow electronic device 400 to communicate wirelessly or by wire with other devices to exchange data.
  • FIG. 9 shows electronic device 400 having various means, it should be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
  • embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated in the flowchart.
  • the computer program may be downloaded and installed from the network via the communication device 409, or from the storage device 408, or from the ROM 402.
  • the processing device 401 When the computer program is executed by the processing device 401, the above-mentioned functions defined in the live interactive method of the embodiment of the present disclosure are executed.
  • the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two.
  • the computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples of computer readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable Programmable read only memory (EPROM or flash memory), fiber optics, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
  • a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
  • a computer-readable signal medium may include a data signal in baseband or propagated as part of a carrier wave with computer-readable program code embodied thereon. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • a computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device .
  • Program code embodied on a computer readable medium may be transmitted using any suitable medium including, but not limited to, electrical wire, optical fiber cable, RF (radio frequency), etc., or any suitable combination of the foregoing.
  • the client and server can use any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol) to communicate, and can communicate with digital data in any form or medium Communication (eg, a communication network) interconnects.
  • HTTP HyperText Transfer Protocol
  • Examples of communication networks include local area networks (“LAN”), wide area networks (“WAN”), the Internet (eg, the Internet), and peer-to-peer networks (eg, ad hoc peer-to-peer networks), as well as any currently known or future development network of.
  • the above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or may exist alone without being assembled into the electronic device.
  • the above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by the electronic device, the electronic device: plays the live content corresponding to the painting topic, and responds to the first painting action of the virtual object, A drawing board is displayed in the first area of the live broadcast interface, and a drawing trajectory map corresponding to the first drawing action is presented on the drawing board; multiple comment information of the live broadcast audience is displayed in the second area of the live broadcast interface; The interactive content of the virtual object for target comment information is played in the live broadcast interface, and the drawing board is hidden; wherein, the target comment information is one or more of the comment information.
  • Computer program code for performing operations of the present disclosure may be written in one or more programming languages, including but not limited to object-oriented programming languages—such as Java, Smalltalk, C++, and This includes conventional procedural programming languages - such as the "C" language or similar programming languages.
  • the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server.
  • the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through Internet connection).
  • LAN local area network
  • WAN wide area network
  • each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more logical functions for implementing the specified functions executable instructions.
  • the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations can be implemented in dedicated hardware-based systems that perform the specified functions or operations , or can be implemented in a combination of dedicated hardware and computer instructions.
  • the units involved in the embodiments of the present disclosure may be implemented in a software manner, and may also be implemented in a hardware manner. Among them, the name of the unit does not constitute a limitation of the unit itself under certain circumstances.
  • exemplary types of hardware logic components include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), Systems on Chips (SOCs), Complex Programmable Logical Devices (CPLDs) and more.
  • FPGAs Field Programmable Gate Arrays
  • ASICs Application Specific Integrated Circuits
  • ASSPs Application Specific Standard Products
  • SOCs Systems on Chips
  • CPLDs Complex Programmable Logical Devices
  • a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with the instruction execution system, apparatus or device.
  • the machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
  • Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or devices, or any suitable combination of the foregoing.
  • machine-readable storage media would include one or more wire-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), fiber optics, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.
  • RAM random access memory
  • ROM read only memory
  • EPROM or flash memory erasable programmable read only memory
  • CD-ROM compact disk read only memory
  • magnetic storage or any suitable combination of the foregoing.
  • the present disclosure provides a live interaction method, including:
  • the interactive content of the virtual object for target comment information is played in the live broadcast interface; wherein, the target comment information is one or more of the comment information.
  • the playing the interactive content of the virtual object with respect to the target comment information in the live interface includes:
  • the target comment information and the reply text information are displayed in the third area of the live broadcast interface, and based on the reply audio data, interactive content of the virtual object for the target comment information is generated and played in the live broadcast interface.
  • the live interaction method provided by the present disclosure further includes:
  • the drawing track map corresponding to the second drawing action is displayed on the drawing board.
  • the comment information includes answer information for the drawing trajectory map of the first drawing action, and the second drawing action is in the Triggered when there is no correct answer corresponding to the drawing question in the answering information.
  • the playing the interactive content of the virtual object with respect to the target comment information in the live interface includes:
  • the live interaction method provided by the present disclosure further includes:
  • the feedback text information corresponding to the answer information is displayed on the live interface, the feedback text information is used to represent the answer result of the answer information, and the feedback text information is based on the ratio of the answer information to the correct answer. OK with the result.
  • the playing of the live broadcast content corresponding to the painting topic includes:
  • Video data and audio data of at least one painting topic of the virtual object wherein the video data includes motion image data corresponding to the painting topic and scene image data of multiple scenes, and the motion image data is used to generate the first drawing action, the drawing trajectory map and the interactive action;
  • live content corresponding to the painting topic is generated and played.
  • the scene of the live broadcast content and/or the action of the virtual object is switched according to the change of the live broadcast content.
  • the live interaction method provided by the present disclosure further includes:
  • the interactive live content between the virtual object and the live audience is played in the live interface based on the interactive video data.
  • the live interaction method provided by the present disclosure further includes:
  • the corresponding special effect is displayed on the virtual object, and the duration identifier of the special effect is displayed in the fifth area of the live broadcast interface.
  • the present disclosure provides a live interactive device, including:
  • the drawing live module is used to play the live content corresponding to the drawing topic, display the drawing board in the first area of the live interface in response to the first drawing action of the virtual object, and present the drawing board corresponding to the first drawing action drawing trajectory map;
  • a comment display module configured to display the comment information of the live audience on the drawing trajectory map in the second area of the live interface
  • a reply live broadcast module configured to play the interactive content of the virtual object with respect to the target comment information in the live broadcast interface; wherein the target comment information is one or more of the comment information.
  • the reply live broadcast module is specifically used for:
  • the device further includes a painting update module for:
  • the drawing track map corresponding to the second drawing action is displayed on the drawing board.
  • the comment information includes answer information for the drawing trajectory map of the first drawing action, and the second drawing action is in the Triggered when there is no correct answer corresponding to the drawing question in the answering information.
  • the reply live broadcast module is specifically used for:
  • the device further includes a feedback module for:
  • the feedback text information corresponding to the answer information is displayed on the live interface, the feedback text information is used to represent the answer result of the answer information, and the feedback text information is based on the ratio of the answer information to the correct answer. OK with the result.
  • the drawing live module is specifically used for:
  • Video data and audio data of at least one painting topic of the virtual object wherein the video data includes motion image data corresponding to the painting topic and scene image data of multiple scenes, and the motion image data is used to generate the first drawing action, the drawing trajectory map and the interactive action;
  • live content corresponding to the painting topic is generated and played.
  • the live interactive device in the process of playing the live content corresponding to the painting topic, based on the action image data and the scene image data of the multiple scenes , the scene of the live broadcast content and/or the action of the virtual object is switched according to the change of the live broadcast content.
  • the device further includes an interactive live broadcast module for:
  • the interactive live content between the virtual object and the live audience is played in the live interface based on the interactive video data.
  • the device further includes a special effect module for:
  • the corresponding special effect is displayed on the virtual object, and the duration identifier of the special effect is displayed in the fifth area of the live broadcast interface.
  • the present disclosure provides an electronic device, comprising:
  • a memory for storing the processor-executable instructions
  • the processor is configured to read the executable instructions from the memory, and execute the instructions to implement any of the live broadcast interaction methods provided in the present disclosure.
  • the present disclosure provides a computer-readable storage medium, where the storage medium stores a computer program, and the computer program is used to execute any of the live broadcasts provided by the present disclosure interactive method.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Computational Linguistics (AREA)
  • Marketing (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Acoustics & Sound (AREA)
  • Business, Economics & Management (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本公开实施例涉及一种直播互动方法、装置、设备及介质，该方法包括：播放绘画题目对应的直播内容，响应于虚拟对象的第一绘画动作，在直播界面的第一区域展示绘画板，以及在绘画板上呈现第一绘画动作对应的绘画轨迹图；在直播界面的第二区域展示直播观众的评论信息；在直播界面中播放虚拟对象针对目标评论信息的互动内容。采用上述技术方案，根据虚拟对象直播绘画的绘画轨迹图用户可以进行猜题，并根据用户输入的评论信息进行回复，实现了虚拟对象与用户之间你画我猜的互动游戏，提高了虚拟对象直播的多样性和趣味性，进而提升了用户的互动体验效果。

Description

一种直播互动方法、装置、设备及介质
本申请要求于2020年12月11日提交国家知识产权局、申请号为202011460121.6、申请名称为“一种直播互动方法、装置、设备及介质”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本公开涉及直播技术领域，尤其涉及一种直播互动方法、装置、设备及介质。
背景技术
随着直播技术的不断发展，观看直播成为人们生活中的一项重要的娱乐活动。直播是网络直播的简称，具体是在互联网上公开播出即时影像。该即时影像中演出或主持的“人”一般称为“直播主”、“主播”，进入直播间观看上述即时影像的“人”称为“观众”。直播与录影的最大差异在于“观众”可以通过留言等方式和主播即时交互，“主播”可以根据“观众”对直播内容的反馈即时调整直播内容，以满足“观众”的需求。
目前，为了趣味性，可以采用虚拟对象替代真人主播进行直播。但是上述虚拟对象的互动形式单一，且用户无法深入参与到虚拟对象对应的直播内容中，互动效果一般，影响了用户体验。
发明内容
为了解决上述技术问题或者至少部分地解决上述技术问题，本公开提供了一种直播互动方法、装置、设备及介质。
本公开实施例提供了一种直播互动方法，所述方法包括：
播放绘画题目对应的直播内容，响应于虚拟对象的第一绘画动作，在直播界面的第一区域展示绘画板，以及在所述绘画板上呈现所述第一绘画动作对应的绘画轨迹图；
在所述直播界面的第二区域展示直播观众针对所述绘画轨迹图的评论信息；
在所述直播界面中播放所述虚拟对象针对目标评论信息的互动内容；其中，所述目标评论信息为所述评论信息的一个或多个。
本公开实施例还提供了一种直播互动装置，所述装置包括：
绘画直播模块，用于播放绘画题目对应的直播内容，响应于虚拟对象的第一绘画动作，在直播界面的第一区域展示绘画板，以及在所述绘画板上呈现所述第一绘画动作对应的绘画轨迹图；
评论展示模块，用于在所述直播界面的第二区域展示直播观众针对所述绘画轨迹图的评论信息；
回复直播模块，用于在所述直播界面中播放所述虚拟对象针对目标评论信息的互动内容；其中，所述目标评论信息为所述评论信息的一个或多个。
本公开实施例还提供了一种电子设备，所述电子设备包括：处理器；用于存储所述处理器可执行指令的存储器；所述处理器，用于从所述存储器中读取所述可执行指令，并执 行所述指令以实现如本公开实施例提供的直播互动方法。
本公开实施例还提供了一种计算机可读存储介质，所述存储介质存储有计算机程序，所述计算机程序用于执行如本公开实施例提供的直播互动方法。
本公开实施例提供的技术方案与现有技术相比具有如下优点：
本公开实施例提供的直播互动方案，播放绘画题目对应的直播内容，响应于虚拟对象的第一绘画动作，在直播界面的第一区域展示绘画板，以及在绘画板上呈现第一绘画动作对应的绘画轨迹图；在直播界面的第二区域展示直播观众针对绘画轨迹图的评论信息；在直播界面中播放虚拟对象针对目标评论信息的互动内容；其中，目标评论信息为评论信息的一个或多个。采用上述技术方案，根据虚拟对象直播绘画的绘画轨迹图用户可以进行猜题，并根据用户输入的评论信息进行回复，实现了虚拟对象与用户之间你画我猜的互动游戏，提高了虚拟对象直播的多样性和趣味性，进而提升了用户的互动体验效果。
附图说明
结合附图并参考以下具体实施方式，本公开各实施例的上述和其他特征、优点及方面将变得更加明显。贯穿附图中，相同或相似的附图标记表示相同或相似的元素。应当理解附图是示意性的，原件和元素不一定按照比例绘制。
图1为本公开实施例提供的一种直播互动方法的流程示意图；
图2为本公开实施例提供的第一种直播互动的示意图；
图3为本公开实施例提供的第二种直播互动的示意图；
图4为本公开实施例提供的第三种直播互动的示意图；
图5为本公开实施例提供的第四种直播互动的示意图；
图6为本公开实施例提供的第五种直播互动的示意图；
图7为本公开实施例提供的第六种直播互动的示意图；
图8为本公开实施例提供的一种直播互动装置的结构示意图；
图9为本公开实施例提供的一种电子设备的结构示意图。
具体实施方式
下面将参照附图更详细地描述本公开的实施例。虽然附图中显示了本公开的某些实施例，然而应当理解的是，本公开可以通过各种形式来实现，而且不应该被解释为限于这里阐述的实施例，相反提供这些实施例是为了更加透彻和完整地理解本公开。应当理解的是，本公开的附图及实施例仅用于示例性作用，并非用于限制本公开的保护范围。
应当理解，本公开的方法实施方式中记载的各个步骤可以按照不同的顺序执行，和/或并行执行。此外，方法实施方式可以包括附加的步骤和/或省略执行示出的步骤。本公开的范围在此方面不受限制。
本文使用的术语“包括”及其变形是开放性包括，即“包括但不限于”。术语“基于”是“至少部分地基于”。术语“一个实施例”表示“至少一个实施例”；术语“另一实施例”表示“至少一个另外的实施例”；术语“一些实施例”表示“至少一些实施例”。其他术语的相关定义将在下文描述中给出。
需要注意，本公开中提及的“第一”、“第二”等概念仅用于对不同的装置、模块或单元进行区分，并非用于限定这些装置、模块或单元所执行的功能的顺序或者相互依存关系。
需要注意，本公开中提及的“一个”、“多个”的修饰是示意性而非限制性的，本领域技术人员应当理解，除非在上下文另有明确指出，否则应该理解为“一个或多个”。
本公开实施方式中的多个装置之间所交互的消息或者信息的名称仅用于说明性的目的，而并不是用于对这些消息或信息的范围进行限制。
图1为本公开实施例提供的一种直播互动方法的流程示意图，该方法可以由直播互动装置执行，其中该装置可以采用软件和/或硬件实现，一般可集成在电子设备中。如图1所示，该方法应用于进入虚拟对象的直播间的用户的终端，包括：
步骤101、播放绘画题目对应的直播内容，响应于虚拟对象的第一绘画动作，在直播界面的第一区域展示绘画板，以及在绘画板上呈现第一绘画动作对应的绘画轨迹图。
其中，虚拟对象可以为基于人工智能(Artificial Intelligence，AI)技术预先创建的一个三维模型，可以为计算机设置可控制的数字化对象，通过动作捕捉设备和面部捕捉设备可以获取真人的肢体动作和面部信息来驱动虚拟对象。虚拟对象的具体类型可以包括多种，不同的虚拟对象可以具有不同的外貌形象，虚拟对象具体可以为虚拟动物，也可以为具有不同风格的虚拟人物。本公开实施例中，通过人工智能技术与视频直播技术的结合，虚拟对象可以代替真人实现视频直播。
本公开实施例中，播放绘画题目对应的直播内容，可以包括：获取虚拟对象的至少一个绘画题目的视频数据和音频数据，其中，视频数据包括绘画题目对应的动作图像数据和多个场景的场景图像数据，动作图像数据用于生成第一绘画动作、绘画轨迹图和互动动作；基于视频数据和音频数据生成绘画题目对应的直播内容并播放。
可选的，在播放绘画题目对应的直播内容的过程中，基于动作图像数据和多个场景的场景图像数据，直播内容的场景和/或虚拟对象的动作随直播内容的变化而进行切换。
绘画题目的视频数据和音频数据是指服务端预先配置好的用于实现虚拟对象直播绘画的数据，绘画题目的数量具体不限，每个绘画题目均存在对应的视频数据和音频数据。本公开实施例中，可以预先设置题库，题库中包括多个绘画题目的视频数据和音频数据，具体数量可以根据实际情况进行设置。可以理解的是，题库中绘画题目的重复程度和出现频率可以基于实际情况进行更新，以满足用户的需求。
视频数据中可以包括绘画题目对应的动作图像数据和多个场景的场景图像数据。动作图像数据可以包括虚拟对象的表情动作和/或肢体动作的画面数据，动作图像数据可以用于生成虚拟对象的第一绘画动作、表征绘画题目的绘画轨迹图和虚拟对象的互动动作，第一绘画动作、绘画轨迹图和互动动作可以与绘画题目相匹配。上述场景图像数据对应的场景可以包括虚拟对象直播时的环境场景以及画面视角场景，画面视角可以为不同镜头拍摄虚拟对象时的视角，不同画面视角对应的场景图像的展示大小和/或展示方向等不同。该场景可以与绘画题目相对应，也可以与直播绘画或直播回复的环节相对应。
本公开实施例中，终端检测到用户对虚拟对象的直播触发操作之后，可以获取服务端中虚拟对象的至少一个绘画题目的视频数据和音频数据，通过对视频数据和音频数据的解 码处理可以生成绘画题目对应的直播内容，并在直播界面中播放虚拟对象进行绘画题目的直播绘画的直播内容。上述直播触发操作的具体形式不限，例如当检测到用户对设定按键的触发时，可以确定接收到直播触发操作；或者当检测到用户对虚拟对象的推荐信息的触发时，可以确定接收到直播触发操作，上述推荐信息可以为图片或视频等。触发操作可以包括单击、双击、滑动、语音指令中的一种或多种。
在播放绘画题目对应的直播内容的过程中，响应于虚拟对象的第一绘画动作，在直播界面的第一区域展示绘画板，以及在绘画板上呈现第一绘画动作对应的绘画轨迹图。绘画板在直播界面上用于展示绘画题目对应的绘画轨迹图。并且，在播放绘画题目对应的直播内容的过程中，基于动作图像数据，虚拟的对象的动作随直播内容的变化可以从第一动作切换至第二动作，并且基于多个场景的场景图像数据，直播内容的场景随直播内容的变化可以从第一场景切换至第二场景。也即随着绘画题目对应的直播内容的变化，虚拟对象可以切换不同的动作，并且直播内容的场景也可以切换不同的场景。在一些实施例中，随着绘画题目对应的直播内容的变化，虚拟对象也可以切换动作，不切换场景，或者是切换场景，不切换动作。
可选的，在播放绘画题目对应的直播内容的过程中，可以接收多个观众发送的互动信息，并接收互动信息对应的音频数据和文本信息，在直播界面中展示互动信息和回复互动信息的文本信息，基于音频数据生成虚拟对象针对互动信息回复的视频内容并在直播页面中播放。虚拟对象在直播绘画的过程中，可以在不停止绘画动作的情况下穿插回复观众的互动信息，虚拟对象于用户之间进行你画我猜的游戏以及互动聊天的两个环节可以同时进行，相互叠加，进一步提高了用户的参与度，增加了用户与虚拟对象之间互动的趣味性。
示例性的，图2为本公开实施例提供的第一种直播互动的示意图，如图2所示，图中展示了一个虚拟对象11的直播界面，该直播界面中展示了虚拟对象11进行绘画动作时的一个直播画面，虚拟对象11的手中拿着画板，在直播界面的第一区域展示了绘画板16，绘画板16中呈现了绘画动作对应的绘画轨迹图，如图中的半个瓶子，以及当前绘画题目的提示信息，如图中提示信息为“三个字、食物”。图2中的直播界面的左上角还展示了虚拟对象11的头像和名称，名称为“小A”，以及关注按键12。
图3为本公开实施例提供的第二种直播互动的示意图，图3展示了当前绘画题目随着第一绘画动作的进行，逐渐生成的绘画轨迹图，如图中的瓶子的下半部分是随着第一绘画动作进一步添加上去的，形成一个完整的瓶子，随着虚拟对象的第一绘画动作的进行可以提供更多线索提高用户作答的正确率。
在虚拟对象直播绘画的过程中，随着绘画题目对应的直播内容的变化，虚拟对象可以切换不同的动作，并且直播内容的场景也可以切换不同的场景，虚拟主播的直播内容与和绘画题目相匹配，关联性较高，使虚拟对象直播的效果更优，提高了虚拟对象展示的多样性和趣味性，进而提升了虚拟对象直播绘画中用户的体验效果。
步骤102、在直播界面的第二区域展示直播观众的多个评论信息。
其中，评论信息是指直播观众在观看虚拟对象的绘画轨迹图时输入的互动信息。该评论信息为针对上述会话轨迹图的评论信息。第二区域是指直播界面中设置的用于展示评论 信息的区域。第二区域的位置具体不限，且第二区域可以在直播界面上通过浮层或弹窗的形式进行展示。
本公开实施例中，终端在播放绘画题目对应的直播内容的过程中，可以接收来自多个直播观众的多个评论信息，并将多个评论信息展示在直播界面的第二区域。评论信息中可以包括针对虚拟对象的绘画轨迹图的作答信息，实现了虚拟对象在绘画过程中，用户可以实时进行猜题。
可选的，终端可以将作答信息仅展示在支持作答的直播观众自身浏览的作答界面中，其他观众不能观看到，提升猜题的公平性，具体可以根据实际场景进行设置。
示例性的，参见图2，直播界面的左下方设置了第二区域，第二区域中展示了观看虚拟对象直播绘画的不同直播观众发送的评论信息，例如图中的用户A发送的“你画的还不错”，用户B发送的“有画画的天赋”，以及用户C发送的“你画的不行啊”。直播界面的最下方还展示了当前用户发送评论信息的编辑区域13以及其他功能按键，例如图中的互动按键14以及活动及奖励按键15等，不同的功能按键具备不同的功能。
步骤103、在直播界面中播放虚拟对象针对目标评论信息的互动内容，并隐藏绘画板；其中，目标评论信息为评论信息的一个或多个。
本公开实施例中，在直播界面中播放虚拟对象针对目标评论信息的互动内容，包括：接收目标评论信息对应的回复音频数据和回复文本信息；在直播界面的第三区域展示目标评论信息和回复文本信息；基于回复音频数据生成虚拟对象针对目标评论信息的互动内容并在直播界面中播放。
目标评论信息是服务端基于预设方案在直播观众发送的多个评论信息中确定的需要回复的一个或多个，预设方案可以根据实际情况进行设定，例如可以为基于发送评论信息的直播观众的积分确定目标评论信息；或者查找与预设关键词匹配的目标评论信息，其中，预设关键词可以预先根据热点信息挖掘提取，也可以是与绘画题目相关的关键词；或者对评论信息进行语义识别，将表述意思相近的评论信息进行聚类，得到若干信息集合，拥有评论信息最多的集合即为直播观众互动最热的话题，将该集合对应的评论信息作为目标评论信息。回复文本信息是指服务端基于语料库确定的与目标评论信息匹配的回复内容，回复音频数据是通过文本转语音(Text To Speech，TTS)技术，实时将文本转化为虚拟对象的自然语音数据。终端可以接收目标评论信息对应的回复音频数据和回复文本信息，并基于回复音频数据和当前绘画题目的视频数据可以生成回复的互动内容，之后终端可以在直播界面的第三区域展示目标评论信息和回复文本信息，并在直播界面中播放虚拟对象针对目标评论信息进行回复的互动内容。
示例性的，图4为本公开实施例提供的第三种直播互动的示意图，如图4所示，直播界面中第三区域17中展示了当前的目标评论信息以及虚拟对象的回复文本信息，如图中目标评论信息为用户A发送的“你画的还不错”，虚拟对象的回复文本信息为“随手一画”，同时播放回复文本信息对应的音频内容。
上述方案中，终端可以在直播界面中播放虚拟对象针对评论信息进行回复的互动内容，并展示当前评论信息以及对应的回复文本信息，以使用户了解虚拟对象正在回复哪一个用 户的交互内容，进一步提升了用户与虚拟对象之间的互动深入程度，提高了互动交互体验。
本公开实施例中，直播互动方法还可以包括：响应于虚拟对象的第二绘画动作，在绘画板上展示第二绘画动作对应的绘画轨迹图。需要说明的是，第二绘画动作是第一绘画动作的后继动作，第一绘画动作和第二绘画动作用于共同完成针对一个绘画题目的绘画。其中，评论信息中包括针对第一绘画动作的绘画轨迹图的作答信息，第二绘画动作在作答信息中不存在绘画题目对应的正确答案时触发。
其中，第二绘画动作是当直播观众均不能猜中答案时虚拟对象的新的绘画动作，与上述第一绘画动作可以相同也可以不同，取决于服务端发送的动作画像数据。终端在播放绘画题目对应的直播内容的过程中，如果作答信息中不存在该绘画题目对应的正确答案，则虚拟对象开始进行第二绘画动作，此时直播界面的第一区域再次展示出绘画板，并在绘画板上呈现步骤S101中已经完成的绘画轨迹图，即第一绘画动作对应的绘画轨迹图，并随着虚拟对象的第二绘画动作不断更新绘画轨迹图，更新的绘画轨迹图为第二绘画动作对应的绘画轨迹图像。直播观众可以根据更新后的绘画轨迹图，继续输入评论信息进行作答。也即虚拟对象与用户之间的你画我猜的游戏可以分多段进行，一个绘画题目可以对应至少一个绘画轨迹图，使用户与虚拟对象之间的游戏互动更加深入，关联性更强。
示例性的，图5为本公开实施例提供的第四种直播互动的示意图，如图5所示，直播界面的绘画板16中展示了当前绘画题目随着第二绘画动作更新后的绘画轨迹图，如图中的包括“辣椒”的瓶子是在图3中的绘画轨迹图中进一步添加的，提供了更多线索提高用户作答的正确率。
本公开实施例中，在直播界面中播放虚拟对象针对目标评论信息的互动内容，包括：接收正确答案对应的音频数据，其中，正确答案在虚拟对象的游戏时间达到预设时间阈值时接收；播放基于音频数据生成的虚拟对象公布正确答案的互动直播内容。
服务端可以获取虚拟对象的游戏时间，如果虚拟对象的游戏时间达到预设时间阈值，和/或，作答信息中不存在正确答案时，可以发送正确答案对应的音频数据和/或文本信息至终端。终端接收到正确答案的音频数据和/或文本信息，可以基于音频数据以及绘画题目的视频数据生成互动直播内容，并在直播界面中播放虚拟对象公布正确答案的互动直播内容，和/或在直播界面中展示正确答案的文本信息。上述两种正确答案的公布方式可以使用户快速了解当前绘画题目的答题正确答案。
本公开实施例中，直播互动方法还可以包括：在直播界面上展示作答信息对应的反馈文本信息，反馈文本信息用于表征作答信息的答题结果，反馈文本信息根据作答信息与正确答案的比对结果确定。
反馈文本信息是指服务端根据作答信息与正确答案的对比结果确定的文本信息，可以表征作答信息的答题是否正确。服务端如果确定作答信息与正确答案相同，则可以确定答题正确，反馈文本信息为作答正确的文本信息，否则反馈文本信息为作答错误的文本信息。终端接收到反馈文本信息之后，可以在直播界面上展示该反馈文本信息。
由于评论信息中可以包括针对绘画轨迹图的作答信息，回复音频数据可以为基于作答信息确定的反馈音频数据，终端可以接收反馈音频数据，并基于反馈频数据生成虚拟对象 针对作答信息进行反馈的互动内容并在直播界面中播放。例如，用户可以观看到虚拟对象说出“这题你们都没答对哦”的互动内容。
示例性的，图6为本公开实施例提供的第五种直播互动的示意图如图6所示，直播界面中的反馈区域18中可以展示反馈文本信息，如图中的“答对啦”，并且还在反馈文本信息上添加对应的特殊动效，图中用户C的答案“辣椒酱”的答题正确。
当答题结果为答题正确时，服务端可以发送答题奖励给对应的用户，并返回答题奖励信息给用户端，用户端将该答题奖励信息展示给用户。答题奖励可以包括多种方式的奖励，例如可以包括积分、虚拟物品或虚拟货币等，具体不限。如图6所示，对于答题正确的用户，直播界面的反馈区域18中还展示了答题奖励信息，如图中虚拟物品“+100”和积分“+50”。
可选的，对于答题结果为答题正确的多个用户，服务端基于用户作答的时间可以进行排序，对排序靠前的预设数量的用户可以发送附加答题奖励终端可以展示包括该附加答题奖励的答题奖励信息。附加答题奖励也可以包括多种方式的奖励，具体不限。预设数量可以根据实际情况进行设置，例如服务端对于排序靠前的5个用户可以发送双倍积分作为附加答题奖励。
本公开实施例中，虚拟对象可以进行直播绘画，直播界面中呈现实时绘画的绘画轨迹图，直播观针对绘画轨迹图可以输入作答信息进行作答，如果答案正确，可以领取奖励，实现了虚拟对象与用户之间深入参与的你画我猜的互动游戏。可以理解的是，虚拟对象的直播绘画不会受到用户输入的作答信息的影响，即使用户输入的作答信息正确，直播绘画也不会停止，以使输入的作答信息错误或未输入作答信息的其他用户可以继续进行猜题。
其中，在直播界面中播放虚拟对象针对目标评论信息的互动内容时，还可以隐藏绘画板16，以便于用户更直观地查看虚拟对象针对目标评论信息的互动内容。在一些实施例中，也可以不执行隐藏绘画板16的步骤，如此，观众可以一边观看绘画板16，一边观看虚拟对象的互动内容。
本公开实施例提供的直播互动方案，播放绘画题目对应的直播内容，响应于虚拟对象的第一绘画动作，在直播界面的第一区域展示绘画板，以及在绘画板上呈现第一绘画动作对应的绘画轨迹图；在直播界面的第二区域展示直播观众的多个评论信息；在直播界面中播放虚拟对象针对目标评论信息的互动内容，并隐藏绘画板；其中，目标评论信息为评论信息的一个或多个。采用上述技术方案，根据虚拟对象直播绘画的绘画轨迹图用户可以进行猜题，并根据用户输入的评论信息进行回复，实现了虚拟对象与用户之间你画我猜的互动游戏，提高了虚拟对象直播的多样性和趣味性，进而提升了用户的互动体验效果。
在一些实施例中，直播互动方法还可以包括：获取虚拟对象的互动视频数据；基于互动视频数据在直播界面中播放虚拟对象与直播观众的互动直播内容。
其中，互动视频数据可以为虚拟对象主动发起话题与直播观众进行互功的视频数据，互动视频数据可以对应多个话题文本。可选地，服务端如果在设定时间内未接收到直播观众发送的评论信息，则可以发送虚拟对象的互动视频数据给终端，终端可以基于互动视频数据生成互动直播内容，并在直播界面中播放虚拟对象与直播观众进行互动的互动直播内容。上述设定时间可以根据实际情况进行设置，例如设定时间可以为5秒。
示例性的，如果服务端在5秒内没有接收到直播观众的评论信息，则可以发送互动视频数据给终端，使终端播放虚拟对象说出预设的说话台本的互动直播内容，如虚拟对象说“你们怎么不理我呢”、“好无聊啊”等。
上述方案中，在实现虚拟对象与用户你画我猜的游戏互动的基础上，当观看虚拟对象直播的用户暂时没有进行互动时，通过设置一些固定说话台本，使虚拟对象与直播观众主动进行互动，调动用户的互动积极性，提高虚拟对象直播时用户的互动效果。并且从游戏互动可以切换虚拟对象与用户进行互动聊天的环节，不同环节之间可以相互切换，更加提高了用户与虚拟对象之间互动的趣味性，提高了用户的互动体验效果。
在一些实施例中，直播互动方法还可以包括：在直播界面的第四区域展示互动面板，其中，互动面板中包括至少一个虚拟资源；基于用户对虚拟资源的触发，在虚拟对象上展示对应的特效效果，并在直播界面的第五区域展示特效效果的持续时间标识。
其中，虚拟资源可以采用预设形状的图像标识等方式展示在互动面板中，例如互动面板中展示的多个虚拟资源可以是不同特效的标识。互动面板支持用户的触控操作，例如点击、长按等，从而使得用户产生针对至少一个虚拟资源的触发操作。虚拟资源可以与虚拟对象的特效效果相对应，特效效果可以包括以下至少之一：服装变换类特效、装扮变换类特效、身体变换类特效和场景道具变换类特效。特效效果的持续时间标识用于提示用户当前直播界面上展示的特效效果的剩余展示时间。持续时间标识可以采用图像标识或文本等形式实现。
在直播界面的第四区域可以展示包括多个虚拟资源的互动面板，基于用户对虚拟资源的触发，可以在虚拟对象上展示对应的特效效果，并在直播界面的第五区域中展示当前特效效果对应的持续时间标识，以提示用户特效效果剩余展示时间。
示例性的，图7为本公开实施例提供的第六种直播互动的示意图，图中互动面板19展示了7个虚拟资源，包括冰冻、零食投喂、猫耳、喝饮料、吹风、换装和喂甜食，仅为示例。如图7直播界面中示出了用户对虚拟资源中的猫耳进行触发之后，在虚拟对象上展示猫耳对应的特效效果后，用户可以看到虚拟对象头上长出了猫耳。并且图中还展示了猫耳的特效效果对应的持续时间标识20，在虚拟对象的直播过程中，持续时间标识20上的圆形区域可以被不断地顺时针填充，达到猫耳的特效效果的预设展示时长后，圆形区域呈现完全填充状态，并且，持续时间标识20可以从直播界面上消失。
上述方案中，虚拟对象在直播的过程中可以基于用户的触发展示特定动态效果，丰富了虚拟直播场景下的直播互动方式，提高了直播趣味性，并且通过展示持续时间标识，可以用户了解特效效果的剩余展示时间，提高直播交互的友好性。
图8为本公开实施例提供的一种直播互动装置的结构示意图，该装置可由软件和/或硬件实现，一般可集成在电子设备中。如图8所示，该装置包括：
绘画直播模块301，用于播放绘画题目对应的直播内容，响应于虚拟对象的第一绘画动作，在直播界面的第一区域展示绘画板，以及在所述绘画板上呈现所述第一绘画动作对应的绘画轨迹图；
评论展示模块302，用于在所述直播界面的第二区域展示直播观众针对所述绘画轨迹图的评论信息；
回复直播模块303，用于在所述直播界面中播放所述虚拟对象针对目标评论信息的互动内容；其中，所述目标评论信息为所述评论信息的一个或多个。
可选的，所述回复直播模块303具体用于：
接收所述目标评论信息对应的回复音频数据和回复文本信息；
在所述直播界面的第三区域展示所述目标评论信息和所述回复文本信息，以及基于所述回复音频数据生成所述虚拟对象针对目标评论信息的互动内容并在所述直播界面中播放。
可选的，所述装置还包括绘画更新模块，用于：
响应于所述虚拟对象的第二绘画动作，在所述绘画板上展示所述第二绘画动作对应的绘画轨迹图。
可选的，所述评论信息中包括针对所述第一绘画动作的绘画轨迹图的作答信息，所述第二绘画动作在所述作答信息中不存在所述绘画题目对应的正确答案时触发。
可选的，所述回复直播模块303具体用于：
接收所述正确答案对应的音频数据，其中，所述正确答案在所述虚拟对象的游戏时间达到预设时间阈值时接收；
播放所述虚拟对象公布所述正确答案的互动直播内容，所述互动直播内容基于所述音频数据生成。
可选的，所述装置还包括反馈模块，用于：
在所述直播界面上展示所述作答信息对应的反馈文本信息，所述反馈文本信息用于表征所述作答信息的答题结果，所述反馈文本信息根据所述作答信息与所述正确答案的比对结果确定。
可选的，所述绘画直播模块301具体用于：
获取所述虚拟对象的至少一个绘画题目的视频数据和音频数据，其中，所述视频数据包括所述绘画题目对应的动作图像数据和多个场景的场景图像数据，所述动作图像数据用于生成所述第一绘画动作、所述绘画轨迹图和互动动作；
基于所述视频数据和所述音频数据生成所述绘画题目对应的直播内容并播放。
可选的，在播放所述绘画题目对应的直播内容的过程中，基于所述动作图像数据和所述多个场景的场景图像数据，所述直播内容的场景和/或所述虚拟对象的动作随直播内容的变化而进行切换。
可选的，所述装置还包括互动直播模块，用于：
获取所述虚拟对象的互动视频数据；
基于所述互动视频数据在所述直播界面中播放所述虚拟对象与所述直播观众的互动直播内容。
可选的，所述装置还包括特效模块，用于：
在所述直播界面的第四区域展示互动面板，其中，所述互动面板中包括至少一个虚拟资源；
基于用户对所述虚拟资源的触发，在所述虚拟对象上展示对应的特效效果，并在所述直播界面的第五区域展示所述特效效果的持续时间标识。
本公开实施例所提供的直播互动装置可执行本公开任意实施例所提供的直播互动方法，具备执行方法相应的功能模块和有益效果。
图9为本公开实施例提供的一种电子设备的结构示意图。下面具体参考图9，其示出了适于用来实现本公开实施例中的电子设备400的结构示意图。本公开实施例中的电子设备400可以包括但不限于诸如移动电话、笔记本电脑、数字广播接收器、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、车载终端(例如车载导航终端)等等的移动终端以及诸如数字TV、台式计算机等等的固定终端。图9示出的电子设备仅仅是一个示例，不应对本公开实施例的功能和使用范围带来任何限制。
如图9所示，电子设备400可以包括处理装置(例如中央处理器、图形处理器等)401，其可以根据存储在只读存储器(ROM)402中的程序或者从存储装置408加载到随机访问存储器(RAM)403中的程序而执行各种适当的动作和处理。在RAM 403中，还存储有电子设备400操作所需的各种程序和数据。处理装置401、ROM 402以及RAM 403通过总线404彼此相连。输入/输出(I/O)接口405也连接至总线404。
通常，以下装置可以连接至I/O接口405：包括例如触摸屏、触摸板、键盘、鼠标、摄像头、麦克风、加速度计、陀螺仪等的输入装置406；包括例如液晶显示器(LCD)、扬声器、振动器等的输出装置407；包括例如磁带、硬盘等的存储装置408；以及通信装置409。通信装置409可以允许电子设备400与其他设备进行无线或有线通信以交换数据。虽然图9示出了具有各种装置的电子设备400，但是应理解的是，并不要求实施或具备所有示出的装置。可以替代地实施或具备更多或更少的装置。
特别地，根据本公开的实施例，上文参考流程图描述的过程可以被实现为计算机软件程序。例如，本公开的实施例包括一种计算机程序产品，其包括承载在非暂态计算机可读介质上的计算机程序，该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中，该计算机程序可以通过通信装置409从网络上被下载和安装，或者从存储装置408被安装，或者从ROM 402被安装。在该计算机程序被处理装置401执行时，执行本公开实施例的直播互动方法中限定的上述功能。
需要说明的是，本公开上述的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本公开中，计算机可读信号介质可以包括在基带中或者作为载波一部分 传播的数据信号，其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式，包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读信号介质还可以是计算机可读存储介质以外的任何计算机可读介质，该计算机可读信号介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括但不限于：电线、光缆、RF(射频)等等，或者上述的任意合适的组合。
在一些实施方式中，客户端、服务器可以利用诸如HTTP(HyperText Transfer Protocol，超文本传输协议)之类的任何当前已知或未来研发的网络协议进行通信，并且可以与任意形式或介质的数字数据通信(例如，通信网络)互连。通信网络的示例包括局域网(“LAN”)，广域网(“WAN”)，网际网(例如，互联网)以及端对端网络(例如，ad hoc端对端网络)，以及任何当前已知或未来研发的网络。
上述计算机可读介质可以是上述电子设备中所包含的；也可以是单独存在，而未装配入该电子设备中。
上述计算机可读介质承载有一个或者多个程序，当上述一个或者多个程序被该电子设备执行时，使得该电子设备：播放绘画题目对应的直播内容，响应于虚拟对象的第一绘画动作，在直播界面的第一区域展示绘画板，以及在所述绘画板上呈现所述第一绘画动作对应的绘画轨迹图；在所述直播界面的第二区域展示直播观众的多个评论信息；在所述直播界面中播放所述虚拟对象针对目标评论信息的互动内容，并隐藏所述绘画板；其中，所述目标评论信息为所述评论信息的一个或多个。
可以以一种或多种程序设计语言或其组合来编写用于执行本公开的操作的计算机程序代码，上述程序设计语言包括但不限于面向对象的程序设计语言—诸如Java、Smalltalk、C++，还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络——包括局域网(LAN)或广域网(WAN)—连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。
附图中的流程图和框图，图示了按照本公开各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上，流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分，该模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意，在有些作为替换的实现中，方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如，两个接连地表示的方框实际上可以基本并行地执行，它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的是，框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合，可以用执行规定的功能或操作的专用的基于硬件的系统来实现，或者可以用专用硬件与计算机指令的组合来实现。
描述于本公开实施例中所涉及到的单元可以通过软件的方式实现，也可以通过硬件的 方式来实现。其中，单元的名称在某种情况下并不构成对该单元本身的限定。
本文中以上描述的功能可以至少部分地由一个或多个硬件逻辑部件来执行。例如，非限制性地，可以使用的示范类型的硬件逻辑部件包括：现场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、片上系统(SOC)、复杂可编程逻辑设备(CPLD)等等。
在本公开的上下文中，机器可读介质可以是有形的介质，其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备，或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。
根据本公开的一个或多个实施例，本公开提供了一种直播交互方法，包括：
播放绘画题目对应的直播内容，响应于虚拟对象的第一绘画动作，在直播界面的第一区域展示绘画板，以及在所述绘画板上呈现所述第一绘画动作对应的绘画轨迹图；
在所述直播界面的第二区域展示直播观众针对所述绘画轨迹图的评论信息；
在所述直播界面中播放所述虚拟对象针对目标评论信息的互动内容；其中，所述目标评论信息为所述评论信息的一个或多个。
根据本公开的一个或多个实施例，本公开提供的直播交互方法中，所述在所述直播界面中播放所述虚拟对象针对目标评论信息的互动内容，包括：
接收所述目标评论信息对应的回复音频数据和回复文本信息；
在所述直播界面的第三区域展示所述目标评论信息和所述回复文本信息，以及基于所述回复音频数据生成所述虚拟对象针对目标评论信息的互动内容并在所述直播界面中播放。
根据本公开的一个或多个实施例，本公开提供的直播交互方法中，还包括：
响应于所述虚拟对象的第二绘画动作，在所述绘画板上展示所述第二绘画动作对应的绘画轨迹图。
根据本公开的一个或多个实施例，本公开提供的直播交互方法中，所述评论信息中包括针对所述第一绘画动作的绘画轨迹图的作答信息，所述第二绘画动作在所述作答信息中不存在所述绘画题目对应的正确答案时触发。
根据本公开的一个或多个实施例，本公开提供的直播交互方法中，所述在所述直播界面中播放所述虚拟对象针对目标评论信息的互动内容，包括：
接收所述正确答案对应的音频数据，其中，所述正确答案在所述虚拟对象的游戏时间达到预设时间阈值时接收；
播放所述虚拟对象公布所述正确答案的互动直播内容，所述互动直播内容基于所述音频数据生成。
根据本公开的一个或多个实施例，本公开提供的直播交互方法中，还包括：
在所述直播界面上展示所述作答信息对应的反馈文本信息，所述反馈文本信息用于表征所述作答信息的答题结果，所述反馈文本信息根据所述作答信息与所述正确答案的比对结果确定。
根据本公开的一个或多个实施例，本公开提供的直播交互方法中，所述播放绘画题目对应的直播内容，包括：
获取所述虚拟对象的至少一个绘画题目的视频数据和音频数据，其中，所述视频数据包括所述绘画题目对应的动作图像数据和多个场景的场景图像数据，所述动作图像数据用于生成所述第一绘画动作、所述绘画轨迹图和互动动作；
基于所述视频数据和所述音频数据生成所述绘画题目对应的直播内容并播放。
根据本公开的一个或多个实施例，本公开提供的直播交互方法中，在播放所述绘画题目对应的直播内容的过程中，基于所述动作图像数据和所述多个场景的场景图像数据，所述直播内容的场景和/或所述虚拟对象的动作随直播内容的变化而进行切换。
根据本公开的一个或多个实施例，本公开提供的直播交互方法中，还包括：
获取所述虚拟对象的互动视频数据；
基于所述互动视频数据在所述直播界面中播放所述虚拟对象与所述直播观众的互动直播内容。
根据本公开的一个或多个实施例，本公开提供的直播交互方法中，还包括：
在所述直播界面的第四区域展示互动面板，其中，所述互动面板中包括至少一个虚拟资源；
基于用户对所述虚拟资源的触发，在所述虚拟对象上展示对应的特效效果，并在所述直播界面的第五区域展示所述特效效果的持续时间标识。
根据本公开的一个或多个实施例，本公开提供了一种直播交互装置，包括：
绘画直播模块，用于播放绘画题目对应的直播内容，响应于虚拟对象的第一绘画动作，在直播界面的第一区域展示绘画板，以及在所述绘画板上呈现所述第一绘画动作对应的绘画轨迹图；
评论展示模块，用于在所述直播界面的第二区域展示直播观众针对所述绘画轨迹图的评论信息；
回复直播模块，用于在所述直播界面中播放所述虚拟对象针对目标评论信息的互动内容；其中，所述目标评论信息为所述评论信息的一个或多个。
根据本公开的一个或多个实施例，本公开提供的直播交互装置中，所述回复直播模块具体用于：
接收所述目标评论信息对应的回复音频数据和回复文本信息；
在所述直播界面的第三区域展示所述目标评论信息和所述回复文本信息；
基于所述回复音频数据生成所述虚拟对象针对目标评论信息的互动内容并在所述直播界面中播放。
根据本公开的一个或多个实施例，本公开提供的直播交互装置中，所述装置还包括绘画更新模块，用于：
响应于所述虚拟对象的第二绘画动作，在所述绘画板上展示所述第二绘画动作对应的绘画轨迹图。
根据本公开的一个或多个实施例，本公开提供的直播交互装置中，所述评论信息中包括针对所述第一绘画动作的绘画轨迹图的作答信息，所述第二绘画动作在所述作答信息中不存在所述绘画题目对应的正确答案时触发。
根据本公开的一个或多个实施例，本公开提供的直播交互装置中，所述回复直播模块具体用于：
接收所述正确答案对应的音频数据，其中，所述正确答案在所述虚拟对象的游戏时间达到预设时间阈值时接收；
播放所述虚拟对象公布所述正确答案的互动直播内容，所述互动直播内容基于所述音频数据生成。
根据本公开的一个或多个实施例，本公开提供的直播交互装置中，所述装置还包括反馈模块，用于：
在所述直播界面上展示所述作答信息对应的反馈文本信息，所述反馈文本信息用于表征所述作答信息的答题结果，所述反馈文本信息根据所述作答信息与所述正确答案的比对结果确定。
根据本公开的一个或多个实施例，本公开提供的直播交互装置中，所述绘画直播模块具体用于：
获取所述虚拟对象的至少一个绘画题目的视频数据和音频数据，其中，所述视频数据包括所述绘画题目对应的动作图像数据和多个场景的场景图像数据，所述动作图像数据用于生成所述第一绘画动作、所述绘画轨迹图和互动动作；
基于所述视频数据和所述音频数据生成所述绘画题目对应的直播内容并播放。
根据本公开的一个或多个实施例，本公开提供的直播交互装置中，在播放所述绘画题目对应的直播内容的过程中，基于所述动作图像数据和所述多个场景的场景图像数据，所述直播内容的场景和/或所述虚拟对象的动作随直播内容的变化而进行切换。
根据本公开的一个或多个实施例，本公开提供的直播交互装置中，所述装置还包括互动直播模块，用于：
获取所述虚拟对象的互动视频数据；
基于所述互动视频数据在所述直播界面中播放所述虚拟对象与所述直播观众的互动直播内容。
根据本公开的一个或多个实施例，本公开提供的直播交互装置中，所述装置还包括特效模块，用于：
在所述直播界面的第四区域展示互动面板，其中，所述互动面板中包括至少一个虚拟资源；
基于用户对所述虚拟资源的触发，在所述虚拟对象上展示对应的特效效果，并在所述 直播界面的第五区域展示所述特效效果的持续时间标识。
根据本公开的一个或多个实施例，本公开提供了一种电子设备，包括：
处理器；
用于存储所述处理器可执行指令的存储器；
所述处理器，用于从所述存储器中读取所述可执行指令，并执行所述指令以实现如本公开提供的任一所述的直播交互方法。
根据本公开的一个或多个实施例，本公开提供了一种计算机可读存储介质，所述存储介质存储有计算机程序，所述计算机程序用于执行如本公开提供的任一所述的直播交互方法。
以上描述仅为本公开的较佳实施例以及对所运用技术原理的说明。本领域技术人员应当理解，本公开中所涉及的公开范围，并不限于上述技术特征的特定组合而成的技术方案，同时也应涵盖在不脱离上述公开构思的情况下，由上述技术特征或其等同特征进行任意组合而形成的其它技术方案。例如上述特征与本公开中公开的(但不限于)具有类似功能的技术特征进行互相替换而形成的技术方案。
此外，虽然采用特定次序描绘了各操作，但是这不应当理解为要求这些操作以所示出的特定次序或以顺序次序执行来执行。在一定环境下，多任务和并行处理可能是有利的。同样地，虽然在上面论述中包含了若干具体实现细节，但是这些不应当被解释为对本公开的范围的限制。在单独的实施例的上下文中描述的某些特征还可以组合地实现在单个实施例中。相反地，在单个实施例的上下文中描述的各种特征也可以单独地或以任何合适的子组合的方式实现在多个实施例中。
尽管已经采用特定于结构特征和/或方法逻辑动作的语言描述了本主题，但是应当理解所附权利要求书中所限定的主题未必局限于上面描述的特定特征或动作。相反，上面所描述的特定特征和动作仅仅是实现权利要求书的示例形式。

Claims (13)

  1. 一种直播互动方法，其特征在于，包括：
    播放绘画题目对应的直播内容，响应于虚拟对象的第一绘画动作，在直播界面的第一区域展示绘画板，以及在所述绘画板上呈现所述第一绘画动作对应的绘画轨迹图；
    在所述直播界面的第二区域展示直播观众针对所述绘画轨迹图的评论信息；
    在所述直播界面中播放所述虚拟对象针对目标评论信息的互动内容；其中，所述目标评论信息为所述评论信息的一个或多个。
  2. 根据权利要求1所述的方法，其特征在于，所述在所述直播界面中播放所述虚拟对象针对目标评论信息的互动内容，包括：
    接收所述目标评论信息对应的回复音频数据和回复文本信息；
    在所述直播界面的第三区域展示所述目标评论信息和所述回复文本信息，以及基于所述回复音频数据生成所述虚拟对象针对目标评论信息的互动内容并在所述直播界面中播放。
  3. 根据权利要求1所述的方法，其特征在于，还包括：
    响应于所述虚拟对象的第二绘画动作，在所述绘画板上展示所述第二绘画动作对应的绘画轨迹图。
  4. 根据权利要求3所述的方法，其特征在于，所述评论信息中包括针对所述第一绘画动作的绘画轨迹图的作答信息，所述第二绘画动作在所述作答信息中不存在所述绘画题目对应的正确答案时触发。
  5. 根据权利要求4所述的方法，其特征在于，所述在所述直播界面中播放所述虚拟对象针对目标评论信息的互动内容，包括：
    接收所述正确答案对应的音频数据，其中，所述正确答案在所述虚拟对象的游戏时间达到预设时间阈值时接收；
    播放所述虚拟对象公布所述正确答案的互动直播内容，所述互动直播内容基于所述音频数据生成。
  6. 根据权利要求4所述的方法，其特征在于，还包括：
    在所述直播界面上展示所述作答信息对应的反馈文本信息，所述反馈文本信息用于表征所述作答信息的答题结果，所述反馈文本信息根据所述作答信息与所述正确答案的比对结果确定。
  7. 根据权利要求1所述的方法，其特征在于，所述播放绘画题目对应的直播内容，包括：
    获取所述虚拟对象的至少一个绘画题目的视频数据和音频数据，其中，所述视频数据包括所述绘画题目对应的动作图像数据和多个场景的场景图像数据，所述动作图像数据用于生成所述第一绘画动作、所述绘画轨迹图和互动动作；
    基于所述视频数据和所述音频数据生成所述绘画题目对应的直播内容并播放。
  8. 根据权利要求7所述的方法，其特征在于，在播放所述绘画题目对应的直播内容的 过程中，基于所述动作图像数据和所述多个场景的场景图像数据，所述直播内容的场景和/或所述虚拟对象的动作随直播内容的变化而进行切换。
  9. 根据权利要求7所述的方法，其特征在于，还包括：
    获取所述虚拟对象的互动视频数据；
    基于所述互动视频数据在所述直播界面中播放所述虚拟对象与所述直播观众的互动直播内容。
  10. 根据权利要求1所述的方法，其特征在于，还包括：
    在所述直播界面的第四区域展示互动面板，其中，所述互动面板中包括至少一个虚拟资源；
    基于用户对所述虚拟资源的触发，在所述虚拟对象上展示对应的特效效果，并在所述直播界面的第五区域展示所述特效效果的持续时间标识。
  11. 一种直播互动装置，其特征在于，包括：
    绘画直播模块，用于播放绘画题目对应的直播内容，响应于虚拟对象的第一绘画动作，在直播界面的第一区域展示绘画板，以及在所述绘画板上呈现所述第一绘画动作对应的绘画轨迹图；
    评论展示模块，用于在所述直播界面的第二区域展示直播观众针对所述绘画轨迹图的评论信息；
    回复直播模块，用于在所述直播界面中播放所述虚拟对象针对目标评论信息的互动内容；其中，所述目标评论信息为所述评论信息的一个或多个。
  12. 一种电子设备，其特征在于，所述电子设备包括：
    处理器；
    用于存储所述处理器可执行指令的存储器；
    所述处理器，用于从所述存储器中读取所述可执行指令，并执行所述指令以实现上述权利要求1-10中任一所述的直播互动方法。
  13. 一种计算机可读存储介质，其特征在于，所述存储介质存储有计算机程序，所述计算机程序用于执行上述权利要求1-10中任一所述的直播互动方法。
PCT/CN2021/128072 2020-12-11 2021-11-02 一种直播互动方法、装置、设备及介质 WO2022121557A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011460121.6 2020-12-11
CN202011460121.6A CN112601100A (zh) 2020-12-11 2020-12-11 一种直播互动方法、装置、设备及介质

Publications (1)

Publication Number Publication Date
WO2022121557A1 true WO2022121557A1 (zh) 2022-06-16

Family

ID=75192624

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/128072 WO2022121557A1 (zh) 2020-12-11 2021-11-02 一种直播互动方法、装置、设备及介质

Country Status (2)

Country Link
CN (1) CN112601100A (zh)
WO (1) WO2022121557A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115174953A (zh) * 2022-07-19 2022-10-11 广州虎牙科技有限公司 赛事虚拟直播方法、系统及赛事直播服务器
CN115278336A (zh) * 2022-07-20 2022-11-01 北京字跳网络技术有限公司 一种信息处理方法及装置
CN116033175A (zh) * 2022-12-27 2023-04-28 南京汇智互娱网络科技有限公司 基于虚拟形象的直播互动服务方法及系统

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112601100A (zh) * 2020-12-11 2021-04-02 北京字跳网络技术有限公司 一种直播互动方法、装置、设备及介质
CN113115061B (zh) * 2021-04-07 2023-03-10 北京字跳网络技术有限公司 直播交互方法、装置、电子设备和存储介质
CN113507620B (zh) * 2021-07-02 2022-05-31 腾讯科技（深圳）有限公司 直播数据处理方法、装置、设备以及存储介质
CN113504853A (zh) * 2021-07-08 2021-10-15 维沃移动通信（杭州）有限公司 评论生成方法和装置
CN113867593B (zh) * 2021-10-18 2024-10-15 北京字跳网络技术有限公司 一种互动方法、装置、电子设备和存储介质
CN114115528B (zh) * 2021-11-02 2024-01-19 深圳市雷鸟网络传媒有限公司 虚拟对象控制方法、装置、计算机设备和存储介质
WO2023134558A1 (zh) * 2022-01-14 2023-07-20 北京字跳网络技术有限公司 交互方法、装置、电子设备、存储介质和程序产品
CN114125492B (zh) * 2022-01-24 2022-07-15 阿里巴巴（中国）有限公司 直播内容生成方法以及装置
CN114125569B (zh) * 2022-01-27 2022-07-15 阿里巴巴（中国）有限公司 直播处理方法以及装置
CN115314749B (zh) * 2022-06-15 2024-03-22 网易（杭州）网络有限公司 互动信息的响应方法、装置和电子设备
CN116095383A (zh) * 2022-11-01 2023-05-09 上海哔哩哔哩科技有限公司 互动面板展示方法、第一服务端、用户端及系统
CN115665436A (zh) * 2022-11-10 2023-01-31 北京字跳网络技术有限公司 用于在线直播的方法、装置、设备和存储介质
CN118214906A (zh) * 2022-12-15 2024-06-18 腾讯科技（深圳）有限公司 基于虚拟场景的互动方法、设备、存储介质及程序产品
CN116527956B (zh) * 2023-07-03 2023-08-22 世优（北京）科技有限公司 基于目标事件触发的虚拟对象直播方法、装置及系统

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140123014A1 (en) * 2012-11-01 2014-05-01 Inxpo, Inc. Method and system for chat and activity stream capture and playback
CN106878820A (zh) * 2016-12-09 2017-06-20 北京小米移动软件有限公司 直播互动方法及装置
CN107750005A (zh) * 2017-09-18 2018-03-02 迈吉客科技（北京）有限公司 虚拟互动方法和终端
CN109271553A (zh) * 2018-08-31 2019-01-25 乐蜜有限公司 一种虚拟形象视频播放方法、装置、电子设备及存储介质
CN110035325A (zh) * 2019-04-19 2019-07-19 广州虎牙信息科技有限公司 弹幕回复方法、弹幕回复装置和直播设备
CN110139142A (zh) * 2019-05-16 2019-08-16 北京达佳互联信息技术有限公司 虚拟物品显示方法、装置、终端及存储介质
CN111277849A (zh) * 2020-02-11 2020-06-12 腾讯科技（深圳）有限公司 一种图像处理方法、装置、计算机设备以及存储介质
CN112601100A (zh) * 2020-12-11 2021-04-02 北京字跳网络技术有限公司 一种直播互动方法、装置、设备及介质

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106873893B (zh) * 2017-02-13 2021-01-22 北京光年无限科技有限公司 用于智能机器人的多模态交互方法及装置
CN107423809B (zh) * 2017-07-07 2021-02-26 北京光年无限科技有限公司 应用于视频直播平台的虚拟机器人多模态交互方法和系统
CN108322832B (zh) * 2018-01-22 2022-05-17 阿里巴巴（中国）有限公司 评论方法、装置、及电子设备
CN110557625A (zh) * 2019-09-17 2019-12-10 北京达佳互联信息技术有限公司 虚拟形象直播方法、终端、计算机设备及存储介质
CN110662083B (zh) * 2019-09-30 2022-04-22 北京达佳互联信息技术有限公司 数据处理方法、装置、电子设备及存储介质
CN112995706B (zh) * 2019-12-19 2022-04-19 腾讯科技（深圳）有限公司 基于人工智能的直播方法、装置、设备及存储介质

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140123014A1 (en) * 2012-11-01 2014-05-01 Inxpo, Inc. Method and system for chat and activity stream capture and playback
CN106878820A (zh) * 2016-12-09 2017-06-20 北京小米移动软件有限公司 直播互动方法及装置
CN107750005A (zh) * 2017-09-18 2018-03-02 迈吉客科技（北京）有限公司 虚拟互动方法和终端
CN109271553A (zh) * 2018-08-31 2019-01-25 乐蜜有限公司 一种虚拟形象视频播放方法、装置、电子设备及存储介质
CN110035325A (zh) * 2019-04-19 2019-07-19 广州虎牙信息科技有限公司 弹幕回复方法、弹幕回复装置和直播设备
CN110139142A (zh) * 2019-05-16 2019-08-16 北京达佳互联信息技术有限公司 虚拟物品显示方法、装置、终端及存储介质
CN111277849A (zh) * 2020-02-11 2020-06-12 腾讯科技（深圳）有限公司 一种图像处理方法、装置、计算机设备以及存储介质
CN112601100A (zh) * 2020-12-11 2021-04-02 北京字跳网络技术有限公司 一种直播互动方法、装置、设备及介质

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115174953A (zh) * 2022-07-19 2022-10-11 广州虎牙科技有限公司 赛事虚拟直播方法、系统及赛事直播服务器
CN115174953B (zh) * 2022-07-19 2024-04-26 广州虎牙科技有限公司 赛事虚拟直播方法、系统及赛事直播服务器
CN115278336A (zh) * 2022-07-20 2022-11-01 北京字跳网络技术有限公司 一种信息处理方法及装置
CN115278336B (zh) * 2022-07-20 2024-03-29 北京字跳网络技术有限公司 一种信息处理方法及装置
CN116033175A (zh) * 2022-12-27 2023-04-28 南京汇智互娱网络科技有限公司 基于虚拟形象的直播互动服务方法及系统

Also Published As

Publication number Publication date
CN112601100A (zh) 2021-04-02

Similar Documents

Publication Publication Date Title
WO2022121557A1 (zh) 一种直播互动方法、装置、设备及介质
WO2022121601A1 (zh) 一种直播互动方法、装置、设备及介质
WO2021254186A1 (zh) 一种活动入口的展示方法、装置、电子设备及存储介质
WO2018010682A1 (zh) 直播方法、直播数据流展示方法和终端
US11247134B2 (en) Message push method and apparatus, device, and storage medium
CN108924661B (zh) 基于直播间的数据交互方法、装置、终端和存储介质
US12001478B2 (en) Video-based interaction implementation method and apparatus, device and medium
WO2022089192A1 (zh) 一种互动处理方法、装置、电子设备和存储介质
WO2022062643A1 (zh) 游戏直播互动方法及装置
CN109600559B (zh) 一种视频特效添加方法、装置、终端设备及存储介质
WO2023001065A1 (zh) 群组互动方法、装置、设备及存储介质
US11671657B2 (en) Method and apparatus for shared viewing of media content
WO2023131104A1 (zh) 直播过程中的界面显示方法、装置、设备、介质及产品
WO2023078069A1 (zh) 一种直播互动方法、系统及相关装置
WO2024193412A1 (zh) 视频通话方法、装置、电子设备及存储介质
CN114895787A (zh) 多人互动方法、装置、电子设备及存储介质
JP7255026B2 (ja) ビデオ録画方法、装置、電子機器及び記憶媒体
CN112752159B (zh) 一种互动方法和相关装置
CN112954426B (zh) 视频播放方法、电子设备及存储介质
CN112015506B (zh) 内容展示方法及装置
TW201917556A (zh) 多屏互動方法、裝置及電子設備
US20240015262A1 (en) Facilitating avatar modifications for learning and other videotelephony sessions in advanced networks
US11526269B2 (en) Video playing control method and apparatus, device, and storage medium
CN112309390A (zh) 信息交互方法和装置
WO2023226851A1 (zh) 三维效果形象的生成方法、装置、电子设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21902264

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21902264

Country of ref document: EP

Kind code of ref document: A1