WO2022223029A1 - Avatar interaction method, apparatus, and device - Google Patents

Avatar interaction method, apparatus, and device Download PDF

Info

Publication number
WO2022223029A1
WO2022223029A1 PCT/CN2022/088522 CN2022088522W WO2022223029A1 WO 2022223029 A1 WO2022223029 A1 WO 2022223029A1 CN 2022088522 W CN2022088522 W CN 2022088522W WO 2022223029 A1 WO2022223029 A1 WO 2022223029A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
avatar
live broadcast
singing
virtual
Prior art date
Application number
PCT/CN2022/088522
Other languages
French (fr)
Chinese (zh)
Inventor
李娣
林克
周萍萍
冯培林
陈建平
赖镇威
赵晶鑫
Original Assignee
北京字节跳动网络技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京字节跳动网络技术有限公司 filed Critical 北京字节跳动网络技术有限公司
Publication of WO2022223029A1 publication Critical patent/WO2022223029A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0483Interaction with page-structured environments, e.g. book metaphor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • G06T13/203D [Three Dimensional] animation
    • G06T13/403D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/20Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Human Computer Interaction (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Architecture (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present disclosure relates to an avatar interaction method, apparatus, and device. The method comprises: after a singing live broadcast is started in a virtual live broadcast room, in response to an instruction of a user in the virtual live broadcast room, the avatar of the user can be configured and a target drive mode of the avatar of the user can be started; and when the user is singing in the virtual live broadcast room, the avatar of the user who simulates a target action corresponding to the target drive mode can be displayed performing singing in the virtual live broadcast room.

Description

虚拟形象的互动方法、装置和设备Interactive method, device and device for avatar
本公开要求于2021年04月22日提交中国国家知识产权局、申请号为202110436963.6、发明名称为“虚拟形象的互动方法、装置和设备”的中国专利申请的优先权,其全部内容通过引用结合在本公开中。This disclosure claims the priority of the Chinese patent application with the application number 202110436963.6 and the invention title "Interactive Method, Apparatus and Device for Virtual Image", filed with the State Intellectual Property Office of China on April 22, 2021, the entire contents of which are incorporated by reference in this disclosure.
技术领域technical field
本公开涉及直播技术领域,尤其涉及一种虚拟形象的互动方法、装置和设备。The present disclosure relates to the technical field of live broadcasting, and in particular, to an interactive method, device and device for virtual images.
背景技术Background technique
随着互联网技术的不断发展,网络直播应运而生,为用户提供了丰富多彩的娱乐生活。通过网络直播,可实现多方异地的实时互动,一般会为不同的网络直播分配不同的接入地址(或称为链接地址),简称虚拟直播间。从而,用户可进入到虚拟直播间中进行观看和互动。例如,用户可进入到歌房场景下的虚拟直播间进行演唱。With the continuous development of Internet technology, webcasting has emerged as the times require, providing users with a rich and colorful entertainment life. Through webcasting, real-time interaction between multiple parties and different places can be realized. Generally, different access addresses (or link addresses) are allocated for different webcasting, which is referred to as a virtual live broadcast room. Thus, users can enter the virtual live broadcast room to watch and interact. For example, the user can enter the virtual live room in the singing room scene to sing.
发明内容SUMMARY OF THE INVENTION
为了解决上述技术问题或者至少部分地解决上述技术问题,本公开实施例提供了一种虚拟形象的互动方法、装置和设备。In order to solve the above technical problem or at least partially solve the above technical problem, the embodiments of the present disclosure provide a method, apparatus and device for interacting with a virtual image.
第一方面,本公开实施例提供了一种虚拟形象的互动方法,包括:In a first aspect, an embodiment of the present disclosure provides a method for interacting with an avatar, including:
在一个虚拟直播间开启唱歌直播后,响应于虚拟直播间中的一个用户的指令,配置用户的虚拟形象以及启动用户的虚拟形象的目标驱动模式;在用户在虚拟直播间中进行演唱的过程中,显示模拟与目标驱动模式对应的目标动作的用户的虚拟形象在虚拟直播间中进行演唱。After the singing live broadcast is started in a virtual live broadcast room, in response to an instruction of a user in the virtual live broadcast room, configure the user's avatar and activate the target drive mode of the user's avatar; during the process of the user singing in the virtual live broadcast room , displaying the avatar of the user who simulates the target action corresponding to the target driving mode and sings in the virtual live room.
在一种可能的设计中,该方法还包括:通过摄像头拍摄用户的拍摄照片;基于用户的拍摄照片,确定用户的虚拟形象;确定目标驱动模式。In a possible design, the method further includes: taking a photograph of the user through a camera; determining an avatar of the user based on the photograph of the user; and determining a target driving mode.
在一种可能的设计中,该方法还包括:从本地存储空间中获取用户的相册照片;基于用户的相册照片,确定用户的虚拟形象;确定目标驱动模式。In a possible design, the method further includes: acquiring the user's album photos from the local storage space; determining the user's avatar based on the user's album photos; determining the target driving mode.
在一种可能的设计中,该方法还包括:基于一个默认形象,确定用户的虚拟形象;确定目标驱动模式。In a possible design, the method further includes: determining an avatar of the user based on a default avatar; and determining a target-driven mode.
在一种可能的设计中,在目标驱动模式为实时驱动模式时,显示模拟与目标驱动模式对应的目标动作的用户的虚拟形象在虚拟直播间中进行演唱,包括:通过摄像头实时采集用户的头部动作;将用户的头部动作确定为目标动作;显示实时模拟用户头部动作的用户的虚拟形象在虚拟直播间中进行演唱。In a possible design, when the target driving mode is the real-time driving mode, displaying the avatar of the user who simulates the target action corresponding to the target driving mode and sings in the virtual live room, including: capturing the head of the user in real time through a camera The head action of the user is determined as the target action; the avatar of the user that simulates the head action of the user in real time is displayed to sing in the virtual live broadcast room.
在一种可能的设计中,该方法还包括:在用户在虚拟直播间中开始唱歌时,在虚拟直播间中显示第一提示信息,第一提示信息用于提示用户的虚拟形象模拟摄像头实时采集的用户的头部动作。In a possible design, the method further includes: when the user starts singing in the virtual live broadcast room, displaying first prompt information in the virtual live broadcast room, where the first prompt information is used to prompt the user's avatar to simulate real-time acquisition by a camera the user's head motion.
在一种可能的设计中,该方法还包括:在用户的头部离开摄像头的识别区域后,在虚拟直播间中显示第二提示信息,第二提示信息用于提示用户调整用户的头部。In a possible design, the method further includes: after the user's head leaves the recognition area of the camera, displaying second prompt information in the virtual live broadcast room, where the second prompt information is used to prompt the user to adjust the user's head.
在一种可能的设计中,在目标驱动模式为默认驱动模式时,显示模拟与目标驱动模式对应的目标动作的用户的虚拟形象在虚拟直播间中进行演唱,包括:基于用户演唱的歌曲的节奏和/或音调,确定默认动作;将默认动作确定为目标动作;显示模拟默认动作的用户的虚拟形象在虚拟直播间中进行演唱。In a possible design, when the target driving mode is the default driving mode, the avatar of the user who simulates the target action corresponding to the target driving mode is displayed to sing in the virtual live room, including: based on the rhythm of the song sung by the user and/or tone, determine the default action; determine the default action as the target action; display the avatar of the user who simulates the default action to sing in the virtual live room.
第二方面,本公开实施例提供了一种虚拟形象的互动装置,包括:In a second aspect, an embodiment of the present disclosure provides an interactive device for a virtual image, including:
配置模块,用于在一个虚拟直播间开启唱歌直播后,响应于虚拟直播间中的一个用户的指令,配置用户的虚拟形象以及启动用户的虚拟形象的目标驱动模式;The configuration module is used to configure the user's avatar and start the target drive mode of the user's avatar in response to an instruction of a user in the virtual live broadcast room after the singing live broadcast is opened in a virtual live broadcast room;
显示模块,用于显示模拟与目标驱动模式对应的目标动作的用户的虚拟形象在虚拟直播间中进行演唱。The display module is used for displaying the avatar of the user who simulates the target action corresponding to the target driving mode to sing in the virtual live broadcast room.
在一种可能的设计中,该虚拟形象的互动装置,还包括:In a possible design, the interactive device of the avatar further includes:
第一获取模块,用于通过摄像头拍摄用户的拍摄照片;a first acquisition module, used for capturing a photo of the user through a camera;
第一确定模块,用于基于用户的拍摄照片,确定用户的虚拟形象;a first determining module, configured to determine the avatar of the user based on the photograph taken by the user;
第一确定模块,还用于确定目标驱动模式。The first determining module is further configured to determine the target driving mode.
在一种可能的设计中,该虚拟形象的互动装置,还包括:In a possible design, the interactive device of the avatar further includes:
第二获取模块,用于从本地存储空间中获取用户的相册照片;The second acquisition module is used to acquire the user's album photos from the local storage space;
第二确定模块,用于基于用户的相册照片,确定用户的虚拟形象;The second determining module is used to determine the avatar of the user based on the photo album of the user;
第二确定模块,还用于确定目标驱动模式。The second determining module is further configured to determine the target driving mode.
在一种可能的设计中,该虚拟形象的互动装置,还包括:In a possible design, the interactive device of the avatar further includes:
第三确定模块,用于基于一个默认形象,确定用户的虚拟形象;第三确定模块,还用于确定目标驱动模式。The third determination module is used for determining the avatar of the user based on a default image; the third determination module is further used for determining the target driving mode.
在一种可能的设计中,在目标驱动模式为实时驱动模式时,显示模块,具体用于通过摄像头实时采集用户的头部动作;将用户的头部动作确定为目标动作;显示实时模拟用户头部动作的用户的虚拟形象在虚拟直播间中进行演唱。In a possible design, when the target driving mode is the real-time driving mode, the display module is specifically used to collect the user's head movement in real time through the camera; determine the user's head movement as the target movement; display the real-time simulated user head movement The avatar of the user who performs the action will sing in the virtual live room.
在一种可能的设计中,显示模块,还用于在用户在虚拟直播间中开始唱歌时,在虚拟直播间中显示第一提示信息,第一提示信息用于提示用户的虚拟形象实时模拟摄像头实时采集的用户的头部动作。In a possible design, the display module is further configured to display first prompt information in the virtual live broadcast room when the user starts singing in the virtual live broadcast room, where the first prompt information is used to prompt the user's avatar to simulate a camera in real time The head movements of the user are collected in real time.
在一种可能的设计中,显示模块,还用于在用户的头部离开摄像头的识别区域后,在虚拟直播间中显示第二提示信息,第二提示信息用于提示用户调整用户的头部。In a possible design, the display module is further configured to display second prompt information in the virtual live broadcast room after the user's head leaves the recognition area of the camera, where the second prompt information is used to prompt the user to adjust the user's head .
在一种可能的设计中,在目标驱动模式为默认驱动模式时,显示模块,具体用于基于用户演唱的歌曲的节奏和/或音调,确定默认动作;将默认动作确定为目标动作;显示模拟默认动作的用户的虚拟形象在虚拟直播间中进行演唱。In a possible design, when the target driving mode is the default driving mode, the display module is specifically configured to determine a default action based on the rhythm and/or pitch of the song sung by the user; determine the default action as the target action; display the simulation The avatar of the user in the default action sings in the virtual live room.
第三方面,本公开实施例提供了一种电子设备,包括:存储器和处理器;存储器用于存储程序指令;处理器用于调用存储器中的程序指令使得电子设备执行第一方面及第一方面任一种可能的设计中的虚拟形象的互动方法。In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a memory and a processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory so that the electronic device executes the first aspect and any of the first aspects. An interactive approach to avatars in a possible design.
第四方面,本公开实施例提供了一种计算机存储介质,包括计算机指令,当计算机指令在电子设备上运行时,使得电子设备执行第一方面及第一方面任一种可能的设计中的虚拟形象的互动方法。In a fourth aspect, an embodiment of the present disclosure provides a computer storage medium, including computer instructions, when the computer instructions are executed on an electronic device, the electronic device enables the electronic device to execute the first aspect and any possible design of the first aspect. The interactive method of the image.
第五方面,本公开实施例提供了一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行第一方面及第一方面任一种可能的设计中的虚拟形象的互动方法。In a fifth aspect, an embodiment of the present disclosure provides a computer program product, which, when the computer program product runs on a computer, enables the computer to execute the first aspect and the interactive method of the avatar in any possible design of the first aspect.
第六方面,本公开实施例提供了一种芯片系统,芯片系统包括:处理器;当处理器执行存储器中存储的计算机指令时,电子设备执行第一方面及第一方面任一种可能的设计中的虚拟形象的互动方法。In a sixth aspect, an embodiment of the present disclosure provides a chip system, the chip system includes: a processor; when the processor executes a computer instruction stored in a memory, the electronic device executes the first aspect and any possible design of the first aspect Interactive methods for avatars in .
附图说明Description of drawings
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本公开的实施例,并与说明书一起用于解释本公开实施例的原理。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure, and together with the description serve to explain the principles of the embodiments of the disclosure.
为了更清楚地说明本公开实施例或相关技术中的技术方案,下面将对实施例或相关技术描述中所需要使用的附图作简单地介绍,显而易见地,对于本领域普通技术人员而言,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or related technologies, the accompanying drawings required for describing the embodiments or related technologies will be briefly introduced below. Obviously, for those skilled in the art, On the premise of no creative labor, other drawings can also be obtained from these drawings.
图1A-图1Z为本公开实施例提供的人机交互界面示意图;1A-1Z are schematic diagrams of human-computer interaction interfaces provided by embodiments of the present disclosure;
图2为本公开实施例提供的虚拟形象的互动方法的流程示意图;FIG. 2 is a schematic flowchart of a method for interacting with a virtual image according to an embodiment of the present disclosure;
图3为本公开实施例提供的虚拟形象的互动装置的结构示意图;FIG. 3 is a schematic structural diagram of an interactive device for a virtual image provided by an embodiment of the present disclosure;
图4为本公开实施例提供的虚拟形象的互动装置的结构示意图;FIG. 4 is a schematic structural diagram of an interactive device for a virtual image provided by an embodiment of the present disclosure;
图5为本公开实施例提供的虚拟形象的互动装置的结构示意图;FIG. 5 is a schematic structural diagram of an interactive device for a virtual image provided by an embodiment of the present disclosure;
图6为本公开实施例提供的虚拟形象的互动装置的结构示意图。FIG. 6 is a schematic structural diagram of a virtual image interaction device according to an embodiment of the present disclosure.
具体实施方式Detailed ways
为了能够更清楚地理解本公开实施例的上述目的、特征和优点,下面将对本公开实施例的方案进行进一步描述。需要说明的是,在不冲突的情况下,本公开的实施例及实施例中的特征可以相互组合。In order to more clearly understand the above objects, features and advantages of the embodiments of the present disclosure, the solutions of the embodiments of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments may be combined with each other under the condition of no conflict.
在下面的描述中阐述了很多具体细节以便于充分理解本公开实施例,但本公开实施例还可以采用其他不同于在此描述的方式来实施;显然,说明书中的实施例只是本公开的一部分实施例,而不是全部的实施例。Many specific details are set forth in the following description to facilitate a full understanding of the embodiments of the present disclosure, but the embodiments of the present disclosure can also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only a part of the present disclosure examples, but not all examples.
随着互联网技术的不断发展,网络直播应运而生,为用户提供了丰富多彩 的娱乐生活。用户可进入到虚拟直播间中进行观看和互动。例如,用户可进入到歌房场景下的虚拟直播间进行演唱。然而,歌房场景下的虚拟直播间只会启动麦克风或摄像头完成用户的演唱,无法实现用户在虚拟直播间中的互动,导致歌房场景下的虚拟直播间的可玩性不大。With the continuous development of Internet technology, live webcasting emerges as the times require, providing users with a rich and colorful entertainment life. Users can enter the virtual live room to watch and interact. For example, the user can enter the virtual live room in the singing room scene to sing. However, the virtual live broadcast room in the song room scenario only activates the microphone or camera to complete the user's singing, and cannot realize the user's interaction in the virtual live broadcast room, which makes the virtual live broadcast room in the song room scene less playable.
基于此,示例性地,本公开实施例提供一种虚拟形象的互动方法、装置、设备、计算机存储介质以及计算机程序产品,借助在歌房场景下的虚拟直播间中引入虚拟形象(avatar),创建了用户对应的个性化的虚拟形象,深度还原线下场景的线上化。使得歌房场景下的虚拟直播间更具实景性,满足了用户在虚拟世界中表达自己的互动心理,通过生动的外观、表情、肢体动作等增加了虚拟直播间的互动可玩性,达到提升了用户粘性的目的。Based on this, exemplary embodiments of the present disclosure provide an interactive method, device, device, computer storage medium, and computer program product for an avatar. By introducing an avatar into a virtual live room in a singing room scenario, A personalized avatar corresponding to the user is created, which deeply restores the onlineization of offline scenes. It makes the virtual live broadcast room in the singing room scene more realistic, which satisfies the user's interactive psychology in expressing himself in the virtual world, and increases the interactive playability of the virtual live broadcast room through vivid appearance, expressions, body movements, etc. for the purpose of user stickiness.
其中,本公开实施例的虚拟形象的互动方法由电子设备或电子设备中的直播应用程序(Application,APP)、网页、公众号来执行。电子设备可以是平板电脑、手机(如折叠屏手机、大屏手机等)、可穿戴设备、车载设备、增强现实(augmented reality,AR)/虚拟现实(virtual reality,VR)设备、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本、个人数字助理(personal digital assistant,PDA)、智能电视、智慧屏、高清电视、4K电视、智能音箱、智能投影仪等设备,本公开实施例对电子设备的具体类型不作任何限制。Wherein, the interaction method of the virtual image in the embodiment of the present disclosure is performed by an electronic device or a live broadcast application (Application, APP), a webpage, and an official account in the electronic device. Electronic devices can be tablet computers, mobile phones (such as folding screen mobile phones, large-screen mobile phones, etc.), wearable devices, in-vehicle devices, augmented reality (AR)/virtual reality (VR) devices, laptops, super Mobile personal computer (ultra-mobile personal computer, UMPC), netbook, personal digital assistant (personal digital assistant, PDA), smart TV, smart screen, high-definition TV, 4K TV, smart speaker, smart projector and other equipment, the implementation of the present disclosure The example does not impose any restrictions on the specific type of electronic equipment.
其中,本公开实施例对电子设备的操作系统的类型不做限定。例如,Android系统、Linux系统、Windows系统、iOS系统等。Wherein, the embodiment of the present disclosure does not limit the type of the operating system of the electronic device. For example, Android system, Linux system, Windows system, iOS system, etc.
基于前述描述,本公开实施例将以电子设备中的直播APP为例,结合附图和应用场景,对本公开实施例提供的虚拟形象的互动方法进行详细阐述。Based on the foregoing description, the embodiment of the present disclosure will take a live broadcast APP in an electronic device as an example, and in conjunction with the accompanying drawings and application scenarios, to describe in detail the method for interacting with an avatar provided by the embodiment of the present disclosure.
结合图1A-图1Z,介绍本公开实施例的虚拟形象的互动方法的具体实现过程。为了便于说明,图1A-图1Z中,以电子设备为手机,手机中安装的直播APP为短视频社交APP 1(简称应用1),使用手机的用户为用户1为例进行示意。With reference to FIGS. 1A-1Z , a specific implementation process of the method for interacting with a virtual image according to an embodiment of the present disclosure is introduced. 1A-1Z, the electronic device is a mobile phone, the live APP installed in the mobile phone is a short video social APP 1 (referred to as application 1), and the user who uses the mobile phone is user 1 as an example for illustration.
请参阅图1A-图1Z,图1A-图1Z为本公开实施例提供的人机交互界面示意图。Please refer to FIG. 1A-FIG. 1Z. FIGS. 1A-1Z are schematic diagrams of a human-computer interaction interface provided by an embodiment of the present disclosure.
1、用户1进入到一个歌房场景下的虚拟直播间11. User 1 enters a virtual live room 1 in a singing room scene
应用1可在手机上显示图1A示例性所示的用户界面10,用户界面10用于显示应用1的虚拟直播间1,使得用户1可在虚拟直播间1中进行歌曲的演唱。The application 1 can display the user interface 10 exemplarily shown in FIG. 1A on the mobile phone. The user interface 10 is used to display the virtual live room 1 of the application 1 , so that the user 1 can sing songs in the virtual live room 1 .
需要说明的是,用户1可以为虚拟直播间1的主播,也可以为除了主播之外的其他用户,本公开实施例对此不做限定。其中,本公开实施例提及的主播为在应用1中创建虚拟直播间1的用户。It should be noted that the user 1 may be the host of the virtual live room 1, or may be another user except the host, which is not limited in this embodiment of the present disclosure. The host mentioned in the embodiment of the present disclosure is the user who creates the virtual live room 1 in the application 1 .
为了便于说明,本公开实施例以用户1为除了主播之外的其他用户为例进行示意。For convenience of description, the embodiment of the present disclosure takes User 1 as another user other than the host as an example for illustration.
其中,用户界面10中可以包括:区域101、区域102、区域103、区域104、公共屏幕105和区域106。The user interface 10 may include: area 101 , area 102 , area 103 , area 104 , public screen 105 and area 106 .
区域101,用于显示虚拟直播间1的主播的账号、主播的账号头像、点赞总数,以及进入虚拟直播间1的用户的账号、用户的账号头像等状态信息。另外,区域101还用于进入到其他虚拟直播间和显示其他虚拟直播间的通知信息等。The area 101 is used to display the account of the host of the virtual live room 1, the profile picture of the host's account, the total number of likes, and status information such as the account of the user entering the virtual live room 1, and the account picture of the user. In addition, the area 101 is also used to enter other virtual live broadcast rooms and display notification information of other virtual live broadcast rooms.
区域102,用于展示用户演唱歌曲的过程中的用户的展示形象、用户的账号、用户收到礼物的数量以及用户演唱歌曲的歌词等。其中,区域102可基于不同的演唱模式来展示对应的用户的展示形象。在语音的演唱模式下,区域102可展示用户的账号头像。在视频的演唱模式下,区域102可视频展示实时采集的用户图像。在虚拟形象的演唱模式下,区域102可展示用户的虚拟形象。The area 102 is used to display the displayed image of the user, the user's account number, the number of gifts received by the user, the lyrics of the song sung by the user, and the like during the process of the user singing a song. The area 102 may display the display image of the corresponding user based on different singing modes. In the voice singing mode, the area 102 may display the user's account avatar. In the singing mode of the video, the area 102 can display the real-time captured user image in the video. In the avatar's singing mode, the area 102 may display the user's avatar.
区域103,用于显示虚拟直播间1的歌曲演唱队列,如主播的账号头像、其他用户的账号头像以及对应的如演唱中、准备、静音等演唱状态等。其中,本公开实施例提及的进入到虚拟直播间1的用户并不等歌曲演唱队列中的用户。进入到虚拟直播间1的用户可不加入到歌曲演唱队列,也可加入到歌曲演唱队列。而歌曲演唱队列中的用户需要进入到虚拟直播间1。The area 103 is used to display the song singing queue of the virtual live room 1, such as the host's account avatar, the account avatars of other users, and the corresponding singing states such as singing, ready, mute, etc. Among them, the users who enter the virtual live room 1 mentioned in the embodiments of the present disclosure are not waiting for the users in the song singing queue. Users who enter the virtual live room 1 may not join the song singing queue, but may also join the song singing queue. The users in the song singing queue need to enter the virtual live broadcast room 1 .
区域104,用于展示如进场、送礼等动画特效。另外,区域104与公共屏幕105可不重叠或部分重叠。The area 104 is used to display animation special effects such as entering the venue and giving gifts. Additionally, the area 104 and the common screen 105 may not overlap or partially overlap.
公共屏幕105,用于滚动展示各个类型的消息,如评论消息、进场通 知消息、分享通知消息、送礼通知消息、点赞通知消息、关注通知消息等。The public screen 105 is used to scroll and display various types of messages, such as comment messages, entry notification messages, share notification messages, gift notification messages, like notification messages, follow notification messages, and the like.
区域106,用于向用户1提供输入评论信息、分享、点赞、送礼、关注等入口。例如,区域106可包括输入框和多个控件。The area 106 is used to provide user 1 with an entry for inputting comment information, sharing, liking, giving gifts, following, etc. For example, area 106 may include an input box and a number of controls.
2、用户1加入到歌曲演唱队列2. User 1 joins the song singing queue
图1A中,区域103中可包括一个或多个控件(如控件1031),每个控件用于加入到歌曲演唱队列中,即其他用户可向主播申请连线,以便来加入到歌曲演唱队列中。在用户加入到歌曲演唱队列后,每个控件还用于显示歌曲演唱队列中的用户的账号头像。一般情况下,区域103的第一个位置可默认固定设置用于显示主播的账号头像的控件,且默认主播已加入到歌曲演唱队列中。并且,区域103可采用上下或左右的滑动方式显示多个控件,以便完整展示歌曲演唱队列中的全部用户的账号头像。In FIG. 1A , the area 103 may include one or more controls (eg, control 1031 ), each of which is used to join the song singing queue, that is, other users can apply for a connection to the host in order to join the song singing queue . After the user joins the song singing queue, each control is also used to display the account avatar of the user in the song singing queue. In general, the first position of the area 103 can be fixed by default with a control for displaying the host's account avatar, and by default the host has joined the song singing queue. In addition, the area 103 can display multiple controls by sliding up and down or left and right, so as to completely display the account avatars of all users in the song singing queue.
在应用1接收到用户1在图1A所示的区域103中执行如点击控件1031的操作后,应用1可在控件1031上显示图1B示例性所示的用户1的账号头像。After the application 1 receives that the user 1 performs an operation such as clicking the control 1031 in the area 103 shown in FIG. 1A , the application 1 can display the account avatar of the user 1 exemplarily shown in FIG. 1B on the control 1031 .
另外,应用1还可在用户界面10中显示图1B示例性所示的控件201,控件201用于通知用户1连线成功,即可表示用户1已加入到歌曲演唱队列中。In addition, the application 1 can also display the control 201 exemplarily shown in FIG. 1B in the user interface 10 . The control 201 is used to notify the user 1 that the connection is successful, which means that the user 1 has joined the song singing queue.
3、用户1在加入到歌曲演唱队列后进行点歌3. User 1 orders songs after joining the song singing queue
图1B中,用户界面10还可包括:控件300,控件300用于提供点歌的入口以及展示歌曲演唱队列中的全部用户已点的歌曲数量。In FIG. 1B , the user interface 10 may further include: a control 300 , where the control 300 is used to provide an entrance to order songs and display the number of songs that all users in the song singing queue have ordered.
在应用1接收到用户1在图1B所示的用户界面10中执行如点击控件300的操作后,应用1可在用户界面10上显示图1C示例性所示的窗口107,窗口107用于提供能够演唱的歌曲,如显示歌曲的如歌曲名称、演唱歌曲的歌手的账号、歌曲的时长、歌曲的封面等相关信息。另外,窗口107还用于显示歌曲演唱队列中的全部用户已点的歌曲数量以及提供搜索歌曲的入口。After the application 1 receives that the user 1 performs an operation such as clicking the control 300 in the user interface 10 shown in FIG. 1B , the application 1 can display the window 107 exemplarily shown in FIG. 1C on the user interface 10, and the window 107 is used to provide Songs that can be sung, such as the display of related information such as the song name, the account number of the singer who sang the song, the duration of the song, and the cover of the song. In addition, the window 107 is also used to display the number of songs that have been clicked by all users in the song singing queue and to provide an entry for searching songs.
其中,窗口107中可以包括:控件1071和控件1072,控件1071用于提供选择(即使用)歌曲名称4的歌曲的入口,控件1072用于显示歌曲演唱队列中的全部用户已点的歌曲数量。The window 107 may include: a control 1071 and a control 1072, the control 1071 is used to provide an entry to select (ie use) the song of the song title 4, and the control 1072 is used to display the number of songs that have been clicked by all users in the song singing queue.
在应用1接收到用户1在图1C所示的窗口107中执行如点击控件1071的操作后,应用1可在窗口107上显示图1D示例性所示的状态更改后的控件1071和控件1072,状态更改后的控件1071用于显示歌曲名称4的歌曲已被用户1选择,状态更改后的控件1072用于歌曲演唱队列中的全部用户当前已点的歌曲数量,即从数量1变为数量2。After the application 1 receives that the user 1 performs an operation such as clicking the control 1071 in the window 107 shown in FIG. 1C , the application 1 can display the control 1071 and the control 1072 after the state change exemplarily shown in FIG. 1D on the window 107 , The state-changed control 1071 is used to display that the song of song name 4 has been selected by user 1, and the state-changed control 1072 is used for the number of songs currently selected by all users in the song singing queue, that is, from number 1 to number 2 .
在应用1接收到用户1在图1D所示的用户界面10中执行如退出窗口107的操作后,应用1可在手机上显示图1E示例性所示的用户界面10,用户界面10中的控件300用于展示歌曲演唱队列中的全部用户当前已点的歌曲数量。After the application 1 receives that the user 1 performs an operation such as exiting the window 107 in the user interface 10 shown in FIG. 1D , the application 1 can display the user interface 10 exemplarily shown in FIG. 1E on the mobile phone, and the controls in the user interface 10 300 is used to display the number of songs currently played by all users in the song singing queue.
另外,应用1还可在用户界面10中显示图1E示例性所示的控件202,控件202用于通知用户1点歌连线成功以及所点歌曲的排行名次。In addition, the application 1 can also display the control 202 exemplarily shown in FIG. 1E in the user interface 10 , and the control 202 is used to notify the user that the song 1 is successfully connected and the ranking of the song.
需要说明的是,除了上述方式之外,在应用1接收到用户1在图1A所示的用户界面10中执行如点击控件300的操作后,应用1可显示图1C所示的窗口。在应用1接收到用户1在图1C所示的窗口107中执行如点击控件1071的操作后,应用1可在窗口107上显示图1D示例性所示的状态更改后的控件1071和控件1072。在应用1接收到用户1在图1D所示的用户界面10中执行如退出窗口107的操作后,应用1可在手机上显示图1E示例性所示的用户界面10,实现加入到歌曲演唱队列中且已点歌的过程。It should be noted that, in addition to the above manner, after application 1 receives that user 1 performs an operation such as clicking on control 300 in user interface 10 shown in FIG. 1A , application 1 can display the window shown in FIG. 1C . After the application 1 receives that the user 1 performs an operation such as clicking the control 1071 in the window 107 shown in FIG. 1C , the application 1 may display the state-changed control 1071 and the control 1072 exemplarily shown in FIG. 1D on the window 107 . After the application 1 receives that the user 1 performs an operation such as exiting the window 107 in the user interface 10 shown in FIG. 1D , the application 1 can display the user interface 10 exemplarily shown in FIG. 1E on the mobile phone to realize adding to the song singing queue in the process of requesting a song.
综上,用户1加入到歌曲演唱队列中且已点歌。To sum up, user 1 has joined the song singing queue and has ordered songs.
4、用户1配置在区域102中的用户1的虚拟形象4. The avatar of user 1 configured in area 102 by user 1
在应用1接收到用户1在图1F所示的区域103中执行如点击控件1031的操作后,应用1可在手机上显示图1G示例性所示的窗口108,窗口108用于提供配置连线状态,如断开连线、连线时静音、连线时不静音、连线时演唱模式等。After the application 1 receives that the user 1 performs an operation such as clicking the control 1031 in the area 103 shown in FIG. 1F , the application 1 can display the window 108 exemplarily shown in FIG. 1G on the mobile phone, and the window 108 is used to provide a configuration connection Status, such as disconnected, muted when connected, not muted when connected, singing mode when connected, etc.
其中,窗口108中可以包括:控件1081,控件1081用于配置连线时演唱模式。The window 108 may include: a control 1081, and the control 1081 is used to configure the singing mode when connected.
在应用1接收到用户1在图1G所示的窗口108中执行如点击控件1081的操作后,应用1可在手机上显示图1H示例性所示的窗口109,窗口109用于提供各种演唱模式,如语音的演唱模式、视频的演唱模式、虚拟形象 的演唱模式等。After the application 1 receives that the user 1 performs an operation such as clicking the control 1081 in the window 108 shown in FIG. 1G , the application 1 can display the window 109 exemplarily shown in FIG. 1H on the mobile phone, and the window 109 is used to provide various performances. mode, such as voice singing mode, video singing mode, avatar singing mode, etc.
其中,窗口109中可以包括:控件1091和控件1092。控件1091用于配置虚拟形象的演唱模式。控件1092用于设置用户1在虚拟形象的演唱模式下的专属虚拟形象。The window 109 may include: a control 1091 and a control 1092. Control 1091 is used to configure the singing mode of the avatar. The control 1092 is used to set the exclusive avatar of the user 1 in the singing mode of the avatar.
需要说明的是,在应用再次显示窗口109时,窗口109中的演唱模式为应用1前一次打开窗口109时用户所选择的演唱模式。如果演唱模式为虚拟形象的演唱模式,那么用户在虚拟形象的演唱模式下的专属虚拟形象为前一次设置的虚拟形象。另外,应用1首次打开窗口109时,窗口109中的演唱模式可默认为语音的演唱模式。另外,窗口109中可以包括:确定控件,确定控件用于确定用户1所选择的演唱模式以及配置的专属虚拟形象。It should be noted that when the application displays the window 109 again, the singing mode in the window 109 is the singing mode selected by the user when the application 1 opened the window 109 last time. If the singing mode is the singing mode of the avatar, the user's exclusive avatar in the singing mode of the avatar is the avatar set previously. In addition, when the application 1 opens the window 109 for the first time, the singing mode in the window 109 may be the singing mode of the voice by default. In addition, the window 109 may include: a determination control, where the determination control is used to determine the singing mode selected by the user 1 and the configured exclusive avatar.
综上,在用户1完成点歌后,应用1基于用户1的账号头像上的触发操作,可对用户1的演唱模式进行选择,以便配置区域102中的用户1的展示形象。To sum up, after user 1 completes the song ordering, application 1 can select the singing mode of user 1 based on the trigger operation on user 1's account avatar, so as to configure the display image of user 1 in area 102 .
在应用1接收到用户1在图1H所示的窗口109中执行如点击控件1091的操作后,应用1可在窗口109上显示图1I示例性所示的加黑突出显示的控件1091,以便向用户1通知已选择虚拟形象的演唱模式。After application 1 receives that user 1 performs an operation such as clicking on control 1091 in window 109 shown in FIG. 1H , application 1 may display control 1091 exemplarily shown in FIG. User 1 notifies that the singing mode of the avatar has been selected.
在应用1接收到用户1在图1I所示的窗口109中执行如点击控件1092的操作后,应用1可在窗口109上显示图1J示例性所示的窗口110,窗口110用于提供各种创建方式来创建用户1的虚拟形象。After the application 1 receives that the user 1 performs an operation such as clicking the control 1092 in the window 109 shown in FIG. 1I, the application 1 can display the window 110 exemplarily shown in FIG. 1J on the window 109, and the window 110 is used to provide various Create a way to create an avatar of User 1.
图1J中,窗口110中可以包括:选项1101、选项1102和选项1103。选项1101用于通过摄像头识别来创建用户1的虚拟形象。选项1102用于通过照片识别来创建用户1的虚拟形象。前述两个选项可通过识别出用户的五官、发色、脸型等参数,以便在前述参数的基础上调整如皮肤、发质、光感等参数,使得用户1的虚拟形象更加形象和立体。选项1103用于通过默认形象来配置用户1的虚拟形象,默认形象可设置男女各一个形象,如默认如服装、发型、脸型等参数。In FIG. 1J , the window 110 may include: option 1101 , option 1102 and option 1103 . Option 1101 is used to create an avatar of User 1 through camera recognition. Option 1102 is used to create an avatar of User 1 through photo recognition. The above two options can identify the user's facial features, hair color, face shape and other parameters, so as to adjust parameters such as skin, hair quality, light perception and other parameters on the basis of the aforementioned parameters, so that the avatar of user 1 is more vivid and three-dimensional. Option 1103 is used to configure the avatar of the user 1 through a default image, which can be set with one image for each male and female, such as default parameters such as clothing, hairstyle, and face shape.
另外,窗口110还用于取消虚拟形象的演唱模式,以便退回到窗口109中重新选择演唱模式或者退回到用户界面10中不再继续选择演唱模式。In addition, the window 110 is also used to cancel the singing mode of the avatar, so as to return to the window 109 to select the singing mode again or return to the user interface 10 to not continue to select the singing mode.
51、用户1通过摄像头识别来创建用户1的虚拟形象51. User 1 creates a virtual image of User 1 through camera recognition
在应用1接收到用户1在图1J所示的窗口110中执行如点击控件1101的操作后,应用1可在手机上显示图1K示例性所示的窗口111,窗口111用于提供摄像头识别创建用户1的虚拟形象的授权入口。After the application 1 receives that the user 1 performs an operation such as clicking the control 1101 in the window 110 shown in FIG. 1J , the application 1 can display the window 111 exemplarily shown in FIG. 1K on the mobile phone, and the window 111 is used to provide the camera identification creation Authorized entry for user 1's avatar.
图1K中,窗口111中可包括:控件1111,控件1111用于选择是否同意启动摄像头(即相机)。In FIG. 1K , the window 111 may include: a control 1111 , and the control 1111 is used to select whether to agree to start the camera (ie, the camera).
在应用1接收到用户1在图1K所示的窗口111中执行如点击控件1111的操作后,应用1可在手机上显示图1L示例性所示的更新后的窗口111。After the application 1 receives that the user 1 performs an operation such as clicking the control 1111 in the window 111 shown in FIG. 1K , the application 1 can display the updated window 111 exemplarily shown in FIG. 1L on the mobile phone.
图1L中,窗口111中可包括控件1112,控件1111用于选择是否同意摄像头拍摄虚拟形象的协议。In FIG. 1L, the window 111 may include a control 1112, and the control 1111 is used to select whether to agree to the agreement for the camera to shoot the avatar.
在应用1接收到用户1在图1L所示的窗口111中执行如点击控件1112的操作后,应用1可在手机上显示图1M示例性所示的窗口112,窗口112用于展示摄像头实时拍摄到的用户1的拍摄照片。After the application 1 receives that the user 1 performs an operation such as clicking the control 1112 in the window 111 shown in FIG. 1L, the application 1 can display the window 112 exemplarily shown in FIG. 1M on the mobile phone, and the window 112 is used to show the real-time shooting of the camera to the captured photo of user 1.
需要说明的是,在应用1首次接收到用户在图1J所示的窗口110中执行如点击控件1101的操作后,应用1可在手机上依次显示图1K和图1L示例性所示的窗口111,用户1可以选择依次同意启动摄像头和同意摄像头拍摄虚拟形象的协议。It should be noted that, after application 1 receives for the first time that the user performs an operation such as clicking on the control 1101 in the window 110 shown in FIG. 1J , the application 1 can sequentially display the windows 111 exemplarily shown in FIGS. 1K and 1L on the mobile phone , the user 1 can choose to agree to start the camera and agree to the agreement of the camera to shoot the avatar in turn.
并且,在用户1已同意启动摄像头和同意摄像头拍摄虚拟形象的协议后,在应用1再次接收到用户1在图1J所示的窗口110中执行如点击控件1101的操作后,应用1可不再显示图1K和图1L示例性所示的窗口111,可直接显示图1M示例性所示的窗口112。In addition, after user 1 has agreed to start the camera and agree to the agreement for the camera to shoot avatars, after application 1 again receives that user 1 performs an operation such as clicking the control 1101 in the window 110 shown in FIG. 1J , application 1 can no longer be displayed. The window 111 exemplarily shown in FIG. 1K and FIG. 1L can directly display the window 112 exemplarily shown in FIG. 1M .
另外,本公开实施例对图1K和图1L所示的窗口110中的控件的显示顺序不做限定。并且,图1K和图1L所示的控件可同时显示在一个窗口110中。In addition, the embodiment of the present disclosure does not limit the display order of the controls in the window 110 shown in FIG. 1K and FIG. 1L. Also, the controls shown in FIGS. 1K and 1L may be displayed in one window 110 at the same time.
在应用1从窗口112中获取到的用户1的拍摄照片后,且对用户1的拍摄照片进行识别的过程中,应用1可在手机上显示图1N示例性所示的窗口113。窗口113用于基于用户1的拍摄照片预览展示用户1的虚拟形象,以及提供虚拟形象的多种驱动模式,使得用户1的虚拟形象在用户1演唱歌曲的过程中能够模拟对应的如头部和/或肢体等部位的动作。After the application 1 obtains the photographed photo of the user 1 from the window 112, and in the process of recognizing the photographed photograph of the user 1, the application 1 may display the window 113 exemplarily shown in FIG. 1N on the mobile phone. The window 113 is used to preview and display the avatar of user 1 based on the photos taken by user 1, and to provide various driving modes of the avatar, so that the avatar of user 1 can simulate corresponding parts such as head and / or movements of limbs, etc.
另外,窗口113还用于提供重新配置用户1的虚拟形象的入口,如退回到图1J所示的窗口110重新选择来创建用户1的虚拟形象的方式,或者退回到图1M所示的窗口115重新通过摄像头识别来创建用户1的虚拟形象。In addition, the window 113 is also used to provide an entrance to reconfigure the avatar of User 1, such as returning to the window 110 shown in FIG. 1J to re-select to create the avatar of User 1, or returning to the window 115 shown in FIG. 1M Re-create the avatar of user 1 through camera recognition.
在驱动模式为实时驱动模式时,动作为摄像头实时采集到的用户1的动作,使得用户1的虚拟形象可随着用户1的动作实时律动。在一些实施例中,虚拟形象可随着脸部动作律动。在驱动模式为默认驱动模式时,动作为默认动作,使得用户1的虚拟形象可随着默认动作律动。在一些实施例中,虚拟形象可随着默认动作间隔预设时长重复律动。其中,本公开实施例对预设时长的具体大小不做限定。When the driving mode is the real-time driving mode, the action is the action of the user 1 captured by the camera in real time, so that the avatar of the user 1 can rhythm in real time with the action of the user 1 . In some embodiments, the avatar may rhythm with facial movements. When the driving mode is the default driving mode, the action is the default action, so that the avatar of the user 1 can rhythm with the default action. In some embodiments, the avatar may rhythm repeatedly with the default action interval for a preset duration. Wherein, the embodiment of the present disclosure does not limit the specific size of the preset duration.
其中,默认动作可为基于用户1所点歌曲的节奏和/或音调进行动作的设计,以便歌曲播放到对应的音调或者预设位置(如间奏前奏)时进行动作下发。在一些实施例中,默认动作可根据歌曲的音调高低而设定的多个动作。在另一些实施例中,默认动作也可为在歌曲进行间奏前奏时设定如麦克风抬起的动作。其中,默认动作可以包括但不限于大笑、转身、跳舞、行走等。随着应用1基于用户1的拍摄照片创建出用户1的虚拟形象,应用1可在窗口113中显示图1O示例性所示的用户的虚拟形象。另外,应用1还可在窗口113中显示图1M示例性所示的控件203,控件203用于通知用户1通过摄像头识别的方式创建虚拟形象成功。The default action may be designed to perform actions based on the rhythm and/or pitch of the song clicked by user 1, so that the action is issued when the song is played to a corresponding pitch or a preset position (eg, an interlude prelude). In some embodiments, the default action may be a number of actions that are set according to the pitch of the song. In other embodiments, the default action can also be set as an action such as raising the microphone when the song performs an interlude. The default actions may include, but are not limited to, laughing, turning around, dancing, walking, and the like. As the application 1 creates the avatar of the user 1 based on the photographed photos of the user 1 , the application 1 may display the avatar of the user exemplarily shown in FIG. 10 in the window 113 . In addition, the application 1 may also display the control 203 exemplarily shown in FIG. 1M in the window 113, and the control 203 is used to notify the user 1 that the avatar is successfully created by means of camera recognition.
需要说明的是,除了上述方式之外,在应用1从窗口112中获取到的用户1的拍摄照片后,且对用户1的拍摄照片进行识别成功后,应用1可在手机上显示图1O示例性所示的窗口113,而不显示图1N示例性所示的窗口113。It should be noted that, in addition to the above methods, after application 1 obtains the photographed photo of user 1 from the window 112 and successfully identifies the photographed photograph of user 1, application 1 can display the example of FIG. 10 on the mobile phone The window 113 shown illustratively is not displayed, and the window 113 exemplarily shown in FIG. 1N is not displayed.
图1O中,窗口113中可以包括:预览区1131和控件1132,预览区用于预览通过摄像头识别创建的用户1的虚拟形象。控件1132用于提供实时驱动模式或者默认驱动模式,即选择用户1的虚拟形象是否在用户1演唱歌曲的过程中模拟摄像头实时采集到的用户1的动作。另外,除了动作之外,用户1的虚拟形象也可模拟摄像头实时采集到的用户1的外观、表情等。在应用1接收到用户1在图1O所示的窗口113中执行如点击控件1132 的操作后,应用1可在窗口113上显示图1P示例性所示的更新后的控件1132,更新后的控件1132用于表示用户1已选择实时驱动模式,使得用户1的虚拟形象在用户1演唱歌曲的过程中能够实时模拟摄像头实时采集到的用户1的动作。In FIG. 10 , the window 113 may include: a preview area 1131 and a control 1132 , and the preview area is used to preview the avatar of the user 1 created by the camera recognition. The control 1132 is used to provide a real-time driving mode or a default driving mode, that is, to select whether the avatar of the user 1 simulates the actions of the user 1 captured by the camera in real time when the user 1 sings a song. In addition, in addition to actions, the avatar of the user 1 can also simulate the appearance, expressions, etc. of the user 1 captured by the camera in real time. After the application 1 receives that the user 1 performs an operation such as clicking the control 1132 in the window 113 shown in FIG. 10 , the application 1 can display the updated control 1132 exemplarily shown in FIG. 1P on the window 113 . The updated control 1132 is used to indicate that the user 1 has selected the real-time driving mode, so that the avatar of the user 1 can simulate in real time the actions of the user 1 captured by the camera in real time during the process of the user 1 singing a song.
需要说明的是,如果用户1没有在图1O所示的窗口113中执行如点击控件1132的操作,那么,应用1可确定用户1已选择默认驱动模式,使得用户1的虚拟形象在用户1演唱歌曲的过程中能够模拟默认动作。It should be noted that, if the user 1 does not perform an operation such as clicking the control 1132 in the window 113 shown in FIG. 10 , then the application 1 can determine that the user 1 has selected the default drive mode, so that the avatar of the user 1 sings in the user 1 The default action can be simulated during the song.
图1P中,窗口113中还可包括:控件1133,控件1133用于确定是否使用预览区1131中的用户1的虚拟形象在区域102中模拟摄像头实时采集到的用户1的动作。In FIG. 1P , the window 113 may further include: a control 1133 for determining whether to use the avatar of the user 1 in the preview area 1131 to simulate the action of the user 1 captured by the camera in real time in the area 102 .
在应用1接收到用户1在图1P所示的窗口113中执行如点击控件1133的操作后,应用1可在手机上显示图1F示例性所示的用户界面10,使得应用1确定使用预览区1131中的用户1的虚拟形象在区域102中模拟摄像头实时采集到的用户1的动作。After the application 1 receives that the user 1 performs an operation such as clicking the control 1133 in the window 113 shown in FIG. 1P , the application 1 can display the user interface 10 exemplarily shown in FIG. 1F on the mobile phone, so that the application 1 determines to use the preview area The avatar of the user 1 in 1131 simulates the actions of the user 1 captured by the camera in real time in the area 102 .
综上,应用1可通过摄像头识别来创建用户1的虚拟形象以及启动用户1的虚拟形象实时模拟驱动模式对应的动作。To sum up, the application 1 can create an avatar of the user 1 through camera recognition and activate the avatar of the user 1 to simulate actions corresponding to the driving mode in real time.
52、用户1通过照片识别来创建用户1的虚拟形象52. User 1 creates an avatar of User 1 through photo recognition
在应用1接收到用户1在图1J所示的窗口110中执行如点击控件1102的操作后,应用1可在手机上显示图1Q示例性所示的窗口114,窗口114用于提供照片识别的方式创建用户1的虚拟形象的授权入口。After the application 1 receives that the user 1 performs an operation such as clicking the control 1102 in the window 110 shown in FIG. 1J , the application 1 can display the window 114 exemplarily shown in FIG. way to create an authorized entry for the avatar of user 1.
图1Q中,窗口114中可包括:控件1141,控件1141用于选择是否同意访问手机的本地存储空间(如相册)。In FIG. 1Q, the window 114 may include: a control 1141, and the control 1141 is used to select whether to agree to access the local storage space (eg photo album) of the mobile phone.
在应用1接收到用户1在图1Q所示的窗口114中执行如点击控件1141的操作后,应用1可在手机上显示图1R示例性所示的更新后的窗口114。After the application 1 receives that the user 1 performs an operation such as clicking the control 1141 in the window 114 shown in FIG. 1Q , the application 1 may display the updated window 114 exemplarily shown in FIG. 1R on the mobile phone.
图1R中,窗口114中可包括控件1142,控件1142用于选择是否同意照片识别的方式创建虚拟形象的协议。In FIG. 1R, the window 114 may include a control 1142, and the control 1142 is used to select whether to agree to the protocol for creating an avatar by means of photo recognition.
在应用1接收到用户1在图1R所示的窗口114中执行如点击控件1142的操作后,应用1可在手机上显示图1S示例性所示的窗口115,窗口115用于展示相册中存储的全部照片的缩略图。After the application 1 receives that the user 1 performs an operation such as clicking the control 1142 in the window 114 shown in FIG. 1R , the application 1 can display the window 115 exemplarily shown in FIG. 1S on the mobile phone, and the window 115 is used to display the storage in the album. Thumbnails of all photos of .
需要说明的是,在应用1首次接收到用户在图1J所示的窗口110中执行如点击控件1102的操作后,应用1可在手机上依次显示图1Q和图1R示例性所示的窗口114,使得用户1能够依次同意访问相册和同意照片识别的方式创建虚拟形象的协议。It should be noted that, after application 1 receives for the first time that the user performs an operation such as clicking on the control 1102 in the window 110 shown in FIG. 1J , the application 1 can sequentially display the windows 114 exemplarily shown in FIG. 1Q and FIG. 1R on the mobile phone , so that the user 1 can sequentially agree to access the album and agree to the agreement of creating a virtual image by means of photo identification.
并且,在用户1已同意启动相册和同意照片识别的方式创建虚拟形象的协议后,在应用1再次接收到用户1在图1J所示的窗口110中执行如点击控件1102的操作后,应用1可不再显示图1Q和图1R示例性所示的窗口114,可直接显示图1S示例性所示的窗口115。And, after user 1 has agreed to start the photo album and agree to the agreement to create an avatar by means of photo recognition, after application 1 receives again that user 1 performs an operation such as clicking on the control 1102 in the window 110 shown in FIG. 1J , application 1 The window 114 exemplarily shown in FIGS. 1Q and 1R may no longer be displayed, and the window 115 exemplarily shown in FIG. 1S may be directly displayed.
另外,本公开实施例对图1Q和图1R所示的窗口114中的控件的显示顺序不做限定。并且,图1Q和图1R所示的控件可同时显示在一个窗口114中。In addition, the embodiment of the present disclosure does not limit the display order of the controls in the window 114 shown in FIG. 1Q and FIG. 1R . Also, the controls shown in FIGS. 1Q and 1R may be displayed in one window 114 at the same time.
图1S中,窗口115中可以包括:控件1151,控件1151用于展示相册中存储的一张照片的缩略图。In FIG. 1S, the window 115 may include: a control 1151, and the control 1151 is used to display a thumbnail of a photo stored in the album.
在应用1接收到用户1在图1S所示的窗口115中执行如点击控件1151的操作后,应用1可在手机上显示图1T示例性所示的窗口116,窗口116用于加载用户1从相册中所选择的一张相册照片1。After the application 1 receives that the user 1 performs an operation such as clicking the control 1151 in the window 115 shown in FIG. 1S , the application 1 can display the window 116 exemplarily shown in FIG. 1T on the mobile phone, and the window 116 is used to load the user 1 from A selected album photo1 in the album.
图1T中,应用1可基于识别规范,判断相册照片1是否符合作为虚拟形象的条件。其中,本公开实施例对识别规范的具体实现方式不做限定。In FIG. 1T , the application 1 can determine whether the album photo 1 meets the conditions of being an avatar based on the identification specification. Wherein, the embodiments of the present disclosure do not limit the specific implementation manner of the identification specification.
在相册照片1不符合作为虚拟形象的条件时,应用1可显示提示信息,以便通知用户1移动相册照片1,使得相册照片1符合作为虚拟形象的条件。When the album photo 1 does not meet the conditions for being an avatar, the application 1 may display prompt information to notify the user 1 to move the album photo 1 so that the album photo 1 meets the conditions for being an avatar.
在相册照片1符合作为虚拟形象的条件后,应用1可在手机上显示图1O示例性所示的窗口113。After the album photo 1 meets the conditions for being an avatar, the application 1 can display the window 113 exemplarily shown in FIG. 10 on the mobile phone.
需要说明的是,此处的窗口113与前文提及的窗口113的功能相同,但此处的窗口113用于基于相册照片1预览用户1的虚拟形象,以及提供虚拟形象的多种驱动模式。另外,窗口113还用于提供重新配置用户1的虚拟形象的入口,如退回到图1J所示的窗口110重新选择来创建用户1的虚拟形象的方式,或者退回到图1S所示的窗口115重新通过照片识别来创建用户1的虚拟形象。It should be noted that the function of the window 113 here is the same as the window 113 mentioned above, but the window 113 here is used to preview the avatar of the user 1 based on the album photo 1 and provide various driving modes of the avatar. In addition, the window 113 is also used to provide an entrance to reconfigure the avatar of the user 1, such as returning to the window 110 shown in FIG. 1J to re-select to create the avatar of the user 1, or returning to the window 115 shown in FIG. 1S Recreate the avatar of User 1 through photo recognition.
另外,在应用1接收到用户1在图1S所示的窗口115中执行如点击控件1151的操作后,应用1也可在手机上显示图1N示例性所示的窗口113。从而,应用1基于识别规范,可判断相册照片1是否符合作为虚拟形象的条件的过程。其中,前述判断过程可参见前述描述,此处不做赘述。In addition, after the application 1 receives that the user 1 performs an operation such as clicking the control 1151 in the window 115 shown in FIG. 1S , the application 1 can also display the window 113 exemplarily shown in FIG. 1N on the mobile phone. Thus, the application 1 can judge whether the album photo 1 meets the conditions of being an avatar based on the identification specification. The foregoing judgment process may refer to the foregoing description, which will not be repeated here.
在相册照片1符合作为虚拟形象的条件后,应用1可在手机上显示图1O示例性所示的窗口113。After the album photo 1 meets the conditions for being an avatar, the application 1 can display the window 113 exemplarily shown in FIG. 10 on the mobile phone.
另外,应用1还可在窗口113中显示图1O示例性所示的控件203,控件203用于通知用户1照片识别的方式创建虚拟形象成功。In addition, the application 1 can also display the control 203 exemplarily shown in FIG. 10 in the window 113, and the control 203 is used to notify the user 1 that the avatar is successfully created by means of photo recognition.
对应地,图1O中,窗口113中可以包括:预览区1131和控件1132,预览区用于预览通过照片识别创建的用户1的虚拟形象。控件1132的具体实现方式可参见前文提及的控件1132的描述,此处不做赘述。Correspondingly, in FIG. 10 , the window 113 may include: a preview area 1131 and a control 1132 , and the preview area is used to preview the avatar of the user 1 created by photo recognition. For the specific implementation of the control 1132, reference may be made to the description of the control 1132 mentioned above, which will not be repeated here.
在应用1接收到用户1在图1O所示的窗口113中执行如点击控件1132的操作后,应用1可在窗口113上显示图1P示例性所示的更新后的控件1132,更新后的控件1132的具体实现方式可参见前文提及的更新后的控件1132的描述,此处不做赘述。After the application 1 receives that the user 1 performs an operation such as clicking the control 1132 in the window 113 shown in FIG. 10 , the application 1 can display the updated control 1132 exemplarily shown in FIG. 1P on the window 113 . The updated control For the specific implementation of 1132, reference may be made to the description of the updated control 1132 mentioned above, which will not be repeated here.
图1P中,窗口113中还可包括:控件1133,控件1133的具体实现方式可参见前文提及的控件1133的描述,此处不做赘述。In FIG. 1P , the window 113 may further include: a control 1133 . For the specific implementation of the control 1133 , reference may be made to the description of the control 1133 mentioned above, which will not be repeated here.
在应用1接收到用户1在图1P所示的窗口113中执行如点击控件1133的操作后,应用1可在手机上显示图1F示例性所示的用户界面10,使得应用1确定使用图1O所示预览区1131中的用户1的虚拟形象在区域102中模拟摄像头实时采集到的用户1的动作。After the application 1 receives that the user 1 performs an operation such as clicking the control 1133 in the window 113 shown in FIG. 1P , the application 1 can display the user interface 10 exemplarily shown in FIG. 1F on the mobile phone, so that the application 1 determines to use FIG. 10 The avatar of user 1 in the shown preview area 1131 simulates the actions of user 1 captured by the camera in real time in the area 102 .
综上,应用1可通过照片识别来创建用户1的虚拟形象以及启动用户1的虚拟形象实时模拟驱动模式对应的动作。To sum up, the application 1 can create an avatar of the user 1 through photo recognition and activate the avatar of the user 1 to simulate actions corresponding to the driving mode in real time.
53、用户1通过默认形象来配置用户1的虚拟形象53. User 1 configures the avatar of User 1 through the default image
在应用1接收到用户1在图1J所示的窗口110中执行如点击控件1103的操作后,应用1可在手机上显示图1U示例性所示的窗口113。After the application 1 receives that the user 1 performs an operation such as clicking the control 1103 in the window 110 shown in FIG. 1J , the application 1 can display the window 113 exemplarily shown in FIG. 1U on the mobile phone.
需要说明的是,图1U中的窗口113与图1O中的窗口113的功能相同,但图1U中的窗口113用于基于默认形象预览展示用户1的虚拟形象,以及提供虚拟形象的多种驱动模式。另外,窗口113还用于提供重新配置用户1 的虚拟形象的入口,如退回到图1J所示的窗口110重新选择来创建用户1的虚拟形象的方式。It should be noted that the function of the window 113 in FIG. 1U is the same as that of the window 113 in FIG. 10 , but the window 113 in FIG. 1U is used to preview and display the avatar of the user 1 based on the default avatar, and provide various drivers for the avatar. model. In addition, window 113 is also used to provide an entry to reconfigure User 1's avatar, such as by returning to window 110 shown in FIG. 1J to re-select to create User 1's avatar.
对应地,图1U中,窗口113中可以包括:预览区1131和控件1132,预览区用于预览通过默认形象创建的用户1的虚拟形象。控件1132的具体实现方式可参见图1O中的控件1132的描述,此处不做赘述。Correspondingly, in FIG. 1U , the window 113 may include: a preview area 1131 and a control 1132 , and the preview area is used to preview the avatar of the user 1 created by the default avatar. For the specific implementation of the control 1132, reference may be made to the description of the control 1132 in FIG. 10 , which will not be repeated here.
在应用1接收到用户1在图1U所示的窗口113中执行如点击控件1132的操作后,应用1可在窗口113上显示图1V示例性所示的更新后的控件1132,更新后的控件1132的具体实现方式可参见图1O中的更新后的控件1132的描述,此处不做赘述。After the application 1 receives that the user 1 performs an operation such as clicking the control 1132 in the window 113 shown in FIG. 1U , the application 1 can display the updated control 1132 exemplarily shown in FIG. 1V on the window 113 . The updated control For the specific implementation of 1132, reference may be made to the description of the updated control 1132 in FIG. 10, which will not be repeated here.
图1V中,窗口113中还可包括:控件1133,控件1133的具体实现方式可参见图1P中的控件1133的描述,此处不做赘述。In FIG. 1V, the window 113 may further include: a control 1133. For the specific implementation of the control 1133, reference may be made to the description of the control 1133 in FIG. 1P, which will not be repeated here.
在应用1接收到用户1在图1V所示的窗口113中执行如点击控件1133的操作后,应用1可在手机上显示图1F示例性所示的用户界面10,使得应用1确定使用图1U所示预览区1131中的用户1的虚拟形象在区域102中模拟摄像头实时采集到的用户1的动作。After the application 1 receives that the user 1 performs an operation such as clicking the control 1133 in the window 113 shown in FIG. 1V , the application 1 can display the user interface 10 exemplarily shown in FIG. 1F on the mobile phone, so that the application 1 determines to use the operation shown in FIG. 1U The avatar of user 1 in the shown preview area 1131 simulates the actions of user 1 captured by the camera in real time in the area 102 .
综上,应用1可通过默认形象来配置用户1的虚拟形象以及启动用户1的虚拟形象实时模拟驱动模式对应的动作。To sum up, the application 1 can configure the avatar of the user 1 through the default avatar and activate the avatar of the user 1 to simulate actions corresponding to the driving mode in real time.
需要说明的是,在应用1基于用户1的拍摄照片或者相册照片1无法创建出用户1的虚拟形象时,应用1可将默认形象作为用户1的虚拟形象。It should be noted that, when the application 1 cannot create the avatar of the user 1 based on the photos taken by the user 1 or the photo album 1, the application 1 can use the default avatar as the avatar of the user 1 .
6、在用户1演唱歌曲的过程中的用户1的虚拟形象6. The avatar of User 1 in the process of User 1 singing a song
在用户1演唱用户1所点歌的歌曲的过程中,应用1可在区域102上显示图1W或图1X示例性所示的用户1的虚拟形象,用户1的虚拟形象随着摄像头实时采集到的用户1的动作而律动,且可在区域103中的控件1031上显示图1W或图1X示例性所示的用户1的演唱状态为演唱中。其中,图1W中的用户1的虚拟形象是基于摄像头或照片识别进行创建的,图1X中的用户1的虚拟形象是基于默认形象进行创建的。During the process of user 1 singing the song requested by user 1, application 1 may display the avatar of user 1 as exemplarily shown in FIG. 1W or FIG. 1X on area 102, and the avatar of user 1 is captured in real time with the camera. The rhythm of the user 1's actions, and the control 1031 in the area 103 can display that the singing state of the user 1 exemplarily shown in FIG. 1W or FIG. 1X is singing. The avatar of the user 1 in FIG. 1W is created based on camera or photo recognition, and the avatar of the user 1 in FIG. 1X is created based on the default avatar.
其中,以图1W为例,在用户1开始演唱用户1所点歌的歌曲时,应用1可在用户界面10上显示图1Y示例性所示的控件204,控件204用于向用户1通知已打开摄像头且用户1的虚拟形象会随着摄像头实时采集到 的用户1的动作而律动,满足用户1表现自己的需求,提升了用户1的互动体验。Wherein, taking FIG. 1W as an example, when user 1 starts to sing the song requested by user 1, application 1 can display control 204 exemplarily shown in FIG. 1Y on user interface 10, and control 204 is used to notify user 1 that the The camera is turned on, and the avatar of user 1 will rhythm with the movements of user 1 captured by the camera in real time, so as to meet user 1's needs for expressing himself, and improve user 1's interactive experience.
其中,以图1W为例,在摄像头检测不到用户1的动作时,应用1可在用户界面10上显示图1Z示例性所示的控件205,控件205用于向用户1通知用户1的动作离开了摄像头的识别区域,方便用户1能够及时调整用户1的动作。Wherein, taking FIG. 1W as an example, when the camera cannot detect the action of the user 1, the application 1 can display the control 205 exemplarily shown in FIG. 1Z on the user interface 10, and the control 205 is used to notify the user 1 of the action of the user 1. Leaving the recognition area of the camera, it is convenient for the user 1 to adjust the actions of the user 1 in time.
需要说明的是,图1A-图1Z中涉及的用户的账号头像、相册照片、拍摄照片、虚拟形象、用户的动作等用户信息均是用户期望电子设备/直播APP获取的,且是经过用户同意的。It should be noted that the user information such as the user's account avatar, album photos, captured photos, avatars, and user actions involved in Figures 1A-1Z are all obtained by the user's desired electronic device/live APP, and are obtained with the user's consent. of.
基于图1A-图1Z实施例的描述,结合图2,对本公开实施例提供的虚拟形象的互动方法的具体实现过程进行详细阐述。Based on the description of the embodiments of FIGS. 1A-1Z , and with reference to FIG. 2 , a specific implementation process of the virtual image interaction method provided by the embodiments of the present disclosure will be described in detail.
请参阅图2,图2为本公开实施例提供的虚拟形象的互动方法的流程示意图。如图2所示,本公开实施例提供的虚拟形象的互动方法可以包括:Please refer to FIG. 2 , which is a schematic flowchart of a method for interacting with an avatar according to an embodiment of the present disclosure. As shown in FIG. 2 , the interaction method of the avatar provided by the embodiment of the present disclosure may include:
S301、在一个虚拟直播间开启唱歌直播后,响应于虚拟直播间中的一个用户的指令,配置用户的虚拟形象以及启动用户的虚拟形象的目标驱动模式。S301. After the singing live broadcast is started in a virtual live broadcast room, in response to an instruction of a user in the virtual live broadcast room, configure the user's avatar and activate the target drive mode of the user's avatar.
在一个虚拟直播间开启唱歌直播后,直播APP可接收到该虚拟直播间中的一个用户的指令。After the singing live broadcast is started in a virtual live broadcast room, the live broadcast APP can receive an instruction from a user in the virtual live broadcast room.
其中,该虚拟直播间为唱歌场景下的虚拟直播间,如KTV虚拟直播间。该虚拟直播间中的一个用户可为该虚拟直播间中的主播或其他用户,本公开实施例对此不做限定。The virtual live broadcast room is a virtual live broadcast room in a singing scene, such as a KTV virtual live broadcast room. A user in the virtual live broadcast room may be a host or other user in the virtual live broadcast room, which is not limited in this embodiment of the present disclosure.
其中,该用户的指令用于指示为该用户配置虚拟形象以及虚拟形象的目标驱动模式。本公开实施例对该用户的指令的具体实现方式不做限定。在一些实施例中,该用户的指令可采用如点击、双击、长按、滑动等类型的操作来实现,如该用户的指令为用户1在图1P或图1V所示的窗口113中执行如点击控件1133的操作。Wherein, the instruction of the user is used to instruct to configure the avatar and the target driving mode of the avatar for the user. The embodiments of the present disclosure do not limit the specific implementation manner of the user's instruction. In some embodiments, the user's instruction may be implemented by operations such as clicking, double-clicking, long-pressing, sliding, and the like. For example, the user's instruction is for User 1 to execute in the window 113 shown in FIG. 1P or FIG. 1V as follows: Click the control 1133 operation.
在接收到该用户的指令后,直播APP可配置该用户的虚拟形象以及启动该用户的虚拟形象的目标驱动模式。After receiving the user's instruction, the live broadcast APP can configure the user's avatar and activate the target driving mode of the user's avatar.
其中,目标驱动模式是一种驱动该用户的虚拟形象律动的驱动方式, 用于确定该用户的虚拟形象所模拟的目标动作。本公开实施例对目标驱动模式和目标动作的具体实现方式不做限定。在一些实施例中,目标动作可为如头部和/或肢体等部位的动作。The target driving mode is a driving manner for driving the rhythm of the avatar of the user, and is used to determine the target action simulated by the avatar of the user. The embodiments of the present disclosure do not limit the specific implementation manner of the target driving mode and the target action. In some embodiments, the target motion may be a motion of parts such as the head and/or limbs.
S302、在用户在虚拟直播间中进行演唱的过程中,显示模拟与目标驱动模式对应的目标动作的用户的虚拟形象在虚拟直播间中进行演唱。S302. During the process of the user singing in the virtual live broadcast room, display the avatar of the user who simulates the target action corresponding to the target driving mode to sing in the virtual live broadcast room.
随着该用户在该虚拟直播间中进行演唱,直播APP可控制该用户的虚拟形象在该用户演唱歌曲的过程中模拟目标动作而进行律动,并显示模拟目标动作的该用户的虚拟形象在虚拟直播间中进行演唱。即直播APP显示该用户的虚拟形象在虚拟直播间中进行演唱,该过程中该用户的虚拟形象模拟目标动作,而目标动作与目标驱动模式相对应。As the user sings in the virtual live broadcast room, the live broadcast APP can control the user's avatar to rhythm by simulating the target action during the user's singing, and display the user's avatar simulating the target action in the virtual Sing in the live room. That is, the live broadcast APP shows that the user's avatar sings in the virtual live broadcast room. During this process, the user's avatar simulates the target action, and the target action corresponds to the target drive mode.
本公开实施例提供的虚拟形象的互动方法,通过在一个虚拟直播间开启唱歌直播后,响应于虚拟直播间中的一个用户的指令,可配置该用户的虚拟形象以及启动该用户的虚拟形象的目标驱动模式。在用户在虚拟直播间中进行演唱的过程中,可显示模拟与目标驱动模式对应的目标动作的用户的虚拟形象在虚拟直播间中进行演唱。从而,在歌房场景下的虚拟直播间中增加了虚拟形象的演唱模式,使得歌房场景下的虚拟直播间更具实景性,满足了用户在虚拟世界中表达自己的互动心理,提高了虚拟直播间的互动可玩性,有利于提升歌房场景下的虚拟直播间的用户流量。In the method for interacting with an avatar provided by the embodiments of the present disclosure, after a singing live broadcast is started in a virtual live broadcast room, in response to an instruction of a user in the virtual live broadcast room, the user's avatar can be configured and the user's avatar can be activated. target-driven mode. During the process of the user singing in the virtual live broadcast room, an avatar of the user simulating the target action corresponding to the target driving mode may be displayed to sing in the virtual live broadcast room. Therefore, the virtual image singing mode is added to the virtual live broadcast room in the singing room scene, which makes the virtual live broadcast room in the singing room scene more realistic, satisfies the user's interactive psychology in expressing themselves in the virtual world, and improves the virtual reality. The interactive playability of the live broadcast room is conducive to increasing the user traffic of the virtual live broadcast room in the singing room scenario.
基于上述实施例的描述,直播APP可采用多种方式来配置该用户的虚拟形象以及启动该用户的虚拟形象的目标驱动模式。Based on the descriptions of the above embodiments, the live APP can use various ways to configure the avatar of the user and activate the target driving mode of the avatar of the user.
在一些实施例中,直播APP可通过摄像头拍摄用户的拍摄照片,并基于用户的拍摄照片,直播APP可确定出用户的虚拟形象。其中,上述步骤的具体实现过程可参见图1J-图1O实施例的描述,此处不做赘述。直播APP可确定出目标驱动模式。其中,上述步骤的具体实现过程可参见图1O-图1P实施例的描述,此处不做赘述。In some embodiments, the live broadcast APP can take a photograph of the user through a camera, and based on the photograph taken by the user, the live broadcast APP can determine the avatar of the user. For the specific implementation process of the above steps, reference may be made to the description of the embodiments in FIG. 1J to FIG. 10 , which will not be repeated here. The live APP can determine the target driving mode. For the specific implementation process of the above steps, reference may be made to the descriptions of the embodiments in FIG. 10 to FIG. 1P , which will not be repeated here.
从而,直播APP在接收到该用户的指令后,可配置用户的虚拟形象以及启动目标驱动模式。其中,上述步骤的具体实现过程可参见图1P实施例的描述,此处不做赘述。Therefore, after receiving the user's instruction, the live broadcast APP can configure the user's avatar and start the target driving mode. For the specific implementation process of the above steps, reference may be made to the description of the embodiment in FIG. 1P , which will not be repeated here.
综上,直播APP可支持通过摄像头识别的方式创建个性化的虚拟形象 在虚拟直播间中进行演唱,有利于通过生动的外观、表情、肢体动作来深度还原用户线下歌唱的场景,使得用户互动更具实景性。In summary, the live broadcast APP can support the creation of personalized avatars through camera recognition to sing in the virtual live broadcast room, which is beneficial to deeply restore the offline singing scene of users through vivid appearance, expressions and body movements, so that users can interact with each other. more realistic.
在另一些实施例中,直播APP可从电子设备的本地存储空间中获取用户的相册照片,并基于用户的相册照片,直播APP可确定出用户的虚拟形象。其中,上述步骤的具体实现过程可参见图1J、图1Q-图1R、图1N-图1O实施例的描述,此处不做赘述。直播APP可确定出目标驱动模式。其中,上述步骤的具体实现过程可参见图1O-图1P实施例的描述,此处不做赘述。In other embodiments, the live broadcast APP can obtain the user's album photos from the local storage space of the electronic device, and based on the user's album photos, the live broadcast APP can determine the user's avatar. For the specific implementation process of the above steps, reference may be made to the descriptions of the embodiments in FIGS. 1J , 1Q-1R, and 1N-1O, which will not be repeated here. The live APP can determine the target driving mode. For the specific implementation process of the above steps, reference may be made to the descriptions of the embodiments in FIG. 10 to FIG. 1P , which will not be repeated here.
从而,直播APP在接收到该用户的指令后,可配置用户的虚拟形象以及启动目标驱动模式。其中,上述步骤的具体实现过程可参见图1P实施例的描述,此处不做赘述。Therefore, after receiving the user's instruction, the live broadcast APP can configure the user's avatar and start the target driving mode. For the specific implementation process of the above steps, reference may be made to the description of the embodiment in FIG. 1P , which will not be repeated here.
综上,直播APP可支持通过照片识别的方式创建个性化的虚拟形象在虚拟直播间中进行演唱,有利于通过生动的外观、表情、肢体动作来深度还原用户线下歌唱的场景,使得用户互动更具实景性。To sum up, the live broadcast APP can support the creation of personalized avatars through photo recognition to sing in the virtual live broadcast room, which is beneficial to deeply restore the offline singing scene of users through vivid appearance, expressions and body movements, so that users can interact with each other. more realistic.
在另一些实施例中,直播APP可基于一个默认形象,可确定出用户的虚拟形象。其中,上述步骤的具体实现过程可参见图1J和图1U实施例的描述,此处不做赘述。直播APP可确定出目标驱动模式。其中,上述步骤的具体实现过程可参见图1U-图1V实施例的描述,此处不做赘述。In other embodiments, the live broadcast APP may determine the user's avatar based on a default avatar. For the specific implementation process of the above steps, reference may be made to the descriptions of the embodiments in FIG. 1J and FIG. 1U , which will not be repeated here. The live APP can determine the target driving mode. For the specific implementation process of the above steps, reference may be made to the description of the embodiments in FIG. 1U-FIG. 1V, which will not be repeated here.
从而,直播APP在接收到该用户的指令后,可配置用户的虚拟形象以及启动目标驱动模式。其中,上述步骤的具体实现过程可参见图1V实施例的描述,此处不做赘述。Therefore, after receiving the user's instruction, the live broadcast APP can configure the user's avatar and start the target driving mode. For the specific implementation process of the above steps, reference may be made to the description of the embodiment in FIG. 1V , which will not be repeated here.
综上,直播APP可支持通过默认形象的方式创建个性化的虚拟形象在虚拟直播间中进行演唱,有利于通过用户演唱的歌曲的音调和/或位置等参数进行虚拟形象的默认动作的下发,降低了虚拟形象的操作门槛,使得用户互动更具实景性。In summary, the live broadcast APP can support the creation of personalized avatars by default images to sing in the virtual live broadcast room, which is conducive to the delivery of the default actions of the avatars through parameters such as the pitch and/or position of the songs sung by the user. , which lowers the operating threshold of virtual images, making user interaction more realistic.
需要说明的是,确定该用户的虚拟形象的步骤以及确定目标驱动模式的步骤可不分先后顺序,两个步骤可先后执行,也可以同时执行,本公开实施例对此不做限定。It should be noted that the steps of determining the avatar of the user and the steps of determining the target driving mode may not be sequenced, and the two steps may be performed sequentially or simultaneously, which is not limited in this embodiment of the present disclosure.
另外,在基于用户的拍摄照片或用户的相册照片无法确定出用户的虚 拟形象的情况下,直播APP可将默认形象确定为用户的虚拟形象。In addition, in the case that the user's avatar cannot be determined based on the user's photographed photos or the user's album photos, the live broadcast APP can determine the default image as the user's avatar.
基于上述实施例的描述,直播APP可提供多种驱动模式。Based on the descriptions of the above embodiments, the live broadcast APP can provide various driving modes.
在一些实施例中,在目标驱动模式为实时驱动模式时,直播APP可通过摄像头实时采集用户的头部动作,并将用户的头部动作确定为目标动作。In some embodiments, when the target driving mode is the real-time driving mode, the live broadcast APP can collect the user's head movement in real time through the camera, and determine the user's head movement as the target movement.
从而,直播APP可显示实时模拟用户头部动作的用户的虚拟形象在虚拟直播间中进行演唱。即直播APP显示该用户的虚拟形象在虚拟直播间中进行演唱,该过程中该用户的虚拟形象实时模拟用户头部动作。Therefore, the live broadcast APP can display the avatar of the user who simulates the user's head movements in real time and sing in the virtual live broadcast room. That is, the live broadcast APP displays the user's avatar singing in the virtual live broadcast room, and the user's avatar simulates the user's head movements in real time during the process.
其中,上述步骤的具体实现过程可参见图1W或图1X实施例的描述,此处不做赘述。For the specific implementation process of the above steps, reference may be made to the description of the embodiment in FIG. 1W or FIG. 1X , which will not be repeated here.
综上,在用户的虚拟形象在该虚拟直播间中进行演唱的过程中,用户的虚拟形象可实时随着摄像头实时采集到的用户的头部动作进行律动,深度还原了用户线下歌唱场景,提高了虚拟直播间的互动可玩性。In summary, during the process of the user's avatar singing in the virtual live broadcast room, the user's avatar can rhythm in real time with the user's head movements captured by the camera in real time, which deeply restores the user's offline singing scene. Improve the interactive playability of the virtual live room.
另外,在用户在虚拟直播间中开始唱歌时,直播APP可在该虚拟直播间中显示第一提示信息,第一提示信息用于提示用户的虚拟形象实时模拟摄像头实时采集的用户的头部动作,以便用户能够及时表现自我,有利于提升用户互动性。In addition, when the user starts singing in the virtual live broadcast room, the live broadcast APP can display the first prompt information in the virtual live broadcast room, and the first prompt information is used to prompt the user's avatar to simulate the user's head movement captured by the camera in real time in real time. , so that users can express themselves in time, which is conducive to improving user interaction.
其中,本公开实施例对第一提示信息的具体实现方式不做限定。在一些实施例中,本公开实施例可采用文本信息等方式来显示第一提示信息,如图1Y中的控件204。并且,上述步骤的具体实现过程可参见图1Y实施例的描述,此处不做赘述。Wherein, the embodiment of the present disclosure does not limit the specific implementation manner of the first prompt information. In some embodiments, the embodiments of the present disclosure may display the first prompt information by means of text information or the like, such as the control 204 in FIG. 1Y . In addition, for the specific implementation process of the above steps, reference may be made to the description of the embodiment in FIG. 1Y , which will not be repeated here.
另外,在用户的头部离开摄像头的识别区域后,直播APP可在该虚拟直播间中显示第二提示信息,第二提示信息用于提示该用户调整用户的头部,以便用户能够及时将用户的头部调整到摄像头的识别区域,有利于提升用户互动性。In addition, after the user's head leaves the recognition area of the camera, the live broadcast APP can display second prompt information in the virtual live broadcast room, and the second prompt information is used to prompt the user to adjust the user's head, so that the user can timely The head is adjusted to the recognition area of the camera, which is conducive to improving user interaction.
其中,本公开实施例对第二提示信息的具体实现方式不做限定。在一些实施例中,本公开实施例可采用文本信息等方式来显示第二提示信息,如图1Z中的控件205。另外,直播APP可在该虚拟直播间的页面中显示出摄像头的识别区域,本公开实施例对摄像头的识别区域的具体实现方式不做限定。并且,上述步骤的具体实现过程可参见图1Z实施例的描述,此处 不做赘述。Wherein, the embodiment of the present disclosure does not limit the specific implementation manner of the second prompt information. In some embodiments, the embodiments of the present disclosure may display the second prompt information by means of text information or the like, such as the control 205 in FIG. 1Z . In addition, the live broadcast APP may display the identification area of the camera on the page of the virtual live broadcast room, and the embodiment of the present disclosure does not limit the specific implementation of the identification area of the camera. In addition, for the specific implementation process of the above steps, reference may be made to the description of the embodiment in FIG. 1Z, which will not be repeated here.
在另一些实施例中,在目标驱动模式为默认驱动模式时,直播APP基于用户演唱的歌曲的节奏和/或音调,可确定出默认动作。直播APP可将默认动作确定为目标动作。In other embodiments, when the target driving mode is the default driving mode, the live APP may determine the default action based on the rhythm and/or pitch of the song sung by the user. The live APP can determine the default action as the target action.
从而,直播APP可显示模拟默认动作的用户的虚拟形象在虚拟直播间中进行演唱。即直播APP显示该用户的虚拟形象在虚拟直播间中进行演唱,该过程中该用户的虚拟形象模拟默认动作。Therefore, the live broadcast APP can display the avatar of the user who simulates the default action to sing in the virtual live broadcast room. That is, the live broadcast APP displays that the user's avatar sings in the virtual live broadcast room, and the user's avatar simulates a default action in the process.
其中,上述步骤的具体实现过程可参见图1X实施例的描述,默认动作的具体实现方式可参见前文的描述,此处不做赘述。The specific implementation process of the above steps may refer to the description of the embodiment in FIG. 1X , and the specific implementation of the default action may refer to the foregoing description, which will not be repeated here.
综上,在用户的虚拟形象在该虚拟直播间中进行演唱的过程中,用户的虚拟形象可实时随着默认动作进行律动,降低了虚拟形象操作门槛,提高了虚拟直播间的互动可玩性。To sum up, during the process of the user's avatar singing in the virtual live broadcast room, the user's avatar can rhythm with the default action in real time, which reduces the threshold for avatar operation and improves the interactive playability of the virtual live broadcast room. .
示例性地,本公开实施例提供一种虚拟形象的互动装置。Exemplarily, an embodiment of the present disclosure provides an interactive device for a virtual image.
请参阅图3,图3为本公开实施例提供的虚拟形象的互动装置的结构示意图。本公开实施例的虚拟形象的互动装置可设置在电子设备中,可实现上述图1A-图1Z和图2实施例的虚拟形象的互动方法对应于电子设备中的直播APP的操作。Please refer to FIG. 3 , which is a schematic structural diagram of an interactive device for virtual images provided by an embodiment of the present disclosure. The avatar interaction apparatus according to the embodiment of the present disclosure can be set in an electronic device, and the avatar interaction method in the above-mentioned embodiments of FIGS. 1A-1Z and FIG.
如图3所示,本公开实施例提供的虚拟形象的互动装置100可以包括:配置模块401和显示模块402。As shown in FIG. 3 , the virtual image interaction device 100 provided by the embodiment of the present disclosure may include: a configuration module 401 and a display module 402 .
配置模块401,用于在一个虚拟直播间开启唱歌直播后,响应于虚拟直播间中的一个用户的指令,配置用户的虚拟形象以及启动用户的虚拟形象的目标驱动模式;The configuration module 401 is used to configure the avatar of the user and start the target drive mode of the avatar of the user in response to an instruction of a user in the virtual live broadcast room after the singing live broadcast is opened in a virtual live broadcast room;
显示模块402,用于显示模拟与目标驱动模式对应的目标动作的用户的虚拟形象在虚拟直播间中进行演唱。The display module 402 is configured to display the avatar of the user who simulates the target action corresponding to the target driving mode to sing in the virtual live broadcast room.
请参阅图4,图4为本公开实施例提供的虚拟形象的互动装置的结构示意图。如图4所示,本公开实施例提供的虚拟形象的互动装置100在图3所示装置结构的基础上,还可以包括:第一获取模块403和第一确定模块404。Please refer to FIG. 4 . FIG. 4 is a schematic structural diagram of an interactive device for virtual images according to an embodiment of the present disclosure. As shown in FIG. 4 , on the basis of the device structure shown in FIG. 3 , the virtual image interaction device 100 provided by the embodiment of the present disclosure may further include: a first acquisition module 403 and a first determination module 404 .
第一获取模块403,用于通过摄像头拍摄用户的拍摄照片;The first obtaining module 403 is used for taking a photograph of the user through a camera;
第一确定模块404,用于基于用户的拍摄照片,确定用户的虚拟形象;a first determining module 404, configured to determine the avatar of the user based on the photograph taken by the user;
第一确定模块404,还用于确定目标驱动模式。The first determining module 404 is further configured to determine the target driving mode.
请参阅图5,图5为本公开实施例提供的虚拟形象的互动装置的结构示意图。如图5所示,本公开实施例提供的虚拟形象的互动装置100在图3所示装置结构的基础上,还可以包括:第二获取模块405和第二确定模块406。Please refer to FIG. 5 . FIG. 5 is a schematic structural diagram of a virtual image interaction device according to an embodiment of the present disclosure. As shown in FIG. 5 , on the basis of the device structure shown in FIG. 3 , the virtual image interaction device 100 provided by the embodiment of the present disclosure may further include: a second acquisition module 405 and a second determination module 406 .
第二获取模块405,用于从本地存储空间中获取用户的相册照片;The second obtaining module 405 is used to obtain the user's album photos from the local storage space;
第二确定模块406,用于基于用户的相册照片,确定用户的虚拟形象;The second determination module 406 is used to determine the avatar of the user based on the photo album of the user;
第二确定模块406,还用于确定目标驱动模式。The second determining module 406 is further configured to determine the target driving mode.
请参阅图6,图6为本公开实施例提供的虚拟形象的互动装置的结构示意图。如图6所示,本公开实施例提供的虚拟形象的互动装置100在图3所示装置结构的基础上,还可以包括:第三确定模块407。Please refer to FIG. 6 . FIG. 6 is a schematic structural diagram of an interactive device for virtual images according to an embodiment of the present disclosure. As shown in FIG. 6 , on the basis of the device structure shown in FIG. 3 , the virtual image interaction device 100 provided by the embodiment of the present disclosure may further include: a third determination module 407 .
第三确定模块407,用于基于一个默认形象,确定用户的虚拟形象;A third determining module 407, configured to determine the avatar of the user based on a default image;
第三确定模块407,还用于确定目标驱动模式。The third determining module 407 is further configured to determine the target driving mode.
在一些实施例中,在目标驱动模式为实时驱动模式时,显示模块402,具体用于通过摄像头实时采集用户的头部动作;将用户的头部动作确定为目标动作;显示实时模拟用户头部动作的用户的虚拟形象在虚拟直播间中进行演唱。In some embodiments, when the target driving mode is the real-time driving mode, the display module 402 is specifically configured to collect the user's head movement in real time through the camera; determine the user's head movement as the target movement; display the real-time simulated user head The avatar of the moving user sings in the virtual live room.
在一些实施例中,显示模块402,还用于在用户在虚拟直播间中开始唱歌时,在虚拟直播间中显示第一提示信息,第一提示信息用于提示用户的虚拟形象实时模拟摄像头实时采集的用户的头部动作。In some embodiments, the display module 402 is further configured to display first prompt information in the virtual live broadcast room when the user starts singing in the virtual live broadcast room, where the first prompt information is used to prompt the user's avatar to simulate the real-time camera in real time The collected head movements of the user.
在一些实施例中,显示模块402,还用于在用户的头部离开摄像头的识别区域后,在虚拟直播间中显示第二提示信息,第二提示信息用于提示用户调整用户的头部。In some embodiments, the display module 402 is further configured to display second prompt information in the virtual live room after the user's head leaves the recognition area of the camera, where the second prompt information is used to prompt the user to adjust the user's head.
在一些实施例中,在目标驱动模式为默认驱动模式时,显示模块402,具体用于基于用户演唱的歌曲的节奏和/或音调,确定默认动作;将默认动作确定为目标动作;显示模拟默认动作的用户的虚拟形象在虚拟直播间中进行演唱。In some embodiments, when the target drive mode is the default drive mode, the display module 402 is specifically configured to determine a default action based on the rhythm and/or pitch of the song sung by the user; determine the default action as the target action; display the simulated default action The avatar of the moving user sings in the virtual live room.
本公开实施例提供的虚拟形象的互动装置,可执行上述方法实施例, 其具体实现原理和技术效果,可参见上述方法实施例,本公开实施例此处不再赘述。The virtual image interaction device provided by the embodiments of the present disclosure can execute the above-mentioned method embodiments, and the specific implementation principles and technical effects thereof may refer to the above-mentioned method embodiments, which will not be repeated here.
示例性地,本公开实施例提供一种电子设备,包括:一个或多个处理器;存储器;以及一个或多个计算机程序;其中一个或多个计算机程序被存储在存储器中;一个或多个处理器在执行一个或多个计算机程序时,使得电子设备实现前文实施例的虚拟形象的互动方法。Exemplarily, embodiments of the present disclosure provide an electronic device, comprising: one or more processors; a memory; and one or more computer programs; wherein the one or more computer programs are stored in the memory; one or more When the processor executes one or more computer programs, the electronic device implements the avatar interaction method of the foregoing embodiments.
示例性地,本公开实施例提供一种芯片系统,芯片系统应用于包括存储器和传感器的电子设备;芯片系统包括:处理器;当处理器执行前文实施例的虚拟形象的互动方法。Exemplarily, an embodiment of the present disclosure provides a chip system, which is applied to an electronic device including a memory and a sensor; the chip system includes: a processor; when the processor executes the avatar interaction method of the foregoing embodiments.
示例性地,本公开实施例提供一种计算机可读存储介质,其上存储有计算机程序,计算机程序被处理器使得电子设备执行时实现前文实施例的虚拟形象的互动方法。Exemplarily, an embodiment of the present disclosure provides a computer-readable storage medium on which a computer program is stored, and the computer program is executed by a processor to cause an electronic device to implement the avatar interaction method of the foregoing embodiments.
示例性地,本公开实施例提供一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行前文实施例的虚拟形象的互动方法。Exemplarily, the embodiments of the present disclosure provide a computer program product, which, when the computer program product runs on a computer, causes the computer to execute the avatar interaction method of the foregoing embodiments.
在上述实施例中,全部或部分功能可以通过软件、硬件、或者软件加硬件的组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行计算机程序指令时,全部或部分地产生按照本公开实施例的流程或功能。计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。计算机指令可以存储在计算机可读存储介质中。计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,DVD)、或者半导体介质(例如,固态硬盘(solid state disk,SSD))等。In the above embodiments, all or part of the functions may be implemented by software, hardware, or a combination of software and hardware. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the procedures or functions according to the embodiments of the present disclosure result in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device. Computer instructions may be stored in a computer-readable storage medium. A computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, a data center, or the like that includes an integration of one or more available media. Useful media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVDs), or semiconductor media (eg, solid state disks (SSDs)), and the like.
需要说明的是,在本文中,诸如“第一”和“第二”等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而 且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that, in this document, relational terms such as "first" and "second" etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these There is no such actual relationship or sequence between entities or operations. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device that includes a list of elements includes not only those elements, but also includes not explicitly listed or other elements inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.
以上所述仅是本公开的具体实施方式,使本领域技术人员能够理解或实现本公开。对这些实施例的多种修改对本领域的技术人员来说将是显而易见的,本文中所定义的一般原理可以在不脱离本公开的精神或范围的情况下,在其它实施例中实现。因此,本公开将不会被限制于本文所述的这些实施例,而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。The above descriptions are only specific embodiments of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the embodiments described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (12)

  1. 一种虚拟形象的互动方法,所述方法包括:A virtual image interaction method, the method includes:
    在一个虚拟直播间开启唱歌直播后,响应于所述虚拟直播间中的一个用户的指令,配置所述用户的虚拟形象以及启动所述用户的虚拟形象的目标驱动模式;After the singing live broadcast is started in a virtual live broadcast room, in response to an instruction of a user in the virtual live broadcast room, configure the avatar of the user and start the target drive mode of the avatar of the user;
    在所述用户在所述虚拟直播间中进行演唱的过程中,显示模拟与所述目标驱动模式对应的目标动作的所述用户的虚拟形象在所述虚拟直播间中进行演唱。During the process of the user singing in the virtual live broadcast room, the avatar of the user simulating the target action corresponding to the target driving mode is displayed to sing in the virtual live broadcast room.
  2. 根据权利要求1所述的方法,其中,所述方法还包括:The method of claim 1, wherein the method further comprises:
    通过摄像头拍摄所述用户的拍摄照片;Taking a photograph of the user through a camera;
    基于所述用户的拍摄照片,确定所述用户的虚拟形象;determining the avatar of the user based on the photograph taken by the user;
    确定所述目标驱动模式。The target drive mode is determined.
  3. 根据权利要求1所述的方法,其中,所述方法还包括:The method of claim 1, wherein the method further comprises:
    从本地存储空间中获取所述用户的相册照片;Obtain the user's album photos from the local storage space;
    基于所述用户的相册照片,确定所述用户的虚拟形象;determining an avatar of the user based on the user's photo album;
    确定所述目标驱动模式。The target drive mode is determined.
  4. 根据权利要求1所述的方法,其中,所述方法还包括:The method of claim 1, wherein the method further comprises:
    基于一个默认形象,确定所述用户的虚拟形象;determining an avatar of the user based on a default avatar;
    确定所述目标驱动模式。The target drive mode is determined.
  5. 根据权利要求1-4任一项所述的方法,其中,在所述目标驱动模式为实时驱动模式时,所述显示模拟与所述目标驱动模式对应的目标动作的所述用户的虚拟形象在所述虚拟直播间中进行演唱,包括:The method according to any one of claims 1-4, wherein, when the target driving mode is a real-time driving mode, the avatar of the user displaying the target action corresponding to the target driving mode is displayed at Singing in the virtual live room includes:
    通过摄像头实时采集所述用户的头部动作;Real-time capture of the head movement of the user through a camera;
    将所述用户的头部动作确定为所述目标动作;determining the head action of the user as the target action;
    显示实时模拟所述用户头部动作的所述用户的虚拟形象在所述虚拟直播间中进行演唱。Displaying the avatar of the user who simulates the head movement of the user in real time and sings in the virtual live broadcast room.
  6. 根据权利要求5所述的方法,其中,所述方法还包括:The method of claim 5, wherein the method further comprises:
    在所述用户在所述虚拟直播间中开始唱歌时,在所述虚拟直播间中显示第一提示信息,所述第一提示信息用于提示所述用户的虚拟形象模拟所 述摄像头实时采集的所述用户的头部动作。When the user starts singing in the virtual live broadcast room, first prompt information is displayed in the virtual live broadcast room, and the first prompt information is used to prompt the user's avatar to simulate the real-time capture of the camera. the head movement of the user.
  7. 根据权利要求6所述的方法,其中,所述方法还包括:The method of claim 6, wherein the method further comprises:
    在所述用户的头部离开所述摄像头的识别区域后,在所述虚拟直播间中显示第二提示信息,所述第二提示信息用于提示所述用户调整所述用户的头部。After the user's head leaves the recognition area of the camera, second prompt information is displayed in the virtual live room, where the second prompt information is used to prompt the user to adjust the user's head.
  8. 根据权利要求1-4任一项所述的方法,其中,在所述目标驱动模式为默认驱动模式时,所述显示模拟与所述目标驱动模式对应的目标动作的所述用户的虚拟形象在所述虚拟直播间中进行演唱,包括:The method according to any one of claims 1-4, wherein, when the target driving mode is a default driving mode, the avatar of the user displaying the target action corresponding to the target driving mode is displayed in Singing in the virtual live room includes:
    基于所述用户演唱的歌曲的节奏和/或音调,确定默认动作;determining a default action based on the tempo and/or pitch of the song sung by the user;
    将所述默认动作确定为所述目标动作;determining the default action as the target action;
    显示模拟所述默认动作的所述用户的虚拟形象在所述虚拟直播间中进行演唱。The avatar of the user simulating the default action is displayed to sing in the virtual live room.
  9. 一种虚拟形象的互动装置,所述装置包括:A virtual image interactive device, the device includes:
    配置模块,用于在一个虚拟直播间开启唱歌直播后,响应于所述虚拟直播间中的一个用户的指令,配置所述用户的虚拟形象以及启动所述用户的虚拟形象的目标驱动模式;A configuration module, configured to configure the user's avatar and start the target drive mode of the user's avatar in response to an instruction of a user in the virtual live broadcast room after the singing live broadcast is turned on in a virtual live broadcast room;
    显示模块,用于显示模拟与所述目标驱动模式对应的目标动作的所述用户的虚拟形象在所述虚拟直播间中进行演唱。The display module is configured to display the avatar of the user who simulates the target action corresponding to the target driving mode to sing in the virtual live broadcast room.
  10. 一种电子设备,包括:一个或多个处理器;存储器;以及一个或多个计算机程序;其中所述一个或多个计算机程序被存储在所述存储器中;其特征在于,所述一个或多个处理器在执行所述一个或多个计算机程序时,使得所述电子设备实现如权利要求1-8任一项所述的虚拟形象的互动方法。An electronic device comprising: one or more processors; a memory; and one or more computer programs; wherein the one or more computer programs are stored in the memory; characterized in that the one or more computer programs When the processor executes the one or more computer programs, the electronic device implements the method for interacting with the avatar according to any one of claims 1-8.
  11. 一种计算机存储介质,包括计算机指令,当所述计算机指令在电子设备上运行时,使得所述电子设备执行如权利要求1-8任一项所述的虚拟形象的互动方法。A computer storage medium, comprising computer instructions, when the computer instructions are executed on an electronic device, the electronic device causes the electronic device to execute the avatar interaction method according to any one of claims 1-8.
  12. 一种计算机程序产品,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如权利要求1-8任一项所述的虚拟形象的互动方法。A computer program product, when the computer program product runs on a computer, causes the computer to execute the method for interacting with an avatar according to any one of claims 1-8.
PCT/CN2022/088522 2021-04-22 2022-04-22 Avatar interaction method, apparatus, and device WO2022223029A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110436963.6A CN115239916A (en) 2021-04-22 2021-04-22 Interaction method, device and equipment of virtual image
CN202110436963.6 2021-04-22

Publications (1)

Publication Number Publication Date
WO2022223029A1 true WO2022223029A1 (en) 2022-10-27

Family

ID=83666120

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/088522 WO2022223029A1 (en) 2021-04-22 2022-04-22 Avatar interaction method, apparatus, and device

Country Status (2)

Country Link
CN (1) CN115239916A (en)
WO (1) WO2022223029A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115657862B (en) * 2022-12-27 2023-03-14 海马云(天津)信息技术有限公司 Method, device, storage medium and equipment for automatically switching virtual KTV scene pictures
CN116437137B (en) * 2023-06-09 2024-01-09 北京达佳互联信息技术有限公司 Live broadcast processing method and device, electronic equipment and storage medium
CN117237576A (en) * 2023-11-15 2023-12-15 太一云境技术有限公司 Meta universe KTV service method and system

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109874021A (en) * 2017-12-04 2019-06-11 腾讯科技(深圳)有限公司 Living broadcast interactive method, apparatus and system
CN110213560A (en) * 2019-05-28 2019-09-06 刘忠华 A kind of immersion video broadcasting method and system
CN110472099A (en) * 2018-05-10 2019-11-19 腾讯科技(深圳)有限公司 Interdynamic video generation method and device, storage medium
CN110691279A (en) * 2019-08-13 2020-01-14 北京达佳互联信息技术有限公司 Virtual live broadcast method and device, electronic equipment and storage medium
JP6796762B1 (en) * 2019-11-28 2020-12-09 有限会社クロマニヨン Virtual person dialogue system, video generation method, video generation program
WO2021052133A1 (en) * 2019-09-19 2021-03-25 聚好看科技股份有限公司 Singing interface display method and display device, and server
CN112581571A (en) * 2020-12-02 2021-03-30 北京达佳互联信息技术有限公司 Control method and device of virtual image model, electronic equipment and storage medium
CN112637622A (en) * 2020-12-11 2021-04-09 北京字跳网络技术有限公司 Live broadcasting singing method, device, equipment and medium
CN113822970A (en) * 2021-09-23 2021-12-21 广州博冠信息科技有限公司 Live broadcast control method and device, storage medium and electronic equipment

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109874021A (en) * 2017-12-04 2019-06-11 腾讯科技(深圳)有限公司 Living broadcast interactive method, apparatus and system
CN110472099A (en) * 2018-05-10 2019-11-19 腾讯科技(深圳)有限公司 Interdynamic video generation method and device, storage medium
CN110213560A (en) * 2019-05-28 2019-09-06 刘忠华 A kind of immersion video broadcasting method and system
CN110691279A (en) * 2019-08-13 2020-01-14 北京达佳互联信息技术有限公司 Virtual live broadcast method and device, electronic equipment and storage medium
WO2021052133A1 (en) * 2019-09-19 2021-03-25 聚好看科技股份有限公司 Singing interface display method and display device, and server
JP6796762B1 (en) * 2019-11-28 2020-12-09 有限会社クロマニヨン Virtual person dialogue system, video generation method, video generation program
CN112581571A (en) * 2020-12-02 2021-03-30 北京达佳互联信息技术有限公司 Control method and device of virtual image model, electronic equipment and storage medium
CN112637622A (en) * 2020-12-11 2021-04-09 北京字跳网络技术有限公司 Live broadcasting singing method, device, equipment and medium
CN113822970A (en) * 2021-09-23 2021-12-21 广州博冠信息科技有限公司 Live broadcast control method and device, storage medium and electronic equipment

Also Published As

Publication number Publication date
CN115239916A (en) 2022-10-25

Similar Documents

Publication Publication Date Title
WO2022223029A1 (en) Avatar interaction method, apparatus, and device
US20230051795A1 (en) Systems, devices and methods for creating a collaborative virtual session
US11895426B2 (en) Method and apparatus for capturing video, electronic device and computer-readable storage medium
WO2020083021A1 (en) Video recording method and apparatus, video playback method and apparatus, device, and storage medium
WO2022001593A1 (en) Video generation method and apparatus, storage medium and computer device
US20240080215A1 (en) Presenting overview of participant reactions within a virtual conferencing system
WO2019128787A1 (en) Network video live broadcast method and apparatus, and electronic device
WO2021233245A1 (en) Method and apparatus for providing commodity object information, and electronic device
US10499004B2 (en) Method and terminal for reproducing content
WO2021143315A1 (en) Scene interaction method and apparatus, electronic device, and computer storage medium
WO2020029523A1 (en) Video generation method and apparatus, electronic device, and storage medium
US10354256B1 (en) Avatar based customer service interface with human support agent
WO2018228037A1 (en) Media data processing method and device and storage medium
TW202007142A (en) Video file generation method, device, and storage medium
JP2003196303A (en) Network information processing system and information processing method
JP2019528594A (en) Cooperative immersive live action 360 degree video and virtual reality
WO2023185809A1 (en) Video data generation method and apparatus, and electronic device and storage medium
JP2024513640A (en) Virtual object action processing method, device, and computer program
CN106105245A (en) The playback of interconnection video
US20140282000A1 (en) Animated character conversation generator
WO2023241377A1 (en) Video data processing method and device, equipment, system, and storage medium
WO2023232103A1 (en) Film-watching interaction method and apparatus, and computer-readable storage medium
US20230403413A1 (en) Method and apparatus for displaying online interaction, electronic device and computer readable medium
KR20190096576A (en) Toys social network service for making user producing and sharing short clip video
WO2024007290A1 (en) Video acquisition method, electronic device, storage medium, and program product

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22791134

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE