WO2023168990A1 - 虚拟场景中的表演录制方法、装置、设备、存储介质及程序产品 - Google Patents

虚拟场景中的表演录制方法、装置、设备、存储介质及程序产品 Download PDF

Info

Publication number
WO2023168990A1
WO2023168990A1 PCT/CN2022/133709 CN2022133709W WO2023168990A1 WO 2023168990 A1 WO2023168990 A1 WO 2023168990A1 CN 2022133709 W CN2022133709 W CN 2022133709W WO 2023168990 A1 WO2023168990 A1 WO 2023168990A1
Authority
WO
WIPO (PCT)
Prior art keywords
performance
target
rhythm
audio
costume
Prior art date
Application number
PCT/CN2022/133709
Other languages
English (en)
French (fr)
Inventor
何晶晶
仇蒙
邹聃成
刘博艺
邓昱
谢洁琪
田聪
崔维健
Original Assignee
腾讯科技（深圳）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技（深圳）有限公司 filed Critical 腾讯科技（深圳）有限公司
Publication of WO2023168990A1 publication Critical patent/WO2023168990A1/zh

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/85—Providing additional services to players
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/53—Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
    • A63F13/533—Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game for prompting the player, e.g. by displaying a game menu
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/54—Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/55—Controlling game characters or game objects based on the game progress
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/60—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
    • A63F13/63—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor by the player, e.g. authoring using a level editor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/50—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers
    • A63F2300/55—Details of game data or player data management
    • A63F2300/5546—Details of game data or player data management using player registration data, e.g. identification, account, preferences, game history
    • A63F2300/5553—Details of game data or player data management using player registration data, e.g. identification, account, preferences, game history user representation in the game field, e.g. avatar
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2024—Style variation

Definitions

  • the present application relates to human-computer interaction technology, and in particular to a performance recording method, device, equipment, storage medium and program product in a virtual scene.
  • Embodiments of the present application provide a performance recording method, device, equipment, computer-readable storage medium, and computer program product in a virtual scene, which can improve the efficiency of changing performance costumes and the efficiency of human-computer interaction.
  • An embodiment of the present application provides a performance recording method in a virtual scene.
  • the method is executed by an electronic device.
  • the method includes:
  • the selected target audio is used as the background audio for performance recording; wherein the target audio includes at least two playback rhythms, and different playback rhythms are associated with different performance costumes;
  • the performance costumes assembled by the virtual object are automatically changed, wherein the performance costumes of the virtual object correspond to the playback rhythm of the background audio.
  • An embodiment of the present application provides a performance recording device in a virtual scene.
  • the device includes:
  • a display module configured to display a virtual object equipped with a performance costume and audio controls for selecting background audio
  • a selection module configured to use the selected target audio as background audio for performance recording in response to an audio selection operation triggered based on the audio control; wherein the target audio includes at least two playback rhythms, and different playback rhythms are associated with different performance costumes;
  • a recording module configured to play the background audio during the performance recording of the virtual object, and display the performance actions performed by the virtual object following the background audio;
  • a replacement module configured to automatically replace the performance costumes assembled by the virtual object when the playback rhythm of the background audio changes, wherein the performance costumes of the virtual object correspond to the playback rhythm of the background audio.
  • An embodiment of the present application provides an electronic device, including:
  • memory configured to store executable instructions
  • the processor is configured to implement the performance recording method in the virtual scene provided by the embodiment of the present application when executing the executable instructions stored in the memory.
  • Embodiments of the present application provide a computer-readable storage medium that stores executable instructions for causing a processor to implement the performance recording method in a virtual scene provided by embodiments of the present application.
  • An embodiment of the present application provides a computer program product.
  • the computer program product includes a computer program or instructions.
  • the performance recording method in a virtual scene provided by the embodiment of the present application is implemented.
  • the changes in the playback rhythm of the audio make the performance costumes of the virtual object equipment echo the playback rhythm of the background audio well, improving the adaptability between each other; and this method of changing performance costumes is compared with manual In terms of switching the performance costumes to be replaced, the efficiency of changing performance costumes is greatly improved, so that users do not need to manually change the performance costumes of virtual objects under different playback rhythms, which improves the efficiency of human-computer interaction.
  • Figure 1A is a schematic diagram of an application scenario of a performance recording method in a virtual scene provided by an embodiment of the present application
  • Figure 1B is a schematic diagram of an application scenario of the performance recording method in a virtual scene provided by an embodiment of the present application
  • Figure 2 is a schematic structural diagram of a terminal device 400 provided by an embodiment of the present application.
  • Figure 3 is a schematic flowchart of a performance recording method in a virtual scene provided by an embodiment of the present application
  • Figure 4 is a schematic diagram of the determination of performance costumes provided by the embodiment of the present application.
  • Figure 5 is a schematic diagram of the background audio correlation settings provided by the embodiment of the present application.
  • Figure 6 is a schematic display diagram of performance recording provided by an embodiment of the present application.
  • Figure 7 is a schematic diagram of performance recording provided by the embodiment of the present application.
  • Figure 8 is a schematic diagram of the arrangement of performance costumes provided by the embodiment of the present application.
  • Figure 9 is a schematic diagram of the arrangement of performance costumes provided by the embodiment of the present application.
  • Figure 10 is a schematic diagram of the background audio correlation settings provided by the embodiment of the present application.
  • Figure 11 is a schematic display diagram of performance recording provided by an embodiment of the present application.
  • first ⁇ second are only used to distinguish similar objects and do not represent a specific ordering of objects. It is understood that “first ⁇ second" may be used where permitted. The specific order or sequence may be interchanged so that the embodiments of the application described herein can be practiced in another order than illustrated or described herein.
  • Client an application running in the terminal to provide various services, such as video playback client, game client, etc.
  • Response is used to represent the conditions or states on which the performed operations depend.
  • the dependent conditions or states are met, the one or more operations performed may be in real time or may have a set delay; Unless otherwise specified, there is no restriction on the execution order of the multiple operations performed.
  • Virtual scene is a virtual scene displayed (or provided) when the application is running on the terminal.
  • the virtual scene can be a simulation environment of the real world, a semi-simulation and semi-fictional virtual environment, or a pure fiction. virtual environment.
  • the virtual scene may be any one of a two-dimensional virtual scene, a 2.5-dimensional virtual scene, or a three-dimensional virtual scene.
  • the embodiments of this application do not limit the dimensions of the virtual scene.
  • the virtual scene can include the sky, land, ocean, etc., and the land can include environmental elements such as deserts and cities, and the user can control virtual objects to move in the virtual scene.
  • the movable object may be a virtual character, a virtual animal, an animation character, etc., such as a character, animal, etc. displayed in a virtual scene.
  • the virtual object may be a virtual avatar representing the user in the virtual scene.
  • the virtual scene may include multiple virtual objects. Each virtual object has its own shape and volume in the virtual scene and occupies the virtual scene. part of the space.
  • Virtual objects can be game characters controlled by users (or players), that is, virtual objects are controlled by real users and will respond to real users' actions on controllers (including touch screens, voice-activated switches, keyboards, mice, joysticks, etc.) For example, when the real user moves the joystick to the left, the virtual object will move to the left in the virtual scene, and can also stay still, jump, and use various functions (such as skills and props) ).
  • controllers including touch screens, voice-activated switches, keyboards, mice, joysticks, etc.
  • Embodiments of the present application provide a performance recording method, device, electronic device, computer-readable storage medium, and computer program product in a virtual scene, which can improve the efficiency of changing performance costumes and the efficiency of human-computer interaction.
  • an exemplary implementation scenario of the performance recording method in the virtual scene provided by the embodiment of the present application is first described.
  • the virtual scene in the performance recording method can be completely based on the output of the electronic device, or based on the collaborative output of the electronic device and the server.
  • the virtual scene may be an environment for game characters to interact. For example, it may be for game characters to compete in the virtual scene. By controlling the actions of the game characters, two parties can interact in the virtual scene, thereby enabling the user to Relieve the stress of life during the game.
  • FIG. 1A is a schematic diagram of an application scenario of a performance recording method in a virtual scene provided by an embodiment of the present application.
  • this application scenario completely relies on the graphics processing hardware computing capabilities of the terminal device 400.
  • the relevant data calculation of the virtual scene 100 can be completed, such as stand-alone/offline mode games, and the output of the virtual scene can be completed through various types of terminal devices 400 such as smartphones, tablets, and virtual reality/augmented reality devices.
  • types of graphics processing hardware include central processing units (CPU, Central Processing Unit) and graphics processing units (GPU, Graphics Processing Unit).
  • the terminal device 400 calculates the data required for display through the graphics computing hardware, completes the loading, parsing and rendering of the display data, and outputs video frames capable of forming the visual perception of the virtual scene through the graphics output hardware.
  • video frames capable of forming the visual perception of the virtual scene through the graphics output hardware.
  • two-dimensional video frames are presented on the display screen of a smartphone, or video frames that achieve a three-dimensional display effect are projected on the lenses of augmented reality/virtual reality glasses; in addition, in order to enrich the perception effect, the terminal device 400 can also use Different hardware to form one or more of auditory perception, tactile perception, motion perception and taste perception.
  • a client 410 (for example, a stand-alone version of a game application) is run on the terminal device 400.
  • a virtual scene 100 including role play is output.
  • the virtual scene 100 may be an environment for game characters to interact with. , for example, it can be a plain, street, valley, etc. for game characters to compete; the virtual scene 100 includes a virtual object 110 for performance recording.
  • the terminal device 400 displays a virtual object equipped with performance costumes, and an audio control for selecting background audio; in response to an audio selection operation triggered based on the audio control, the selected target audio is determined as the background of the performance recording Audio; wherein, the target audio includes at least two playback rhythms, and different playback rhythms are associated with different performance costumes; during the performance recording process of the virtual object, the background audio is played, and the execution of the virtual object following the background audio is displayed.
  • FIG. 1B is a schematic diagram of an application scenario of a performance recording method in a virtual scene provided by an embodiment of the present application.
  • the application scenario includes a terminal device 400 and a server 200 , relying on the calculation of the server 200 The ability to complete virtual scene calculation and output the virtual scene on the terminal device 400.
  • the server 200 calculates the virtual scene-related display data (such as scene data) and sends it to the terminal device 400 through the network 300.
  • the terminal device 400 relies on the graphics computing hardware to complete the loading of the calculation display data. , parsing and rendering, relying on graphics output hardware to output virtual scenes to form visual perception.
  • two-dimensional video frames can be presented on the display screen of a smartphone, or projected on the lenses of augmented reality/virtual reality glasses to achieve a three-dimensional display effect.
  • video frames for the perception of the form of the virtual scene, it can be understood that corresponding hardware output of the terminal device 400 can be used, such as using a microphone to form auditory perception, using a vibrator to form tactile perception, and so on.
  • a client 410 (for example, a stand-alone version of a game application) is run on the terminal device 400.
  • a virtual scene 100 including role play is output.
  • the virtual scene 100 may be an environment for game characters to interact with. , for example, it can be a plain, street, valley, etc. for game characters to compete; the virtual scene 100 includes a virtual object 110 for performance recording.
  • Cloud technology refers to the unification of a series of resources such as hardware, software, and networks within a wide area network or a local area network to realize data calculation, storage, and processing. and shared hosting technology.
  • Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, and application technology based on the cloud computing business model. It can form a resource pool and use it on demand, which is flexible and convenient. Cloud computing technology will become an important support.
  • the background services of technical network systems require a large amount of computing and storage resources; for example, when the virtual scene is a game scene, the corresponding game is a cloud game, and the virtual scene images displayed on the terminal are all rendered by the server.
  • the terminal device 400 can implement the performance recording method in the virtual scene provided by the embodiments of the present application by running a computer program.
  • the computer program can be a native program or software module in the operating system; it can be a local ( Native) application (APP, APplication), that is, a program that needs to be installed in the operating system to run, such as a shooting game APP (that is, the above-mentioned client 410); it can also be a small program, that is, it only needs to be downloaded to the browser environment It can be a program that can be run in any APP; it can also be a game applet that can be embedded in any APP.
  • the computer program described above can be any form of application, module or plug-in.
  • the terminal device 400 installs and runs an application program that supports virtual scenes.
  • the application can be any one of a first-person shooting game (FPS, First-Person Shooting game), a third-person shooting game, a virtual reality application, a three-dimensional map program, an exercise simulation program, or a multiplayer gunfight survival game.
  • the user uses the terminal device 400 to operate virtual objects located in the virtual scene to perform activities, which activities include but are not limited to: adjusting body posture, crawling, walking, running, riding, jumping, driving, picking up, shooting, attacking, throwing, building virtual At least one of the buildings.
  • the virtual object may be a virtual character, such as a simulated character or an animation character.
  • the server 200 in Figure 1B can be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or it can provide cloud services, cloud databases, cloud computing, cloud functions, Cloud servers for basic cloud computing services such as cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN, Content Delivery Network), and big data and artificial intelligence platforms.
  • the terminal device 400 may be a smartphone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, a wearable device, etc., but is not limited thereto.
  • the terminal device 400 and the server 200 can be connected directly or indirectly through wired or wireless communication methods, which are not limited in the embodiments of this application.
  • the electronic device 5 can be the terminal device shown in Figure 1A or Figure 1B , or can be the terminal device shown in Figure 1B
  • the server shown takes the electronic device as the terminal device 400 shown in FIG. 1A as an example, and the structure of the terminal device 400 shown in FIG. 1A is explained.
  • Figure 2 is a schematic structural diagram of a terminal device 400 provided by an embodiment of the present application.
  • the terminal device 400 shown in Figure 2 includes: at least one processor 420, a memory 460, at least one network interface 430 and a user interface 440.
  • the various components in the terminal device 400 are coupled together via a bus system 450 .
  • bus system 450 is configured to enable connected communications between these components.
  • the bus system 450 also includes a power bus, a control bus and a status signal bus.
  • the various buses are labeled bus system 450 in FIG. 2 .
  • the processor 420 may be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP, Digital Signal Processor), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware Components, etc., wherein the general processor can be a microprocessor or any conventional processor, etc.
  • DSP Digital Signal Processor
  • User interface 440 includes one or more output devices 441 that enable the presentation of media content, including one or more speakers and/or one or more visual displays.
  • User interface 440 also includes one or more input devices 442, including user interface components that facilitate user input, such as keyboards, mice, microphones, touch screen displays, cameras, and other input buttons and controls.
  • Memory 460 may be removable, non-removable, or a combination thereof.
  • Exemplary hardware devices include solid state memory, hard disk drives, optical disk drives, etc.
  • Memory 460 optionally includes one or more storage devices physically located remotely from processor 420 .
  • Memory 460 includes volatile memory or non-volatile memory, and may include both volatile and non-volatile memory.
  • Non-volatile memory can be read-only memory (ROM, Read Only Memory), and volatile memory can be random access memory (RAM, Random Access Memory).
  • RAM Random Access Memory
  • the memory 460 described in the embodiments of this application is intended to include any suitable type of memory.
  • the memory 460 is capable of storing data to support various operations, examples of which include programs, modules, and data structures, or subsets or supersets thereof, as exemplarily described below.
  • the operating system 461 includes system programs configured to handle various basic system services and perform hardware-related tasks, such as the framework layer, core library layer, driver layer, etc., used to implement various basic services and process hardware-based tasks;
  • Network communications module 462 configured to reach other computing devices via one or more (wired or wireless) network interfaces 430, example network interfaces 430 include: Bluetooth, Wireless Compliance Certified (WiFi), and Universal Serial Bus ( USB, Universal Serial Bus), etc.;
  • Presentation module 463 configured to enable the presentation of information (e.g., a user interface for operating peripheral devices and displaying content and information) via one or more output devices 441 (e.g., display screens, speakers, etc.) associated with user interface 440 );
  • information e.g., a user interface for operating peripheral devices and displaying content and information
  • output devices 441 e.g., display screens, speakers, etc.
  • Input processing module 464 is configured to detect one or more user inputs or interactions from one or more input devices 442 and translate the detected inputs or interactions.
  • the performance recording device in the virtual scene provided by the embodiment of the present application can be implemented in a software manner.
  • Figure 2 shows the performance recording device 465 in the virtual scene stored in the memory 460, which can be a program and
  • Software in the form of plug-ins and other software includes the following software modules: display module 4651, selection module 4652, recording module 4653 and replacement module 4654. These modules are logical, so they can be combined or split arbitrarily according to the functions implemented. The functions of each module are explained below.
  • the performance recording device in the virtual scene provided by the embodiment of the present application can be implemented in hardware.
  • the performance recording device in the virtual scene provided by the embodiment of the present application can be implemented by using a hardware decoding processor.
  • a processor in the form of a hardware decoding processor that is programmed to execute the performance recording method in a virtual scene provided by the embodiments of the present application.
  • a processor in the form of a hardware decoding processor may adopt one or more Application Specific Integrated Circuits (ASICs). Integrated Circuit), DSP, programmable logic device (PLD, Programmable Logic Device), complex programmable logic device (CPLD, Complex Programmable Logic Device), field programmable gate array (FPGA, Field-Programmable Gate Array) or other electronic components .
  • ASICs Application Specific Integrated Circuits
  • DSP digital signal processor
  • PLD programmable logic device
  • CPLD Complex Programmable Logic Device
  • FPGA Field-Programmable Gate Array
  • FIG. 1A is a schematic flowchart of a performance recording method in a virtual scene provided by an embodiment of the present application, which will be described in conjunction with the steps shown in Figure 3.
  • the method shown in Figure 3 can be executed by various forms of computer programs running on the terminal device 400, and is not limited to the above-mentioned client 410. It can also be the operating system 461 and software mentioned above. Modules and scripts, therefore the client should not be regarded as limiting the embodiments of this application.
  • Step 101 The terminal device displays a virtual object equipped with performance costumes and an audio control for selecting background audio.
  • the terminal device can be installed with an application client that supports virtual scenes (such as a game client), or a client that integrates virtual scene functions (such as an instant messaging client, a live broadcast client, an education client, etc.).
  • an application client that supports virtual scenes
  • a client that integrates virtual scene functions such as an instant messaging client, a live broadcast client, an education client, etc.
  • the user can interact with virtual objects based on the virtual scene displayed by the client; for example, when the client is a game client , the user can perform interactions (such as virtual battles) between game characters (virtual objects) in the game scene based on the game screen displayed on the game client.
  • the user can control the virtual object to perform in the virtual scene based on the virtual scene displayed on the client, and record the performance of the virtual object.
  • the user can control the virtual scene based on the virtual scene displayed on the terminal device.
  • the performance recording interface records the performance of the virtual object.
  • the performance recording interface can display the virtual object equipped with performance costumes and audio controls for selecting background audio.
  • assembling or equipping a performance costume for a virtual object in a virtual scene means superimposing the model of the performance costume on the corresponding position of the virtual object model.
  • the user Before starting performance recording, the user can first set the performance costumes equipped by the virtual object when performing performance recording in the virtual scene.
  • the performance clothing equipped by the virtual object may be the clothing or accessories that the virtual object initially equipped (default equipment).
  • the performance clothing may be attached to or detached from the virtual object, for example, it may be the clothing worn by the virtual object (such as a top, jacket, etc.) shoes, etc.), it can also be accessories worn by the virtual object (such as glasses, necklaces, helmets, etc.), or it can be the skin color, hair color, hairstyle style, etc. of the virtual object.
  • the performance costumes assembled by virtual objects can exist as a single costume accessory (such as one of clothes, shoes, and hairstyle), or as a costume set (such as a combination of clothes, shoes, and hairstyle). exist in the form of).
  • Step 102 In response to an audio selection operation triggered based on the audio control, use the selected target audio as background audio for performance recording.
  • the target audio includes at least two playback rhythms, and different playback rhythms are associated with different performance costumes.
  • the playback rhythm of audio refers to the length and strength of the mid-tones in the audio movement. It is often compared to the skeleton of a musician.
  • the playback rhythm of audio also refers to the change and repetition of the sound beat. It has a sense of time.
  • the playback rhythm includes both beat and speed.
  • the former refers to the regular alternating movement of strong and weak music, that is, the combination of beat points, while the latter refers to the speed of this rhythm.
  • the background audio during performance recording is selected through the audio control.
  • the terminal device displays the background audio selection interface in response to the click operation, and displays at least one available song in the background audio selection interface.
  • the user can select a certain audio as the background audio through the background audio selection interface. For example, when the user selects the target audio, the target audio will be used as the background audio for performance recording.
  • the background audio can not only be audio outside the scene (such as the locally stored audio or network stored audio selected above), but also can be in-scene audio, such as in the virtual scene of performance recording.
  • the audio in the scene is part of the performance content being recorded.
  • the virtual object is singing, shouting, etc. in the recorded performance content, or the virtual scene is in addition to the audio emitted by the virtual object.
  • the audio in such virtual scenes will be used as in-scene audio, that is, the audio in the virtual scene will be used as background audio.
  • the terminal device can intelligently determine the performance costumes that match the playback rhythm according to the playback rhythm of the background audio, and automatically change the performance costumes of the virtual object equipment when the playback rhythm of the background audio changes, so that the virtual object equipment can Performance costumes correspond to the rhythm of the background audio playing.
  • the terminal device before performance recording or before using the selected target audio as background audio for performance recording, can establish an association between the playback rhythm included in the target audio and the corresponding performance costumes in the following manner: : In response to the association setting operation for the target audio, display the association setting interface of the target audio; in the association setting interface of the target audio, display at least two performance costumes used to associate the target audio and the rhythm indication information of the target audio, the rhythm indication The information is used to indicate the playback rhythm of the target audio; in response to the performance clothing association operation triggered based on the rhythm indication information, an association relationship between the target performance clothing indicated by the performance clothing association operation and the target playback rhythm is established.
  • the terminal device before using the target audio as background audio, it is necessary to associate the performance costumes with the target audio.
  • the terminal device when the user clicks on the audio related control, the terminal device responds to the click operation, receives a related setting operation for the target audio, and responds to the related setting operation, displays the rhythm indication information of the target audio and at least two set
  • the corresponding performance costumes association operation can be triggered based on the rhythm indication information of the target audio and at least two candidate performance costumes, and then the playback rhythm and performance costumes are established based on the performance costumes correlation operation.
  • the performance costume association operation instructs to associate playback rhythm 1 with performance costume 1, that is, establish an association between playback rhythm 1 and performance costume 1.
  • the terminal device may perform rhythm point detection on the target audio to obtain at least two rhythm points included in the target audio; and based on each rhythm point, generate the rhythm indication information of the target audio.
  • the rhythm point of the audio is also the beat and drumbeat of the audio.
  • the beat refers to the combination law of strong beat and weak beat, and refers to the total length of the notes in each section of the score.
  • the terminal device After the terminal device obtains the target audio, it performs rhythm point detection on the target audio to obtain multiple rhythm points included in the target audio. For example, it samples the target audio based on the sampling window to obtain audio data corresponding to multiple sampling windows.
  • Corresponding audio data determine the energy spectrum corresponding to each sampling window, determine multiple rhythm points of the target audio based on the energy spectrum corresponding to each sampling window, and then generate corresponding rhythm indication information based on each rhythm point, such as the rhythm point corresponding to rhythm point 1
  • the rhythm indication information indicates that the rhythm is stronger
  • the rhythm indication information corresponding to rhythm point 2 indicates that the rhythm is weaker, and so on.
  • the terminal device When the terminal device detects rhythm points, it can detect rhythm points of audio data based on signal processing. In practical applications, general music samples 44,100 times per second, and there will be 44,100 samples in one second. If 1,024 samples are taken as one Window, there are about 44 windows in one second, so a 3-minute audio data will have about 7920 windows. According to the energy spectrum of the sampling window, it is judged whether the sampling window is a rhythm point; when performing rhythm detection During the process, the density of the rhythm can also be adjusted by limiting the threshold, so that stronger rhythms can be detected and weaker rhythms can be ignored.
  • the terminal device can determine the rhythm point in the following ways: perform Fourier transform on the audio data corresponding to each sampling window to obtain the audio spectrum corresponding to each sampling window; determine adjacent samples in the audio data of the target video The degree of difference of the audio spectrum corresponding to the window; based on the degree of difference, determine the energy spectrum corresponding to each sampling window; obtain the energy spectrum corresponding to the preset number of sampling windows from multiple sampling windows; corresponding to the preset number of sampling windows The energy spectrum is weighted and averaged to obtain the corresponding energy spectrum mean; the energy spectrum mean is multiplied by a proportional coefficient to obtain the corresponding energy spectrum threshold; the sampling window corresponding to the energy spectrum greater than the energy spectrum threshold is determined as the rhythm point.
  • audio data is a messy waveform signal in the time domain.
  • the audio data in the time domain can be converted to the frequency domain through fast Fourier transform to obtain the audio spectrum corresponding to the audio data, and then based on The obtained audio spectrum calculates the degree of difference between the audio spectra corresponding to adjacent sampling windows, and then determines the energy spectrum corresponding to each sampling window based on the obtained multiple degrees of difference. For example, subtract the audio spectrum corresponding to the current sampling window from the previous The degree of difference obtained from the audio spectrum corresponding to an adjacent sampling window is determined as the energy spectrum corresponding to the current sampling window.
  • the terminal device may determine the performance costume for correlating the target audio in the following manner: display the performance costume for correlating the virtual A performance costume setting interface for setting performance costumes of the object equipment; in the performance costume setting interface, at least two candidate performance costumes for selection are displayed; in response to the selection of a target number of candidate performance costumes among the at least two candidate performance costumes Operations to determine a target number of candidate performance costumes as performance costumes for association with the target audio.
  • the user can enter the performance costume setting interface through the terminal device, and select performance costumes based on the performance costume setting interface.
  • the performance costume setting interface can provide the user with multiple candidate performance costumes for the user to choose.
  • a certain number of candidate performance costumes can be selected to associate with the target audio as needed.
  • there may be a quantitative threshold for the number of candidate performance costumes selected by the user that is, there is a maximum value of candidate performance costumes that the user can associate, such as 10 , the user can select any number within the maximum value during actual selection, but cannot exceed the maximum value.
  • Figure 4 is a schematic diagram of determining performance costumes provided by an embodiment of the present application.
  • the terminal device displays a costume control 401 for setting the performance costumes of the virtual object equipment in the performance recording interface.
  • the terminal device responds to the costume control
  • the triggering operation of 401 displays the performance costume setting interface 402, and displays multiple candidate performance costumes in the performance costume setting interface 402, such as candidate performance costumes 1 to candidate performance costumes 5, in response to the selection operation of the target number of candidate performance costumes.
  • candidate performance costumes 2 to candidate performance costumes 4 are determined as performance costumes used to associate the target audio.
  • the terminal device may determine the performance costume for correlating the target audio in the following manner: display the performance costume for correlating the virtual A performance costume setting interface for setting performance costumes of the object equipment; when the performance costume is displayed in the form of a performance costume set, at least two types of costume accessories for selection are displayed in the performance costume setting interface; in response to at least two types of costumes The selection operation of the clothing accessories of the target type among the accessories is to combine the clothing accessories of the selected target type; and determine the combined performance clothing set as the performance clothing used to associate the target audio.
  • the performance clothing is displayed in the form of a performance clothing set
  • at least two types of clothing accessories are displayed in the performance clothing setting interface, such as clothing accessories, shoe clothing accessories, and socks clothing accessories.
  • hair style clothing accessories, etc. you can select the target type of clothing accessories and combine them to get multiple performance clothing sets, such as selecting clothing accessories, shoe type clothing accessories and combining them to get a performance clothing set 1.
  • Select a combination of shoe-type clothing accessories, socks-type clothing accessories, and hairstyle-type clothing accessories to obtain a performance clothing set 2 and determine the combined performance clothing set 1 and performance clothing set 2 as performance clothing used to associate the target audio.
  • the terminal device may determine the performance costume for correlating the target audio in the following manner: display the performance costume for correlating the virtual The performance costume setting interface for setting the performance costumes of the object equipment; when the performance costumes are displayed in the form of performance costume sets, in the performance costume setting interface, at least two accessory controls corresponding to the performance costume set are displayed, and different accessory controls correspond to different type of clothing accessories; for the type corresponding to each of the accessory controls, in response to the triggering operation of the accessory control, display at least one candidate clothing accessory of the corresponding type; in response to the selection operation of the target accessory in at least one candidate accessory, the The target accessory is determined to be the accessory selected for the type; the accessories selected corresponding to each accessory control are combined to obtain the corresponding performance costume set, and the obtained performance costume set is determined to be the performance costume used to associate the target audio wait.
  • each performance costume set includes 4 costume accessories (corresponding to hairstyle, clothes, socks and shoes ), when setting the performance costume set 1, when the user clicks the hairstyle control, the terminal responds to the click operation and displays multiple hairstyles to choose from, such as hairstyle 1, hairstyle 2, and hairstyle 3.
  • the terminal When the user selects hairstyle 3
  • the terminal displays multiple clothes for selection, such as clothes 1, clothes 2, clothes 3, clothes 4.
  • clothes 2 When the user selects clothes 2, clothes 2 will be used as the clothing accessories in the performance clothing set 1; and so on, assuming that socks 2 are selected as the socks accessories in the performance clothing set 1, and performance clothing shoes 1 are selected as the accessories in the performance clothing set 1.
  • the performance costume suits 2,..., and performance costume suits N can be obtained by matching them (N>2, which can be set according to the actual application).
  • the obtained performance costume suits 1,..., and suit N can be used as a pair in the virtual scene.
  • Performance costumes equipped by virtual objects for performance recording When the user clicks on the clothes control, the terminal displays multiple clothes for selection, such as clothes 1, clothes 2, clothes 3, clothes 4.
  • clothes 2 When the user selects clothes 2, clothes 2 will be used as the clothing accessories in the performance clothing set 1; and so on, assuming that socks 2 are selected
  • the number of costume accessories included in different performance costume sets may be different.
  • the number of costume accessories corresponding to performance costume suit 1 is 3 (corresponding to Hair style, clothes, socks), performance clothing set 2 corresponds to 4 clothing accessories (corresponding to hairstyle, clothes, socks and shoes).
  • the types of clothing accessories included in performance clothing set 1 and performance clothing set 2 can be different.
  • the types of accessories included in the clothing accessories may be different.
  • the clothing accessories corresponding to performance clothing set 1 are 4 (corresponding to hairstyle, clothes, socks and glasses), and the number of clothing accessories corresponding to performance costume set 2 is 4 (corresponding to hairstyle, clothes, socks and shoes).
  • the costume accessories included in performance costume suit 1 and performance costume suit 2 The types may not be exactly the same; in other embodiments, if a certain accessory control is not clicked, the accessory indicated by the accessory control is set to empty by default. For example, when setting the performance costume set 1, If the user does not click on the hairstyle accessory, the default is that the hairstyle in the performance costume set 1 has not been set. At this time, the obtained hairstyle in the performance costume set 1 can be the default hairstyle of the virtual object.
  • the terminal device can display the rhythm indication information of the target audio in the following manner: the terminal device displays the playback timeline of the target audio, and the playback timeline is used to indicate the current playback time, total playback duration, etc. of the target audio; Display at least two rhythm point slots corresponding to the playback rhythm of the target audio in the playback timeline, and use the rhythm point slots as rhythm indication information; wherein the rhythm point slots are used to carry performance costumes to be associated; correspondingly , when the performance clothing association operation is a drag operation for the target performance clothing, the terminal device responds to the performance clothing association operation triggered based on the rhythm indication information, and can establish the target performance clothing and the target indicated by the performance clothing association operation in the following manner Association of playback rhythm: in response to the drag operation, when the target performance costume is dragged to the target rhythm point slot, the playback rhythm corresponding to the target rhythm point slot is determined as the target playback rhythm, and the target is established The relationship between the performance costumes and the target playback rhythm corresponding to the target rhythm point slot.
  • rhythm point slots corresponding to the playback rhythm of the target audio are displayed (used to carry the performance costumes to be associated, and the rhythm point slots are located at At the location of the beat, drum beat or rhythm point of the target audio, the playback rhythm corresponding to this position will change, that is, this position is the position where the performance costumes are changed); at the same time, in the association setting interface of the target audio, the set pair is displayed.
  • Performance costumes equipped by virtual objects in the game when recording performances such as performance costume suit 1, performance costume suit 2, performance costume suit 3 and performance costume suit 4; when the user drags the target performance costume to the target rhythm point slot , the terminal device responds to the drag operation and establishes an association between the target performance costume and the target playback rhythm corresponding to the target rhythm point slot.
  • the terminal device responds to the drag operation and establishes an association between the target performance costume and the target playback rhythm corresponding to the target rhythm point slot.
  • the terminal device responds to the drag operation and establishes an association between the target performance costume and the target playback rhythm corresponding to the target rhythm point slot.
  • the terminal device responds to the drag operation and establishes an association between the target performance costume and the target playback rhythm corresponding to the target rhythm point slot.
  • the terminal device responds to the drag operation and establishes an association between the target performance costume and the target playback rhythm corresponding to the target rhythm point slot.
  • the terminal device responds to the drag operation and establishes an association between the target performance costume
  • the terminal device may display at least two performance costumes associated with the target audio and the rhythm indication information of the target audio in the following manner: the terminal device has at least two change moments, and the change moments are the playback rhythm of the target audio.
  • the rhythm indication information is displayed in the associated area of each change moment; in response to a selection operation for the target rhythm indication information corresponding to the target change moment in the at least two change moments, at least one performance corresponding to the target rhythm indication information is displayed Costume options, where each performance costume option corresponds to one performance costume;
  • the terminal device in response to the performance costume association operation triggered based on the rhythm indication information, can establish an association between the target performance costume indicated by the performance costume association operation and the target playback rhythm in the following manner: the terminal device responds to the performance costume association operation for at least two performances.
  • the selection operation of the target performance costume option in the costume options controls the target performance costume corresponding to the target performance costume option to be in the selected state; in response to the determination operation for the target performance costume, the performance costume association operation is received, that is, the target performance costume is selected
  • the determination operation is determined as a performance costume association operation; in response to the performance costume association operation, an association relationship between the target performance costume and the target playback rhythm corresponding to the target change moment is established.
  • FIG 5 is a schematic diagram of the association setting of the background audio provided by the embodiment of the present application.
  • the association setting interface of the target audio displays three change moments used to indicate changes in the playback rhythm of the target audio, such as the 10th second, The 40th second and the 70th second, and the rhythm indication information 501 of "strong” is displayed in the correlation area at the 10th second, the rhythm indication information 502 of "weak” is displayed in the correlation area at the 40th second, and the rhythm indication information 502 of "weak” is displayed in the correlation area at the 70th second.
  • the rhythm indication information 503 of "Medium” is displayed in the associated area of seconds.
  • the terminal device responds to the triggering operation for the playing indication information 501 and displays the corresponding "Strong" "At least one performance costume option of this rhythm indication information, each performance costume option corresponds to a performance costume, for example, performance costume option 1 corresponds to performance costume set 1, performance costume option 2 corresponds to performance costume set 2, when the user selects the performance costume option At 1, establish an association between the performance costume set 1 and the playback rhythm (strong) corresponding to the 10th second in the target audio.
  • the equipment of the target virtual object is replaced with the performance Costume set 1; through the above method, the association between the playback rhythm (weak) corresponding to the 40th second in the target audio and the selected performance costume (such as performance costume set 3), and the playback corresponding to the 70th second can also be established The relationship between the rhythm (weak and medium) and the selected performance costumes (such as performance costume set 2).
  • the target audio can be used as the background audio to be applied to the virtual objects in the game. The performance is being recorded.
  • the terminal device may display the rhythm indication information of the target audio in the following manner: in response to a selection operation for the target performance costume among the at least two performance costumes, display at least one playback rhythm option corresponding to the target performance costume, and Each playback rhythm option serves as the rhythm indication information; accordingly, in response to the performance costume association operation triggered based on the rhythm indication information, the terminal device can establish the association between the target performance costume indicated by the performance costume association operation and the target playback rhythm in the following manner: In response to the selection operation of the target playback rhythm option in at least one playback rhythm option, the terminal device controls the target playback rhythm corresponding to the target playback rhythm option to be in the selected state; in response to the determination operation of the target playback rhythm, receiving the performance clothing association operation, That is, the determination operation for the target playback rhythm is determined as a performance costume association operation; in response to the performance costume association operation, an association relationship between the target performance costume and the target playback rhythm is established.
  • At least two performance costumes for correlating the target audio are displayed in the target audio association setting interface, such as performance costume suit 1, performance costume suit 2, and performance costume suit 4.
  • the target performance costume such as performance costume suit 2
  • display at least one playback rhythm option that matches the target performance costume and use each playback rhythm option as rhythm indication information.
  • playback rhythm option 1 indicates that the corresponding playback rhythm is stronger
  • playback rhythm option 2 indicates that the corresponding playback rhythm is stronger
  • the playback rhythm is moderate
  • the playback rhythm option 3 indicates that the corresponding playback rhythm is weak.
  • the performance costume set 2 and the stronger playback rhythm in the target audio can be created (the corresponding playback time is known, such as Corresponding to the 10th second of the target audio, that is, when the target audio is played as the background audio to the 10th second, the association between the equipment of the target virtual object and the performance costume set 2) is replaced; through the above method, other performance costumes can be created The association relationship with the matching playback rhythm in the target audio. After the association setting of the target audio is completed, the target audio can be used as background audio in the performance recording of virtual objects in the game.
  • the terminal device may display at least two performance costumes for associating the target audio and the rhythm indication information of the target audio in the following manner: display at least two playback rhythms included in the target audio, and assign the at least two playback rhythms to As the rhythm indication information; in response to the selection operation for the target playback rhythm in the at least two playback rhythms, display recommendation information, the recommendation information is used to recommend settings for performance costumes associated with the target playback rhythm, wherein the recommendation information includes recommended Target performance clothing; accordingly, in response to the performance clothing association operation triggered based on the rhythm indication information, the terminal device can establish an association between the target performance clothing indicated by the performance clothing association operation and the target playback rhythm in the following manner: in response to the recommendation information The determination operation of the performance clothing association operation is received, that is, the determination operation for the recommended information is determined as the performance clothing association operation; in response to the performance clothing association operation, an association relationship between the target performance clothing and the target playback rhythm is established.
  • At least two playback rhythms included in the target audio are displayed in the association setting interface of the target audio, and the at least two playback rhythms are used as rhythm indication information, such as playback rhythm 1 (the corresponding playback time is known, such as the corresponding playback time of the target audio).
  • the 10th second indicates a strong playback rhythm
  • playback rhythm 2 (the corresponding playback time is known, such as the 40th second corresponding to the target audio) indicates a moderate playback rhythm
  • playback rhythm 3 (the corresponding playback time is known, such as the corresponding target audio 70 seconds) indicates that the playback rhythm is weak.
  • the recommended information including the recommended target performance clothing (such as performance clothing set 2) is displayed, such as "It is recommended to choose performance clothing set 2", where the target performance costume is based on the performance costume equipped when performing performance recording of the virtual object in the virtual scene (such as the above-mentioned performance costume suit 1,..., performance costume suit N) and the target playback rhythm (such as playback rhythm 1), select the performance clothing whose fitness degree exceeds the fitness threshold (such as performance clothing set 2) as the target performance clothing included in the recommendation information.
  • a confirm button and a change button corresponding to the recommended information can also be presented.
  • the terminal device can receive the confirm operation of the recommended information, that is, receive the performance costume An association operation is performed, and in response to the performance apparel association operation, an association relationship is established between the target playback rhythm (eg, playback rhythm 1) and the target performance apparel (eg, performance apparel set 2) included in the recommendation information.
  • the terminal device responds to the trigger operation by updating and displaying a new recommendation information, in which the target performance clothing in the new recommendation information is different from the target performance clothing (such as performance clothing set 3) of the original recommendation information.
  • the target performance costumes in the new recommendation information can be used as the performance costumes associated with the target playback rhythm.
  • the corresponding change button can still be triggered to select a new target performance. Clothes until satisfied.
  • the association between other playback rhythms in the target audio and the matching performance costumes can be created.
  • the target audio can be applied as background audio to virtual objects in the game. 's performance is being recorded.
  • the association between the playback rhythm included in the target audio and the corresponding performance costumes can also be established in the following manner: the terminal device Perform rhythm recognition on the audio to obtain at least two playback rhythms corresponding to the target audio; obtain at least two performance costumes used to associate background audio settings, and match each performance costume with each playback rhythm to obtain the corresponding matching degree; Obtain at least two clothing rhythm pairs whose matching degree reaches the matching degree threshold, wherein the clothing rhythm pair includes a performance clothing and a playback rhythm; establish an association between the performance clothing and the playback rhythm in each clothing rhythm pair; wherein, the matching degree threshold
  • the size can be set according to actual needs, such as 0.8.
  • the terminal device can match each performance costume with each playback rhythm in the following manner: the terminal device obtains the style of each performance costume and the style of each playback rhythm, and compares the style of each performance costume with the style of each playback rhythm.
  • the styles are matched, and the matching results are used as the matching results of performance costumes and playback rhythm.
  • the style can include: gentle, cheerful, melancholy, relaxed, quiet, sad, etc.
  • the terminal device when the target audio is associated with performance clothing, after the terminal device obtains the selected target audio, it automatically performs rhythm recognition on the target audio, obtains at least two playback rhythms corresponding to the target audio, and compares each playback rhythm with
  • the user has set up matching performance costumes (such as performance costume suit 1,..., performance costume suit 4) equipped when performing performance recording of virtual objects in the virtual scene, that is, matching each playback rhythm with each performance costume in pairs , get multiple clothing rhythm pairs, such as clothing rhythm pair 1 (playing rhythm 1, performance clothing suit 1), clothing rhythm pair 2 (playing rhythm 1, performance clothing suit 2),..., clothing rhythm pair 12 (playing rhythm 3, performance clothing suit 2) Performance clothing set 4), and obtain the matching degree of each clothing rhythm pair.
  • matching performance costumes such as performance costume suit 1,..., performance costume suit 4
  • the clothing rhythm pair with the largest matching degree is clothing rhythm pair 2 (playback rhythm 1, performance Costume Suit 2)
  • the clothing rhythm pair with the greatest matching degree is clothing rhythm pair 2 (playback rhythm 1, performance Costume Suit 2)
  • the association between the playback rhythm 1 and the performance costume suit 2 that is, when recording the background audio for the performance with the target audio, when the target audio is played to the 10th second, the performance of the virtual object equipment
  • the costumes are automatically replaced with performance costumes 2; through the above method, the association between other playback rhythms in the target audio and the matching performance costumes can be created.
  • the target can be The audio is used as background audio in the performance recording of virtual objects in the game.
  • the terminal device after the terminal device obtains the selected target audio, it can also combine the target audio with the performance costumes (such as the above-mentioned performance costumes) that the user has set to equip when recording performances of virtual objects in the virtual scene.
  • the performance costumes such as the above-mentioned performance costumes
  • Suit 1,..., performance costume suit N are input into the machine learning model, and the performance costume correlation setting is performed on the target audio through the machine learning model based on the artificial intelligence algorithm, which can make the correlation setting results more intelligent and accurate, and can improve the performance of the target audio.
  • the efficiency of clothing association setting is improved, thereby improving the efficiency of changing performance costumes.
  • Step 103 During the process of recording the performance of the virtual object, play the background audio, and display the performance actions performed by the virtual object following the background audio.
  • the background audio is played, and the performance actions performed by the virtual objects following the background audio are displayed, where the performance actions may include at least one action.
  • Each action in at least one action is continuous.
  • one action can be executed continuously and repeatedly, or an action sequence composed of multiple actions can be executed.
  • the multiple actions included in the action sequence are continuous.
  • the performance movements may be dance movements (including a plurality of consecutive dance movements), martial arts movements (including a plurality of consecutive martial arts movements), gymnastics movements (including a plurality of consecutive gymnastics movements), and the like.
  • Step 104 When the playback rhythm of the background audio changes, automatically change the performance costumes assembled by the virtual object so that the performance costumes of the virtual object correspond to the playback rhythm of the background audio.
  • the terminal device before the playback rhythm of the background audio changes, can display the performance actions performed by the virtual object following the background audio in the following manner: display the performance actions performed by the virtual object equipped with the first performance costume following the background audio. Performance action; correspondingly, when the playback rhythm of the background audio changes, the terminal can automatically change the performance costumes assembled by the virtual object in the following ways: obtain the second performance costumes associated with the playback rhythm of the background audio after the playback rhythm changes; automatically change the performance costumes The performance costume equipped by the virtual object is switched from the first performance costume to the second performance costume, and the performance action performed by the virtual object equipped with the second performance costume following the background audio is displayed.
  • the terminal can also implement the following method to automatically change the performance costumes assembled by the virtual object when the playback rhythm of the background audio changes: during the process of playing the background audio, display the playback timeline of the background audio, and At the change moment when the playback rhythm changes in the playback timeline, the target performance costume associated with the changed playback rhythm is displayed; when the background audio is played to the change moment, the performance costume assembled by the virtual object is automatically replaced with the target performance costume, and Display the performance actions performed by the virtual object equipped with the target performance costume following the background audio until the background audio plays to the next change moment.
  • FIG 6 is a schematic display diagram of a performance recording provided by an embodiment of the present application.
  • the target performance costume associated with the changed playback rhythm is displayed, such as The associated performance costume set 1 is displayed at the playback rhythm 1 (strong), the associated performance costume set 2 is displayed at the playback rhythm 2 (medium), the associated performance costume set 3 is displayed at the playback rhythm 3 (weak), and the associated performance costume set 3 is displayed at the playback rhythm 2 (medium).
  • the clothing of the virtual object equipment is the default suit.
  • the clothing of the virtual object equipment is automatically changed from the default suit to the performance costume suit 1. And display the performance actions performed by the virtual object equipped with the performance costume suit 1 following the background audio until the playback rhythm 2 is played; when the background audio is played to the playback rhythm 2, the costumes equipped by the virtual object are automatically changed from the performance costume suit 1 is replaced with the performance costume suit 2, and the virtual object equipped with the performance costume suit 2 is shown to follow the performance actions performed by the background audio until it reaches playback rhythm 3; and so on, it is realized that during the process of playing the background audio, the automatic Control the virtual object to click on the background audio timing at the corresponding beat, and automatically change to the performance costume corresponding to the playback rhythm of the background audio, achieving the effect of switching equipment instantly.
  • the terminal device when the terminal device automatically changes the performance costumes assembled by the virtual object, it can also determine a picture scaling ratio that is adapted to the playback rhythm of the background audio.
  • the picture scaling ratio is, for the performance picture recorded by the virtual object.
  • the zoom ratio as the playback rhythm of the background audio changes, the recorded performance picture is displayed according to the determined picture zoom ratio, so that the picture zoom ratio of the performance picture corresponds to the playback rhythm.
  • the rhythm indication information of the background audio is displayed in the performance recording interface, such as the waveform diagram of the background audio selected by the user to inform the approximate rhythm curve of the background audio.
  • the performance screen The scaling ratio is 1.0, that is, no screen scaling will be performed; when the user clicks to record, the background audio will automatically start to play, and the performance screen will be enlarged or reduced in real time according to the ups and downs of the waveform indicated by the rhythm indication information; when When the rhythm indication information indicates that the playback rhythm of the background audio is relatively fast (for example, the waveform of the background audio will reach a peak), it indicates that the background audio has entered the climax stage.
  • the zoom ratio of the performance screen reaches the maximum to match the current playback rhythm of the background audio;
  • the rhythm indication information indicates that the playback rhythm of the background audio is slow, the waveform of the background audio is relatively slow, and the zoom ratio of the performance screen will gradually shrink until it is zoomed to the default 1.0 times; in this way, by zooming in on the performance recording screen Zoom adjustment, between two different playback rhythms, even if the virtual object is equipped with the same set of performance costumes, there will be different display effects, enriching the display style.
  • the scene data related to the virtual scene in the embodiment of the present application is essentially the relevant data of the user.
  • the user's permission or consent needs to be obtained, and the relevant data Collection, use and processing need to comply with relevant laws, regulations and standards of relevant countries and regions.
  • Figure 7 is a schematic diagram of performance recording provided by an embodiment of the present application.
  • the player before recording the performance of the game, the player can first perform performance clothing (such as hairstyle, clothes, pants, backpack, Helmet), for example, click on the warehouse to select clothing accessories and match the clothing accessories; after saving the matching, the matching can be saved by saving the latest matching performance clothing to the corresponding slot; then, during the performance recording process, Select the matching performance costumes on the birth island (such as clicking the corresponding performance costume set button), and you can switch between the performance costumes in the game; however, this method requires the player to manually change the performance costumes of the equipment, and the replacement efficiency is very low. lower.
  • performance clothing such as hairstyle, clothes, pants, backpack, Helmet
  • the matching can be saved by saving the latest matching performance clothing to the corresponding slot
  • Select the matching performance costumes on the birth island such as clicking the corresponding performance costume set button
  • embodiments of the present application provide a performance recording method in a virtual scene to improve the efficiency of changing performance costumes.
  • the performance costumes equipped by the virtual object player
  • the performance costumes are displayed in the form of a performance costume suit for explanation.
  • Figure 8 is a schematic diagram of the setting of performance costumes provided by the embodiment of the present application. After the virtual object enters the game dance room, when the user clicks the costume button 501, the terminal device displays the performance costume setting interface in response to the click operation. The user can set several performance costume sets through the performance costume setting interface.
  • the user can match the costume accessories (such as hairstyle, clothes, shoes, socks, accessories, etc.) in the first performance costume set through the performance costume setting interface.
  • the setting of the first performance costume set can be completed; after that, by clicking the switch button, the subsequent second performance costume set, ...., and the Nth (N>2, can be set according to the actual application) performance set Clothing set to set.
  • FIG. 9 is a schematic diagram of the setting of performance costumes provided by the embodiment of the present application.
  • Performance costume sets to be set such as suit 1, suit 2, suit 3 and suit 4.
  • Each performance costume suit includes 4 costume accessories, that is, 4 accessory controls corresponding to each performance costume suit.
  • different accessory controls Corresponds to different types of clothing accessories, such as hairstyle controls corresponding to hairstyle accessories, and clothing controls corresponding to clothing accessories; when setting each performance clothing set, perform the following operations for the 4 accessory controls associated with each performance clothing set: Response In response to a triggering operation on the accessory control, at least one candidate clothing accessory of the corresponding type is displayed; in response to a selection operation on the target accessory in the at least one candidate accessory, the target accessory is determined as the accessory selected corresponding to the accessory control; and the corresponding accessory control is Combine the selected accessories to get the corresponding performance costume set.
  • the terminal when setting Suit 1, when the user clicks the hairstyle control, the terminal responds to the click operation and displays multiple hairstyles to choose from, such as hairstyle 1, hairstyle 2, and hairstyle 3. When the user selects hairstyle 3, Then use hairstyle 3 as the hairstyle accessory in suit 1; when the user clicks the clothes control, the terminal responds to the click operation and displays multiple clothes for selection, such as clothes 1, clothes 2, clothes 3, and clothes 4.
  • clothes 2 When selecting clothes 2, clothes 2 will be used as the clothes accessories in suit 1; and so on, assuming that socks 2 are selected as the socks accessories in suit 1, and shoes 1 are selected as the shoe accessories in suit 1; finally, hairstyle 3, clothes 2. Combine socks 2 and shoes 1 to get suit 1. In this way, Suit 2, Suit 3 and Suit 4 can be obtained by matching, and finally the obtained Suit 1, Suit 2, Suit 3 and Suit 4 will be used as performance costumes to be equipped when recording performances of virtual objects in the game.
  • the accessory indicated by the accessory control will be set to empty by default.
  • the default is that the hairstyle in suit 1 is not set.
  • the obtained hairstyle in suit 1 can be the default hairstyle of the virtual object.
  • FIG. 10 is a schematic diagram of the association setting of background audio provided by an embodiment of the present application.
  • the terminal device responds to the click operation and displays the background audio selection interface.
  • the background audio selection interface displays multiple audios to choose from. The user can select The audio selection interface selects a certain audio as the background audio. If the user selects the target audio, the target audio will be used as the background audio for performance recording.
  • the association settings of the performance costumes for the target audio will be explained.
  • the terminal device When the user clicks the change button (the above-mentioned audio correlation control), the terminal device responds to the click operation and receives the correlation setting operation for the target audio. In response to the correlation setting operation, it performs rhythm point detection on the target audio to obtain the target audio.
  • the audio includes multiple rhythm points, and at least two rhythm point slots corresponding to the playback rhythm of the target audio are displayed in the playback timeline in the association settings interface of the target audio (used to carry the performance costumes to be associated, the The position of the slot is the location of the beat, drum beat or rhythm point of the target audio.
  • the playback rhythm corresponding to this position will change, that is, this position is the position where the performance costumes are changed); at the same time, in the association setting interface of the target audio, it is displayed
  • the performance costumes that have been set for recording performances of virtual objects in the game, such as Suit 1, Suit 2, Suit 3 and Suit 4 obtained by the above combination; when the user drags the target performance costume to the target rhythm point slot
  • the terminal device responds to the drag operation, it establishes an association between the target performance costume and the target playback rhythm corresponding to the target rhythm point slot. For example, when the user drags suit 1 to the slot where beat 1 is located, suit 1 and The relationship between beat 1.
  • the association between the playback rhythm corresponding to each rhythm point slot and the corresponding performance costume can be established.
  • the target audio can be used as background audio in the game.
  • the virtual object's performance is being recorded.
  • the target audio When returning to the main interface to start performance recording, if the target audio is selected as the background audio for performance recording, the background audio will be played, and the performance actions performed by the virtual object following the background audio will be displayed.
  • the playback rhythm of the background audio changes, it will automatically Change the performance costumes assembled by the virtual object so that the performance costumes of the virtual object correspond to the playback rhythm of the background audio; for example, during the playback of the target audio, the playback timeline of the background audio is displayed, and the playback rhythm occurs in the playback timeline
  • the target performance costume associated with the changed playback rhythm is displayed; when the background audio is played to the change moment, the performance costume assembled by the virtual object is automatically replaced with the target performance costume, and the performance costume equipped with the target performance costume is displayed.
  • the virtual object follows the performance action performed by the background audio until the background audio plays to the next change moment.
  • FIG 11 is a schematic display diagram of a performance recording provided by an embodiment of the present application.
  • the target performance costume associated with the changed playback rhythm is displayed at the change moment when the playback rhythm changes in the playback timeline of the background audio, as in
  • the associated package 1 is displayed at beat 1
  • the associated package 2 is displayed at beat 2
  • the associated package 3 is displayed at beat 3
  • the associated package 4 is displayed at beat 4, and the time between the background audio playing and beat 1
  • the clothing equipped by the virtual object is the default suit.
  • the clothing equipped by the virtual object is automatically changed from the default suit to suit 1, and the execution of the virtual object equipped with suit 1 following the background audio is displayed.
  • the performance action is played until beat 2 is played; when the background audio is played to beat 2, the clothing equipped by the virtual object is automatically changed from suit 1 to suit 2, and the virtual object equipped with suit 2 is displayed following the background audio. performance action until the playback reaches beat 3; and by analogy, during the process of playing the background audio, the virtual object is automatically controlled to click on the background audio sequence at the corresponding beat, and is automatically changed to a performance corresponding to the playback rhythm of the background audio. Clothing, achieving the effect of switching equipment instantly.
  • the background audio recorded by the selected performance since the background audio recorded by the selected performance includes a variety of playback rhythms, and different playback rhythms are associated with different performance costumes, the background audio recorded by the performance changes as the background audio changes.
  • the change of playback rhythm automatically changes the performance costumes equipped by the virtual object so that the performance costumes of the virtual object correspond to the playback rhythm of the background audio.
  • the performance costumes equipped by the virtual object follow the playback rhythm of the background audio.
  • the performance costumes of the virtual object equipment change according to the changes, so that the performance costumes of the virtual object equipment and the playback rhythm of the background audio can echo well, improving the adaptability between each other; and this method of changing performance costumes is compared with manual switching. As far as performance costumes are concerned, the replacement efficiency of performance costumes is greatly improved.
  • a display module 4651 configured to display a virtual object equipped with performance clothing and an audio control configured to select background audio;
  • a selection module 4652 configured to use the selected target audio as background audio for performance recording in response to an audio selection operation triggered based on the audio control;
  • the target audio includes at least two playback rhythms, and different playback rhythms are associated with different performance costumes;
  • the recording module 4653 is configured to play the background audio during the performance recording of the virtual object, and display the performance actions performed by the virtual object following the background audio;
  • the replacement module 4654 is configured to automatically replace the performance costumes assembled by the virtual object when the playback rhythm of the background audio changes, wherein the performance costumes of the virtual object correspond to the playback rhythm of the background audio.
  • the apparatus further includes: an association establishment module configured to display the target audio in response to an association setting operation for the target audio before using the selected target audio as background audio for performance recording.
  • the association setting interface of the target audio in the association setting interface of the target audio, display at least two performance costumes used to associate the target audio, and display the rhythm indication information of the target audio, the rhythm indication information is used to indicate The playback rhythm of the target audio; in response to the performance clothing association operation triggered based on the rhythm indication information, establish an association between the target performance clothing indicated by the performance clothing association operation and the target playback rhythm.
  • the device further includes: a first costume determination module configured to display a performance costume setting interface before displaying at least two performance costumes used to associate the target audio, and the performance costume setting interface is used to For setting the performance costumes of the virtual object equipment; in the performance costume setting interface, display at least two candidate performance costumes for selection; in response to the target number of the at least two candidate performance costumes.
  • the selection operation of candidate performance costumes determines the target number of candidate performance costumes as performance costumes used to associate with the target audio.
  • the apparatus further includes: a second costume determination module configured to display a performance costume for performing the performance costume of the virtual object equipment before displaying at least two performance costumes for correlating the target audio.
  • the performance clothing setting interface is set; when the performance clothing is displayed in the form of a performance clothing set, at least two types of clothing accessories for selection are displayed in the performance clothing setting interface; in response to the at least two types of clothing accessories
  • the selection operation of the clothing accessories of the target type among the accessories is to combine the clothing accessories of the selected target type; and determine the combined performance clothing set as the performance clothing used to associate the target audio.
  • the apparatus further includes: a third costume determination module configured to display a performance costume for performing the performance costume of the virtual object equipment before displaying at least two performance costumes for correlating the target audio.
  • the set performance costume setting interface when the performance costume is displayed in the form of a performance costume set, in the performance costume setting interface, at least two accessory controls corresponding to the performance costume set are displayed, and different accessory controls correspond to different type of clothing accessories; for the type corresponding to each of the accessory controls, in response to the triggering operation of the accessory control, display at least one candidate clothing accessory of the corresponding type; in response to the target accessory in the at least one candidate accessory
  • the selection operation determines the target accessory as the accessory selected for the type; combines the accessories selected for each of the types to obtain a corresponding performance costume set, and determines the performance costume set as the one for Performance costumes associated with the target audio player.
  • the association establishment module is further configured to display a playback timeline of the target audio, and display at least two rhythm point slots corresponding to the playback rhythm of the target audio in the playback timeline. position, and use the rhythm point slot as the rhythm indication information; wherein the rhythm point slot is used to carry the performance costume to be associated; receive a drag for the target performance costume among the at least two performance costumes.
  • the drag operation indicates dragging the target performance costume to the target rhythm point slot
  • the drag operation is determined as the performance costume associated operation; in response to the performance costume associated operation, Establish an association between the target performance costume and the target playback rhythm corresponding to the target rhythm point slot.
  • the association establishment module is further configured to display at least two change moments, which are the moments when the playback rhythm of the target audio changes, and in the associated area of each of the change moments. , display the rhythm indication information corresponding to the change moment; in response to a selection operation for the target rhythm indication information corresponding to the target change moment in the at least two change moments, display at least one performance costume option corresponding to the target rhythm indication information , wherein each of the performance costume options corresponds to one performance costume; in response to a selection operation for a target performance costume option in the at least one performance costume option, controlling the target performance costume corresponding to the target performance costume option to be in a selected state; In response to the determination operation for the target performance costume, the performance costume association operation is received; in response to the performance costume association operation, an association relationship between the target performance costume and the target playback rhythm corresponding to the target change moment is established. .
  • the association establishment module is further configured to, in response to a selection operation for a target performance costume among the at least two performance costumes, display at least one playback rhythm option corresponding to the target performance costume, and assign each of the playback rhythm options to the target performance costume.
  • the playback rhythm option is used as the rhythm indication information; in response to the selection operation for the target playback rhythm option in the at least one playback rhythm option, the target playback rhythm corresponding to the target playback rhythm option is controlled to be in the selected state; in response to the selection operation for the target playback rhythm option.
  • the determination operation of the target playback rhythm receives the performance costume association operation; in response to the performance costume association operation, an association relationship between the target performance costume and the target playback rhythm is established.
  • the association establishment module is further configured to display at least two playback rhythms included in the target audio, and use the at least two playback rhythms as the rhythm indication information; in response to the at least The selection operation of the target playback rhythm among the two playback rhythms displays the recommendation information for recommending and setting the performance costumes associated with the target playback rhythm, and the recommendation information includes the recommended target performance costumes; in response to the recommendation In the information determining operation, the performance costume association operation is received; in response to the performance costume association operation, an association relationship between the target performance costume and the target playback rhythm is established.
  • the device further includes: a first generation module configured to perform rhythm point detection on the target audio before displaying the rhythm indication information of the target audio to obtain at least two elements included in the target audio. rhythm points; based on each of the rhythm points, generate rhythm indication information of the target audio.
  • the device further includes: a second generation module configured to perform sampling processing on the target audio based on a preset sampling frequency before displaying the rhythm indication information of the target audio to obtain the target audio.
  • the frequency of each audio frame in the plurality of audio frames included in the audio Fourier transform is performed on the frequency of each of the audio frames to obtain a spectrogram corresponding to each of the audio frames; Based on the spectrogram of each of the audio frames, Rhythm indication information of the target audio is generated.
  • the association establishment module is further configured to perform rhythm recognition on the selected target audio before using it as the background audio for performance recording, and obtain at least two playback modes corresponding to the target audio.
  • Rhythm obtain at least two performance costumes used to associate and set the background audio, and match each of the performance costumes with each of the playback rhythms to obtain a corresponding matching degree; obtain the matching degree to achieve a matching degree
  • At least two clothing rhythm pairs corresponding to the threshold, the clothing rhythm pairs include a performance clothing and a playback rhythm; establish an association between the performance clothing and the playback rhythm in each of the clothing rhythm pairs.
  • the recording module is further configured to display the performance action performed by the virtual object equipped with the first performance costume following the background audio; the replacement module is also configured to display the performance action when the background audio When the playback rhythm changes, obtain the second performance costume associated with the playback rhythm of the background audio after the playback rhythm changes; automatically switch the performance costume equipped by the virtual object from the first performance costume to the third performance costume. two performance costumes, and display performance actions performed by the virtual object equipped with the second performance costume following the background audio.
  • the replacement module is further configured to display a playback timeline of the background audio during the playback of the background audio, and change the playback rhythm in the playback timeline.
  • the target performance costume associated with the changed playback rhythm is displayed; when the background audio is played to the change moment, the performance costume assembled by the virtual object is automatically replaced with the target performance costume, and the equipment is displayed.
  • the virtual object with the target performance costume follows the performance action performed by the background audio until the background audio is played to the next change moment.
  • the device further includes: a zoom module configured to determine the zoom of the recorded performance picture that is adapted to the playback rhythm of the background audio when automatically changing the performance costumes assembled by the virtual object. Ratio: As the playing rhythm of the background audio changes, the recorded performance picture is displayed according to the corresponding scaling ratio, so that the scaling ratio of the performance picture corresponds to the playing rhythm.
  • Embodiments of the present application provide a computer program product or computer program.
  • the computer program product or computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium.
  • the processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the performance recording method in the virtual scene described above in the embodiment of the present application.
  • Embodiments of the present application provide a computer-readable storage medium storing executable instructions.
  • the executable instructions are stored therein.
  • the executable instructions When executed by a processor, they will cause the processor to execute the virtual scene provided by the embodiments of the present application.
  • a performance recording method for example, the method shown in Figure 3.
  • the computer-readable storage medium may be read-only memory (Read-Only Memory, ROM), random access memory (RAM), erasable programmable read-only memory (Erasable Programmable Read-Only Memory) , EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), flash memory, magnetic surface memory, optical disk, or CD-ROM; it can also include one or any combination of the above memories of various equipment.
  • ROM read-only memory
  • RAM random access memory
  • EPROM erasable programmable read-only memory
  • EEPROM Electrically Erasable Programmable Read-Only Memory
  • flash memory magnetic surface memory, optical disk, or CD-ROM
  • executable instructions may take the form of a program, software, software module, script, or code, written in any form of programming language, including compiled or interpreted languages, or declarative or procedural languages, and their May be deployed in any form, including deployed as a stand-alone program or deployed as a module, component, subroutine, or other unit suitable for use in a computing environment.
  • executable instructions may, but do not necessarily correspond to, files in a file system and may be stored as part of a file holding other programs or data, for example, in a Hyper Text Markup Language (HTML) document. in one or more scripts, in a single file that is specific to the program in question, or in multiple collaborative files (e.g., files that store one or more modules, subroutines, or portions of code).
  • HTML Hyper Text Markup Language
  • executable instructions may be deployed to execute on one computing device, or on multiple computing devices located at one location, or alternatively, on multiple computing devices distributed across multiple locations and interconnected by a communications network execute on.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Architecture (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请提供了一种虚拟场景中的表演录制方法、装置、设备、计算机可读存储介质及计算机程序产品；方法包括：显示装配有表演服饰的虚拟对象、以及用于选择背景音频的音频控件；响应于基于所述音频控件触发的音频选择操作，将所选择的目标音频作为表演录制的背景音频；其中，目标音频包括至少两种播放节奏，不同的播放节奏关联有不同的表演服饰；在对虚拟对象进行表演录制的过程中，播放背景音频，并展示虚拟对象跟随背景音频所执行的表演动作；当背景音频的播放节奏发生变化时，自动更换虚拟对象装配的表演服饰，使得虚拟对象的表演服饰与背景音频的播放节奏相对应。

Description

虚拟场景中的表演录制方法、装置、设备、存储介质及程序产品
相关申请的交叉引用
本申请基于申请号为202210231332.5、申请日为2022年03月10日的中国专利申请提出，并要求该中国专利申请的优先权，该中国专利申请的全部内容在此引入本申请作为参考。
技术领域
本申请涉及人机交互技术，尤其涉及一种虚拟场景中的表演录制方法、装置、设备、存储介质及程序产品。
背景技术
在虚拟场景(如游戏)的表演录制应用中，用户可控制虚拟对象在表演录制过程中更换表演服饰(如穿戴的衣服或佩戴的配饰)。相关技术中，在表演录制过程中更换虚拟对象的表演服饰时，需要先搭配好多套表演服饰，再手动进行表演服饰的更换，使得表演服饰的更换效率较低，造成人机交互效率低。
发明内容
本申请实施例提供一种虚拟场景中的表演录制方法、装置、设备、计算机可读存储介质及计算机程序产品，能够提高表演服饰的更换效率及人机交互效率。
本申请实施例的技术方案是这样实现的：
本申请实施例提供一种虚拟场景中的表演录制方法，所述方法由电子设备执行，所述方法包括：
显示装配有表演服饰的虚拟对象、以及用于选择背景音频的音频控件；
响应于基于所述音频控件触发的音频选择操作，将所选择的目标音频作为表演录制的背景音频；其中，所述目标音频包括至少两种播放节奏，不同的播放节奏关联有不同的表演服饰；
在对所述虚拟对象进行表演录制的过程中，播放所述背景音频，并展示所述虚拟对象跟随所述背景音频所执行的表演动作；
当所述背景音频的播放节奏发生变化时，自动更换所述虚拟对象装配的表演服饰，其中，所述虚拟对象的表演服饰与所述背景音频的播放节奏相对应。
本申请实施例提供一种虚拟场景中的表演录制装置，所述装置包括：
显示模块，配置为显示装配有表演服饰的虚拟对象、以及用于选择背景音频的音频控件；
选择模块，配置为响应于基于所述音频控件触发的音频选择操作，将所选择的目标音频作为表演录制的背景音频；其中，所述目标音频包括至少两种播放节奏，不同的播放节奏关联有不同的表演服饰；
录制模块，配置为在对所述虚拟对象进行表演录制的过程中，播放所述背景音频，并展示所述虚拟对象跟随所述背景音频所执行的表演动作；
更换模块，配置为当所述背景音频的播放节奏发生变化时，自动更换所述虚拟对象装配的表演服饰，其中，所述虚拟对象的表演服饰与所述背景音频的播放节奏相对应。
本申请实施例提供一种电子设备，包括：
存储器，配置为存储可执行指令；
处理器，配置为执行所述存储器中存储的可执行指令时，实现本申请实施例提供的虚拟场 景中的表演录制方法。
本申请实施例提供一种计算机可读存储介质，所述计算机可读存储介质存储有可执行指令，用于引起处理器执行时，实现本申请实施例提供的虚拟场景中的表演录制方法。
本申请实施例提供一种计算机程序产品，所述计算机程序产品包括计算机程序或指令，所述计算机程序或指令被处理器执行时，实现本申请实施例提供的虚拟场景中的表演录制方法。
本申请实施例具有以下有益效果：
应用本申请实施例，在对虚拟场景中的虚拟对象进行表演录制过程中，由于所选择的表演录制的背景音频包括多种播放节奏，不同的播放节奏关联有不同的表演服饰，随着表演录制的背景音频的播放节奏的变化，自动更换虚拟对象装配的表演服饰，使得虚拟对象的表演服饰与背景音频的播放节奏相对应，如此，在表演录制过程中，虚拟对象装备的表演服饰随着背景音频的播放节奏的变化而变化，使得虚拟对象装备的表演服饰与背景音频的播放节奏达到很好的呼应，提高了彼此之间的适配度；而且这种表演服饰的更换方式相较于手动切换所要更换的表演服饰而言，大大提高了表演服饰的更换效率，使得用户无需在不同的播放节奏下手动更换虚拟对象的表演服饰，提高了人机交互效率。
附图说明
图1A为本申请实施例提供的虚拟场景中的表演录制方法的应用场景示意图；
图1B为本申请实施例提供的虚拟场景中的表演录制方法的应用场景示意图；
图2为本申请实施例提供的终端设备400的结构示意图；
图3为本申请实施例提供的虚拟场景中的表演录制方法的流程示意图；
图4为本申请实施例提供的表演服饰的确定示意图；
图5为本申请实施例提供的背景音频的关联设置示意图；
图6为本申请实施例提供的表演录制的显示示意图；
图7为本申请实施例提供的表演录制示意图；
图8为本申请实施例提供的表演服饰的设置示意图；
图9为本申请实施例提供的表演服饰的设置示意图；
图10为本申请实施例提供的背景音频的关联设置示意图；
图11为本申请实施例提供的表演录制的显示示意图。
具体实施方式
为了使本申请的目的、技术方案和优点更加清楚，下面将结合附图对本申请进行详细描述，所描述的实施例不应视为对本申请的限制，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其它实施例，都属于本申请保护的范围。
在以下的描述中，涉及到“一些实施例”，其描述了所有可能实施例的子集，但是可以理解，“一些实施例”可以是所有可能实施例的相同子集或不同子集，并且可以在不冲突的情况下相互结合。
在以下的描述中，所涉及的术语“第一\第二…”仅仅是区别类似的对象，不代表针对对象的特定排序，可以理解地，“第一\第二…”在允许的情况下可以互换特定的顺序或先后次序，以使这里描述的本申请实施例能够以除了在这里图示或描述的以外的顺序实施。
除非另有定义，本文所使用的所有的技术和科学术语与属于本申请的技术领域的技术人员通常理解的含义相同。本文中所使用的术语只是为了描述本申请实施例的目的，不是旨在限制本申请。
对本申请实施例进行详细说明之前，对本申请实施例中涉及的名词和术语进行说明，本申请实施例中涉及的名词和术语适用于如下的解释。
1)客户端，终端中运行的用于提供各种服务的应用程序，例如视频播放客户端、游戏客户端等。
2)响应于，用于表示所执行的操作所依赖的条件或者状态，当满足所依赖的条件或状态时，所执行的一个或多个操作可以是实时的，也可以具有设定的延迟；在没有特别说明的情况下，所执行的多个操作不存在执行先后顺序的限制。
3)虚拟场景，是应用程序在终端上运行时显示(或提供)的虚拟场景，该虚拟场景可以是对真实世界的仿真环境，也可以是半仿真半虚构的虚拟环境，还可以是纯虚构的虚拟环境。虚拟场景可以是二维虚拟场景、2.5维虚拟场景或者三维虚拟场景中的任意一种，本申请实施例对虚拟场景的维度不加以限定。例如，该虚拟场景中可以包括天空、陆地、海洋等，该陆地可以包括沙漠、城市等环境元素，用户可以控制虚拟对象在该虚拟场景中进行移动。
4)虚拟对象，虚拟场景中可以进行交互的各种人和物的形象，或在虚拟场景中的可活动对象。该可活动对象可以是虚拟人物、虚拟动物、动漫人物等，比如在虚拟场景中显示的人物、动物等。该虚拟对象可以是该虚拟场景中的一个虚拟的用于代表用户的虚拟形象，虚拟场景中可以包括多个虚拟对象，每个虚拟对象在虚拟场景中具有自身的形状和体积，占据虚拟场景中的一部分空间。虚拟对象可以是受用户(或称玩家)控制的游戏角色，即虚拟对象受控于真实用户，将响应于真实用户针对控制器(包括触控屏、声控开关、键盘、鼠标和摇杆等)的操作而在虚拟场景中运动，例如当真实用户向左移动摇杆时，虚拟对象将在虚拟场景中向左部移动，还可以保持原地静止、跳跃以及使用各种功能(如技能和道具)。
本申请实施例提供一种虚拟场景中的表演录制方法、装置、电子设备、计算机可读存储介质及计算机程序产品，能够提高表演服饰的更换效率及人机交互效率。为便于更容易理解本申请实施例提供的虚拟场景中的表演录制方法，首先说明本申请实施例提供的虚拟场景中的表演录制方法的示例性实施场景，本申请实施例提供的虚拟场景中的表演录制方法中的虚拟场景可以完全基于电子设备输出，或者基于电子设备和服务器协同输出。在一些实施例中，虚拟场景可以是供游戏角色交互的环境，例如可以是供游戏角色在虚拟场景中进行对战，通过控制游戏角色的行动可以在虚拟场景中进行双方互动，从而使用户能够在游戏的过程中舒缓生活压力。
在一个实施场景中，参见图1A，图1A为本申请实施例提供的虚拟场景中的表演录制方法的应用场景示意图，在该应用场景下，完全依赖于终端设备400的图形处理硬件计算能力，即可完成虚拟场景100的相关数据计算，例如单机版/离线模式的游戏，通过智能手机、平板电脑和虚拟现实/增强现实设备等各种不同类型的终端设备400完成虚拟场景的输出。作为示例，图形处理硬件的类型包括中央处理器(CPU，Central Processing Unit)和图形处理器(GPU，Graphics Processing Unit)。
当形成虚拟场景100的视觉感知时，终端设备400通过图形计算硬件计算显示所需要的数据，并完成显示数据的加载、解析和渲染，在图形输出硬件输出能够对虚拟场景形成视觉感知的视频帧，例如，在智能手机的显示屏幕呈现二维的视频帧，或者，在增强现实/虚拟现实眼镜的镜片上投射实现三维显示效果的视频帧；此外，为了丰富感知效果，终端设备400还可以借助不同的硬件来形成听觉感知、触觉感知、运动感知和味觉感知的一种或多种。
作为示例，终端设备400上运行有客户端410(例如单机版的游戏应用)，在客户端410的运行过程中输出包括有角色扮演的虚拟场景100，虚拟场景100可以是供游戏角色交互的环境，例如可以是用于供游戏角色进行对战的平原、街道、山谷等等；虚拟场景100中包括进行表演录制的虚拟对象110。
作为示例，终端设备400显示装配有表演服饰的虚拟对象、以及用于选择背景音频的 音频控件；响应于基于所述音频控件触发的音频选择操作，将所选择的目标音频确定为表演录制的背景音频；其中，目标音频包括至少两种播放节奏，不同的播放节奏关联有不同的表演服饰；在对所述虚拟对象进行表演录制的过程中，播放背景音频，并展示虚拟对象跟随背景音频所执行的表演动作；当背景音频的播放节奏发生变化时，自动更换虚拟对象装配的表演服饰，使得虚拟对象的表演服饰与背景音频的播放节奏相对应；如此，由于所选择的表演录制的背景音频关联有与播放节奏相对应的表演服饰，故随着背景音频的播放节奏的变化，自动更换虚拟对象装配的表演服饰，使得虚拟对象的表演服饰与背景音频的播放节奏相对应，相较于手动切换所要更换的表演服饰而言，大大提高了表演服饰的更换效率，使得用户无需在不同的播放节奏下手动更换虚拟对象的表演服饰，提高了人机交互效率。
在另一个实施场景中，参见图1B，图1B为本申请实施例提供的虚拟场景中的表演录制方法的应用场景示意图，该应用场景中包括终端设备400和服务器200，依赖于服务器200的计算能力完成虚拟场景计算、并在终端设备400输出虚拟场景。以形成虚拟场景100的视觉感知为例，服务器200进行虚拟场景相关显示数据(例如场景数据)的计算并通过网络300发送到终端设备400，终端设备400依赖于图形计算硬件完成计算显示数据的加载、解析和渲染，依赖于图形输出硬件输出虚拟场景以形成视觉感知，例如可以在智能手机的显示屏幕呈现二维的视频帧，或者，在增强现实/虚拟现实眼镜的镜片上投射实现三维显示效果的视频帧；对于虚拟场景的形式的感知而言，可以理解，可以借助于终端设备400的相应硬件输出，例如使用麦克风形成听觉感知，使用振动器形成触觉感知等等。
作为示例，终端设备400上运行有客户端410(例如单机版的游戏应用)，在客户端410的运行过程中输出包括有角色扮演的虚拟场景100，虚拟场景100可以是供游戏角色交互的环境，例如可以是用于供游戏角色进行对战的平原、街道、山谷等等；虚拟场景100中包括进行表演录制的虚拟对象110。
在一些实施例中，本申请实施例可以借助于云技术(Cloud Technology)实现，云技术是指在广域网或局域网内将硬件、软件、网络等系列资源统一起来，实现数据的计算、储存、处理和共享的一种托管技术。云技术是基于云计算商业模式应用的网络技术、信息技术、整合技术、管理平台技术、以及应用技术等的总称，可以组成资源池，按需所用，灵活便利。云计算技术将变成重要支撑。技术网络系统的后台服务需要大量的计算、存储资源；如当虚拟场景为游戏场景时，相应的游戏为云游戏，终端显示的虚拟场景的画面皆由服务器渲染得到。
在一些实施例中，终端设备400可以通过运行计算机程序来实现本申请实施例提供的虚拟场景中的表演录制方法，例如，计算机程序可以是操作系统中的原生程序或软件模块；可以是本地(Native)应用程序(APP，APPlication)，即需要在操作系统中安装才能运行的程序，例如射击类游戏APP(即上述的客户端410)；也可以是小程序，即只需要下载到浏览器环境中就可以运行的程序；还可以是能够嵌入至任意APP中的游戏小程序。总而言之，上述计算机程序可以是任意形式的应用程序、模块或插件。
以计算机程序为应用程序为例，在实际实施时，终端设备400安装和运行有支持虚拟场景的应用程序。该应用程序可以是第一人称射击游戏(FPS，First-Person Shooting game)、第三人称射击游戏、虚拟现实应用程序、三维地图程序、演习仿真程序或者多人枪战类生存游戏中的任意一种。用户使用终端设备400操作位于虚拟场景中的虚拟对象进行活动，该活动包括但不限于：调整身体姿态、爬行、步行、奔跑、骑行、跳跃、驾驶、拾取、射击、攻击、投掷、建造虚拟建筑中的至少一种。示意性的，该虚拟对象可以是虚拟人物，比如仿真人物角色或动漫人物角色等。
在实际应用中，图1B中的服务器200可以是独立的物理服务器，也可以是多个物理服务器构成的服务器集群或者分布式系统，还可以是提供云服务、云数据库、云计算、云函数、云存储、网络服务、云通信、中间件服务、域名服务、安全服务、内容分发网络(CDN， Content Delivery Network)、以及大数据和人工智能平台等基础云计算服务的云服务器。终端设备400可以是智能手机、平板电脑、笔记本电脑、台式计算机、智能音箱、智能手表、可穿戴设备等，但并不局限于此。终端设备400以及服务器200可以通过有线或无线通信方式进行直接或间接地连接，本申请实施例中不做限制。
下面对实施本申请实施例的虚拟场景中的表演录制方法的电子设备进行说明，在一些实施例中，该电子设备5可以为图1A或图1B示出的终端设备，也可以为图1B示出的服务器，以电子设备为图1A中示出的终端设备400为例，对图1A中示出的终端设备400的结构进行说明。参见图2，图2为本申请实施例提供的终端设备400的结构示意图，图2所示的终端设备400包括：至少一个处理器420、存储器460、至少一个网络接口430和用户接口440。终端设备400中的各个组件通过总线系统450耦合在一起。可理解，总线系统450配置为实现这些组件之间的连接通信。总线系统450除包括数据总线之外，还包括电源总线、控制总线和状态信号总线。但是为了清楚说明起见，在图2中将各种总线都标为总线系统450。
处理器420可以是一种集成电路芯片，具有信号的处理能力，例如通用处理器、数字信号处理器(DSP，Digital Signal Processor)，或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等，其中，通用处理器可以是微处理器或者任何常规的处理器等。
用户接口440包括使得能够呈现媒体内容的一个或多个输出装置441，包括一个或多个扬声器和/或一个或多个视觉显示屏。用户接口440还包括一个或多个输入装置442，包括有助于用户输入的用户接口部件，比如键盘、鼠标、麦克风、触屏显示屏、摄像头、其他输入按钮和控件。
存储器460可以是可移除的，不可移除的或其组合。示例性的硬件设备包括固态存储器，硬盘驱动器，光盘驱动器等。存储器460可选地包括在物理位置上远离处理器420的一个或多个存储设备。
存储器460包括易失性存储器或非易失性存储器，也可包括易失性和非易失性存储器两者。非易失性存储器可以是只读存储器(ROM，Read Only Memory)，易失性存储器可以是随机存取存储器(RAM，Random Access Memory)。本申请实施例描述的存储器460旨在包括任意适合类型的存储器。
在一些实施例中，存储器460能够存储数据以支持各种操作，这些数据的示例包括程序、模块和数据结构或者其子集或超集，下面示例性说明。
操作系统461，包括配置为处理各种基本系统服务和执行硬件相关任务的系统程序，例如框架层、核心库层、驱动层等，用于实现各种基础业务以及处理基于硬件的任务；
网络通信模块462，配置为经由一个或多个(有线或无线)网络接口430到达其他计算设备，示例性的网络接口430包括：蓝牙、无线相容性认证(WiFi)、和通用串行总线(USB，Universal Serial Bus)等；
呈现模块463，配置为经由一个或多个与用户接口440相关联的输出装置441(例如，显示屏、扬声器等)使得能够呈现信息(例如，用于操作外围设备和显示内容和信息的用户接口)；
输入处理模块464，配置为对一个或多个来自一个或多个输入装置442之一的一个或多个用户输入或互动进行检测以及翻译所检测的输入或互动。
在一些实施例中，本申请实施例提供的虚拟场景中的表演录制装置可以采用软件方式实现，图2示出了存储在存储器460中的虚拟场景中的表演录制装置465，其可以是程序和插件等形式的软件，包括以下软件模块：显示模块4651、选择模块4652、录制模块4653和更换模块4654，这些模块是逻辑上的，因此根据所实现的功能可以进行任意的组合或拆分，将在下文中说明各个模块的功能。
在另一些实施例中，本申请实施例提供的虚拟场景中的表演录制装置可以采用硬件方 式实现，作为示例，本申请实施例提供的虚拟场景中的表演录制装置可以是采用硬件译码处理器形式的处理器，其被编程以执行本申请实施例提供的虚拟场景中的表演录制方法，例如，硬件译码处理器形式的处理器可以采用一个或多个应用专用集成电路(ASIC，Application Specific Integrated Circuit)、DSP、可编程逻辑器件(PLD，Programmable Logic Device)、复杂可编程逻辑器件(CPLD，Complex Programmable Logic Device)、现场可编程门阵列(FPGA，Field-Programmable Gate Array)或其他电子元件。
下面将结合附图对本申请实施例提供的虚拟场景中的表演录制方法进行说明。本申请实施例提供的虚拟场景中的表演录制方法可以由图1A中的终端设备400单独执行，也可以由图1B中的终端设备400和服务器200协同执行。接下来，以由图1A中的终端设备400单独执行本申请实施例提供的虚拟场景中的表演录制方法为例进行说明。参见图3，图3为本申请实施例提供的虚拟场景中的表演录制方法的流程示意图，将结合图3示出的步骤进行说明。
需要说明的是，图3示出的方法可以由终端设备400上运行的各种形式的计算机程序执行，并不局限于上述的客户端410，还可以是上文所述的操作系统461、软件模块和脚本，因此客户端不应视为对本申请实施例的限定。
步骤101：终端设备显示装配有表演服饰的虚拟对象、以及用于选择背景音频的音频控件。
这里，终端设备上可以安装有支持虚拟场景的应用客户端(比如游戏客户端)，还可以是集成有虚拟场景功能的客户端(比如即时通信客户端、直播客户端、教育客户端等)，当用户打开终端上的应用客户端，且终端运行该应用客户端时，用户可以基于该客户端所显示的虚拟场景的画面，进行虚拟对象间的交互；例如，当客户端为游戏客户端时，用户可基于该游戏客户端显示的游戏画面，执行游戏场景中游戏角色(虚拟对象)间的交互(如进行虚拟对战)。
在实际应用中，用户可基于客户端显示的虚拟场景，控制的虚拟对象在虚拟场景中表演，并对虚拟对象的表演进行录制，在一些实施例中，用户可基于终端设备显示的虚拟场景的表演录制界面，对虚拟对象的表演进行录制，该表演录制界面中可以显示装配有表演服饰的虚拟对象、以及用于选择背景音频的音频控件。
在实际应用中，为虚拟场景中的虚拟对象装配或装备表演服饰是指，将该表演服饰的模型叠加在虚拟对象模型的相应位置上。
在开始表演录制前，用户可先对虚拟对象在虚拟场景进行表演录制时所装备的表演服饰进行设置。在开始表演录制时，虚拟对象所装备的表演服饰可以是虚拟对象最初装备(默认装备)的服装或配饰，表演服饰可附加或可脱离虚拟对象，如其可以是虚拟对象穿戴的服装(如上衣、鞋子等)，也可以是虚拟对象佩戴的配饰(如眼镜、项链、头盔等)，还可以是虚拟对象的皮肤颜色、头发颜色、发型样式等。在实际应用中，虚拟对象所装配的表演服饰可以是以单一的服饰配件(如衣服、鞋子、发型中之一)而存在，还可以是以服饰套装(如由衣服、鞋子、发型搭配组合而成)的形式而存在。
步骤102：响应于基于音频控件触发的音频选择操作，将所选择的目标音频作为表演录制的背景音频。
其中，目标音频包括至少两种播放节奏，不同的播放节奏关联有不同的表演服饰。
这里，对音频的播放节奏进行说明。音频的播放节奏是指音频运动中音的长短和强弱，常被比喻为音乐家的骨架，音频的播放节奏也指音响节拍轻重缓急的变化和重复，具有时间感，播放节奏包括节拍和速度两个概念，前者是指音乐规律性的强弱交替的运动，即拍点的组合，后者则是指这种律动的速率。
在进行表演录制时，通过音频控件选择表演录制时的背景音频，如用户点击音频控件时，终端设备响应于该点击操作，显示背景音频选择界面，并在背景音频选择界面中显示 至少一首可供选择的音频，用户可通过背景音频选择界面选择某一音频作为背景音频，如用户选择目标音频时，将目标音频作为表演录制的背景音频。
需要说明的是，在实际应用中，背景音频除了可为场景外音频(如上述选择的本地存储的音频或网络存储的音频)之外，还可以为场景内音频，如表演录制的虚拟场景中的音频，该场景内音频属于正在录制的表演内容中的一部分，如在表演录制过程中，所录制的表演内容中虚拟对象正在歌唱、呐喊等，或虚拟场景中除虚拟对象发出的音频之外的其他音频，如虚拟对象使用虚拟道具攻击敌人的声音或其他特效音频，则将此类虚拟场景内的音频作为场景内音频，即将虚拟场景内的音频作为背景音频，对于此类，在表演录制过程中，终端设备可智能根据背景音频的播放节奏，确定与播放节奏相适配的表演服饰，并当背景音频的播放节奏发生变化时，自动更换虚拟对象装备的表演服饰，使得虚拟对象装备的表演服饰与背景音频的播放节奏相对应。
在一些实施例中，在表演录制之前或在将所选择的目标音频作为表演录制的背景音频之前，终端设备可通过如下方式建立目标音频所包括的播放节奏与相应的表演服饰之间的关联关系：响应于针对目标音频的关联设置操作，显示目标音频的关联设置界面；在目标音频的关联设置界面中，显示用于关联目标音频的至少两个表演服饰以及目标音频的节奏指示信息，节奏指示信息用于指示目标音频的播放节奏；响应于基于节奏指示信息触发的表演服饰关联操作，建立表演服饰关联操作所指示的目标表演服饰与目标播放节奏的关联关系。
这里，在将目标音频作为背景音频之前，需对目标音频进行表演服饰的关联设置。例如，当用户点击音频关联控件时，终端设备响应于该点击操作，接收到针对目标音频的关联设置操作，响应于该关联设置操作，显示目标音频的节奏指示信息以及至少两个已设置好的对虚拟对象进行表演录制时所装备的表演服饰，基于目标音频的节奏指示信息和候选的至少两个表演服饰即可触发相应的表演服饰关联操作，进而基于表演服饰关联操作建立播放节奏与表演服饰的关联关系，例如，表演服饰关联操作指示将播放节奏1与表演服饰1进行关联，即建立播放节奏1与表演服饰1之间的关联关系，如此，在表演录制过程中，当目标音频(背景音频)的播放节奏变化成播放节奏1时，自动将虚拟对象原来装备的表演服饰(播放节奏变化成播放节奏1之前所装备的表演服饰)更换为表演服饰1。
在一些实施例中，终端设备显示目标音频的节奏指示信息之前，可对目标音频进行节奏点检测，得到目标音频包括的至少两个节奏点；基于各节奏点，生成目标音频的节奏指示信息。
这里，音频的节奏点也即音频的节拍、鼓点，节拍是指强拍和弱拍的组合规律，是指在乐谱中每一小节的音符总长度。终端设备获取目标音频后，对目标音频进行节奏点检测，得到目标音频包括的多个节奏点，如基于采样窗口对目标音频进行采样处理，得到多个采样窗口对应的音频数据，基于各采样窗口对应的音频数据，确定各采样窗口对应的能量谱，基于各采样窗口对应的能量谱，确定目标音频的多个节奏点，进而基于各节奏点生成相应的节奏指示信息，如节奏点1对应的节奏指示信息为节奏较强，节奏点2对应的节奏指示信息为节奏较弱，等等。
终端设备在进行节奏点检测时，可基于信号处理对音频数据进行节奏点检测，在实际应用中，一般音乐每秒采样44100次，一秒就会有44100个采样，如果以1024个采样为一个窗口，一秒大约就会有44个窗口，那么一首3分钟的音频数据就大约会有7920个窗口，根据采样窗口的能量谱来判断该采样窗口是不是一个节奏点；在进行节奏检测的过程中，也可通过限定阈值来调整节奏的疏密，如此可检测较强的节奏，忽略较弱的节奏。
在一些实施例中，终端设备可通过如下方式确定节奏点：分别对各采样窗口对应的音频数据进行傅里叶变换，得到对应各采样窗口的音频频谱；确定目标视频的音频数据中相邻采样窗口对应的音频频谱的差异度；基于差异度，确定对应各采样窗口的能量谱；从多个采样窗口中，分别获取预设数量的采样窗口对应的能量谱；对预设数量的采样窗口对应 的能量谱进行加权求平均，得到对应的能量谱均值；将能量谱均值乘以一个比例系数得到对应的能量谱阈值；将能量谱大于能量谱阈值所对应的采样窗口确定为节奏点。
在实际应用中，音频数据在时域上是杂乱无章的波形信号，为了便于分析，可将时域上的音频数据通过快速傅里叶变换转换到频域，得到对应音频数据的音频频谱，然后基于得到的音频频谱计算相邻采样窗口对应的音频频谱之间的差异度，再基于得到的多个差异度，确定对应各采样窗口的能量谱，比如，将当前采样窗口对应的音频频谱减去前一相邻采样窗口对应的音频频谱得到的差异度，确定为当前采样窗口对应的能量谱。
在一些实施例中，终端设备在目标音频的关联设置界面中，显示用于关联目标音频的至少两个表演服饰之前，可通过如下方式确定用于关联目标音频的表演服饰：显示用于对虚拟对象装备的表演服饰进行设置的表演服饰设置界面；在表演服饰设置界面中，显示可供选择的至少两个候选表演服饰；响应于针对至少两个候选表演服饰中目标数量的候选表演服饰的选择操作，将目标数量的候选表演服饰确定为用于关联目标音频的表演服饰。
这里，用户可通过终端设备进入表演服饰设置界面，基于表演服饰设置界面进行表演服饰的选择，在实际应用中，在表演服饰设置界面中，可为用户提供多个候选表演服饰供用户选择，用户可以依据需要选择一定数量的候选表演服饰关联目标音频，在一些实施例中，关于用户选择的候选表演服饰的数量可以存在数量阈值，也即用户可关联的候选表演服饰存在最大值，比如10个，用户在实际选择的时候可以选择最大值以内的任意数量，但不能超过最大值。
参见图4，图4为本申请实施例提供的表演服饰的确定示意图，终端设备在表演录制界面中显示用于对虚拟对象装备的表演服饰进行设置的服饰控件401，终端设备响应于针对服饰控件401的触发操作，显示表演服饰设置界面402，并在表演服饰设置界面402中显示多个候选表演服饰，如候选表演服饰1～候选表演服饰5，响应于针对目标数量的候选表演服饰的选择操作(如候选表演服饰2～候选表演服饰4)，将候选表演服饰2～候选表演服饰4确定为用于关联目标音频的表演服饰。
在一些实施例中，终端设备在目标音频的关联设置界面中，显示用于关联目标音频的至少两个表演服饰之前，可通过如下方式确定用于关联目标音频的表演服饰：显示用于对虚拟对象装备的表演服饰进行设置的表演服饰设置界面；当表演服饰以表演服饰套装的形式显示时，在表演服饰设置界面中，显示可供选择的至少两类服饰配件；响应于针对至少两类服饰配件中目标类型的服饰配件的选择操作，将所选择的目标类型的服饰配件进行组合；将组合得到的表演服饰套装确定为用于关联目标音频的表演服饰。
这里，当表演服饰以表演服饰套装的形式显示时，在表演服饰设置界面中，显示可供选择的至少两类服饰配件，如衣服类的服饰配件、鞋子类的服饰配件、袜子类的服饰配件、发型类的服饰配件，等等，可从中选择目标类型的服饰配件进行组合以得到多个表演服装套装，如从中选择衣服类的服饰配件、鞋子类的服饰配件组合得到表演服装套装1、从中选择鞋子类的服饰配件、袜子类的服饰配件、发型类的服饰配件组合得到表演服饰套装2，并将组合得到的表演服装套装1和表演服装套装2确定为用于关联目标音频的表演服饰。
在一些实施例中，终端设备在目标音频的关联设置界面中，显示用于关联目标音频的至少两个表演服饰之前，可通过如下方式确定用于关联目标音频的表演服饰：显示用于对虚拟对象装备的表演服饰进行设置的表演服饰设置界面；当表演服饰以表演服饰套装的形式显示时，在表演服饰设置界面中，显示表演服饰套装对应的至少两个配件控件，不同的配件控件对应不同类型的服饰配件；针对各所述配件控件所对应的类型，响应于针对配件控件的触发操作，显示相应类型的至少一个候选服饰配件；响应于针对至少一个候选配件中目标配件的选择操作，将目标配件确定为针对该类型所选择的配件；将对应各配件控件所选择的配件进行组合，得到对应的表演服饰套装，并将得到的表演服饰套装确定为用于关联目标音频待的表演服饰。
这里，当表演服饰以表演服饰套装的形式显示时，在表演服饰设置界面中，显示表演 服饰套装对应的至少两个配件控件，不同的配件控件对应不同类型的服饰配件，如发型控件对应发型配件、衣服控件对应衣服配件等；在对每一套表演服饰套装进行设置时，可采用相应的设置方式进行设置，例如，每套表演服饰套装包括4个服饰配件(对应发型、衣服、袜子和鞋子)，在对表演服饰套装1进行设置时，当用户点击发型控件时，终端响应于该点击操作，显示可供选择的多个发型，如发型1、发型2、发型3，当用户选择发型3时，则将发型3作为表演服饰套装1中的发型配件；当用户点击衣服控件时，终端响应于该点击操作，显示可供选择的多个衣服，如衣服1、衣服2、衣服3、衣服4，当用户选择衣服2时，则将衣服2作为表演服饰套装1中的衣服配件；依次类推，假设选择袜子2作为表演服饰套装1中的袜子配件，选择表演服饰鞋子1作为套装1中的鞋子配件；最后，将发型3、衣服2、袜子2和鞋子1进行组合搭配，得到表演服饰套装1。通过此方式，即可搭配得到表演服饰套装2、…、表演服饰套装N(N>2，可根据实际应用设置)，最终将搭配得到的表演服饰套装1、…、套装N作为对虚拟场景中的虚拟对象进行表演录制时所装备的表演服饰。
需要说明的是，在对表演服饰套装进行设置时，在一些实施例中，不同的表演服饰套装所包括服饰配件的数量可以是不同的，如表演服饰套装1对应的服饰配件为3个(对应发型、衣服、袜子)，表演服饰套装2对应的服饰配件为4个(对应发型、衣服、袜子和鞋子)，如此，表演服饰套装1和表演服饰套装2所包括的服饰配件的类型可以是不完全相同的；在另一些实施例中，不同的表演服饰套装所包括服饰配件的数量虽然相同，但所包括的服饰配件所属配件类型可以是不同的，如表演服饰套装1对应的服饰配件为4个(对应发型、衣服、袜子和眼镜)，表演服饰套装2对应的服饰配件为4个(对应发型、衣服、袜子和鞋子)，如此，表演服饰套装1和表演服饰套装2所包括的服饰配件的类型可以是不完全相同的；在另一些实施例中，若未点击某一配件控件，则默认为将该配件控件所指示的配件设置为空，如在对表演服饰套装1进行设置时，若用户未点击发型配件，则默认为未对表演服饰套装1中的发型进行设置，此时，得到的表演服饰套装1中的发型可以是虚拟对象的默认发型。
在一些实施例中，终端设备可通过如下方式显示目标音频的节奏指示信息：终端设备显示目标音频的播放时间轴，该播放时间轴用于指示目标音频当前的播放时间、总的播放时长等；在播放时间轴中显示与目标音频的播放节奏相对应的至少两个节奏点槽位，并将节奏点槽位作为节奏指示信息；其中，节奏点槽位用于承载待关联的表演服饰；相应的，当表演服饰关联操作为针对目标表演服饰的拖动操作时，终端设备响应于基于节奏指示信息触发的表演服饰关联操作，可通过如下方式建立表演服饰关联操作所指示的目标表演服饰与目标播放节奏的关联关系：响应于所述拖动操作，当目标表演服饰被拖动至目标节奏点槽位时，将所述目标节奏点槽位对应的播放节奏确定为目标播放节奏，并建立目标表演服饰与目标节奏点槽位对应的目标播放节奏的关联关系。
这里，在目标音频的关联设置界面中的播放时间轴中，显示与目标音频的播放节奏相对应的至少两个节奏点槽位(用于承载待关联的表演服饰，节奏点槽位所在位置为目标音频的节拍、鼓点或节奏点所在位置，该位置对应的播放节奏将发生变化，即该位置为更换表演服饰的位置)；同时，在目标音频的关联设置界面中，显示已设置好的对游戏中的虚拟对象进行表演录制时所装备的表演服饰，如表演服饰套装1、表演服饰套装2、表演服饰套装3和表演服饰套装4；当用户拖动目标表演服饰至目标节奏点槽位时，终端设备响应于该拖动操作，建立目标表演服饰与目标节奏点槽位对应的目标播放节奏的关联关系，如用户将表演服饰套装1拖动至节奏点槽位1时，则建立表演服饰套装1和节奏点槽位1对应的播放节奏之间的关联关系。通过上述方式，即可建立各个节奏点槽位对应的播放节奏与相应的表演服饰之间的关联关系，在对目标音频进行关联设置完成后，即可将该目标音频作为背景音频应用于游戏中虚拟对象的表演录制中。
在一些实施例中，终端设备可通过如下方式显示用于关联目标音频的至少两个表演服 饰以及目标音频的节奏指示信息：终端设备至少两个变化时刻，该变化时刻为，目标音频的播放节奏发生变化的时刻，在各变化时刻的关联区域处显示节奏指示信息；响应于针对至少两个变化时刻中目标变化时刻对应的目标节奏指示信息的选择操作，显示对应目标节奏指示信息的至少一个表演服饰选项，其中，每个表演服饰选项对应一个表演服饰；
相应的，终端设备响应于基于节奏指示信息触发的表演服饰关联操作，可通过如下方式建立表演服饰关联操作所指示的目标表演服饰与目标播放节奏的关联关系：终端设备响应于针对至少两个表演服饰选项中目标表演服饰选项的选择操作，控制目标表演服饰选项对应的目标表演服饰处于选中状态；响应于针对目标表演服饰的确定操作，接收到表演服饰关联操作，也即，将针对目标表演服饰的确定操作确定为表演服饰关联操作；响应于表演服饰关联操作，建立目标表演服饰与目标变化时刻对应的目标播放节奏的关联关系。
参见图5，图5为本申请实施例提供的背景音频的关联设置示意图，在目标音频的关联设置界面中显示用于指示目标音频的播放节奏发生变化的3个变化时刻，如第10秒、第40秒和第70秒，并在第10秒的关联区域中显示“强”这一节奏指示信息501，在第40秒的关联区域中显示“弱”这一节奏指示信息502，在第70秒的关联区域中显示“中”这一节奏指示信息503，若用户需对第10秒的播放节奏进行表演服饰关联设置时，终端设备响应于针对奏指示信息501的触发操作，显示对应“强”这一节奏指示信息的至少一个表演服饰选项，每个表演服饰选项对应一个表演服饰，如表演服饰选项1对应表演服饰套装1、表演服饰选项2对应表演服饰套装2，当用户选择表演服饰选项1时，建立表演服饰套装1与目标音频中第10秒对应的播放节奏(强)的关联关系，如此，在目标音频作为背景音频播放至第10秒时，将目标虚拟对象的装备更换为表演服饰套装1；通过上述方式，还可建立目标音频中第40秒对应的播放节奏(弱)与所选择的表演服饰(如表演服饰套装3)之间的关联关系、以及第70秒对应的播放节奏(弱中)与所选择的表演服饰(如表演服饰套装2)之间的关联关系，在对目标音频进行关联设置完成后，即可将该目标音频作为背景音频应用于游戏中虚拟对象的表演录制中。
在一些实施例中，终端设备可通过如下方式显示目标音频的节奏指示信息：响应于针对至少两个表演服饰中目标表演服饰的选择操作，显示对应目标表演服饰的至少一个播放节奏选项，并将各播放节奏选项作为节奏指示信息；相应的，终端设备响应于基于节奏指示信息触发的表演服饰关联操作，可通过如下方式建立表演服饰关联操作所指示的目标表演服饰与目标播放节奏的关联关系：终端设备响应于针对至少一个播放节奏选项中目标播放节奏选项的选择操作，控制目标播放节奏选项对应的目标播放节奏处于选中状态；响应于针对目标播放节奏的确定操作，接收到表演服饰关联操作，也即，将针对目标播放节奏的确定操作确定为表演服饰关联操作；响应于表演服饰关联操作，建立目标表演服饰与目标播放节奏的关联关系。
这里，在目标音频的关联设置界面中显示用于关联目标音频的至少两个表演服饰，如表演服饰套装1、表演服饰套装2、表演服饰套装4，当用户选择目标表演服饰(如表演服饰套装2)时，显示与目标表演服饰相适配的至少一个播放节奏选项，并将各播放节奏选项作为节奏指示信息，如播放节奏选项1指示相应的播放节奏较强、播放节奏选项2指示相应的播放节奏适中、播放节奏选项3指示相应的播放节奏较弱，当用户选择播放节奏选项3时，即可创建表演服饰套装2与目标音频中较强的播放节奏(对应的播放时刻已知，如对应目标音频的第10秒，即在目标音频作为背景音频播放至第10秒时，将目标虚拟对象的装备更换为表演服饰套装2)之间的关联关系；通过上述方式，可创建其他表演服饰与目标音频中相适配的播放节奏之间的关联关系，在对目标音频进行关联设置完成后，即可将该目标音频作为背景音频应用于游戏中虚拟对象的表演录制中。
在一些实施例中，终端设备可通过如下方式显示用于关联目标音频的至少两个表演服饰以及目标音频的节奏指示信息：显示目标音频包括的至少两个播放节奏，并将至少两个播放节奏作为节奏指示信息；响应于针对至少两个播放节奏中目标播放节奏的选择操作， 显示推荐信息，该推荐信息用于对目标播放节奏关联的表演服饰进行推荐设置，其中，推荐信息中包括推荐的目标表演服饰；相应的，终端设备响应于基于节奏指示信息触发的表演服饰关联操作，可通过如下方式建立表演服饰关联操作所指示的目标表演服饰与目标播放节奏的关联关系：响应于针对推荐信息的确定操作，接收到表演服饰关联操作，也即将针对推荐信息的确定操作，确定为表演服饰关联操作；响应于表演服饰关联操作，建立目标表演服饰与目标播放节奏的关联关系。
这里，在目标音频的关联设置界面中显示目标音频包括的至少两个播放节奏，并将至少两个播放节奏作为节奏指示信息，如播放节奏1(对应的播放时刻已知，如对应目标音频的第10秒)指示播放节奏较强、播放节奏2(对应的播放时刻已知，如对应目标音频的第40秒)指示播放节奏适中、播放节奏3(对应的播放时刻已知，如对应目标音频的第70秒)指示播放节奏较弱，当用户选择目标播放节奏(如播放节奏1)时，显示包括推荐的目标表演服饰(如表演服饰套装2)的推荐信息，如“建议选择表演服饰套装2”，其中，目标表演服饰是基于对虚拟场景中的虚拟对象进行表演录制时所装备的表演服饰(如上述的表演服饰套装1、…、表演服饰套装N)与目标播放节奏(如播放节奏1)之间的适配度推荐得到的，选择适配度超过适配度阈值的表演服饰(如表演服饰套装2)作为推荐信息中包括的目标表演服饰。在实际应用中，在呈现推荐信息的同时，还可呈现对应推荐信息的确定按钮和更换按钮，当用户触发确定按钮时，终端设备即可接收到推荐信息的确定操作，也即接收到表演服饰关联操作，并响应于该表演服饰关联操作，建立目标播放节奏(如播放节奏1)与推荐信息中包括的目标表演服饰(如表演服饰套装2)之间的关联关系。当用户触发更换按钮时，终端设备响应于该触发操作，更新显示一条新推荐信息，其中，新推荐信息中的目标表演服饰与最初推荐信息的目标表演服饰(如表演服饰套装3)不同，用户可将新推荐信息中的目标表演服饰作为目标播放节奏所关联的表演服饰，当然，当用户对新推荐信息中的目标表演服饰仍不满意时，仍可触发相应的更换按钮选择新的目标表演服饰直至满意为止。通过上述方式，可创建目标音频中其他播放节奏与相适配的表演服饰之间的关联关系，在对目标音频进行关联设置完成后，即可将该目标音频作为背景音频应用于游戏中虚拟对象的表演录制中。
在一些实施例中，终端设备将所选择的目标音频作为表演录制的背景音频之前，还可通过如下方式建立目标音频所包括的播放节奏与相应的表演服饰之间的关联关系：终端设备对目标音频进行节奏识别，得到目标音频对应的至少两种播放节奏；获取用于对背景音频进行关联设置的至少两个表演服饰，并将各表演服饰与各播放节奏进行匹配，得到相应的匹配度；获取匹配度达到匹配度阈值的至少两个服饰节奏对，其中，服饰节奏对包括一个表演服饰和一个播放节奏；建立各服饰节奏对中表演服饰与播放节奏的关联关系；其中，匹配度阈值的大小可以依据实际需要进行设定，如0.8。
在一些实施例中，终端设备可通过如下方式将各表演服饰与各播放节奏进行匹配：终端设备获取各表演服饰的风格，以及各播放节奏的风格，将各表演服饰的风格与各播放节奏的风格进行匹配，并将匹配结果作为表演服饰与播放节奏的匹配结果。在实际应用中，该风格可以包括：温柔、欢快、忧郁、轻松、安静、伤感等。
这里，在对目标音频进行表演服饰关联设置时，终端设备获取到所选择的目标音频后，自动对目标音频进行节奏识别，得到目标音频对应的至少两种播放节奏，并分别将各播放节奏与用户已设置好的对虚拟场景中的虚拟对象进行表演录制时所装备的表演服饰(如表演服饰套装1、…、表演服饰套装4)进行匹配，即将各播放节奏与各表演服饰进行两两匹配，得到多个服饰节奏对，如服饰节奏对1(播放节奏1、表演服饰套装1)、服饰节奏对2(播放节奏1、表演服饰套装2)、…、服饰节奏对12(播放节奏3、表演服饰套装4)，并获取各服饰节奏对的匹配度，对于每个播放节奏，从包含该播放节奏的各服饰节奏对选择匹配度最大的服饰节奏对，并建立该服饰节奏对中表演服饰与播放节奏之间的关联关系，如对于播放节奏1(对应的播放时刻已知，如对应目标音频的第10秒)，匹配度最大的服饰 节奏对为服饰节奏对2(播放节奏1、表演服饰套装2)，则建立播放节奏1与表演服饰套装2之间的关联关系(即在以目标音频为表演录制额背景音频时，当目标音频播放至第10秒时，将虚拟对象装备的表演服饰自动更换为表演服饰套装2)；通过上述方式，可创建目标音频中其他播放节奏与相适配的表演服饰之间的关联关系，在对目标音频进行关联设置完成后，即可将该目标音频作为背景音频应用于游戏中虚拟对象的表演录制中。
在一些实施例中，终端设备获取到所选择的目标音频后，还可将目标音频与用户已设置好的对虚拟场景中的虚拟对象进行表演录制时所装备的表演服饰(如上述的表演服饰套装1、…、表演服饰套装N)输入至机器学习模型中，通过基于人工智能算法的机器学习模型对目标音频进行表演服饰关联设置，能够使关联设置结果更加智能准确，能够提高目标音频的表演服饰关联设置效率，进而提高表演服饰的更换效率。
步骤103：在对虚拟对象进行表演录制的过程中，播放背景音频，并展示虚拟对象跟随背景音频所执行的表演动作。
这里，在对虚拟场景中的虚拟对象进行表演录制场景应用中，在表演录制过程中，播放背景音频，并展示虚拟对象跟随背景音频所执行的表演动作，其中，表演动作可以包括至少一个动作，至少一个动作中各动作之间是连续的，例如可以连续且重复的执行一个动作，也可以是执行由多个动作组成的动作序列，该动作序列中包括的多个动作是连续的。作为示例，表演动作可以是舞蹈动作(包括多个连续的舞蹈动作)、武术动作(包括多个连续的武术动作)、体操动作(包括多个连续的体操动作)等等。
步骤104：当背景音频的播放节奏发生变化时，自动更换虚拟对象装配的表演服饰，使得虚拟对象的表演服饰与背景音频的播放节奏相对应。
在一些实施例中，在背景音频的播放节奏发生变化前，终端设备可通过如下方式展示虚拟对象跟随背景音频所执行的表演动作：展示装备有第一表演服饰的虚拟对象跟随背景音频所执行的表演动作；相应的，当背景音频的播放节奏发生变化时，终端可通过如下方式自动更换虚拟对象装配的表演服饰：获取播放节奏发生变化后背景音频的播放节奏关联的第二表演服饰；自动将虚拟对象所装备的表演服饰由第一表演服饰切换为第二表演服饰，并展示装备有第二表演服饰的虚拟对象跟随背景音频所执行的表演动作。
在一些实施例中，终端还可通过如下方式实现当背景音频的播放节奏发生变化时，自动更换虚拟对象装配的表演服饰：在播放背景音频的过程中，显示背景音频的播放时间轴，并在播放时间轴中播放节奏发生变化的变化时刻处，显示发生变化的播放节奏所关联的目标表演服饰；当背景音频播放至变化时刻时，自动将虚拟对象装配的表演服饰更换为目标表演服饰，并展示装备有目标表演服饰的虚拟对象跟随背景音频所执行的表演动作，直至背景音频播放至下一个变化时刻处。
参见图6，图6为本申请实施例提供的表演录制的显示示意图，在背景音频的播放时间轴中播放节奏发生变化的变化时刻处，显示发生变化的播放节奏所关联的目标表演服饰，如在播放节奏1(强)处显示关联的表演服饰套装1，在播放节奏2(中)显示关联的表演服饰套装2、在播放节奏3(弱)处显示关联的表演服饰套装3，在背景音频在播放至播放节奏1处之间的时间段1内，虚拟对象装备的服饰为默认套装，当播放至播放节奏1处时，自动将虚拟对象装备的服饰由默认套装更换为表演服饰套装1，并展示装备有表演服饰套装1的虚拟对象跟随背景音频所执行的表演动作，直至播放至播放节奏2处；当背景音频播放至播放节奏2处时，自动将虚拟对象装备的服饰由表演服饰套装1更换为表演服饰套装2，并展示装备有表演服饰套装2的虚拟对象跟随背景音频所执行的表演动作，直至播放至播放节奏3处；依次类推，实现了在播放背景音频的过程中，自动控制虚拟对象在对应节拍点按背景音频时序，自动更换为与背景音频的播放节奏相对应的表演服饰，实现瞬间切换装备的效果。
在一些实施例中，终端设备在自动更换虚拟对象装配的表演服饰时，还可确定与背景音频的播放节奏相适配的画面缩放比例，该画面缩放比例为，针对虚拟对象所录制的表演 画面的缩放比例；伴随背景音频的播放节奏的变化，根据确定的画面缩放比例展示所录制的表演画面，使得表演画面的画面缩放比例与播放节奏相对应。
例如，在进入表演录制时，表演录制界面中呈现背景音频的节奏指示信息，如用户所选背景音频的波形图以告知此背景音频的大概节奏曲线，当还未开始表演录制时，表演画面的缩放比例为1.0，即不会进行任何的画面缩放；当用户点击录制后，开始自动播放背景音频，并依据节奏指示信息所指示的波形图的起伏，对表演画面进行实时的放大或缩小；当节奏指示信息指示背景音频的播放节奏较快(如背景音频的波形图会达到波峰)时，表征背景音频进入高潮阶段，此时表演画面的缩放比例达到最大，以匹配当前背景音频的播放节奏；当节奏指示信息指示背景音频的播放节奏较慢时，背景音频的波形也相对舒缓，此时表演画面的缩放比例也会逐渐缩小，直至缩放至默认的1.0倍；如此，通过对表演录制画面进行缩放调整，在两个不同的播放节奏之间，即使虚拟对象装备有同一套表演服饰，也会有不同的展示效果，丰富了展示样式。
可以理解的是，在本申请实施例中涉及到虚拟场景的场景数据实质是用户的相关数据，当本申请实施例运用到具体产品或技术中时，需要获得用户许可或者同意，且相关数据的收集、使用和处理需要遵守相关国家和地区的相关法律法规和标准。
下面，将说明本申请实施例在一个实际的应用场景中的示例性应用。以虚拟场景为游戏为例，参见图7，图7为本申请实施例提供的表演录制示意图，相关技术在游戏的表演录制前，玩家可先进行表演服饰(如发型、衣服、裤子、背包、头盔)的搭配，如点击仓库选择服饰配件，对服饰配件进行搭配；在保存搭配后，通过将最新搭配的表演服饰保存至相应槽位中即可实现搭配保存；然后，在表演录制过程中，在出生岛选择搭配好的表演服饰(如点击相应的表演服饰套装按钮)，即可实现在局内表演服饰之间的切换显示；然而，此种方式需要玩家手动更换装备的表演服饰，更换的效率较低。
为此，本申请实施例提供一种虚拟场景中的表演录制方法，以提高表演服饰的更换效率。在实际应用中，在虚拟场景中进行表演录制前，可先对虚拟对象(玩家)装备的表演服饰进行设置，接下来以表演服饰以表演服饰套装的形式显示进行说明。参见图8，图8为本申请实施例提供的表演服饰的设置示意图，在虚拟对象进入游戏舞蹈室后，当用户点击服饰按钮501时，终端设备响应于该点击操作，显示表演服饰设置界面，用户可通过表演服饰设置界面中设置几套表演服饰套装，如用户可通过表演服饰设置界面对第一套表演服饰套装中服饰配件(如发型、衣服、鞋子、袜子、配饰等)进行搭配置，搭配保存后即可完成对第一表演服饰套装的设置；此后通过点击切换按钮，即依次对后续第二套表演服饰套装、….、第N(N>2，可根据实际应用设置)套表演服饰套装进行设置。
接下来以(N＝4)，即设置4套表演服饰套装为例进行说明，参见图9，图9为本申请实施例提供的表演服饰的设置示意图，在表演服饰设置界面中，显示4套待设置的表演服饰套装，如套装1、套装2、套装3和套装4，每套表演服饰套装包括4个服饰配件，即每套表演服饰套装对应的4个配件控件，其中，不同的配件控件对应不同类型的服饰配件，如发型控件对应发型配件，衣服控件对应衣服配件；在对每一套表演服饰套装进行设置时，分别针对每套表演服饰套装关联的4个配件控件执行以下操作：响应于针对配件控件的触发操作，显示相应类型的至少一个候选服饰配件；响应于针对至少一个候选配件中目标配件的选择操作，将目标配件确定为配件控件所对应选择的配件；将对应各配件控件所选择的配件进行组合，得到对应的表演服饰套装。
例如，在对套装1进行设置时，当用户点击发型控件时，终端响应于该点击操作，显示可供选择的多个发型，如发型1、发型2、发型3，当用户选择发型3时，则将发型3作为套装1中的发型配件；当用户点击衣服控件时，终端响应于该点击操作，显示可供选择的多个衣服，如衣服1、衣服2、衣服3、衣服4，当用户选择衣服2时，则将衣服2作为套装1中的衣服配件；依次类推，假设选择袜子2作为套装1中的袜子配件，选择鞋子1 作为套装1中的鞋子配件；最后，将发型3、衣服2、袜子2和鞋子1进行组合搭配，得到套装1。通过此方式，即可搭配得到套装2、套装3和套装4，最终将搭配得到的套装1、套装2、套装3和套装4作为对游戏中的虚拟对象进行表演录制时所装备的表演服饰。
需要说明的是，在用户对套装进行设置时，若未点击某一配件控件，则默认为将该配件控件所指示的配件设置为空，如在对套装1进行设置时，若用户未点击发型配件，则默认为未对套装1中的发型进行设置，此时，得到的套装1中的发型可以是虚拟对象的默认发型。
在实际应用中，在虚拟场景中进行表演录制前，还可对表演录制所采用的背景音频进行表演服饰的关联设置，参见图10，图10为本申请实施例提供的背景音频的关联设置示意图，在虚拟对象进入游戏舞蹈室后，当用户点击音频按钮时，终端设备响应于该点击操作，显示背景音频选择界面，背景音频选择界面中显示有多首可供选择的音频，用户可通过背景音频选择界面选择某一音频作为背景音频，如用户选择目标音频时，则将目标音频作为表演录制的背景音频，接下来对目标音频进行表演服饰的关联设置进行说明。
当用户点击换装按钮(上述的音频关联控件)时，终端设备响应于该点击操作，接收到针对目标音频的关联设置操作，响应于该关联设置操作，对目标音频进行节奏点检测，得到目标音频包括的多个节奏点，并在目标音频的关联设置界面中的播放时间轴中显示与目标音频的播放节奏相对应的至少两个节奏点槽位(用于承载待关联的表演服饰，该槽位所在位置为目标音频的节拍、鼓点或节奏点所在位置，该位置对应的播放节奏将发生变化，即该位置为更换表演服饰的位置)；同时，在目标音频的关联设置界面中，显示已设置好的对游戏中的虚拟对象进行表演录制时所装备的表演服饰，如上述搭配得到的套装1、套装2、套装3和套装4；当用户拖动目标表演服饰至目标节奏点槽位时，终端设备响应于该拖动操作，建立目标表演服饰与目标节奏点槽位对应的目标播放节奏的关联关系，如用户将套装1拖动至节拍1所在槽位时，则建立套装1和节拍1之间的关联关系。
通过上述方式，即可建立各个节奏点槽位对应的播放节奏与相应的表演服饰之间的关联关系，在对目标音频进行关联设置完成后，即可将该目标音频作为背景音频应用于游戏中虚拟对象的表演录制中。
在返回主界面开始表演录制时，若选择目标音频作为表演录制的背景音频，则播放该背景音频，并展示虚拟对象跟随背景音频所执行的表演动作，当背景音频的播放节奏发生变化时，自动更换虚拟对象装配的表演服饰，使得虚拟对象的表演服饰与背景音频的播放节奏相对应；例如，在播放目标音频的过程中，显示背景音频的播放时间轴，并在播放时间轴中播放节奏发生变化的变化时刻处，显示发生变化的播放节奏所关联的目标表演服饰；当背景音频播放至变化时刻时，自动将虚拟对象装配的表演服饰更换为目标表演服饰，并展示装备有目标表演服饰的虚拟对象跟随背景音频所执行的表演动作，直至背景音频播放至下一个变化时刻处。
参见图11，图11为本申请实施例提供的表演录制的显示示意图，在背景音频的播放时间轴中播放节奏发生变化的变化时刻处显示发生变化的播放节奏所关联的目标表演服饰，如在节拍1处显示关联的套装1，在节拍2显示关联的套装2、在节拍3处显示关联的套装3，在节拍4显示关联的套装4，在背景音频在播放至节拍1处之间的时间段1内，虚拟对象装备的服饰为默认套装，当播放至节拍1处时，自动将虚拟对象装备的服饰由默认套装更换为套装1，并展示装备有套装1的虚拟对象跟随背景音频所执行的表演动作，直至播放至节拍2处；当背景音频播放至节拍2处时，自动将虚拟对象装备的服饰由套装1更换为套装2，并展示装备有套装2的虚拟对象跟随背景音频所执行的表演动作，直至播放至节拍3处；依次类推，实现了在播放背景音频的过程中，自动控制虚拟对象在对应节拍点按背景音频时序，自动更换为与背景音频的播放节奏相对应的表演服饰，实现瞬间切换装备的效果。
应用本申请实施例，在虚拟场景的表演录制过程中，由于所选择的表演录制的背景音 频包括多种播放节奏，不同的播放节奏关联有不同的表演服饰，故随着表演录制的背景音频的播放节奏的变化，自动更换虚拟对象装配的表演服饰，使得虚拟对象的表演服饰与背景音频的播放节奏相对应，如此，在表演录制过程中，虚拟对象装备的表演服饰随着背景音频的播放节奏的变化而变化，使得虚拟对象装备的表演服饰与背景音频的播放节奏达到很好的呼应，提高了彼此之间的适配度；而且这种表演服饰的更换方式相较于手动切换所要更换的表演服饰而言，大大提高了表演服饰的更换效率。
下面继续说明本申请实施例提供的虚拟场景中的表演录制装置465的实施为软件模块的示例性结构，在一些实施例中，存储在图2中存储器460的虚拟场景中的表演录制装置465中的软件模块可以包括：
显示模块4651，配置为显示装配有表演服饰的虚拟对象、以及配置为选择背景音频的音频控件；
选择模块4652，配置为响应于基于所述音频控件触发的音频选择操作，将所选择的目标音频作为表演录制的背景音频；
其中，所述目标音频包括至少两种播放节奏，不同的播放节奏关联有不同的表演服饰；
录制模块4653，配置为在对所述虚拟对象进行表演录制的过程中，播放所述背景音频，并展示所述虚拟对象跟随所述背景音频所执行的表演动作；
更换模块4654，配置为当所述背景音频的播放节奏发生变化时，自动更换所述虚拟对象装配的表演服饰，其中，所述虚拟对象的表演服饰与所述背景音频的播放节奏相对应。
在一些实施例中，所述装置还包括：关联建立模块，配置为在将所选择的目标音频作为表演录制的背景音频之前，响应于针对所述目标音频的关联设置操作，显示所述目标音频的关联设置界面；在所述目标音频的关联设置界面中，显示用于关联所述目标音频的至少两个表演服饰，并显示所述目标音频的节奏指示信息，所述节奏指示信息用于指示所述目标音频的播放节奏；响应于基于所述节奏指示信息触发的表演服饰关联操作，建立所述表演服饰关联操作所指示的目标表演服饰与目标播放节奏的关联关系。
在一些实施例中，所述装置还包括：第一服饰确定模块，配置为在显示用于关联所述目标音频的至少两个表演服饰之前，显示表演服饰设置界面，该表演服饰设置界面，用于对所述虚拟对象装备的表演服饰进行设置的；在所述表演服饰设置界面中，显示可供选择的至少两个候选表演服饰；响应于针对所述至少两个候选表演服饰中目标数量的候选表演服饰的选择操作，将所述目标数量的候选表演服饰确定为用于关联所述目标音频的表演服饰。
在一些实施例中，所述装置还包括：第二服饰确定模块，配置为在显示用于关联所述目标音频的至少两个表演服饰之前，显示用于对所述虚拟对象装备的表演服饰进行设置的表演服饰设置界面；当所述表演服饰以表演服饰套装的形式显示时，在所述表演服饰设置界面中，显示可供选择的至少两类服饰配件；响应于针对所述至少两类服饰配件中目标类型的服饰配件的选择操作，将所选择的目标类型的服饰配件进行组合；将组合得到的表演服饰套装，确定为用于关联所述目标音频的表演服饰。
在一些实施例中，所述装置还包括：第三服饰确定模块，配置为在显示用于关联所述目标音频的至少两个表演服饰之前，显示用于对所述虚拟对象装备的表演服饰进行设置的表演服饰设置界面；当所述表演服饰以表演服饰套装的形式显示时，在所述表演服饰设置界面中，显示所述表演服饰套装对应的至少两个配件控件，不同的配件控件对应不同类型的服饰配件；针对各所述配件控件所对应的类型，响应于针对所述配件控件的触发操作，显示相应类型的至少一个候选服饰配件；响应于针对所述至少一个候选配件中目标配件的选择操作，将所述目标配件确定为针对所述类型所选择的配件；将针对各所述类型所选择的配件进行组合，得到对应的表演服饰套装，并将所述表演服饰套装确定为用于关联所述目标音频待的表演服饰。
在一些实施例中，所述关联建立模块，还配置为显示所述目标音频的播放时间轴，在所述播放时间轴中显示与所述目标音频的播放节奏相对应的至少两个节奏点槽位，并将所述节奏点槽位作为所述节奏指示信息；其中，所述节奏点槽位用于承载待关联的表演服饰；接收到针对所述至少两个表演服饰中目标表演服饰的拖动操作，当所述拖动操作指示将所述目标表演服饰拖动至目标节奏点槽位时，将所述拖动操作确定为所述表演服饰关联操作；响应于所述表演服饰关联操作，建立所述目标表演服饰与所述目标节奏点槽位对应的目标播放节奏的关联关系。
在一些实施例中，所述关联建立模块，还配置为显示至少两个变化时刻，该变化时刻为，所述目标音频的播放节奏发生变化的时刻，并在各所述变化时刻的关联区域处，显示所述变化时刻对应的节奏指示信息；响应于针对所述至少两个变化时刻中目标变化时刻对应的目标节奏指示信息的选择操作，显示对应所述目标节奏指示信息的至少一个表演服饰选项，其中，每个所述表演服饰选项对应一个表演服饰；响应于针对所述至少一个表演服饰选项中目标表演服饰选项的选择操作，控制所述目标表演服饰选项对应的目标表演服饰处于选中状态；响应于针对所述目标表演服饰的确定操作，接收到所述表演服饰关联操作；响应于所述表演服饰关联操作，建立所述目标表演服饰与所述目标变化时刻对应的目标播放节奏的关联关系。
在一些实施例中，所述关联建立模块，还配置为响应于针对所述至少两个表演服饰中目标表演服饰的选择操作，显示对应所述目标表演服饰的至少一个播放节奏选项，并将各所述播放节奏选项作为所述节奏指示信息；响应于针对所述至少一个播放节奏选项中目标播放节奏选项的选择操作，控制所述目标播放节奏选项对应的目标播放节奏处于选中状态；响应于针对所述目标播放节奏的确定操作，接收到所述表演服饰关联操作；响应于所述表演服饰关联操作，建立所述目标表演服饰与所述目标播放节奏的关联关系。
在一些实施例中，所述关联建立模块，还配置为显示所述目标音频包括的至少两个播放节奏，并将所述至少两个播放节奏作为所述节奏指示信息；响应于针对所述至少两个播放节奏中目标播放节奏的选择操作，显示用于对所述目标播放节奏关联的表演服饰进行推荐设置的推荐信息，所述推荐信息中包括推荐的目标表演服饰；响应于针对所述推荐信息的确定操作，接收到所述表演服饰关联操作；响应于所述表演服饰关联操作，建立所述目标表演服饰与所述目标播放节奏的关联关系。
在一些实施例中，所述装置还包括：第一生成模块，配置为在显示所述目标音频的节奏指示信息之前，对所述目标音频进行节奏点检测，得到所述目标音频包括的至少两个节奏点；基于各所述节奏点，生成所述目标音频的节奏指示信息。
在一些实施例中，所述装置还包括：第二生成模块，配置为在显示所述目标音频的节奏指示信息之前，基于预设采样频率，对所述目标音频进行采样处理，得到所述目标音频包括的多个音频帧中各音频帧的频率；分别对各所述音频帧的频率进行傅里叶变换，得到对应各所述音频帧的频谱图；基于各所述音频帧的频谱图，生成所述目标音频的节奏指示信息。
在一些实施例中，所述关联建立模块，还配置为在将所选择的目标音频作为表演录制的背景音频之前，对所述目标音频进行节奏识别，得到所述目标音频对应的至少两种播放节奏；获取用于对所述背景音频进行关联设置的至少两个表演服饰，并将各所述表演服饰与各所述播放节奏进行匹配，得到相应的匹配度；获取所述匹配度达到匹配度阈值时所对应的至少两个服饰节奏对，所述服饰节奏对包括一个表演服饰和一个播放节奏；建立各所述服饰节奏对中表演服饰与播放节奏的关联关系。
在一些实施例中，所述录制模块，还配置为展示装备有第一表演服饰的所述虚拟对象跟随所述背景音频所执行的表演动作；所述更换模块，还配置为当所述背景音频的播放节奏发生变化时，获取播放节奏发生变化后所述背景音频的播放节奏关联的第二表演服饰；自动将所述虚拟对象所装备的表演服饰由所述第一表演服饰切换为所述第二表演服饰，并 展示装备有所述第二表演服饰的所述虚拟对象跟随所述背景音频所执行的表演动作。
在一些实施例中，所述更换模块，还配置为在播放所述背景音频的过程中，显示所述背景音频的播放时间轴，并在所述播放时间轴中所述播放节奏发生变化的变化时刻处，显示发生变化的播放节奏所关联的目标表演服饰；当所述背景音频播放至所述变化时刻时，自动将所述虚拟对象装配的表演服饰更换为所述目标表演服饰，并展示装备有所述目标表演服饰的所述虚拟对象跟随所述背景音频所执行的表演动作，直至所述背景音频播放至下一个变化时刻处。
在一些实施例中，所述装置还包括：缩放模块，配置为在自动更换所述虚拟对象装配的表演服饰时，确定与所述背景音频的播放节奏相适配的所录制的表演画面的缩放比例；伴随所述背景音频的播放节奏的变化，根据相应的缩放比例展示所录制的表演画面，使得所述表演画面的缩放比例与所述播放节奏相对应。
本申请实施例提供了一种计算机程序产品或计算机程序，该计算机程序产品或计算机程序包括计算机指令，该计算机指令存储在计算机可读存储介质中。计算机设备的处理器从计算机可读存储介质读取该计算机指令，处理器执行该计算机指令，使得该计算机设备执行本申请实施例上述的虚拟场景中的表演录制方法。
本申请实施例提供一种存储有可执行指令的计算机可读存储介质，其中存储有可执行指令，当可执行指令被处理器执行时，将引起处理器执行本申请实施例提供的虚拟场景中的表演录制方法，例如，如图3示出的方法。
在一些实施例中，计算机可读存储介质可以是只读存储器(Read-Only Memory，ROM)、随即存储器(Random Access Memory，RAM)、可擦写可编程只读存储器(Erasable Programmable Read-Only Memory，EPROM)、电可擦可编程只读存储器(Electrically Erasable Programmable Read-Only Memory，EEPROM)、闪存、磁表面存储器、光盘、或CD-ROM等存储器；也可以是包括上述存储器之一或任意组合的各种设备。
在一些实施例中，可执行指令可以采用程序、软件、软件模块、脚本或代码的形式，按任意形式的编程语言(包括编译或解释语言，或者声明性或过程性语言)来编写，并且其可按任意形式部署，包括被部署为独立的程序或者被部署为模块、组件、子例程或者适合在计算环境中使用的其它单元。
作为示例，可执行指令可以但不一定对应于文件系统中的文件，可以可被存储在保存其它程序或数据的文件的一部分，例如，存储在超文本标记语言(HTML，Hyper Text Markup Language)文档中的一个或多个脚本中，存储在专用于所讨论的程序的单个文件中，或者，存储在多个协同文件(例如，存储一个或多个模块、子程序或代码部分的文件)中。
作为示例，可执行指令可被部署为在一个计算设备上执行，或者在位于一个地点的多个计算设备上执行，又或者，在分布在多个地点且通过通信网络互连的多个计算设备上执行。
以上所述，仅为本申请的实施例而已，并非用于限定本申请的保护范围。凡在本申请的精神和范围之内所作的任何修改、等同替换和改进等，均包含在本申请的保护范围之内。

Claims (18)

  1. 一种虚拟场景中的表演录制方法，所述方法由电子设备执行，所述方法包括：
    显示装配有表演服饰的虚拟对象、及用于选择背景音频的音频控件；
    响应于基于所述音频控件触发的音频选择操作，将所选择的目标音频作为表演录制的背景音频；其中，所述目标音频包括至少两种播放节奏，不同的播放节奏关联有不同的表演服饰；
    在对所述虚拟对象进行表演录制的过程中，播放所述背景音频，并展示所述虚拟对象跟随所述背景音频所执行的表演动作；
    当所述背景音频的播放节奏发生变化时，自动更换所述虚拟对象装配的表演服饰，其中，所述虚拟对象的表演服饰与所述背景音频的播放节奏相对应。
  2. 如权利要求1所述的方法，其中，所述将所选择的目标音频作为表演录制的背景音频之前，所述方法还包括：
    响应于针对所述目标音频的关联设置操作，显示用于关联所述目标音频的至少两个表演服饰，并显示所述目标音频的节奏指示信息；
    其中，所述节奏指示信息，用于指示所述目标音频的播放节奏；
    基于所述节奏指示信息，响应于针对目标表演服饰的表演服饰关联操作，建立所述目标表演服饰与目标播放节奏的关联关系。
  3. 如权利要求2所述的方法，其中，所述显示用于关联所述目标音频的至少两个表演服饰之前，所述方法还包括：
    显示表演服饰设置界面，所述表演服饰设置界面，用于对所述虚拟对象装备的表演服饰进行设置；
    在所述表演服饰设置界面中，显示可供选择的至少两个候选表演服饰；
    响应于针对所述至少两个候选表演服饰中目标数量的候选表演服饰的选择操作，将所述目标数量的候选表演服饰确定为用于关联所述目标音频的表演服饰。
  4. 如权利要求2所述的方法，其中，所述显示用于关联所述目标音频的至少两个表演服饰之前，所述方法还包括：
    显示表演服饰设置界面，所述表演服饰设置界面，用于对所述虚拟对象装备的表演服饰进行设置；
    当所述表演服饰以表演服饰套装的形式显示时，在所述表演服饰设置界面中，显示可供选择的至少两类服饰配件；
    响应于针对所述至少两类服饰配件中目标类型的服饰配件的选择操作，将所选择的目标类型的服饰配件进行组合；
    将组合得到的表演服饰套装，确定为用于关联所述目标音频的表演服饰。
  5. 如权利要求2所述的方法，其中，所述显示用于关联所述目标音频的至少两个表演服饰之前，所述方法还包括：
    显示表演服饰设置界面，所述表演服饰设置界面，用于对所述虚拟对象装备的表演服饰进行设置；
    当所述表演服饰以表演服饰套装的形式显示时，在所述表演服饰设置界面中，显示所述表演服饰套装对应的至少两个配件控件，不同的配件控件对应不同类型的服饰配件；
    针对各所述配件控件所对应的类型，响应于针对所述配件控件的触发操作，显示相应类型的至少一个候选服饰配件；
    响应于针对所述至少一个候选配件中目标配件的选择操作，将所述目标配件确定为针对所述类型所选择的配件；
    将针对各所述类型所选择的配件进行组合，得到表演服饰套装，并将所述表演服饰套装确定为用于关联所述目标音频待的表演服饰。
  6. 如权利要求2所述的方法，其中，所述显示所述目标音频的节奏指示信息，包括：
    显示所述目标音频的播放时间轴，在所述播放时间轴中显示与所述目标音频的播放节奏相对应的至少两个节奏点槽位，并将所述节奏点槽位作为所述节奏指示信息；其中，所述节奏点槽位用于承载待关联的表演服饰；
    所述表演服饰关联操作为针对所述目标表演服饰的拖动操作，所述基于所述节奏指示信息，响应于针对目标表演服饰的表演服饰关联操作，建立所述目标表演服饰与目标播放节奏的关联关系，包括：
    响应于所述拖动操作，当所述目标表演服饰被拖动至目标节奏点槽位时，将所述目标节奏点槽位对应的播放节奏确定为目标播放节奏，并建立所述目标表演服饰与所述目标播放节奏的关联关系。
  7. 如权利要求2所述的方法，其中，所述显示用于关联所述目标音频的至少两个表演服饰，包括：
    显示至少两个变化时刻，所述变化时刻为，所述目标音频的播放节奏发生变化的时刻；
    在各所述变化时刻的关联区域处，显示所述变化时刻对应的节奏指示信息；
    响应于针对目标变化时刻对应的目标节奏指示信息的选择操作，显示对应所述目标节奏指示信息的至少一个表演服饰选项，其中，每个所述表演服饰选项对应一个表演服饰；
    所述基于所述节奏指示信息，响应于针对目标表演服饰的表演服饰关联操作，建立所述目标表演服饰与目标播放节奏的关联关系，包括：
    响应于针对目标表演服饰选项的选择操作，控制所述目标表演服饰选项对应的目标表演服饰处于选中状态；
    响应于针对所述目标表演服饰的确定操作，将所述确定操作确定为所述表演服饰关联操作；
    响应于所述表演服饰关联操作，建立所述目标表演服饰与所述目标变化时刻的目标播放节奏的关联关系。
  8. 如权利要求2所述的方法，其中，所述显示所述目标音频的节奏指示信息，包括：
    响应于针对所述至少两个表演服饰中目标表演服饰的选择操作，显示对应所述目标表演服饰的至少一个播放节奏选项，并将各所述播放节奏选项作为所述节奏指示信息；
    所述基于所述节奏指示信息，响应于针对目标表演服饰的表演服饰关联操作，建立所述目标表演服饰与目标播放节奏的关联关系，包括：
    响应于针对目标播放节奏选项的选择操作，控制所述目标播放节奏选项处于选中状态；
    响应于针对所述目标播放节奏的确定操作，将所述确定操作确定为所述表演服饰关联操作；
    响应于所述表演服饰关联操作，建立所述目标表演服饰与所述目标播放节奏选项对应的目标播放节奏的关联关系。
  9. 如权利要求2所述的方法，其中，所述显示所述目标音频的节奏指示信息，包括：
    显示所述目标音频包括的至少两个播放节奏，并将所述至少两个播放节奏作为所述节奏指示信息；
    所述方法还包括：
    响应于针对所述至少两个播放节奏中目标播放节奏的选择操作，显示推荐信息，所述推荐信息，用于对所述目标播放节奏关联的表演服饰进行推荐设置，所述推荐信息中包括推荐的目标表演服饰；
    所述基于所述节奏指示信息，响应于针对目标表演服饰的表演服饰关联操作，建立所述目标表演服饰与目标播放节奏的关联关系，包括：
    响应于针对所述推荐信息的确定操作，将所述确定操作确定为所述表演服饰关联操作；
    响应于所述表演服饰关联操作，建立推荐的所述目标表演服饰与所述目标播放节奏的关联关系。
  10. 如权利要求2所述的方法，其中，所述显示所述目标音频的节奏指示信息之前，所述方法还包括：
    对所述目标音频进行节奏点检测，得到所述目标音频包括的至少两个节奏点；
    基于各所述节奏点，生成所述目标音频的节奏指示信息。
  11. 如权利要求1所述的方法，其中，所述将所选择的目标音频作为表演录制的背景音频之前，所述方法还包括：
    对所述目标音频进行节奏识别，得到所述目标音频的至少两种播放节奏；
    获取用于对所述背景音频进行关联设置的至少两个表演服饰，并将各所述表演服饰与各所述播放节奏进行匹配，得到相应的匹配度；
    获取所述匹配度达到匹配度阈值的至少两个服饰节奏对，所述服饰节奏对包括一个表演服饰和一个播放节奏；
    建立各所述服饰节奏对中表演服饰与播放节奏的关联关系。
  12. 如权利要求1所述的方法，其中，所述展示所述虚拟对象跟随所述背景音频所执行的表演动作，包括：
    展示装备有第一表演服饰的所述虚拟对象跟随所述背景音频所执行的表演动作；
    所述当所述背景音频的播放节奏发生变化时，自动更换所述虚拟对象装配的表演服饰，包括：
    当所述背景音频的播放节奏发生变化时，获取播放节奏发生变化后所述背景音频的播放节奏关联的第二表演服饰；
    将所述虚拟对象所装备的表演服饰，自动由所述第一表演服饰切换为所述第二表演服饰，并展示装备有所述第二表演服饰的所述虚拟对象跟随所述背景音频所执行的表演动作。
  13. 如权利要求1所述的方法，其中，所述当所述背景音频的播放节奏发生变化时，自动更换所述虚拟对象装配的表演服饰，包括：
    在播放所述背景音频的过程中，显示所述背景音频的播放时间轴，并在所述播放时间轴中所述播放节奏发生变化的变化时刻处，显示发生变化的播放节奏所关联的目标表演服饰；
    当所述背景音频播放至所述变化时刻时，自动将所述虚拟对象装配的表演服饰更换为所述目标表演服饰，并展示装备有所述目标表演服饰的所述虚拟对象跟随所述 背景音频所执行的表演动作，直至所述背景音频播放至下一个变化时刻处。
  14. 如权利要求1所述的方法，其中，所述方法还包括：
    在自动更换所述虚拟对象装配的表演服饰时，确定与所述背景音频的播放节奏相适配的画面缩放比例，所述画面缩放比例为录制的表演画面的缩放比例；
    伴随所述背景音频的播放节奏的变化，根据相应的画面缩放比例展示所录制的表演画面，其中，所述表演画面的画面缩放比例与所述播放节奏相对应。
  15. 一种虚拟场景中的表演录制装置，所述装置包括：
    显示模块，配置为显示装配有表演服饰的虚拟对象、及用于选择背景音频的音频控件；
    选择模块，配置为响应于基于所述音频控件触发的音频选择操作，将所选择的目标音频作为表演录制的背景音频；其中，所述目标音频包括至少两种播放节奏，不同的播放节奏关联有不同的表演服饰；
    录制模块，配置为在对所述虚拟对象进行表演录制的过程中，播放所述背景音频，并展示所述虚拟对象跟随所述背景音频所执行的表演动作；
    更换模块，配置为当所述背景音频的播放节奏发生变化时，自动更换所述虚拟对象装配的表演服饰，其中，所述虚拟对象的表演服饰与所述背景音频的播放节奏相对应。
  16. 一种电子设备，所述电子设备包括：
    存储器，配置为存储可执行指令；
    处理器，配置为执行所述存储器中存储的可执行指令时，实现权利要求1至14任一项所述的虚拟场景中的表演录制方法。
  17. 一种计算机可读存储介质，所述计算机可读存储介质存储有可执行指令，用于被处理器执行时，实现权利要求1至14任一项所述的虚拟场景中的表演录制方法。
  18. 一种计算机程序产品，包括计算机程序或指令，所述计算机程序或指令被处理器执行时，实现权利要求1至14任一项所述的虚拟场景中的表演录制方法。
PCT/CN2022/133709 2022-03-10 2022-11-23 虚拟场景中的表演录制方法、装置、设备、存储介质及程序产品 WO2023168990A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210231332.5 2022-03-10
CN202210231332.5A CN116764240A (zh) 2022-03-10 2022-03-10 虚拟场景中的表演录制方法、装置、设备及存储介质

Publications (1)

Publication Number Publication Date
WO2023168990A1 true WO2023168990A1 (zh) 2023-09-14

Family

ID=87937135

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/133709 WO2023168990A1 (zh) 2022-03-10 2022-11-23 虚拟场景中的表演录制方法、装置、设备、存储介质及程序产品

Country Status (3)

Country Link
US (1) US20240037884A1 (zh)
CN (1) CN116764240A (zh)
WO (1) WO2023168990A1 (zh)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120258797A1 (en) * 2011-04-08 2012-10-11 Disney Enterprises, Inc. Recording audio in order to affect gameplay experience
CN110020903A (zh) * 2018-01-08 2019-07-16 广东欧珀移动通信有限公司 模拟用户试装的方法、装置、存储介质及移动终端
US20190236209A1 (en) * 2018-01-29 2019-08-01 Gary Bencar Artificial intelligence methodology to automatically generate interactive play along songs
CN110213613A (zh) * 2018-08-09 2019-09-06 腾讯科技（深圳）有限公司 图像处理方法、装置及存储介质
CN110300242A (zh) * 2019-07-05 2019-10-01 北京乐元素文化发展有限公司 虚拟形象的表演系统
CN110472099A (zh) * 2018-05-10 2019-11-19 腾讯科技（深圳）有限公司 互动视频生成方法及装置、存储介质
CN111489424A (zh) * 2020-04-10 2020-08-04 网易（杭州）网络有限公司 虚拟角色表情生成方法、控制方法、装置和终端设备
CN112541959A (zh) * 2020-12-21 2021-03-23 广州酷狗计算机科技有限公司 虚拟对象显示方法、装置、设备及介质
CN113113045A (zh) * 2021-04-02 2021-07-13 广州繁星互娱信息科技有限公司 场景画面展示方法、装置、终端及存储介质

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120258797A1 (en) * 2011-04-08 2012-10-11 Disney Enterprises, Inc. Recording audio in order to affect gameplay experience
CN110020903A (zh) * 2018-01-08 2019-07-16 广东欧珀移动通信有限公司 模拟用户试装的方法、装置、存储介质及移动终端
US20190236209A1 (en) * 2018-01-29 2019-08-01 Gary Bencar Artificial intelligence methodology to automatically generate interactive play along songs
CN110472099A (zh) * 2018-05-10 2019-11-19 腾讯科技（深圳）有限公司 互动视频生成方法及装置、存储介质
CN110213613A (zh) * 2018-08-09 2019-09-06 腾讯科技（深圳）有限公司 图像处理方法、装置及存储介质
CN110300242A (zh) * 2019-07-05 2019-10-01 北京乐元素文化发展有限公司 虚拟形象的表演系统
CN111489424A (zh) * 2020-04-10 2020-08-04 网易（杭州）网络有限公司 虚拟角色表情生成方法、控制方法、装置和终端设备
CN112541959A (zh) * 2020-12-21 2021-03-23 广州酷狗计算机科技有限公司 虚拟对象显示方法、装置、设备及介质
CN113113045A (zh) * 2021-04-02 2021-07-13 广州繁星互娱信息科技有限公司 场景画面展示方法、装置、终端及存储介质

Also Published As

Publication number Publication date
US20240037884A1 (en) 2024-02-01
CN116764240A (zh) 2023-09-19

Similar Documents

Publication Publication Date Title
CN110225388B (zh) 直播互动的处理方法、装置、电子设备及存储介质
WO2023082927A1 (zh) 虚拟场景中任务引导方法、装置、电子设备、存储介质及程序产品
CN112691377A (zh) 虚拟角色的控制方法、装置、电子设备及存储介质
WO2022242260A1 (zh) 游戏中的互动方法、装置、设备及存储介质
TWI818343B (zh) 虛擬場景的適配顯示方法、裝置、電子設備、儲存媒體及電腦程式產品
CN111913624B (zh) 虚拟场景中对象的交互方法及装置
TWI831074B (zh) 虛擬場景中的信息處理方法、裝置、設備、媒體及程式產品
CN112669194A (zh) 虚拟场景中的动画处理方法、装置、设备及存储介质
CN114344896A (zh) 基于虚拟场景的合拍处理方法、装置、设备及存储介质
JP2018108150A (ja) プログラム、ゲーム装置、及びサーバ装置
US20230350554A1 (en) Position marking method, apparatus, and device in virtual scene, storage medium, and program product
WO2023168990A1 (zh) 虚拟场景中的表演录制方法、装置、设备、存储介质及程序产品
WO2023138142A1 (zh) 虚拟场景中的运动处理方法、装置、设备、存储介质及程序产品
WO2019201822A1 (en) Tangible mobile game programming environment for non-specialists
CN113763568A (zh) 增强现实的显示处理方法、装置、设备及存储介质
CN115396685B (zh) 直播互动方法、装置、可读存储介质及电子设备
WO2024037139A1 (zh) 虚拟场景中的信息提示方法、装置、电子设备、存储介质及程序产品
Beksa et al. Adapting videogame interfaces for the visually impaired: a case study of audio game hub
WO2024021792A1 (zh) 虚拟场景的信息处理方法、装置、设备、存储介质及程序产品
US20240091650A1 (en) Systems and methods for modifying user sentiment for playing a game
US11995311B2 (en) Adaptive display method and apparatus for virtual scene, electronic device, storage medium, and computer program product
WO2024060888A1 (zh) 虚拟场景的交互处理方法、装置、电子设备、计算机可读存储介质及计算机程序产品
US20230381649A1 (en) Method and system for automatically controlling user interruption during game play of a video game
CN112800252A (zh) 虚拟场景中媒体文件的播放方法、装置、设备及存储介质
WO2024060924A1 (zh) 虚拟场景的互动处理方法、装置、电子设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22930613

Country of ref document: EP

Kind code of ref document: A1