WO2025016144A1 - Scene adjustment method and apparatus, device, and storage medium - Google Patents

Abstract

The present invention provides a scene adjustment method and apparatus, a device, and a storage medium. The method comprises: acquiring status information of a target object in a virtual scene; on the basis of the status information of the target object, adjusting environment information in the virtual scene.

Description

Scene adjustment method, device, equipment and storage medium

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based on and claims the priority of a Chinese patent application with application number 202310870291.9 and application date July 14, 2023. The disclosed content of the Chinese patent application is hereby introduced as a whole into this application.

Technical Field

The embodiments of the present application relate to the field of computer technology, and in particular to a scene adjustment method, apparatus, device and storage medium.

Background Art

With the development of Extended Reality (XR) technology, users can watch various virtual live broadcasts through electronic devices such as XR devices, Virtual Reality (VR) devices or Augmented Reality (AR), thereby obtaining an immersive live broadcast experience that cannot be experienced on traditional electronic devices such as mobile phones or tablets.

Summary of the invention

The present application provides a scene adjustment method, apparatus, device and storage medium.

In a first aspect, an embodiment of the present application provides a scene adjustment method, including:

Obtaining status information of target objects in the virtual scene;

According to the state information of the target object, the environmental information in the virtual scene is adjusted.

In a second aspect, an embodiment of the present application provides a scene adjustment device, including:

An information acquisition module is used to obtain the status information of the target object in the virtual scene;

The scene adjustment module is used to adjust the environment information in the virtual scene according to the state information of the target object.

In a third aspect, an embodiment of the present application provides an electronic device, including:

A processor and a memory, the memory being used to store a computer program, and the processor being used to call and run the computer program stored in the memory to execute the scene adjustment method described in the first aspect embodiment or its various implementation methods.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium for storing a computer program, wherein the computer program enables a computer to execute the scene adjustment method as described in the embodiment of the first aspect or its various implementations.

In a fifth aspect, an embodiment of the present application provides a computer program product comprising program instructions, which, when executed on an electronic device, enables the electronic device to execute the scene adjustment method as described in the embodiment of the first aspect or its various implementations.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will describe the technical solutions required in the embodiments. The accompanying drawings are briefly introduced. Obviously, the accompanying drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without any creative work.

FIG1 is a schematic diagram of a flow chart of a scene adjustment method provided in an embodiment of the present application;

FIG2 is a schematic diagram of setting up a performance stage and various decorative objects in a virtual scene provided by an embodiment of the present application;

FIG3 is a flow chart of another scene adjustment method provided in an embodiment of the present application;

FIG4 is a flow chart of another scene adjustment method provided in an embodiment of the present application;

FIG5 is a schematic diagram of a flow chart of another scene adjustment method provided in an embodiment of the present application;

FIG6 is a schematic diagram of adjusting any environmental parameter on a control panel according to an embodiment of the present application;

FIG7 is a schematic block diagram of a scene adjustment device provided in an embodiment of the present application;

FIG8 is a schematic block diagram of an electronic device provided in an embodiment of the present application.

DETAILED DESCRIPTION

The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. According to the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

Considering that users currently watch various virtual live broadcasts based on electronic devices such as XR devices, virtual reality (VR) devices or augmented reality (AR), such as live music performances or live DJing, the environmental information in the performance space where the performers are located is usually expressed in a single form, which cannot meet the diverse viewing needs of users, resulting in limited visual experience for users. To this end, the present application provides a scene adjustment scheme to enrich the expression of environmental information in the performance space, thereby providing users with more colorful visual effects and artistic appeal to meet the diverse viewing needs of users and enhance their visual experience. At the same time, it can also enhance the attractiveness and viewing value of music performances.

In order to facilitate understanding of the embodiments of the present application, before describing each embodiment of the present application, some concepts involved in all embodiments of the present application are first appropriately explained, as follows:

1) Virtual Reality (VR), a technology for creating and experiencing a virtual world, generates a virtual environment through computational means, and is a kind of multi-source information (the virtual reality mentioned in this article includes at least visual perception, and can also include auditory perception, tactile perception, motion perception, and even taste perception, olfactory perception, etc.), realizing the fusion of virtual environments, interactive three-dimensional dynamic vision and simulation of entity behaviors, allowing users to immerse themselves in a simulated virtual reality environment, and realizing applications in a variety of virtual environments such as maps, games, videos, education, medical treatment, simulation, collaborative training, sales, assisted manufacturing, maintenance and repair, etc.

2) Virtual reality devices (VR devices), terminals for realizing virtual reality effects, can usually be provided in the form of glasses, helmet-mounted displays (Head Mount Display, HMD), and contact lenses to realize visual perception and other forms of perception. Of course, the form of virtual reality devices is not limited to this, and can be further miniaturized or enlarged according to actual needs.

Optionally, the virtual reality devices described in the embodiments of the present application may include but are not limited to the following types:

2.1) PC-based virtual reality (PCVR) devices use the PC to perform relevant calculations and data output for virtual reality functions. External PC-based virtual reality devices use the data output by the PC to achieve virtual reality effects.

2.2) Mobile virtual reality devices support the configuration of mobile terminals (such as smart phones) in various ways (such as head-mounted displays with dedicated card slots). Through wired or wireless connection with the mobile terminal, the mobile terminal performs relevant calculations of virtual reality functions and outputs data to the mobile virtual reality device, such as watching virtual reality videos through the mobile terminal's APP.

2.3) All-in-one virtual reality devices have a processor for performing relevant calculations of virtual functions, and thus have independent virtual reality input and output functions. They do not need to be connected to a PC or mobile terminal and have a high degree of freedom in use.

3) Augmented Reality (AR): A technology that calculates the camera’s attitude parameters in the real world (or three-dimensional world, real world) in real time during the process of the camera capturing images, and adds virtual elements to the images captured by the camera based on the camera attitude parameters. Virtual elements include but are not limited to: images, videos, and three-dimensional models. The goal of AR technology is to integrate the virtual world with the real world on the screen for interaction.

4) Mixed Reality (MR): A simulated set that integrates computer-created sensory input (e.g., virtual objects) with sensory input from a physical set or its representation. In some MR sets, the computer-created sensory input can adapt to changes in the sensory input from the physical set. In addition, some electronic systems used to present MR sets can monitor the orientation and/or position relative to the physical set to enable virtual objects to interact with real objects (i.e., physical elements from the physical set or their representations). For example, the system can monitor movement so that virtual plants appear stationary relative to physical buildings.

5) Extended Reality (XR) refers to all real and virtual combined environments and human-computer interactions generated by computer technology and wearable devices, which include virtual reality (VR), augmented reality (AR) and mixed reality (MR) and other forms.

6) Virtual scene (also known as virtual space) is a virtual scene displayed (or provided) when the application is running on an electronic device. The virtual scene can be a simulation of the real world or a semi-simulated and semi-fictional virtual scene. It can also be a purely fictitious virtual scene. The virtual scene can be any one of a two-dimensional virtual scene, a 2.5-dimensional virtual scene or a three-dimensional virtual scene. The embodiment of the present application does not limit the dimension of the virtual scene. For example, the virtual scene may include the sky, land, ocean, etc. The land may include environmental elements such as deserts and cities, and the user can control the virtual object to move in the virtual scene.

7) Virtual objects are objects that interact in virtual scenes and are controlled by users or robot programs (for example, robot programs based on artificial intelligence). They can be still, move, and perform various behaviors in virtual scenes, such as various characters in games.

After introducing some concepts involved in the embodiments of the present application, a scene adjustment method, device, equipment and storage medium provided in the embodiments of the present application are specifically described below with reference to the accompanying drawings.

Figure 1 is a flow chart of a scene adjustment method provided in an embodiment of the present application. The scene adjustment method provided in an embodiment of the present application can be performed by a scene adjustment device. The scene adjustment device can be composed of hardware and/or software and can be integrated into an electronic device. In an embodiment of the present application, the electronic device can be selected as an XR device, or it can be any other hardware device that can provide a virtual scene. Among them, the XR device can be a VR device, an AR device, or an MR device, etc., and the present application does not specifically limit the type of electronic device.

As shown in FIG1 , the method comprises the following steps:

S101, obtaining status information of a target object in a virtual scene.

S102: Adjusting environmental information in the virtual scene according to the state information of the target object.

Optionally, the user can select any type of virtual scene from multiple types of virtual scenes provided by the electronic device display interface and enter the virtual scene, so that the user can watch the performance of the performer in the virtual scene as an audience.

That is to say, when the performance screen displayed in the virtual scene entered by the user is a live video stream screen, the virtual scene can be understood as a live performance room.

It should be understood that the above-mentioned performers and users entering the virtual scene can be real people or virtual objects, such as virtual characters Avatar. Among them, the virtual objects can be created based on real people, or customized according to the performance needs of the performers, or customized according to the viewing needs of the audience, etc., and this application does not impose any restrictions on them.

Among them, when customizing virtual objects, it can be implemented based on the role creation function provided by the electronic device. The specific creation process can be referred to the existing solution, and it will not be described in detail here.

In addition, a performance stage and various decorative objects, such as various lights, display screens and props, can be set up in the above-mentioned virtual scene to enhance the performance effect of the performers in the virtual scene and serve as a foil for the performers' performance process. At the same time, the atmosphere between the performers and the audience in the entire virtual scene can also be adjusted to make the performance more contagious.

The above-mentioned various decorative objects can be set on the performance stage, as well as other areas besides the performance stage, such as the audience seating area, etc., and this application does not impose any restrictions on this.

For example, if the virtual scene that the user enters is a live music performance room, the virtual scene may be provided with The performance stage can be equipped with various decorative objects such as lights, display screens and props, as well as various musical instruments or equipment required for music performances. In addition, other areas of the virtual scene, such as the viewing area where the audience can watch the performance, can also be equipped with decorative objects such as lights and props to set off the entire performance process of the performer, as shown in Figure 2.

Considering that after the user enters the virtual scene, the user can not only watch the performer's performance content, but also interact with the performer in various ways. Therefore, the present application can adjust the environmental information in the virtual scene based on the performer's performance content in the virtual scene and/or based on the interactive operation of the user as the audience, so as to achieve a more intelligent, accurate and diversified performance effect, thereby improving the performer's performance effect and the user's viewing experience.

That is, the target object in this application includes the performer's performance content and/or user interaction operations.

Because the performance content of the performer corresponds to different status information, such as the status information that can be selected as the music audio information and performance content type of the current performance. And the interactive operations of the users as the audience also correspond to different status information, such as the status information that can be selected as operation instructions, interactive elements and interactive status. Therefore, when the present application adjusts the environmental information in the virtual scene based on the performance content of the performers in the virtual scene or the interactive operations of the users, it can specifically dynamically adjust the environmental information in the virtual scene based on the status information of the performance content, and/or dynamically adjust the environmental information in the virtual scene based on the status information of the user interactive operations, so that the relatively static environmental information in the virtual scene becomes more diversified and interactive, thereby bringing more colorful performance effects to the performers' performances, while enhancing the viewing experience of the audience users.

The scene adjustment method provided by the present application obtains the state information of the target object in the virtual scene, and adjusts the environmental information in the virtual scene according to the state information of the target object. Thus, the environmental information in the virtual scene where the performer is located can be adjusted in real time based on the acquired state information of the target object, thereby enriching the environmental information expression form of the performance space, thereby providing users with more colorful visual effects and artistic appeal, so as to meet the diverse viewing needs of users, enhance the visual experience of users, and also enhance the attractiveness and appreciation of music performances.

Considering that the target object in this application can be the performance content of the performer or the interactive operation of the user as the audience, referring to FIG. 3 below, the target object is the performance content of the performer, and the environmental information in the virtual scene is adjusted based on the state information of the performance content for specific description.

As shown in FIG3 , the method may include the following steps:

S201: If the target object is performance content, obtain current music audio information and/or content type of the performance content in the virtual scene.

Among them, the current music audio information can be understood as the real-time audio of a certain piece of music that the performer is currently performing. For example, the real-time audio of a certain piece of music that the performer is performing on a disc table or a disc (Disco jockey, DJ) stage on the performance stage. For another example, the real-time audio of a certain piece of music played by a performer on the performance stage through a certain instrument. For another example, the real-time audio of the background music played when the performer is dancing on the performance stage, and so on.

The content type of the above performance content can be determined according to the performance content of the performer. For example, if the performance content is a performance of a musical instrument, ...

It should be understood that the present application obtains the current music audio information and/or content type of the performance content in the virtual scene, which may be to obtain the current music audio information of the performance content in the virtual scene; or, it may be to obtain the content type of the performance content in the virtual scene; or, it may be to obtain the current music audio information and content type of the performance content in the virtual scene, and the present application does not impose any restrictions on this.

In some optional implementations, when a performer is performing in a virtual scene, the current music audio information and/or content type of the performance content can be acquired in real time in different ways.

Optionally, obtaining the current music audio information of the performance content may be achieved by using an audio extraction tool or an audio extraction algorithm, and the present application does not impose any restrictions on the method of obtaining the current music audio information. The audio extraction tool may be an audio extractor or audio extraction software, and the like.

Considering that when a virtual scene is used as a live broadcast room, the performer needs to set the content type of the performance content in the live broadcast room before performing a live performance in the live broadcast room. Therefore, this application obtains the content type of the performance content by searching the content type of the performance content in the virtual scene in the virtual scene setting information; or, it can also intercept the performance video clip and identify it through the performance video clip to determine the content type of the performance content, etc., and there is no restriction on it here.

The above-mentioned performance video clips that are identified and intercepted can be input into a type recognition model to process the performance video clips through the type recognition model to determine the content type of the performance content, or can be analyzed and processed by other recognition algorithms to determine the content of the performance content. Among them, the type recognition model can be a pre-trained network model. The specific training process of the model can refer to the existing training method, which will not be described in detail here.

S202: Determine target environment information according to current music audio information and/or content type of the performance content.

In the present application, the target environment information may include at least one of the following: lighting effects, theme special effects, environment maps, and prop materials.

The above-mentioned lighting effects can be understood as the lighting effects in the virtual scene. Theme effects can be understood as the corresponding animation effects when the virtual scene presents any theme to the user. Environment maps can be understood as the atmosphere maps presented by the stage background or other visible areas, such as a blue sky and white cloud map on the top of the stage, or a large grassland map on the stage floor. Prop materials can be understood as the prop materials presented in the virtual scene, such as prop color, prop transparency, and prop luminosity.

Optionally, determine the target environment information, which may include the following situations:

Case 1

Target environment information is determined based on current music audio information of the performance content.

Considering that music audio information includes rhythm and beat, the present application determines the target environment information according to the current music audio information of the performance content, and optionally first determines the rhythm and/or beat of the current music audio information, and then determines the target environment information according to the rhythm and/or beat of the current music audio information.

Among them, the rhythm and/or beat of the current music audio information can be understood as the rhythm of the current music audio information; or, it can also be the beat of the current music audio information; or, it can also be the rhythm and beat of the current music audio information.

Optionally, determining the rhythm and/or beat of the current music audio information may be implemented in the following ways:

The first implementation method is

According to the spectrum analysis method, the current music audio information is analyzed and processed to determine the rhythm and/or beat of the current music audio information.

Among them, the spectrum analysis method specifically refers to a music analysis algorithm integrated within the Unity engine.

The spectrum analysis method within the Unity engine is used to analyze and process the music audio. Specifically, based on the sound wave frequency that can be heard by the human ear, such as 20 to 20,000 vibrations per second, that is, between 20 Hz and 20,000, the continuous signal (i.e., sound wave) is reduced to a discrete signal (i.e., a series of sample data) by sampling. Then, the discrete signal is converted using the fast Fourier transform algorithm, for example, by calling the fast Fourier transform algorithm through the Audio Source.GetSpectrumData command. Then, the converted signal is serialized into a preset numerical range through a serialization script to obtain the rhythm and/or beat of the music audio.

The above preset numerical range can be flexibly set according to actual needs, for example, it can be [0, 1], etc. This application does not impose any restrictions on this range.

The second implementation method is

According to the rhythm detection algorithm, the rhythm of the current music audio information is determined.

The rhythm detection algorithm may be a pre-trained rhythm detection model or a music rhythm extraction algorithm, etc., and there is no limitation on it here.

The third method,

According to the beat detection algorithm, the beat of the current music audio information is determined.

It should be noted that the present application can also determine the rhythm of the current music audio information through a beat detection model or a music beat extraction algorithm, and the present application does not impose any specific restrictions on this.

The second and third methods can be implemented separately or in combination, specifically according to the rhythm and/or beat of the current music audio information. Specifically, when the rhythm of the current music audio information is determined, the second method is implemented separately; when the beat of the current music audio information is determined, the third method is implemented separately; when the rhythm and beat of the current music audio information are determined, the second and third methods are implemented in combination.

Generally speaking, rhythm refers to organizing sounds of different lengths to form regular changes in strength, which can be understood as the proportional balance of the entire music. Beat refers to the regular cycle of strong and weak beats of equal duration, specifically the total length of notes in each measure in the score. Therefore, when determining the rhythm and/or beat of the current music audio information through the above three methods, it is also possible to determine the rhythm strength value and/or beat strength value of the music audio.

After determining the rhythm and/or beat of the current music audio information, the present application can search for a corresponding rhythm and/or beat of the current music audio information in a pre-established first mapping relationship according to the rhythm and/or beat of the current music audio information. The target environment information is obtained and the found scene information is determined as the target environment information.

The above-mentioned pre-established first mapping relationship may be a mapping relationship between rhythm and environmental information, or a mapping relationship between beat and environmental information, or a mapping relationship between rhythm, beat and environmental information.

Case 2

Determine the target environment information based on the content type of the performance content.

Optionally, in order to enrich the environment information of the virtual scene, a mapping relationship between the content type and the environment information, i.e., a second mapping relationship, may be pre-established. Further, according to the content type of the performance content, the environment information corresponding to the content type may be searched in the pre-established second mapping relationship, and the searched scene information may be determined as the target environment information.

Case 3

The target environment information is determined based on the current music audio information and content type of the performance content.

Specifically, the present application can determine the first environment information according to the current music audio information of the performance content, and determine the second environment information according to the content type of the performance content, and then merge the first environment information and the second environment information to obtain the target environment information.

Among them, the implementation principle of determining the first environmental information is the same or similar to the implementation principle of the aforementioned situation one. The specific implementation process can be referred to in part of the aforementioned situation, and no further details are given here. In addition, the implementation principle of determining the first environmental information is the same or similar to the implementation principle of the aforementioned situation two. The specific implementation process can be referred to in part of the aforementioned situation two, and no further details are given here.

It should be understood that the above fusion of the first environment information and the second environment information is specifically to add the same environment parameters at the same time to achieve fusion; or to add the same environment parameters at the same time and multiply them by the fusion parameter to achieve fusion, etc. Among them, the fusion parameter can be flexibly set according to the fusion effect, such as the fusion parameter is 0.5 or 0.7, etc., which is not specifically limited here.

For example, the first environment information at time t1 includes: the first lighting effect, the first environment map and the first prop material; the second environment information at time t1 includes: the second lighting effect, the second environment map and the second prop material. Then, the first environment information and the second environment information at time t1 are merged, specifically, the first lighting effect + the second lighting effect, the first environment map + the second environment map, and the first prop material + the second prop material.

For another example, the first environment information at time t1 includes: the first lighting effect, the first environment map and the first prop material; the second environment information at time t1 includes: the second lighting effect, the second environment map and the second prop material, and the fusion parameter is a = 0.5. Then, the first environment information and the second environment information at time t1 are fused, specifically (first lighting effect + second lighting effect) * 0.5, (first environment map + second environment map) * 0.5, and (first prop material + second prop material) * 0.5.

Considering that the environmental parameters included in the first environmental information and the second environmental information at the same time may be different. For example, the first environmental information at time t2 includes: the first lighting effect and the first theme special effect; the second environmental information at time t2 includes: the second lighting effect and the second environmental map. Then, only the same environmental parameters at the same time are added, and the different environmental parameters are directly reused to obtain the fused target environmental information.

Continuing with the first environmental information and the second environmental information at time t2 as an example, the first environmental information and the second environmental information at time t2 are specifically integrated, specifically the first lighting effect + the second lighting effect, the first theme special effect and the second environmental map.

It can be understood that the present application pre-configures various environmental information to the client by pre-establishing a first mapping relationship, or pre-establishing a second mapping relationship, so that when the client needs to adjust the environmental information of the virtual scene, it can directly call any pre-configured environmental information, thereby eliminating the need for real-time calculation and real-time rendering, which can greatly save resource consumption of electronic devices and improve the display performance of electronic devices.

In addition, the above-mentioned pre-configured environmental information can also support resource reuse. For example, when the rhythm and/or beat of the music audio information at a certain moment is the same as the rhythm and/or beat of the music audio at any previous historical moment, the environmental information used at any previous historical moment can be directly called from the database, thereby reducing the production cost of environmental information resources.

Among them, the database refers to a library that stores various environmental information pre-made by technicians. As mentioned above, the database can be stored on the electronic device (such as a client) side, or it can be stored on the electronic device communication connection server side, and this application does not impose any restrictions on this. The above-mentioned technicians pre-produce various environmental information, including parameters such as environmental maps, lighting effects, theme special effects and/or prop materials. The advantage of this setting is that it can not only achieve resource reuse and resource sharing, but also when new environmental information needs to be produced, the technician can select the corresponding environmental data from the database for parameter fine-tuning, or recombine to obtain new environmental information, so as to reduce production costs and avoid repeated production and waste of resources.

S203: Adjust the environment information in the virtual scene according to the target environment information.

The target environment information may include at least one of the following: lighting effects, theme effects, environment maps, and prop materials.

In some optional implementations, the present application adjusts the current environment information of the virtual scene in real time according to the target environment information, including at least one of the following:

According to the lighting effects in the target environment information, the lighting control components in virtual engines such as Unity are used to control the color, brightness, position, shape, motion trajectory and other parameters of the light through programming.

According to the prop material in the target environment information, the material control components in virtual engines such as Unity are used to control the material's color, transparency, reflectivity, luminosity and other parameters through programming.

According to the theme special effects in the target environment information, the special effects control components in virtual engines such as Unity are used to control the shape, size, color, motion trajectory and other parameters of the special effects through programming.

That is to say, by utilizing the target environmental information, the environmental information currently presented in the virtual scene can be adjusted in real time, so that the environmental information presented in the virtual scene can change accordingly with the rhythm and/or beat of the music audio, and/or the change of content type, thereby bringing richer performance effects to the performance in the virtual scene, making the traditional relatively static environmental information more diverse and interactive, thereby improving the performance performance ability and user visual experience in the entire virtual scene.

The scene adjustment method provided by the present application obtains the state information of the target object in the virtual scene, and adjusts the environmental information in the virtual scene according to the state information of the target object. Thus, the environmental information in the virtual scene where the performer is located is adjusted in real time based on the acquired state information of the target object, so that the environmental information expression form of the performance space can be enriched, thereby providing users with more colorful visual effects and artistic appeal to meet the diverse viewing needs of users, improve the visual experience of users, and also improve the attractiveness and appreciation of music performances. In addition, by adjusting the environmental information in the virtual scene in real time according to the current music audio information and/or content type of the performance content in the virtual scene, a richer performance effect can be brought to the performance in the virtual scene, making the traditional relatively static environmental information more diverse and interactive, thereby improving the performance performance ability and the visual experience of users in the entire virtual scene.

On the basis of the above-mentioned embodiments, considering that the rhythm and/or beat of the music audio information have corresponding strength values, when the present application determines the target environment information according to the current music audio information of the performance content, the target environment information can be determined according to the rhythm strength value and/or beat strength value of the current music audio information. The following is a specific description of determining the target environment information according to the rhythm strength value and/or beat strength value of the current music audio information in the present application in conjunction with FIG4. Referring to FIG4, the method may include the following steps:

S301: If the target object is the performance content, obtain current music audio information of the performance content in the virtual scene.

S302, determining the rhythm and/or beat of the current music audio information.

S303: Determine the target environment information according to the rhythm strength value and/or beat strength value of the current music audio information.

Considering that when determining the rhythm and/or beat of the current music audio information, the rhythm strength value and/or beat strength value of the current music audio information can also be determined. Therefore, the present application can determine the target environment information according to the determined rhythm strength value and/or beat strength value.

Optionally, when determining the target environmental information based on the rhythm strength value and/or beat strength value of the current music audio information, specifically, search for environmental information corresponding to the rhythm strength value and/or beat strength value of the current music audio information in a pre-established third mapping relationship, and use the environmental information as the target environmental information.

Among them, the pre-established third mapping relationship can be a mapping relationship between rhythm strength values and environmental information, or a mapping relationship between beat strength values and environmental information, or a mapping relationship between rhythm strength values, beat strength values and environmental information.

That is to say, the present application determines the target environmental information based on the rhythm strength value and/or beat strength value of the current music audio information, including: determining the target environmental information in the mapping relationship between the rhythm strength value and the environmental information based on the rhythm strength value of the current music audio information; or, determining the target environmental information in the mapping relationship between the beat strength value and the environmental information based on the beat strength value of the current music audio information; or, determining the target environmental information in the mapping relationship between the rhythm strength value, the beat strength value and the environmental information based on the rhythm strength value and the beat strength value of the current music audio information.

In some optional implementations, the pre-established mapping relationship between the rhythm strength value and the environmental information may be as shown in the following Table 1:

Table 1

In some optional implementations, the pre-established mapping relationship between the beat strength value and the environmental information may be as shown in Table 2 below:

Table 2

In some optional implementations, the pre-established mapping relationship between the rhythm strength value, the beat strength value and the environmental information may be as shown in the following Table 3:

Table 3

It should be noted that the preset numerical interval [0,1] corresponding to the rhythm strength value and/or beat strength value in Table 1, Table 2 and Table 3 above can be flexibly adjusted according to actual needs, and the interval value for dividing the numerical interval [0,1] can be adjusted according to the scene adjustment accuracy. The above division method is only used as an exemplary description of the present application and is not a specific limitation on the present application. For example, in addition to 0.1, the interval value for dividing the numerical interval [0,1] can also be 0.05 as the interval value for segmentation, or 0.15 as the interval value for segmentation, and the present application does not impose any restrictions on it.

For example, assuming that the rhythm strength value of the current music audio information is determined to be 0.2, then in the mapping relationship between the beat strength value and the environmental information established in advance, such as in Table 2 above, the environmental information found according to the rhythm strength value 0.2 includes: the lighting effect is the adjustment of the light from the first color to the second color; the theme effect is theme effect A; the environmental map is the environmental map X2, such as seaweed and small fish; the prop material is the color value of the prop color remains unchanged at the second value. Then, the environmental information found above can be used as the target environmental information.

It is worth noting that when the target environment information is determined in the mapping relationship between the rhythm strength value, the beat strength value and the environment information according to the rhythm strength value and the beat strength value of the current music audio information, it is possible that the rhythm strength value and the beat strength value are In the case where the beat strength values are inconsistent, the rhythm strength value or the beat strength value can be used as a search condition at this time, and the target environment information is determined in the mapping relationship between the rhythm strength value, the beat strength value and the environmental information. Alternatively, according to the preset priority of the rhythm strength value and the beat strength value, the strength value corresponding to the highest priority is used as a search condition, and the target environment information is determined in the mapping relationship between the rhythm strength value, the beat strength value and the environmental information. Exemplarily, if the priority of the rhythm strength value is higher than the beat strength value, then when the rhythm strength value and the beat strength value are inconsistent, the rhythm strength value is used as a search condition to determine the target environment information. For another example, if the priority of the beat strength value is higher than the rhythm strength value, then when the rhythm strength value and the beat strength value are inconsistent, the beat strength value is used as a search condition to determine the target environment information.

Considering that when determining the target environment information in a pre-established third mapping relationship based on the rhythm strength value and/or beat strength value of the current music audio information, the target environment information may not be found in the pre-established third mapping relationship because the accuracy of the rhythm strength value and/or beat strength value is different from the accuracy in the pre-established third mapping relationship.

To this end, the present application can solve the accuracy of the rhythm strength value and/or the beat strength value through the following situations. When the accuracy is different from the accuracy in the pre-established third mapping relationship, the target environment information is searched in the pre-established third mapping relationship:

The first case

If the accuracy of the rhythm strength value and/or the beat strength value is 0.01, and the accuracy in the pre-established third mapping relationship is 0.1, the rhythm strength value and/or the beat strength value is adjusted by rounding off so that the accuracy of the adjusted rhythm strength value and/or the adjusted beat strength value is the same as the accuracy of the pre-established third mapping relationship, so that the target environment information corresponding to the rhythm strength value and/or the beat strength value can be found from the pre-established third mapping relationship.

For example, the rhythm strength value of a certain music audio is 0.09, and the precision of the pre-established third mapping relationship is 0.1, such as the above Table 1. Because the last digit 9 in 0.09 is greater than 5, the unit to the left of 9 can be moved up one digit, so that the adjusted rhythm strength value changes from 0.09 to 0.1. Furthermore, according to the adjusted rhythm strength value 0.1, it can be determined from Table 1 that the environmental information corresponding to the rhythm strength value 0.1 includes: the lighting effect is the light brightness adjusted from the first value to the second value; the theme effect is the theme effect A; the environmental map is the environmental map X1, such as seaweed, etc.; the prop material is the color value of the prop color adjusted from the first value to the second value. Then, the above-searched environmental information is used as the target environmental information.

Second situation

The value of the strength value in the pre-established third mapping relationship is set to an interval, thereby determining the rhythm strength value interval corresponding to the rhythm strength value of the current music audio information and/or the beat strength value interval corresponding to the beat strength value of the current music audio information. Then, according to the rhythm strength value interval and/or the beat strength value interval, the target environment information is determined in the preset mapping relationship.

Among them, the preset mapping relationship is the mapping relationship between the rhythm strength value interval and the environmental information, the mapping relationship between the beat strength value interval and the environmental information, or the mapping relationship between the rhythm strength value interval, the beat strength value interval and the environmental information.

Considering that the implementation principle and implementation process of each of the above preset mapping relationships are the same or similar, the mapping relationship between the rhythm strength value interval and the environmental information is mainly used as an example for explanation below.

Assume that the mapping relationship between the above-mentioned rhythm strength value interval and environmental information includes five rhythm strength value intervals, specifically: [0,0.2), [0.2,0.4), [0.4,0.6), [0.6,0.8), [0.8,1], and the environmental information corresponding to each rhythm strength value interval is: the first group of environmental information, the second group of environmental information, the third group of environmental information, the fourth group of environmental information, and the fifth group of environmental information. For details, please refer to the following Table 4.

Table 4

If the rhythm strength value of the audio information of a certain piece of music at the current moment is 0.51, then the rhythm strength value interval corresponding to the rhythm strength value 0.51 is determined to be [0.4, 0.6). Furthermore, according to the rhythm strength value interval [0.4, 0.6), the target environmental information is determined to be the third group of environmental information in the mapping relationship between the rhythm strength value interval and the environmental information, and the third group of environmental information includes: the lighting effect is that the first group of lights are on and the second group of lights are off; the theme special effect is theme special effect B; the environmental map is environmental map Y2; the color value of the prop color remains unchanged at the fourth value.

S304, adjusting the environment information of the music performance stage according to the target environment information.

Optionally, after determining the target environment information corresponding to the rhythm strength value and/or the beat strength value of the current music audio information, the present application can adjust the current environment information in the virtual scene based on the target environment information, so that the environment information presented in the virtual scene can be dynamically adjusted in real time with the rhythm strength value and/or the beat strength value of the music audio information. Therefore, it enriches the expression of stage environment information.

The scene adjustment method provided by the embodiment of the present application obtains the current music audio information of the performance content in the virtual scene, and determines the rhythm and/or beat of the current music audio, so as to determine the target environment information according to the rhythm strength value and/or beat strength value of the current music audio information, and then adjusts the environment information in the virtual scene according to the target environment information. In this way, the environmental information expression form of the performance space can be enriched, so that users can be provided with more colorful visual effects and artistic appeal to meet the diverse viewing needs of users, enhance the visual experience of users, and also enhance the attractiveness and appreciation of music performances. In addition, it can also bring richer performance effects to the performances in the virtual scene, making the traditional relatively static environmental information more diverse and interactive, thereby improving the performance performance ability and the visual experience of users in the entire virtual scene.

Considering that the target object in this application can be the performance content of the performer or the user interaction operation of the audience, the following is a specific description of adjusting the environment information in the virtual scene based on the state information of the user interaction operation, taking the target object as the user interaction operation, in conjunction with FIG. 5 .

As shown in FIG5 , the method comprises the following steps:

S401: If the target object is a user interactive operation, obtain an operation instruction, interactive element or interactive state of the user interactive operation in the virtual scene.

S402: Determine target environment information according to an operation instruction, interactive element or interactive state of a user interactive operation.

Considering that the user as an audience may interact based on the performance content in the virtual scene, such as interacting with the performer, actively triggering interactive operation instructions such as adjusting the environmental information in the virtual scene, etc. Therefore, this application can obtain the operation instruction, interactive element or interactive state corresponding to the user's interactive operation. Then, the target environmental information is determined according to the operation instruction, interactive element or interactive state of the user's interactive operation.

The above-mentioned operation instructions can be understood as the triggering instructions of any environmental parameters by the user on the control panel provided in the virtual scene. Among them, the operation panel can be a virtual screen located in the virtual scene, so that the user as the audience can perform various live broadcast operations through the control panel, such as adjusting the environmental parameters in the virtual scene.

Interactive elements can be understood as various elements that improve the interactive atmosphere, such as pen refill emojis, like emojis, fireworks emojis, text emojis, etc. There are no restrictions on them here.

The interactive state can be understood as the state of the user in the virtual scene, where the state of the user in the virtual scene can be a spectator or a performer. In other words, the user can switch his state from the spectator state to the performer state and perform a live performance in the virtual scene.

In some optional implementations, the target environment information is determined according to the operation instruction, interactive element or interactive state of the user interaction operation, which may include the following situations:

Scenario 1

In response to the user's operation instruction on any environmental parameter on the control panel, the target environmental information is determined. The control panel is located in the virtual scene.

As shown in Figure 6, assuming that the user triggers the environment adjustment control on the control panel, the control panel switches from the current display interface to the environment adjustment interface, where the environment adjustment interface may include various environment parameter items, such as lighting effects, theme effects, and environment maps. Furthermore, the user can adjust any environment parameter item according to his or her own adjustment needs for the environmental information in the virtual scene. When the electronic device obtains the user's adjustment instruction for any environment parameter item on the environment adjustment interface, it counts which environment parameter items are adjusted, and obtains the target environment information based on the adjusted environment parameters. It should be noted that in addition to being options, each environment parameter in Figure 6 can also be a progress bar set for each environment parameter, so that the user drags the progress bar to adjust the environment parameter.

Scenario 2

In response to the interactive operation triggered by the user, an interactive element corresponding to the interactive operation is determined, and the interactive element is added to the current environment information of the interactive scene to obtain the target environment information.

Considering that users as audiences can interact with performers or follow the performance content while watching the performance of performers. When users interact, they can manipulate fluorescent sticks or other types of interactive objects by manipulating interactive controllers such as handles, hand controllers, or gloves; or, users can also interact by holding fluorescent sticks or other objects with bare hands; or, users can also interact by manipulating interactive controllers, etc. This application does not impose any restrictions on the interaction method.

When the electronic device detects an interactive operation triggered by a user, it first determines the interactive element corresponding to the interactive operation, and then adds the determined interactive element to the current environment information of the virtual scene to obtain the target environment information.

For example, if the interactive operation triggered by the user is to swing a fluorescent stick left and right with bare hands, the interactive element corresponding to the interactive operation can be determined in the pre-established mapping relationship between interactive operations and interactive elements. Then, the interactive element corresponding to the interactive operation is added to the current environment information in the virtual scene to obtain the target environment information.

In an optional implementation of the present application, the pre-established mapping relationship between interactive operations and interactive elements may be as shown in the following Table 5:

Table 5

It should be noted that the mapping relationship between the above-mentioned interactive operations and interactive elements can be flexibly adjusted and updated according to the adjustment requirements of the environmental information in the virtual scene.

Scenario 3

In response to the identity switching operation triggered by the user, the user's identity is switched from audience to performer. Further, the target environment information is determined according to the performance content of the user whose interactive status is performer.

Considering that the audience and performers can switch identities in the virtual scene to increase the interactive effect of the entire live broadcast room, High audience participation enthusiasm. Therefore, when a user wants to perform music as a performer, the user can send an identity switching operation through voice, eye tracking, gestures, or a control handle to switch the user's audience identity to a performer, and then perform in the virtual scene as a performer in the interactive state, and then determine the target environment information according to the user's performance content.

For example, the user can trigger the identity switching operation by clicking the identity switching control displayed on the live broadcast room through the control handle. Then, the electronic device can switch the user's identity from audience to performer according to the identity switching operation triggered by the user.

When the user triggers the identity switching operation, there may be a performer currently performing. At this time, the electronic device will display a prompt message to the user such as: A performer is currently performing, please wait. When it is determined that the above performer has finished the performance, the electronic device performs the identity switching operation to switch the user's identity from the audience to the latest performer, so that the user can perform as a performer, so that the user can more freely control the performance effect in the virtual scene, improving the efficiency and quality of the performance.

S403: Adjust the environment information in the virtual scene according to the target environment information.

After determining the target environment information, the present application can update the environment information in the virtual scene in real time based on the target environment information.

In some optional implementations, when the target environmental information is to add the interactive elements corresponding to the user's interactive operation to the current environmental information of the virtual scene, then when the environmental information within the virtual scene is adjusted, the corresponding interactive elements can be displayed near the interactive operation triggered by the user, so as to respond to the user's interactive operation, improve the visual effect of the user's interaction and the interactive atmosphere of the entire virtual scene.

Taking into account that there can be multiple audiences in a virtual scene, when any audience triggers an interactive operation in the virtual scene and adjusts the current environmental information in the virtual scene based on the target environmental information determined by the interactive elements of the interactive operation, the present application preferably only adjusts the environmental information seen by the user who triggers the interactive operation, so that the user who triggers the interactive operation can see the corresponding interactive response from his or her own perspective, while no processing is performed in the vision of other users. This allows for a single-person interactive response to an interactive operation triggered by a single person, thereby avoiding the abrupt feeling of environmental information adjustment that occurs to other users while they are watching the performance due to the lack of an interactive operation being triggered.

It should be noted that when the user performs as a performer, the present application will execute steps S201 to S203, or steps S301 to S304 in the aforementioned embodiments, so as to achieve real-time dynamic adjustment of the environmental information in the virtual scene following the performer's performance, thereby improving the performance ability of the virtual scene and the visual effect of the user.

In an optional implementation, when the user performs interactive operations in a virtual scene, the present application can optionally perform enhanced display based on the current environmental information of the virtual scene to adjust the environmental information, thereby further improving the user's interactive interest and enthusiasm. Among them, enhanced display can be understood as increasing the brightness of the light, driving the playback of preset special effects and/or turning on and off preset light groups, etc. based on the current environmental information presentation.

The above current environment information is the environment information before adjustment or the environment information after adjustment, and no restriction is imposed on it here.

As an optional implementation, the enhanced display of the current environment information of the virtual scene may include at least one of the following situations:

First case

If the motion trajectory of the interactive controller manipulated by the user is a preset motion trajectory, the current environment information in the virtual scene is enhanced and displayed according to the motion trajectory.

Among them, the motion trajectory of the interactive controller can be determined according to the position data in the posture data determined by the inertial measurement unit data sent by the inertial measurement unit (IMU) in the interactive controller. The specific determination process is the conventional technology in the field and will not be elaborated here.

In this application, the preset motion trajectory can be set according to actual interaction needs, such as drawing a circle or a center.

Optionally, the present application may compare the motion trajectory of the interactive controller with a preset motion trajectory. If the motion trajectory is the same as any preset motion trajectory, the current environmental information in the virtual scene is enhanced and displayed according to the enhanced display method associated with the preset motion trajectory.

The enhanced display mode associated with the preset motion trajectory may be a mapping relationship between the motion trajectory and the enhanced display mode pre-built by the technician, and the mapping relationship may also be stored in the database. In addition, the technician may also update the mapping relationship between the motion trajectory and the enhanced display mode at regular intervals to meet the needs of the virtual scene to respond to the interactive operation in a personalized manner through environmental information.

Case 2

If the movement amplitude of the user manipulating the interactive controller reaches the amplitude threshold, the current environment information in the virtual scene is enhanced and displayed according to the movement amplitude.

The movement amplitude of the interactive controller can be determined based on the inertial measurement unit data sent by the inertial measurement unit (IMU) in the interactive controller. Specifically, the movement distance of the user manipulating the interactive controller can be determined based on the position data in the posture data determined by the inertial measurement unit data, and the movement distance is determined as the movement amplitude of the interactive controller. The movement distance can be determined based on the position data of the interactive controller, and can be determined based on a two-point distance calculation formula, such as calculating the Euclidean distance, etc., which is not specifically limited here.

In this application, the amplitude threshold can be set according to actual interaction requirements, such as 20 cm or 40 cm, etc. This application does not impose any restrictions on it.

Optionally, the present application may compare the movement amplitude of the interactive controller with the amplitude threshold, and if the movement amplitude is greater than the amplitude threshold, the current environment information in the virtual scene is enhanced and displayed in a preset enhanced display mode. Otherwise, the current environment information in the virtual scene is enhanced and displayed without any processing.

There may be multiple preset enhanced display modes. When the motion amplitude is greater than the amplitude threshold, any mode is randomly selected from the multiple preset enhanced display modes for response display, thereby increasing the diversity and interest of the response.

Case 3

If the movement frequency of the user manipulating the interactive controller reaches a frequency threshold, the current environment information in the virtual scene is enhanced and displayed according to the movement frequency.

In the present application, the frequency threshold can be set according to the actual interaction needs. For example, if the number of times the interactive controller is shaken within 1 minute reaches 5 times, the frequency threshold is f=1/5; or, if the number of times the interactive controller is shaken within 5 minutes reaches 30 times, the frequency threshold is f=1/30, etc. This application does not impose any restrictions on it.

Optionally, the present application can capture real-time images of the user operating the interactive controller through a camera on a head-mounted display device in an electronic device, and then identify the real-time tracking image captured by the camera to determine the movement frequency of the interactive controller. The specific identification method can refer to the existing implementation method, which will not be described in detail here.

Furthermore, the electronic device may compare the movement frequency of the interactive controller with the frequency threshold, and if the movement frequency is greater than the frequency threshold, the current environment information in the virtual scene is enhanced and displayed in a preset enhanced display manner. Otherwise, the current environment information in the virtual scene is enhanced and displayed without any processing.

There may be multiple preset enhanced display modes. When the motion frequency is greater than a frequency threshold, any mode is randomly selected from the multiple preset enhanced display modes for response display, thereby increasing the diversity and interest of the response.

Case 4

If the motion trajectory of the user's hand is a preset motion trajectory, the current environment information in the virtual scene is enhanced and displayed according to the motion trajectory.

The user's hand may be understood as the user's real hand, or a virtual hand model presented in the virtual space, and no specific limitation is imposed on it here.

Optionally, the present application can collect real-time images of the user's hands through a camera on a head-mounted display device in an electronic device, and then identify the real-time tracking image collected by the camera to determine the movement trajectory of the user's hands. The specific identification method can refer to the existing implementation method, which will not be described in detail here.

Furthermore, the motion trajectory of the user's hand can be compared with the preset motion trajectory. If the motion trajectory is the same as any preset motion trajectory, the current environmental information in the virtual scene is enhanced and displayed according to the enhanced display method associated with the preset motion trajectory.

The enhanced display mode associated with the preset motion trajectory may be a mapping relationship between the motion trajectory and the enhanced display mode pre-constructed by the technician, and the mapping relationship may also be stored in the database. In addition, the technician may also update the mapping relationship between the motion trajectory and the enhanced display mode at regular intervals to meet the personalized display requirements of different performance stages.

Case 5

If the movement amplitude of the user's hand reaches the amplitude threshold, the current environment information in the virtual scene is enhanced and displayed according to the movement amplitude.

In this application, the amplitude threshold can be set according to actual interaction requirements, such as 20 cm or 40 cm, etc. This application does not impose any restrictions on it.

Optionally, the present application can collect real-time images of the user's hands through a camera on a head-mounted display device in an electronic device, and then identify the real-time tracking image collected by the camera to determine the movement amplitude of the user's hands. The specific identification method can refer to the existing implementation method, which will not be described in detail here.

Furthermore, the movement amplitude of the user's hand can be compared with the amplitude threshold, and if the movement amplitude is greater than the amplitude threshold, the current environment information in the virtual scene is enhanced and displayed according to the preset enhanced display mode. Otherwise, the current environment information in the virtual scene is enhanced and displayed without any processing.

There may be multiple preset enhanced display modes. When the motion amplitude is greater than the amplitude threshold, any mode is randomly selected from the multiple preset enhanced display modes for response display, thereby increasing the diversity and interest of the response.

Case 6

If the movement frequency of the user's hand reaches a frequency threshold, the current environment information in the virtual scene is enhanced and displayed according to the movement frequency.

In the present application, the frequency threshold can be set according to the actual interaction needs. For example, if the number of times the interactive controller is shaken within 1 minute reaches 5 times, the frequency threshold is f=1/5; or, if the number of times the interactive controller is shaken within 5 minutes reaches 30 times, the frequency threshold is f=1/30, etc. This application does not impose any restrictions on it.

Optionally, the present application can collect real-time images of the user's hands through a camera on a head-mounted display device in an electronic device, and then identify the real-time tracking images collected by the camera to determine the movement frequency of the user's hands. The specific identification method can refer to the existing implementation method, which will not be described in detail here.

Furthermore, the electronic device may compare the movement frequency of the user's hand with the frequency threshold, and if the movement frequency is greater than the frequency threshold, the current environment information in the virtual scene is enhanced and displayed in a preset enhanced display manner. Otherwise, the current environment information in the virtual scene is enhanced and displayed without any processing.

There may be multiple preset enhanced display modes. When the motion frequency is greater than a frequency threshold, any mode is randomly selected from the multiple preset enhanced display modes for response display, thereby increasing the diversity and interest of the response.

Situation 7

If the user gesture is a preset gesture, the current environment information in the virtual scene is enhanced and displayed according to the gesture.

In the present application, the preset gesture may be a pre-set gesture, and the gesture may be flexibly adjusted according to actual interaction needs, such as: a thumbs-up gesture, a heart gesture, etc., and no specific restrictions are imposed here.

Optionally, the present application can collect real-time images of the user's hands through a camera on a head-mounted display device in an electronic device, and then identify the real-time tracking image collected by the camera to determine the gestures made by the user's hands. The specific identification method can refer to the existing implementation method, which will not be described in detail here.

Furthermore, the electronic device can compare the gesture made by the user's hand with the preset gesture. If the gesture made by the user's hand is the same as any preset gesture, the current environmental information in the virtual scene is enhanced and displayed according to the enhanced display method associated with the preset gesture.

The enhanced display mode associated with the preset gesture may be a mapping relationship between the gesture and the enhanced display mode pre-built by the technician, and the mapping relationship may also be stored in the database. In addition, the technician may also update the mapping relationship between the gesture and the enhanced display mode at regular intervals to meet the personalized display requirements of different performance stages.

That is, in response to the interactive operation triggered by the user, the present application adds information about the current environment in the virtual scene. Strong display, including at least one of the following:

If the motion trajectory of the interactive controller controlled by the user is a preset motion trajectory, the current environment information in the virtual scene is enhanced and displayed according to the motion trajectory;

If the movement amplitude of the user's manipulation of the interactive controller reaches the amplitude threshold, the current environment information in the virtual scene is enhanced and displayed according to the movement amplitude;

If the movement frequency of the user manipulating the interactive controller reaches a frequency threshold, the current environment information in the virtual scene is enhanced and displayed according to the movement frequency;

If the motion trajectory of the user's hand is a preset motion trajectory, the current environment information in the virtual scene is enhanced and displayed according to the motion trajectory;

If the movement amplitude of the user's hand reaches the amplitude threshold, the current environment information in the virtual scene is enhanced and displayed according to the movement amplitude;

If the movement frequency of the user's hand reaches a frequency threshold, the current environment information in the virtual scene is enhanced and displayed according to the movement frequency;

If the user gesture is a preset gesture, the current environment information in the virtual scene is enhanced and displayed according to the gesture.

The scene adjustment method provided in the embodiment of the present application obtains the operation instructions, interactive elements or interactive states of the user's interactive operation in the virtual scene, determines the target environment information according to the operation instructions, interactive elements or interactive states of the user's interactive operation, and then adjusts the environment information in the virtual scene according to the target environment information. In this way, the environmental information expression form of the performance space can be enriched, so that users can be provided with more colorful visual effects and artistic appeal to meet the diverse viewing needs of users, enhance the user's visual experience, and also enhance the attractiveness and viewing of music performances. In addition, by enhancing the display of the current environmental information in the virtual scene according to the interactive operation triggered by the user, the user's interactive interest and interactive enthusiasm can be improved, and the performance presentation effect in the entire virtual scene can be dynamically adjusted according to the user's interactive operation, further enriching the performance effect of the stage and enhancing the user's viewing experience.

A scene adjustment device provided in an embodiment of the present application is described below with reference to FIG7 . FIG7 is a schematic block diagram of a scene adjustment device provided in an embodiment of the present application.

As shown in FIG. 7 , the scene adjustment device 400 includes: an information acquisition module 410 and a scene adjustment module 420 .

The information acquisition module 410 is used to acquire the state information of the target object in the virtual scene;

The scene adjustment module 420 is used to adjust the environment information in the virtual scene according to the state information of the target object.

In an optional implementation of the embodiment of the present application, the target object includes: performance content and user interactive operations;

Accordingly, the information acquisition module 410 is specifically used for:

If the target object is the performance content, obtaining current music audio information and/or content type of the performance content in the virtual scene;

If the target object is the user interactive operation, an operation instruction, an interactive element or an interactive state of the user interactive operation in the virtual scene is obtained.

In an optional implementation of the embodiment of the present application, when the target object is the performance content, the scene adjustment module 420 includes:

A first determining unit, configured to determine target environment information according to current music audio information and/or content type of the performance content;

An adjustment unit is used to adjust the environment information in the virtual scene according to the target environment information.

In an optional implementation manner of the embodiment of the present application, the first determining unit is specifically configured to:

Determining the rhythm and/or beat of the current music audio information;

The target environment information is determined according to the rhythm and/or beat of the current music audio information.

In an optional implementation manner of the embodiment of the present application, the first determining unit is further configured to:

The target environment information is determined according to the rhythm strength value and/or the beat strength value of the current music audio information.

In an optional implementation manner of the embodiment of the present application, the first determining unit is further configured to:

Determining the target environment information in a mapping relationship between the rhythm strength value and the environment information according to the rhythm strength value of the current music audio information;

or,

According to the beat strength value of the current music audio information, determining the target environment information in the mapping relationship between the beat strength value and the environment information;

or,

According to the rhythm strength value and the beat strength value of the current music audio information, the target environmental information is determined in the mapping relationship between the rhythm strength value, the beat strength value and the environmental information.

In an optional implementation manner of the embodiment of the present application, the first determining unit is specifically configured to:

Determine a rhythm strength value interval corresponding to the rhythm strength value of the current music audio information, and/or a beat strength value interval corresponding to the beat strength value of the current music audio information;

Determining the target environment information in a preset mapping relationship according to the rhythm strength value interval and/or the beat strength value interval;

Among them, the preset mapping relationship is a mapping relationship between rhythm strength value intervals and environmental information, a mapping relationship between beat strength value intervals and environmental information, or a mapping relationship between rhythm strength value intervals, beat strength value intervals and environmental information.

In an optional implementation manner of the embodiment of the present application, the first determining unit is specifically configured to:

The target environment information is determined in a mapping relationship between content type and environment information according to the content type of the performance content.

In an optional implementation manner of the embodiment of the present application, the first determining unit is specifically configured to:

Determine first environmental information corresponding to current music audio information of the performance content, and Second environment information corresponding to the content type;

The first environment information and the second environment information are integrated to obtain the target environment information.

In an optional implementation of the embodiment of the present application, when the target object is the user interactive operation, the scene adjustment module 420 includes:

A second determining unit, configured to determine target environment information according to an operation instruction, an interactive element or an interactive state of the user interactive operation;

The adjustment unit is further used to adjust the environmental information in the virtual scene according to the target environmental information.

In an optional implementation manner of the embodiment of the present application, the second determining unit is specifically configured to:

The target environment information is determined in response to an operation instruction of a user on a control panel for any environment parameter, wherein the control panel is located in the virtual scene.

In an optional implementation manner of the embodiment of the present application, the second determining unit is specifically configured to:

In response to an identity switching operation triggered by a user, switching the identity of the user from a spectator to a performer;

The target environment information is determined according to the performance content of the user whose interactive state is a performer.

In an optional implementation of the embodiment of the present application, the scene adjustment module 420 further includes:

An element determination unit, configured to determine, in response to an interactive operation triggered by a user, an interactive element corresponding to the interactive operation;

Accordingly, the second determining unit is specifically configured to:

The interactive element is added to the current environment information of the interactive scene to obtain the target environment information.

In an optional implementation manner of an embodiment of the present application, the target environment information includes at least one of the following: lighting effects, theme special effects, environment maps, and prop materials.

The scene adjustment device provided in the embodiment of the present application obtains the state information of the target object in the virtual scene, and adjusts the environmental information in the virtual scene according to the state information of the target object. Thus, the environmental information in the virtual scene where the performer is located can be adjusted in real time based on the acquired state information of the target object, thereby enriching the environmental information expression form of the performance space, thereby providing users with more colorful visual effects and artistic appeal, so as to meet the diverse viewing needs of users, enhance the visual experience of users, and also enhance the attractiveness and appreciation of music performances.

It should be understood that the device embodiment and the aforementioned method embodiment may correspond to each other, and similar descriptions may refer to the method embodiment. To avoid repetition, no further description is given here. Specifically, the device 400 shown in FIG. 7 can execute the method embodiment corresponding to FIG. 1, and the aforementioned and other operations and/or functions of each module in the device 400 are respectively for implementing the corresponding processes in each method in FIG. 1, and for the sake of brevity, no further description is given here.

The above text describes the device 400 of the embodiment of the present application from the perspective of functional modules in conjunction with the accompanying drawings. It should be understood that the functional modules can be implemented in hardware form, can be implemented in software form, or can be implemented in a combination of hardware and software modules. Specifically, each step of the first aspect of the method embodiment in the embodiment of the present application can be completed by the hardware integrated logic circuit in the processor and/or the software form of the instruction, combined with the first aspect of the method disclosed in the embodiment of the present application The steps can be directly embodied as being executed by a hardware decoding processor, or can be executed by a combination of hardware and software modules in the decoding processor. Optionally, the software module can be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps in the above-mentioned first aspect method embodiment in combination with its hardware.

FIG8 is a schematic block diagram of an electronic device provided in an embodiment of the present application. As shown in FIG8 , the electronic device 500 may include:

The memory 510 and the processor 520, the memory 510 is used to store the computer program and transmit the program code to the processor 520. In other words, the processor 520 can call and run the computer program from the memory 510 to implement the scene adjustment method in the embodiment of the present application.

For example, the processor 520 may be used to execute the above-mentioned scene adjustment method embodiment according to the instructions in the computer program.

Optionally, the scene adjustment method includes:

Obtaining status information of target objects in the virtual scene;

According to the state information of the target object, the environmental information in the virtual scene is adjusted.

Optionally, the target objects include: performance content and user interactive operations;

Accordingly, the step of obtaining the state information of the target object in the virtual scene includes:

If the target object is the performance content, obtaining current music audio information and/or content type of the performance content in the virtual scene;

If the target object is the user interactive operation, an operation instruction, an interactive element or an interactive state of the user interactive operation in the virtual scene is obtained.

Optionally, when the target object is the performance content, adjusting the environmental information in the virtual scene according to the state information of the target object includes:

Determining target environment information according to current music audio information and/or content type of the performance content;

According to the target environment information, the environment information in the virtual scene is adjusted.

Optionally, determining the target environment information according to the current music audio information of the performance content includes:

Determining the rhythm and/or beat of the current music audio information;

The target environment information is determined according to the rhythm and/or beat of the current music audio information.

Optionally, determining the target environment information according to the rhythm and/or beat of the current music audio information includes:

The target environment information is determined according to the rhythm strength value and/or the beat strength value of the current music audio information.

Optionally, determining the target environment information according to the rhythm strength value and/or the beat strength value of the current music audio information includes:

Determining the target environment information in a mapping relationship between the rhythm strength value and the environment information according to the rhythm strength value of the current music audio information;

or,

According to the beat strength value of the current music audio information, determining the target environment information in the mapping relationship between the beat strength value and the environment information;

or,

According to the rhythm strength value and the beat strength value of the current music audio information, the target environmental information is determined in the mapping relationship between the rhythm strength value, the beat strength value and the environmental information.

Optionally, determining the target environment information according to the rhythm strength value and/or the beat strength value of the current music audio information includes:

Determine a rhythm strength value interval corresponding to the rhythm strength value of the current music audio information, and/or a beat strength value interval corresponding to the beat strength value of the current music audio information;

Determining the target environment information in a preset mapping relationship according to the rhythm strength value interval and/or the beat strength value interval;

Among them, the preset mapping relationship is a mapping relationship between rhythm strength value intervals and environmental information, a mapping relationship between beat strength value intervals and environmental information, or a mapping relationship between rhythm strength value intervals, beat strength value intervals and environmental information.

Optionally, determining the target environment information according to the content type of the performance content includes:

The target environment information is determined in a mapping relationship between content type and environment information according to the content type of the performance content.

Optionally, determining the target environment information according to the current music audio information and content type of the performance content includes:

Determining first environmental information corresponding to current music audio information of the performance content, and second environmental information corresponding to a content type of the performance content;

The first environment information and the second environment information are integrated to obtain the target environment information.

Optionally, when the target object is the user interactive operation, adjusting the environmental information in the virtual scene according to the state information of the target object includes:

Determining target environment information according to an operation instruction, an interactive element or an interactive state of the user interactive operation;

According to the target environment information, the environment information in the virtual scene is adjusted.

Optionally, determining the target environment information according to the operation instruction of the user interactive operation includes:

The target environment information is determined in response to an operation instruction of a user on a control panel for any environment parameter, wherein the control panel is located in the virtual scene.

Optionally, determining the target environment information according to the interactive state of the user interactive operation includes:

In response to an identity switching operation triggered by a user, switching the identity of the user from a spectator to a performer;

The target environment information is determined according to the performance content of the user whose interactive state is a performer.

Optionally, before determining the target environment information according to the interactive element of the user interactive operation, the method further includes:

In response to an interactive operation triggered by a user, determining an interactive element corresponding to the interactive operation;

Accordingly, determining target environment information according to the interactive element of the user interactive operation includes:

The interactive element is added to the current environment information of the interactive scene to obtain the target environment information.

Optionally, the target environment information includes at least one of the following: lighting effects, theme special effects, environment maps and prop materials.

In some embodiments of the present application, the processor 520 may include but is not limited to:

General-purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.

In some embodiments of the present application, the memory 510 includes but is not limited to:

Volatile memory and/or non-volatile memory. Among them, the non-volatile memory can be read-only memory (ROM), programmable ROM (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM) or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link DRAM (SLDRAM) and direct RAM bus random access memory (Direct Rambus RAM, DR RAM).

In some embodiments of the present application, the computer program may be divided into one or more modules, which are stored in the memory 510 and executed by the processor 520 to complete the scene adjustment method provided by the present application. The one or more modules may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program in the electronic device.

As shown in FIG8 , the electronic device 500 may further include:

The transceiver 530 may be connected to the processor 520 or the memory 510 .

The processor 520 may control the transceiver 530 to communicate with other devices, specifically, to send information or data to other devices, or to receive information or data sent by other devices. The transceiver 530 may include a transmitter and a receiver. The transceiver 530 may further include an antenna, and the number of antennas may be one or more.

It should be understood that the various components in the electronic device are connected via a bus system, wherein the bus system includes not only a data bus but also a power bus, a control bus and a status signal bus.

The present application also provides a computer storage medium on which a computer program is stored. When the computer program is executed by a computer, the computer is enabled to execute the method of the above method embodiment.

An embodiment of the present application further provides a computer program product including program instructions, and when the program instructions are executed on an electronic device, the electronic device executes the method of the above method embodiment.

When software is used for implementation, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a digital video disc (DVD)), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.

Those of ordinary skill in the art will appreciate that the modules and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the module is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

The modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. For example, each functional module in each embodiment of the present application may be integrated into a processing module, or each module may exist physically separately, or two or more modules may be integrated into one module.

The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims (19)

A scene adjustment method, comprising: Obtaining status information of target objects in the virtual scene; According to the state information of the target object, the environmental information in the virtual scene is adjusted. The method according to claim 1, wherein the target objects include: performance content and user interactive operations; Accordingly, the step of obtaining the state information of the target object in the virtual scene includes: If the target object is the performance content, obtaining current music audio information and/or content type of the performance content in the virtual scene; If the target object is the user interactive operation, an operation instruction, an interactive element or an interactive state of the user interactive operation in the virtual scene is obtained. The method according to claim 2, wherein when the target object is the performance content, adjusting the environmental information in the virtual scene according to the state information of the target object comprises: Determining target environment information according to current music audio information and/or content type of the performance content; According to the target environment information, the environment information in the virtual scene is adjusted. The method according to claim 3, wherein the determining the target environment information according to the current music audio information of the performance content comprises: Determining the rhythm and/or beat of the current music audio information; The target environment information is determined according to the rhythm and/or beat of the current music audio information. The method according to claim 4, wherein determining the target environment information according to the rhythm and/or beat of the current music audio information comprises: The target environment information is determined according to the rhythm strength value and/or the beat strength value of the current music audio information. The method according to claim 5, wherein determining the target environment information according to the rhythm strength value and/or the beat strength value of the current music audio information comprises: Determining the target environment information in a mapping relationship between the rhythm strength value and the environment information according to the rhythm strength value of the current music audio information; or, According to the beat strength value of the current music audio information, determining the target environment information in the mapping relationship between the beat strength value and the environment information; or, According to the rhythm strength value and the beat strength value of the current music audio information, the target environmental information is determined in the mapping relationship between the rhythm strength value, the beat strength value and the environmental information. The method according to claim 5, wherein determining the target environment information according to the rhythm strength value and/or the beat strength value of the current music audio information comprises: Determine the rhythm strength value interval corresponding to the rhythm strength value of the current music audio information, and/or the current music The beat strength value interval corresponding to the beat strength value of the audio information; Determining the target environment information in a preset mapping relationship according to the rhythm strength value interval and/or the beat strength value interval; Among them, the preset mapping relationship is a mapping relationship between rhythm strength value intervals and environmental information, a mapping relationship between beat strength value intervals and environmental information, or a mapping relationship between rhythm strength value intervals, beat strength value intervals and environmental information. The method according to claim 3, wherein determining the target environment information according to the content type of the performance content comprises: The target environment information is determined in a mapping relationship between content type and environment information according to the content type of the performance content. The method according to claim 3, wherein the determining the target environment information according to the current music audio information and content type of the performance content comprises: Determining first environmental information corresponding to current music audio information of the performance content, and second environmental information corresponding to a content type of the performance content; The first environment information and the second environment information are integrated to obtain the target environment information. The method according to claim 2, wherein when the target object is the user interactive operation, adjusting the environmental information in the virtual scene according to the state information of the target object comprises: Determining target environment information according to an operation instruction, an interactive element or an interactive state of the user interactive operation; According to the target environment information, the environment information in the virtual scene is adjusted. The method according to claim 10, wherein determining the target environment information according to the operation instruction of the user interactive operation comprises: The target environment information is determined in response to an operation instruction of a user on a control panel for any environment parameter, wherein the control panel is located in the virtual scene. The method according to claim 10, wherein determining the target environment information according to the interactive state of the user interactive operation comprises: In response to an identity switching operation triggered by a user, switching the identity of the user from a spectator to a performer; The target environment information is determined according to the performance content of the user whose interactive state is a performer. The method according to claim 10, wherein before determining the target environment information according to the interactive element of the user interactive operation, the method further comprises: In response to an interactive operation triggered by a user, determining an interactive element corresponding to the interactive operation; Accordingly, determining target environment information according to the interactive element of the user interactive operation includes: The interactive element is added to the current environment information of the interactive scene to obtain the target environment information. The method according to any one of claims 3 to 13, wherein the target environment information includes at least one of the following: lighting effects, theme special effects, environment maps, and prop materials. A scene adjustment device, comprising: An information acquisition module is used to obtain the status information of the target object in the virtual scene; The scene adjustment module is used to adjust the environment information in the virtual scene according to the state information of the target object. An electronic device, comprising: A processor and a memory, the memory being used to store a computer program, and the processor being used to call and run the computer program stored in the memory to execute the scene adjustment method as claimed in any one of claims 1 to 14. A computer-readable storage medium is used to store a computer program, wherein the computer program enables a computer to execute the scene adjustment method according to any one of claims 1 to 14. A computer program product comprising program instructions, when the program instructions are executed on an electronic device, enables the electronic device to execute the scene adjustment method as claimed in any one of claims 1 to 14. A computer program, when the computer program is run on an electronic device, enables the electronic device to execute the scene adjustment method as claimed in any one of claims 1 to 14.