WO2024077437A1

WO2024077437A1 - Wallpaper display method and apparatus, and device, storage medium and program product

Info

Publication number: WO2024077437A1
Application number: PCT/CN2022/124330
Authority: WO
Inventors: 张夏风; 崔兆坤; 吴鸿琦
Original assignee: 广州酷狗计算机科技有限公司
Priority date: 2022-10-10
Filing date: 2022-10-10
Publication date: 2024-04-18
Also published as: CN115997191A

Abstract

The present invention relates to the field of user interfaces. Disclosed are a wallpaper display method and apparatus, and a device, a storage medium and a program product. The wallpaper display method comprises: playing audio data (S302); and dynamically displaying a wallpaper on the basis of spectral features of the audio data at different moments (S304). By means of the display method, a wallpaper in a first terminal can be dynamically displayed in real time on the basis of the spectral features, thereby realizing the visualization of audio.

Description

Wallpaper display method, device, equipment, storage medium and program product

Technical Field

The present application relates to the field of user interfaces, and in particular to a wallpaper display method, device, equipment, storage medium and program product.

Background technique

Wallpaper refers to the background image used on the computer desktop or mobile phone desktop. Users can beautify their terminals by selecting wallpapers of different styles. Wallpapers can be displayed in static or dynamic ways.

In the related art, the wallpaper dynamically displayed on the terminal is realized by looping the playing of picture materials or video materials.

However, the display method of the dynamic display wallpaper in the related art is relatively simple.

Summary of the invention

Embodiments of the present application provide a wallpaper display method, device, equipment, storage medium, and program product.

According to one aspect of the present application, a method for displaying wallpaper is provided, the method comprising:

Play audio data;

The wallpaper is dynamically displayed based on the frequency spectrum characteristics of the audio data at different moments.

According to one aspect of the present application, a wallpaper display device is provided, the device comprising:

A playback module, used for playing audio data;

The display module is used to dynamically display the wallpaper based on the frequency spectrum characteristics of the audio data at different times.

According to one aspect of the present application, a computer device is provided, comprising: a processor and a memory, wherein at least one computer program is stored in the memory, and at least one computer program is loaded and executed by the processor to implement the above-mentioned wallpaper display method.

According to one aspect of the present application, a computer-readable storage medium is provided, in which a computer program is stored. The computer program is used to be executed by a processor to implement the wallpaper display method as described above.

According to one aspect of the present application, a computer storage medium is provided, wherein the computer-readable storage medium stores at least one computer program, and the at least one computer program is loaded and executed by a processor to implement the wallpaper display method as described above.

According to one aspect of the present application, a computer program product is provided, which includes a computer program stored in a computer-readable storage medium; the computer program is read and executed from the computer-readable storage medium by a processor of a computer device, so that the computer device executes the wallpaper display method as described above.

The technical solution provided by the embodiments of the present application includes at least the following beneficial effects:

By playing audio data, the wallpaper is dynamically displayed based on the spectrum characteristics of the audio data at different times. The present application provides a new wallpaper display method, which enables the wallpaper in the first terminal to be dynamically displayed in real time based on the spectrum characteristics, thereby realizing the visualization of audio.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

FIG1 is a schematic diagram of a method for displaying wallpaper provided by an exemplary embodiment of the present application;

FIG2 is a schematic diagram of the architecture of a computer system provided by an exemplary embodiment of the present application;

FIG3 is a flowchart of a method for displaying wallpaper provided by an exemplary embodiment of the present application;

FIG4 is a flowchart of a method for displaying wallpaper provided by an exemplary embodiment of the present application;

FIG5 is a schematic diagram of a displayed wallpaper provided by an exemplary embodiment of the present application;

FIG6 is a schematic diagram of a displayed wallpaper provided by an exemplary embodiment of the present application;

FIG7 is a schematic diagram of a wallpaper display interface provided by an exemplary embodiment of the present application;

FIG8 is a flowchart of a method for displaying wallpaper provided by an exemplary embodiment of the present application;

FIG9 is a schematic structural diagram of a wallpaper display device provided by an exemplary embodiment of the present application;

FIG. 10 is a schematic diagram of the structure of a computer device according to an exemplary embodiment of the present application.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present application more clear, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

The embodiment of the present application provides a technical solution for a method for displaying wallpaper, which is executed by a first terminal. As shown in FIG. 1 (a), a wallpaper display interface 10 for displaying wallpaper is displayed on the first terminal, and a "sky full of stars" wallpaper is displayed in the wallpaper display interface 10. In response to the playback operation of the audio data, the first terminal dynamically displays the "sky full of stars" wallpaper based on the frequency spectrum characteristics of the audio data at different times. As shown in FIG. 1 (b), as the audio data "Xiao Erlang" is played, the "sky full of stars" wallpaper is dynamically displayed in real time based on the frequency spectrum characteristics of the audio data "Xiao Erlang", that is, the "sky full of stars" wallpaper is dynamically displayed following the music rhythm of the audio data "Xiao Erlang". The "sky full of stars" wallpaper includes at least one small star. Taking one of the stars 20 as an example, after playing the audio data "Xiao Erlang", at a first moment, based on the frequency spectrum characteristics of the first moment, the star 20 explodes with a first special effect; at a second moment, based on the frequency spectrum characteristics of the second moment, the star 20 explodes with a second special effect; that is, the display effect of the star 20 explodes with different special effects according to the frequency spectrum characteristics at different moments, and finally presents the changing effect of the "sky full of stars" wallpaper as the audio data is dynamically displayed in real time.

Exemplarily, in addition to the case of dynamically displaying wallpaper in real time based on the frequency spectrum characteristics of audio data, at least one of the following is also included:

Dynamically display wallpaper based on audio category of audio data;

Dynamically display wallpaper based on the playback progress of audio data.

The spectral characteristics refer to the number of times the sound vibrates per second.

The audio category refers to the category to which the audio data belongs.

Optionally, the category of the audio data includes at least one of lyrical, rock, and nostalgic, but is not limited thereto, and the embodiments of the present application do not make specific limitations on this.

Dynamically displaying the wallpaper based on the playback progress refers to dynamically displaying the wallpaper based on the playback time of the audio data. For example, as the playback time of the audio data is longer, the dynamic display rhythm of the wallpaper is faster.

Exemplarily, the first terminal plays audio data, and the first terminal obtains real-time data of the audio data. After obtaining the real-time data, the real-time data is extracted by the central processing unit (CPU) to obtain spectrum data corresponding to the audio data; then, the spectrum data is extracted by the graphics processing unit (GPU) to obtain spectrum features corresponding to the audio data; and the wallpaper is dynamically displayed in real time based on the spectrum features.

Exemplarily, the first terminal plays audio data, and the first terminal obtains real-time data of the audio data at the i-th moment; performs category identification on the real-time data of the audio data at the i-th moment to obtain an audio category corresponding to the audio data; changes the display elements of the wallpaper based on the audio category; and dynamically displays the wallpaper in real time based on the changed display elements, where i is a positive integer.

For example, when the audio data at the i-th moment has a lyrical rhythm, the wallpaper is dynamically displayed with a first rhythm; when the audio data at the i-th moment has a rock rhythm, the wallpaper is displayed with a second rhythm; wherein the second rhythm is faster than the first rhythm.

In a possible implementation manner, the first terminal plays audio data in the first terminal, and the first terminal dynamically displays wallpaper based on frequency spectrum characteristics of the audio data played in the first terminal at different times.

For example, in the case of playing audio data in the first terminal, the wallpaper is dynamically displayed in the wallpaper display interface 10 based on the frequency spectrum characteristics of the audio data played in the first terminal at different times.

In a possible implementation, the second terminal plays audio data, and the first terminal dynamically displays wallpaper in the first terminal based on frequency spectrum characteristics of the audio data played in the second terminal at different times.

The second terminal refers to a terminal device associated with the first terminal.

For example, when the second terminal plays audio data, the first terminal records the audio data through a recording device, and the first terminal dynamically displays wallpaper in real time based on frequency spectrum features corresponding to the audio data recorded by the recording device.

In summary, the method provided in this embodiment dynamically displays wallpapers by playing audio data based on the spectrum characteristics of the audio data at different times. This application provides a new wallpaper display method, which enables wallpapers in the wallpaper display interface to be displayed dynamically in real time based on spectrum characteristics, realizes audio visualization, and improves user experience.

Fig. 2 shows a schematic diagram of the architecture of a computer system provided by an embodiment of the present application. The computer system may include: a terminal 100 and a server 200.

The terminal 100 may be an electronic device such as a mobile phone, a tablet computer, a vehicle terminal (vehicle computer), a wearable device, a personal computer (PC), an intelligent voice interaction device, a smart home appliance, a vehicle terminal, an aircraft, an unmanned vending terminal, etc. The terminal 100 may be installed with a client that runs a target application, and the target application is an application for displaying wallpapers. In addition, the present application does not limit the form of the target application, including but not limited to an application (Application, App) installed in the terminal 100, a mini-program, etc., and may also be in the form of a web page.

Server 200 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud computing services, cloud database, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), and cloud servers for basic cloud computing services such as big data and artificial intelligence platforms. Server 200 may be a backend server of the above-mentioned target application, used to provide backend services for the client of the target application.

Among them, cloud technology refers to a hosting technology that unifies hardware, software, network and other resources in a wide area network or local area network to realize data computing, storage, processing and sharing. Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, application technology, etc. based on the cloud computing business model. It can form a resource pool, which is used on demand and is flexible and convenient. Cloud computing technology will become an important support. The background services of technical network systems require a large amount of computing and storage resources, such as video websites, picture websites and more portal websites. With the high development and application of the Internet industry, in the future, each item may have its own identification mark, and all need to be transmitted to the background system for logical processing. Data of different levels will be processed separately. All kinds of industry data require strong system backing support, which can only be achieved through cloud computing.

In some embodiments, the above-mentioned server can also be implemented as a node in a blockchain system. Blockchain is a new application mode of computer technologies such as distributed data storage, peer-to-peer transmission, consensus mechanism, encryption algorithm, etc. Blockchain is essentially a decentralized database, a string of data blocks generated by cryptographic methods. Each data block contains a batch of network transaction information, which is used to verify the validity of its information (anti-counterfeiting) and generate the next block. Blockchain can include the blockchain underlying platform, platform product service layer and application service layer.

The terminal 100 and the server 200 may communicate with each other via a network, such as a wired or wireless network.

In the wallpaper display method provided in the embodiment of the present application, the execution subject of each step may be a computer device, which refers to an electronic device with data calculation, processing and storage capabilities. Taking the implementation environment of the solution shown in FIG2 as an example, the wallpaper display method may be executed by the terminal 100 (such as the client of the target application installed and running in the terminal 100 executes the wallpaper display method), or the terminal 100 and the server 200 cooperate to execute it, and the present application does not limit this.

FIG3 is a flowchart of a method for displaying wallpaper provided by an exemplary embodiment of the present application. The method may be executed by a first terminal. The method includes:

Step 302: Play audio data.

Exemplarily, the audio data is played in at least one of a music player, a mini-program, and a web page, but is not limited thereto and is not specifically limited in this embodiment of the present application.

The method of obtaining the audio data includes at least one of the following situations:

1. The first terminal records audio data. For example, the first terminal is a terminal that initiates audio recording. The audio is recorded through the first terminal, and after the recording is completed, the audio data is stored.

2. Audio data is obtained from a stored database/music library, such as obtaining at least one audio data to be played from an audio platform database.

It is worth noting that the above-mentioned method of obtaining audio data is only an illustrative example and is not limited to this in the embodiments of the present application.

Step 304: Dynamically display wallpaper based on the frequency spectrum characteristics of the audio data at different times.

Wallpaper refers to the background image used in the terminal's user interface.

The spectrum feature refers to a physical quantity representing the acoustic characteristics of audio, and is one of the audio features. Exemplarily, the audio feature includes at least one of the spectrum feature, audio category, and playback progress, but is not limited thereto, and the embodiments of the present application do not limit this.

The first terminal dynamically displays the wallpaper based on the frequency spectrum characteristics of the audio data at different times, that is, the wallpaper uses the frequency spectrum characteristics of the audio data at different times as display parameters to dynamically display the wallpaper in real time.

It is understandable that after the first terminal receives the audio data, the wallpaper displayed in the first terminal is displayed in real time and dynamically following the playing rhythm of the audio data. Different songs correspond to different spectral characteristics, and the real-time dynamic display method of the wallpaper based on different spectral characteristics is also different.

In summary, the method provided in this embodiment dynamically displays wallpapers by playing audio data based on the spectrum characteristics of the audio data at different times. This application provides a new wallpaper display method, which enables the wallpaper in the first terminal to be dynamically displayed in real time based on the spectrum characteristics, realizes the visualization of audio, and improves the user experience.

FIG4 is a flowchart of a method for displaying wallpaper provided by an exemplary embodiment of the present application. The method may be executed by a first terminal. The method includes:

Step 402: Play the audio data in the first terminal or the audio data in the second terminal.

Exemplarily, playing audio data includes at least one of the following situations:

Playing audio data in the first terminal;

Playing audio data in a second terminal, where the second terminal refers to a terminal device associated with the first terminal.

Optionally, the mutual association relationship between the first terminal and the second terminal includes at least one of Bluetooth connection, sharing a WiFi, the audio data played in the second terminal is a favorite/collected song in the first terminal, and the distance between the first terminal and the second terminal is less than a distance threshold, but is not limited to this, and the embodiments of the present application do not make specific limitations on this.

Step 404: Dynamically display wallpaper based on the frequency spectrum characteristics of the audio data at different times.

Exemplarily, the first terminal obtains real-time data of audio data at the i-th moment; the first terminal performs feature extraction on the real-time data of the audio data at the i-th moment to obtain frequency spectrum features of the audio data at the i-th moment; the first terminal generates a wallpaper at the i-th moment based on the frequency spectrum features at the i-th moment, where i is a positive integer.

Exemplarily, the step of acquiring spectral features includes: the first terminal has a CPU and a GPU, and after the first terminal acquires the real-time data of the audio data at the i-th moment, the first terminal performs data extraction on the real-time data of the audio data at the i-th moment through the CPU to obtain the spectral data of the audio data at the i-th moment; the first terminal performs feature extraction on the spectral data at the i-th moment through the GPU to obtain the spectral features of the audio data at the i-th moment.

Optionally, the CPU extracts real-time data of the audio data through Fourier transform to obtain frequency spectrum data of the audio data.

Exemplarily, after acquiring the spectral features of the audio data, the first terminal models the display elements of the wallpaper at the i-th moment based on the spectral features at the i-th moment; the first terminal renders the wallpaper displayed at the i-th moment based on the display elements of the modeled wallpaper at the i-th moment.

Optionally, when the GPU models the display elements of the wallpaper at the i-th moment through a modeling function, the GPU superimposes the spectral features at the i-th moment onto the input of the modeling function to obtain the display elements of the wallpaper at the i-th moment, thereby adding the spectral features to the display elements of the wallpaper in real time.

Optionally, the modeling function includes at least one of a polynomial modeling function, an exponential modeling function, a circle and ellipse modeling function, and a Bezier modeling function, but is not limited thereto, and the embodiments of the present application do not make specific limitations on this.

Polynomial shaping functions are used to shape, tween, and ease information in the [0-1] range.

The Exponential Shaping Function is used to change the function from the first easing form to the second easing form in this exponential shaping function.

The circle and ellipse styling functions are used to ease in and out of the unit square.

For example, when the GPU models the display elements of the wallpaper through the modeling function at the first moment, it superimposes the spectral characteristics corresponding to the first moment as input to the display elements of the wallpaper constructed at the first moment, thereby superimposing the spectral characteristics to the display style of the wallpaper. The first terminal realizes the visualization of the audio data by rendering and displaying the wallpaper based on the display elements of the modeled wallpaper at the current moment, thereby improving the interest of the music.

During the wallpaper display process, the CPU is only used to obtain real-time audio data, extract data from the real-time audio data, obtain the spectrum data of the audio data, and pass the spectrum data to the GPU. The GPU is used to extract features from the acquired spectrum data, obtain the spectrum features of the audio data, model the display elements of the wallpaper based on the spectrum features (modeling process), and then render and color each pixel in the display elements obtained by modeling, and finally present a wallpaper with spectrum features. By using the parallel computing power of the GPU to model the display elements of the wallpaper in the GPU, the efficiency of audio visualization is improved.

For example, 480,000 pixels need to be processed on each frame of wallpaper. If the process of modeling the display elements of the wallpaper based on spectral features is run in the CPU, that is, the modeling process is run in the CPU, the CPU needs to calculate 480,000 pixels in sequence, and the serial processing capability of the CPU will make the CPU's operation capability poor and prone to jamming. In an embodiment of the present application, the process of modeling the display elements of the wallpaper based on spectral features (modeling process) is migrated to the GPU for execution, giving full play to the parallel computing capability of the GPU, and can process all pixels on a frame at the same time, that is, can process 480,000 pixels in parallel, thereby improving the efficiency of audio data visualization.

Optionally, the display elements of the wallpaper include at least one of hue, saturation value, brightness value, fluctuation rate, fluctuation frequency, and motion trajectory, but are not limited thereto and are not specifically limited in the embodiments of the present application.

For example, as shown in a schematic diagram of a wallpaper in FIG5 , a “sky full of stars” wallpaper is displayed on the first terminal. When no audio data is played, the “sky full of stars” wallpaper displayed on the first terminal is in a static state or a regularly flowing state. After the audio data “Xiao Erlang” is played, the “sky full of stars” wallpaper displayed in the first terminal is dynamically displayed based on the frequency spectrum characteristics of the audio data “Xiao Erlang”, that is, the stars in the “sky full of stars” wallpaper change their shape according to the frequency spectrum characteristics of the audio data “Xiao Erlang”, presenting a “fireworks shape”. At the same time, the size or brightness of the “fireworks-shaped” stars changes with the rhythm of the audio data “Xiao Erlang”, thereby visualizing the audio and allowing the user to always perceive the rhythm and dynamics of the audio data, thereby improving the user experience.

In a possible implementation manner, the first terminal dynamically displays the wallpaper in real time based on the audio category of the audio data.

Exemplarily, the first terminal obtains real-time data of audio data at the i-th moment; the first terminal performs category recognition on the real-time data of the audio data at the i-th moment to obtain the audio category of the audio data at the i-th moment; and dynamically displays wallpaper in real time based on the audio category at the i-th moment.

Optionally, after the first terminal obtains the audio category of the audio data at the i-th moment, the first terminal changes the display elements of the wallpaper based on the audio category at the i-th moment; the first terminal dynamically displays the wallpaper in real time based on the changed display elements.

Exemplarily, the display position of the wallpaper displayed in real time and dynamically based on the spectral characteristics of the audio data is displayed on at least one of the terminal's desktop, lock screen interface, floating window, and widgets on the interface, but is not limited to this. The embodiments of the present application do not make specific limitations on this.

In a possible implementation manner, the first terminal dynamically displays the wallpaper in real time based on the playback progress of the audio data.

Dynamically displaying wallpaper based on playback progress refers to dynamically displaying wallpaper in real time based on the playback time of audio data.

For example, as the playing time of the audio data is longer, the dynamic display rhythm of the wallpaper is faster; or, as the playing time of the audio data is longer, the dynamic display rhythm of the wallpaper is slower.

In a possible implementation, the audio data in the first terminal is played; and the wallpaper is dynamically displayed based on the frequency spectrum characteristics of the audio data played in the first terminal at different times.

Exemplarily, the first terminal plays audio data in the first terminal, and the first terminal dynamically displays wallpaper based on frequency spectrum characteristics of the audio data played in the first terminal at different times.

For example, when a music player in the first terminal plays audio data, the first terminal dynamically displays wallpaper based on frequency spectrum characteristics of the audio data played in the first terminal at different times.

In a possible implementation, audio data in the second terminal is played, and based on frequency spectrum characteristics of the audio data played in the second terminal at different times, wallpaper is dynamically displayed in the first terminal.

Exemplarily, the second terminal plays audio data, and the first terminal dynamically displays wallpaper in the first terminal based on the frequency spectrum characteristics of the audio data played in the second terminal at different times.

Exemplarily, for example, as shown in FIG6 , a schematic diagram of a wallpaper is shown in the first terminal in the form of a pendant or a floating window. Taking the floating window 601 as an example, when no audio data is played, the "sky full of stars" wallpaper displayed on the floating window 601 in the first terminal is in a static state or a regularly flowing state. After the audio data "Xiao Erlang" is played, the "sky full of stars" wallpaper displayed in the floating window 601 is dynamically displayed based on the frequency spectrum characteristics of the audio data "Xiao Erlang", that is, the stars in the "sky full of stars" wallpaper change the shape of the stars according to the frequency spectrum characteristics of the audio data "Xiao Erlang", presenting a "fireworks shape", and at the same time, the size or brightness of the "fireworks-shaped" stars changes with the rhythm of the audio data "Xiao Erlang", thereby visualizing the audio, allowing the user to both hear and see the music, thereby improving the user experience.

In a possible implementation, audio data is played, and the first terminal dynamically displays wallpaper in real time based on frequency spectrum characteristics of the audio data and customized settings.

Custom settings refer to custom settings of display effects of display elements of the wallpaper based on the frequency spectrum characteristics of the audio data.

For example, based on the spectral characteristics of audio data, the jumping rate of the wallpaper is further improved to achieve better visual effects.

In a possible implementation, the first terminal dynamically displays display materials corresponding to the frequency spectrum characteristics in the wallpaper based on the frequency spectrum characteristics of the audio data at different moments.

For example, the display materials displayed in the wallpaper include at least one of streamlines, light columns, light spots, stars, and spirals. When the spectral characteristics are bound to the stars, based on the spectral characteristics of the audio data at different times, the stars in the wallpaper change with the changes in the spectral characteristics of the audio data at different times. For example, the brightness of the stars in the wallpaper changes with the changes in the spectral characteristics of the audio data at different times.

In a possible implementation, the first terminal dynamically displays the wallpaper in real time based on the time, weather, geographic location and gyroscope data changes of the first terminal.

Optionally, audio data is played, and the first terminal dynamically displays the wallpaper based on the frequency spectrum characteristics and weather element information of the audio data at different times, where the weather element information refers to the weather information at the geographical location of the first terminal.

For example, on a cloudy day, the effect of the display elements of the wallpaper dynamically displayed in the first terminal based on the spectral characteristics of the audio data at different times is reduced by 20%; on a sunny day, the effect of the display elements of the wallpaper dynamically displayed in the first terminal based on the spectral characteristics of the audio data at different times is increased by 30%.

Optionally, the audio data is played, and the first terminal dynamically displays a wallpaper based on the frequency spectrum characteristics and heart rate characteristics of the audio data at different times.

The heartbeat variation characteristics are obtained by monitoring a third terminal associated with the first terminal.

For example, taking the third terminal as a smart bracelet, the first terminal is connected to the smart bracelet, and the first terminal dynamically displays wallpaper based on the frequency spectrum characteristics of the audio data at different times and the heart rate characteristics at the same time.

For example, when the user is happier and has a faster heartbeat, the effect of the display elements of the wallpaper that are dynamically displayed in the first terminal based on the spectral characteristics of the audio data at different times increases by 20%; when the user is more irritable and has a faster heartbeat, the effect of the display elements of the wallpaper that are dynamically displayed in the first terminal based on the spectral characteristics of the audio data at different times decreases by 10%.

Optionally, the audio data is played, and the first terminal dynamically displays the wallpaper based on the frequency spectrum characteristics of the audio data at different moments and the change characteristics of the gyroscope data.

The gyroscope data change feature is used to indicate a position change of the first terminal.

For example, when playing audio data, the first terminal dynamically displays the wallpaper in real time based on the spectral characteristics of the audio data. When the mobile phone shifts to the left, the display effect of the display elements on the left side of the wallpaper is stronger than the display effect of the display elements on the right side of the wallpaper. For example, in the "Starry Sky" wallpaper, the size of the stars on the left side of the wallpaper is larger than the size of the stars on the right side of the wallpaper.

For example, as shown in FIG. 7 , there is a schematic diagram of a wallpaper display interface. As shown in FIG. 7 (a), a wallpaper selection interface displays many wallpapers in the selection interface. For example, after selecting the “streamlined” wallpaper, the full-screen display style of the “streamlined” wallpaper is displayed in the terminal selection interface. When playing audio data, the “streamlined” wallpaper is dynamically displayed based on the frequency spectrum characteristics of the audio data at different times, so that the user can see the dynamic display wallpaper of the “streamlined” wallpaper. As shown in FIG. 7 (b), there is a schematic diagram of the display effect of the wallpaper on the desktop, which provides a reference for the user by showing the effect of the “streamlined” wallpaper on the desktop.

In the case of playing audio data, based on the spectral characteristics of the audio data at different times, the wallpaper is dynamically displayed. Taking the "streamline" wallpaper in Figure 7 as an example, the wallpaper includes cross-arranged streamline lines. In the case of playing audio data, based on the spectral characteristics of the audio data at different times, the streamline lines are dynamically displayed, that is, the light intensity and color of the streamline lines between any two nodes change with the spectral characteristics. For example, taking the first streamline line 701 in (a) of Figure 7 as an example, at the first moment, based on the spectral characteristics of the first moment, the color of the first streamline line 701 is red and the light intensity is 1 candela; at the second moment, based on the spectral characteristics of the second moment, the color of the first streamline line 701 changes to green and the light intensity changes to 1.5 candela; at the third moment, based on the spectral characteristics of the third moment, the color of the first streamline line 701 changes to cyan and the light intensity changes to 0.5 candela; that is, the color and light intensity of the first streamline line 701 present corresponding dynamic effects with the spectral characteristics at different times, and finally present the "streamline" wallpaper with the real-time dynamic display of audio data.

It is understandable that changing the color and light intensity of streamlines based on the change of spectral characteristics is only one of the ways. The change of spectral characteristics can change at least one of the shapes, colors, brightness, moving speeds, and motion trajectories of the display elements in the wallpaper, but is not limited to this. The embodiments of the present application do not make specific limitations on this.

In summary, the method provided in this embodiment plays audio data and dynamically displays wallpaper in real time based on the spectrum characteristics, audio category or playback progress of the audio data at different times. This application provides a new wallpaper display method, which enables the wallpaper in the first terminal to be dynamically displayed in real time based on the spectrum characteristics, realizes the visualization of audio, and improves the user experience.

FIG8 is a flowchart of a method for displaying wallpaper provided by an exemplary embodiment of the present application. The method may be executed by a first terminal. The method includes:

Step 801: Play audio data.

Step 802: Acquire real-time audio data.

Exemplarily, in the case of playing audio data, the first terminal obtains real-time data of the audio data at the current moment.

Step 803: extract the real-time data through Fourier transform to obtain spectrum data.

Exemplarily, the first terminal includes a CPU and a GPU. After the first terminal obtains the real-time data of the audio data, the first terminal performs Fourier transformation and data extraction on the real-time data of the audio data through the CPU to obtain the spectrum data of the audio data at the i-th moment.

Step 804: Transmit spectrum data to the GPU.

Exemplarily, after the spectrum data of the audio data at the i-th moment is obtained, the spectrum data is transmitted to the GPU of the first terminal.

The CPU in the first terminal is only used to obtain real-time data of the audio data, perform data extraction on the real-time data of the audio data, obtain spectrum data of the audio data, and transmit the spectrum data to the GPU.

Step 805: extracting features from the spectrum data to obtain spectrum features.

Exemplarily, after the GPU of the first terminal receives the spectrum data, the first terminal performs feature extraction on the spectrum data through the GPU to obtain spectrum features of the audio data.

Step 806: Modeling and coloring the wallpaper based on the spectrum characteristics.

Exemplarily, after acquiring the spectral features of the audio data, the GPU of the first terminal models the display elements of the wallpaper at the i-th moment based on the spectral features at the i-th moment; after obtaining the display elements of the modeled wallpaper at the i-th moment, the display elements of the wallpaper are rendered and colored.

Optionally, when modeling the display elements of the wallpaper through the modeling function, the GPU of the first terminal adds the frequency spectrum features at the i-th moment to the display elements of the wallpaper to obtain the display elements of the wallpaper at the i-th moment.

The GPU in the first terminal is used to model the display elements of the wallpaper based on the spectrum characteristics and render and color the modeled display elements. The parallel processing capability of the GPU can process each pixel in the wallpaper in parallel, and perform different operations according to the different positions of the pixels on the wallpaper, greatly improving efficiency.

Step 807: Dynamically display the wallpaper.

Exemplarily, the first terminal dynamically displays the wallpaper based on display elements of the wallpaper obtained by modeling at the current moment.

In summary, the method provided in this embodiment extracts data from the real-time data of the audio data by the CPU in the first terminal to obtain the spectrum data of the audio data; and extracts features from the spectrum data by the GPU in the first terminal to obtain the spectrum features of the audio data. The wallpaper is dynamically displayed in real time based on the spectrum features of the audio data. The present application provides a new method for displaying wallpapers, which enables the wallpapers in the first terminal to be dynamically displayed in real time based on the spectrum features, realizes the visualization of the audio, and improves the user experience.

FIG9 shows a schematic diagram of the structure of a wallpaper display device provided by an exemplary embodiment of the present application. The device can be implemented as all or part of a computer device through software, hardware, or a combination of both. The device includes:

Playing module 901, used for playing audio data;

The display module 902 is used to dynamically display the wallpaper based on the frequency spectrum characteristics of the audio data at different times.

In a possible implementation, the display module 902 is also used to obtain real-time data of the audio data at the i-th moment; perform feature extraction on the real-time data at the i-th moment to obtain frequency spectrum features of the audio data at the current moment; and generate a wallpaper at the i-th moment based on the frequency spectrum features at the i-th moment, where i is a positive integer.

In a possible implementation, the display module 902 is further configured to extract data from the real-time data at the i-th moment through the CPU to obtain spectrum data of the audio data at the i-th moment;

The GPU performs feature extraction on the spectrum data at the i-th moment to obtain the spectrum features of the audio data at the i-th moment.

In a possible implementation, the display module 902 is further configured to model display elements of the wallpaper at the i-th moment based on the spectrum features at the i-th moment; and render and display the wallpaper based on the display elements of the wallpaper at the i-th moment obtained by the modeling.

In a possible implementation, the display module 902 is further used to superimpose the spectral features at the i-th moment onto the input of the modeling function when modeling the display elements of the wallpaper at the i-th moment through the modeling function to obtain the display elements of the wallpaper at the i-th moment.

Exemplarily, the display element includes at least one of hue, saturation value, brightness value, fluctuation rate, fluctuation frequency, and motion trajectory.

In a possible implementation, the playing module 901 is further configured to play the audio data in the first terminal; or play the audio data in a second terminal, where the second terminal refers to a terminal device associated with the first terminal.

In a possible implementation, the display module 902 is further configured to dynamically display the wallpaper based on the frequency spectrum characteristics of the audio data played in the first terminal at different times.

In a possible implementation, the display module 902 is further configured to dynamically display the wallpaper in real time in the first terminal based on the frequency spectrum characteristics of the audio data played in the second terminal at different times.

In a possible implementation, the display module 902 is further configured to dynamically display the display material corresponding to the frequency spectrum feature in the wallpaper based on the frequency spectrum feature of the audio data at different moments.

In a possible implementation, the display module 902 is further used to dynamically display the wallpaper based on the frequency spectrum characteristics and weather element information of the audio data at different times, where the weather element information refers to the weather information at the geographical location of the first terminal.

In a possible implementation, the display module 902 is further used to dynamically display the wallpaper based on the frequency spectrum characteristics of the audio data at different times and the gyroscope data change characteristics, and the gyroscope data change characteristics are used to indicate the position change of the first terminal.

In a possible implementation, the display module 902 is also used to dynamically display the wallpaper based on the spectrum characteristics and heart rate characteristics of the audio data at different times, and the heart rate change characteristics are obtained by monitoring a third terminal associated with the first terminal.

FIG10 shows a block diagram of a computer device 1000 provided by an exemplary embodiment of the present application. The computer device 1000 may be a portable mobile terminal, such as a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III), an MP4 player (Moving Picture Experts Group Audio Layer IV). The computer device 1000 may also be called a user device, a portable terminal, or other names.

Typically, the computer device 1000 includes a processor 1001 and a memory 1002 .

The processor 1001 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1001 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), and PLA (Programmable Logic Array). The processor 1001 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1001 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1001 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

The memory 1002 may include one or more computer-readable storage media, which may be tangible and non-transitory. The memory 1002 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1002 is used to store at least one instruction, which is used to be executed by the processor 1001 to implement the wallpaper display method provided in the embodiment of the present application.

In some embodiments, the computer device 1000 may further include: a peripheral device interface 1003 and at least one peripheral device. Specifically, the peripheral device includes: at least one of a radio frequency circuit 1004 , a touch display screen 1005 , a camera 1006 , an audio circuit 1007 and a power supply 1008 .

The peripheral device interface 1003 may be used to connect at least one peripheral device related to I/O (Input/Output) to the processor 1001 and the memory 1002. In some embodiments, the processor 1001, the memory 1002, and the peripheral device interface 1003 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1001, the memory 1002, and the peripheral device interface 1003 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

The radio frequency circuit 1004 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1004 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 1004 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the radio frequency circuit 1004 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The radio frequency circuit 1004 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to: the World Wide Web, a metropolitan area network, an intranet, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and/or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 1004 may also include circuits related to NFC (Near Field Communication), which is not limited in this application.

The touch display screen 1005 is used to display a UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. The touch display screen 1005 also has the ability to collect touch signals on the surface or above the surface of the touch display screen 1005. The touch signal may be input as a control signal to the processor 1001 for processing. The touch display screen 1005 is used to provide virtual buttons and/or virtual keyboards, also known as soft buttons and/or soft keyboards. In some embodiments, the touch display screen 1005 may be one, and the front panel of the computer device 1000 is set; in other embodiments, the touch display screen 1005 may be at least two, and they are respectively set on different surfaces of the computer device 1000 or are folded; in some embodiments, the touch display screen 1005 may be a flexible display screen, and is set on a curved surface or a folded surface of the computer device 1000. Even, the touch display screen 1005 may be set to a non-rectangular irregular shape, that is, a special-shaped screen. The touch display screen 1005 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

The camera assembly 1006 is used to capture images or videos. Optionally, the camera assembly 1006 includes a front camera and a rear camera. Usually, the front camera is used to realize video calls or selfies, and the rear camera is used to realize photo or video shooting. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, and a wide-angle camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, and the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting functions. In some embodiments, the camera assembly 1006 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

The audio circuit 1007 is used to provide an audio interface between the user and the computer device 1000. The audio circuit 1007 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 1001 for processing, or input them into the radio frequency circuit 1004 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the computer device 1000. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 1001 or the radio frequency circuit 1004 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as distance measurement. In some embodiments, the audio circuit 1007 may also include a headphone jack.

The power supply 1008 is used to power various components in the computer device 1000. The power supply 1008 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 1008 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged through a wired line, and a wireless rechargeable battery is a battery that is charged through a wireless coil. The rechargeable battery can also be used to support fast charging technology.

In some embodiments, the computer device 1000 further includes one or more sensors 1009 , including but not limited to: an acceleration sensor 1010 , a gyroscope sensor 1011 , a pressure sensor 1012 , an optical sensor 1013 , and a proximity sensor 1014 .

The acceleration sensor 1010 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the computer device 1000. For example, the acceleration sensor 1010 can be used to detect the components of gravity acceleration on the three coordinate axes. The processor 1001 can control the touch display screen 1005 to display the user interface in a horizontal view or a vertical view according to the gravity acceleration signal collected by the acceleration sensor 1010. The acceleration sensor 1010 can also be used for collecting game or user motion data.

The gyro sensor 1011 can detect the body direction and rotation angle of the computer device 1000, and the gyro sensor 1011 can cooperate with the acceleration sensor 1010 to collect the user's 3D actions on the computer device 1000. The processor 1001 can implement the following functions based on the data collected by the gyro sensor 1011: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

The pressure sensor 1012 can be set on the side frame of the computer device 1000 and/or the lower layer of the touch display screen 1005. When the pressure sensor 1012 is set on the side frame of the computer device 1000, it can detect the user's grip signal of the computer device 1000, and perform left and right hand recognition or shortcut operation according to the grip signal. When the pressure sensor 1012 is set on the lower layer of the touch display screen 1005, it can control the operability controls on the UI interface according to the user's pressure operation on the touch display screen 1005. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.

The optical sensor 1013 is used to collect the ambient light intensity. In one embodiment, the processor 1001 can control the display brightness of the touch display screen 1005 according to the ambient light intensity collected by the optical sensor 1013. Specifically, when the ambient light intensity is high, the display brightness of the touch display screen 1005 is increased; when the ambient light intensity is low, the display brightness of the touch display screen 1005 is reduced. In another embodiment, the processor 1001 can also dynamically adjust the shooting parameters of the camera assembly 1006 according to the ambient light intensity collected by the optical sensor 1013.

The proximity sensor 1014, also called a distance sensor, is usually arranged on the front of the computer device 1000. The proximity sensor 1014 is used to collect the distance between the user and the front of the computer device 1000. In one embodiment, when the proximity sensor 1014 detects that the distance between the user and the front of the computer device 1000 is gradually decreasing, the processor 1001 controls the touch display screen 1005 to switch from the screen-on state to the screen-off state; when the proximity sensor 1014 detects that the distance between the user and the front of the computer device 1000 is gradually increasing, the processor 1001 controls the touch display screen 1005 to switch from the screen-off state to the screen-on state.

Those skilled in the art will appreciate that the structure shown in FIG. 10 does not limit the computer device 1000 , and may include more or fewer components than shown in the figure, or combine certain components, or adopt a different component arrangement.

An embodiment of the present application also provides a computer device, which includes: a processor and a memory, wherein at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor to implement the wallpaper display method provided by the above-mentioned method embodiments.

An embodiment of the present application further provides a computer storage medium, in which at least one computer program is stored. The at least one computer program is loaded and executed by a processor to implement the wallpaper display method provided by the above-mentioned method embodiments.

An embodiment of the present application also provides a computer program product, which includes a computer program stored in a computer-readable storage medium; the computer program is read and executed from the computer-readable storage medium by a processor of a computer device, so that the computer device executes the wallpaper display method provided by the above-mentioned method embodiments.

It should be understood that the "plurality" mentioned in this article refers to two or more. "And/or" describes the association relationship of the associated objects, indicating that there can be three relationships. For example, A and/or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character "/" generally indicates that the associated objects before and after are in an "or" relationship.

A person skilled in the art will appreciate that all or part of the steps to implement the above embodiments may be accomplished by hardware, or by a program to instruct the relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent switching, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

A method for displaying wallpaper, characterized in that the method is executed by a first terminal, and the method includes:

Play audio data;

The wallpaper is dynamically displayed based on the frequency spectrum characteristics of the audio data at different moments.
The method according to claim 1, characterized in that the dynamically displaying the wallpaper based on the frequency spectrum characteristics of the audio data at different times comprises:

Obtaining real-time data of the audio data at the i-th moment;

Performing feature extraction on the real-time data at the i-th moment to obtain frequency spectrum features of the audio data at the i-th moment;

Based on the frequency spectrum feature at the i-th moment, a wallpaper at the i-th moment is generated, where i is a positive integer.
The method according to claim 2, characterized in that the first terminal has a central processing unit (CPU) and a graphics processing unit (GPU);

The extracting features of the real-time data at the i-th moment to obtain the frequency spectrum features of the audio data at the i-th moment includes:

Extracting the real-time data at the i-th moment by the CPU to obtain the frequency spectrum data of the audio data at the i-th moment;

The GPU performs feature extraction on the spectrum data at the i-th moment to obtain the spectrum features of the audio data at the i-th moment.
The method according to claim 2, characterized in that the step of generating the wallpaper at the i-th moment based on the spectrum characteristics at the i-th moment comprises:

Modeling display elements of the wallpaper at the i-th moment based on the frequency spectrum characteristics at the i-th moment;

Based on the display elements of the wallpaper at the i-th moment obtained by modeling, the wallpaper at the i-th moment is rendered and displayed.
The method according to claim 4, characterized in that modeling the display elements of the wallpaper at the i-th moment based on the spectrum characteristics at the i-th moment comprises:

When the display elements of the wallpaper at the i-th moment are modeled by a modeling function, the frequency spectrum features at the i-th moment are superimposed on the input of the modeling function to obtain the display elements of the wallpaper at the i-th moment.
The method according to claim 5 is characterized in that the display element includes at least one of hue, saturation value, brightness value, fluctuation rate, fluctuation frequency, and motion trajectory.
The method according to any one of claims 1 to 6, characterized in that the playing of audio data comprises:

Play the audio data in the first terminal; or,

The audio data is played in a second terminal, where the second terminal refers to a terminal device associated with the first terminal.
The method according to claim 7, characterized in that the dynamically displaying the wallpaper based on the frequency spectrum characteristics of the audio data at different times comprises:

The wallpaper is dynamically displayed based on the frequency spectrum characteristics of the audio data played in the first terminal at different times.
The method according to claim 7, characterized in that the dynamically displaying the wallpaper based on the frequency spectrum characteristics of the audio data at different times comprises:

The wallpaper is dynamically displayed in the first terminal based on the frequency spectrum characteristics of the audio data played in the second terminal at different times.
The method according to any one of claims 1 to 6, characterized in that the wallpaper comprises at least one display material;

The dynamically displaying the wallpaper based on the frequency spectrum characteristics of the audio data at different times includes:

Based on the frequency spectrum characteristics of the audio data at different moments, the display materials corresponding to the frequency spectrum characteristics in the wallpaper are dynamically displayed.
The method according to any one of claims 1 to 6, characterized in that dynamically displaying the wallpaper based on the frequency spectrum characteristics of the audio data at different times comprises:

The wallpaper is dynamically displayed based on the frequency spectrum characteristics of the audio data at different times and weather element information, where the weather element information refers to weather information at the geographical location of the first terminal.
The method according to any one of claims 1 to 6, characterized in that dynamically displaying the wallpaper based on the frequency spectrum characteristics of the audio data at different times comprises:

The wallpaper is dynamically displayed based on the frequency spectrum characteristics of the audio data at different times and the gyroscope data change characteristics, and the gyroscope data change characteristics are used to indicate the position change of the first terminal.
The method according to any one of claims 1 to 6, characterized in that dynamically displaying the wallpaper based on the frequency spectrum characteristics of the audio data at different times comprises:

The wallpaper is dynamically displayed based on the frequency spectrum characteristics and heart rate characteristics of the audio data at different times, and the heart rate change characteristics are obtained by monitoring a third terminal associated with the first terminal.
A wallpaper display device, characterized in that the device comprises:

A playback module, used for playing audio data;

The display module is used to dynamically display the wallpaper based on the frequency spectrum characteristics of the audio data at different times.
A computer device, characterized in that the computer device comprises: a processor and a memory, wherein at least one computer program is stored in the memory, and at least one computer program is loaded and executed by the processor to implement the wallpaper display method according to any one of claims 1 to 13.
A computer storage medium, characterized in that at least one computer program is stored in the computer-readable storage medium, and the at least one computer program is loaded and executed by a processor to implement the wallpaper display method as described in any one of claims 1 to 13.
A computer program product, characterized in that the computer program product comprises a computer program, which is stored in a computer-readable storage medium; the computer program is read and executed from the computer-readable storage medium by a processor of a computer device, so that the computer device executes the wallpaper display method according to any one of claims 1 to 13.