CN110139143B - Virtual article display method, device, computer equipment and storage medium - Google Patents
Virtual article display method, device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN110139143B CN110139143B CN201910436553.4A CN201910436553A CN110139143B CN 110139143 B CN110139143 B CN 110139143B CN 201910436553 A CN201910436553 A CN 201910436553A CN 110139143 B CN110139143 B CN 110139143B
- Authority
- CN
- China
- Prior art keywords
- virtual article
- virtual
- frequency values
- animation
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/7834—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using audio features
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4784—Supplemental services, e.g. displaying phone caller identification, shopping application receiving rewards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Library & Information Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a virtual article display method, a virtual article display device, computer equipment and a storage medium, and belongs to the technical field of networks. According to the method for displaying the virtual article, the corresponding virtual article data are obtained based on the virtual article presenting instruction initiated by the terminal, the audio data corresponding to the virtual article data are also obtained when the virtual article data are obtained, so that the virtual article which changes along with the frequency change of audio playing can be displayed when the audio data are played.
Description
Technical Field
The present invention relates to the field of network technologies, and in particular, to a method and an apparatus for displaying a virtual object, a computer device, and a storage medium.
Background
Live broadcast is a sharing mode which is more and more popular with the public at present, and the anchor can transmit the video content which the anchor wants to transmit to the audience by live broadcast in a live broadcast room. In order to pull the distance between the anchor and the audience to form a good interaction, most live broadcast applications provide a function of presenting virtual items such as gifts, the audience can select a certain gift to be sent to the anchor, and once the presentation is successful, the gift can be displayed on a live broadcast interface, for example, when the audience feeds a rose to the anchor, a rose can be displayed on the live broadcast interface. However, such display effect and interaction manner are monotonous, and the live scenes cannot be effectively utilized.
Disclosure of Invention
The embodiment of the invention provides a virtual article display method, a virtual article display device, computer equipment and a readable storage medium, and can provide more diversified display effects and more vivid interaction modes. The technical scheme is as follows:
in one aspect, an embodiment of the present invention provides a virtual article display method, where the method includes:
receiving a virtual article presenting instruction, wherein the virtual article presenting instruction carries a virtual article identifier;
acquiring virtual article data corresponding to the virtual article identifier and audio data corresponding to the virtual article data;
analyzing the audio data to obtain a plurality of frequency values of the audio data;
and when the audio data is played, displaying virtual article animation according to the multiple frequency values of the audio data and the virtual article data, wherein the display form of a virtual article in the virtual article animation changes along with the multiple frequency values.
In one possible implementation manner, the obtaining audio data corresponding to the virtual article data includes:
when a target webpage element is detected in a live broadcast page, downloading the audio data through an audio path stored in an element attribute of the target webpage element.
In one possible implementation manner, the analyzing the audio data to obtain a plurality of frequency values of the audio data includes:
sampling the audio data according to a preset sampling duration to obtain a plurality of frequency values represented in a hash form;
storing the plurality of frequency values represented in hash form in array form.
In one possible implementation, the displaying a virtual good animation according to the plurality of frequency values of the audio data and the virtual good data includes:
and for any animation element of the virtual article, adjusting at least one of the size and the color of the animation element according to the plurality of frequency values, and drawing based on the adjusted animation element to realize the display of the animation of the virtual article.
In one possible implementation, the adjusting at least one of the size and the color of the animation element according to the plurality of frequency values comprises any one of:
adjusting at least one of the size and the color of the animation element to a value corresponding to a first difference value according to the first difference value between the plurality of frequency values and a reference frequency value;
and adjusting at least one of the size and the color of the animation element to a value corresponding to a second difference value according to the second difference value between the plurality of frequency values and the average value of the plurality of frequency values.
In one aspect, an embodiment of the present invention provides a virtual article display apparatus, where the apparatus includes:
the receiving module is used for receiving a virtual article presenting instruction, and the virtual article presenting instruction carries a virtual article identifier;
the acquisition module is used for acquiring virtual article data corresponding to the virtual article identifier and audio data corresponding to the virtual article data;
the analysis module is used for analyzing the audio data to obtain a plurality of frequency values of the audio data;
and the display module is used for displaying virtual article animation according to the multiple frequency values of the audio data and the virtual article data when the audio data is played, wherein the display form of a virtual article in the virtual article animation changes along with the multiple frequency values.
In one possible implementation, the obtaining module includes: and the audio data acquisition unit is used for downloading the audio data through an audio path stored in the element attribute of the target webpage element when the target webpage element is detected in the live broadcast page.
In a possible implementation manner, the display module is configured to, for any animation element of the virtual article, adjust at least one of a size and a color of the animation element according to the plurality of frequency values, and draw based on the adjusted animation element, so as to implement display of the animation of the virtual article.
In one aspect, a computer device is provided, and the computer device includes a processor and a memory, where at least one instruction is stored in the memory, and the instruction is loaded and executed by the processor to implement the operations performed by the virtual article display method as described above.
In one aspect, a computer-readable storage medium is provided, in which at least one instruction is stored, and the instruction is loaded and executed by the processor to implement the operations performed by the virtual article display method as described above.
The technical scheme provided by the embodiment of the invention has the beneficial effects that at least: the virtual article display method comprises the steps that corresponding virtual article data are obtained based on a virtual article presentation instruction initiated by a terminal, and audio data corresponding to the virtual article data are also obtained when the virtual article data are obtained, so that a virtual article which changes along with the frequency change of audio playing can be displayed when the audio data are played.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 illustrates a block diagram of a virtual item display system 100 provided by an exemplary embodiment of the present application;
FIG. 2 is a schematic flow diagram of a virtual item display process according to an embodiment of the present invention;
FIG. 3 is a flowchart of a virtual article display method according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a virtual article display device according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a terminal according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a computer device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
Fig. 1 shows a block diagram of a virtual article display system 100 according to an exemplary embodiment of the present application. The virtual item display system 100 includes: terminal 110 and virtual item display platform 140.
The terminal 110 is connected to the virtual item display platform 110 through a wireless network or a wired network. The terminal 110 may be at least one of a smartphone, a game console, a desktop computer, a tablet computer, an e-book reader, an MP3 player, an MP4 player, and a laptop portable computer. The terminal 110 is installed and operated with an application program supporting the display of the virtual good. The application may be any one of a social application, an instant messaging application, a shopping application, and a video application, and in one possible implementation, the application may be a live application. Illustratively, the terminal 110 is a terminal used by any user, and a user account may be registered in an application running in the terminal 110.
Terminal 110 is connected to virtual item display platform 140 via a wireless or wired network.
The virtual item display platform 140 includes at least one of a server, a plurality of servers, a cloud computing platform, and a virtualization center. Virtual good display platform 140 is used to provide background services for applications that support virtual good display.
Optionally, taking the application as a live application for example for explanation, the virtual article display platform 140 includes: the system comprises an access server, a live broadcast server and a database. The access server is used for providing the terminal 110 with access service. Live servers are used to provide live related background services, e.g.,. The live broadcast server can be one or more. When the number of the live broadcast servers is multiple, at least two live broadcast servers exist for providing different services, and/or at least two live broadcast servers exist for providing the same service, for example, the same service is provided in a load balancing manner, which is not limited in the embodiment of the present application. Virtual article data can be set in the live broadcast server to provide a display form of the virtual article.
The terminal 110 may be generally referred to as one of a plurality of terminals, and the embodiment is only illustrated by the terminal 110. The types of the terminal 110 include: at least one of a smartphone, a gaming console, a desktop computer, a tablet, an e-book reader, an MP3 player, an MP4 player, and a laptop portable computer.
Those skilled in the art will appreciate that the number of terminals described above may be greater or fewer. For example, the number of the terminals may be only one, or several tens or hundreds, or more, and in this case, the virtual article display system further includes other terminals. The number of terminals and the type of the device are not limited in the embodiments of the present application.
Fig. 2 is a flowchart illustrating a virtual article display method according to an exemplary embodiment of the present application. Referring to fig. 2, the method is applied to any terminal, and includes:
200. and receiving a virtual article presenting instruction, wherein the virtual article presenting instruction carries the virtual article identifier.
The virtual object can be a virtual gift, a virtual item, a virtual currency, and the like, and the virtual object can be a virtual object accompanied by an audio playing effect, the virtual object has a display form, and is configured with a corresponding audio playing effect, and the display form is affected by the audio playing effect. For example, the display size of the virtual article may vary with the frequency of the audio, the larger the frequency, the larger the display size, the color of the virtual article may vary with the frequency of the audio, the larger the frequency, the brighter the color.
Wherein the virtual object may correspond to a piece of music, which may be a song, pure music, or the like.
201. And acquiring virtual article data of the virtual article identifier and audio data corresponding to the virtual article data.
202. And analyzing the audio data to obtain a plurality of frequency values of the audio data.
203. And when the audio data is played, displaying virtual article animation according to the plurality of frequency values of the audio data and the virtual article data, wherein the display form of a virtual article in the virtual article animation changes along with the plurality of frequency values.
According to the method provided by the embodiment of the invention, when the virtual article data is acquired, the audio data corresponding to the virtual article data is also acquired, so that the virtual article which changes along with the frequency change of audio playing can be displayed when the audio data is played.
In one possible implementation manner, the obtaining audio data corresponding to the virtual article data includes:
when a target webpage element is detected in a live broadcast page, downloading the audio data through an audio path stored in an element attribute of the target webpage element.
In one possible implementation manner, the analyzing the audio data to obtain a plurality of frequency values of the audio data includes:
sampling the audio data according to a preset sampling duration to obtain a plurality of frequency values represented in a hash form;
storing the plurality of frequency values represented in hash form in array form.
In one possible implementation, the displaying a virtual good animation according to the plurality of frequency values of the audio data and the virtual good data includes:
and for any animation element of the virtual article, adjusting at least one of the size and the color of the animation element according to the plurality of frequency values, and drawing based on the adjusted animation element to realize the display of the animation of the virtual article.
In one possible implementation, the adjusting at least one of the size and the color of the animation element according to the plurality of frequency values comprises any one of:
adjusting at least one of the size and the color of the animation element to a value corresponding to a first difference value according to the first difference value between the plurality of frequency values and a reference frequency value;
and adjusting at least one of the size and the color of the animation element to a value corresponding to a second difference value according to the second difference value between the plurality of frequency values and the average value of the plurality of frequency values.
All the above optional technical solutions may be combined arbitrarily to form the optional embodiments of the present disclosure, and are not described herein again.
Fig. 3 is a flowchart illustrating a virtual article display method according to an exemplary embodiment of the present application. Referring to fig. 3, the method is described by taking an interaction among the first terminal, the server, and the second terminal as an example, and may specifically include the following steps.
300. The first terminal receives a virtual article presenting instruction, and the virtual article presenting instruction carries a virtual article identifier.
The first terminal can trigger the presentation process of the virtual item on a live interface of the terminal, the live interface can include at least one virtual item option for a terminal user to select, and the option of the virtual item accompanied by the audio playing effect can be distinguished from the options of other common virtual items, for example, one side of the option can display an audio symbol and the like.
301. The first terminal sends a virtual item presentation request to the server, wherein the virtual item presentation request carries the virtual item identifier.
And the virtual item presentation request is used for requesting the presentation of the virtual item corresponding to the virtual item identifier to the user of the second terminal.
302. After receiving the virtual article presentation request, the server creates a target webpage element in a live broadcast page, and stores an audio path corresponding to the virtual article identifier in an element attribute of the target webpage element.
After receiving the virtual item presentation request, the server extracts the virtual item identifier from the virtual item presentation request, and when the virtual item identifier corresponds to audio, acquires an audio path corresponding to the virtual item identifier, creates a target web page element (e.g., < audio/>) in a live page, sets the audio path through an element attribute, for example, a storage path of mp3 may be stored in an element attribute src, so that the audio path may be provided to the terminal, so that the terminal may play based on the audio path.
Of course, for different web page encoding modes, the target web page element may be another web page element, which is not limited in the embodiment of the present invention.
303. And the server sends the live broadcast data containing the live broadcast page to the first terminal and the second terminal.
The server can carry live broadcast data of a live broadcast page in live broadcast video streams and send the live broadcast data to each terminal, so that each terminal can play virtual articles and audio.
304. And after the second terminal receives the live broadcast data, the second terminal acquires the virtual article data from the live broadcast data and downloads the audio data corresponding to the virtual article data through the audio path stored in the element attribute of the target webpage element in the live broadcast page.
In step 304, the second terminal obtains the virtual article data and the audio data corresponding to the virtual article data. In the embodiment of the present invention, only the processing process of the second terminal after receiving the live data is taken as an example for explanation, in the implementation process, both the audience terminal and the anchor terminal of the live page may receive the live data, so as to obtain the audio based on the live data for playing, which is not described herein again.
It should be noted that the above process of acquiring audio data can be implemented by WebAudio technology.
305. The second terminal analyzes the audio data to obtain a plurality of frequency values of the audio data.
The frequency value can express information such as tone height, rhythm speed and the like of the audio data, and the characteristics of the audio data can be embodied through the information, so that the frequency value can be obtained through analysis of the audio data. In one possible implementation, this step 305 may be implemented by the following process: according to a preset sampling duration, carrying out frequency sampling on the audio data to obtain a plurality of frequency values represented in a hash form; storing the plurality of frequency values represented in hash form in array form. The storage based on the array form can be conveniently read, and the array form can store the frequency value based on the time sequence of sampling, so that the display effect of the subsequent virtual article corresponds to the actual effect of audio playing, and the audio-visual experience of a user is improved.
It should be noted that the above process of analyzing audio data can be implemented by WebAudio technology.
306. And when the second terminal plays the audio data, displaying virtual article animation according to the multiple frequency values of the audio data and the virtual article data, wherein the display form of a virtual article in the virtual article animation changes along with the multiple frequency values.
In order to realize that the display form of the virtual article changes along with the frequency values, the terminal may initialize a canvas object first, and then in the process of drawing based on the canvas object, associate the size, length, color and other attributes of the animation elements with the array obtained in step 305, thereby realizing the effect that the gift animation moves rhythmically along with the audio.
Some specific implementations of displaying virtual item animations are described below:
in one possible implementation, this step 306 may include: and for any animation element of the virtual article, adjusting at least one of the size and the color of the animation element according to the plurality of frequency values, and drawing based on the adjusted animation element to realize the display of the animation of the virtual article.
The animation element corresponding to the virtual article may have an initial size and a color, and in order to enable the display of the animation element to change along with the change of the audio, the display effect of the animation element may be changed by adjusting at least one of the initial size and the color of the animation element.
In one possible implementation, the adjusting at least one of the size and the color of the animation element according to the plurality of frequency values may include: and adjusting at least one of the size and the color of the animation element to a numerical value corresponding to a first difference value according to the first difference value between the plurality of frequency values and the reference frequency value. The reference frequency value may be a preset frequency value, and it may be determined, according to a difference between each frequency value and the reference frequency value, what value at least one of the size and the color of the animation element is adjusted to reflect a differentiated display effect between each virtual article, where if some audio frequency values are large, the corresponding target value is large, and finally the displayed size or color is more obvious.
The difference and the size and the corresponding relationship between the difference and the color may be preset, so that in the adjusting process, the corresponding relationship between the difference and the size and between the difference and the color may be queried based on the first difference to obtain at least one of the target size and the target color. For the virtual article itself, it may set in advance a display item of the animation element to be adjusted, for example, for the first virtual article, it may set to adjust only the size of the animation element, and then the target size of the animation element may be determined according to the above first difference.
In one possible implementation, the adjusting at least one of the size and the color of the animation element according to the plurality of frequency values may include: and adjusting at least one of the size and the color of the animation element to a value corresponding to a second difference value according to the second difference value between the plurality of frequency values and the average value of the plurality of frequency values. The average value may be a preset frequency value, and it may be determined, according to a difference between each frequency value and the average value, what value at least one of the size and the color of the animation element is adjusted to achieve a more uniform display effect, the target value is changed based on a change degree of the whole audio itself, for some audio with less frequency fluctuation, the audio may be displayed in a more gradual form, and the fluctuation of the audio itself may be reflected by a change of the display form of the virtual article.
The difference and the size and the corresponding relationship between the difference and the color may be preset, so that in the adjusting process, the corresponding relationship between the difference and the size and between the difference and the color may be queried based on the second difference to obtain at least one of the target size and the target color. For the virtual article itself, it may set in advance a display item of the animation element to be adjusted, for example, for the second virtual article, it may set a color for which only the animation element is adjusted, and then the target color of the animation element may be determined according to the above-mentioned second difference.
It should be noted that, when the target value of the adjustment is determined based on a certain frequency value, at least one of the size and the color of the virtual article at a certain playing time point is actually adjusted based on the frequency value at the playing time point, so that the virtual article can present the actual audio effect of the audio through the form change when the virtual article is played at the certain time point.
It should be noted that, in the above embodiment, only the display of the second terminal when the first terminal initiates the presenting flow is taken as an example for description, but in an actual scene, after the first terminal initiates the presenting flow, the above process is also implemented in the first terminal, so that the user of the first terminal can view the audio data that changes along with the change of the frequency of the audio playing.
According to the method provided by the embodiment of the invention, the corresponding virtual article data is obtained based on the virtual article presentation instruction initiated by the terminal, and the audio data corresponding to the virtual article data is also obtained when the virtual article data is obtained, so that the virtual article which changes along with the frequency change of audio playing can be displayed when the audio data is played.
Further, the above embodiment may implement a unique audio gift based on a live broadcast room through a WebAudio technology, and when any user sends out the audio gift, corresponding audio data may be played in the live broadcast room, and it may be visually observed that an animation action of the gift changes with a change in audio frequency, thereby greatly improving user experience.
Fig. 4 is a schematic structural diagram of a virtual object display apparatus according to an embodiment of the present invention, and referring to fig. 4, the apparatus includes:
a receiving module 400, configured to receive a virtual article presenting instruction, where the virtual article presenting instruction carries a virtual article identifier;
an obtaining module 401, configured to obtain virtual item data corresponding to the virtual item identifier and audio data corresponding to the virtual item data;
an analysis module 402, configured to analyze the audio data to obtain a plurality of frequency values of the audio data;
a display module 403, configured to display a virtual article animation according to the multiple frequency values of the audio data and the virtual article data when the audio data is played, where a display form of a virtual article in the virtual article animation changes along with the multiple frequency values.
In one possible implementation, the obtaining module includes: and the audio data acquisition unit is used for downloading the audio data through an audio path stored in the element attribute of the target webpage element when the target webpage element is detected in the live broadcast page.
In a possible implementation manner, the display module is configured to, for any animation element of the virtual article, adjust at least one of a size and a color of the animation element according to the plurality of frequency values, and draw based on the adjusted animation element, so as to implement display of the animation of the virtual article.
In one possible implementation, the analysis module is configured to:
sampling the audio data according to a preset sampling duration to obtain a plurality of frequency values represented in a hash form;
storing the plurality of frequency values represented in hash form in array form.
In one possible implementation, the display module is configured to perform any one of the following steps:
adjusting at least one of the size and the color of the animation element to a value corresponding to a first difference value according to the first difference value between the plurality of frequency values and a reference frequency value;
and adjusting at least one of the size and the color of the animation element to a value corresponding to a second difference value according to the second difference value between the plurality of frequency values and the average value of the plurality of frequency values.
It should be noted that: in the virtual article display device provided in the above embodiment, when recommending an application, only the division of the above functional modules is used as an example, and in practical applications, the above function allocation may be completed by different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the above described functions. In addition, the virtual article display apparatus provided in the above embodiments and the virtual article display method embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments and are not described herein again.
For example, fig. 5 is a schematic structural diagram of a server provided in an embodiment of the present invention, and the server 500 may generate a relatively large difference due to different configurations or performances, and may include one or more processors (CPUs) 501 and one or more memories 502, where the memory 502 stores at least one instruction, and the at least one instruction is loaded and executed by the processor 501 to implement the virtual item display method provided in each method embodiment. Of course, the server may also have components such as a wired or wireless network interface, a keyboard, and an input/output interface, so as to perform input/output, and the server may also include other components for implementing the functions of the device, which are not described herein again.
The method provided by the embodiment of the present invention may be implemented in a computer device, and the computer device may be implemented as a terminal, for example, fig. 6 is a schematic structural diagram of a terminal provided by the embodiment of the present invention. The terminal 600 may be a portable mobile terminal such as: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion Picture Experts compression standard Audio Layer 3), an MP4 player (Moving Picture Experts Group Audio Layer IV, motion Picture Experts compression standard Audio Layer 4), a notebook computer, a desktop computer, a head-mounted device, or any other intelligent terminal. The terminal 600 may also be referred to by other names such as user equipment, portable terminal, laptop terminal, desktop terminal, etc.
In general, the terminal 600 includes: a processor 601 and a memory 602.
The processor 601 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so on. The processor 601 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 601 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 601 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the display screen. In some embodiments, processor 601 may also include an AI (Artificial Intelligence) processor for processing computational operations related to machine learning.
The memory 602 may include one or more computer-readable storage media, which may be non-transitory. The memory 602 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 602 is used to store at least one instruction for being possessed by processor 601 to implement the virtual article display method provided by the method embodiments herein.
In some embodiments, the terminal 600 may further optionally include: a peripheral interface 603 and at least one peripheral. The processor 601, memory 602, and peripheral interface 603 may be connected by buses or signal lines. Various peripheral devices may be connected to the peripheral interface 603 via a bus, signal line, or circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 604, a touch screen display 605, a camera 606, an audio circuit 607, a positioning component 608, and a power supply 609.
The peripheral interface 603 may be used to connect at least one peripheral related to I/O (Input/Output) to the processor 601 and the memory 602. In some embodiments, the processor 601, memory 602, and peripheral interface 603 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 601, the memory 602, and the peripheral interface 603 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.
The Radio Frequency circuit 604 is used for receiving and transmitting RF (Radio Frequency) signals, also called electromagnetic signals. The radio frequency circuitry 604 communicates with communication networks and other communication devices via electromagnetic signals. The rf circuit 604 converts an electrical signal into an electromagnetic signal to transmit, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 604 comprises: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuitry 604 may communicate with other terminals via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: metropolitan area networks, various generation mobile communication networks (2G, 3G, 4G, and 8G), Wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the rf circuit 604 may further include NFC (Near Field Communication) related circuits, which are not limited in this application.
The display 605 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 605 is a touch display screen, the display screen 605 also has the ability to capture touch signals on or over the surface of the display screen 605. The touch signal may be input to the processor 601 as a control signal for processing. At this point, the display 605 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, the display 605 may be one, providing the front panel of the terminal 600; in other embodiments, the display 605 may be at least two, respectively disposed on different surfaces of the terminal 600 or in a folded design; in still other embodiments, the display 605 may be a flexible display disposed on a curved surface or on a folded surface of the terminal 600. Even more, the display 605 may be arranged in a non-rectangular irregular pattern, i.e., a shaped screen. The Display 605 may be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), and the like.
The camera assembly 606 is used to capture images or video. Optionally, camera assembly 606 includes a front camera and a rear camera. Generally, a front camera is disposed at a front panel of the terminal, and a rear camera is disposed at a rear surface of the terminal. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments, camera assembly 606 may also include a flash. The flash lamp can be a monochrome temperature flash lamp or a bicolor temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.
The positioning component 608 is used for positioning the current geographic Location of the terminal 600 to implement navigation or LBS (Location Based Service). The Positioning component 608 can be a Positioning component based on the united states GPS (Global Positioning System), the chinese beidou System, the russian graves System, or the european union's galileo System.
In some embodiments, the terminal 600 also includes one or more sensors 610. The one or more sensors 610 include, but are not limited to: acceleration sensor 611, gyro sensor 612, pressure sensor 613, fingerprint sensor 614, optical sensor 615, and proximity sensor 616.
The acceleration sensor 611 may detect the magnitude of acceleration in three coordinate axes of a coordinate system established with the terminal 611. For example, the acceleration sensor 611 may be used to detect components of the gravitational acceleration in three coordinate axes. The processor 601 may control the touch screen display 605 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 611. The acceleration sensor 611 may also be used for acquisition of motion data of a game or a user.
The gyro sensor 612 may detect a body direction and a rotation angle of the terminal 600, and the gyro sensor 612 and the acceleration sensor 611 may cooperate to acquire a 3D motion of the user on the terminal 600. The processor 601 may implement the following functions according to the data collected by the gyro sensor 612: motion sensing (such as changing the UI according to a user's tilting operation), image stabilization at the time of photographing, game control, and inertial navigation.
The pressure sensor 613 may be disposed on a side frame of the terminal 600 and/or on a lower layer of the touch display screen 605. When the pressure sensor 613 is disposed on the side frame of the terminal 600, a user's holding signal of the terminal 600 can be detected, and the processor 601 performs left-right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 613. When the pressure sensor 613 is disposed at the lower layer of the touch display screen 605, the processor 601 controls the operability control on the UI interface according to the pressure operation of the user on the touch display screen 605. The operability control comprises at least one of a button control, a scroll bar control, an icon control and a menu control.
The fingerprint sensor 614 is used for collecting a fingerprint of a user, and the processor 601 identifies the identity of the user according to the fingerprint collected by the fingerprint sensor 614, or the fingerprint sensor 614 identifies the identity of the user according to the collected fingerprint. Upon recognizing that the user's identity is a trusted identity, the processor 601 authorizes the user to have relevant sensitive operations including unlocking the screen, viewing encrypted information, downloading software, paying, and changing settings, etc. The fingerprint sensor 614 may be disposed on the front, back, or side of the terminal 600. When a physical key or vendor Logo is provided on the terminal 600, the fingerprint sensor 614 may be integrated with the physical key or vendor Logo.
The optical sensor 615 is used to collect the ambient light intensity. In one embodiment, processor 601 may control the display brightness of touch display 605 based on the ambient light intensity collected by optical sensor 615. Specifically, when the ambient light intensity is high, the display brightness of the touch display screen 605 is increased; when the ambient light intensity is low, the display brightness of the touch display screen 605 is turned down. In another embodiment, the processor 601 may also dynamically adjust the shooting parameters of the camera assembly 606 according to the ambient light intensity collected by the optical sensor 615.
A proximity sensor 616, also known as a distance sensor, is typically disposed on the front panel of the terminal 600. The proximity sensor 616 is used to collect the distance between the user and the front surface of the terminal 600. In one embodiment, when the proximity sensor 616 detects that the distance between the user and the front surface of the terminal 600 gradually decreases, the processor 601 controls the touch display 605 to switch from the bright screen state to the dark screen state; when the proximity sensor 616 detects that the distance between the user and the front surface of the terminal 600 gradually becomes larger, the processor 601 controls the touch display 605 to switch from the breath screen state to the bright screen state.
Those skilled in the art will appreciate that the configuration shown in fig. 6 is not intended to be limiting of terminal 600 and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components may be used.
In an exemplary embodiment, there is also provided a computer readable storage medium, such as a memory, comprising instructions executable by a processor in a terminal or server to perform the virtual item display method in the above embodiments. For example, the computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a Compact Disc Read-Only Memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, and the like.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only exemplary of the present invention and should not be taken as limiting the invention, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (9)
1. A virtual item display method, the method comprising:
receiving a virtual article presenting instruction, wherein the virtual article presenting instruction carries a virtual article identifier, and a virtual article corresponding to the virtual article identifier has a display form and is configured with an audio playing effect;
acquiring virtual article data corresponding to the virtual article identifier and audio data corresponding to the virtual article data;
sampling the audio data according to a preset sampling duration to obtain a plurality of frequency values represented in a hash form;
storing the plurality of hash-represented frequency values in an array, an attribute of the frequency values being associated with an animation element of the virtual item data;
and when the audio data is played, displaying virtual article animation according to the multiple frequency values of the audio data and the virtual article data, wherein the display form of a virtual article in the virtual article animation changes along with the multiple frequency values.
2. The method according to claim 1, wherein the obtaining audio data corresponding to the virtual article data comprises:
when a target webpage element is detected in a live broadcast page, downloading the audio data through an audio path stored in an element attribute of the target webpage element.
3. The method of claim 1, wherein said displaying a virtual item animation based on the plurality of frequency values of the audio data and the virtual item data comprises:
and for any animation element of the virtual article, adjusting at least one of the size and the color of the animation element according to the plurality of frequency values, and drawing based on the adjusted animation element to realize the display of the animation of the virtual article.
4. The method of claim 3, wherein said adjusting at least one of a size and a color of said animated element according to said plurality of frequency values comprises any of:
adjusting at least one of the size and the color of the animation element to a value corresponding to a first difference value according to the first difference value between the plurality of frequency values and a reference frequency value;
and adjusting at least one of the size and the color of the animation element to a value corresponding to a second difference value according to the second difference value between the plurality of frequency values and the average value of the plurality of frequency values.
5. A virtual item display apparatus, the apparatus comprising:
the receiving module is used for receiving a virtual article presenting instruction, the virtual article presenting instruction carries a virtual article identifier, and a virtual article corresponding to the virtual article identifier has a display form and is configured with an audio playing effect;
the acquisition module is used for acquiring virtual article data corresponding to the virtual article identifier and audio data corresponding to the virtual article data;
the analysis module is used for sampling the audio data according to preset sampling duration to obtain a plurality of frequency values expressed in a hash form; storing the plurality of hash-represented frequency values in an array, an attribute of the frequency values being associated with an animation element of the virtual item data;
and the display module is used for displaying virtual article animation according to the multiple frequency values of the audio data and the virtual article data when the audio data is played, wherein the display form of a virtual article in the virtual article animation changes along with the multiple frequency values.
6. The apparatus of claim 5, wherein the obtaining module comprises: and the audio data acquisition unit is used for downloading the audio data through an audio path stored in the element attribute of the target webpage element when the target webpage element is detected in the live broadcast page.
7. The apparatus of claim 5, wherein the display module is configured to adjust at least one of a size and a color of any animation element of the virtual article according to the plurality of frequency values, and draw based on the adjusted animation element to achieve the animated display of the virtual article.
8. A computer device comprising a processor and a memory, the memory having stored therein at least one instruction that is loaded and executed by the processor to perform operations performed by the virtual article display method of any one of claims 1 to 4.
9. A computer-readable storage medium having stored therein at least one instruction, which is loaded and executed by a processor to perform operations performed by the virtual article display method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910436553.4A CN110139143B (en) | 2019-05-23 | 2019-05-23 | Virtual article display method, device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910436553.4A CN110139143B (en) | 2019-05-23 | 2019-05-23 | Virtual article display method, device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110139143A CN110139143A (en) | 2019-08-16 |
| CN110139143B true CN110139143B (en) | 2021-11-02 |
Family
ID=67573079
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910436553.4A Active CN110139143B (en) | 2019-05-23 | 2019-05-23 | Virtual article display method, device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110139143B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111857931B (en) * | 2020-07-22 | 2024-05-28 | 北京达佳互联信息技术有限公司 | Processing method and device for animation display of virtual article |
| CN113613056A (en) * | 2021-08-03 | 2021-11-05 | 广州繁星互娱信息科技有限公司 | Animation special effect display method and device, electronic equipment and medium |
| CN114302160B (en) * | 2021-12-29 | 2023-04-28 | 北京达佳互联信息技术有限公司 | Information display method, device, computer equipment and medium |
| CN114415873A (en) * | 2022-01-14 | 2022-04-29 | 北京字节跳动网络技术有限公司 | Virtual object display method and device, computer equipment and storage medium |
| WO2024077492A1 (en) * | 2022-10-11 | 2024-04-18 | 广州酷狗计算机科技有限公司 | Playback interface displaying method and apparatus, device, medium and program product |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007096691A2 (en) * | 2006-02-21 | 2007-08-30 | Nokia Corporation | Generating a representation of a dancer dancing to music |
| CN106101736A (en) * | 2016-06-28 | 2016-11-09 | 广州华多网络科技有限公司 | The methods of exhibiting of a kind of virtual present and system |
| CN106789562A (en) * | 2016-12-06 | 2017-05-31 | 腾讯科技（深圳）有限公司 | A kind of virtual objects sending method, method of reseptance, device and system |
| CN108259925A (en) * | 2017-12-29 | 2018-07-06 | 广州市百果园信息技术有限公司 | Music gifts processing method, storage medium and terminal in net cast |
| CN108989706A (en) * | 2017-06-02 | 2018-12-11 | 北京字节跳动网络技术有限公司 | The method and device of special efficacy is generated based on music rhythm |
-
2019
- 2019-05-23 CN CN201910436553.4A patent/CN110139143B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007096691A2 (en) * | 2006-02-21 | 2007-08-30 | Nokia Corporation | Generating a representation of a dancer dancing to music |
| CN106101736A (en) * | 2016-06-28 | 2016-11-09 | 广州华多网络科技有限公司 | The methods of exhibiting of a kind of virtual present and system |
| CN106789562A (en) * | 2016-12-06 | 2017-05-31 | 腾讯科技（深圳）有限公司 | A kind of virtual objects sending method, method of reseptance, device and system |
| CN108989706A (en) * | 2017-06-02 | 2018-12-11 | 北京字节跳动网络技术有限公司 | The method and device of special efficacy is generated based on music rhythm |
| CN108259925A (en) * | 2017-12-29 | 2018-07-06 | 广州市百果园信息技术有限公司 | Music gifts processing method, storage medium and terminal in net cast |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110139143A (en) | 2019-08-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107967706B (en) | Multimedia data processing method and device and computer readable storage medium | |
| CN108401124B (en) | Video recording method and device | |
| CN110139143B (en) | Virtual article display method, device, computer equipment and storage medium | |
| CN112672176B (en) | Interaction method, device, terminal, server and medium based on virtual resources | |
| WO2019114514A1 (en) | Method and apparatus for displaying pitch information in live broadcast room, and storage medium | |
| CN110841285B (en) | Interface element display method and device, computer equipment and storage medium | |
| CN109168073B (en) | Method and device for displaying cover of live broadcast room | |
| CN110061900B (en) | Message display method, device, terminal and computer readable storage medium | |
| CN112118477B (en) | Virtual gift display method, device, equipment and storage medium | |
| CN109327608B (en) | Song sharing method, terminal, server and system | |
| CN109144346B (en) | Song sharing method and device and storage medium | |
| CN112533017B (en) | Live broadcast method, device, terminal and storage medium | |
| CN109275013B (en) | Method, device and equipment for displaying virtual article and storage medium | |
| CN110750734A (en) | Weather display method and device, computer equipment and computer-readable storage medium | |
| CN113411680A (en) | Multimedia resource playing method, device, terminal and storage medium | |
| CN111586444B (en) | Video processing method and device, electronic equipment and storage medium | |
| CN114116053A (en) | Resource display method and device, computer equipment and medium | |
| CN111031391A (en) | Video dubbing method, device, server, terminal and storage medium | |
| CN111402844B (en) | Song chorus method, device and system | |
| CN111061405A (en) | Method, device and equipment for recording song audio and storage medium | |
| CN110662105A (en) | Animation file generation method and device and storage medium | |
| CN111092991B (en) | Lyric display method and device and computer storage medium | |
| CN111083526B (en) | Video transition method and device, computer equipment and storage medium | |
| CN111368114A (en) | Information display method, device, equipment and storage medium | |
| CN113377270A (en) | Information display method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |