US20220318301A1 - Information displaying method and device - Google Patents

Information displaying method and device Download PDF

Info

Publication number
US20220318301A1
US20220318301A1 US17/600,342 US202117600342A US2022318301A1 US 20220318301 A1 US20220318301 A1 US 20220318301A1 US 202117600342 A US202117600342 A US 202117600342A US 2022318301 A1 US2022318301 A1 US 2022318301A1
Authority
US
United States
Prior art keywords
audio
spectrum
audio data
color
array
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
US17/600,342
Other languages
English (en)
Inventor
Yuxin Yang
Ruixin Feng
Weiyi CHANG
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Suixuntong Electronic Technology Co Ltd
Beijing Zitiao Network Technology Co Ltd
Original Assignee
Shanghai Suixuntong Electronic Technology Co Ltd
Beijing Zitiao Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Suixuntong Electronic Technology Co Ltd, Beijing Zitiao Network Technology Co Ltd filed Critical Shanghai Suixuntong Electronic Technology Co Ltd
Assigned to BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD. reassignment BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO. LTD.
Assigned to SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO. LTD. reassignment SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO. LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHANG, Weiyi, FENG, Ruixin, YANG, Yuxin
Publication of US20220318301A1 publication Critical patent/US20220318301A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
    • G06F16/64—Browsing; Visualisation therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs

Definitions

  • Embodiments of the present disclosure relates to the field of audio processing technologies, and in particular, to an information displaying method and device.
  • Audio signal spectrum is widely involved in many fields due to its numerous advantages.
  • a playback progress of audio is usually displayed through a separate progress bar, and display effect is relatively simple.
  • the audio spectrum needs to be displayed separately, resulting in occupying more space in the display interface of the audio playback App, affecting the audio playback experience of a user.
  • Embodiments of the present disclosure provide an information displaying method and device, which, through displaying a playback progress of audio through an audio spectrum, possess rich display effects, and can also save a space occupied by the progress when displayed separately, and meanwhile, a user can perceive the playback progress when enjoying the audio spectrum, thereby improving a user experience.
  • an embodiment of the present disclosure provides an information displaying method, including:
  • an information display device including:
  • an acquiring module configured to acquire audio data to be played
  • a displaying module configured to display an audio spectrum corresponding to the audio data, where the audio spectrum displays a playback progress of the audio data.
  • an electronic device including: a processor and a memory; where the memory stores computer executable instructions; the processor executes the computer executable instructions stored in the memory to cause the processor to execute the information displaying method according to the first aspect above and various possible designs of the first aspect.
  • a computer-readable storage medium stores computer executable instructions, and when a processor executes the computer executable instructions, the information displaying method according to the first aspect above and various possible designs of the first aspect is implemented.
  • a computer program product includes: a computer program, and when the computer program is executed by a processor, the information displaying method according to the first aspect above and various possible designs of the first aspect is implemented.
  • a computer program is provided, and when the computer program is executed by a processor, the information displaying method according to the first aspect above and various possible designs of the first aspect is implemented.
  • the embodiments provide the information displaying method and device.
  • the method can blend the audio spectrum with a progress bar and have rich display effects, and can also save a space occupied by the progress bar when displayed separately, and meanwhile, a user can perceive the playback progress of the audio when enjoying the audio spectrum, thereby improving an audio playback experience of the user.
  • FIG. 1 is a schematic display diagram of an audio spectrum and a progress bar in the prior art
  • FIG. 2 is a first schematic flow diagram of an information displaying method according to an embodiment of the present disclosure
  • FIG. 3 is a first schematic display diagram of an audio spectrum according to an embodiment of the present disclosure
  • FIG. 4 is a second schematic display diagram of an audio spectrum according to an embodiment of the present disclosure.
  • FIG. 5 is a schematic diagram of a principle for displaying an audio spectrum according to an embodiment of the present disclosure
  • FIG. 6 is a second schematic flow diagram of an information displaying method according to an embodiment of the present disclosure.
  • FIG. 7 is a third schematic display diagram of an audio spectrum according to an embodiment of the present disclosure.
  • FIG. 8 is a structural block diagram of an information display device according to an embodiment of the present disclosure.
  • FIG. 9 is a structural diagram of an electronic device according to an embodiment of the present disclosure.
  • FIG. 1 is a schematic display diagram of an audio spectrum and a progress bar in the prior art.
  • a separate progress bar (shown as B in the figure) is usually used in the prior art, and a playback progress of audio is displayed in a relatively simple manner.
  • the audio spectrum needs to be displayed separately (shown as A in the figure). Since the audio spectrum and the progress bar (B in the figure are displayed separately, they occupy a relatively large space in a display interface of the App, which affects the placement of other controls.
  • a user enjoys the audio spectrum, he needs to watch separately to perceive the playback progress, which affects the audio playback experience of the user.
  • a playback progress of audio is shown through an audio spectrum, which can blend the audio spectrum with a progress bar and possess rich display effects, and can also save a space occupied by the progress bar when displayed separately, and at the same time, a user can perceive the playback progress of the audio when enjoying the audio spectrum, thereby improving the audio playback experience of the user.
  • a terminal involved in the present disclosure may be a wireless terminal or a wired terminal.
  • the wireless terminal may be a device that provides voice and/or other service data connectivity to a user, a handheld device with wireless connection function, or other processing devices connected to a wireless modem.
  • the wireless terminal may communicate with one or more core network devices through a radio access network (Radio Access Network, RAN for short).
  • the wireless terminal may be a mobile terminal, such as a mobile phone (or called a “cellular” phone) and a computer with a mobile terminal, for example, it may be a portable, pocket, handheld, computer built-in or vehicle mounted mobile apparatus, and they exchange language and/or data with wireless access networks.
  • the wireless terminal may also be a personal communication service (Personal Communication Service, PCS for short) telephone, a cordless telephone, a session initiation protocol (Session Initiation Protocol, SIP for short) telephone, a wireless local loop (Wireless Local Loop, WLL for short) station, a personal digital assistant (Personal Digital Assistant, PDA for short) and other devices.
  • PCS Personal Communication Service
  • SIP Session Initiation Protocol
  • WLL Wireless Local Loop
  • PDA Personal Digital Assistant
  • the wireless terminal may also be called as a system, a subscriber unit (Subscriber Unit), a subscriber station (Subscriber Station), a mobile station (Mobile Station), a mobile (Mobile), a remote station (Remote Station), a remote terminal (Remote Terminal), an access terminal (Access Terminal), a user terminal (User Terminal), a user agent (User Agent), a user device (User Device or User Equipment), which is not limited here.
  • the terminal device may also be a smart watch, a tablet computer and other devices.
  • An interface is displayed by running an audio playback App installed on the terminal.
  • FIG. 2 is a first schematic flow diagram of an information displaying method according to an embodiment of the present disclosure.
  • the displaying method of an audio spectrum in the embodiment of the present disclosure may be applied to a terminal with a display interface.
  • the information displaying method includes:
  • the audio data to be played may be a complete piece of audio data or an audio data segment extracted from complete audio data.
  • the audio data to be played may be acquired in real time by online loading through a network, or a locally stored audio to be played (such as audio data cached in an audio playback APP) may be acquired.
  • a locally stored audio to be played such as audio data cached in an audio playback APP
  • S 202 display an audio spectrum corresponding to the audio data, where the audio spectrum displays a playback progress of the audio data.
  • the audio spectrum may be displayed in a form of a column bar or waveform graph.
  • pulse code modulation data of the audio data may be extracted, a spectrum array of the audio data can be obtained according to the pulse code modulation data, the audio spectrum can be generated according to the spectrum array, and the audio spectrum can be displayed on the display interface.
  • the audio data further includes audio progress callback data, and the playback progress of the audio data may be obtained according to the audio progress callback data.
  • the audio spectrum may be displayed differently according to colors.
  • the audio spectrum may be divided into two colors, where an audio spectrum in one color represents a playback length of audio data that has been played, and an audio spectrum in the other color represents a playback length of audio data that has not been played.
  • FIG. 3 is a first schematic display diagram of an audio spectrum according to an embodiment of the present disclosure.
  • a white audio spectrum is used to represent the playback length of the audio data that has been played
  • a black audio spectrum is used to represent the playback length of the audio data that has not been played.
  • the audio spectrum may also be displayed differently according to spectrum shapes.
  • the audio spectrum may be divided into two spectrum shapes, an audio spectrum in one shape represents a playback length of audio data that has been played, and an audio spectrum in the other shape represents a playback length of audio data that has not been played.
  • FIG. 4 is a second schematic display diagram of an audio spectrum according to an embodiment of the present disclosure.
  • an audio spectrum in wider columns is used to represent the playback length of audio data that has been played
  • an audio spectrum in narrower columns is used to represent the playback length of audio data that has not been played.
  • displaying a playback progress of audio through an audio spectrum can blend the audio spectrum with the progress bar, possessing rich display effects, and can also save a space occupied by the progress bar when displayed separately; and meanwhile, a user can perceive the playback progress of the audio when enjoying the audio spectrum, thereby improving the audio playback experience of the user.
  • step S 202 a specific implementation of the above step S 202 is as follows:
  • the relative proportion of the first part to the second part of the audio spectrum refers to: the audio spectrum is divided into the first part P 1 and the second part P 2 in its extension direction, and taking a boundary O between the two parts as a reference point, the audio spectrum is divided into two segments in its extension direction, so that the audio spectrum corresponds to two line segments (D 1 and D 2 ) in its extension direction; and a ratio of a length of the first line segment (D 1 ) corresponding to the first part of the audio spectrum to a length of the second line segment (D 2 ) corresponding to the first part of the audio spectrum is the relative proportion of the first part to the second part of the audio spectrum.
  • the first color and the second color may be any other two different colors.
  • the first color may be white and the second color may be gray.
  • the audio spectrum is displayed separately in the first color and the second color.
  • the relative of the first color to the second color moves with the playback progress of the audio data.
  • the playback progress of the audio data is displayed through different spectrum colors, so that the user can perceive the playback progress of the music through the color change of the spectrum while enjoying the audio spectrum, thereby improving the use experience of the user.
  • the first part and the second part of the audio spectrum may be displayed in different colors by masking, which is specifically as follows:
  • the first mask layer and the second mask layer are used as the masked layers, and the audio spectrum is the mask layer.
  • the first mask layer is a rectangular box in the first color, and the audio spectrum shape of the first color is displayed through the mask layer of the audio spectrum shape.
  • the second mask layer is a rectangular box in the second color, and the audio spectrum shape of the second color is displayed through the mask layer of the audio spectrum shape.
  • the relative proportion of the first masked layer to the second masked layer is consistent with the description of the relative proportion of the first part to the second part of the audio spectrum, which will not be repeated here.
  • the embodiment does not need to carry out a complex processing on an output audio spectrum, and an effect of distinguishing and displaying the audio spectrum in different colors can be realized by masking.
  • step S 202 is as follows:
  • the first shape and the second shape may be different shapes, or may be a same shape with different sizes.
  • the first shape is square and the second shape is rectangular.
  • the first shape is a wider column, and the first shape is a narrower column.
  • the playback progress of the audio data is displayed through different spectrum shapes, so that the user can perceive the playback progress of music through the shape changes of the spectrum while enjoying the audio spectrum, thereby improving the use experience of the user.
  • the embodiment of the present disclosure may also display the audio spectrum through a combination of color change and shape change, and the principle thereof is similar to the above embodiments and will not be repeated here. Displaying the playback progress through the combination of color change and shape, has a more obvious visual effect and the user's perception is stronger.
  • FIG. 6 is a second schematic flow diagram of an information displaying method according to an embodiment of the present disclosure. Based on the above embodiments, this embodiment mainly describes the process of how to generate and display the audio spectrum during audio data is played, which is detailed as follows:
  • S 601 perform a transforming processing to the audio data to obtain a spectrum array corresponding to audio data of each frame.
  • the audio data of each frame refers to a data segment obtained by dividing the audio data frame by frame according to a playing order of the audio data.
  • pulse code modulation data of the audio data is acquired; then the pulse code modulation data is converted from a time domain to a frequency domain to obtain the spectrum array corresponding to the audio data of each frame.
  • the pulse code modulation data (a non-periodic continuous signal in the time domain) may be converted from the time domain to the frequency domain through a fast Fourier transform to obtain the spectrum array (a non-periodic continuous signal in the frequency domain).
  • the fast Fourier transform can be implemented through a vDSP framework.
  • S 603 draw a corresponding graph according to respective values in the processed spectrum array and display the graph on an audio playback interface to display an audio spectrum of the audio data of each frame.
  • the smoothing processing may be a smoothing processing on respective values in the spectrum array corresponding to the audio data of each frame, or a smoothing processing on spectrum arrays of respective frames of audio data.
  • the graph is column bars or a waveform line.
  • a corresponding audio spectrum is a column graph composed of a series of column bars.
  • the interface display is more concise and the user experience is more friendly.
  • a corresponding audio spectrum is a wavy graph composed of a waveform line.
  • the interface display is more concise and closer to real audio frequency, and the user has a more vivid perception.
  • the following operation is performed for respective values in the spectrum array of the audio data of each frame: adding a target value, a preset number of values before the target value and the preset number of values after the target value according to a first preset weight to obtain a final value of the target value.
  • a target value refers to any value in the spectrum array.
  • the preset number can be arbitrary.
  • the preset number is 2, that is, a target value and two values before the target value and two values after the target value (a total of 5 values) are added according to the first preset weight.
  • the first preset weights are 10%, 20%, 50%, 20% and 10% respectively according to the order of respective values in the spectrum array.
  • the following operation is performed for spectrum arrays of respective frames of the audio data: adding values at a same position in a spectrum array of any target frame and a spectrum array of a previous frame of the target frame according to a second preset weight to obtain a final value of each value of the spectrum array of the target frame.
  • Any target frame refers to any frame in the respective frames of the audio data.
  • the same position refers to the values corresponding to the same sequential position in the two spectrum arrays.
  • the second preset weights are 50% and 50%, respectively.
  • FIG. 7 is a third schematic flow diagram of an information displaying method according to an embodiment of the present disclosure.
  • the information displaying method further includes: acquiring lyrics data of the audio data, and displaying the playback progress of the audio data and lyrics corresponding to the audio spectrum on the audio playback interface.
  • the audio data can be parsed to extract a lrc (lyric, lyric) file in the audio data, and the lyrics data of the audio data can be obtained.
  • the information displaying method further includes:
  • the user's first triggering operation on the audio spectrum may be the user dragging a preset position of the audio spectrum.
  • the preset position may be a boundary between different colors or different shapes of the audio spectrum.
  • the progress of music data can be adjusted. There is no need to provide a progress bar on the music playback interface, thereby saving a space of the music playback interface and improving the user experience.
  • the information displaying method further includes displaying the playback progress of the audio data in response to a second trigger operation by a user on the audio spectrum.
  • the user's second trigger operation on the audio spectrum can be clicking any position of the audio data.
  • the manner of displaying the playback progress of the audio data includes: a corresponding relationship between a played time length and a total time length, a corresponding relationship between the played time length and an unplayed time length, or a corresponding relationship between the unplayed time length and a remaining time length.
  • the playback progress of audio data is displayed under the triggering on the audio spectrum by the user, which improves the user's experience of viewing the playback progress.
  • FIG. 8 is a structural block diagram of an information display device according to an embodiment of the present disclosure. For ease of illustration, only parts related to embodiments of the present disclosure are shown.
  • an information displaying device 80 includes an acquiring module 801 and a displaying module 802 .
  • the acquiring module 801 is configured to acquire audio data to be played.
  • the displaying module 802 is configured to display an audio spectrum corresponding to the audio data, where the audio spectrum displays a playback progress of the audio data.
  • the displaying module 802 is specifically configured to display a first part of the audio spectrum in a first color and display a second part of the audio spectrum in a second color; where the first color is different from the second color, and a relative proportion of the first part of the audio spectrum to the second part of the audio spectrum changes with the playback progress of the audio data.
  • the displaying module 802 is specifically configured to establish a first masked layer of the first color and a second masked layer of the second color; and take the audio spectrum as a mask layer to process the first masked layer and the second masked layer, so that a first part of the audio spectrum corresponding to the first masked layer is displayed in the first color and a second part of the audio spectrum corresponding to the second masked layer is displayed in the second color, where a relative proportion of the first masked layer to the second masked layer changes with the playback progress of the audio data.
  • the displaying module 802 is further specifically configured to display a first part of the audio spectrum in a first shape and display a second part of the audio spectrum in a second shape; where the first shape is different from the second shape, and a proportion of the first part of the audio spectrum to the second part of the audio spectrum changes with the playback progress of the audio data.
  • the displaying module 802 is further specifically configured to perform a transforming processing to the audio data to obtain a spectrum array corresponding to audio data of each frame; perform a smoothing processing to the spectrum array to obtain a processed spectrum array; and draw a corresponding graph according to respective values in the processed spectrum array and display the graph on the audio playback interface to display an audio spectrum of the audio data of each frame.
  • the displaying module 802 is further specifically configured to perform a following operation for respective values in the spectrum array of the audio data of each frame: adding any target value, a preset number of values before the target value and the preset number of values after the target value according to a first preset weight to obtain a final value of the target value.
  • the displaying module 802 is further specifically configured to perform a following operation for spectrum arrays of respective frames of the audio data: add values at a same position in a spectrum array of any target frame and a spectrum array of a previous frame of the target frame according to a second preset weight to obtain a final value of each value of the spectrum array of the target frame.
  • the displaying module 802 is further specifically configured to acquire pulse code modulation data of the audio data; and convert the pulse code modulation data from a time domain to a frequency domain to obtain a spectrum array corresponding to the audio data of each frame.
  • the device further includes a progress processing module 803 , configured to change the playback progress of the audio data in response to a first triggering operation by a user on the audio spectrum.
  • the progress processing module 803 is further configured to display the playback progress of the audio data in response to a second trigger operation by a user on the audio spectrum.
  • the device provided by the present embodiment can be used to perform the technical solutions of the above method embodiments, implementation principles and technical effects thereof are similar, and will not be repeated in the present embodiment herein.
  • an embodiment of the present disclosure further provide an electronic device.
  • the terminal device may include, but is not limited to, a mobile terminal, such as a mobile phone, a notebook computer, a digital broadcast receiver, a personal digital assistant (Personal Digital Assistant, PDA for short), a portable android device (Portable Android Device, PAD for short), a portable media player (Portable Media Player, PMP for short), an in-vehicle terminal (for example, an in-vehicle navigation terminal), and a fixed terminal, such as a digital television (Television, TV for short), a desktop computer.
  • PDA Personal Digital Assistant
  • PDA Personal Digital Assistant
  • portable android device Portable Android Device, PAD for short
  • PMP portable media player
  • an in-vehicle terminal for example, an in-vehicle navigation terminal
  • a fixed terminal such as a digital television (Television, TV for short)
  • the electronic device shown in FIG. 9 is merely an example, and should not bring about any limitation to functions and usage scopes of the embodiments of the present disclosure.
  • the electronic device 900 may include a processing apparatus (for example, a central processor, a graphic processor, etc.) 901 , which may perform various appropriate actions and processing according to a program stored in a read only memory (Read Only Memory, ROM for short) 902 or a program loaded from a storage apparatus 908 to a random access memory (Random Access Memory, RAM for short) 903 .
  • a processing apparatus for example, a central processor, a graphic processor, etc.
  • RAM 903 Random Access Memory
  • various programs and data required for operations of the electronic device 900 may also be stored.
  • the processing apparatus 901 , the ROM 902 , and the RAM 903 are connected to each other by a bus 904 .
  • An input/output (Input/Output, I/O) interface 905 is also connected to the bus 904 .
  • the following apparatuses may connect to the I/O interface 905 : an input apparatus 906 , which includes, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output apparatus 907 , which includes, for example, a liquid crystal display (Liquid Crystal Display, LCD for short), a speaker, a vibrator, etc.; a storage apparatus 908 , which includes, for example, a magnetic tape, a hard disk, etc.; and a communication apparatus 909 .
  • the communication apparatus 909 may allow the electronic device 900 to communicate with other devices in a wireless or wired way, to exchange data.
  • FIG. 9 shows an electronic device 900 having various apparatuses, it should be understood that it is not required to implement or have all of the shown apparatuses. It is alternatively possible to implement or have more or fewer apparatuses.
  • an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer readable medium, and the computer program contains program codes used for executing the method shown in the flowchart.
  • the computer program may be downloaded and installed from a network via the communication apparatus 909 , or installed from the storage apparatus 908 , or installed from the ROM 902 .
  • the processing apparatus 901 When the computer program is executed by the processing apparatus 901 , the above functions defined in the method of the embodiments of the present disclosure are performed.
  • An embodiment of the present disclosure further includes a computer program that, when executed by a processor, implements the above functions defined in the method of the embodiments of the present disclosure.
  • the above computer readable medium in the present disclosure may be a computer readable signal medium, or a computer readable storage medium, or any combination of both.
  • the computer readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or components, or any combination thereof.
  • the computer readable storage medium may include, but is not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read only memory (ROM), an erasable programmable read only memory (Electrical Programmable ROM, EPROM or a flash memory), an optical fiber, a portable compact disc read only memory (Compact Disc ROM, CD-ROM), an optical storage component, a magnetic storage component, or any suitable combination thereof.
  • a computer readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or component.
  • a computer readable signal medium may include a data signal propagated in a baseband or as a part of a carrier, and the data signal carries computer readable program codes. Such propagated data signal may take various forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination thereof.
  • the computer readable signal medium may also be any computer readable medium other than the computer readable storage medium, and the computer readable signal medium may send, propagate, or transmit a program which is used by or in combination with the instruction execution system, apparatus, or component.
  • the program codes contained in the computer readable medium may be transmitted by any suitable medium, including but is not limited to: a wire, an optical cable, a radio frequency (Radio Frequency, RF), etc., or any suitable combination thereof.
  • the above computer readable medium may be included in the above electronic device; or may exist alone without being assembled into the electronic device.
  • the above computer readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to perform the method shown in the above embodiments.
  • the computer program codes used to perform operations of the present disclosure may be written in one or more programming languages or a combination thereof, the above programming languages include object-oriented programming languages, such as Java, Smalltalk, C++, and also include conventional procedural programming languages, such as “C” language or similar programming language.
  • the program codes may be executed entirely on a user's computer, executed partly on a user's computer, executed as an independent software package, executed partly on a user's computer and partly on a remote computer, or executed entirely on a remote computer or a server.
  • the remote computer may connect to the user's computer through any kind of networks, which includes a local area network (Local Area Network, LAN for short) or a wide area network (Wide Area Network, WAN for short), or, the remote computer may connect to an external computer (for example, connect to the external computer via the Internet by utilizing an internet service provider).
  • networks which includes a local area network (Local Area Network, LAN for short) or a wide area network (Wide Area Network, WAN for short)
  • the remote computer may connect to an external computer (for example, connect to the external computer via the Internet by utilizing an internet service provider).
  • each block in the flowcharts or block diagrams may represent a module, a program segment, or a part of codes, and the module, the program segment, or the part of codes contains one or more executable instructions used for realizing specified logic functions.
  • functions marked in the block may also occur in an order different from the order marked in the accompanying drawings. For example, two blocks shown in succession may actually be performed substantially in parallel, and they may sometimes be performed in a reverse order, depending on the functions involved.
  • each block in the block diagrams and/or the flowcharts as well as combinations of blocks in the block diagrams and/or the flowcharts may be implemented by a dedicated hardware-based system that performs specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.
  • Units involved in the embodiments described in the present disclosure may be implemented in a software or hardware manner.
  • a name of a unit does not constitute a limitation on the unit itself under certain circumstances, for example, a first acquiring unit may also be described as “a unit for acquiring at least two internet protocol addresses”.
  • exemplary types of hardware logic assemblies include: a field programmable gate array (Field Programmable Gate Array, FPGA), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), an application specific standard product (Application Specific Standard Product, ASSP), a system on chip (System On Chip, SOC), a complex programmable logic device (Complex Programmable Logic Device, CPLD), etc.
  • FPGA Field Programmable Gate Array
  • ASIC Application Specific Integrated Circuit
  • ASSP Application Specific Standard Product
  • SOC System On Chip
  • CPLD complex Programmable Logic Device
  • a machine readable medium may be a tangible medium that may contain or store a program to be used by or in combination with an instruction execution system, apparatus, or device.
  • the machine readable medium may be a machine readable signal medium or a machine readable storage medium.
  • the machine readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination thereof.
  • machine readable storage medium More specific examples of the machine readable storage medium would include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read only memory (ROM), an erasable programmable read only memory (EPROM or a flash memory), an optical fiber, a portable compact disc read only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.
  • RAM random access memory
  • ROM read only memory
  • EPROM or a flash memory erasable programmable read only memory
  • CD-ROM portable compact disc read only memory
  • magnetic storage device or any suitable combination thereof.
  • an information displaying method including: acquiring audio data to be played; displaying an audio spectrum corresponding to the audio data, where the audio spectrum displays a playback progress of the audio data.
  • displaying the audio spectrum corresponding to the audio data, where the audio spectrum displays the playback progress of the audio data includes:
  • displaying the first part of the audio spectrum in the first color and displaying the second part of the audio spectrum in the second color includes:
  • displaying the audio spectrum corresponding to the audio data, where the audio spectrum displays the playback progress of the audio data includes:
  • displaying the audio spectrum corresponding to the audio data includes:
  • the graph is column bars or a waveform line.
  • performing the smoothing processing to the spectrum array to obtain the processed spectrum array includes:
  • performing the smoothing processing to the spectrum array to obtain the processed spectrum array includes:
  • performing the transforming processing to the audio data to obtain the spectrum array corresponding to the audio data of each frame includes:
  • the method further includes:
  • the method further includes:
  • an information display device including:
  • an acquiring module configured to acquire audio data to be played
  • a displaying module configured to display an audio spectrum corresponding to the audio data, where the audio spectrum displays a playback progress of the audio data.
  • the displaying module is specifically configured to display a first part of the audio spectrum in a first color and display a second part of the audio spectrum in a second color; where the first color is different from the second color, and a relative proportion of the first part of the audio spectrum to the second part of the audio spectrum changes with the playback progress of the audio data.
  • the displaying module is specifically configured to establish a first masked layer of the first color and a second masked layer of the second color; and take the audio spectrum as a mask layer to process the first masked layer and the second masked layer, so that a first part of the audio spectrum corresponding to the first masked layer is displayed in the first color and a second part of the audio spectrum corresponding to the second masked layer is displayed in the second color, where a relative proportion of the first masked layer to the second masked layer changes with the playback progress of the audio data.
  • the displaying module is further specifically configured to display a first part of the audio spectrum in a first shape and display a second part of the audio spectrum in a second shape; where the first shape is different from the second shape, and a proportion of the first part of the audio spectrum to the second part of the audio spectrum changes with the playback progress of the audio data.
  • the displaying module is further specifically configured to perform a transforming processing to the audio data to obtain a spectrum array corresponding to audio data of each frame; perform a smoothing processing to the spectrum array to obtain a processed spectrum array; and draw a corresponding graph according to respective values in the processed spectrum array and display the graph on the audio playback interface to display an audio spectrum of the audio data of each frame.
  • the displaying module is further specifically configured to perform a following operation for respective values in the spectrum array of the audio data of each frame: adding any target value, a preset number of values before the target value and the preset number of values after the target value according to a first preset weight to obtain a final value of the target value.
  • the displaying module is further specifically configured to perform a following operation for spectrum arrays of respective frames of the audio data: add values at a same position in a spectrum array of any target frame and a spectrum array of a previous frame of the target frame according to a second preset weight to obtain a final value of each value of the spectrum array of the target frame.
  • the displaying module is further specifically configured to acquire pulse code modulation data of the audio data; and convert the pulse code modulation data from a time domain to a frequency domain to obtain the spectrum array corresponding to the audio data of each frame.
  • the device further includes a progress processing module, configured to change the playback progress of the audio data in response to a first triggering operation by a user on the audio spectrum.
  • the progress processing module is further configured to display the playback progress of the audio data in response to a second triggering operation by the user on the audio spectrum.
  • an electronic device including: at least one processor and a memory;
  • the at least one processor executes the computer executable instructions stored in the memory, causing the at least one processor to execute the information displaying method described above in the first aspect and various possible designs of the first aspect.
  • a computer-readable storage medium stores computer executable instructions, and when a processor executes the computer executable instructions, the information displaying method described in the first aspect and various possible designs of the first aspect is implemented.
  • a computer program product includes: a computer program, and when the computer program is executed by a processor, the information displaying method described in the first aspect and various possible designs of the first aspect is implemented.
  • a computer program is provided, and when the computer program is executed by a processor, the information displaying method described in the first aspect and various possible designs of the first aspect is implemented.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Indexing, Searching, Synchronizing, And The Amount Of Synchronization Travel Of Record Carriers (AREA)
US17/600,342 2020-08-03 2021-07-15 Information displaying method and device Pending US20220318301A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN202010767377.5 2020-08-03
CN202010767377.5A CN114064963A (zh) 2020-08-03 2020-08-03 信息显示方法及设备
PCT/CN2021/106592 WO2022028227A1 (zh) 2020-08-03 2021-07-15 信息显示方法及设备

Publications (1)

Publication Number Publication Date
US20220318301A1 true US20220318301A1 (en) 2022-10-06

Family

ID=80116963

Family Applications (1)

Application Number Title Priority Date Filing Date
US17/600,342 Pending US20220318301A1 (en) 2020-08-03 2021-07-15 Information displaying method and device

Country Status (4)

Country Link
US (1) US20220318301A1 (zh)
CN (1) CN114064963A (zh)
BR (1) BR112021020653A2 (zh)
WO (1) WO2022028227A1 (zh)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140082666A1 (en) * 2012-09-19 2014-03-20 JBF Interlude 2009 LTD - ISRAEL Progress bar for branched videos
US20140286644A1 (en) * 2012-12-27 2014-09-25 Panasonic Corporation Information communication method
US20170332120A1 (en) * 2016-05-12 2017-11-16 Time Warner Cable Enterprises Llc Content management and control based on tracking of prior content playback behavior
US10012691B1 (en) * 2017-11-07 2018-07-03 Qualcomm Incorporated Audio output diagnostic circuit
US20190348062A1 (en) * 2018-05-08 2019-11-14 Gyrfalcon Technology Inc. System and method for encoding data using time shift in an audio/image recognition integrated circuit solution
US20210304784A1 (en) * 2020-03-27 2021-09-30 Arizona Board Of Regents On Behalf Of Arizona State University Systems and methods for gunshot detection

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20080040274A (ko) * 2006-11-02 2008-05-08 엘지전자 주식회사 이동통신 단말기의 음원 파형 정보 추출 장치 및 방법
CN101901622B (zh) * 2009-05-27 2012-08-29 鸿富锦精密工业（深圳）有限公司 音频资料定位方法
CN101984490B (zh) * 2010-11-23 2012-06-27 亿览在线网络技术（北京）有限公司 一种逐字同步的歌词文件的生成方法及系统
CN107220048B (zh) * 2017-05-19 2021-04-20 北京酷我科技有限公司 一种音频频谱和进度条叠加方法
CN107221021B (zh) * 2017-05-19 2021-07-13 北京酷我科技有限公司 一种音频频谱动画的绘制算法
CN107220047B (zh) * 2017-05-19 2021-01-05 北京酷我科技有限公司 一种音频频谱的动图显示进度条控件实现方法
CN107393571B (zh) * 2017-08-18 2019-08-27 深圳市路畅科技股份有限公司 一种车载导航仪显示音乐信息的方法
CN107886969B (zh) * 2017-11-20 2020-08-28 维沃移动通信有限公司 一种音频播放方法及音频播放装置
CN109120983B (zh) * 2018-09-28 2021-07-27 腾讯音乐娱乐科技（深圳）有限公司 一种音频处理方法和装置
CN111026907B (zh) * 2019-12-09 2023-10-27 腾讯音乐娱乐科技（深圳）有限公司 音频播放过程中音频信息的显示方法及装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140082666A1 (en) * 2012-09-19 2014-03-20 JBF Interlude 2009 LTD - ISRAEL Progress bar for branched videos
US20140286644A1 (en) * 2012-12-27 2014-09-25 Panasonic Corporation Information communication method
US20170332120A1 (en) * 2016-05-12 2017-11-16 Time Warner Cable Enterprises Llc Content management and control based on tracking of prior content playback behavior
US10012691B1 (en) * 2017-11-07 2018-07-03 Qualcomm Incorporated Audio output diagnostic circuit
US20190348062A1 (en) * 2018-05-08 2019-11-14 Gyrfalcon Technology Inc. System and method for encoding data using time shift in an audio/image recognition integrated circuit solution
US20210304784A1 (en) * 2020-03-27 2021-09-30 Arizona Board Of Regents On Behalf Of Arizona State University Systems and methods for gunshot detection

Also Published As

Publication number Publication date
CN114064963A (zh) 2022-02-18
WO2022028227A1 (zh) 2022-02-10
BR112021020653A2 (pt) 2022-03-08

Similar Documents

Publication Publication Date Title
US20220309723A1 (en) Method, apparatus, electronic device, and computer-readable medium for displaying special effects
CN112738634B (zh) 视频文件的生成方法、装置、终端及存储介质
US20210350545A1 (en) Image processing method and apparatus, and hardware apparatus
CN109525853A (zh) 直播间封面展示方法、装置、终端、服务器及可读介质
CN109460233A (zh) 页面的原生界面显示更新方法、装置、终端设备及介质
KR102614263B1 (ko) 인터랙션 방법 및 장치, 전자 디바이스 및 컴퓨터 판독 가능 저장 매체
US11997356B2 (en) Video page display method and apparatus, electronic device and computer-readable medium
US11849211B2 (en) Video processing method, terminal device and storage medium
US11822854B2 (en) Automatic volume adjustment method and apparatus, medium, and device
WO2020151491A1 (zh) 图像形变的控制方法、装置和硬件装置
US11863835B2 (en) Interaction method and apparatus, and electronic device
US20240104810A1 (en) Method and apparatus for processing portrait image
CN110070495B (zh) 图像的处理方法、装置和电子设备
WO2021197024A1 (zh) 视频特效配置文件生成方法、视频渲染方法及装置
US20240040069A1 (en) Image special effect configuration method, image recognition method, apparatus and electronic device
WO2020233143A1 (zh) 播放进度显示方法、装置、电子设备和存储介质
EP4050899A1 (en) Method and apparatus for displaying video playing page, and electronic device and medium
US20230360286A1 (en) Image processing method and apparatus, electronic device and storage medium
US20220318301A1 (en) Information displaying method and device
CN112017261B (zh) 贴纸生成方法、装置、电子设备及计算机可读存储介质
US20230224429A1 (en) Video generation method, video playing method, video generation device, video playing device, electronic apparatus and computer-readable storage medium
CN110069641A (zh) 图像处理方法、装置和电子设备
US11805219B2 (en) Image special effect processing method and apparatus, electronic device and computer-readable storage medium
CN111199519A (zh) 特效包的生成方法和装置
WO2021018176A1 (zh) 文字特效处理方法及装置

Legal Events

Date Code Title Description
AS Assignment

Owner name: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD., CHINA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO. LTD.;REEL/FRAME:059436/0517

Effective date: 20210918

Owner name: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO. LTD., CHINA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:YANG, YUXIN;FENG, RUIXIN;CHANG, WEIYI;REEL/FRAME:059436/0450

Effective date: 20211008

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS