CN111859015A - Music response method and related equipment - Google Patents

Music response method and related equipment Download PDF

Info

Publication number
CN111859015A
CN111859015A CN202010630221.2A CN202010630221A CN111859015A CN 111859015 A CN111859015 A CN 111859015A CN 202010630221 A CN202010630221 A CN 202010630221A CN 111859015 A CN111859015 A CN 111859015A
Authority
CN
China
Prior art keywords
music
matching
point information
client
lyrics
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010630221.2A
Other languages
Chinese (zh)
Inventor
闫震海
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Music Entertainment Technology Shenzhen Co Ltd
Original Assignee
Tencent Music Entertainment Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Music Entertainment Technology Shenzhen Co Ltd filed Critical Tencent Music Entertainment Technology Shenzhen Co Ltd
Priority to CN202010630221.2A priority Critical patent/CN111859015A/en
Publication of CN111859015A publication Critical patent/CN111859015A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/60Information retrieval; Database structures therefor; File system structures therefor of audio data
    • G06F16/68Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/683Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/60Information retrieval; Database structures therefor; File system structures therefor of audio data
    • G06F16/63Querying
    • G06F16/638Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/60Information retrieval; Database structures therefor; File system structures therefor of audio data
    • G06F16/68Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/683Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/685Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using automatically derived transcript of audio data, e.g. lyrics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/60Information retrieval; Database structures therefor; File system structures therefor of audio data
    • G06F16/68Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/686Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title or artist information, time, location or usage information, user ratings

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Library & Information Science (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Reverberation, Karaoke And Other Acoustics (AREA)

Abstract

The embodiment of the invention discloses a music response method and related equipment.A client side acquires a music fragment and sends the music fragment to a server, the server determines matching beat point information in an audio database, the audio database stores a plurality of standard music and corresponding beat point information thereof, and the matching beat point information comprises the beat point information between a first matching position of the music fragment in the corresponding standard music and an end point of the corresponding standard music; and the server sends the matching shooting point information to the client so that the mobile terminal bound by the client responds to the matching shooting point information and outputs a feedback signal. By quickly determining the matching beat point information corresponding to the music fragment, the mobile terminal bound by the client can respond to the matching beat point information to output a feedback signal, and the feedback signal can prompt the user of accurate music beat so as to effectively improve the music response effect.

Description

Music response method and related equipment
Technical Field
The invention relates to the technical field of music, in particular to a music response method and related equipment.
Background
At the concert site, the user hears that the live concert wants to hum, wave, or beat along with the live music. However, in this scenario, there are still some inconveniences:
1. The effect of responding to the music tempo is single. The user can only wave a glow stick or flash in his hand, without the flash flashing following the music tempo.
2. The rhythm is lacking. There is no explicit cadence cue. The manual response effect of the user may not be in rhythm, but rather, a suitably opposite effect is obtained.
In short, the existing music response form is tedious and not closely linked to live music, which results in poor music response effect.
Disclosure of Invention
The embodiment of the invention provides a music response method and related equipment, which can improve the music response effect.
In a first aspect, an embodiment of the present invention provides a music response method, including:
receiving a music piece sent by a client, wherein the music piece is acquired by the client;
determining matching beat point information in an audio database, wherein the audio database stores a plurality of standard music and corresponding beat point information thereof, and the matching beat point information comprises beat point information between a first matching position of the music piece in the corresponding standard music and an end point of the standard music;
and sending the matching shooting point information to the client so that the mobile terminal bound by the client responds to the matching shooting point information to output a feedback signal.
Optionally, the form of outputting the feedback signal in response to the matching beat point information includes a light feedback form, a sound feedback form, a vibration feedback form or an output feedback form, where the outputting the feedback form includes outputting a portion of lyrics corresponding to the matching beat point information, and the portion of lyrics has beat point mark information.
Optionally, the method further comprises:
determining first matching music in the audio database, wherein the first matching music comprises audio data of standard music corresponding to the music piece from the first matching position to an end point;
sending a first spectrum display instruction to the client according to the first matching music so that a mobile terminal bound by the client responds to the first spectrum display instruction to perform audio spectrum visual display on the first matching music;
alternatively, the first and second electrodes may be,
determining matching lyrics in the audio database, wherein the matching lyrics comprise lyrics of standard music corresponding to the music fragment from the first matching position to an end point;
and sending the matched lyrics to the client so that the mobile terminal bound by the client displays the matched lyrics, and highlighting the lyrics from the part corresponding to the first matched position.
Optionally, the matching beat point information further includes beat point information between a starting point and the first matching position of standard music corresponding to the music piece; or the first matching music also comprises audio data from a starting point to the first matching position of the standard music corresponding to the music piece; or the matching lyrics further comprise lyrics from a starting point to the first matching position of the standard music corresponding to the music piece.
Optionally, the method further comprises:
receiving a first adjustment position sent by the client, wherein the first adjustment position is generated by the client in response to a lyric adjustment operation of a user, and the lyric adjustment operation is an operation of adjusting displayed matched lyrics to redetermine a highlighted part of lyrics;
determining a second matching music in the audio database, the second matching music comprising audio data of a corresponding standard music from the first adjusted position to an end point;
and sending a second spectrum display instruction to the client according to the second matching music so that the mobile terminal bound by the client responds to the second spectrum display instruction to perform audio spectrum visual display on the second matching music.
In a second aspect, an embodiment of the present invention provides a music response method, where the method includes:
receiving a music query instruction sent by a client, wherein the music query instruction carries a music name;
responding to the music query instruction, and determining beat point information corresponding to the music query instruction in an audio database, wherein the audio database stores corresponding relations between a plurality of beat point information and music names;
and sending the inquired shooting point information to the client so that the mobile terminal bound by the client responds to the shooting point information and outputs a feedback signal.
Optionally, the method further comprises:
responding to the music query instruction, and determining third matched music in the audio database, wherein the third matched music is audio data of standard music corresponding to the music query instruction;
sending a third spectrum display instruction to the client according to the third matching music, so that the mobile terminal bound by the client responds to the third spectrum display instruction, and performing audio frequency spectrum visual display on the third matching music;
alternatively, the first and second electrodes may be,
responding to the music query instruction, and determining lyrics of standard music corresponding to the music query instruction in the audio database;
And sending the inquired lyrics to the client so that the mobile terminal bound by the client displays the lyrics and performs prominent display from the lyrics at the starting point of the music.
Optionally, the method further comprises:
receiving a second adjustment position sent by the client, wherein the second adjustment position is generated by the client in response to a lyric adjustment operation of a user, and the lyric adjustment operation is an operation of adjusting displayed lyrics to redetermine a highlighted part of the lyrics;
determining fourth matching music in the audio database, wherein the fourth matching music comprises audio data of corresponding standard music from the second adjustment position to an end point;
and sending a fourth spectrum display instruction to the client according to the fourth matching music, so that the mobile terminal bound by the client responds to the fourth spectrum display instruction, and performing audio spectrum visual display on the fourth matching music.
In a third aspect, an embodiment of the present invention provides a music response method, including:
acquiring a music fragment;
sending the music clips to a server so that the server determines matching beat point information in an audio database, wherein the audio database stores a plurality of standard music and corresponding beat point information thereof, and the matching beat point information comprises beat point information between a first matching position of the music clip in the corresponding standard music and an end point of the standard music;
Receiving the matched shooting point information sent by the server;
and responding the matched beat point information to output a feedback signal.
Optionally, the method further comprises:
receiving lyrics sent by the server;
displaying the lyrics, and highlighting the lyrics from the part corresponding to the first matching position;
determining a first adjustment position in response to a lyric adjustment operation of a user, the lyric adjustment operation being an operation of adjusting the displayed lyrics to re-determine a portion of the lyrics that are highlighted;
and outputting a feedback signal in response to the shooting point information of the first adjusting position.
In a fourth aspect, an embodiment of the present invention provides a music client bound to a mobile terminal, including:
the music query window is used for receiving a music name input by a user to generate a music query instruction;
the sending module is used for sending the music query instruction to a server, wherein the music query instruction carries a music name, so that the server responds to the music query instruction, beat point information corresponding to the music query instruction is determined in an audio database, and the audio database stores a plurality of corresponding relations between the beat point information and the music name;
The receiving module is used for receiving the shooting point information sent by the server;
and the output module is used for responding to the beat point information and outputting an instruction to the bound mobile terminal so as to enable the terminal to output a feedback signal.
In a fifth aspect, an embodiment of the present invention provides a music response apparatus, including:
the first receiving module is used for receiving music pieces sent by a client, wherein the music pieces are acquired by the client;
the system comprises a first processing module, a second processing module and a third processing module, wherein the first processing module is used for determining matching beat point information in an audio database, the audio database stores a plurality of standard music and corresponding beat point information thereof, and the matching beat point information comprises beat point information between a first matching position of a music piece in the corresponding standard music and an end point of the standard music; and the first sending module is used for sending the matching shooting point information to the client so that the mobile terminal bound by the client responds to the matching shooting point information and outputs a feedback signal.
In a sixth aspect, an embodiment of the present invention provides a mobile terminal, including: a processor and a memory;
the processor is connected to a memory, wherein the memory is used for storing program codes, and the processor is used for calling the program codes to execute the music response method according to the third aspect.
In the embodiment of the invention, a client side acquires a music fragment and sends the music fragment to a server, the server determines matching beat point information in an audio database, the audio database stores a plurality of standard music and corresponding beat point information thereof, and the matching beat point information comprises beat point information between a first matching position of the music fragment in the corresponding standard music and an end point of the corresponding standard music; and the server sends the matching shooting point information to the client so that the mobile terminal bound by the client responds to the matching shooting point information and outputs a feedback signal. By quickly determining the matching beat point information corresponding to the music fragment, the mobile terminal bound by the client can respond to the matching beat point information to output a feedback signal, and the feedback signal can prompt the user of accurate music beat so as to effectively improve the music response effect.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a scene schematic diagram of a music response method according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a music response method according to an embodiment of the present invention;
fig. 3 is a flowchart illustrating a music response method according to an embodiment of the present invention;
fig. 4 is a flowchart illustrating a music response method according to an embodiment of the present invention;
fig. 5 is a flowchart illustrating a music response method according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a music response device according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a music response device according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a music response device according to an embodiment of the present invention.
Detailed Description
The technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.
It should be understood that the terms "first," "second," and the like in the description and claims of this application and in the drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by the person skilled in the art that the described embodiments of the invention can be combined with other embodiments.
In music, time is divided into equal basic units, each unit being called a "beat" or a beat. The same time segment with accents and without accents repeats cyclically according to a certain sequence, called beat. Each time slice, called a unit beat, used to constitute a beat. When there is only one accent in each cycle of the beat, the unit beat with accents is called a reprint. When more than one accent is provided, the first accented unit beat is called the rephotography, and the accented unit beat is called the secondary rephotography after the accented unit beat is provided, and the unit beat without accent is called the weak beat.
The music beat points are the general names of time points with strong rhythm characteristics, such as drum set knocking, piano accent, voice climax and the like in music, and comprise repeated beat points, secondary repeated beat points and weak beat points. In this embodiment, the beat point information of music includes a vocal beat point and a musical instrument beat point. The human voice beat points comprise the starting time and the ending time of music elements such as single words, sentences, humming, pseudovoice effect and the like which are vocalized and sung by a singer in the music; the instrument tempo point includes any one or a combination of the start time and the end time of a note with a certain pitch played by any one instrument in the music and the start time and the end time of a rhythm note emitted by a percussion instrument in the music.
In the embodiment of the present invention, the standard music is a work played with various musical instruments and vocal techniques, and includes a work with only instrumental music, a work with only vocal music (e.g., a song accompanied with no musical instrument), and a work combining a singing and a musical instrument.
In the embodiment of the present invention, the mobile terminal may be a handheld device, such as a smart phone, a tablet computer, a palmtop computer, etc., and may also be a wearable device (such as a smart watch, a sports bracelet), or a notebook computer; as long as the terminal has a communication capability and can output sound, images, light, vibration, and the like.
In the prior art, in a concert scene, a singer can only manually wave a fluorescent bar or a flash lamp in the singing process so as to realize interaction with the singer and respond to the music sung by the singer. However, the manual random waving fails to correspond to the music of the singer, which results in poor music response effect and low interactive experience between the fan and the singer. Therefore, the music response method can effectively improve the music response effect.
Referring to fig. 1, fig. 1 is a schematic view of a scenario of a music response method according to an embodiment of the present invention; in fig. 1, the mobile terminal is exemplified by a mobile phone, and in a concert, a singer 101 sings music on a stage. When music response starts, a fan turns on the mobile phone 103, acquires music segments sung by the singer 101 by using a client on the mobile phone 103, sends the music segments to the server 102 for processing, the server 102 determines matching beat point information corresponding to the music segments according to the music segments and an audio database, and the audio database stores a plurality of standard music and corresponding beat point information thereof; the server 102 issues the determined matching point information to the client on the mobile phone 103, so that the mobile phone 103 responds to the matching point information in at least one feedback form of light, sound and vibration, and for example, three feedback forms of light, sound and vibration are provided at the same time, the flash lamp, the speaker and the vibration motor of the mobile phone 103 are controlled to work according to the matching point information, and the point information of singing music by the singer 101 is fed back to the user through light emitting, sound producing and vibration, so that the singer can play an accurate beat along with the music, can be immersed in the music better, can also interact in concert with the singer 101, and has better interaction effect and music response effect.
The fan acquires music fragments by using the mobile phone 103 and uploads the music fragments to the server 102 for processing, and then receives returned matching shooting point information to perform real-time feedback in various feedback forms, so that real-time music response interaction is realized, the interaction mode of a user is linked with live music, and a live effect with more rhythm and stronger interactivity is formed.
Fig. 2 is a schematic flow chart of a music response method according to an embodiment of the present invention; the music response method comprises the following steps:
201. the client acquires the music segments;
specifically, the client picks up a piece of music through a sound pickup device (built-in or externally connected), such as a microphone, and may pick up a piece of music played, or a piece of music singing live, or a piece of music hummed by human voice. For example, in a concert scene, a fan responds to the music of a singer, which is a main application scene of the scheme, and the fan picks up the music segment sung by the singer by using a client on a mobile phone. If there is no music in the scene, the user can try to hum the piece of music by himself to pick up the piece of music, just by thinking about a piece of music.
202. The client sends the music piece to the server;
Specifically, the mobile terminal bound by the client and the server have wired or wireless communication connection, and the wireless connection mode includes a mobile communication mode (2G, 3G, 4G, or 5G), a WiFi communication mode, and the like. To implement the music response, the client on the mobile terminal sends the acquired music piece to the server.
203. The server determines matching beat point information in an audio database, the audio database stores a plurality of standard music and corresponding beat point information, and the matching beat point information comprises beat point information between a first matching position of a music piece in the corresponding standard music and an end point of the standard music;
specifically, the server performs processing according to the received music piece and the audio database to determine matching beat point information corresponding to the music piece. The standard music to which the music piece belongs can be searched by comparing the music piece with the standard music, and the first matching position of the music piece in the corresponding standard music can be searched at the same time. For example, the duration of a certain piece of music is 1 minute and 2 seconds, the first matching position (corresponding to the matching time point) in the corresponding standard music is 1 minute and 23 seconds to 2 minutes and 25 seconds, and the total duration of the standard music is 5 minutes. Then, according to the first matching position and the beat point information corresponding to the standard music, the matching beat point information can be obtained through processing. For example, the matching point information corresponding to a certain piece of music is point information between 1 minute 23 seconds and 5 minutes.
204. The client receives the matched shooting point information sent by the server;
specifically, the server sends the matching beat point information obtained by the processing to the client.
205. And the mobile terminal bound by the client responds to the matching shooting point information and outputs a feedback signal.
Specifically, after the client receives the matching beat point information, the mobile terminal bound to the client responds to the matching beat point information to output a feedback signal, the user can acquire beat information of standard music corresponding to the music piece according to the feedback signal, and the user can be prompted about accurate music beats through the feedback signal, so that the music response effect is effectively improved.
Particularly, in consideration of the influence of communication delay, in order to realize real-time response, when the mobile terminal bound by the client responds to the matched shooting point information and outputs the feedback signal, the communication delay time can be added on the basis of the first matched position, and the feedback signal is output from the shooting point information corresponding to the delayed position so as to accurately correspond to the live music and improve the experience of the user. For example, the matching beat point information corresponding to a certain music piece is beat point information between 1 minute and 23 seconds and 5 minutes, and assuming that the communication delay is 2 seconds, the mobile terminal bound to the client outputs a feedback signal in response to the beat point information between 1 minute and 25 seconds and starts to output the feedback signal from the beat point information corresponding to 1 minute and 25 seconds.
In particular, in step 203, the data formats of the standard music of the audio database include, but are not limited to, MP3 format, AAC format, WMA format, WAV format, MMF format, AMR format, MIDI format, IMY format, RTTTL format, and M3U format.
In one possible embodiment, in step 203, the first matching position of the music piece in the corresponding standard music and the matching beat point information corresponding to the music piece can be determined by using an audio fingerprint feature matching method or a lyric text matching method.
In particular, audio fingerprint feature matching is an accurate sound-to-sound retrieval. The retrieved content on which is based is a "fingerprint" feature of the audio signal. When the server determines the first matching position, firstly extracting the audio fingerprint features of the music segments, then extracting the audio fingerprint features of each standard music in the audio database for comparison so as to determine the matched standard music and the first matching position, and then processing according to the first matching position and the beat point information corresponding to the matched standard music to obtain the matched beat point information corresponding to the music segments.
In order to speed up the determination of the first matching position and the matching of the beat point information, the audio fingerprint characteristics corresponding to each piece of standard music may be obtained in advance, and an audio database may be established according to the standard music, the audio fingerprint characteristics, and the beat point information, where the audio database includes the corresponding relationship between the beat point information and the music fingerprint characteristics, and the audio database may also include the corresponding relationship between the standard music, the beat point information, and the music fingerprint characteristics. The server utilizes the audio database to process the received music segments, extracts hidden audio features as audio fingerprint features of the music segments, compares the audio fingerprint features with the audio fingerprint features in the audio database, and can determine the audio fingerprint features and the beat point information of the music segments and a first matching position of the music segments in standard music. After the first matching position is obtained, matching beat point information corresponding to the music piece can be obtained by processing according to the first matching position and beat point information of the standard music.
In addition, the audio database can only store a plurality of standard music, the server extracts the audio fingerprint features of each standard music in the database after extracting the audio fingerprint features of the music segments and compares the audio fingerprint features of each standard music to determine the matched standard music and the corresponding first matching position, corresponding beat point information is obtained through processing according to the matched standard music, and the matched beat point information is obtained according to the first matching position and the beat point information of the standard music.
And when determining the first matching position, the server firstly identifies the text corresponding to the music fragment, then extracts the lyric text of each standard music in the audio database for comparison to determine the matched standard music and the first matching position, and then processes the lyric text to obtain the matched beat point information corresponding to the music fragment according to the first matching position and the beat point information corresponding to the matched standard music.
In order to accelerate the matching speed, the standard music in the audio database can be processed in advance to obtain the corresponding lyric text, the audio database is established according to the standard music, the lyric text and the beat point information, the audio database comprises the corresponding relation of the beat point information and the lyric text, and the audio database can also comprise the corresponding relation of the standard music, the beat point information and the lyric text. When the first matching position of the music fragment and the matching beat point information are determined, the server performs voice recognition on the music fragment to obtain a lyric text fragment, and performs maximum similarity matching according to the lyric text fragment and lyric texts in an audio database to determine the lyric text and beat point information of the music fragment, and at the same time, the first matching position of the music fragment in standard music can be determined. And obtaining the matching shooting point information corresponding to the music piece according to the first matching position and the shooting point information.
In addition, when the audio database only stores a plurality of standard music, the server extracts the text of each standard music in the database after extracting the text of the music fragment, compares the extracted text of each standard music with the extracted text of each standard music in the database to determine the matched standard music and the corresponding first matching position, processes the standard music according to the matched standard music to obtain corresponding beat point information, and obtains the matched beat point information according to the first matching position and the beat point information of the standard music.
Particularly, for music segments picked up from music played by a machine or music played live, the first matching position of the music segments is determined by preferentially selecting an audio fingerprint feature matching method because the features are clearer; for the music pieces picked up from the music of human humming, the lyric text matching method is preferably used to determine the first matching position of the music pieces due to the difference in the tunes of human humming.
In one possible embodiment, the output feedback signal form in response to the matching beat point information includes a light feedback form, a sound feedback form, a vibration feedback form or an output feedback form, the output feedback form includes outputting a part of lyrics corresponding to the matching beat point information, and the part of lyrics has beat point mark information.
The light feedback form may be that the mobile terminal bound by the client controls a light-emitting lamp (such as an LED lamp, for example, a flash of a mobile phone) to emit light so as to feed back the matching shooting point information to the user.
The sound feedback form can be that the mobile terminal bound by the client controls an audio output device (such as a loudspeaker) to sound so as to feed back the matching shooting point information to the user.
The vibration feedback form can be that the terminal bound by the client controls the vibration output device (such as a vibration motor) to vibrate so as to feed back the matching shooting point information to the user.
The light emitting lamp, the audio output device and the vibration output device can be built in the mobile terminal, or can be arranged outside the terminal and are in communication connection with the mobile terminal in a wired or wireless mode. In order to improve the music response effect and facilitate the user to know the feedback matching beat point information, a built-in mode is preferred. For example, taking a mobile phone as an example, the mobile phone performs the tapping feedback in three feedback forms, namely a light feedback form, a sound feedback form and a vibration feedback form. After receiving the matching shooting point information between 1 minute and 23 seconds to 5 minutes, the client on the mobile phone controls the flash lamp to intermittently emit light, the loudspeaker to intermittently emit sound and the vibration motor to intermittently generate vibration according to the matching shooting point information so as to feed back the matching shooting point information to a mobile phone user.
The user can quickly know the matching beat point information corresponding to the music fragment by feeling light, sound and vibration, and effectively prompts the music beat of the standard music corresponding to the music fragment of the user so as to improve the music response effect and create a dynamic effect corresponding to the picked music fragment by the light, sound and vibration.
In addition, for the output feedback form, it may be that a part of the lyrics corresponding to the matching beat point information is output (e.g., displayed and output), and the part of the lyrics has beat point mark information. Specifically, adding beat mark information to the song words can be completed in modes of adding bold fonts, changing colors of the fonts, adding shadows to the fonts and the like. Or adding a specific beat mark (for example, a beat mark of a rephoto point, a beat mark of a second rephoto point, and a beat mark of a weak beat point) around the corresponding lyric (for example, the upper right corner or the lower right corner).
The output feedback mode can also be a mode of outputting pictures marked with different shooting points, and the pictures corresponding to the shooting points are output according to the matched shooting point information so as to prompt the user of the shooting points of music. For example, a weak shot point corresponds to a picture a, a secondary repeated shot point corresponds to a picture B, a repeated shot point corresponds to a picture C, and the display contents of the picture a, the picture B and the picture C are different so as to distinguish different shot points. According to the shooting point sequence of the matched shooting point information, pictures corresponding to the shooting points are sequentially displayed, for example, the shooting point sequence is a repeated shooting point-a weak shooting point-a repeated shooting point, and then the terminal is moved to output the pictures in sequence: picture C-picture a-picture B.
In one possible embodiment, in step 205, for the light feedback mode, in order to optimize the music response effect, more than two brightness levels are used for different shooting point information (e.g. weak shooting point, sub-repeat shooting point, repeat shooting point) to perform feedback to distinguish different shooting point information. The following uses two gears to feed back the rephotography point and other rephotography points as an example, the luminescent lamp has two gears, one gear is used for feeding back the rephotography point in the matching rephotography point information, another gear is used for feeding back the other rephotography points (for example, weak rephotography point, secondary rephotography point) in the matching rephotography point information, the luminescent lamp flashes dynamically, the effect of the flashing is completely consistent with the rhythm of the live music, and compared with the simple flash lamp waving by turning on, the luminescent lamp has more rhythm sense and telepresence sense, and the interactive form of the live singer is greatly enriched. Especially some fast paced music, which can be kept up to by simply waving one's hand.
For the sound feedback mode, the audio output device (such as a mobile phone loudspeaker) of the mobile terminal bound by the client can also dynamically send out some sound effects consistent with the current music rhythm, namely sound beats, according to the matched beat point information. And for the vibration feedback mode, the vibration frequency of the vibration output device of the mobile terminal bound by the client can vibrate along with the matching beat point information. Therefore, the tempo prompt information of the current music can be provided for the user, and the embarrassing phenomenon that the user beats the tempo disorderly due to inaccurate tempo stepping can be avoided. The feedback signals provided by the audio output device and the vibration output device can help the user to grasp the accurate rhythm point, and the immersion feeling of the live music is not obviously reduced due to the incorrect rhythm. Meanwhile, the user can have accurate rhythm information, so that the enthusiasm of the user for participating in site interaction is greatly increased.
In one possible embodiment, the music response method further comprises:
s1, the server determines first matching music in the audio database, wherein the first matching music comprises audio data of standard music corresponding to the music fragments from the first matching position to the end point;
specifically, after the server determines a first matching position of the audio segment in the standard music according to the music segment and the standard music in the audio database, a first matching music corresponding to the music segment can be determined according to the first matching position. The first matching music is audio data of standard music corresponding to the music fragment from the first matching position to the end point.
S2, the server sends a first spectrum display instruction to the client according to the first matching music;
s3, the mobile terminal bound by the client responds to the first spectrum display instruction, and audio frequency spectrum visual display is conducted on the first matching music.
Specifically, the mobile terminal bound by the client responds to the first spectrum display instruction, and visually displays the spectrum corresponding to the first matching music. The frequency spectrum visual display mode can be frequency spectrum dynamic effect, such as linear and columnar visual audio frequency spectrum beating special effect.
The first matching music is dynamically displayed on the screen of the mobile terminal in a frequency spectrum visualization mode, and the interactivity is stronger compared with a traditional LED lamp panel irrelevant to music.
Wherein, the first implementation manner of the steps S2 and S3: the first frequency spectrum display instruction carries first matching music, after the mobile terminal bound by the client receives the first matching music, the mobile terminal carries out frequency domain transformation on the first matching music to obtain corresponding frequency spectrum characteristics, and then the mobile terminal is controlled to carry out audio frequency spectrum visual display according to the frequency spectrum characteristics. In addition, the second implementation manner of steps S2 and S3: the server performs frequency domain conversion on the first matching music to obtain a frequency spectrum of the first matching music, and then issues a first frequency spectrum display instruction to the client, wherein the first frequency spectrum display instruction carries the frequency spectrum of the first matching music, and the mobile terminal bound by the client directly performs visual display control according to the received frequency spectrum, so that the processing amount of the mobile terminal is effectively reduced, and frequency spectrum visualization is performed in time.
In one possible embodiment, the music response method further comprises:
s4, the server determines matching lyrics in the audio database, wherein the matching lyrics comprise lyrics between a first matching position and an end point of standard music corresponding to the music fragment;
Specifically, the server performs speech recognition on the standard music in the audio database to obtain lyrics of the standard music. In order to improve the speed of acquiring lyrics, the lyric text of standard music can be acquired in advance and added into a database, namely, the audio database stores the corresponding relation between the standard music and the lyric text thereof. When the matched lyrics are obtained, the server can determine the matched lyrics according to the first matching position and the corresponding lyrics of the standard music, and the matched lyrics are the lyrics between the first matching position and the end point of the standard music.
S5, the server sends the matched lyrics to the terminal;
s6, the mobile terminal bound by the client displays the matched lyrics, and highlights the lyrics from the part corresponding to the first matching position.
Specifically, the mobile terminal bound by the client displays the received matched lyrics, and performs prominent display from a part of lyrics corresponding to the first matching position. The mobile terminal can add an arrow around the position of the highlighted lyric, highlight the lyric to be highlighted, increase the word number of the lyric to be highlighted, or highlight the lyric in a text color different from other lyrics.
And highlighting the corresponding lyrics in real time according to the music fragments obtained by the client so as to achieve the aim of easily following the music humming by the user. By using the scheme of the embodiment of the invention, the lyric panel can dynamically roll along with the progress of music, so that a user can conveniently and freely follow the music for humming without worrying about that the lyrics are not accurately remembered.
In one possible embodiment, the matching beat point information further includes beat point information between the starting point and the first matching position of the standard music corresponding to the music piece; the first matching music also comprises audio data from a starting point to a first matching position of the standard music corresponding to the music piece; the matching lyrics further comprise lyrics from a starting point to a first matching position of the standard music corresponding to the music piece. The server sends all the beat point information, the audio data and the lyrics of the standard music corresponding to the music fragments to the client, so that a user can conveniently obtain the complete audio information of the standard music.
In one possible embodiment, whether it is an audio fingerprint feature match or a lyric text match, this is only a quick preliminary determination of the approximate location of the music piece in the standard music, which cannot be synchronized with the picked-up music, and therefore the music response method further comprises:
S7, the client responds to the lyric adjusting operation of the user to generate a first adjusting position, the lyric adjusting operation is an operation of adjusting the displayed matched lyrics to redetermine the highlighted part of the lyrics, and the first adjusting position is sent to the server;
in particular, the user may actually re-determine the currently highlighted partial lyrics by sliding the lyrics panel on the client (showing the matching lyrics on the panel), and generate position information of the re-determined partial lyrics, i.e., the first adjusted position, in response to the lyrics adjusting operation. The client sends the first adjusting position to the server.
S8, the server receives the first adjustment position sent by the client, and determines second matching music in the audio database, wherein the second matching music comprises audio data of corresponding standard music from the first adjustment position to an end point;
specifically, the server determines second matching music according to the first adjustment position and standard music of the audio database, wherein the second matching music is audio data between the first adjustment position and an end point of the corresponding standard music.
S9, the server sends a second spectrum display instruction to the client according to the second matching music;
And S10, responding to the second spectrum display instruction by the mobile terminal bound by the client, and performing audio spectrum visual display on the second matching music.
Specifically, after the client receives the second spectrum display instruction, the bound mobile terminal performs audio spectrum visual display on the second matching music. Like step S2 and step S3, step S9 and step S10 have different implementations, and specific reference is made to the description of two implementations of step S2 and step S3, which are not repeated herein.
Therefore, when the visual frequency spectrum is inconsistent with the music in the current environment, the user can re-determine the highlighted lyrics by performing lyric adjustment operation on the lyric panel so as to achieve the effect of further correction, realize the synchronization of the visual frequency spectrum and the picked music and optimize the music response effect.
In one possible embodiment, the music response method further comprises:
and the mobile terminal bound by the client responds to the shooting point information of the first adjusting position to output a feedback signal.
Specifically, in response to the lyric adjusting operation of the user, the mobile terminal responds to the beat point information of the first adjusting position in real time to output a feedback signal according to the change of the first adjusting position. In short, in response to the lyric adjusting operation of the user, the mobile terminal bound to the client may change the highlighted lyrics in real time according to the first adjusting position, output a feedback signal in response to the beat information of the first adjusting position, and perform audio frequency spectrum visualization display in response to the audio data of the first adjusting position, so as to meet the music response requirement of the user.
With reference to the foregoing embodiment, an embodiment of the present invention further provides a music response method, including:
s11, the server receives a music query instruction sent by the client, wherein the music query instruction carries a music name;
specifically, when music is not played or singed on site, or when vocal singing is unavailable, or the picked music segments cannot be matched with the beat information, the lyrics, the audio segments or are not accurately matched, the user can send a music query instruction through the client to realize music response. The music query instruction carries a music name and can also carry music identification information such as a singer name and the like.
S12, the server responds to the music query instruction, and the beat point information corresponding to the music query instruction is determined in the audio database, wherein the audio database stores the corresponding relation between a plurality of beat point information and music names;
specifically, the server may determine its corresponding beat point information from the music name and the audio database.
S13, the server sends the inquired point information to the client;
and S14, the mobile terminal bound by the client outputs a feedback signal in response to the beat point information.
Specifically, the mobile terminal bound by the client outputs a feedback signal in response to the received beat point information, and the form of outputting the feedback signal refers to the description of the above embodiment and is not repeated.
Therefore, with the above-described embodiment, music beat point feedback can be performed in response to a music query instruction of a user, so that the user knows the beat point of music queried by the user.
In one possible embodiment, the music response method further comprises:
s15, the server responds to the music query instruction, and third matching music is determined in the audio database, wherein the third matching music is the audio data of the music corresponding to the music query instruction;
specifically, in response to the music query instruction, third matching music corresponding to the music query instruction is determined, and the third matching music is audio data of music corresponding to the query instruction.
S16, the server sends a third spectrum display instruction to the client according to the third matching music;
and S17, responding to the third spectrum display instruction by the mobile terminal bound by the client, and performing audio spectrum visual display on the third matching music.
Specifically, similar to step S2 and step S3, there are many different implementations of step S16 and step S17, and specific reference is made to the descriptions of two implementations of step S2 and step S3, which are not repeated herein. And the mobile terminal bound by the client performs audio frequency spectrum visual display on the third matching music from the starting point of the music.
In one possible embodiment, the method further comprises:
s18, the server responds to the music query instruction, and the lyrics of the music corresponding to the music query instruction are determined in the audio database;
s19, the server sends the inquired lyrics to the client;
and S20, the mobile terminal bound by the client displays the lyrics and performs prominent display from the lyrics at the starting point of the music.
Specifically, the mobile terminal bound by the client displays the lyrics according to the inquired lyrics, and performs prominent display from the lyrics at the starting point of the music.
In one possible embodiment, the method further comprises:
s21, the client responds to the lyric adjusting operation of the user to generate a second adjusting position, and the lyric adjusting operation is an operation of adjusting the displayed lyrics to redetermine the highlighted lyrics;
specifically, for the lyrics presented in step 20, the user may generate a second adjusted position by re-determining the highlighted lyrics by adjusting the lyrics.
S22, the server determines fourth matching music in the audio database, wherein the fourth matching music comprises audio data of corresponding standard music from the second adjustment position to the end point;
s23, the server sends a fourth spectrum display instruction to the client according to the fourth matching music;
And S24, responding to the fourth spectrum display instruction by the mobile terminal bound by the client, and performing audio spectrum visual display on the fourth matching music.
Specifically, similar to step S2 and step S3, there are many different implementations of step S23 and step S24, and specific reference is made to the descriptions of two implementations of step S2 and step S3, which are not repeated herein. And the mobile terminal bound by the client performs audio frequency spectrum visual display on the fourth matching music from the second adjusting position. The embodiment can respond to the lyric adjusting operation of the user to change the frequency spectrum which is displayed visually at present in real time.
In one possible embodiment, the music response method further comprises:
and the mobile terminal bound by the client responds to the shooting point information of the second adjusting position to output a feedback signal.
Specifically, in response to the lyric adjusting operation of the user, the mobile terminal responds to the beat point information of the second adjusting position in real time to output a feedback signal according to the change of the second adjusting position. In short, in response to the lyric adjusting operation of the user, the mobile terminal bound to the client may change the highlighted lyrics in real time according to the second adjusting position, output a feedback signal in response to the beat point information of the second adjusting position, and perform audio frequency spectrum visualization display in response to the audio data of the second adjusting position, so as to meet the music response requirement of the user.
Therefore, when music response is carried out based on the music query instruction, the beat point information, the lyrics and the audio frequency spectrum which are displayed currently can be adjusted in real time in response to the lyric adjusting operation of the user, and the flexibility is strong.
Based on the music response method, an embodiment of the present invention further provides a music response method, and referring to fig. 3, fig. 3 is a schematic flow chart of the music response method according to the embodiment of the present invention; the method comprises the following steps:
301. receiving music pieces sent by a client, wherein the music pieces are acquired by the client;
302. determining matching beat point information in an audio database, wherein the audio database stores a plurality of standard music and corresponding beat point information thereof, and the matching beat point information comprises beat point information between a first matching position of a music piece in the corresponding standard music and an end point of the standard music;
303. and sending the matching shooting point information to the client so that the mobile terminal bound by the client responds to the matching shooting point information to output a feedback signal.
In one possible embodiment, the output feedback signal form in response to the matching beat point information includes a light feedback form, a sound feedback form, a vibration feedback form or an output feedback form, the output feedback form includes outputting a part of lyrics corresponding to the matching beat point information, and the part of lyrics has beat point mark information.
In one possible embodiment, the method further comprises:
determining first matching music in an audio database, wherein the first matching music comprises audio data of standard music corresponding to the music sections from a first matching position to an end point;
and sending a first spectrum display instruction to the client according to the first matching music so that the mobile terminal bound by the client responds to the first spectrum display instruction to perform audio spectrum visual display on the first matching music.
In one possible embodiment, the method further comprises:
determining matched lyrics in an audio database, wherein the matched lyrics comprise lyrics between a first matching position and an end point of standard music corresponding to the music fragment;
and sending the matched lyrics to the client so that the mobile terminal bound by the client displays the matched lyrics, and highlighting the lyrics from the part corresponding to the first matching position.
In one possible embodiment, the matching beat point information further includes beat point information between the starting point and the first matching position of the standard music corresponding to the music piece; the first matching music also comprises audio data from a starting point to a first matching position of the standard music corresponding to the music piece; the matching lyrics further comprise lyrics from a starting point to a first matching position of the standard music corresponding to the music piece.
In one possible embodiment, the method further comprises:
receiving a first adjusting position sent by a client, wherein the first adjusting position is generated by the client in response to a lyric adjusting operation of a user, and the lyric adjusting operation is an operation of adjusting displayed matched lyrics to redetermine a highlighted part of the lyrics;
determining second matching music in the audio database, wherein the second matching music comprises audio data of corresponding standard music from the first adjusting position to the end point;
and sending a second spectrum display instruction to the client according to the second matching music so that the mobile terminal bound by the client responds to the second spectrum display instruction to perform audio spectrum visual display on the second matching music.
In the music response method in this embodiment, reference may be made to the execution steps of the server in the music response method, which are not described in detail again.
Based on the music response method, an embodiment of the present invention further provides a music response method, and referring to fig. 4, fig. 4 is a schematic flowchart of a music response method according to an embodiment of the present invention; the method comprises the following steps:
401. receiving a music query instruction sent by a client, wherein the music query instruction carries a music name;
402. Responding to the music query instruction, determining beat point information corresponding to the music query instruction in an audio database, wherein the audio database stores corresponding relations between a plurality of beat point information and music names;
403. and sending the inquired beat point information to the client so that the mobile terminal bound by the client outputs a feedback signal in response to the beat point information.
In one possible embodiment, the method further comprises:
responding to the music query instruction, and determining third matched music in the audio database, wherein the third matched music is the audio data of the standard music corresponding to the music query instruction;
and sending a third spectrum display instruction to the client according to the third matching music so that the mobile terminal bound by the client responds to the third spectrum display instruction to perform audio frequency spectrum visual display on the third matching music.
In one possible embodiment, the method further comprises:
responding to the music query instruction, and determining lyrics of standard music corresponding to the music query instruction in an audio database;
and sending the inquired lyrics to the client so that the mobile terminal bound by the client displays the lyrics and performs prominent display from the lyrics at the starting point of the music.
In one possible embodiment, the method further comprises:
Receiving a second adjustment position sent by the client, wherein the second adjustment position is generated by the client in response to a lyric adjustment operation of a user, and the lyric adjustment operation is an operation of adjusting displayed lyrics to redetermine a highlighted part of the lyrics;
determining fourth matching music in the audio database, wherein the fourth matching music comprises audio data of corresponding standard music from the second adjusting position to the end point;
and sending a fourth spectrum display instruction to the client according to the fourth matching music so that the mobile terminal bound by the client responds to the fourth spectrum display instruction to perform audio spectrum visual display on the fourth matching music.
The music response method in this embodiment may refer to the execution steps of the client in the music response method, and is not described in detail again.
Based on the music response method, an embodiment of the present invention further provides a music response method, and referring to fig. 5, fig. 5 is a schematic flow chart of the music response method according to the embodiment of the present invention; the method comprises the following steps:
501. acquiring a music fragment;
502. sending music clips to a server so that the server determines matching beat point information in an audio database, wherein the audio database stores a plurality of standard music and corresponding beat point information thereof, and the matching beat point information comprises beat point information between a first matching position of a music clip in the corresponding standard music and an end point of the standard music;
503. Receiving matching shooting point information sent by a server;
504. and outputting a feedback signal in response to the matched beat point information.
In one possible embodiment, the output feedback signal form in response to the matching beat point information includes a light feedback form, a sound feedback form, a vibration feedback form or an output feedback form, the output feedback form includes outputting a part of lyrics corresponding to the matching beat point information, and the part of lyrics has beat point mark information.
In one possible embodiment, the method further comprises:
receiving lyrics sent by a server;
displaying the lyrics, and highlighting the lyrics from the part corresponding to the first matching position;
determining a first adjustment position in response to a lyric adjustment operation of a user, the lyric adjustment operation being an operation of adjusting the displayed lyrics to re-determine a portion of the lyrics that are highlighted;
and outputting a feedback signal in response to the shooting point information of the first adjusting position.
In one possible embodiment, the method further comprises:
receiving a first spectrum display instruction sent by a server according to first matched music, wherein the first matched music comprises audio data of standard music corresponding to music fragments from a first matching position to an end point;
And responding to the first spectrum display instruction, and performing audio spectrum visual display on the first matching music.
In one possible embodiment, the method further comprises:
receiving matched lyrics sent by a server, wherein the matched lyrics comprise lyrics between a first matching position and an end point of standard music corresponding to the music fragments;
and displaying the matched lyrics, and highlighting the lyrics from the part corresponding to the first matching position.
In one possible embodiment, the matching beat point information further includes beat point information between the starting point and the first matching position of the standard music corresponding to the music piece; the first matching music also comprises audio data from a starting point to a first matching position of the standard music corresponding to the music piece; the matching lyrics further comprise lyrics from a starting point to a first matching position of the standard music corresponding to the music piece.
In one possible embodiment, the method further comprises:
generating a first adjusted position in response to a lyric adjusting operation of a user, the lyric adjusting operation being an operation of adjusting the displayed matching lyrics to re-determine a portion of the lyrics highlighted;
sending the first adjustment position to the server so that the server determines second matching music in the audio database, wherein the second matching music comprises audio data of corresponding standard music from the first adjustment position to an end point;
Receiving a second spectrum display instruction sent by the server according to the second matching music;
and responding to the second spectrum display instruction, and performing audio spectrum visual display on the second matching music.
In one possible embodiment, the method further comprises:
determining a first adjustment position in response to a lyric adjustment operation of a user, the lyric adjustment operation being an operation of adjusting the displayed matching lyrics to re-determine a portion of the lyrics highlighted;
and outputting a feedback signal in response to the shooting point information of the first adjusting position.
The music response method in this embodiment may refer to the execution steps of the client in the music response method, and is not described in detail again.
Based on the foregoing method embodiment, an embodiment of the present invention further provides a music client bound to a mobile terminal, including:
the music query window is used for receiving a music name input by a user to generate a music query instruction;
the music query instruction carries a music name so that the server responds to the music query instruction, beat point information corresponding to the music query instruction is determined in an audio database, and the audio database stores a plurality of corresponding relations between the beat point information and the music name;
The receiving module is used for receiving the shooting point information sent by the server;
and the output module is used for responding to the beat point information and outputting an instruction to the bound mobile terminal so that the terminal outputs a feedback signal.
The music client in this embodiment may refer to the execution steps of the client in the music response method, and will not be described again.
Based on the description of the above embodiment of the music response method, the embodiment of the present invention further discloses a music response device, and referring to fig. 6, fig. 6 is a schematic structural diagram of a music response device provided in the embodiment of the present invention, where the music response device includes;
a first receiving module 601, configured to receive a music piece sent by a client, where the music piece is obtained by the client;
the first processing module 602 is configured to determine matching beat point information in an audio database, where the audio database stores multiple pieces of standard music and corresponding beat point information, and the matching beat point information includes beat point information between a first matching position of a music piece in the corresponding standard music and an end point of the standard music;
the first sending module 603 is configured to send the matching beat point information to the client, so that the mobile terminal bound to the client outputs a feedback signal in response to the matching beat point information.
In one possible embodiment, the output feedback signal form in response to the matching beat point information includes a light feedback form, a sound feedback form, a vibration feedback form or an output feedback form, the output feedback form includes outputting a part of lyrics corresponding to the matching beat point information, and the part of lyrics has beat point mark information.
In one possible embodiment, the music responding apparatus further includes:
the first determining module is used for determining first matching music in the audio database, wherein the first matching music comprises audio data of standard music corresponding to the music sections from a first matching position to an end point;
the first sending module is further configured to send a first spectrum display instruction to the client according to the first matching music, so that the mobile terminal bound to the client responds to the first spectrum display instruction, and performs audio spectrum visual display on the first matching music.
In one possible embodiment, the music responding apparatus further includes:
the second determining module is used for determining matched lyrics in the audio database, wherein the matched lyrics comprise lyrics between the first matching position and the end point of the standard music corresponding to the music fragment;
the first sending module is further used for sending the matched lyrics to the client so that the mobile terminal bound by the client displays the matched lyrics and performs prominent display from the part of the lyrics corresponding to the first matching position.
In one possible embodiment, the matching beat point information further includes beat point information between the starting point and the first matching position of the standard music corresponding to the music piece; the first matching music also comprises audio data from a starting point to a first matching position of the standard music corresponding to the music piece; the matching lyrics further comprise lyrics from a starting point to a first matching position of the standard music corresponding to the music piece.
In one possible embodiment, the music responding apparatus further includes:
the first receiving module is further used for receiving a first adjusting position sent by the client, wherein the first adjusting position is generated by the client in response to a lyric adjusting operation of a user, and the lyric adjusting operation is an operation of adjusting displayed matched lyrics to redetermine a highlighted part of the lyrics;
the third determining module is used for determining second matching music in the audio database, wherein the second matching music comprises audio data of corresponding standard music from the first adjusting position to the end point;
the first sending module is further configured to send a second spectrum display instruction to the client according to the second matching music, so that the mobile terminal bound to the client responds to the second spectrum display instruction to perform audio spectrum visual display on the second matching music.
It should be noted that, for a specific implementation of the function of the music response apparatus, reference may be made to the description of the music response method, and details are not described here. The units or modules in the music response device may be respectively or completely combined into one or several other units or modules to form the music response device, or some unit(s) or module(s) thereof may be further split into multiple functionally smaller units or modules to form the music response device, which may achieve the same operation without affecting the achievement of the technical effects of the embodiments of the present invention. The above units or modules are divided based on logic functions, and in practical applications, the functions of one unit (or module) may also be implemented by a plurality of units (or modules), or the functions of a plurality of units (or modules) may be implemented by one unit (or module).
Based on the description of the above embodiment of the music response method, the embodiment of the present invention further discloses a music response device, referring to fig. 7, fig. 7 is a schematic structural diagram of a mobile terminal provided in the embodiment of the present invention, where the music response device includes;
a second receiving module 701, configured to receive a music query instruction sent by a client, where the music query instruction carries a music name;
A second processing module 702, configured to respond to the music query instruction, determine, in an audio database, beat point information corresponding to the music query instruction, where the audio database stores a corresponding relationship between a plurality of beat point information and music names;
the second sending module 703 is further configured to send the queried beat point information to the client, so that the mobile terminal bound to the client outputs a feedback signal in response to the beat point information. Responding to the music query instruction, and determining third matched music in the audio database, wherein the third matched music is the audio data of the music corresponding to the music query instruction;
in one possible embodiment, the music responding apparatus further includes:
the second processing module 702 is further configured to respond to the music query instruction, and determine third matching music in the audio database, where the third matching music is audio data of standard music corresponding to the music query instruction;
the second sending module 703 is further configured to send a third spectrum display instruction to the client according to the third matching music, so that the mobile terminal bound to the client responds to the third spectrum display instruction, and performs audio spectrum visual display on the third matching music.
In one possible embodiment, the music responding apparatus further includes:
The second processing module 702 is further configured to, in response to the music query instruction, determine lyrics of standard music corresponding to the music query instruction in the audio database;
the second sending module 703 is further configured to send the queried lyrics to the client, so that the mobile terminal bound to the client displays the lyrics, and performs a prominent display from the lyrics at the start point of the music.
In one possible embodiment, the music responding apparatus further includes:
the second receiving module 701 is further configured to receive a second adjusted position sent by the client, where the second adjusted position is generated by the client in response to a lyric adjusting operation of the user, and the lyric adjusting operation is an operation of adjusting displayed lyrics to re-determine a highlighted portion of the lyrics;
a second processing module 702, further configured to determine a fourth matching music in the audio database, where the fourth matching music includes audio data of a corresponding standard music from the second adjustment position to the end point;
the second sending module 703 is further configured to send a fourth spectrum display instruction to the client according to the fourth matching music, so that the mobile terminal bound to the client responds to the fourth spectrum display instruction to perform audio spectrum visual display on the fourth matching music.
It should be noted that, for a specific implementation of the function of the music response apparatus, reference may be made to the description of the music response method, and details are not described here. The units or modules in the music response device may be respectively or completely combined into one or several other units or modules to form the music response device, or some unit(s) or module(s) thereof may be further split into multiple functionally smaller units or modules to form the music response device, which may achieve the same operation without affecting the achievement of the technical effects of the embodiments of the present invention. The above units or modules are divided based on logic functions, and in practical applications, the functions of one unit (or module) may also be implemented by a plurality of units (or modules), or the functions of a plurality of units (or modules) may be implemented by one unit (or module).
Based on the description of the method embodiment and the device embodiment, the embodiment of the invention also provides music response equipment.
Fig. 8 is a schematic structural diagram of a music response device according to an embodiment of the present invention. As shown in fig. 8, the above-described music responding apparatus may be applied to a music responding apparatus 800, and the music responding apparatus 800 may include: the processor 801, the network interface 804 and the memory 805, and the music responding apparatus 800 may further include: a user interface 803, and at least one communication bus 802. Wherein a communication bus 802 is used to enable connective communication between these components. The user interface 803 may include a Display (Display) and a Keyboard (Keyboard), and the optional user interface 803 may also include a standard wired interface and a standard wireless interface. The network interface 804 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 805 may be a high-speed RAM memory or a non-volatile memory (e.g., at least one disk memory). The memory 805 may optionally be at least one memory device located remotely from the processor 801 as previously described. As shown in fig. 8, the memory 805, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a device control application program.
In the music responding apparatus 800 shown in fig. 8, the network interface 804 may provide a network communication function; and the user interface 803 is primarily an interface for providing input to a user; and the processor 801 may be adapted to invoke a device control application stored in the memory 805 to implement the steps of the music response method described in any of the embodiments above.
It should be understood that the music response device 800 described in the embodiment of the present invention may perform the music response method described above, specifically referring to the description about the server; the description of the music responding apparatus can also be performed, and will not be repeated herein. In addition, the beneficial effects of the same method are not described in detail.
Based on the description of the above method embodiment, the embodiment of the present invention further provides a mobile terminal. The mobile terminal comprises a processor and a memory, wherein the processor is connected with the memory; wherein the memory is used for storing program codes, and the processor is used for calling the program codes to execute the music response method.
It should be understood that the mobile terminal described in the embodiment of the present invention may execute the music response method described above, and refer to the description about the client specifically, which is not described herein again. In addition, the beneficial effects of the same method are not described in detail.
Further, here, it is to be noted that: an embodiment of the present invention further provides a computer storage medium, where the computer storage medium stores the computer program executed by the aforementioned music response apparatus, and the computer program includes program instructions, and when the processor executes the program instructions, the processor can execute the description of the music response method, and therefore, details are not repeated here. In addition, the beneficial effects of the same method are not described in detail. For technical details not disclosed in the embodiments of the computer storage medium to which the present invention relates, reference is made to the description of the method embodiments of the present invention.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present invention, and it is therefore to be understood that the invention is not limited by the scope of the appended claims.

Claims (13)

1. A musical response method, comprising:
receiving a music piece sent by a client, wherein the music piece is acquired by the client;
determining matching beat point information in an audio database, wherein the audio database stores a plurality of standard music and corresponding beat point information thereof, and the matching beat point information comprises beat point information between a first matching position of the music piece in the corresponding standard music and an end point of the standard music;
and sending the matching shooting point information to the client so that the mobile terminal bound by the client responds to the matching shooting point information to output a feedback signal.
2. The method of claim 1, wherein outputting a feedback signal in response to the matching beat point information comprises outputting a light feedback form, a sound feedback form, a vibration feedback form, or an output feedback form, wherein outputting the feedback signal comprises outputting a portion of lyrics corresponding to the matching beat point information, and wherein the portion of lyrics has beat point mark information.
3. The method of claim 1, further comprising:
determining first matching music in the audio database, wherein the first matching music comprises audio data of standard music corresponding to the music piece from the first matching position to an end point;
sending a first spectrum display instruction to the client according to the first matching music so that a mobile terminal bound by the client responds to the first spectrum display instruction to perform audio spectrum visual display on the first matching music;
alternatively, the first and second electrodes may be,
determining matching lyrics in the audio database, wherein the matching lyrics comprise lyrics of standard music corresponding to the music fragment from the first matching position to an end point;
and sending the matched lyrics to the client so that the mobile terminal bound by the client displays the matched lyrics, and highlighting the lyrics from the part corresponding to the first matched position.
4. The method according to claim 3, wherein the matching beat point information further comprises beat point information from a starting point to the first matching position of standard music corresponding to the music piece; or the first matching music also comprises audio data from a starting point to the first matching position of the standard music corresponding to the music piece; or the matching lyrics further comprise lyrics from a starting point to the first matching position of the standard music corresponding to the music piece.
5. The method according to claim 3 or 4, characterized in that the method further comprises:
receiving a first adjustment position sent by the client, wherein the first adjustment position is generated by the client in response to a lyric adjustment operation of a user, and the lyric adjustment operation is an operation of adjusting displayed matched lyrics to redetermine a highlighted part of lyrics;
determining a second matching music in the audio database, the second matching music comprising audio data of a corresponding standard music from the first adjusted position to an end point;
and sending a second spectrum display instruction to the client according to the second matching music so that the mobile terminal bound by the client responds to the second spectrum display instruction to perform audio spectrum visual display on the second matching music.
6. A musical response method, the method comprising:
receiving a music query instruction sent by a client, wherein the music query instruction carries a music name;
responding to the music query instruction, and determining beat point information corresponding to the music query instruction in an audio database, wherein the audio database stores corresponding relations between a plurality of beat point information and music names;
And sending the inquired shooting point information to the client so that the mobile terminal bound by the client responds to the shooting point information and outputs a feedback signal.
7. The method of claim 6, further comprising:
responding to the music query instruction, and determining third matched music in the audio database, wherein the third matched music is audio data of standard music corresponding to the music query instruction;
sending a third spectrum display instruction to the client according to the third matching music, so that the mobile terminal bound by the client responds to the third spectrum display instruction, and performing audio frequency spectrum visual display on the third matching music;
alternatively, the first and second electrodes may be,
responding to the music query instruction, and determining lyrics of standard music corresponding to the music query instruction in the audio database;
and sending the inquired lyrics to the client so that the mobile terminal bound by the client displays the lyrics and performs prominent display from the lyrics at the starting point of the music.
8. The method of claim 6, further comprising:
receiving a second adjustment position sent by the client, wherein the second adjustment position is generated by the client in response to a lyric adjustment operation of a user, and the lyric adjustment operation is an operation of adjusting displayed lyrics to redetermine a highlighted part of the lyrics;
Determining fourth matching music in the audio database, wherein the fourth matching music comprises audio data of corresponding standard music from the second adjustment position to an end point;
and sending a fourth spectrum display instruction to the client according to the fourth matching music, so that the mobile terminal bound by the client responds to the fourth spectrum display instruction, and performing audio spectrum visual display on the fourth matching music.
9. A musical response method, comprising:
acquiring a music fragment;
sending the music clips to a server so that the server determines matching beat point information in an audio database, wherein the audio database stores a plurality of standard music and corresponding beat point information thereof, and the matching beat point information comprises beat point information between a first matching position of the music clip in the corresponding standard music and an end point of the standard music;
receiving the matched shooting point information sent by the server;
and responding the matched beat point information to output a feedback signal.
10. The method of claim 9, further comprising:
receiving lyrics sent by the server;
Displaying the lyrics, and highlighting the lyrics from the part corresponding to the first matching position;
determining a first adjustment position in response to a lyric adjustment operation of a user, the lyric adjustment operation being an operation of adjusting the displayed lyrics to re-determine a portion of the lyrics that are highlighted;
and outputting a feedback signal in response to the shooting point information of the first adjusting position.
11. A music client bound to a mobile terminal, comprising:
the music query window is used for receiving a music name input by a user to generate a music query instruction;
the sending module is used for sending the music query instruction to a server, wherein the music query instruction carries a music name, so that the server responds to the music query instruction, beat point information corresponding to the music query instruction is determined in an audio database, and the audio database stores a plurality of corresponding relations between the beat point information and the music name;
the receiving module is used for receiving the shooting point information sent by the server;
and the output module is used for responding to the beat point information and outputting an instruction to the bound mobile terminal so as to enable the terminal to output a feedback signal.
12. A musical response apparatus, comprising:
The first receiving module is used for receiving music pieces sent by a client, wherein the music pieces are acquired by the client;
the system comprises a first processing module, a second processing module and a third processing module, wherein the first processing module is used for determining matching beat point information in an audio database, the audio database stores a plurality of standard music and corresponding beat point information thereof, and the matching beat point information comprises beat point information between a first matching position of a music piece in the corresponding standard music and an end point of the standard music;
and the first sending module is used for sending the matching shooting point information to the client so that the mobile terminal bound by the client responds to the matching shooting point information and outputs a feedback signal.
13. A mobile terminal, comprising: a processor and a memory;
the processor is coupled to a memory, wherein the memory is configured to store program code and the processor is configured to invoke the program code to perform the music response method of any of claims 9-10.
CN202010630221.2A 2020-07-01 2020-07-01 Music response method and related equipment Pending CN111859015A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010630221.2A CN111859015A (en) 2020-07-01 2020-07-01 Music response method and related equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010630221.2A CN111859015A (en) 2020-07-01 2020-07-01 Music response method and related equipment

Publications (1)

Publication Number Publication Date
CN111859015A true CN111859015A (en) 2020-10-30

Family

ID=73152802

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010630221.2A Pending CN111859015A (en) 2020-07-01 2020-07-01 Music response method and related equipment

Country Status (1)

Country Link
CN (1) CN111859015A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112866224A (en) * 2021-01-12 2021-05-28 广州橙行智动汽车科技有限公司 Data processing method and device
CN113392262A (en) * 2020-11-26 2021-09-14 腾讯科技(北京)有限公司 Music identification method, recommendation method, device, equipment and storage medium
CN114398529A (en) * 2021-12-27 2022-04-26 江苏亨通数字智能科技有限公司 Optical wand detaching method and device and storage medium

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5663515A (en) * 1994-05-02 1997-09-02 Yamaha Corporation Online system for direct driving of remote karaoke terminal by host station
KR20030067377A (en) * 2002-02-08 2003-08-14 엘지전자 주식회사 Method and apparatus for searching of musical data based on melody
CN1941071A (en) * 2005-07-27 2007-04-04 索尼株式会社 Beat extraction and detection apparatus and method, music-synchronized image display apparatus and method
CN1983253A (en) * 2005-12-15 2007-06-20 北京中科信利技术有限公司 Method, apparatus and system for supplying musically searching service
JP2007304474A (en) * 2006-05-15 2007-11-22 Taito Corp Karaoke performance device
CN102479509A (en) * 2010-11-29 2012-05-30 财团法人资讯工业策进会 Melody recognition method and device thereof
CN105405337A (en) * 2015-10-22 2016-03-16 小天才科技有限公司 Auxiliary music playing method and system
CN105513583A (en) * 2015-11-25 2016-04-20 福建星网视易信息系统有限公司 Display method and system for song rhythm
CN107786876A (en) * 2017-09-21 2018-03-09 北京达佳互联信息技术有限公司 The synchronous method of music and video, device and mobile terminal
CN108259983A (en) * 2017-12-29 2018-07-06 广州市百果园信息技术有限公司 A kind of method of video image processing, computer readable storage medium and terminal
CN108447311A (en) * 2018-02-02 2018-08-24 北京网梯科技发展有限公司 Music education method and apparatus based on voice recognition
CN109241329A (en) * 2018-08-03 2019-01-18 百度在线网络技术(北京)有限公司 For the music retrieval method of AR scene, device, equipment and storage medium
CN109272808A (en) * 2018-11-13 2019-01-25 上海艺瓣文化传播有限公司 A kind of interaction systems towards the teaching of music beat rhythm and science popularization
CN111046226A (en) * 2018-10-15 2020-04-21 阿里巴巴集团控股有限公司 Music tuning method and device

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5663515A (en) * 1994-05-02 1997-09-02 Yamaha Corporation Online system for direct driving of remote karaoke terminal by host station
KR20030067377A (en) * 2002-02-08 2003-08-14 엘지전자 주식회사 Method and apparatus for searching of musical data based on melody
CN1941071A (en) * 2005-07-27 2007-04-04 索尼株式会社 Beat extraction and detection apparatus and method, music-synchronized image display apparatus and method
CN1983253A (en) * 2005-12-15 2007-06-20 北京中科信利技术有限公司 Method, apparatus and system for supplying musically searching service
JP2007304474A (en) * 2006-05-15 2007-11-22 Taito Corp Karaoke performance device
CN102479509A (en) * 2010-11-29 2012-05-30 财团法人资讯工业策进会 Melody recognition method and device thereof
CN105405337A (en) * 2015-10-22 2016-03-16 小天才科技有限公司 Auxiliary music playing method and system
CN105513583A (en) * 2015-11-25 2016-04-20 福建星网视易信息系统有限公司 Display method and system for song rhythm
CN107786876A (en) * 2017-09-21 2018-03-09 北京达佳互联信息技术有限公司 The synchronous method of music and video, device and mobile terminal
CN108259983A (en) * 2017-12-29 2018-07-06 广州市百果园信息技术有限公司 A kind of method of video image processing, computer readable storage medium and terminal
CN108447311A (en) * 2018-02-02 2018-08-24 北京网梯科技发展有限公司 Music education method and apparatus based on voice recognition
CN109241329A (en) * 2018-08-03 2019-01-18 百度在线网络技术(北京)有限公司 For the music retrieval method of AR scene, device, equipment and storage medium
CN111046226A (en) * 2018-10-15 2020-04-21 阿里巴巴集团控股有限公司 Music tuning method and device
CN109272808A (en) * 2018-11-13 2019-01-25 上海艺瓣文化传播有限公司 A kind of interaction systems towards the teaching of music beat rhythm and science popularization

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113392262A (en) * 2020-11-26 2021-09-14 腾讯科技(北京)有限公司 Music identification method, recommendation method, device, equipment and storage medium
CN112866224A (en) * 2021-01-12 2021-05-28 广州橙行智动汽车科技有限公司 Data processing method and device
CN114398529A (en) * 2021-12-27 2022-04-26 江苏亨通数字智能科技有限公司 Optical wand detaching method and device and storage medium
CN114398529B (en) * 2021-12-27 2023-12-01 江苏亨通数字智能科技有限公司 Optical wand disassembly method, optical wand disassembly device and storage medium

Similar Documents

Publication Publication Date Title
CN111859015A (en) Music response method and related equipment
CN105810190B (en) Automatic transcription of music content and real-time musical accompaniment
US7605322B2 (en) Apparatus for automatically starting add-on progression to run with inputted music, and computer program therefor
CN108630177B (en) Electronic musical instrument, control method for electronic musical instrument, and recording medium
US20170053642A1 (en) Information Processing Method and Information Processing Device
US9142203B2 (en) Music data generation based on text-format chord chart
JP6452229B2 (en) Karaoke sound effect setting system
CN108257588A (en) One kind is set a song to music method and device
CN111048058A (en) Singing or playing method and terminal for adjusting song music score in real time
CN110517657B (en) Beat configuration/playing method, system, medium and equipment of music file
WO2017221766A1 (en) Performance support device and method
CN113874932A (en) Electronic musical instrument, control method for electronic musical instrument, and storage medium
JP2014048472A (en) Voice synthesis system for karaoke and parameter extractor
JP4808641B2 (en) Caricature output device and karaoke device
JP4491743B2 (en) Karaoke equipment
JP6693176B2 (en) Lyrics generation device and lyrics generation method
JP3931442B2 (en) Karaoke equipment
CN111666445A (en) Scene lyric display method and device and sound box equipment
CN108922505A (en) Information processing method and device
JP2016142967A (en) Accompaniment training apparatus and accompaniment training program
JP6459162B2 (en) Performance data and audio data synchronization apparatus, method, and program
JP2005189658A (en) Luminescence presenting system and luminescence presenting apparatus
CN111667554A (en) Control method for information processing apparatus, electronic device, performance data display system
JP2008197269A (en) Data reproduction device, data reproduction method, and program
US8217251B2 (en) Interactive display

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination