CN107093419B - Dynamic vocal accompaniment method and device - Google Patents
Dynamic vocal accompaniment method and device Download PDFInfo
- Publication number
- CN107093419B CN107093419B CN201610089388.6A CN201610089388A CN107093419B CN 107093419 B CN107093419 B CN 107093419B CN 201610089388 A CN201610089388 A CN 201610089388A CN 107093419 B CN107093419 B CN 107093419B
- Authority
- CN
- China
- Prior art keywords
- singing
- audio
- accompaniment
- current
- original
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/36—Accompaniment arrangements
- G10H1/361—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Reverberation, Karaoke And Other Acoustics (AREA)
Abstract
The embodiment of the invention discloses a dynamic vocal accompaniment method, which comprises the following steps: playing the accompaniment audio of the current on-demand song; acquiring singing voice information input by a user through a microphone; and controlling to play the original singing audio of the current on-demand song according to the singing sound information. The embodiment of the invention also discloses a dynamic vocal accompaniment device. By adopting the method and the device, the original vocal audio can be dynamically played, and better vocal accompaniment experience is provided.
Description
Technical Field
The invention relates to the field of multimedia playing, in particular to a dynamic vocal accompaniment method and a dynamic vocal accompaniment device.
Background
Singing is a movable mode often selected in daily life of people, so that accompanying music also becomes a condition required by people for singing, people often go to karaoke (karaok) to sing, and application programs installed on mobile terminals can provide accompanying functions nowadays. However, the existing vocal accompaniment functions generally only have two choices of an original vocal mode and an accompaniment mode (original vocal is closed), so that a user usually selects to play the original vocal mode when the user is not familiar with songs, and selects to play the accompaniment mode when the user compares songs with certain habits.
The conventional accompaniment technology depends on manual selection and switching of an original singing mode and an accompaniment mode by a user, so that the operation is inconvenient, for example, when the user is familiar with some parts in a song and is not familiar with some parts, the user needs to take a lot of attention to manually switch the accompaniment mode, and great influence is brought to the singing of the user.
Disclosure of Invention
In view of this, embodiments of the present invention provide a dynamic vocal accompaniment method and apparatus, which can dynamically play the original vocal audio to provide better vocal accompaniment experience.
In order to solve the above technical problem, an embodiment of the present invention provides a dynamic vocal accompaniment method, including:
playing the accompaniment audio of the current on-demand song;
acquiring singing voice information input by a user through a microphone;
and controlling to play the original singing audio of the current on-demand song according to the singing sound information.
Correspondingly, the embodiment of the invention also provides a dynamic vocal accompaniment device, which comprises:
the accompaniment playing module is used for playing the accompaniment audio of the current on-demand song;
the singing voice acquisition module is used for acquiring singing voice information input by a user through a microphone;
and the dynamic vocal accompaniment module is used for controlling and playing the original vocal audio of the current on-demand song according to the vocal sound information.
According to the embodiment of the invention, in the playing process of the on-demand song, the original singing audio frequency of the current on-demand song is dynamically controlled to be played according to the singing sound information of the user, so that automatic dynamic accompanying singing for the user is realized, the user does not need to manually switch an accompanying singing mode, and the singing experience of the user is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flow chart of a dynamic vocal accompaniment method in accordance with an embodiment of the present invention;
FIG. 2 is a flow chart of a dynamic vocal accompaniment method in accordance with another embodiment of the present invention;
FIG. 3 is a flow chart of a dynamic vocal accompaniment method in accordance with another embodiment of the present invention;
FIG. 4 is a flow chart of a dynamic vocal accompaniment method in accordance with another embodiment of the present invention;
fig. 5 is a schematic flow chart of a dynamic vocal accompaniment apparatus according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The dynamic vocal accompaniment method and the device in the embodiment of the invention can be realized in a KTV song-requesting system or multimedia playing devices such as a mobile phone, a tablet personal computer, a digital television terminal and the like, and the dynamic vocal accompaniment device is taken as an execution main body for introduction in the implementation process of introducing the dynamic vocal accompaniment method.
Fig. 1 is a schematic flow chart of a dynamic vocal accompaniment method in an embodiment of the present invention, and as shown in the drawing, the flow of the dynamic vocal accompaniment method in the embodiment may include:
s101, playing the accompaniment audio of the current on-demand song.
Specifically, the current on-demand song may be a song currently or selected in advance by the user, the accompaniment audio of the current on-demand song may be played by default after the playing is started, and the accompaniment audio and the original singing audio of each song are pre-stored in the dynamic accompaniment device. Optionally, the original singing audio may include an accompaniment part + a singing part, and the accompaniment audio only includes an accompaniment part; in yet another alternative embodiment, the original audio may only include the singing portion, i.e., the original audio and the accompanying audio do not include the overlapping portion.
And S102, acquiring singing voice information input by a user through a microphone.
Specifically, in the process of playing the on-demand song, the dynamic vocal accompaniment device can collect the singing voice information input by the user through the microphone, and the singing voice information can comprise the singing volume, the singing tone or the singing tempo information sung by the user.
S103, controlling and playing the original singing audio of the current on-demand song according to the singing sound information.
Specifically, the dynamic vocal accompaniment device can control to open/close the original vocal audio for playing the current on-demand song according to the collected singing sound information of the user, and can also control the output proportion of the accompaniment audio and the original vocal audio of the current on-demand song. For example, according to the collected singing sound information of the user, judging that the user sings more proficiently or confidently at present, the original singing audio frequency of the currently requested song can be closed to play, or the output proportion of the original singing audio frequency and the accompaniment audio frequency of the currently requested song is reduced; on the contrary, if the current singing of the user is judged to be unskilled or not confident according to the collected singing sound information of the user, the original singing audio frequency of the current on-demand song can be started to be played, or the output proportion of the original singing audio frequency and the accompaniment audio frequency of the current on-demand song is improved. In an optional embodiment, the dynamic accompaniment device may control to play the original singing audio of the currently requested song according to the singing sound information when determining that the current playing progress time of the currently requested song has the original singing part, that is, if the current playing progress time of the currently requested song does not have the original singing part, that is, the original singing part is a pure accompaniment part, the user should not sing at present, and then the original singing audio does not need to be played, and actually, the audio of the original singing part does not exist at this time (if the original singing audio includes the original singing part and the accompaniment part, then the original singing audio and the accompaniment audio are completely consistent at this time, and only the accompaniment audio needs to be played).
In an optional embodiment, a singing volume interval where the current singing volume is located may be determined in a plurality of preset singing volume intervals, and then, according to a corresponding relationship between the preset output proportion of the accompaniment audio and the original singing audio and the singing volume interval, the output proportion of the accompaniment audio and the original singing audio is controlled according to the output proportion corresponding to the singing volume interval where the current singing volume is located. For example, if the singing volume of the user collected by the dynamic accompaniment device is smaller than a first volume threshold, it can be judged that the user is not singing (not knowing how to sing, or not remembering the lyrics, or microphone faults, etc.), at this time, the original singing audio frequency of the current on-demand song can be played according to the output volume of the current system, and if the original singing audio frequency comprises the accompaniment part and the singing part, the accompaniment audio frequency of the current played song can be closed; if the singing volume of the user collected by the dynamic vocal accompaniment device is greater than a second volume threshold, judging that the user is confident to sing currently (without the original vocal accompaniment), and closing the original vocal audio for playing the currently requested song, wherein the second volume threshold is greater than the first volume threshold; and then if the singing volume of the user collected by the dynamic accompanying device is between the first volume threshold and the second volume threshold, judging that the user is not confident currently singing, determining a singing volume interval in which the current singing volume is positioned in a plurality of preset singing volume intervals, and controlling the output of the accompaniment audio and the original singing audio according to the corresponding relation between the output proportion of the preset accompaniment audio and the original singing audio and the singing volume interval and the output proportion corresponding to the singing volume interval in which the current singing volume is positioned, namely dynamically controlling the output of the original singing audio. An exemplary assumption is that the first volume threshold is a, the second volume threshold is c, where d > a, 2 singing volume intervals are further assumed between a and c, a-b and b-c, the output proportion of the control accompaniment audio corresponding to the singing volume interval a-b and the original singing audio corresponding to the singing volume interval a-b is preset to be 1:2, the output proportion of the control accompaniment audio corresponding to the singing volume interval a-b and the original singing audio corresponding to the singing volume interval a-b is 2:1, and further, if the singing volume of the user currently collected by the dynamic accompanying device is in the a-b singing volume interval, the accompaniment audio and the original singing audio are output according to the system output volume and the proportion of 1:2, that is, the output volume of the original singing audio is 2 times of the accompaniment audio. The output specific gravities corresponding to the intervals 0-a and c-infinity can be regarded as 1:0 and 0: 1. It should be noted that the above is merely an example, and in other alternative embodiments, more singing volume intervals may be set, or other output proportions of the accompaniment audio and the original singing audio may be set. Furthermore, the output proportion is set under the condition that the original singing audio comprises the accompaniment part and the singing part, and if the original singing audio only comprises the singing part but not comprises the accompaniment part, the setting of the output proportion can be adaptively adjusted.
In another optional embodiment, the dynamic vocal accompaniment device can compare the singing tone with the standard original singing tone at the time corresponding to the current on-demand song according to the playing progress time of the current on-demand song to obtain a tone deviation value; and controlling the output proportion of the accompaniment audio and the original singing audio of the current on-demand song according to the tone deviation value. Comparing the singing tone of the user with the standard original singing tone to judge whether the currently singing tone of the user is accurate, for example, if the deviation is large (the deviation value is larger than a preset threshold value) or the singing tones acquired for multiple times continuously are different from the standard original singing tone, the user can be considered to be unskilled (wrong tune or wrong singing) on the current song, the original singing audio of the currently requested song can be played, and if the original singing audio comprises an accompaniment part and a singing part, the accompaniment audio of the currently played song can be closed; otherwise, if the tone of the current singing of the user is more accurate, the original singing audio frequency for playing the current on-demand song can be closed; and the output proportion of the accompaniment audio and the original singing audio can be controlled according to the size of the deviation value or the occurrence frequency of the singing tones which are continuously collected and are different from the standard original singing tones. The deviation value of the tone can be determined according to the difference of the musical scales and can also be determined according to the collected sound frequency. The standard original tone can be extracted according to a standard note file of the current on-demand song.
In another optional embodiment, the dynamic vocal accompaniment device can compare the singing tempo information with the standard original singing tempo information of the corresponding time of the current on-demand song according to the playing progress time of the current on-demand song to obtain a tempo deviation value; and controlling the output proportion of the accompaniment audio and the original singing audio of the current on-demand song according to the beat deviation value. The method comprises the steps that a singing beat of a user is compared with a standard original singing beat to judge whether the current singing beat of the user is accurate, for example, if the deviation is large (the deviation value is larger than a preset threshold value) or a plurality of continuous beats deviate from the standard original singing beat, the user can be considered to be unskilled to the current song (the beats are not right, the rhythm sense is poor or the song is unfamiliar), the original singing audio of the current song on demand can be played, and if the original singing audio comprises an accompaniment part and a singing part, the accompaniment audio of the currently played song can be closed; otherwise, if the beat of the current singing of the user is more accurate, the original singing audio frequency for playing the current on-demand song can be closed; and the output proportion of the accompaniment audio and the original singing audio can be controlled according to the size of the deviation value or the occurrence frequency of the continuously collected singing beat information different from the standard original singing beat information. The deviation value of the tone can be determined according to the difference of the musical scales and can also be determined according to the collected sound frequency. The standard original tone can be extracted according to a standard note file of the current on-demand song.
Therefore, in the dynamic vocal accompaniment method in the embodiment, the original vocal accompaniment audio of the current on-demand song is dynamically controlled to be played according to the vocal singing sound information of the user in the playing process of the on-demand song, so that automatic dynamic vocal accompaniment of the user is realized, the user does not need to manually switch the vocal accompaniment mode, and the singing experience of the user is improved.
Fig. 2 is a schematic flow chart of a dynamic vocal accompaniment method in another embodiment of the present invention, as shown in the figure, the dynamic vocal accompaniment method in this embodiment may include:
s201, playing the accompaniment audio of the current on-demand song.
Specifically, the current on-demand song may be a song currently or selected in advance by the user, the accompaniment audio of the current on-demand song may be played by default after the playing is started, and the accompaniment audio and the original singing audio of each song are pre-stored in the dynamic accompaniment device. Optionally, the original singing audio may include an accompaniment part + a singing part, and the accompaniment audio only includes an accompaniment part; in yet another alternative embodiment, the original audio may only include the singing portion, i.e., the original audio and the accompanying audio do not include the overlapping portion.
S202, obtaining singing voice information input by the user through the microphone, where the singing voice information in this embodiment includes a singing volume of the user.
S203, determining whether the singing volume is smaller than a first volume threshold, if so, executing S204, otherwise, executing S205.
If the singing volume of the user collected by the dynamic accompanying device is smaller than the first volume threshold, the user can be judged not to sing (not knowing how to sing, or not remembering the lyrics, or the microphone is out of order, etc.).
And S204, playing the original singing audio of the current on-demand song according to the output volume of the current system.
If the original singing audio comprises the accompaniment part and the singing part, the accompaniment audio of the currently played song can be closed.
S205, determine whether the singing volume is greater than the second volume threshold, if so, execute S206, otherwise execute S207.
The second volume threshold in this embodiment is greater than the first volume threshold. If the singing volume of the user collected by the dynamic vocal accompaniment device is larger than the second volume threshold, the fact that the user sings at present is confident (the original vocal accompaniment is not needed) can be judged.
S206, the original singing audio of the current on-demand song is closed to play.
And S207, controlling the output of the accompaniment audio and the original singing audio according to the output proportion corresponding to the singing volume interval in which the current volume is positioned.
If the singing volume of the user collected by the dynamic accompanying device is between the first volume threshold and the second volume threshold, the fact that the user sings at present is not very confident can be judged, the singing volume interval where the current singing volume is located can be determined in a plurality of preset singing volume intervals, and then the output of the accompaniment audio and the original singing audio is controlled according to the corresponding relation between the output proportion of the preset accompaniment audio and the original singing audio and the singing volume interval, namely the output of the original singing audio is dynamically controlled. An exemplary assumption is that the first volume threshold is a, the second volume threshold is c, where d > a, 2 singing volume intervals are further assumed between a and c, a-b and b-c, the output proportion of the control accompaniment audio corresponding to the singing volume interval a-b and the original singing audio corresponding to the singing volume interval a-b is preset to be 1:2, the output proportion of the control accompaniment audio corresponding to the singing volume interval a-b and the original singing audio corresponding to the singing volume interval a-b is 2:1, and further, if the singing volume of the user currently collected by the dynamic accompanying device is in the a-b singing volume interval, the accompaniment audio and the original singing audio are output according to the system output volume and the proportion of 1:2, that is, the output volume of the original singing audio is 2 times of the accompaniment audio. It should be noted that the above is merely an example, and in other alternative embodiments, more singing volume intervals may be set, or output weights of other accompaniment audio and original singing audio may be set, and the output weights corresponding to the 0-a and c-infinity intervals may be regarded as 1:0 and 0: 1. It should be further noted that the output weight is set under the condition that the original singing audio includes the accompaniment part and the singing part, and if the original singing audio only includes the singing part but not includes the accompaniment part, the setting of the output weight can be adaptively adjusted.
Therefore, in the dynamic vocal accompaniment method in the embodiment, the original vocal accompaniment audio of the current on-demand song is dynamically controlled and played according to the singing volume of the user in the playing process of the on-demand song, so that automatic dynamic vocal accompaniment of the user is realized, the user does not need to manually switch the vocal accompaniment mode, and the singing experience of the user is improved.
Fig. 3 is a schematic flow chart of a dynamic vocal accompaniment method in another embodiment of the present invention, as shown in the figure, the dynamic vocal accompaniment method in this embodiment may include:
s301, playing the accompaniment audio of the current on-demand song.
Specifically, the current on-demand song may be a song currently or selected in advance by the user, the accompaniment audio of the current on-demand song may be played by default after the playing is started, and the accompaniment audio and the original singing audio of each song are pre-stored in the dynamic accompaniment device. Optionally, the original singing audio may include an accompaniment part + a singing part, and the accompaniment audio only includes an accompaniment part; in yet another alternative embodiment, the original audio may only include the singing portion, i.e., the original audio and the accompanying audio do not include the overlapping portion.
S302, obtaining singing voice information input by the user through the microphone, where the singing voice information in this embodiment includes a singing tone of the user.
And S303, comparing the singing tone with the standard original singing tone at the time corresponding to the current on-demand song according to the playing progress time of the current on-demand song to obtain a tone deviation value.
Namely, the tone of singing of the user is compared with the standard original tone to judge whether the tone of singing currently performed by the user is accurate. The standard original tone can be extracted according to a standard note file of the current on-demand song.
And S304, controlling the output proportion of the accompaniment audio and the original singing audio of the current on-demand song according to the tone deviation value.
If the deviation is large (the deviation value is larger than the preset threshold value), or the singing tones acquired for multiple times continuously are different from the standard original singing tones, the user can be considered to be unfamiliar with the current song (tuning away or wrong singing), the original singing audio of the current on-demand song can be played, otherwise, if the tone currently sung by the user is more accurate, the original singing audio of the current on-demand song can be closed. In an alternative embodiment, the output proportion of the accompaniment audio and the original singing audio can be controlled according to the magnitude of the deviation value or the occurrence frequency of the singing tone different from the standard original singing tone, which is continuously collected. The pitch deviation value can be determined according to the scale difference and also can be determined according to the collected sound frequency.
Therefore, in the dynamic vocal accompaniment method in the embodiment, the original vocal accompaniment audio of the current song on demand is dynamically controlled to be played according to whether the vocal tones of the user are accurate or not in the playing process of the song on demand, so that automatic dynamic vocal accompaniment of the user is realized, the user does not need to manually switch vocal accompaniment modes, and the singing experience of the user is improved.
Fig. 4 is a schematic flow chart of a dynamic vocal accompaniment method in another embodiment of the present invention, as shown in the figure, the dynamic vocal accompaniment method in this embodiment may include:
s401, playing the accompaniment audio of the current on-demand song.
Specifically, the current on-demand song may be a song currently or selected in advance by the user, the accompaniment audio of the current on-demand song may be played by default after the playing is started, and the accompaniment audio and the original singing audio of each song are pre-stored in the dynamic accompaniment device. Optionally, the original singing audio may include an accompaniment part + a singing part, and the accompaniment audio only includes an accompaniment part; in yet another alternative embodiment, the original audio may only include the singing portion, i.e., the original audio and the accompanying audio do not include the overlapping portion.
S402, obtaining singing voice information input by the user through the microphone, where the singing voice information in this embodiment includes singing tempo information sung by the user.
And S403, comparing the singing beat information with the standard original singing beat information of the time corresponding to the current on-demand song according to the playing progress time of the current on-demand song to obtain a beat deviation value.
Namely, the singing tempo of the user is compared with the standard original singing tempo to judge whether the current singing tempo of the user is accurate. The standard original tone can be extracted according to a standard note file of the current on-demand song.
And S404, controlling the output proportion of the accompaniment audio and the original singing audio of the current on-demand song according to the beat deviation value.
If the deviation is large (the deviation value is larger than the preset threshold value), or the deviation occurs between the continuous multiple beats and the standard original singing beat, the user can be considered to be unfamiliar with the current song (the beats are not right, namely, the rhythm sense is poor or the song is unfamiliar), the original singing audio of the current on-demand song can be played, otherwise, if the beat currently sung by the user is more accurate, the original singing audio of the current on-demand song can be closed. In an optional embodiment, the output proportion of the accompaniment audio and the original singing audio can be controlled according to the magnitude of the deviation value or the occurrence frequency of the continuously collected singing tempo information different from the standard original singing tempo information. The deviation value of the tone can be determined according to the difference of the musical scales and can also be determined according to the collected sound frequency.
Therefore, in the dynamic vocal accompaniment method in the embodiment, the original vocal accompaniment audio of the current on-demand song is dynamically controlled to be played according to whether the singing tempo of the user is accurate or not in the playing process of the on-demand song, so that automatic dynamic vocal accompaniment of the user is realized, the manual vocal accompaniment mode switching of the user is not needed, and the singing experience of the user is improved.
Fig. 5 is a schematic flow chart of a dynamic vocal accompaniment apparatus according to an embodiment of the present invention, where the dynamic vocal accompaniment apparatus according to the embodiment of the present invention includes:
an accompaniment playing module 510, configured to play an accompaniment audio of a currently requested song;
specifically, the current on-demand song may be a song currently selected or selected in advance by the user, the accompaniment playing module 510 may play the accompaniment audio of the current on-demand song by default after the start of playing, and the dynamic accompaniment device pre-stores the accompaniment audio and the original singing audio of each song. Optionally, the original singing audio may include an accompaniment part + a singing part, and the accompaniment audio only includes an accompaniment part; in yet another alternative embodiment, the original audio may only include the singing portion, i.e., the original audio and the accompanying audio do not include the overlapping portion.
A singing voice acquisition module 520, configured to acquire singing voice information input by a user through a microphone;
specifically, in the process of playing the on-demand song, the singing sound collecting module 520 may collect the singing sound information input by the user through the microphone, where the singing sound information may include the singing volume, the singing tone, or the singing tempo information sung by the user.
And the dynamic accompaniment module 530 is used for controlling and playing the original singing audio frequency of the current on-demand song according to the singing sound information.
Specifically, the dynamic accompaniment module 530 may control to turn on/off the original vocal audio for playing the currently requested song according to the collected vocal sound information of the user, and may also control the output proportion of the accompaniment audio and the original vocal audio of the currently requested song. For example, according to the collected singing sound information of the user, judging that the user sings more proficiently or confidently at present, the original singing audio frequency of the currently requested song can be closed to play, or the output proportion of the original singing audio frequency and the accompaniment audio frequency of the currently requested song is reduced; on the contrary, if the current singing of the user is judged to be unskilled or not confident according to the collected singing sound information of the user, the original singing audio frequency of the current on-demand song can be started to be played, or the output proportion of the original singing audio frequency and the accompaniment audio frequency of the current on-demand song is improved.
For example, in an optional embodiment, the dynamic accompaniment module 530 may determine a singing volume interval where the current singing volume is located in a plurality of preset singing volume intervals, and further control output of the accompaniment audio and the original singing audio according to a corresponding relationship between the preset output proportion of the accompaniment audio and the original singing audio and the singing volume interval and the output proportion corresponding to the singing volume interval where the current singing volume is located. For example, if the singing volume of the user collected by the singing sound collection module 520 is smaller than the first volume threshold, it may be determined that the user is not currently singing (does not know how to sing, or does not remember the lyrics, or the microphone fails, etc.), at this time, the dynamic accompaniment module 530 may play the original singing audio of the currently requested song according to the current system output volume, and if the original singing audio includes the accompaniment part + the singing part, the dynamic accompaniment module 530 may close the accompaniment audio of the currently played song; if the singing volume of the user collected by the singing sound collection module 520 is greater than a second volume threshold, it can be determined that the user is confident to sing currently (without the original singing), and the dynamic vocal accompaniment module 530 can close the original singing audio for playing the currently requested song, wherein the second volume threshold is greater than the first volume threshold; further, if the singing volume of the user collected by the singing sound collection module 520 is between the first volume threshold and the second volume threshold, it can be determined that the user is not confident that the user is currently singing, the dynamic accompaniment module 530 can determine a singing volume interval in which the current singing volume is located among a plurality of preset singing volume intervals, and then control the output of the accompaniment audio and the original singing audio according to the corresponding relationship between the preset output proportion of the accompaniment audio and the original singing audio and the singing volume interval, that is, dynamically control the output of the original singing audio. An exemplary assumption is that the first volume threshold is a, the second volume threshold is c, where d > a, 2 singing volume intervals are further provided between a and c, and a-b and b-c, an output proportion of the control accompaniment audio corresponding to the singing volume interval a-b and the original singing audio is preset to be 1:2, an output proportion of the control accompaniment audio corresponding to the singing volume interval a-b and the original singing audio is 2:1, and if the singing volume of the user currently collected by the singing sound collection module 520 is in the a-b singing volume interval, the dynamic accompaniment module 530 outputs the accompaniment audio and the original singing audio according to the system output volume and the proportion of 1:2, that is, the output volume of the original accompaniment audio is 2 times of the output volume of the accompaniment audio. The output specific gravities corresponding to the intervals 0-a and c-infinity can be regarded as 1:0 and 0: 1. It should be noted that the above is only an example, and in other alternative embodiments, more singing volume intervals may be set, or output weights of other accompaniment audio and original singing audio may be set, and the output weights are set in a case where the original singing audio includes an accompaniment part and a singing part, and if the original singing audio only includes a singing part and does not include an accompaniment part, the setting of the output weights may be adaptively adjusted.
In another alternative embodiment, the dynamic vocal accompaniment module 530 may compare the singing pitch with the standard original singing pitch at the time corresponding to the currently requested song according to the playing progress time of the currently requested song to obtain a pitch deviation value; and controlling the output proportion of the accompaniment audio and the original singing audio of the current on-demand song according to the tone deviation value. Comparing the user singing tone with the standard original singing tone to judge whether the tone currently sung by the user is accurate, for example, if the deviation is large (the deviation value is greater than a preset threshold value) or the singing tones acquired for multiple times continuously are different from the standard original singing tone, the user can be considered to be unskilled (wrong tune or wrong singing) on the current song, the dynamic accompanying module 530 can play the original singing audio of the currently requested song, and if the original singing audio comprises an accompanying part and a singing part, the accompanying audio of the currently played song can be closed; otherwise, if the tone of the current song is more accurate, the dynamic vocal accompaniment module 530 may close the original vocal audio playing the current on-demand song; and the output proportion of the accompaniment audio and the original singing audio can be controlled according to the size of the deviation value or the occurrence frequency of the singing tones which are continuously collected and are different from the standard original singing tones. The deviation value of the tone can be determined according to the difference of the musical scales and can also be determined according to the collected sound frequency. The standard original tone can be extracted according to a standard note file of the current on-demand song.
In another alternative embodiment, the dynamic vocal accompaniment module 530 may compare the singing tempo information with the standard original singing tempo information of the time corresponding to the currently requested song to obtain a tempo deviation value according to the playing progress time of the currently requested song; and controlling the output proportion of the accompaniment audio and the original singing audio of the current on-demand song according to the beat deviation value. That is, the user singing tempo is compared with the standard original singing tempo to determine whether the current singing tempo of the user is accurate, for example, if the deviation is large (the deviation value is greater than the preset threshold value) or a plurality of continuous tempos deviate from the standard original singing tempo, the user can be considered to be unfamiliar with the current song (the tempo is not right or is bad in rhythm sense or is unfamiliar with the song), the dynamic accompaniment module 530 can play the original singing audio of the currently requested song, and if the original singing audio includes an accompaniment part and a singing part, the accompaniment audio of the currently played song can be closed; otherwise, if the tempo of the current song is more accurate, the dynamic vocal accompaniment module 530 may close the original vocal audio playing the current on-demand song; and the output proportion of the accompaniment audio and the original singing audio can be controlled according to the size of the deviation value or the occurrence frequency of the continuously collected singing beat information different from the standard original singing beat information. The deviation value of the tone can be determined according to the difference of the musical scales and can also be determined according to the collected sound frequency. The standard original tone can be extracted according to a standard note file of the current on-demand song.
The dynamic vocal accompaniment apparatus in an alternative embodiment further may comprise:
the singing part determining module 540 is configured to detect whether an original singing part exists in the current playing progress time of the currently requested song, and if so, trigger the dynamic accompanying module to control to play the original singing audio of the currently requested song according to the singing sound information. That is, the dynamic accompaniment module 530 may control to play the original singing audio of the currently requested song according to the singing sound information when the singing portion determining module 540 determines that the current playing schedule time of the currently requested song has the original singing portion, that is, if the current playing schedule time of the currently requested song does not have the original singing portion, the currently requested song is the pure accompaniment portion, the user should not sing at present, so that the original singing audio does not need to be played, and actually, the audio of the original singing portion does not exist at this time (if the original singing audio includes the original singing portion and the accompaniment portion, at this time, the original singing audio is completely consistent with the accompaniment audio, and only the accompaniment audio needs to be played).
Therefore, in the dynamic vocal accompaniment method in the embodiment, the original vocal accompaniment audio of the current on-demand song is dynamically controlled to be played according to the vocal singing sound information of the user in the playing process of the on-demand song, so that automatic dynamic vocal accompaniment of the user is realized, the user does not need to manually switch the vocal accompaniment mode, and the singing experience of the user is improved.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present invention, and it is therefore to be understood that the invention is not limited by the scope of the appended claims.
Claims (10)
1. A dynamic vocal accompaniment method, characterized in that the method comprises:
playing the accompaniment audio of the current on-demand song;
acquiring singing voice information input by a user through a microphone, wherein the singing voice information comprises singing tones;
controlling the original singing audio frequency of the current on-demand song to be played according to the singing sound information comprises the following steps: according to the playing progress time of the current on-demand song, comparing the singing tone with the standard original singing tone at the time corresponding to the current on-demand song to obtain a tone deviation value;
and controlling the output proportion of the accompaniment audio and the original singing audio of the current on-demand song according to the tone deviation value.
2. The dynamic accompaniment method according to claim 1, wherein said vocal sound information further includes vocal volume or vocal tempo information.
3. The dynamic vocal accompaniment method according to claim 2, wherein said vocal sound information is a vocal volume; the controlling the original singing audio frequency of the current on-demand song according to the singing sound information comprises the following steps:
and determining a singing volume interval in which the current singing volume is positioned in a plurality of preset singing volume intervals, and controlling the output of the accompaniment audio and the original singing audio according to the corresponding relation between the output proportion of the preset accompaniment audio and the original singing audio and the singing volume interval and the output proportion corresponding to the singing volume interval in which the current singing volume is positioned.
4. The dynamic vocal accompaniment method according to claim 2, wherein said vocal sound information is vocal tempo information; the controlling the original singing audio frequency of the current on-demand song according to the singing sound information comprises the following steps:
according to the playing progress time of the current on-demand song, comparing the singing beat information with standard original singing beat information of the time corresponding to the current on-demand song to obtain a beat deviation value;
and controlling the output proportion of the accompaniment audio and the original singing audio of the current on-demand song according to the beat deviation value.
5. The dynamic vocal accompaniment method according to any one of claims 1 to 4, wherein said controlling the original vocal audio of the currently on-demand song to be played based on said vocal sound information further comprises:
and determining that the current playing progress time of the current on-demand song has an original singing part.
6. A dynamic vocal accompaniment apparatus, comprising:
the accompaniment playing module is used for playing the accompaniment audio of the current on-demand song;
the singing voice acquisition module is used for acquiring singing voice information input by a user through a microphone, and the singing voice information comprises singing tones;
the dynamic vocal accompaniment module is used for comparing the singing tone with the standard original singing tone at the time corresponding to the current on-demand song according to the playing progress time of the current on-demand song to obtain a tone deviation value;
and the dynamic accompaniment module is also used for controlling the output proportion of the accompaniment audio and the original singing audio of the current on-demand song according to the tone deviation value.
7. The dynamic vocal accompaniment apparatus according to claim 6, wherein said vocal sound information further includes vocal volume or vocal tempo information.
8. The dynamic vocal accompaniment apparatus according to claim 7, wherein said vocal sound information is a vocal volume; the dynamic vocal accompaniment module is used for:
and determining a singing volume interval in which the current singing volume is positioned in a plurality of preset singing volume intervals, and controlling the output of the accompaniment audio and the original singing audio according to the corresponding relation between the output proportion of the preset accompaniment audio and the original singing audio and the singing volume interval and the output proportion corresponding to the singing volume interval in which the current singing volume is positioned.
9. The dynamic vocal accompaniment apparatus according to claim 7, wherein said vocal sound information is vocal tempo information; the dynamic vocal accompaniment module is used for:
according to the playing progress time of the current on-demand song, comparing the singing beat information with standard original singing beat information of the time corresponding to the current on-demand song to obtain a beat deviation value;
and controlling the output proportion of the accompaniment audio and the original singing audio of the current on-demand song according to the beat deviation value.
10. The dynamic vocal accompaniment apparatus according to any one of claims 6 to 9, further comprising:
and the singing part determining module is used for detecting whether the current playing progress time of the current on-demand song has an original singing part or not, and if so, triggering the dynamic accompanying module to control and play the original singing audio frequency of the current on-demand song according to the singing sound information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610089388.6A CN107093419B (en) | 2016-02-17 | 2016-02-17 | Dynamic vocal accompaniment method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610089388.6A CN107093419B (en) | 2016-02-17 | 2016-02-17 | Dynamic vocal accompaniment method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107093419A CN107093419A (en) | 2017-08-25 |
| CN107093419B true CN107093419B (en) | 2020-04-24 |
Family
ID=59648706
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610089388.6A Active CN107093419B (en) | 2016-02-17 | 2016-02-17 | Dynamic vocal accompaniment method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107093419B (en) |
Families Citing this family (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107680571A (en) * | 2017-10-19 | 2018-02-09 | 百度在线网络技术（北京）有限公司 | A kind of accompanying song method, apparatus, equipment and medium |
| CN109905807A (en) * | 2017-12-07 | 2019-06-18 | 北京雷石天地电子技术有限公司 | Intelligence adjusts the method and system of volume output |
| CN110097868A (en) * | 2018-01-29 | 2019-08-06 | 阿里巴巴集团控股有限公司 | Play the methods, devices and systems of music |
| CN108436914A (en) * | 2018-05-04 | 2018-08-24 | 安徽三弟电子科技有限责任公司 | A kind of singing interaction robot control system based on interconnection regulation and control |
| CN108766406A (en) * | 2018-05-15 | 2018-11-06 | 苏州妙文信息科技有限公司 | A kind of mini singing machine of intelligence and sound adjusting method |
| CN109272975B (en) * | 2018-08-14 | 2023-06-27 | 无锡冰河计算机科技发展有限公司 | Automatic adjustment method and device for singing accompaniment and KTV jukebox |
| CN111179890B (en) * | 2018-11-09 | 2022-09-23 | 百度在线网络技术（北京）有限公司 | Voice accompaniment method and device, computer equipment and storage medium |
| CN109410902A (en) * | 2018-11-20 | 2019-03-01 | 福建海媚数码科技有限公司 | A kind of Karaoke based on audio-frequency information, which is intelligently led, sings method and system |
| CN109887521B (en) * | 2019-01-21 | 2020-11-27 | 北京小唱科技有限公司 | Dynamic master tape processing method and device for audio |
| CN109743461B (en) * | 2019-01-29 | 2021-07-02 | 广州酷狗计算机科技有限公司 | Audio data processing method, device, terminal and storage medium |
| US11315585B2 (en) | 2019-05-22 | 2022-04-26 | Spotify Ab | Determining musical style using a variational autoencoder |
| CN110675848B (en) * | 2019-09-30 | 2023-05-30 | 腾讯音乐娱乐科技（深圳）有限公司 | Audio processing method, device and storage medium |
| US11355137B2 (en) | 2019-10-08 | 2022-06-07 | Spotify Ab | Systems and methods for jointly estimating sound sources and frequencies from audio |
| US11366851B2 (en) | 2019-12-18 | 2022-06-21 | Spotify Ab | Karaoke query processing system |
| CN111028618B (en) * | 2019-12-27 | 2022-03-25 | 郑州工程技术学院 | Vocal music singing simulation training platform |
| CN111475672B (en) * | 2020-03-27 | 2023-12-08 | 咪咕音乐有限公司 | Lyric distribution method, electronic equipment and storage medium |
| CN112634939A (en) * | 2020-12-11 | 2021-04-09 | 腾讯音乐娱乐科技（深圳）有限公司 | Audio identification method, device, equipment and medium |
| CN112927666B (en) * | 2021-01-26 | 2023-11-28 | 北京达佳互联信息技术有限公司 | Audio processing method, device, electronic equipment and storage medium |
| CN113470602B (en) * | 2021-06-29 | 2023-09-29 | 广州番禺巨大汽车音响设备有限公司 | Method, device and system for controlling karaoke sound through audio playing |
| CN113473170B (en) * | 2021-07-16 | 2023-08-25 | 广州繁星互娱信息科技有限公司 | Live audio processing method, device, computer equipment and medium |
| CN114466241A (en) * | 2022-01-27 | 2022-05-10 | 海信视像科技股份有限公司 | Display device and audio processing method |
| CN117369759A (en) * | 2022-06-30 | 2024-01-09 | 腾讯科技（深圳）有限公司 | Song playing method, song playing device, computer equipment and computer readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010256425A (en) * | 2009-04-21 | 2010-11-11 | Daiichikosho Co Ltd | Karaoke device for automatically changing key, when person sings whose gender is different from original singer |
| CN202871290U (en) * | 2012-09-27 | 2013-04-10 | 比亚迪股份有限公司 | Apparatus for automatic switching of original singing and vocal accompaniment of karaoke equipment |
| CN202905151U (en) * | 2012-09-27 | 2013-04-24 | 惠州比亚迪实业有限公司 | Original/accompaniment automatic switching device applied to karaoke device |
| CN103259931A (en) * | 2013-04-25 | 2013-08-21 | 广东欧珀移动通信有限公司 | Switching method and device based on singing mode of mobile-phone music player |
| CN104538011A (en) * | 2014-10-30 | 2015-04-22 | 华为技术有限公司 | Tone adjusting method and device and terminal device |
-
2016
- 2016-02-17 CN CN201610089388.6A patent/CN107093419B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010256425A (en) * | 2009-04-21 | 2010-11-11 | Daiichikosho Co Ltd | Karaoke device for automatically changing key, when person sings whose gender is different from original singer |
| CN202871290U (en) * | 2012-09-27 | 2013-04-10 | 比亚迪股份有限公司 | Apparatus for automatic switching of original singing and vocal accompaniment of karaoke equipment |
| CN202905151U (en) * | 2012-09-27 | 2013-04-24 | 惠州比亚迪实业有限公司 | Original/accompaniment automatic switching device applied to karaoke device |
| CN103259931A (en) * | 2013-04-25 | 2013-08-21 | 广东欧珀移动通信有限公司 | Switching method and device based on singing mode of mobile-phone music player |
| CN104538011A (en) * | 2014-10-30 | 2015-04-22 | 华为技术有限公司 | Tone adjusting method and device and terminal device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107093419A (en) | 2017-08-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107093419B (en) | Dynamic vocal accompaniment method and device | |
| US8158871B2 (en) | Audio recording analysis and rating | |
| KR20060112633A (en) | System and method for grading singing data | |
| JP2006195385A (en) | Device and program for music reproduction | |
| JP2015069082A (en) | Information processing device, data generation method and program | |
| JP4487209B2 (en) | Karaoke device and karaoke processing program | |
| JP2005107333A (en) | Karaoke machine | |
| CN112669811B (en) | Song processing method and device, electronic equipment and readable storage medium | |
| JP6288197B2 (en) | Evaluation apparatus and program | |
| JP6102076B2 (en) | Evaluation device | |
| JP4491743B2 (en) | Karaoke equipment | |
| JP6098422B2 (en) | Information processing apparatus and program | |
| WO2019180830A1 (en) | Singing evaluating method, singing evaluating device, and program | |
| CN112309351A (en) | Song generation method and device, intelligent terminal and storage medium | |
| JP4170279B2 (en) | Lyric display method and apparatus | |
| CN113781989A (en) | Audio animation playing and rhythm stuck point identification method and related device | |
| JP6380305B2 (en) | Data generation apparatus, karaoke system, and program | |
| JP2005107332A (en) | Karaoke machine | |
| JP6144593B2 (en) | Singing scoring system | |
| JP2017181661A (en) | Support device | |
| JP6083400B2 (en) | Music selection device and music selection program | |
| JP6144592B2 (en) | Singing scoring system | |
| JP5703555B2 (en) | Music signal processing apparatus and program | |
| JP2005107335A (en) | Karaoke machine | |
| JP2011197564A (en) | Electronic music device and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 510000 Guangzhou City, Guangzhou, Guangdong, Whampoa Avenue, No. 315, self - made 1-17 Applicant after: Guangzhou KuGou Networks Co., Ltd. Address before: 510000 Guangzhou, Tianhe District branch Yun Yun Road, No. 16, self built room 2, building 1301 Applicant before: Guangzhou KuGou Networks Co., Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |