CN111966319A - Audio control method, device, system, storage medium and terminal - Google Patents

Audio control method, device, system, storage medium and terminal Download PDF

Info

Publication number
CN111966319A
CN111966319A CN202010684268.7A CN202010684268A CN111966319A CN 111966319 A CN111966319 A CN 111966319A CN 202010684268 A CN202010684268 A CN 202010684268A CN 111966319 A CN111966319 A CN 111966319A
Authority
CN
China
Prior art keywords
heart rate
audio
current
value
speed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010684268.7A
Other languages
Chinese (zh)
Other versions
CN111966319B (en
Inventor
许飞
桑耀
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhuhai Jieli Technology Co Ltd
Original Assignee
Zhuhai Jieli Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhuhai Jieli Technology Co Ltd filed Critical Zhuhai Jieli Technology Co Ltd
Priority to CN202010684268.7A priority Critical patent/CN111966319B/en
Publication of CN111966319A publication Critical patent/CN111966319A/en
Application granted granted Critical
Publication of CN111966319B publication Critical patent/CN111966319B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/165Management of the audio stream, e.g. setting of volume, audio stream path
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024Detecting, measuring or recording pulse rate or heart rate
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/7405Details of notification to user or communication with user or patient ; user input means using sound

Abstract

The application relates to an audio control method, device, system, storage medium and terminal. The method comprises the following steps: confirming an audio rate mapping relation, and acquiring each heart rate value of a current time window and the maximum difference value between the heart rate values; the audio rate mapping relation comprises a corresponding relation between a heart rate interval and a playing speed; under the condition that the maximum difference value is smaller than the difference value threshold value, determining an average heart rate value of a current time window and a current heart rate interval corresponding to the current playing speed, and if the average heart rate value falls into the heart rate interval except the current heart rate interval, adjusting the current playing speed to the corresponding playing speed; the audio is adjusted according to the adjusted current playing multiple speed, and the audio is output, so that the audio playing speed can be adaptively adjusted according to the current state of a user, the current activity efficiency is improved, meanwhile, the audio can be prevented from being switched, and the playing stability can be improved.

Description

Audio control method, device, system, storage medium and terminal
Technical Field
The present application relates to the field of mobile terminal technologies, and in particular, to an audio control method, apparatus, system, storage medium, and terminal.
Background
With the development of mobile terminal accessories, bluetooth headsets have become one of the widely used consumer electronics products, and meanwhile, the demands of users are continuously increasing. In different use scenes, the bluetooth headset needs to adjust the playing speed and rhythm of the currently played audio, such as low speed, high speed and the like. If the user is in the input state, for example, the current work is full of enthusiasm, the heart rate is faster at the moment, the perception to the outside world and the corresponding speed are faster, and the work efficiency can be effectively improved by matching with the music with the faster rhythm speed. If the user is in a relaxed state, for example, during a reading period in idle, music with a moderate rhythm is output to the user at the moment, so that the current state of the user is not negatively affected, and the user can enjoy audio. In addition, during the exercise, most users are used to listen to audio played by a mobile phone end, such as songs, by wearing a bluetooth headset, and need fast-paced music during fast running and slow-paced music during slow running.
According to the traditional technology, the heart rate can be detected through a motion sensor at the earphone end, and the threshold range of the heart rate is judged, so that music with fast or slow rhythm can be switched, and the more efficient motion requirements of users are met. However, the conventional method frequently switches the played audio, and has the problem of poor playing stability.
Disclosure of Invention
Accordingly, it is necessary to provide an audio control method, apparatus, system, storage medium, and terminal capable of improving the playing stability in view of the problem of poor playing stability in the conventional technology.
An audio control method, the method comprising:
confirming an audio rate mapping relation, and acquiring each heart rate value of a current time window and the maximum difference value between the heart rate values; the audio rate mapping relation comprises a corresponding relation between a heart rate interval and a playing speed;
under the condition that the maximum difference value is smaller than the difference value threshold value, determining an average heart rate value of a current time window and a current heart rate interval corresponding to the current playing speed, and if the average heart rate value falls into the heart rate interval except the current heart rate interval, adjusting the current playing speed to the corresponding playing speed;
and adjusting the audio according to the adjusted current playing multiple speed, and outputting the audio.
In one embodiment, the method further comprises the following steps:
and if the average heart rate value falls into the current heart rate interval, keeping the current playing speed constant.
In one embodiment, the step of validating the audio rate mapping relationship comprises:
at the initial moment, acquiring the heart rate change rate and the heart rate change amplitude, estimating the heart rate change range according to the heart rate change rate and the heart rate change amplitude, and selecting an audio rate mapping relation matched with the heart rate change range.
In one embodiment, the step of confirming the audio rate mapping relationship further comprises:
and under the condition that any heart rate value is larger than the upper limit value of the heart rate variation range or smaller than the lower limit value of the heart rate variation range, reselecting the audio rate mapping relation.
In one embodiment, the method further comprises the following steps:
and outputting a reminding audio under the condition that the current playing speed is the maximum playing speed and the average heart rate value falls into the maximum heart rate interval.
An audio control device, the device comprising:
the heart rate value acquisition module is used for confirming the audio rate mapping relation and acquiring the maximum difference value between each heart rate value of the current time window and each heart rate value; the audio rate mapping relation comprises a corresponding relation between a heart rate interval and a playing speed;
the current playing double-speed confirming module is used for determining the average heart rate value of the current time window and the current heart rate interval corresponding to the current playing double-speed under the condition that the maximum difference value is smaller than the difference value threshold value, and if the average heart rate value falls into the heart rate interval except the current heart rate interval, adjusting the current playing double-speed to the corresponding playing double-speed;
and the audio adjusting module is used for adjusting the audio according to the adjusted current playing speed and outputting the audio.
A terminal comprising a processor which, when executing a computer program, performs the steps of the audio control method of any of the above embodiments.
In one embodiment, the system further comprises a first communication circuit electrically connected to the processor; the first communication circuit is used for being in communication connection with the earphone.
An audio control system comprising an earphone and a terminal as in any of the above embodiments; the terminal is in communication connection with the earphone;
the earphone is used for playing the received audio and sending the acquired real-time heart rate value to the terminal.
A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the audio control method of any of the above embodiments.
According to the audio control method, the device, the system, the storage medium and the terminal, the maximum difference value between each heart rate value of the current time window and each heart rate value is obtained by confirming the audio rate mapping relation; the audio rate mapping relation comprises a corresponding relation between a heart rate interval and a playing speed; under the condition that the maximum difference value is smaller than the difference value threshold value, determining an average heart rate value of a current time window and a current heart rate interval corresponding to the current playing speed, and if the average heart rate value falls into the heart rate interval except the current heart rate interval, adjusting the current playing speed to the corresponding playing speed; the audio is adjusted according to the adjusted current playing multiple speed, and the audio is output, so that the audio playing speed can be adaptively adjusted according to the current state of a user, the current activity efficiency is improved, meanwhile, the audio can be prevented from being switched, and the playing stability can be improved.
Drawings
FIG. 1 is a first flowchart of an exemplary audio control method;
FIG. 2 is a schematic diagram of a time window in one embodiment;
FIG. 3 is a first heart rate value detection diagram in one embodiment;
FIG. 4 is a second heart rate value detection diagram in one embodiment;
FIG. 5 is a second flowchart of an audio control method according to an embodiment;
FIG. 6 is a block diagram showing the structure of an audio control device according to an embodiment;
FIG. 7 is an internal block diagram of a terminal in one embodiment;
fig. 8 is a schematic block diagram of an audio control system in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
Just as background art, the conventional art detects the heart rate through the motion sensor at the earphone end, judges the threshold range of the heart rate, switches music with fast or slow rhythm according to the judgment result, meets the more efficient exercise requirement of the user, and in the using process, the conventional art can frequently switch playing audio, so that the problem of poor playing stability in the conventional art is caused. Meanwhile, the conventional technology mainly aims at the exercise requirements of users to achieve efficient exercise, but if non-exercise scenes such as office and study occasions are considered, poor user experience can be generated by switching the currently played audio.
According to the scheme, the audio playing speed can be adaptively adjusted according to the current state of the user, the audio switching can be avoided while the current activity efficiency is improved, the playing stability can be improved, and the experience of the user is improved.
In one embodiment, as shown in fig. 1, an audio rate control method is provided, and this embodiment is illustrated by applying the method to a terminal, and it is to be understood that the method may also be applied to a server, and may also be applied to a system including a terminal and a server, and is implemented by interaction between the terminal and the server. In this embodiment, the method includes the steps of:
step 110, confirming an audio rate mapping relation, and acquiring each heart rate value of a current time window and the maximum difference value between the heart rate values; the audio rate mapping relationship comprises a corresponding relationship between a heart rate interval and a playing speed.
The audio rate mapping relation comprises a corresponding relation between a heart rate interval and a playing speed, and in different audio rate mapping relations, the same heart rate interval can correspond to the same or different playing speeds. Further, the audio rate mapping relationship may be generated in advance.
The playback speed may be used to indicate the playback rate of the audio, and the heart rate interval may include one or more heart rate values and may or may not include boundary values. For example, if the playing speed is 0.9 times, it may indicate that the audio needs to be played at 0.9 times, and if the heart rate interval is 121 times to 125 times, the heart rate interval may include 121 times and 125 times, or only include 122 times, 123 times, and 124 times. The playing speed can be confirmed through the heart rate interval in which the heart rate value falls, or the heart rate interval in which the current heart rate value falls can be confirmed through the current playing speed.
The current time window may be an observation window in which the current time is located, and each heart rate value of the current time window may be each heart rate value obtained within a period of duration. For example, if the current time is time t0 and the duration is Δ t, the current time window may be [ t0, t0 +. DELTA.t ], [ t 0-. DELTA.t, t0], or (t 0-0.5. DELTA.t, t0+ 0.5. DELTA.t), etc. It should be noted that the duration may be determined according to the actual situation and the application requirement, and the current time window is not limited to the above situation, and only needs to include the current time.
The current time window may include a plurality of heart rate values, e.g., 3, 5, 6, or 8, etc., and in one example, the current time window may include 10 heart rate values. The number of heart rate values in the current time window and the number of heart rate values in the next time window may be the same, and each heart rate value may be partially overlapped or not overlapped; or the duration of any two time windows may be the same, e.g., the length of time of any one time window may be 10s (seconds).
In one example, the heart rate values within the current time window may partially coincide with the heart rate values within the next time window, as shown in fig. 2, the first time window comprising heart rate values a 1-a 10 (10 total), the second time window comprising heart rate values a 2-a 11 (10 total), the third time window comprising heart rate values A3-a 12 (10 total).
Specifically, the terminal may receive data sent by other devices to obtain a heart rate value of the current time window, for example, a heart rate value sent by a headset may be received, or a heart rate value transmitted by a server may be received. Further, taking the case that the earphone collects the heart rate value as an example, the earphone is used for transmitting the currently collected heart rate value to the terminal, the terminal can sequence the heart rate values according to the receiving time/sending time of the heart rate values, and the heart rate values corresponding to the sequence numbers between the start sequence number and the end sequence number are obtained by determining the start sequence number and the end sequence number (or the start time and the end time) of the current time window, so that the heart rate values of the current time window can be obtained. Or the terminal can generate the corresponding relation between each heart rate value and the receiving time and acquire each heart rate value of the receiving time in the current time window.
After obtaining the heart rate values of the current time window, a maximum difference value between the heart rate values of the current time window is obtained, that is, the maximum difference value may be a difference value between the maximum heart rate value and the minimum heart rate value in the heart rate values of the current time window.
And step 120, determining an average heart rate value of the current time window and a current heart rate interval corresponding to the current playing speed multiplier under the condition that the maximum difference value is smaller than the difference threshold, and adjusting the current playing speed multiplier to the corresponding playing speed multiplier if the average heart rate value falls into the heart rate interval except the current heart rate interval.
Specifically, when the maximum difference is smaller than the difference threshold, an average heart rate value of the current time window, that is, an average value of each heart rate value in the current time window, and a heart rate interval corresponding to the current playing double speed in the audio rate mapping relationship are calculated, and the heart rate interval corresponding to the current playing double speed is determined as the current heart rate interval. And determining which heart rate interval in the audio rate mapping relation the average heart rate value falls into, and determining the heart rate interval in which the average heart rate value falls as the target heart rate interval. And if the target heart rate interval is not the current heart rate interval, adjusting the current playing speed to be the playing speed corresponding to the target heart rate interval.
When the maximum difference is larger than or equal to the difference threshold, the current playing speed can be kept unchanged until the maximum difference of the current time window is smaller than the difference threshold, and whether the current playing speed is adjusted or not is judged according to the average heart rate value. It should be noted that, in the present application, the difference threshold may be determined according to actual situations and design requirements, and the present application does not specifically limit this. In one example, the difference threshold may be 5 times per minute.
And step 130, adjusting the audio according to the adjusted current playing multiple speed, and outputting the audio.
The audio includes, but is not limited to, broadcast audio, song audio, and/or listening book audio, and further, the audio may not include real-time call audio.
Specifically, under the condition that the current playing speed is confirmed, the terminal can adjust the playing speed of the audio according to the updated current playing speed, and output the adjusted audio to the audio playing device, such as an earphone, a loudspeaker and the like, so as to provide the adjusted audio for the user. For example, if the current playing speed is 1.5 times, the terminal may adjust the audio to 1.5 times playing and output the 1.5 times played audio to the user.
In the audio control method, the maximum difference value between each heart rate value of the current time window and each heart rate value is obtained by confirming the audio rate mapping relation; the audio rate mapping relation comprises a corresponding relation between a heart rate interval and a playing speed; under the condition that the maximum difference value is smaller than the difference value threshold value, determining an average heart rate value of a current time window and a current heart rate interval corresponding to the current playing speed, and if the average heart rate value falls into the heart rate interval except the current heart rate interval, adjusting the current playing speed to the corresponding playing speed; the audio is adjusted according to the adjusted current playing multiple speed, and the audio is output, so that the audio playing speed can be adaptively adjusted according to the current state of a user, the current activity efficiency is improved, meanwhile, the audio can be prevented from being switched, and the playing stability can be improved.
In one embodiment, the audio control method further comprises the steps of:
and if the average heart rate value falls into the current heart rate interval, keeping the current playing speed constant.
Specifically, if the target heart rate interval in which the average heart rate value of the current time window falls is the current heart rate interval, the current playing speed is kept unchanged, and the audio is played according to the original playing speed.
For example, the determined audio rate mapping relationship may be as follows:
first heart rate interval: the heart rate is 75-80 times/time-sharing, and the speed of 0.5 time is selected to play the audio;
second heart rate interval: the heart rate is 81-85 times/time-sharing, and the speed of 0.8 times is selected to play audio;
the third heart rate interval: the heart rate is 86-90 times/time-sharing, and the speed of 0.9 time is selected to play audio;
a fourth heart rate interval: the heart rate is 91-95 times/time-sharing, and the speed of 1.0 time is selected to play audio;
a fifth heart rate interval: the heart rate is 96-100 times/time, and the speed of 1.05 times is selected to play audio;
a sixth heart rate interval: the heart rate is 101-;
a seventh heart rate interval: the heart rate is 111-;
eighth heart rate interval: the heart rate is 116-;
ninth heart rate interval: the heart rate is 121-;
tenth heart rate interval: the heart rate is 126-;
the duration of the current time window is 10s, the number of heart rate values is 10, and the difference threshold is 5 times/minute. In one example, as shown in fig. 3, if the current playback speed is 0.9 times playback, the current time window is the fifth time window. And in the current time window, the maximum difference value is 4/min and is smaller than the difference threshold value, the average value of all the heart rate values of the fifth time window is calculated to be 90.2, if the heart rate values are not integers, rounding is carried out on the heart rate values, and the average heart rate value of the fifth time window is confirmed to be 90.
At this time, the average heart rate value in the current time window falls into a heart rate interval of 86-90 times/minute, namely a third heart rate interval, the playing speed corresponding to the third heart rate interval is 0.9, and is the same as the current playing speed which is 0.9 times, the playing speed of the current audio is not changed, the next time window is determined as the current time window (namely, the sixth time window is determined as the current time window), and the average heart rate value is calculated.
In the sixth time window, the average of the 10 heart rate values calculated is 90.6, if not an integer, it is rounded off, and 91 is taken as the average heart rate value of the sixth time window. And confirming that the average heart rate value of the current time window falls into an interval of 91-95 times/minute, namely a fourth heart rate interval, wherein the playing speed corresponding to the fourth heart rate interval is 1.0 and is not consistent with the current playing speed which is 0.9 times, adjusting the current playing speed to be 1.0 times, playing the audio at the speed which is 1.0 times, and calculating the average heart rate value of the next time window.
In another example, if the current playback speed is 1.2 times playback, the current time window is the tenth time window. As shown in fig. 4, if the average value of the heart rate values in the tenth time window is 110.5 and is not an integer, the values are rounded up and 111 is determined to be the average heart rate value in the fifth time window. At this time, the average heart rate value in the current time window falls into the heart rate interval of 111-.
In the eleventh time window, the average heart rate value of 10 heart rate values is calculated to be 110, the average heart rate value in the current time window is determined to belong to a 95-110 times/minute interval, namely a sixth heart rate interval, the playing speed corresponding to the sixth heart rate interval is 1.1, and is not consistent with the current playing speed which is 1.2 times, the current playing speed is adjusted to be 1.1 times, and the audio is played at the speed which is 1.1 times. Calculating the average heart rate value of the next time window;
it should be noted that, because the heart rate values detected by different heart rate detection devices are different in number, 8 heart rate values can be detected within 10 seconds, and 10 heart rate values can also be obtained, that is, the current time window can be fixed in duration and the number of the heart rate values is variable in the present application.
According to the audio rate control method, if the average heart rate value falls into the current heart rate interval, the current playing speed is kept unchanged, so that the frequency switching of the playing speed can be avoided, the playing stability can be further improved, and the experience and the working efficiency of a user are improved.
In one embodiment, the step of validating the audio rate mapping relationship comprises:
at the initial moment, acquiring the heart rate change rate and the heart rate change amplitude, estimating the heart rate change range according to the heart rate change rate and the heart rate change amplitude, and selecting an audio rate mapping relation matched with the heart rate change range.
The initial time may be a time when the earphone is switched from the detached state to the worn state, or a time when the user uses the earphone for the first time. For example, the time of wearing the earphone each time can be respectively confirmed as the initial time, and the same user can reselect the audio rate mapping relation each time wearing the earphone; or the time when the user wears the earphone for use for the first time is confirmed as the initial time, and the same user can only select the audio rate mapping relation once in multiple uses.
In particular, the rate of heart rate change and the amplitude of heart rate change may be detected by the headset. And the terminal estimates the heart rate variation range of the user according to the received heart rate variation rate and the heart rate variation amplitude, and selects a matched audio rate mapping relation according to the estimated heart rate variation range. Further, the audio rate mapping relationship may be reset according to a heart rate variation range redetected by the user, and when the headset is serving a different user, a new audio rate mapping relationship may be redetected and backed up by resetting the audio rate mapping relationship.
For example, the first set of audio rate maps can be found in the above embodiments with heart rate ranges of 75-130 beats/minute. The second set of audio rate mapping relationships may have a range of heart rate variation of 60-150 beats/minute, as shown below:
first heart rate interval: the heart rate is 60-75 times/time, and 0.5 time of rate is selected to play audio;
second heart rate interval: the heart rate is 76-80 times/time-sharing, and the speed of 0.8 times is selected to play audio;
the third heart rate interval: the heart rate is 81-85 times/time-sharing, and the speed of 0.9 time is selected to play audio;
a fourth heart rate interval: the heart rate is 86-95 times/time-sharing, and the speed of 1.0 time is selected to play audio;
a fifth heart rate interval: the heart rate is 96-100 times/time, and the speed of 1.05 times is selected to play audio;
a sixth heart rate interval: the heart rate is 101-;
a seventh heart rate interval: the heart rate is 111-;
eighth heart rate interval: the heart rate is 111-;
ninth heart rate interval: the heart rate is 121-;
tenth heart rate interval: the heart rate is 136-;
eleventh heart rate interval: the heart rate is 141-145 times/time-sharing, and the speed of 1.4 times is selected to play the audio;
twelfth heart rate interval: the heart rate is 146-.
At the initial moment, the heart rate change rate and the heart rate change amplitude can be recorded through the earphone, the heart rate change range of the user is estimated to be 75-130 times/min according to the heart rate change rate and the heart rate change amplitude, and then the first set of audio rate mapping relation can be selected as the corresponding audio rate mapping relation. If the estimated heart rate variation range is 60-150/min, the second set of audio rate maps can be used as the corresponding audio rate maps.
According to the audio rate control method, the heart rate change range is determined according to the heart rate change rate and the heart rate change amplitude which are obtained at the initial moment, and the audio rate mapping relation matched with the heart rate change range is selected as the corresponding audio rate mapping relation, so that the audio rate mapping relation is more in line with the user requirements, the matching degree of rate adjustment is improved, and the user experience is further improved.
In one embodiment, the step of confirming the audio rate mapping relationship further comprises:
and under the condition that any heart rate value is larger than the upper limit value of the heart rate variation range or smaller than the lower limit value of the heart rate variation range, reselecting the audio rate mapping relation.
Specifically, an upper limit value and/or a lower limit value of the heart rate variation range may be obtained according to the determined audio rate mapping relationship, where the upper limit value or the lower limit value may be determined according to the heart rate variation range, and the upper limit value may be, for example, a maximum heart rate value in the heart rate variation range, or a sum of the maximum heart rate value in the heart rate variation range and a preset value. Similarly, the lower limit value may be the minimum heart rate value in the heart rate variation range, or the difference between the minimum heart rate value and the preset value in the heart rate variation range.
For example, in the above embodiment, the heart rate of the first set of audio rate maps ranges from 75 to 130 beats/minute, the minimum heart rate value is 75 beats/minute, the maximum heart rate value is 130 beats/minute, the upper limit value may be 135 (the sum of 130 and the preset value of 5), and the lower limit value may be 70 (the difference between 75 and the preset value of 5).
And re-determining the audio rate mapping relation under the condition that the heart rate value detected in real time is larger than the upper limit value or smaller than the lower limit value. Further, a heart rate change interval can be estimated according to the heart rate change rate and the heart rate change amplitude which are detected again, and the corresponding audio rate mapping relation is selected again according to the heart rate change interval.
In the above audio control method, when any heart rate value is greater than the upper limit value of the heart rate variation range or less than the lower limit value of the heart rate variation range, the current audio rate mapping relationship is adaptively adjusted, and whether the current playing rate follows the current audio rate mapping relationship is further determined.
In one embodiment, the method further comprises the steps of:
and outputting a reminding audio under the condition that the current playing speed is the maximum playing speed and the average heart rate value falls into the maximum heart rate interval.
Specifically, in the present application, if the current playing speed is the maximum playing speed (e.g. 1.5 speed), the audio is continuously output at the maximum playing speed, and the average heart rate value of the current time window is continuously maintained in the maximum heart rate interval, it may be determined that the user has reached the maximum heart rate limit of the user, and at this time, a reminding audio is output to the earphone, so as to remind the user. Further alerting the audio may alert the user to make a reasonable movement.
To facilitate understanding of the solution of the present application, the following description is made by way of specific example, and as shown in fig. 5, there is provided an audio control method including the steps of:
and step 510, at an initial moment, estimating a heart rate variation range according to the acquired heart rate variation rate and the acquired heart rate variation amplitude.
And step 520, selecting a corresponding audio rate mapping relation according to the heart rate variation range.
At step 530, all heart rate values within the current time window are obtained.
In step 540, it is determined whether the maximum difference of the current time window is smaller than the difference threshold, if yes, step 550 is performed, and if not, step 580 is performed.
Step 550, determining the average heart rate value of the current time window and the current heart rate interval corresponding to the current playing speed.
Step 560, determine whether the average heart rate value falls within a heart rate interval other than the current heart rate interval, if yes, go to step 570, otherwise, go to step 580.
Step 570, adjusting the current playing speed to the corresponding playing speed.
Step 580, keeping the current playing multiple speed unchanged.
And adjusting the current playing multiple speed according to the currently selected audio rate mapping relation, and ending.
It should be understood that although the various steps in the flow charts of fig. 1-5 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 1-5 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed in turn or alternately with other steps or at least some of the other steps.
In one embodiment, as shown in fig. 6, there is provided an audio control apparatus including:
the heart rate value acquisition module is used for confirming the audio rate mapping relation and acquiring the maximum difference value between each heart rate value of the current time window and each heart rate value; the audio rate mapping relation comprises a corresponding relation between a heart rate interval and a playing speed;
the current playing double-speed confirming module is used for determining the average heart rate value of the current time window and the current heart rate interval corresponding to the current playing double-speed under the condition that the maximum difference value is smaller than the difference value threshold value, and if the average heart rate value falls into the heart rate interval except the current heart rate interval, adjusting the current playing double-speed to the corresponding playing double-speed;
and the audio adjusting module is used for adjusting the audio according to the adjusted current playing speed and outputting the audio.
In an embodiment, the current playing speed determining module is further configured to keep the current playing speed unchanged if the average heart rate value falls within the current heart rate interval.
In an embodiment, the heart rate value obtaining module is further configured to obtain a heart rate variation rate and a heart rate variation amplitude at an initial time, estimate a heart rate variation range according to the heart rate variation rate and the heart rate variation amplitude, and select an audio rate mapping relationship matched with the heart rate variation range.
In an embodiment, the heart rate value obtaining module is further configured to reselect the audio rate mapping relationship when any one of the heart rate values is greater than an upper limit value of the heart rate variation range or smaller than a lower limit value of the heart rate variation range.
In one embodiment, the apparatus further comprises: and the reminding audio output module is used for outputting the reminding audio under the condition that the current playing speed is the maximum playing speed and the average heart rate value falls into the maximum heart rate interval.
For specific limitations of the audio control device, reference may be made to the above limitations of the audio control method, which are not described herein again. The respective modules in the audio control device may be implemented wholly or partially by software, hardware, and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a terminal is provided comprising a processor which, when executing a computer program, performs the steps of the method described in any of the above embodiments.
Specifically, the internal structure of the terminal may be as shown in fig. 7. The terminal comprises a processor, a memory, a communication interface, a display screen and an input device which are connected through a system bus. Wherein the processor of the terminal is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the terminal is used for carrying out wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, an operator network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement an audio control method.
Those skilled in the art will appreciate that the architecture shown in fig. 7 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, further comprising a first communication circuit electrically connected to the processor; the first communication circuit is used for being in communication connection with the earphone.
Wherein, the earphone can be a Bluetooth earphone.
In particular, the terminal may include a first communication circuit for communicative connection with an ear piece and electrically connected to the processor. The terminal can receive data transmitted by the earphone through the first communication circuit, such as a heart rate value, a heart rate change rate, a heart rate change amplitude and the like.
Further, the terminal may also include an audio rate control circuit electrically connected to the processor. The terminal can adjust the audio frequency according to the current playing speed multiplication through the audio frequency rate control circuit, and sends the adjusted audio frequency to the earphone through the first communication circuit, so that the earphone can play the audio frequency corresponding to the speed multiplication according to the audio frequency data sent by the terminal.
In one embodiment, as shown in fig. 8, there is provided an audio control system comprising a headset and a terminal as in any of the above embodiments; the terminal is in communication connection with the earphone;
the earphone is used for playing the received audio and sending the acquired real-time heart rate value to the terminal.
Specifically, the earphone can be used for monitoring a real-time heart rate value of a user and sending the real-time heart rate value to the terminal, and can also be used for receiving and playing audio data sent by the terminal. Specifically, the earphone may include a heart rate monitoring circuit, an earphone processor, an audio playing circuit, and a second communication unit, the earphone processor is electrically connected to the heart rate monitoring circuit, the audio playing circuit, and the second communication circuit, respectively, and the second communication circuit is communicatively connected to the first communication circuit.
Further, the number of earphones in the audio control system may be one or at least two, and in one example, the number of earphones may be two, and the structure of each earphone may be the same.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of:
confirming an audio rate mapping relation, and acquiring each heart rate value of a current time window and the maximum difference value between the heart rate values; the audio rate mapping relation comprises a corresponding relation between a heart rate interval and a playing speed;
under the condition that the maximum difference value is smaller than the difference value threshold value, determining an average heart rate value of a current time window and a current heart rate interval corresponding to the current playing speed, and if the average heart rate value falls into the heart rate interval except the current heart rate interval, adjusting the current playing speed to the corresponding playing speed;
and adjusting the audio according to the adjusted current playing multiple speed, and outputting the audio.
In one embodiment, the computer program when executed by the processor further performs the steps of: and if the average heart rate value falls into the current heart rate interval, keeping the current playing speed constant.
In one embodiment, the computer program when executed by the processor further performs the steps of:
at the initial moment, acquiring the heart rate change rate and the heart rate change amplitude, estimating the heart rate change range according to the heart rate change rate and the heart rate change amplitude, and selecting an audio rate mapping relation matched with the heart rate change range.
In one embodiment, the computer program when executed by the processor further performs the steps of:
and under the condition that any heart rate value is larger than the upper limit value of the heart rate variation range or smaller than the lower limit value of the heart rate variation range, reselecting the audio rate mapping relation.
In one embodiment, the computer program when executed by the processor further performs the steps of:
and outputting a reminding audio under the condition that the current playing speed is the maximum playing speed and the average heart rate value falls into the maximum heart rate interval.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (10)

1. An audio control method, characterized in that the method comprises:
confirming an audio rate mapping relation, and acquiring each heart rate value of a current time window and the maximum difference value between the heart rate values; the audio rate mapping relation comprises a corresponding relation between a heart rate interval and a playing speed;
under the condition that the maximum difference value is smaller than a difference value threshold value, determining an average heart rate value of the current time window and a current heart rate interval corresponding to the current playing double speed, and if the average heart rate value falls into the heart rate interval except the current heart rate interval, adjusting the current playing double speed to the corresponding playing double speed;
and adjusting the audio according to the adjusted current playing speed, and outputting the audio.
2. The audio control method according to claim 1, further comprising:
and if the average heart rate value falls into the current heart rate interval, keeping the current playing speed constant.
3. The audio control method of claim 1, wherein the step of validating the audio rate map comprises:
at the initial moment, acquiring a heart rate change rate and a heart rate change amplitude, estimating a heart rate change range according to the heart rate change rate and the heart rate change amplitude, and selecting the audio rate mapping relation matched with the heart rate change range.
4. The audio control method of claim 3, wherein the step of confirming the audio rate mapping relationship further comprises:
and under the condition that any heart rate value is larger than the upper limit value of the heart rate variation range or smaller than the lower limit value of the heart rate variation range, reselecting the audio rate mapping relation.
5. The audio control method according to claim 1, further comprising the steps of:
and outputting a reminding audio under the condition that the current playing speed is the maximum playing speed and the average heart rate value falls into the maximum heart rate interval.
6. An audio control apparatus, characterized in that the apparatus comprises:
the heart rate value acquisition module is used for confirming an audio rate mapping relation and acquiring each heart rate value of a current time window and the maximum difference value between the heart rate values; the audio rate mapping relation comprises a corresponding relation between a heart rate interval and a playing speed;
a current playing double-speed confirming module, configured to determine an average heart rate value of the current time window and a current heart rate interval corresponding to the current playing double-speed when the maximum difference value is smaller than a difference threshold value, and adjust the current playing double-speed to a corresponding playing double-speed if the average heart rate value falls into a heart rate interval other than the current heart rate interval;
and the audio adjusting module is used for adjusting the audio according to the adjusted current playing speed and outputting the audio.
7. A terminal comprising a processor, characterized in that the processor, when executing a computer program, implements the steps of the method of any of claims 1 to 5.
8. The terminal of claim 7, further comprising a first communication circuit electrically connected to the processor; the first communication circuit is used for being in communication connection with a headset.
9. An audio control system comprising an earphone and a terminal as claimed in claim 7 or 8; the terminal is in communication connection with the earphone;
the earphone is used for playing the received audio and sending the acquired real-time heart rate value to the terminal.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 5.
CN202010684268.7A 2020-07-16 2020-07-16 Audio control method, device, system, storage medium and terminal Active CN111966319B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010684268.7A CN111966319B (en) 2020-07-16 2020-07-16 Audio control method, device, system, storage medium and terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010684268.7A CN111966319B (en) 2020-07-16 2020-07-16 Audio control method, device, system, storage medium and terminal

Publications (2)

Publication Number Publication Date
CN111966319A true CN111966319A (en) 2020-11-20
CN111966319B CN111966319B (en) 2024-04-23

Family

ID=73362120

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010684268.7A Active CN111966319B (en) 2020-07-16 2020-07-16 Audio control method, device, system, storage medium and terminal

Country Status (1)

Country Link
CN (1) CN111966319B (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070112245A1 (en) * 2005-09-26 2007-05-17 Booty Donald J Jr Method and apparatus to relax a patient to minimize the administration of anesthesia, facilitate successful surgery, and shorten recovery time
CN101026995A (en) * 2002-12-13 2007-08-29 因特尔丘尔有限公司 Apparatus and method for beneficial modification of biorhythmic activity
CN104133551A (en) * 2014-07-15 2014-11-05 惠州Tcl移动通信有限公司 Method capable of changing musical style of music according to heart rate value and mobile terminal
US20160292270A1 (en) * 2013-12-27 2016-10-06 Intel Corporation Tracking heart rate for music selection
KR20170011264A (en) * 2015-07-22 2017-02-02 엘지전자 주식회사 Mobile terminal and method for controlling the same
US20170061950A1 (en) * 2015-08-24 2017-03-02 Plantronics, Inc. Biometrics-Based Dynamic Sound Masking
CN106599123A (en) * 2016-11-29 2017-04-26 上海斐讯数据通信技术有限公司 Music playing method and system for use during exercise
CN108429972A (en) * 2018-05-28 2018-08-21 Oppo广东移动通信有限公司 Method for playing music, device, terminal, earphone and readable storage medium storing program for executing
US20190022349A1 (en) * 2017-07-20 2019-01-24 Bose Corporation Earphones for Measuring and Entraining Respiration
CN111202509A (en) * 2020-01-17 2020-05-29 山东中医药大学 Target heart rate monitoring method and device based on auditory expression strategy

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101026995A (en) * 2002-12-13 2007-08-29 因特尔丘尔有限公司 Apparatus and method for beneficial modification of biorhythmic activity
US20070112245A1 (en) * 2005-09-26 2007-05-17 Booty Donald J Jr Method and apparatus to relax a patient to minimize the administration of anesthesia, facilitate successful surgery, and shorten recovery time
US20160292270A1 (en) * 2013-12-27 2016-10-06 Intel Corporation Tracking heart rate for music selection
CN104133551A (en) * 2014-07-15 2014-11-05 惠州Tcl移动通信有限公司 Method capable of changing musical style of music according to heart rate value and mobile terminal
KR20170011264A (en) * 2015-07-22 2017-02-02 엘지전자 주식회사 Mobile terminal and method for controlling the same
US20170061950A1 (en) * 2015-08-24 2017-03-02 Plantronics, Inc. Biometrics-Based Dynamic Sound Masking
CN106599123A (en) * 2016-11-29 2017-04-26 上海斐讯数据通信技术有限公司 Music playing method and system for use during exercise
US20190022349A1 (en) * 2017-07-20 2019-01-24 Bose Corporation Earphones for Measuring and Entraining Respiration
CN108429972A (en) * 2018-05-28 2018-08-21 Oppo广东移动通信有限公司 Method for playing music, device, terminal, earphone and readable storage medium storing program for executing
CN111202509A (en) * 2020-01-17 2020-05-29 山东中医药大学 Target heart rate monitoring method and device based on auditory expression strategy

Also Published As

Publication number Publication date
CN111966319B (en) 2024-04-23

Similar Documents

Publication Publication Date Title
CN104410379B (en) A kind of volume adjusting method
US20210330229A1 (en) Method and device for attention training, and computer readable storage medium
US9241215B2 (en) Mobile apparatus and control method thereof
CN105404160A (en) Control method and device based on sleep state
WO2017181365A1 (en) Earphone channel control method, related apparatus, and system
CN107425568B (en) Method and device for preventing over-discharge of battery, mobile terminal and storage medium
CN109348399B (en) Terminal and control method of stereo sound effect thereof
CN110599989B (en) Audio processing method, device and storage medium
CN105007053A (en) Audio play method and device
CN110675848B (en) Audio processing method, device and storage medium
WO2021103260A1 (en) Control method for headphones and headphones
CN111353100A (en) Clothing information recommendation method and device, mobile terminal and storage medium
CN104866078B (en) Control method and control device of electronic equipment and electronic equipment
CN106375809B (en) Volume adjusting method and device and storage medium
CN111800699B (en) Volume adjustment prompting method and device, earphone equipment and storage medium
JP2019537116A (en) Method of adjusting screen-on period of terminal and terminal
CN107681993B (en) Method for adjusting audio parameters and mobile terminal
CN111966319A (en) Audio control method, device, system, storage medium and terminal
CN112616108A (en) Audio output method, device, system, storage medium and electronic equipment
CN106648540B (en) Music switching method and device
CN107085497A (en) Method for controlling volume and device
CN108154886A (en) Noise suppressing method and device, electronic device and computer readable storage medium
CN113039518B (en) Playing control method and device, computer readable storage medium and electronic equipment
CN109119101B (en) Audio data processing method and device and mobile terminal
CN116095595B (en) Audio processing method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 519000 No. 333, Kexing Road, Xiangzhou District, Zhuhai City, Guangdong Province

Applicant after: ZHUHAI JIELI TECHNOLOGY Co.,Ltd.

Address before: Floor 1-107, building 904, ShiJiHua Road, Zhuhai City, Guangdong Province

Applicant before: ZHUHAI JIELI TECHNOLOGY Co.,Ltd.

GR01 Patent grant
GR01 Patent grant