CN107633853A

CN107633853A - Control method for playing audio and video files and user terminal

Info

Publication number: CN107633853A
Application number: CN201710654606.0A
Authority: CN
Inventors: 唐涛
Original assignee: Guangdong Genius Technology Co Ltd
Current assignee: Guangdong Genius Technology Co Ltd
Priority date: 2017-08-03
Filing date: 2017-08-03
Publication date: 2018-01-26
Anticipated expiration: 2037-08-03
Also published as: CN107633853B

Abstract

The invention discloses a control method for playing audio and video files and a user terminal, wherein the method comprises the following steps: when the user terminal plays the audio and video file in an earphone mode, judging whether a first detection parameter sent by an earphone is received or not, wherein the first detection parameter is used for indicating that the current state of the earphone is switched from a wearing state to a non-wearing state, when the first detection parameter is judged to be received, recording the playing time point of the audio and video file at the moment when the first detection parameter is received, judging whether a second detection parameter sent by the earphone is received or not, wherein the second detection parameter is used for indicating that the current state of the earphone is switched from the non-wearing state to the wearing state, when the second detection parameter is judged to be received, adjusting the playing progress of the audio and video file to the playing time point, and playing the audio and video file again from the playing time point. Therefore, the playing efficiency of the audio and video file can be improved by implementing the embodiment of the invention, and the operation is simple.

Description

Control method for playing audio and video files and user terminal

Technical Field

The invention relates to the technical field of intelligent user terminals, in particular to a control method for playing audio and video files and a user terminal.

Background

Currently, many users learn inertial experience of entertainment applications through earphones when using user terminals such as mobile phones and tablet computers, that is, when the user terminal establishes wireless connection with the earphones or an earphone interface on the user terminal is plugged with the earphones, the users can enjoy audio and video files played by the user terminal in an earphone mode of the user terminal. Practice shows that when the user enjoys the audio and video files, the user can be temporarily away in some special situations, if the user does not pause playing of the audio and video files when the user temporarily leaves, the user terminal can continue playing the audio and video files, and if the user wants to continue enjoying the audio and video files after processing the special situations, the user needs to manually adjust the playing progress of the audio and video files for many times so as to adjust the playing progress of the audio and video files to the playing progress of the audio and video files when the user temporarily leaves, so that the operation is complex, and the playing efficiency of the audio and video files is greatly reduced.

Disclosure of Invention

The embodiment of the invention discloses a control method for playing an audio and video file and a user terminal, which can improve the playing efficiency of the audio and video file and are simple to operate.

The first aspect of the embodiment of the invention discloses a control method for playing an audio and video file, which comprises the following steps:

when a user terminal plays an audio and video file in an earphone mode, judging whether a first detection parameter sent by an earphone is received or not, wherein the first detection parameter is used for indicating that the current state of the earphone is switched from a wearing state to a non-wearing state;

when the first detection parameter is judged to be received, recording the playing time point of the audio and video file at the moment of receiving the first detection parameter;

judging whether a second detection parameter sent by the earphone is received or not, wherein the second detection parameter is used for indicating that the current state of the earphone is switched from the unworn state to the worn state;

and when the second detection parameter is judged to be received, adjusting the playing progress of the audio and video file to the playing time point, and starting to play the audio and video file again from the playing time point.

As an optional implementation manner, in the first aspect of this embodiment of the present invention, the method further includes:

in the process of playing the audio and video file, receiving a skin conductivity index obtained after the skin galvanic reaction detection is carried out on the earphone;

according to the skin conductivity index, drawing a variation curve aiming at the skin conductivity index;

and adjusting sound effect output parameters when the audio and video file is played according to the change curve.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, after the drawing a variation curve for the skin conductivity index according to the skin conductivity index, and before the adjusting a sound effect output parameter when the audio/video file is played according to the variation curve, the method further includes:

judging whether the change curve is a preset stable change curve or not, judging whether the change range of the skin conductivity index indicated by the change curve is within a preset change range or not when judging that the change curve is not the preset stable change curve, and triggering and executing the operation of adjusting the sound effect output parameter when the audio and video file is played according to the change curve when the change range is not within the preset change range.

when judging the change curve does preset steady change curve just change range is in when presetting change range in, judge whether duration reaches and predetermine the length of time threshold value, when duration reaches when predetermineeing the length of time threshold value, it is right to pause the broadcast of audio and video file, duration does the change curve does preset steady change curve just change range is in predetermine the length of time in the change range.

As an alternative implementation, in the first aspect of the embodiment of the present invention, the first detected parameter includes a electrodermal response parameter detected by a electrodermal sensor on the headset; or,

the first detection parameter comprises a light brightness value detected by a brightness sensor on the earphone and/or a human body temperature value detected by a temperature sensor on the earphone.

A second aspect of the embodiments of the present invention discloses a user terminal, where the user terminal includes:

the device comprises a judging unit, a judging unit and a judging unit, wherein the judging unit is used for judging whether a first detection parameter sent by an earphone is received or not when the user terminal plays an audio and video file in an earphone mode, and the first detection parameter is used for indicating that the current state of the earphone is switched from a wearing state to a non-wearing state;

the recording unit is used for recording the playing time point of the audio and video file at the moment of receiving the first detection parameter when the judging unit judges that the first detection parameter is received;

the judging unit is further configured to judge whether a second detection parameter sent by the earphone is received, where the second detection parameter is used to indicate that the current state of the earphone is switched from the unworn state to the worn state;

the adjusting unit is used for adjusting the playing progress of the audio and video file to the playing time point when the judging unit judges that the second detection parameter is received;

and the playing unit is used for playing the audio and video file again from the playing time point.

As an optional implementation manner, in a second aspect of the embodiment of the present invention, the user terminal further includes:

the receiving unit is used for receiving the skin conductance index obtained after the earphone carries out the skin conductance reaction detection in the process of playing the audio and video file by the playing unit;

the drawing unit is used for drawing a variation curve aiming at the skin conductivity index according to the skin conductivity index;

and the adjusting unit is also used for adjusting sound effect output parameters when the audio and video file is played according to the change curve.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the determining unit is further configured to determine whether the change curve is a preset stable change curve after the drawing unit draws the change curve for the skin conductivity index according to the skin conductivity index and before the adjusting unit adjusts the sound effect output parameter when the audio/video file is played according to the change curve, and when it is determined that the change curve is not the preset stable change curve, determine whether a change range of the skin conductivity index indicated by the change curve is within a preset change range;

the specific mode of adjusting the sound effect output parameters when the audio and video file is played by the adjusting unit according to the change curve is as follows:

and when the change curve is not the preset stable change curve and the change range is not in the preset change range, adjusting the sound effect output parameters when the audio/video file is played according to the change curve.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the determining unit is further configured to determine, when it is determined that the variation curve is the preset stable variation curve and the variation range is within the preset variation range, whether a duration reaches a preset duration threshold, where the duration is a duration in which the variation curve is the preset stable variation curve and the variation range is within the preset variation range;

the user terminal further comprises:

and the pause unit is used for pausing the playing of the audio and video file when the judgment unit judges that the duration reaches the preset duration threshold.

As an alternative implementation, in the second aspect of the embodiment of the present invention, the first detected parameter includes a electrodermal response parameter detected by a electrodermal sensor on the headset; or,

A third aspect of the present invention discloses another user terminal, where the user terminal includes:

a memory storing executable program code;

a processor coupled with the memory;

the processor calls the executable program code stored in the memory to execute the control method for playing the audio and video file in the first aspect of the embodiment of the invention.

A fourth aspect of the present invention discloses a computer-readable storage medium storing a computer program for electronic data exchange, where the computer program enables a computer to execute the control method for playing an audio/video file according to the first aspect of the present invention.

A fifth aspect of the embodiments of the present invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, where the computer program is operable to make a computer execute the control method for playing an audio/video file described in the first aspect of the embodiments of the present invention.

Compared with the prior art, the embodiment of the invention has the following beneficial effects:

in the embodiment of the invention, when a user terminal plays an audio and video file in an earphone mode, whether a first detection parameter sent by an earphone is received or not is judged, the first detection parameter is used for indicating that the current state of the earphone is switched from a wearing state to a non-wearing state, when the first detection parameter is judged to be received, the playing time point of the audio and video file at the moment when the first detection parameter is received is recorded, whether a second detection parameter sent by the earphone is received or not is judged, the second detection parameter is used for indicating that the current state of the earphone is switched from the non-wearing state to the wearing state, and when the second detection parameter is judged to be received, the playing progress of the audio and video file is adjusted to the playing time point, and the audio and video file is played again from the playing time point. Therefore, by implementing the embodiment of the invention, whether the earphone is picked or not can be automatically detected when the audio and video file is played, the playing progress of the audio and video file is automatically recorded when the earphone is detected to be picked, and the audio and video file is continuously played according to the recorded playing progress when the earphone is detected to be put on again, so that the playing progress of the audio and video file does not need to be manually adjusted for many times by a user, the playing efficiency of the audio and video file is improved, the operation is simple, and the use experience of the user is further improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.

Fig. 1 is a schematic flow chart of a control method for playing an audio/video file according to an embodiment of the present invention;

fig. 2 is a schematic flow chart of another control method for playing an audio/video file according to an embodiment of the present invention;

fig. 3 is a schematic flowchart of another control method for playing an audio/video file according to an embodiment of the present invention;

fig. 4 is a schematic structural diagram of a user terminal disclosed in the embodiment of the present invention;

fig. 5 is a schematic structural diagram of another ue disclosed in the embodiment of the present invention;

fig. 6 is a schematic structural diagram of another user equipment disclosed in the embodiment of the present invention;

fig. 7 is a schematic structural diagram of another user terminal disclosed in the embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that the terms "comprises" and "comprising," and any variations thereof, of embodiments of the present invention are intended to cover non-exclusive inclusions, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

The embodiment of the invention discloses a control method for playing an audio and video file and a user terminal, which can automatically detect whether an earphone is picked up or not when the audio and video file is played, automatically record the playing progress of the audio and video file when the earphone is detected to be picked up, and continuously play the audio and video file according to the recorded playing progress when the earphone is detected to be re-worn, so that the playing progress of the audio and video file does not need to be manually adjusted for many times by a user, the playing efficiency of the audio and video file is improved, the operation is simple, and the use experience of the user is further improved. The following are detailed below.

Example one

Referring to fig. 1, fig. 1 is a schematic flowchart of a control method for playing an audio/video file according to an embodiment of the present invention. As shown in fig. 1, the control method for playing the audio/video file may include the following operations:

101. when the user terminal plays the audio/video file in the earphone mode, the user terminal judges whether a first detection parameter sent by the earphone is received, the first detection parameter is used for indicating that the current state of the earphone is switched from a wearing state to a non-wearing state, when the judgment result in the step 101 is yes, the step 102 is triggered to be executed, and when the judgment result in the step 101 is no, the process can be ended.

In the embodiment of the present invention, the user terminal may be a user terminal that can establish a connection with an earphone and can play an audio/video file, such as a smart phone (an Android phone, an iOS phone, and the like), a smart phone watch, a tablet computer, a palmtop computer, and a Mobile Internet Device (MID).

In the embodiment of the present invention, the earphone may be a wired earphone or a wireless earphone (such as a bluetooth earphone), and when the earphone is a wired earphone, the connection between the user terminal and the earphone is a wired connection, and when the earphone is a wireless earphone, the connection between the user terminal and the earphone is a wireless connection.

As an alternative embodiment, the first detection parameter may include a skin electric reaction parameter detected by a skin electric sensor on the earphone, that is, a skin electric sensor is installed on the earphone which is connected with the user terminal, the skin electric sensor can detect the skin electric reaction parameter based on a skin electric reaction detection principle, wherein a detection parameter detected by the earphone in a worn state is different from a detection parameter detected by the earphone in an unworn state, the user terminal can determine whether a current state of the earphone changes according to the detection parameter sent by the earphone, preferably, the first detection parameter may include skin electric reaction parameters detected by the earphone at two consecutive detection times, wherein the skin electric reaction parameter detected at the first detection time indicates that the earphone is in a worn state, and the skin electric reaction parameter detected at the second detection time indicates that the earphone is in an unworn state, i.e. the headset is removed.

As another alternative, the first detection parameter may also include a light brightness value detected by a brightness sensor on the earphone and/or a human body temperature value detected by a temperature sensor on the earphone, when the first detection parameter includes the light brightness value and the human body temperature value, a condition that the light brightness value detected by the earphone is lower than a preset brightness threshold value and the human body temperature value reaches a preset human body normal temperature range indicates that the earphone is in a worn state, a condition that the light brightness value detected by the earphone is not lower than the preset brightness threshold value or the human body temperature value is not within the preset human body normal temperature range indicates that the earphone is in an unworn state, preferably, the first detection parameter includes the light brightness value detected by the earphone at two consecutive detection times and the human body temperature value, wherein the light brightness value detected at the first detection time and the human body temperature value indicate that the earphone is in a, the light brightness value and the human body temperature value detected at the second detection moment indicate that the earphone is not worn.

102. And the user terminal records the playing time point of the audio and video file at the moment of receiving the first detection parameter.

In the embodiment of the present invention, the playing time point of the audio/video file recorded by the user terminal is used to indicate the playing progress of the audio/video file, for example, when the audio/video file is played to the 10 th minute and 50 th second at the time of receiving the first detection parameter, the playing time point recorded by the user terminal is 10 minutes and 50 seconds.

In the embodiment of the present invention, when the determination result in step 101 is yes, the user terminal may continue to play the audio/video file while recording the play time point of the audio/video file.

103. The user terminal determines whether a second detection parameter sent by the earphone is received, where the second detection parameter is used to indicate that the current state of the earphone is switched from an unworn state to a worn state, and when the determination result in step 103 is yes, step 104 is triggered to be executed, and when the determination result in step 103 is no, the process may be ended.

In this embodiment of the present invention, the type of the parameter included in the second detection parameter is the same as the type of the parameter included in the first detection parameter.

104. And the user terminal adjusts the playing progress of the audio and video file to the playing time point and plays the audio and video file again from the playing time point.

In the embodiment of the present invention, a correction duration may be stored in the user terminal in advance, where the correction duration is used to correct the play time point, and specifically, the correction duration is used to reverse the play time point, so as to reduce the probability that the user misses the audio and video content that is not listened to or watched. For example, assuming that the correction time period is 3 seconds, when the playback time point recorded in step 102 is 10 minutes 50 seconds, the corrected playback is simply 10 minutes 47 seconds.

In an optional embodiment, when the determination result in step 103 is yes, before performing step 104, the method for controlling playing of the audio/video file may further include the following operations:

the user terminal judges whether the time length between the moment of receiving the first detection parameter and the moment of receiving the second detection parameter is less than or equal to a preset time length threshold value, and when the time length is less than or equal to the preset time length threshold value, the execution step 104 is triggered.

In another optional embodiment, the method for playing the audio/video file may further include the following operations:

in the process of playing the audio/video file, the user terminal receives skin conductivity indexes obtained after the skin galvanic reaction detection is carried out on the earphone, wherein the received skin conductivity indexes are specifically a plurality of skin conductivity indexes obtained after the skin galvanic reaction detection is continuously carried out on the earphone within a certain time period;

the user terminal draws a change curve aiming at the received skin conductivity index according to the received skin conductivity index, wherein the change curve is used for indicating the change of the emotional state of the user when listening to the audio and video file;

and the user terminal adjusts the sound effect output parameters when the audio/video file is played according to the change curve.

For example, when the variation curve shows an upward trend, the user terminal may enhance the sound effect when playing the audio/video file, and when the variation curve shows a downward trend, the user terminal may weaken the sound effect when playing the audio/video file.

In this another optional embodiment, further optionally, after the operation of drawing a variation curve for the received skin conductivity index according to the received skin conductivity index is performed, and before the operation of adjusting the sound effect output parameter when the audio/video file is played according to the variation curve is performed, the control method for playing the audio/video file may further include the following operations:

judging whether the change curve is a preset stable change curve or not, judging whether the change range of the skin conductivity index indicated by the change curve is within a preset change range or not when judging that the change curve is not the preset stable change curve, and triggering and executing the operation of adjusting the sound effect output parameter when the audio/video file is played according to the change curve when the change range is not within the preset change range.

Further optionally, the control method for playing the audio/video file may further include the following operations:

and when the change curve is judged to be a preset stable change curve and the change range is in a preset change range, judging whether the duration time reaches a preset time threshold value, and when the duration time reaches the preset time threshold value, suspending the playing of the audio and video file, wherein the duration time is the duration time when the change curve is the preset stable change curve and the change range is in the preset change range, and the preset change range is the change range of the skin conductivity index when the human body is in a sleep state.

In this alternative embodiment, since the skin conductance varies with the activity of the sympathetic nervous system, i.e., with the alertness of the human body, when the human body is in a sleep state, the alertness is lowest and the emotion is most stable, the skin conductance level of the human body is lowest and most stable; when a human body is in a waking state, the alarm degree of the human body is relatively high, the emotion of the human body fluctuates, and at this time, the skin conductivity level of the human body is relatively high and unstable, so that the alternative embodiment can further detect whether the user is in a sleeping state through a skin electric sensor on the earphone, adjust the sound effect output parameter according to the detected skin conductivity index when the user is not in the sleeping state, and directly stop playing the audio and video files when the user is detected to be in the sleeping state, so that the electric quantity of the user terminal can be saved, and the body health of the user can be effectively protected.

It can be seen that, by implementing the control method for playing the audio/video file described in fig. 1, whether the earphone is picked up or not can be automatically detected when the audio/video file is played, when the earphone is detected to be picked up, the playing progress of the audio/video file is automatically recorded, and when the earphone is detected to be worn again, the audio/video file is continuously played according to the recorded playing progress, so that the playing progress of the audio/video file does not need to be manually adjusted for many times by a user, the playing efficiency of the audio/video file is improved, the operation is simple, and the use experience of the user is further improved.

Example two

Referring to fig. 2, fig. 2 is a schematic flowchart of another control method for playing an audio/video file according to an embodiment of the present invention. As shown in fig. 2, the control method for playing the audio/video file may include the following operations:

201. and the user terminal plays the audio and video file in an earphone mode and triggers the earphone to start a skin-electricity reaction detection function.

In the embodiment of the invention, the function of detecting the skin electric reaction on the earphone is realized by a skin electric sensing module on the earphone, wherein the skin electric sensing module can be a skin electric sensor.

202. The earphone detects whether the user wears the earphone to listen to the audio/video file or not through the skin galvanic reaction detection function, when the judgment result in the step 202 is yes, the step 202 can be continuously triggered and executed, and when the judgment result in the step 202 is no, the step 203 is triggered and executed.

In the embodiment of the invention, when the earphone detects the galvanic skin reaction through the galvanic skin reaction detection function, the earphone determines that the earphone is in a wearing state, namely, the user is determined to wear the earphone to listen to the audio and video file, and when the earphone does not detect the galvanic skin reaction through the galvanic skin reaction detection function, the earphone determines that the earphone is in an unworn state, namely, the user is determined to take off the earphone.

203. The earphone sends a prompt message to the user terminal, wherein the prompt message is used for prompting that the earphone is not worn.

204. And the user terminal receives the prompt message, records the playing time point of the audio and video file at the current moment and continues to play the audio and video file.

205. The earphone detects whether the user wears the earphone again to listen to the audio/video file through the skin-to-electricity reaction detection function, if the judgment result in the step 205 is yes, the step 206 is triggered to be executed, and if the judgment result in the step 205 is no, the step 205 can be continuously triggered to be executed.

206. And the user terminal adjusts the audio and video file to the playing time point and plays the audio and video file again from the playing time point.

207. Under the condition that the earphone is worn to listen to the audio and video files, the earphone detects the skin electricity reaction change level of the user and sends the skin electricity reaction change level to the user terminal.

208. And the user terminal determines the emotional change of the user when listening to the audio/video file according to the received skin electricity response change level, and draws a skin electricity response curve according to the received skin electricity response change level.

In the embodiment of the present invention, the change level of the galvanic skin response is used to represent an emotional state of the user when listening to the audio/video file, and when the galvanic skin response curve shows an ascending trend, step 209 is triggered to be executed; when the picoelectric response curve shows a downward trend, the step 210 is triggered.

209. And the user terminal enhances the sound effect when playing the audio/video file.

210. And the user terminal weakens the sound effect when the audio/video file is played.

It can be seen that, the implementation of the control method for playing the audio/video file described in fig. 2 can detect whether the earphone is picked up or not when playing the audio/video file based on the principle of galvanic skin response detection, when it is detected that the earphone is picked up, the playing progress of the audio/video file is automatically recorded, and when it is detected that the earphone is worn again, the audio/video file is continuously played according to the recorded playing progress, the playing progress of the audio/video file does not need to be manually adjusted for many times by a user, so that the playing efficiency of the audio/video file is improved, the operation is simple, the user experience is improved, meanwhile, the sound effect output effect of the audio/video file can be automatically adjusted according to the change of the galvanic skin response level of a human body, the operation is convenient.

EXAMPLE III

Referring to fig. 3, fig. 3 is a schematic flowchart of another control method for playing an audio/video file according to an embodiment of the present invention. As shown in fig. 3, the control method for playing the audio/video file may include the following operations:

301. the user terminal plays the audio and video file in the earphone mode, and triggers the earphone to start the light sensor and the thermistor temperature sensor.

In the embodiment of the invention, the light sensor is used for detecting the light brightness value, and the thermosensitive temperature sensor is used for detecting the human body temperature value.

302. The earphone detects a first light brightness value through the light sensor and detects a first person temperature value through the thermistor temperature sensor, and sends the detected first light brightness value and the first person temperature value to the user terminal.

303. The user terminal determines whether the earphone is in a worn state according to the first light brightness value and the first person body temperature value sent by the earphone, if yes, the process may be ended, and if no, the step 304 is triggered.

In the embodiment of the present invention, when the first light brightness value is not lower than the preset brightness threshold or the first human body temperature value is not within the preset normal human body temperature range, the user terminal determines that the earphone is not in the wearing state, and when the first light brightness value is lower than the preset brightness threshold and the first human body temperature value is within the preset normal human body temperature range, the user terminal determines that the earphone is in the wearing state.

304. And the user terminal records the playing time point of the audio and video file and continues to play the audio and video file.

305. The earphone detects a second light brightness value through the light sensor and a second human body temperature value through the thermistor temperature sensor, and sends the detected second light brightness value and the second human body temperature value to the user terminal.

306. The user terminal determines whether the earphone is worn again according to the second light brightness value and the second human body temperature value sent by the earphone, if the determination result in step 306 is negative, the process may be ended, and if the determination result in step 306 is positive, step 307 is triggered to be executed.

In the embodiment of the present invention, when the second light brightness value is not lower than the preset brightness threshold or the second human body temperature value is not within the preset human body normal temperature range, the user terminal determines that the earphone is not in the wearing state, and when the second light brightness value is lower than the preset brightness threshold and the second human body temperature value is within the preset human body normal temperature range, the user terminal determines that the earphone is in the wearing state.

307. And the user terminal adjusts the audio and video file to the playing time point and plays the audio and video file again from the playing time point.

It can be seen that, by implementing the control method for playing the audio/video file described in fig. 3, whether the earphone is picked up can be detected based on the human body temperature value and the light brightness value detected by the earphone when the audio/video file is played, when the earphone is detected to be picked up, the playing progress of the audio/video file is automatically recorded, and when the earphone is detected to be worn again, the audio/video file is continuously played according to the recorded playing progress, the playing progress of the audio/video file does not need to be manually adjusted for many times by a user, so that the playing efficiency of the audio/video file is improved, the operation is simple, and the use experience of.

Example four

Referring to fig. 4, fig. 4 is a schematic structural diagram of a ue according to an embodiment of the present invention. As shown in fig. 4, the user terminal 400 may include a judging unit 401, a recording unit 402, an adjusting unit 403, and a playing unit 404, wherein:

the determining unit 401 is configured to determine whether a first detection parameter sent by the earphone is received when the playing unit 404 of the user terminal 400 plays the audio/video file in the earphone mode, where the first detection parameter is used to indicate that the current state of the earphone is switched from the wearing state to the non-wearing state.

A recording unit 402, configured to record, when the determining unit 401 determines that the first detection parameter is received, a playing time point of the audio/video file at a time when the first detection parameter is received.

The determining unit 401 is further configured to determine whether a second detection parameter sent by the earphone is received, where the second detection parameter is used to indicate that the current state of the earphone is switched from the unworn state to the worn state.

An adjusting unit 403, configured to adjust the playing progress of the audio/video file to the playing time point when the determining unit 401 determines that the second detection parameter is received.

The playing unit 404 is configured to play the audio/video file again from the playing time point.

Optionally, the first detection parameter may include a skin electric reaction parameter detected by a skin electric sensor on the earphone, or include a light brightness value detected by a brightness sensor on the earphone and/or a human body temperature value detected by a temperature sensor on the earphone.

It can be seen that, by implementing the user terminal 400 described in fig. 4, it is possible to automatically detect whether the earphone is picked up when playing the audio/video file, automatically record the playing progress of the audio/video file when detecting that the earphone is picked up, and continue to play the audio/video file according to the recorded playing progress when detecting that the earphone is re-worn, without the need for the user to manually adjust the playing progress of the audio/video file many times, so that the playing efficiency of the audio/video file is improved, the operation is simple, and the use experience of the user is improved.

In an optional embodiment, the user terminal 400 may further include a receiving unit 405 and a drawing unit 406, at this time, the structure of the user terminal 400 may be as shown in fig. 5, and fig. 5 is a schematic structural diagram of another user terminal disclosed in the embodiment of the present invention. Wherein:

and a receiving unit 405, configured to receive the skin conductance index obtained after the skin conductance index is detected by the earphone in the process of playing the audio/video file by the playing unit 404.

A drawing unit 406, configured to draw a variation curve for the skin conductance index according to the skin conductance index.

The adjusting unit 403 is further configured to adjust a sound effect output parameter when the audio/video file is played according to the variation curve.

Therefore, the user terminal 400 described in fig. 5 can automatically adjust the sound effect output effect of the audio/video file according to the change of the human body skin electricity response level, is convenient to operate, saves time, and further improves the use experience of the user.

Optionally, the determining unit 401 may be further configured to determine whether the change curve is a preset steady change curve after the drawing unit 406 draws the change curve for the skin conductivity index according to the skin conductivity index and before the adjusting unit 403 adjusts the sound effect output parameter when the audio/video file is played according to the change curve, and determine whether the change range of the skin conductivity index indicated by the change curve is within a preset change range when the change curve is determined not to be the preset steady change curve.

The specific way of adjusting the sound effect output parameter when playing the audio/video file by the adjusting unit 403 according to the variation curve may be:

Still further optionally, as shown in fig. 5, the user terminal 400 may further include a suspending unit 407, where:

the determining unit 401 may be further configured to determine, when it is determined that the variation curve is the preset stable variation curve and the variation range is within the preset variation range, whether a duration reaches a preset duration threshold, where the duration is a duration when the variation curve is the preset stable variation curve and the variation range is within the preset variation range.

A pause unit 407, configured to pause the playing of the audio/video file by the playing unit 404 when the determining unit 401 determines that the duration reaches the preset duration threshold.

It can be seen that, the user terminal 400 described in fig. 5 can also detect the skin conductivity level of the user through a built-in skin sensor of the earphone when playing the audio/video file, so as to acquire the physiological state corresponding to the human body, and when the acquired physiological state is a sleep state, the audio/video file can be automatically closed, so that the intelligent control of playing the audio/video file is realized, the body health of the user is protected, and the use experience of the user is further improved.

EXAMPLE five

Referring to fig. 6, fig. 6 is a schematic structural diagram of another ue according to an embodiment of the present invention. As shown in fig. 6, the user terminal 600 may include: at least one processor 601, e.g., a CPU, a memory 602, at least one communication bus 603, an input device 604, an output device 605. Wherein a communication bus 603 is used to enable communication connections between these components. The memory 602 may be a high-speed RAM memory or a non-volatile memory (e.g., at least one disk memory). The memory 602 may alternatively be at least one storage device located remotely from the processor 601. Wherein:

the processor 601 may be combined with the user terminal 400 described in fig. 4 to 5, a set of program codes is stored in the memory 602, and the processor 601 calls the program codes stored in the memory 602 to perform the following operations:

when the user terminal 600 plays the audio/video file in the earphone mode, judging whether a first detection parameter sent by the earphone is received, wherein the first detection parameter is used for indicating that the current state of the earphone is switched from a wearing state to an unworn state;

when the first detection parameter is judged to be received, recording the playing time point of the audio and video file at the moment when the first detection parameter is received;

and when the second detection parameter is judged to be received, adjusting the playing progress of the audio and video file to the playing time point, and playing the audio and video file again from the playing time point.

In an alternative embodiment, the processor 601 calls the program code stored in the memory 602, and is further operable to:

in the process of playing the audio and video file, receiving a skin conductivity index obtained after the skin galvanic reaction detection is carried out by an earphone;

and adjusting the sound effect output parameters when the audio/video file is played according to the change curve.

In this optional embodiment, further optionally, after drawing a variation curve for the skin conductivity index according to the skin conductivity index and before adjusting the sound effect output parameter when playing the audio/video file according to the variation curve, the processor 601 calls the program code stored in the memory 602, and may further be configured to perform the following operations:

judging whether the change curve is a preset stable change curve or not, judging whether the change range of the skin conductivity index indicated by the change curve is within a preset change range or not when judging that the change curve is not the preset stable change curve, and triggering and executing the operation of adjusting the sound effect output parameter when playing the audio and video file according to the change curve when the change range is not within the preset change range.

Still further optionally, the processor 601 calls the program code stored in the memory 602, and may be further configured to perform the following operations:

and when the change curve is judged to be the preset stable change curve and the change range is within the preset change range, judging whether the duration time reaches a preset time threshold value, and when the duration time reaches the preset time threshold value, suspending the playing of the audio and video file, wherein the duration time is the duration time when the change curve is the preset stable change curve and the change range is within the preset change range.

Optionally, the first detection parameter may include a electrodermal response parameter detected by a electrodermal sensor on the earphone; or, the first detection parameter includes a light brightness value detected by a brightness sensor on the earphone and/or a human body temperature value detected by a temperature sensor on the earphone.

It can be seen that, by implementing the user terminal 600 described in fig. 6, it can be detected whether the earphone is picked up when playing the audio/video file, when it is detected that the earphone is picked up, the playing progress of the audio/video file is automatically recorded, and when it is detected that the earphone is put on again, the audio/video file is continuously played according to the recorded playing progress, and it is not necessary for the user to manually adjust the playing progress of the audio/video file many times, so that the playing efficiency of the audio/video file is improved, the operation is simple, and the use experience of the user is further improved.

EXAMPLE six

Referring to fig. 7, fig. 7 is a schematic structural diagram of another ue according to an embodiment of the present invention. As shown in fig. 7, the user terminal may include: a Radio Frequency (RF) circuit 10, a memory 20, an input unit 30, a display unit 40, a sensor 50, an audio circuit 60, a Wireless Fidelity (WiFi) module 70, a processor 80, and a power supply 90. Those skilled in the art will appreciate that the user terminal architecture shown in fig. 7 does not constitute a limitation of the user terminal and may include more or fewer components than shown, or some components may be combined, or a different arrangement of components.

The following describes each component of the user terminal in detail with reference to fig. 7:

the RF circuit 10 may be used for the reception and transmission of information. In general, the RF circuit 10 includes, but is not limited to, an antenna, at least one Amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 10 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Message Service (SMS), and the like.

The memory 20 may be used to store software programs and modules, and the processor 80 executes various functional applications and data processing of the user terminal by operating the software programs and modules stored in the memory 20. The memory 20 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as an application interface display function, a telephone dialing function, etc.), and the like; the storage data area may store data created according to the use of the user terminal (such as a contact identification, a preset operation mode, etc.), and the like. Further, the memory 20 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The input unit 30 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the user terminal. Specifically, the input unit 30 may include a touch panel 31 and other input devices 32. The touch panel 31, also called a touch screen, may collect touch operations of a user on or near the touch panel 31 (for example, operations of the user on or near the touch panel 31 using any suitable object or accessory such as a finger or a stylus pen), and drive the corresponding connection device according to a preset program. Alternatively, the touch panel 31 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 80, and can receive and execute commands sent by the processor 80. In addition, the touch panel 31 may be implemented by various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. The input unit 30 may include other input devices 32 in addition to the touch panel 31. In particular, other input devices 32 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 40 may be used to display information input by a user or information provided to the user and various menus of the user terminal. The display unit 40 may include a display panel 41, and optionally, the display panel 41 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. Further, the touch panel 31 may cover the display panel 41, and when the touch panel 31 detects a touch operation on or near the touch panel 31, the touch operation is transmitted to the processor 80 to determine the type of the touch event, and then the processor 80 provides a corresponding visual output on the display panel 41 according to the type of the touch event. Although in fig. 7 the touch panel 31 and the display panel 41 are two separate components to implement the input and output functions of the user terminal, in some embodiments, the touch panel 31 and the display panel 41 may be integrated to implement the input and output functions of the user terminal.

The user terminal may also include at least one sensor 50, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that adjusts the brightness of the display panel 41 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 41 and/or the backlight when the user terminal moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), detect the magnitude and direction of gravity when stationary, and can be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration) for recognizing the attitude of the user terminal, and related functions (such as pedometer and tapping) for vibration recognition; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured by the user terminal, further description is omitted here.

The audio circuitry 60, speaker 61, microphone 62 may provide an audio interface between the user and the user terminal. The audio circuit 60 may transmit the electrical signal converted from the received audio data to the speaker 61, and the electrical signal is converted into a sound signal by the speaker 61 and output; on the other hand, the microphone 62 converts the collected sound signal into an electric signal, which is received by the audio circuit 60 and converted into audio data, which is then processed by the audio data output processor 80, and then transmitted to, for example, another user terminal via the RF circuit 10, or the audio data is output to the memory 20 for further processing.

WiFi belongs to a short-distance wireless transmission technology, and the user terminal can help the user send and receive e-mails, browse web pages, access streaming media and the like through the WiFi module 70, and provides wireless broadband internet access for the user. Although fig. 7 shows the WiFi module 70, it is understood that it does not belong to the essential constitution of the user terminal, and may be omitted entirely as needed within the scope not changing the essence of the invention.

The processor 80 is a control center of the user terminal, connects various parts of the entire user terminal using various interfaces and lines, and performs various functions of the user terminal and processes data by operating or executing software programs and/or modules stored in the memory 20 and calling data stored in the memory 20, thereby performing overall monitoring of the user terminal. Alternatively, processor 80 may include one or more processing units; preferably, the processor 80 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 80.

The user terminal may also include a power supply 90 (e.g., a battery) for powering the various components, which may preferably be logically coupled to the processor 80 via a power management system to manage charging, discharging, and power consumption management functions via the power management system.

Although not shown, the user terminal may further include a camera, a bluetooth module, and the like, which will not be described herein.

In the embodiments shown in fig. 1, fig. 2 and fig. 3, the method flows of the steps may be implemented based on the structure of the ue.

In the embodiments shown in fig. 4 and fig. 5, the functions of the units may be implemented based on the structure of the user terminal.

It can be seen that, the user terminal described in fig. 7 can detect whether the earphone is picked up when playing the audio/video file, automatically record the playing progress of the audio/video file when detecting that the earphone is picked up, and continuously play the audio/video file according to the recorded playing progress when detecting that the earphone is put on again, without manually adjusting the playing progress of the audio/video file many times by the user, so that the playing efficiency of the audio/video file is improved, the operation is simple, and the use experience of the user is improved.

EXAMPLE seven

The embodiment of the invention discloses a computer-readable storage medium which stores a computer program for electronic data exchange, wherein the computer program enables a computer to execute the steps in the control method for playing the audio and video file described in any one of figures 1-3.

Example eight

An embodiment of the invention discloses a computer program product, which includes a non-transitory computer readable storage medium storing a computer program, and the computer program is operable to make a computer execute the steps in the control method for playing an audio/video file described in any one of fig. 1 to 3.

It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by instructions associated with a program, which may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), compact disc-Read-Only Memory (CD-ROM), or other Memory, magnetic disk, magnetic tape, or magnetic tape, Or any other medium which can be used to carry or store data and which can be read by a computer.

The control method for playing the audio/video file and the user terminal disclosed by the embodiment of the invention are described in detail, a specific example is applied in the text to explain the principle and the implementation mode of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A control method for playing an audio/video file is characterized by comprising the following steps:

2. The method for controlling the playing of audio/video files according to claim 1, further comprising:

3. The method according to claim 2, wherein after the variation curve for the skin conductivity index is drawn according to the skin conductivity index and before the sound effect output parameter when the audio/video file is played is adjusted according to the variation curve, the method further comprises:

4. The method for controlling the playing of audio/video files according to claim 3, wherein the method further comprises:

5. The control method for playing audio/video files according to any of claims 1 to 4, wherein said first detection parameter comprises a electrodermal response parameter detected by a electrodermal sensor on said headphones; or,

6. A user terminal, characterized in that the user terminal comprises:

7. The user terminal according to claim 6, wherein the user terminal further comprises:

8. The user terminal according to claim 7, wherein the determining unit is further configured to determine whether the change curve is a preset steady change curve after the drawing unit draws the change curve for the skin conductance index according to the skin conductance index and before the adjusting unit adjusts the sound effect output parameter when playing the audio/video file according to the change curve, and determine whether a change range of the skin conductance index indicated by the change curve is within a preset change range when determining that the change curve is not the preset steady change curve;

9. The ue according to claim 8, wherein the determining unit is further configured to determine whether a duration reaches a preset duration threshold when it is determined that the variation curve is the preset steady variation curve and the variation range is within the preset variation range, where the duration is a duration when the variation curve is the preset steady variation curve and the variation range is within the preset variation range;

the user terminal further comprises:

10. The user terminal of any of claims 6-9, wherein the first detected parameter comprises a electrodermal response parameter detected by a electrodermal sensor on the earpiece; or,

11. A user terminal, characterized in that the user terminal comprises:

a memory storing executable program code;

a processor coupled with the memory;

the processor calls the executable program code stored in the memory to execute the control method for playing the audio and video file according to any one of claims 1 to 5.

12. A computer-readable storage medium, characterized in that it stores a computer program for electronic data exchange, wherein the computer program causes a computer to execute the control method of playing an audio-visual file according to any one of claims 1 to 5.