CN113282269B

CN113282269B - Audio playing method, device, storage medium and computing equipment

Info

Publication number: CN113282269B
Application number: CN202110711419.8A
Authority: CN
Inventors: 朱一闻; 俞静; 王逸天; 赵宗
Original assignee: Hangzhou Netease Cloud Music Technology Co Ltd
Current assignee: Hangzhou Netease Cloud Music Technology Co Ltd
Priority date: 2021-06-25
Filing date: 2021-06-25
Publication date: 2023-05-05
Anticipated expiration: 2041-06-25
Also published as: CN113282269A

Abstract

The embodiment of the invention provides an audio playing method, an audio playing device, a storage medium and computing equipment. The method comprises the following steps: playing second audio associated with the first audio in response to a play start event of the first audio; wherein the first audio is not played in the playing time period of the second audio; and playing the first audio in response to a play stop event of the second audio. The invention can improve the user touch rate of the explanation content related to the audio, which is released by the audio creator, and improve the communication between the audio creator and the audience, thereby improving the user experience of the audio creator and the audience.

Description

Audio playing method, device, storage medium and computing equipment

Technical Field

The embodiment of the invention relates to the technical field of man-machine interaction, in particular to an audio playing method, an audio playing device, a storage medium and computing equipment.

Background

This section is intended to provide a background or context to the embodiments of the invention that are recited in the claims. The description herein is not admitted to be prior art by inclusion in this section.

With the development of computer Application technology and the like, the types and functions of Application programs (APP) running on terminal devices are becoming more and more abundant. For example, a user may listen to audio such as songs, tracks, or audio books through an audio application running on the terminal device.

For a piece of audio, the creator of the audio typically wants to be able to make additional interpretations of the audio to a listener, such as: the audience is taught the authored background of the audio so that the audience can better understand the ideas and emotions conveyed by the audio, thereby improving the audience's preference for the audio.

The existing audio application program can display the explanation content related to the audio, which is issued by the creator of the audio, in a text form in a user comment interface of the audio; in this case, a user listening to the audio may view the explanation contents through a user comment interface of the audio.

Disclosure of Invention

However, in the existing audio application program, the method for displaying the explanation content related to the audio, which is published by the creator of the audio, in the user comment interface in the text form only ensures that the user who enters the user comment interface can view the explanation content related to the audio, while the user who does not enter the user comment interface cannot know the explanation content related to the audio.

That is, when a user listens to a piece of audio through an existing audio application, he must enter a user comment interface of the audio to see the explanation content related to the audio, which is published by the creator of the audio.

Therefore, in the prior art, the content of the explanation related to the audio, which is distributed by the creator of the audio, does not reach the audience well.

Therefore, there is a great need for an improved audio playing method to increase the user accessibility of the explanatory content related to the audio, which is released by the creator of the audio, and to increase the communication between the creator and the listener of the audio, thereby improving the user experience of the creator and the listener of the audio.

In this context, embodiments of the present invention desire to provide an audio playing method, apparatus, storage medium, and computing device.

In a first aspect of the embodiment of the present invention, there is provided an audio playing method, including:

playing second audio associated with the first audio in response to a play start event of the first audio; wherein the first audio is not played in the playing time period of the second audio;

and playing the first audio in response to a play stop event of the second audio.

Optionally, the playing the second audio associated with the first audio in response to a play start event of the first audio includes:

determining whether a first audio is played for the first time or not in response to a play start event of the first audio; if yes, playing second audio associated with the first audio; or alternatively, the process may be performed,

responding to a play start event of a first audio, and determining whether the historical play times of the first audio are smaller than a preset threshold value; if so, playing a second audio associated with the first audio.

Optionally, an audio playing interface corresponding to the first audio includes a playing control corresponding to the second audio;

the playing the first audio in response to the play stop event of the second audio, including:

in the playing time period of the second audio, responding to the triggering operation of a user on the playing control, stopping playing the second audio, and starting to play the first audio from the playing starting position of the first audio or starting to play the first audio from the playing pause position of the first audio; or alternatively, the process may be performed,

stopping playing the second audio when the second audio is detected to be played to the playing end position, and starting to play the first audio from the playing start position of the first audio, or starting to play the first audio from the playing pause position of the first audio.

the method further comprises the steps of:

and in the playing time period of the first audio, responding to the triggering operation of a user on the playing control, stopping playing the first audio, and starting to play the second audio from the playing starting position of the second audio or starting to play the second audio from the playing pause position of the second audio.

Optionally, the method further comprises:

responding to the triggering operation of a user on the playing control, and detecting whether the duration of the triggering operation reaches a preset threshold value;

outputting at least one operation control corresponding to the second audio in the audio playing interface if the duration of the triggering operation reaches the threshold;

and responding to the triggering operation of a user on any target operation control in the at least one operation control, and executing the operation corresponding to the target operation control on the second audio.

Optionally, the operation control comprises a voice recognition control;

the responding to the triggering operation of the user on any target operation control in the at least one operation control, executing the operation corresponding to the target operation control on the second audio, including:

And responding to the triggering operation of the user on the voice recognition control, performing voice recognition on the second audio, converting the second audio into text, and outputting the text in the audio playing interface.

Optionally, the operation control comprises a sharing control;

and responding to the triggering operation of the user on the sharing control, and sending the URL link of the audio playing interface to a target user selected by the user.

Optionally, the method further comprises:

responding to the triggering operation of a user on the playing control, and detecting the moving track of a triggering point of the triggering operation in the audio playing interface;

and determining the moving direction and the moving distance of the trigger point based on the moving track, and adjusting the audio playing progress of the second audio based on the moving direction and the moving distance.

Optionally, the method further comprises:

responding to the triggering operation of a user on a menu display control corresponding to a function option menu in the audio playing interface, and outputting the function option menu in the audio playing interface; the function option menu comprises a switch option for indicating the display state of the play control;

And hiding or closing the play control when the user switches the switch option to indicate to close the play control.

Optionally, the method further comprises:

responding to the triggering operation of a user for an interface jump control corresponding to the user comment interface, jumping to the user comment interface, and outputting a play control corresponding to the second audio in the user comment interface;

and responding to the triggering operation of the user on the playing control, and playing the second audio.

Optionally, the outputting, in the user comment interface, a play control corresponding to the second audio includes:

determining whether the second audio has been played;

and if the second audio is not played yet, outputting the playing control in a user comment interface, and adding an unrevealed mark for the playing control.

Optionally, the method further comprises:

outputting at least one operation control corresponding to the second audio in the user comment interface if the duration of the triggering operation reaches the threshold;

Optionally, the operation control comprises a voice recognition control;

and responding to the triggering operation of the user on the voice recognition control, performing voice recognition on the second audio, converting the second audio into text, and outputting the text in the user comment interface.

Optionally, the method further comprises:

responding to the triggering operation of a user on the playing control, and detecting the moving track of a triggering point of the triggering operation in the user comment interface;

Optionally, the method further comprises:

Outputting at least one operation control corresponding to the second audio in the user comment interface;

Optionally, the operation control comprises a comment reply control and/or a comment praise control.

In a second aspect of the embodiments of the present invention, there is provided an audio playing device, the device comprising:

a first playing module, configured to respond to a playing start event of a first audio, and play a second audio associated with the first audio; wherein the first audio is not played in the playing time period of the second audio;

and the second playing module is used for responding to the playing stopping event of the second audio and playing the first audio.

Optionally, the first playing module is specifically configured to:

the second playing module is specifically configured to:

the second playing module is further configured to:

Optionally, the apparatus further comprises:

the first detection module is used for responding to the triggering operation of the user on the playing control and detecting whether the duration of the triggering operation reaches a preset threshold value;

the first output module is used for outputting at least one operation control corresponding to the second audio in the audio playing interface when the duration of the triggering operation reaches the threshold value;

and the first execution module is used for responding to the triggering operation of a user on any target operation control in the at least one operation control and executing the operation corresponding to the target operation control on the second audio.

Optionally, the operation control comprises a voice recognition control;

the first execution module is specifically configured to:

Optionally, the operation control comprises a sharing control;

the first execution module is specifically configured to:

Optionally, the apparatus further comprises:

the second detection module is used for responding to the triggering operation of the user on the playing control and detecting the moving track of the triggering point of the triggering operation in the audio playing interface;

the first adjusting module is used for determining the moving direction and the moving distance of the trigger point based on the moving track, and adjusting the audio playing progress of the second audio based on the moving direction and the moving distance.

Optionally, the apparatus further comprises:

the second output module is used for responding to the triggering operation of a user on a menu display control corresponding to a function option menu in the audio playing interface and outputting the function option menu in the audio playing interface; the function option menu comprises a switch option for indicating the display state of the play control;

and the closing module is used for hiding or closing the play control when the user switches the switch option to instruct to close the play control.

Optionally, the apparatus further comprises:

the jump module is used for responding to the triggering operation of a user for the interface jump control corresponding to the user comment interface, jumping to the user comment interface and outputting a play control corresponding to the second audio in the user comment interface;

And the third playing module is used for responding to the triggering operation of the user on the playing control and playing the second audio.

Optionally, the skip module is specifically configured to:

determining whether the second audio has been played;

Optionally, the apparatus further comprises:

the third detection module is used for responding to the triggering operation of the user on the playing control and detecting whether the duration of the triggering operation reaches a preset threshold value;

the third output module is used for outputting at least one operation control corresponding to the second audio in the user comment interface when the duration of the triggering operation reaches the threshold;

and the second execution module is used for responding to the triggering operation of a user on any target operation control in the at least one operation control and executing the operation corresponding to the target operation control on the second audio.

Optionally, the operation control comprises a voice recognition control;

the second execution module is specifically configured to:

Optionally, the apparatus further comprises:

a fourth detection module, configured to respond to a trigger operation of a user on the play control, and detect a movement track of a trigger point of the trigger operation in the user comment interface;

and the second adjusting module is used for determining the moving direction and the moving distance of the trigger point based on the moving track and adjusting the audio playing progress of the second audio based on the moving direction and the moving distance.

Optionally, the apparatus further comprises:

a fourth output module, configured to output at least one operation control corresponding to the second audio in the user comment interface;

and the third execution module is used for responding to the triggering operation of a user on any target operation control in the at least one operation control and executing the operation corresponding to the target operation control on the second audio.

In a third aspect of the embodiments of the present invention, there is provided a computer storage medium having stored thereon a computer program which, when executed by a processor, implements any of the above-described audio playback methods.

In a fourth aspect of embodiments of the present invention, there is provided a computing device comprising:

a processor;

a memory for storing processor-executable instructions;

the processor executes the executable instructions to implement any of the above audio playing methods.

According to the audio playing method, the client can respond to the playing start event of the first audio and firstly play the second audio associated with the first audio; and in the playing time period of the second audio, the first audio cannot be played. Subsequently, the client may play the first audio again in response to a play stop event of the second audio. By adopting the mode, when a user listens to a certain section of audio through the client, the user can firstly listen to the explanation content related to the audio, so that the user touch rate of the explanation content related to the audio, which is issued by the audio creator, can be improved, the communication between the audio creator and the audience can be improved, and the user experience of the audio creator and the audience can be improved.

Drawings

The above, as well as additional purposes, features, and advantages of exemplary embodiments of the present invention will become readily apparent from the following detailed description when read in conjunction with the accompanying drawings. Several embodiments of the present invention are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which:

FIG. 1 schematically illustrates a prior art audio playback interface;

fig. 2 schematically shows a flow chart of an audio playing method according to an embodiment of the invention;

FIG. 3 schematically illustrates a schematic diagram of an audio distribution interface according to an embodiment of the present invention;

FIG. 4 schematically illustrates a schematic diagram of an audio list interface according to an embodiment of the invention;

FIG. 5 schematically illustrates a schematic diagram of a playlist interface according to an embodiment of the present invention;

FIG. 6 schematically illustrates a schematic diagram of an audio playback interface according to an embodiment of the present invention;

FIG. 7 schematically illustrates a schematic diagram of another audio list interface according to an embodiment of the invention;

FIG. 8 schematically illustrates a schematic diagram of another audio playback interface in accordance with an embodiment of the present invention;

FIG. 9 schematically illustrates a schematic diagram of yet another audio playback interface in accordance with an embodiment of the present invention;

FIG. 10A schematically illustrates a schematic diagram of yet another audio playback interface in accordance with an embodiment of the present invention;

FIG. 10B schematically illustrates a schematic diagram of yet another audio playback interface in accordance with an embodiment of the present invention;

FIG. 11A schematically illustrates a schematic diagram of yet another audio playback interface in accordance with an embodiment of the present invention;

FIG. 11B schematically illustrates a schematic diagram of a user comment interface according to an embodiment of the invention;

FIG. 12 schematically illustrates a schematic diagram of another user comment interface according to an embodiment of the invention;

FIG. 13 schematically illustrates a schematic diagram of a medium according to an embodiment of the present invention;

fig. 14 schematically shows a block diagram of an audio playback apparatus according to an embodiment of the present invention;

FIG. 15 schematically illustrates a schematic diagram of a computing device according to an embodiment of the invention.

In the drawings, the same or corresponding reference numerals indicate the same or corresponding parts.

Detailed Description

The principles and spirit of the present invention will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are presented merely to enable those skilled in the art to better understand and practice the invention and are not intended to limit the scope of the invention in any way. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.

Those skilled in the art will appreciate that embodiments of the invention may be implemented as a system, apparatus, device, method, or computer program product. Thus, the invention may be embodied in the form of: complete hardware, complete software (including firmware, resident software, micro-code, etc.), or a combination of hardware and software.

According to an embodiment of the invention, an audio playing method, an audio playing device, a storage medium and a computing device are provided.

Any number of elements in the figures are for illustration and not limitation, and any naming is used for distinction only, and not for any limiting sense.

The principles and spirit of the present invention are explained in detail below with reference to several representative embodiments thereof.

Summary of The Invention

The inventor finds that the method for displaying the explanation content related to the audio, which is released by the creator of the audio, in the user comment interface in the form of text in the existing audio application program, leads to that when a user listens to a certain section of audio through the existing audio application program, the user must enter the user comment interface of the audio to see the explanation content related to the audio, which is released by the creator of the audio, so that the user touch rate of the explanation content related to the audio, which is released by the creator of the audio, is lower.

In order to solve the above problems, the present invention provides an audio playing method, apparatus, storage medium, and computing device, in which a client may first play second audio associated with first audio in response to a play start event of the first audio; and in the playing time period of the second audio, the first audio cannot be played.

Subsequently, the client may play the first audio in response to a play stop event of the second audio.

By adopting the mode, when a user listens to a certain section of audio through the client, the user can firstly listen to the explanation content related to the audio, so that the user touch rate of the explanation content related to the audio, which is issued by the audio creator, can be improved, the communication between the audio creator and the audience can be improved, and the user experience of the audio creator and the audience can be improved.

Having described the basic principles of the present invention, various non-limiting embodiments of the invention are described in detail below.

Application scene overview

It should be noted that the above application scenario is only shown for the convenience of understanding the spirit and principle of the present invention, and the embodiments of the present invention are not limited in any way. Rather, embodiments of the invention may be applied to any scenario where applicable.

According to the audio playing method, the client can respond to the playing start event of the first audio and firstly play the second audio associated with the first audio; and in the playing time period of the second audio, the first audio cannot be played. Subsequently, the client may play the first audio in response to a play stop event of the second audio.

In practical applications, the second audio may be audio recorded by the creator of the first audio for explaining the first audio, that is, the audio content of the second audio may be the explanation content related to the first audio issued by the creator of the first audio. For example, the first audio may be an original song and the second audio may be audio recorded by an author of the original song to teach an authoring background of the original song.

Exemplary method

In general, a user may install a client corresponding to a certain business activity in an electronic device that the user uses; the electronic device can be a terminal device such as a smart phone, a tablet personal computer, a notebook computer, a palm computer, an intelligent wearable device, an intelligent vehicle-mounted device or a game machine.

In this case, the client may output an interface related to the business activity to the user, so that the user may perform an interactive operation in the interface; the client may perform a business process associated with the business activity based on user interaction in the interface.

Taking a client corresponding to an audio application as an example, the client may output an audio playback interface for presenting audio being played as shown in fig. 1 to a user. The user can execute operations such as playing, pausing or switching to the next operation in the audio playing interface; the client can execute corresponding business flow for the playing audio based on the operation of the user in the audio playing interface.

As shown in fig. 1, the audio playing interface may include a plurality of controls therein, for example: a display control 101 for displaying an audio picture (e.g., a cover picture of an album to which a song belongs), a play control 102 for playing audio, a switch control 103 for switching to the next, etc. The user can execute triggering operation for the control in the audio playing interface so as to realize interaction operation in the audio playing interface.

For example, a user may perform a triggering operation in the audio playback interface for playback control 102, such as: clicking a play control 102 in the audio play interface; and the client can respond to the triggering operation to play the corresponding audio in the audio playing interface.

Referring to fig. 2, fig. 2 schematically shows a flowchart of an audio playing method according to an embodiment of the present invention. The audio playing method may include the steps of:

step S201, in response to a play start event of a first audio, playing a second audio associated with the first audio; wherein the first audio is not played in the playing time period of the second audio;

step S202, playing the first audio in response to the play stop event of the second audio.

In this embodiment, a client (e.g., a client corresponding to an audio application, i.e., a client implementing a function of the audio application) may play one piece of audio (referred to as a first audio) in response to a play start event of another piece of audio (referred to as a second audio) associated with the first audio; and in the playing time period of the second audio, the first audio cannot be played.

Specifically, a client of an audio-oriented creator may output an audio distribution interface as shown in fig. 3 to the audio creator. The creator of the first audio can upload the first audio and the second audio to be released in the audio release interface, click a release button in the audio release interface after the audio is completely uploaded, so as to send the first audio and the second audio to a background service system of the client, and the background service system stores the first audio and the second audio in an associated mode.

In this case, the client may transmit an audio acquisition request corresponding to the first audio to the background service system in response to a play start event of the first audio. When the background service system receives the audio acquisition request, the background service system can search a first audio in an audio database which is in butt joint with the background service system and a second audio which is stored in association with the first audio, and return the searched first audio and second audio to the client so as to play the first audio and the second audio by the client.

In practical applications, the client may determine that the play start event of the first audio is detected under the following two conditions:

(1) The client may output an audio list interface for presenting an audio list 401 as shown in fig. 4 to the user. For any audio in the audio list 401, the user may perform a triggering operation in the audio list interface for a display area corresponding to text representing an audio identification (e.g., audio name) of the audio, such as: clicking a display area corresponding to a text representing an audio name of the audio in the audio list interface; and when the client detects the triggering operation of the user on the display area in the audio list interface, the client can determine that the play start event of the audio is detected.

That is, the client may determine that the play start event of the first audio is detected when detecting a trigger operation of the user in the audio list interface for a display area corresponding to a text representing an audio identification of the first audio.

Taking audio 1 and audio 2 in the audio list 401 as an example, assuming that the user performs a trigger operation on the display area 402 corresponding to the text of "audio 1" in the audio list interface, the client may determine that a play start event of audio 1 is detected; assuming that the user performs a trigger operation for the display area 403 corresponding to the text of "audio 2" in the above-described audio list interface, the above-described client may determine that a play start event of audio 2 is detected.

(2) The client can sequentially play the audio in the play list according to the audio arrangement sequence in the play list. For any audio in the playlist, the client may automatically start playing the audio after the audio playing arranged in the previous bit of the audio is completed. At this time, the client may determine that a play start event of the audio is detected after the audio play arranged in the previous bit of the audio is completed.

That is, the client may determine that the play start event of the first audio is detected after the audio play arranged in the previous bit of the first audio in the playlist is completed.

Taking the playlist interface for presenting the playlist 501 as shown in fig. 5 as an example, in the playlist, the audio 2 is arranged in front of the audio 1, so that the client may automatically start playing the audio 1 after the audio 2 is played, that is, determine that a play start event of the audio 1 is detected.

In one embodiment, to avoid the user repeatedly listening to the second audio, the client may first determine whether the first audio is played for the first time in response to a play start event of the first audio. If the first audio is played for the first time, the client can play the second audio first, and respond to the play stop event of the second audio, and play the first audio again. Accordingly, if the first audio is not first played, the client may directly play the first audio.

Specifically, the client may store the history play record of the first audio in a storage space of the terminal device where the client is located. At this time, the client may determine that the first audio is played for the first time when the history play record of the first audio is not detected, and determine that the first audio is not played for the first time when the history play record of the first audio is detected.

Alternatively, the client may first determine, in response to a play start event of the first audio, whether a historical play number of times of the first audio is smaller than a preset threshold. If the historical playing times of the first audio are smaller than the threshold value, the client can play the second audio first and play the first audio again in response to the playing stop event of the second audio. Accordingly, if the historical playing times of the first audio reach the threshold value, the client may directly play the first audio.

Specifically, the client may record the historical playing number of times of the first audio in the storage space of the terminal device where the client is located, and add 1 to the recorded historical playing number of times when the first audio is played each time. At this time, the client may determine that the number of times of the history playing of the first audio is smaller than the threshold when the history playing record of the record is compared to be smaller than the threshold, and determine that the number of times of the history playing of the first audio reaches the threshold when the history playing record of the record is compared to reach the threshold.

In one embodiment, the client may output a play control corresponding to the second audio in an audio play interface corresponding to the first audio.

In this case, in one aspect, the client may stop playing the second audio in response to a trigger operation of the user on a play control corresponding to the second audio in the audio play interface corresponding to the first audio in a play period of the second audio, and start playing the first audio from a play start position of the first audio, or start playing the first audio from a play pause position of the first audio.

Or, the client may stop playing the second audio when detecting that the second audio is played to the playing end position, and start playing the first audio from the playing start position of the first audio, or start playing the first audio from the playing pause position of the first audio.

On the other hand, when the client side is in the playing time period of the first audio, the triggering operation of the user on the playing control corresponding to the second audio in the audio playing interface corresponding to the first audio is responded, the first audio is stopped to be played, and the second audio is started to be played from the playing starting position of the second audio, or the second audio is started to be played from the playing pause position of the second audio.

In practical applications, the client may play the second audio (assuming that the audio duration is 30 seconds) first in response to a play start event of the first audio (assuming that the audio duration is 4 minutes); if a trigger operation of a user on a play control corresponding to the second audio in an audio play interface corresponding to the first audio is detected for the first time in a play time period of the second audio, the second audio can be stopped being played (assuming that the second audio is already played to a position of 15 seconds at this time), and the first audio can be played from a play start position (i.e., a position of 0 minutes and 0 seconds) of the first audio; in the playing time period of the first audio, if the triggering operation of the user for the playing control is detected for the second time, the playing of the first audio can be stopped (assuming that the first audio has been played to a position of 2 minutes and 30 seconds at this time), and the playing of the second audio is started from a playing pause position (i.e. a position of 15 seconds) of the second audio, or from a playing start position (i.e. a position of 0 seconds) of the second audio; in the playing time period of the second audio, if the triggering operation of the user on the playing control is detected for the third time, or the second audio is detected to be played to the playing end position (i.e. the position of 30 seconds), the playing of the second audio can be stopped, and the playing of the first audio can be started from the playing pause position (i.e. the position of 2 minutes and 30 seconds) of the first audio, or the playing of the first audio can be started from the playing start position of the first audio.

In combination with the foregoing manner of determining that the play start event of the first audio is detected, the client may output an audio play interface corresponding to the first audio in four cases:

(1) When the client detects a triggering operation of a user on a display area corresponding to a text representing an audio identifier of the audio in an audio list interface as shown in fig. 4, the client can determine that a play start event of the first audio is detected and jump to an audio play interface corresponding to the first audio; the audio playing interface may include a playing control corresponding to the second audio.

Assuming that the first audio is audio 1 in the audio list 401 and the second audio associated with audio 1 is audio a, when detecting a trigger operation of the user on the display area 402 corresponding to the text of "audio 1" in the audio list interface, the client may determine that a play start event of audio 1 is detected, and jump to an audio play interface corresponding to audio 1 as shown in fig. 6; wherein, the audio playing interface may include a playing control 601 corresponding to audio a.

(2) The above-described client may determine that the play start event of the first audio is detected when detecting a trigger operation of the user on a display area corresponding to a text representing an audio identification of the audio in an audio list interface as shown in fig. 4. In addition, an audio play bar can be output at the bottom of the audio list interface, and partial information (such as an audio name, an audio creator, a play control, a play list display control and the like) related to the first audio is displayed in the audio play bar; the client can jump to an audio playing interface corresponding to the first audio in response to a triggering operation of a user in the audio playing column for a display area corresponding to a text representing an audio identification of the audio; the audio playing interface may include a playing control corresponding to the second audio.

Assuming that the first audio is audio 1 in the audio list 401 and the second audio associated with audio 1 is audio a, the client may determine that a play start event of audio 1 is detected when detecting a trigger operation of the user on the display area 402 corresponding to the text of "audio 1" in the audio list interface. In addition, as shown in fig. 7, an audio playing field 701 may be output at the bottom of the audio list interface, and a part of information related to audio 1 may be displayed in the audio playing field 701; the client may jump to an audio playing interface corresponding to audio 1 as shown in fig. 6 in response to a triggering operation by the user in the audio playing bar for the display area 702 corresponding to the text of "audio 1"; wherein, the audio playing interface may include a playing control 601 corresponding to audio a.

(3) The client may play the audio in an audio playing interface corresponding to the audio arranged in the previous position of the first audio in the playlist; after the audio playing is completed, the client can automatically start to play the first audio, and switch the audio playing interface corresponding to the audio into the audio playing interface corresponding to the first audio; the audio playing interface corresponding to the first audio may include a playing control corresponding to the second audio.

(4) The client may play the audio arranged in the previous position of the first audio in the play list in the audio play column; after the audio playing is completed, the client may automatically start playing the first audio, where the audio playing column may include an interface skip control corresponding to the audio playing interface of the first audio. The client can respond to the triggering operation of the user for the interface jump control in the audio list interface and jump to an audio playing interface corresponding to the first audio; the audio playing interface may include a playing control corresponding to the second audio.

In an embodiment shown, for a play control corresponding to a second audio in an audio play interface corresponding to a first audio, the client may detect, in response to a triggering operation of a user on the play control in the audio play interface, whether a duration of the triggering operation reaches a preset threshold. If the duration of the trigger operation reaches the threshold, at least one operation control corresponding to the second audio can be output in the audio playing interface.

In practical applications, the triggering operation of the user on the play control in the audio play interface may be a clicking operation on the play control in the audio play interface.

For example, assuming that the threshold preset by the technician is 2 seconds, the user may click on the play control corresponding to the second audio in the audio play interface corresponding to the first audio, and maintain the click state for the play control; the client can respond to the click operation of the user on the playing control in the audio playing interface, and detect whether the duration of the click state of the user on the playing control reaches 2 seconds or not. If the duration of the click state for the play control is maintained for 2 seconds by the user, at least one operation control corresponding to the second audio may be output in the audio play interface.

In this case, the client may perform an operation corresponding to the target operation control with respect to the second audio in response to a trigger operation of the user with respect to any one of the at least one operation control (referred to as the target operation control).

Further, in one illustrated embodiment, the operation control corresponding to the second audio output in the audio playing interface corresponding to the first audio may include a speech recognition control.

In this case, the client may perform voice recognition on the second audio in response to a trigger operation of the user on the voice recognition control, to convert the second audio into text, and output the converted text in the audio playing interface.

In another embodiment shown, the operation control corresponding to the second audio output in the audio playing interface corresponding to the first audio may include a sharing control.

In this case, the client may send the URL link with the audio playing interface to the user (referred to as the target user) selected by the user to share the first audio with in response to the user's trigger operation on the sharing control. The target user can enter the audio playing interface through the URL link, so that the first audio and the second audio can be listened to in the audio playing interface.

For example, assuming that the first audio is audio 1 and the second audio associated with audio 1 is audio a, the client may detect whether the duration of the trigger operation reaches a preset threshold in response to the trigger operation of the user on the play control 801 corresponding to audio a in the audio play interface corresponding to audio 1 as shown in fig. 8. If the duration of the triggering operation reaches the threshold, the client may output a speech recognition control 802 and a sharing control 803 corresponding to audio a in the audio playback interface. In one aspect, the client may perform voice recognition on audio a in response to a triggering operation of the user on the voice recognition control 802, so as to convert the audio a into text, and output the converted text in the audio playing interface; on the other hand, the client may send a URL link with the audio playing interface to the target user selected by the user in response to the user's trigger operation for the sharing control 803.

In one embodiment, for a play control corresponding to a second audio in an audio play interface corresponding to a first audio, the client may detect a movement track of a trigger point of a trigger operation in the audio play interface in response to a trigger operation of a user on the play control in the audio play interface.

In practical applications, the triggering operation of the user on the play control in the audio play interface may be a clicking operation on the play control in the audio play interface. At this time, the trigger point of the trigger operation may be a contact point between the user and the play control in the click operation. After the user clicks the play control in the audio play interface, the click state of the play control can be maintained, and the contact point is continuously moved in the audio play interface.

For example, the terminal device where the client is located may include a touchable screen, through which a user may use a finger to click on a play control corresponding to the second audio in an audio play interface corresponding to the first audio, and keep a click state for the play control, and slide the finger in the audio play interface to continuously move the contact point in the audio play interface.

In this case, the client may determine a moving direction and a moving distance of the trigger point based on the moving track, and adjust an audio playing progress of the second audio based on the determined moving direction and the determined moving distance.

For example, assuming that the first audio is audio 1 and the second audio associated with audio 1 is audio a, the client may respond to a triggering operation of the user on the play control 901 corresponding to audio a in the audio play interface corresponding to audio 1 as shown in fig. 9, and when detecting that the trigger point of the triggering operation moves in the audio play interface, output the play progress bar 902 corresponding to audio a in the audio play interface. In addition, the moving direction and moving distance of the trigger point may be determined based on the moving track of the trigger point in the audio playing interface, and based on the determined moving direction and moving distance, the position of the dot representing the audio playing position of the audio a in the playing progress bar 902 may be adjusted to adjust the audio playing progress of the audio a, for example: assuming that the audio duration of the audio a is 30 seconds, when the current audio a has been played to a position of 15 seconds, and the moving direction of the trigger point is determined to be moving leftwards, and when the moving distance is 1/6 of the total distance representing the audio duration of the audio a, the audio playing progress of the audio a may be backed by 5 seconds (30×1/6=5), that is, the audio playing position of the audio a is adjusted to a position of 10 seconds.

In one embodiment, the client may output the function option menu in the audio playing interface in response to a triggering operation of a user on a menu display control corresponding to the function option menu in the audio playing interface corresponding to the first audio; the function option menu may include a switch option indicating a presentation state of a play control corresponding to the second audio.

In practical applications, the default state of the switch option is to instruct to turn on the play control, that is, the default state is to display the play control corresponding to the second audio in the audio play interface corresponding to the first audio.

Accordingly, when the user switches the switch option to indicate to close the playing control, the playing control can be hidden or closed, that is, the playing control corresponding to the second audio is not displayed in the audio playing interface corresponding to the first audio.

For example, assuming that the first audio is audio 1 and the second audio associated with audio 1 is audio a, the client may respond to the triggering operation of the user on the menu display control 1001 corresponding to the function option menu in the audio playing interface corresponding to audio 1 as shown in fig. 10A and 10B, and output the function option menu 1002 in the audio playing interface; among them, a switch option 1004 indicating the presentation state of the play control 1003 corresponding to the audio a may be included in the function menu option 1002. As shown in fig. 10A, the default state of the switch option 1004 is to indicate that the play control is open, at which time the play control 1003 may be presented in the audio play interface. Accordingly, as shown in fig. 10B, when the user switches the switch option 1004 to indicate to close the play control, the play control 1003 may be hidden or closed, at which time the play control 1003 is no longer presented in the audio play interface.

In one embodiment, the client may jump to the user comment interface in response to a triggering operation of the user on an interface jump control corresponding to the user comment interface, and output a play control corresponding to the second audio in the user comment interface.

In this case, the client may play the second audio in response to a triggering operation of the user on the play control in the user comment interface.

Further, in the illustrated embodiment, to remind the user to listen to the second audio, it may be determined whether the second audio has been played before the play control corresponding to the second audio is output in the user comment interface. If the second audio has not been played, the play control may be output in the user comment interface, and an unplayed flag may be added to the play control, for example: a dot mark representing that the playing control has not been played is added to the playing control. If the second audio has been played, the play control may be output directly in the user comment interface.

Specifically, the client may store the history play record of the second audio in the storage space of the terminal device where the client is located. At this time, the client may determine that the second audio has not been played when the history play record of the second audio is not detected, and determine that the second audio has been played when the history play record of the second audio is detected.

For example, assuming that the first audio is audio 1 and the second audio associated with audio 1 is audio a, the client may jump to the user comment interface shown in fig. 11B in response to the triggering operation of the user for the interface jump control 1101 corresponding to the user comment interface in the audio playing interface corresponding to audio 1 shown in fig. 11A, and output the play control 1102 corresponding to audio a in the user comment interface. Assuming that the audio a is not yet played at this time, a dot mark 1103 indicating that the audio a is not yet played may also be added to the play control 1102 in the user comment interface.

In an embodiment shown, for a play control corresponding to the second audio in the user comment interface, the client may respond to a trigger operation of the user for the play control in the user comment interface, and detect whether a duration of the trigger operation reaches a preset threshold. If the duration of the trigger operation reaches the threshold, at least one operation control corresponding to the second audio may be output in the user comment interface.

Further, in an embodiment shown, the operation control corresponding to the second audio output in the user comment interface may include a voice recognition control.

In this case, the client may perform voice recognition on the second audio in response to a triggering operation of the user on the voice recognition control, to convert the second audio into text, and output the converted text in the user comment interface.

In an embodiment shown, for a play control corresponding to the second audio in the user comment interface, the client may respond to a trigger operation of the user for the play control in the user comment interface, and detect a movement track of a trigger point of the trigger operation in the audio play interface.

In one embodiment, the client may further output at least one operation control corresponding to the second audio in the user comment interface.

Further, in an embodiment shown, the operation control corresponding to the second audio output in the user comment interface may include a comment reply control and/or a comment praise control. The user can trigger the comment reply control in the user comment interface to reply to the second audio; or, the user may trigger the comment approval control in the user comment interface to approve the comment for the second audio.

For example, assuming that the first audio is audio 1 and the second audio associated with audio 1 is audio a, the client may output a play control 1201 corresponding to audio a, and a comment reply control 1202 and a comment approval control 1203 corresponding to the second audio in the user comment interface as shown in fig. 12.

In summary, according to the audio playing method of the embodiment of the present invention, the client may first play the second audio associated with the first audio in response to the play start event of the first audio; and in the playing time period of the second audio, the first audio cannot be played. Subsequently, the client may play the first audio again in response to a play stop event of the second audio. By adopting the mode, when a user listens to a certain section of audio through the client, the user can firstly listen to the explanation content related to the audio, so that the user touch rate of the explanation content related to the audio, which is issued by the audio creator, can be improved, the communication between the audio creator and the audience can be improved, and the user experience of the audio creator and the audience can be improved.

Exemplary Medium

Having described the method of an exemplary embodiment of the present invention, next, a medium of an exemplary embodiment of the present invention will be described with reference to fig. 13.

In the present exemplary embodiment, the above-described method may be implemented by a program product, such as a portable compact disc read only memory (CD-ROM) and including program code, and may be run on a device, such as a personal computer. However, the program product of the present invention is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The computer readable signal medium may include a data signal propagated in baseband or as part of a carrier wave with readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RE, etc., or any suitable combination of the foregoing.

Program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the C programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected via the Internet using an Internet service provider).

Exemplary apparatus

Having described the medium of an exemplary embodiment of the present invention, next, an apparatus of an exemplary embodiment of the present invention will be described with reference to fig. 14.

Fig. 14 schematically shows a block diagram of an audio playback apparatus according to an embodiment of the present invention. The audio playing device may include:

a first playing module 1401 for playing second audio associated with a first audio in response to a play start event of the first audio; wherein the first audio is not played in the playing time period of the second audio;

a second playing module 1402, configured to play the first audio in response to a play stop event of the second audio.

Optionally, the first playing module 1401 is specifically configured to:

The second playing module 1402 is specifically configured to:

the second playing module 1402 is further configured to:

Optionally, the apparatus further comprises:

a first detection module 1403, configured to, in response to a trigger operation of a user on the play control, detect whether a duration of the trigger operation reaches a preset threshold;

a first output module 1404, configured to output, in the audio playing interface, at least one operation control corresponding to the second audio when the duration of the triggering operation reaches the threshold;

a first execution module 1405, configured to execute, for the second audio, an operation corresponding to a target operation control in response to a triggering operation of a user on any target operation control in the at least one operation control.

Optionally, the operation control comprises a voice recognition control;

the first execution module 1405 is specifically configured to:

Optionally, the operation control comprises a sharing control;

the first execution module 1405 is specifically configured to:

Optionally, the apparatus further comprises:

a second detection module 1406, responsive to a trigger operation of a user on the play control, for detecting a movement track of a trigger point of the trigger operation in the audio play interface;

a first adjusting module 1407, configured to determine a movement direction and a movement distance of the trigger point based on the movement track, and adjust an audio playing progress of the second audio based on the movement direction and the movement distance.

Optionally, the apparatus further comprises:

a second output module 1408, configured to output, in the audio playing interface, a function option menu in response to a trigger operation of a user on a menu display control corresponding to the function option menu in the audio playing interface; the function option menu comprises a switch option for indicating the display state of the play control;

and a closing module 1409, configured to hide or close the play control when the user switches the switch option to instruct to close the play control.

Optionally, the apparatus further comprises:

the skip module 1410 is configured to skip to the user comment interface in response to a triggering operation of the user on the interface skip control corresponding to the user comment interface, and output a play control corresponding to the second audio in the user comment interface;

And a third playing module 1411, configured to respond to a triggering operation of the user on the playing control, and play the second audio.

Optionally, the skip module 1410 is specifically configured to:

determining whether the second audio has been played;

Optionally, the apparatus further comprises:

a third detection module 1412, configured to, in response to a trigger operation of the user on the play control, detect whether a duration of the trigger operation reaches a preset threshold;

a third output module 1413, configured to output at least one operation control corresponding to the second audio in the user comment interface when the duration of the trigger operation reaches the threshold;

and a second execution module 1414, configured to execute, in response to a trigger operation of a user on any target operation control in the at least one operation control, an operation corresponding to the target operation control with respect to the second audio.

Optionally, the operation control comprises a voice recognition control;

the second execution module 1414 is specifically configured to:

Optionally, the apparatus further comprises:

a fourth detection module 1415, configured to detect a movement track of a trigger point of a trigger operation in the user comment interface in response to a trigger operation of a user on the play control;

a second adjustment module 1416, configured to determine a movement direction and a movement distance of the trigger point based on the movement track, and adjust an audio playing progress of the second audio based on the movement direction and the movement distance.

Optionally, the apparatus further comprises:

a fourth output module 1417 for outputting at least one operation control corresponding to the second audio in the user comment interface;

and a third executing module 1418, configured to execute, for the second audio, an operation corresponding to the target operation control in response to a triggering operation of the user for any target operation control in the at least one operation control.

Exemplary computing device

Having described the methods, media, and apparatus of exemplary embodiments of the present invention, a computing device of exemplary embodiments of the present invention is next described with reference to FIG. 15.

The computing device 1500 shown in fig. 15 is but one example and should not be taken as limiting the functionality and scope of use of embodiments of the invention.

As shown in fig. 15, computing device 1500 is embodied in the form of a general purpose computing device. Components of computing device 1500 may include, but are not limited to: the at least one processing unit 1501, the at least one memory unit 1502, and a bus 1503 connecting the different system components (including the processing unit 1501 and the memory unit 1502).

Bus 1503 includes a data bus, a control bus, and an address bus.

The storage unit 1502 may include readable media in the form of volatile memory, such as Random Access Memory (RAM) 15021 and/or cache memory 15022, and may further include readable media in the form of non-volatile memory, such as Read Only Memory (ROM) 15023.

The storage unit 1502 may also include a program/utility 15025 having a set (at least one) of program modules 15024, such program modules 15024 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment.

The computing device 1500 may also communicate with one or more external devices 1504 (e.g., keyboard, pointing device, etc.).

Such communication may occur through an input/output (I/O) interface 1505. Moreover, the computing device 1500 may also communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network, for example, the Internet, through the network adapter 1506. As shown in fig. 15, the network adapter 1506 communicates with other modules of the computing device 1500 over bus 1503. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with computing device 1500, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.

It should be noted that although several units/modules or sub-units/modules of an audio playback apparatus are mentioned in the above detailed description, this division is merely exemplary and not mandatory. Indeed, the features and functionality of two or more units/modules described above may be embodied in one unit/module in accordance with embodiments of the present invention. Conversely, the features and functions of one unit/module described above may be further divided into ones that are embodied by a plurality of units/modules.

Furthermore, although the operations of the methods of the present invention are depicted in the drawings in a particular order, this is not required to either imply that the operations must be performed in that particular order or that all of the illustrated operations be performed to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step to perform, and/or one step decomposed into multiple steps to perform.

While the spirit and principles of the present invention have been described with reference to several particular embodiments, it is to be understood that the invention is not limited to the disclosed embodiments nor does it imply that features of the various aspects are not useful in combination, nor are they useful in any combination, such as for convenience of description. The invention is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Claims

1. An audio playing method, which is applied to a client, comprises the following steps:

Playing the first audio in response to a play stop event of the second audio; wherein, the audio playing interface corresponding to the first audio comprises a playing control corresponding to the second audio;

responding to the triggering operation of a user for an interface jump control corresponding to a user comment interface, jumping to the user comment interface, determining whether the second audio is played or not, outputting the play control in the user comment interface if the second audio is not played yet, and adding an unrevealed mark for the play control; responding to the triggering operation of the user on the playing control, and playing the second audio;

responding to the triggering operation of a user on the playing control in the audio playing interface or the user comment interface, and detecting whether the duration of the triggering operation reaches a preset threshold value; outputting at least one operation control corresponding to the second audio in the same interface if the duration of the triggering operation reaches the threshold; responding to the triggering operation of a user on any target operation control in the at least one operation control, and executing the operation corresponding to the target operation control on the second audio;

Responding to the triggering operation of a user on the playing control in the audio playing interface, and detecting the moving track of the triggering point of the triggering operation in the audio playing interface; determining the moving direction and the moving distance of the trigger point based on the moving track, and adjusting the audio playing progress of the second audio based on the moving direction and the moving distance;

responding to the triggering operation of a user on a menu display control corresponding to a function option menu in the audio playing interface, and outputting the function option menu in the audio playing interface; the function option menu comprises a switch option for indicating the display state of the play control; and hiding or closing the play control when the user switches the switch option to indicate to close the play control.

2. The method of claim 1, the playing in response to the first audio begins

-playing a second audio associated with the first audio, comprising:

3. The method of claim 1, the playing the first audio in response to a play stop event of the second audio, comprising:

when the playing time period of the second audio is within, responding to the triggering operation of a user on the playing control, stopping playing the second audio, and starting to play the first audio from the playing starting position of the first audio or starting to play the first audio from the playing pause position of the first audio; or alternatively, the process may be performed,

4. The method of claim 1, the method further comprising:

and when the playing time period of the first audio is within, responding to the triggering operation of a user on the playing control, stopping playing the first audio, and starting to play the second audio from the playing starting position of the second audio or starting to play the second audio from the playing pause position of the second audio.

5. The method of claim 1, the operational control comprising a speech recognition control;

6. The method of claim 1, the operation control comprising a sharing control;

7. The method of claim 1, the operational control comprising a speech recognition control;

8. The method of claim 1, the method further comprising:

9. The method of claim 1, the method further comprising:

outputting at least one operation control corresponding to the second audio in the user comment page;

10. The method of claim 9, wherein the operational controls comprise comment reply controls,

and/or comment endorsement controls.

11. An audio playback device, the device comprising:

the second playing module is used for responding to the playing stopping event of the second audio and playing the first audio; wherein, the audio playing interface corresponding to the first audio comprises a playing control corresponding to the second audio;

the first detection module is used for responding to the triggering operation of the user on the playing control in the audio playing interface and detecting whether the duration of the triggering operation reaches a preset threshold value; the first output module is used for outputting at least one operation control corresponding to the second audio in the audio playing interface when the duration of the triggering operation reaches the threshold value; the first execution module is used for responding to the triggering operation of a user on any target operation control in the at least one operation control and executing the operation corresponding to the target operation control on the second audio;

The jump module is used for responding to the triggering operation of a user for an interface jump control corresponding to the user comment interface, jumping to the user comment interface, determining whether the second audio is played or not, outputting the play control in the user comment interface if the second audio is not played yet, and adding an unrevealed mark for the play control; the third playing module is used for responding to the triggering operation of the user on the playing control and playing the second audio;

the third detection module is used for responding to the triggering operation of the user on the play control in the user comment interface and detecting whether the duration of the triggering operation reaches a preset threshold value; the third output module is used for outputting at least one operation control corresponding to the second audio in the user comment interface when the duration of the triggering operation reaches the threshold; the second execution module is used for responding to the triggering operation of a user on any target operation control in the at least one operation control and executing the operation corresponding to the target operation control on the second audio;

the second detection module is used for responding to the triggering operation of the user on the playing control in the audio playing interface and detecting the moving track of the triggering point of the triggering operation in the audio playing interface; a first adjustment module for determining the movement direction of the trigger point based on the movement track

The moving distance is used for adjusting the audio playing progress of the second audio based on the moving direction and the moving distance;

the second output module is used for responding to the triggering operation of a user on a menu display control corresponding to a function option menu in the audio playing interface and outputting the function option menu in the audio playing interface; the function option menu comprises a switch option for indicating the display state of the play control; and the closing module is used for hiding or closing the play control when the user switches the switch option to instruct to close the play control.

12. The apparatus of claim 11, wherein the first playing module is specifically configured to:

13. The apparatus of claim 11, wherein the second playing module is specifically configured to:

14. The apparatus of claim 11, the second playback module further to:

15. The apparatus of claim 11, the operational control comprising a speech recognition control;

the first execution module is specifically configured to:

16. The apparatus of claim 11, the operational control comprising a sharing control;

the first execution module is specifically configured to:

17. The apparatus of claim 11, the operational control comprising a speech recognition control;

the second execution module is specifically configured to:

18. The apparatus of claim 11, the apparatus further comprising:

19. The apparatus of claim 11, the apparatus further comprising:

20. The apparatus of claim 19, the operation control comprises a comment reply control, and/or a comment endorsement control.

21. A computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of any of claims 1-10.

22. A computing device, comprising:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to implement the method of any of claims 1-10 by executing the executable instructions.