CN113050911A

CN113050911A - Audio playing method and audio playing device

Info

Publication number: CN113050911A
Application number: CN201911374732.6A
Authority: CN
Inventors: 黄洽南
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2019-12-27
Filing date: 2019-12-27
Publication date: 2021-06-29
Anticipated expiration: 2039-12-27
Also published as: CN113050911B

Abstract

An audio playing method and an audio playing apparatus are disclosed. And receiving second audio data to be played in the process of playing the first audio data. Determining a control strategy according to the type of the first audio data and/or the type of the second audio data. And controlling the playing of the first audio data and the second audio data according to the control strategy. The second audio data may be inserted in a case where the priority of the second audio data is higher than the priority of the first audio data. The state switching of the first audio data and the second audio data may be controlled according to a control policy. Therefore, under the condition that various types of audio contents exist, the audio playing can be controlled, and reasonable and efficient switching is realized.

Description

Audio playing method and audio playing device

Technical Field

The present disclosure relates to audio playback management, and in particular, to an audio playback method and an audio playback apparatus.

Background

With the popularization of artificial intelligence, the types of contents processed by equipment are more and more, and the situation that the same equipment plays multiple audios is more and more common.

For example, the same device with a speaker may be in a business scenario of music playing, news broadcasting, joke, conversation (TTS), alarm clock, countdown, etc., and the played content data is music, news, joke, conversation voice, alarm tone, alert tone, etc., respectively.

Thus, the device side should support multiple audio plays and multiple service scenarios, and accordingly, different end-side processing capabilities are required.

The audio contents in different service scenes may enter a playing state at the same time, or in the playing process of one audio content, another audio content may be received. Control over the playback of such audio content is required.

In a conventional voice switching management system, a common processing method is to forcibly interrupt currently played audio content in order to solve the problem that a user selects audio output.

The disadvantages of this handover processing method are mainly: it is not suitable for selective output of complex audio channels; non-priority selection logic; there is no reasonable decision in the aspect of recovery logic, and the user experience is poor.

Therefore, there is still a need for a method that can reasonably control multiple types of audio content.

Disclosure of Invention

One technical problem to be solved by the present disclosure is to provide an audio playing scheme, which can control audio playing in the presence of multiple types of audio contents, and implement reasonable and efficient switching.

According to a first aspect of the present disclosure, there is provided an audio playing method, including: playing the first audio data; receiving second audio data to be played; determining a control strategy according to the type of the first audio data and/or the type of the second audio data; and controlling the playing of the first audio data and the second audio data according to the control strategy.

Optionally, priorities are respectively set for multiple types of audio data, and the control policy includes: the second audio data is inserted in a case where the priority of the second audio data is higher than the priority of the first audio data.

Optionally, the control policy for inserting the second audio data is determined according to the type of the first audio data and/or the type of the second audio data from at least one of: ending the playing of the first audio data; pausing the playing of the first audio data and resuming the playing of the first audio data after the playing of the second audio data is finished; continuing to play the first audio data, and simultaneously inserting second audio data, wherein the playing volume of the second audio data is higher than that of the first audio data; and inserting the second audio data in the play queue before the audio data with lower priority than the second audio data.

Optionally, the step of controlling the playing of the first audio data and the second audio data according to the control policy comprises: and respectively maintaining states for the first audio data and the second audio data, and controlling the state switching of the first audio data and the second audio data according to a control strategy.

Optionally, the status comprises at least one of: waiting; playing; pausing; insufficient cache; stopping; and (6) ending.

Optionally, the control policy for the state switching is determined from at least one of the following according to the type of the first audio data and/or the type of the second audio data: maintaining the first audio data in a playing state, and putting the second audio data into a playing queue to enable the second audio data to be in a waiting state; switching the playing state of the first audio data to pause, and enabling the second audio data to enter the playing state; switching the playing state of the first audio data to be finished, and enabling the second audio data to enter the playing state; and maintaining the first audio data in a playing state, and enabling the second audio data to enter the playing state, so that the first audio data and the second audio data are played simultaneously.

Optionally, when the first audio data is of the continuous interest type, switching the playing state of the first audio data to pause, and enabling the second audio data to enter the playing state; and when the first audio data is of the short-time interest type, switching the playing state of the first audio data to be finished, and enabling the second audio data to enter the playing state.

Optionally, the persistent interest type includes audio content and/or audiovisual content; and/or the short interest type includes a conversation and/or a reminder.

Optionally, the method further comprises: acquiring audio playing priorities set by a user for one or more audio playing events, wherein the step of determining a control strategy according to the type of the first audio data and/or the type of the second audio data comprises the following steps: and determining a control strategy according to the audio playing priority of the audio playing event to which the first audio data and the second audio data belong.

Optionally, the second audio data is received in response to a request by a user.

Optionally, different audio channels are used to enable playback of different types of audio data, respectively.

According to a second aspect of the present disclosure, there is provided an audio playing method, including: acquiring a play control parameter set by a user, wherein the play control parameter is used for representing the play duration and/or the play position of a second audio play event in the play process of a first audio play event; playing first audio data corresponding to the first audio playing event; receiving second audio data to be played corresponding to a second audio playing event; and controlling the playing of the first audio data and the second audio data according to the playing control parameter.

According to a third aspect of the present disclosure, there is provided an audio playing method, including: acquiring audio playing planning information of one or more established time periods, wherein the audio playing planning information is used for representing audio playing events needing to be executed in the established time periods; receiving second audio playing data corresponding to the audio playing event represented by the audio playing planning information; and responding to the current time reaching the set time period, and playing second audio playing data corresponding to the audio playing event represented by the audio playing planning information of the set time period.

Optionally, the method further comprises: playing the first audio data before the current time reaches the set time period; and stopping playing the first audio data in response to the current time reaching the set time period.

According to a fourth aspect of the present disclosure, there is provided an audio playing method, including: acquiring a play control parameter set by a user, wherein the play control parameter is used for representing the play duration and/or the play position of a second audio play event in the play process of a first audio play event; and according to the playing control parameter, issuing first audio data and second audio data which accord with the playing sequence represented by the playing control parameter to the audio playing device, wherein the first audio data is audio data corresponding to the first audio playing event, and the second audio data is audio data corresponding to the second audio playing event.

According to a fifth aspect of the present disclosure, there is provided an audio playing method, comprising: playing the first audio data; receiving second audio data to be played; receiving a control strategy which is issued by a server and determined according to the type of the first audio data and/or the type of the second audio data; and controlling the playing of the first audio data and the second audio data according to the control strategy.

According to a sixth aspect of the present disclosure, there is provided an audio playing method, comprising: issuing first audio data to an audio playing device; issuing second audio data to be played to an audio playing device; determining a control strategy according to the type of the first audio data and/or the type of the second audio data; and issuing a control strategy to the audio playing device.

According to a seventh aspect of the present disclosure, there is provided an audio playback apparatus comprising: playing means for playing the audio data; the receiving device is used for receiving second audio data to be played while playing the first audio data; the decision-making device is used for determining a control strategy according to the type of the first audio data and/or the type of the second audio data; and a control device for controlling the playing of the first audio data and the second audio data according to the control strategy.

According to an eighth aspect of the present disclosure, there is provided an audio playback apparatus comprising: the device comprises an acquisition device and a playing device, wherein the acquisition device is used for acquiring a playing control parameter set by a user, and the playing control parameter is used for representing the playing time length and/or the playing position of a second audio playing event in the playing process of a first audio playing event; the playing device is used for playing first audio data corresponding to the first audio playing event; the receiving device is used for receiving second audio data to be played corresponding to the second audio playing event; and the control device is used for controlling the playing of the first audio data and the second audio data according to the playing control parameter.

According to a ninth aspect of the present disclosure, there is provided an audio playing device comprising: the device comprises an acquisition device, a processing device and a processing device, wherein the acquisition device is used for acquiring audio playing planning information of one or more established time periods, and the audio playing planning information is used for representing audio playing events needing to be executed in the established time periods; the receiving device is used for receiving second audio playing data corresponding to the audio playing event represented by the audio playing planning information; and the playing device is used for responding to the current time reaching the set time period and playing the second audio playing data corresponding to the audio playing event represented by the audio playing planning information of the set time period.

According to a tenth aspect of the present disclosure, there is provided a server comprising: the device comprises an acquisition device and a playing device, wherein the acquisition device is used for acquiring a playing control parameter set by a user, and the playing control parameter is used for representing the playing time length and/or the playing position of a second audio playing event in the playing process of a first audio playing event; and the issuing device is used for issuing first audio data and second audio data which accord with the playing sequence represented by the playing control parameters to the audio playing device according to the playing control parameters, wherein the first audio data is audio data corresponding to the first audio playing event, and the second audio data is audio data corresponding to the second audio playing event.

According to an eleventh aspect of the present disclosure, there is provided an audio playing device comprising: playing means for playing the first audio data; the first receiving device is used for receiving second audio data to be played; the second receiving device is used for receiving a control strategy which is sent by the server and determined according to the type of the first audio data and/or the type of the second audio data; and a control device for controlling the playing of the first audio data and the second audio data according to the control strategy.

According to a twelfth aspect of the present disclosure, there is provided a server comprising: the issuing device is used for issuing the first audio data and the second audio data to be played to the audio playing device; and the decision device is used for determining the control strategy according to the type of the first audio data and/or the type of the second audio data, wherein the issuing device also issues the control strategy to the audio playing device.

According to a thirteenth aspect of the present disclosure, there is provided a computing device comprising: a processor; and a memory having executable code stored thereon, which when executed by the processor, causes the processor to perform the method of any of the first to sixth aspects as described above.

According to a twelfth aspect of the present disclosure, there is provided a non-transitory machine-readable storage medium having stored thereon executable code, which when executed by a processor of an electronic device, causes the processor to perform the method of any of the first to sixth aspects described above.

Therefore, under the condition that various types of audio contents exist, the audio playing can be controlled, and reasonable and efficient switching is realized.

Drawings

The above and other objects, features and advantages of the present disclosure will become more apparent by describing in greater detail exemplary embodiments thereof with reference to the attached drawings, in which like reference numerals generally represent like parts throughout.

Fig. 1 shows a schematic diagram of an audio playback scheme of the present disclosure.

Fig. 2 is a schematic flow chart of an audio playing method of the present disclosure.

Fig. 3 is a schematic block diagram of an audio playback device that may be used to implement the audio playback scheme of the present disclosure.

Fig. 4 is a schematic diagram of switching between states of audio data.

Fig. 5 shows a number of examples of audio data control strategies.

Fig. 6 shows a schematic block diagram of an audio playback apparatus according to another embodiment of the present disclosure.

Fig. 7 shows a schematic block diagram of a server according to an embodiment of the present disclosure.

Fig. 8 shows a schematic block diagram of an audio playback apparatus according to another embodiment of the present disclosure.

Fig. 9 shows a schematic block diagram of a server according to another embodiment of the present disclosure.

Fig. 10 shows a schematic block diagram of an audio playback apparatus according to another embodiment of the present disclosure.

Fig. 11 is a schematic structural diagram of a computing device that can be used to implement the audio playing method according to an embodiment of the present invention.

Detailed Description

Preferred embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While the preferred embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

The user may speak into the microphone. After the device is awakened, speech received by the microphone is processed and may then be transmitted to the server. These voices may include requests for voices, requests to perform certain device control operations, or plays certain content, or makes certain feedback such as audio feedback, etc.

The server processes the received speech, such as text recognition and natural language understanding. From the results of the recognition and understanding, the user's intent is determined.

When the user's intention corresponds to the playing of certain audio data, the corresponding audio data may be issued to the device, or the user may be instructed to acquire the corresponding audio data.

Fig. 1 shows a case where a server performs text recognition and natural language understanding on a voice and issues corresponding audio data. It should be understood, however, that the operations of text recognition, natural language understanding, audio data acquisition may also be performed by the device itself, a local control device, or other device.

Audio data delivered by a server or from other audio sources may be classified into a number of types.

For example, audio data may be classified as: dialog (T: TTS), reminder (P: PlayOnce), audio content (U: URL), audiovisual content or what is called "Screen content" (S: Screen).

It should be understood that other classifications may also be made or included.

In some embodiments, different channels may be used to enable different types of audio data to be played, respectively. Alternatively, in some embodiments, the audio data may also be classified based on the channel used.

For example, a dialog channel, a reminder channel, an audio channel, and an audio-video channel may be used to implement the playing of the dialog, the reminder, the audio content, and the audio-video content, respectively.

The dialog channel corresponds to the end-side processing capabilities of the Voice Input (Voice Input) and the Voice Output (Voice Output). And responding to a voice request of a user or when the device executes a voice instruction for broadcasting, and enabling the conversation channel to enter an active state.

The alert channel corresponds to alert (Alerts) end-side processing capabilities. Reminders include timed reminders such as alarms and reminders issued in response to the occurrence of certain events. The alert channel enters an active state when, for example, an alert alarm rings.

The Audio channel corresponds to the Audio Player (Audio Player) side processing capability. The audio channel enters an active state when, for example, audio (music, news, audio assets) is played.

The audio/Video channel, which may also be referred to as an on-screen channel, corresponds to independently applied end-side processing capabilities of Video players (Video players), Video telephony (IM), and the like. When, for example, playing a band image, the on-screen channel enters an active state.

In the case where there are a plurality of audio data to be played, the play queue may be used for management.

The play queue can be controlled according to a control strategy, and particularly, the sequencing of the audio data in the play queue can be controlled.

Corresponding control strategies can be respectively formulated for various types of audio data. The control policy may include a control policy for a single audio data, and may also include a control policy for a combination of a plurality of audio data.

The control strategy corresponding to various types of audio data can be preset. In addition, the control policy may also be set or modified in response to a policy setting instruction from the server. Alternatively, the control policy may be set or modified in response to a policy setting instruction of a local user.

Accordingly, corresponding control strategies can be executed on various types of audio data, and corresponding audio data contents can be played through the loudspeaker. Therefore, seamless reasonable and fast switching between audio data contents can be realized.

As an example, an audio playback player configured by a user for one or more audio playback events may be obtained, so that the control policy may be determined according to the audio playback priorities of the audio playback events to which the first audio data and the second audio data belong. The audio playing event may include, but is not limited to, a dialog event, a reminder event, an audio event, and an on-screen event, which correspond to the above-mentioned dialog channel, reminder channel, audio channel, and on-screen channel, respectively.

Next, the audio playing method of the present disclosure is described by describing a control flow of the present disclosure when one audio data content is played and another audio content is received.

As shown in fig. 3, the audio playing device 300 may include a playing device 310, a receiving device 320, a decision device 330, and a control device 340.

The playing device 310 is used for playing audio data. The receiving means 320 is used for receiving audio data. The decision means 330 is used to determine the control strategy to be currently employed. The control means 340 is arranged to implement the determined control strategy.

As shown in fig. 2, in step S210, the first audio data may be played, for example, through the playing device 310.

In the process of playing the first audio data, for example, in response to a request of a user (e.g., an inquiry or a content playing request), or in response to a predetermined event (e.g., an event scheduled to be reminded, etc.), or in response to a predetermined condition (e.g., a predetermined condition for a reminder item, etc.) being reached, in step S220, new second audio data to be played may be received, for example, through the receiving device 320.

It should be understood that "first" and "second" are used herein only for the purpose of distinguishing between the expressions.

At this time, it is necessary to determine how to control the control of the first audio data being played and the second audio data desired to be played, so as to better meet the user's desire and provide a better user experience.

Then, in step S230, a control strategy to be currently adopted may be determined, for example, by the decision device 330, according to the type of the first audio data and/or the type of the second audio data. The control policy is determined for the first audio data and the second audio data. The control strategies of the first audio data and the second audio data may be set by a user, that is, the control strategies set by the user for the first audio data and the second audio data may be obtained, where the control strategies are used to represent the playing strategies of the first audio data and the second audio data.

After determining the control strategy, in step S240, the playing of the first audio data and the second audio data may be controlled according to the control strategy, for example, by the control device 340.

As an aspect of the control policy, priorities may be set for a plurality of types of audio data, respectively. Accordingly, each channel also has a respective priority.

If multiple channels are active at the same time (e.g. an alarm ring while music is being played), the highest priority channel should be in the foreground (forkround) and the other low priority channels should be moved to the background (background).

And after the playing channel with the highest priority finishes playing and exits from the active state, the playing channel with the next priority is moved from the background to the foreground.

Moving to the background playback channel can pause the playback, can mute the playback, and in some cases can end the playback directly.

As an example, the priority of several channels playing simultaneously may be as follows:

the conversation channel is larger than the reminding channel, and the audio channel is larger than the screen display channel.

I.e. the dialog channel has the highest priority, followed by the reminder channel. The audio channel and the on-screen display channel have the same priority and are lower than the priority of the reminding channel.

Specifically, in the case where the priority of the new second audio data is higher than that of the first audio data being played, the second audio data may be inserted.

The control policy of the operation of inserting the second audio data may be different depending on the type of the first audio data and/or the type of the second audio data, and there may be various cases, for example, as follows.

When the first audio data belongs to the short-time interest type, the playing of the first audio data may be ended and the second audio data may be played.

The short interest type may refer to audio data that the user is interested in only a short time at the present time, and the user is not interested after the end of the current interest period. For example, the short interest types may include conversations, reminders, and the like.

For example, in the case where the first audio data is a reminder audio such as an alarm clock, when the user notices the reminder, it is no longer necessary to pay attention to it continuously.

For another example, during a dialog between a user and a device, the first audio data is the audio data replied in response to a user query, and the user is only interested currently, and after the user issues a new indication, the current dialog content of the user can be considered to be no longer interested.

When the first audio data belongs to the continuous interest type, the playing of the first audio data can be paused, and the playing of the first audio data can be resumed after the playing of the second audio data is finished.

The persistent interest type may refer to audio data that a user is generally interested in the entire content of the audio data, and the user's interest in such audio data is generally not terminated by a short interruption. For example, the persistent interest types may include audio content and audiovisual content, etc.

For example, when the first audio data is music, the music is being played, the user talks to the device, inquires about weather forecast, and then receives the second audio data about the weather forecast. At this point, music playback may be paused with the weather forecast interspersed. After the weather forecast is broadcast, the music can be resumed.

In some cases, the first audio data may also continue to be played while the second audio data is being inserted. In other words, the first audio data and the second audio data are simultaneously played in superposition.

For example, the playback volume of the second audio data may be made higher than the playback volume of the first audio data. For example, the playback volume of the first audio data may be made to fade.

In other cases, the playing of the first audio data may be continued, in other words without interrupting or interfering with the playing of the first audio data, but the second audio data is inserted in the play queue just before the audio data having a lower priority than the second audio data.

The playback control of each audio data can be realized by state switching control.

In other words, the status may be maintained separately for each audio data, e.g., the first audio data and the second audio data. Accordingly, the state switching of the first audio data and the second audio data may be controlled according to the control policy.

The status may include waiting, playing, pausing, buffer starving, stopping, ending, etc.

The control strategy of the state switching is determined according to the type of the first audio data and/or the type of the second audio data.

For example, in a case where the first audio data needs to be completely played and the playing of the second audio data is not very urgent, or in a case where the priority of the second audio data is lower than that of the first audio data, for example, the first audio data may be maintained in a playing state, and the second audio data may be put into a play queue to be in a waiting state.

For example, when the first audio data is of the above-mentioned continuous interest type, the playing state of the first audio data may be switched to pause, so that the second audio data enters the playing state. For example, when the speaker device is playing music, the user wakes up the speaker and asks "what the weather is". After the sound box responds to the weather information, the music needs to be played continuously.

For example, when the first audio data is of the above-mentioned short-time interest type, the playing state of the first audio data may be switched to end, so that the second audio data enters the playing state. For example, when the speaker device is playing weather information, the user wakes up the speaker and asks "who Liu De Hua is". After the sound box answers and plays the Liu De Hua information, the weather information before the playing is not played any more. For another example, when the speaker device is playing an alarm clock, the user wakes up the speaker and asks "i want to listen to a song". After the sound box responds to play music, the previous alarm clock is not played any more.

For another example, in a case where the first audio data and the second audio data can be played without affecting each other, the first audio data can be maintained in a playing state, and the second audio data is brought into the playing state, so that the first audio data and the second audio data are played simultaneously.

Fig. 4 is a schematic diagram of switching between states of audio data.

For the audio stream (audio data) in the waiting state, when a play instruction is received, the playback state is switched to, and playback is started.

On the other hand, in the case where any problem (playback failure) occurs in the playback of the audio stream in the playback state, the playback state is switched to the stop state.

And for the audio stream in the playing state, when a stop instruction is received or a CLEAR queue instruction CLEAR _ ALL is received, switching to the stop state.

On the other hand, for the audio stream in the stopped state, when a play instruction is received, the audio stream is switched to the play state, and play is started.

For the audio stream (first audio data) in the playing state, when the conversation/reminding channel enters the active state after receiving the second audio data of the conversation/reminding type, the first audio data is temporarily switched to the pause state, and the playing is paused.

On the other hand, after the inserted second audio data is played, the first audio data in the pause state is switched to the play state, and the playing is resumed.

For the audio stream in the playing state, when the buffer data is used up and the playing starts to pause, the audio stream is switched to the buffer shortage state.

On the other hand, after the necessary buffering is completed, the playback is stopped, switched to the playback state, and the playback is resumed.

For the audio stream in the pause state and the audio stream in the cache-deficient state, when a CLEAR queue instruction CLEAR _ ALL is received, switching to the stop state is performed.

And for the audio stream in the playing state, when the audio stream is played, switching to the ending state, and ending the playing.

On the other hand, when receiving a playback command, the audio stream in the end state may be switched to the playback state and playback may be resumed.

On the other hand, in some cases, for an audio stream (first audio data) in a playing state, when a dialog/reminder channel enters an active state when second audio data of a dialog/reminder type or the like is received, the first audio data may also be directly switched to an end state to end the playing. For example, in the case where the first audio data itself is also an audio data of a type of short interest, the interrupted first audio data does not have to be resumed.

The processing is controlled for each audio stream in the queue in such a manner that effective control of various types of audio data can be achieved.

Some types of audio data and corresponding control strategies are described in further detail below.

Fig. 5 shows 15 examples of audio data control strategies.

In the 1 st example, two audio contents U1, U2, e.g. two pieces of music, are in turn in the play queue. In other words, while the audio content U1 is played, the audio content U2 is received. At this point, playback of U1 can be paused or stopped and playback of U2 can begin, i.e., U2 interrupts U1 and plays U2 directly.

In the 2 nd example, the audio content U and the reminder content P are in turn in the play queue. And starting to play the reminding content P after the audio content U is played. I.e., queue play U and P. In addition, the control strategy may also be set to insert P during the playback of U. Whether to resume the U play after the P break can be determined according to the control strategy.

In the 3 rd example, the audio content U and the dialog content T are in turn in the play queue. And starting to play the dialogue content T after the audio content U is played. I.e., queue play U and T. In addition, the control strategy may also be set to insert T during the playback of U. Whether to recover U after the T inter cut is finished can be determined according to the control strategy.

In the 4 th example, the reminder content P and the audio content U are in turn in the play queue. And starting the audio content U after the playing of the reminding content P is finished. I.e., queue P and U for play.

In the 5 th example, two reminder contents P1 and P2 are in turn in the play queue. The two pieces of reminder content P1 and P2 may be queued to play in turn.

In the 6 th example, the reminder content P and the conversation content T are in turn in the play queue. And playing the conversation content T after the playing of the reminding content P is finished. I.e. queue play P and T.

In the 7 th example, the dialog content T and the audio content U are in turn in the play queue. And playing the audio content U after the playing of the conversation content T is finished. I.e. queue T and U.

In the 8 th example, the dialog content T and the reminder content P are in turn in the play queue. And playing the reminding content P after the playing of the conversation content T is finished. I.e. queue up to play T and P.

In the 9 th example, two dialog contents T1 and T2 are in turn played in the queue. The two dialog contents T1 and T2 may be played in sequence. Namely, T1 and T2 are queued for play.

In the 10 th example, three audio contents, U1, U2, and U3, such as three pieces of music, are in sequence in the play queue. In other words, while the audio content U1 is played, the audio content U2 is received. At this point, playback of U1 can be paused or stopped and playback of U2 can begin. While the audio content U2 is being played, the audio content U3 is received again. At this point, playback of U2 can be paused or stopped and playback of U3 can begin. In addition, the control strategy can also be set to queue and play U1, U2 and U3 in turn by using queues.

In the 11 th example, two audio contents U1, U2 and one reminder content P are in turn in the play queue. In other words, while the audio content U1 is played, the audio content U2 is received. At this point, playback of U1 can be paused or stopped and playback of U2 can begin. I.e., U2 breaks U1. While the audio content U2 is being played, the reminder content P is again received. The reminder content P can be played after the audio content U2 is played. In addition, the control strategy may also be set to insert P during the playback of U2. Whether the U1 and U2 playing is resumed after the P and U2 break is determined according to the control strategy.

In the 12 th example, two audio contents U1, U2 and one dialog content T are in turn in the play queue. In other words, while the audio content U1 is played, the audio content U2 is received. At this point, playback of U1 can be paused or stopped and playback of U2 can begin. I.e., U2 breaks U1. While the audio content U2 is being played, the dialog content T is received again. The dialog content T may be played after the audio content U2 has ended. In addition, the control strategy may also be set to insert T during the playback of U2. Whether to resume the U1 and U2 playing after the T and U2 break is determined according to the control strategy.

In the 13 th example, the audio content U1, the reminder content P, and the audio content U2 are in sequence in the play queue. The reminder content P may be played starting after the audio content U1 is played and the audio content U2 may be played starting after the reminder content P is played. In addition, the control strategy may also be set to insert P during the playback of U1, or to insert U2 during the playback of P.

In the 14 th example, the audio content U, the reminder content P1 and the reminder content P2 are in sequence in the play queue. The reminder content P1 may be started to be played after the audio content U is played and the reminder content P2 may be started to be played after the reminder content P1 is played. In addition, the control strategy may also be set to insert P1 during the playback of U, or P2 during the playback of P1.

In the 15 th example, the audio content U, the reminder content P, and the conversation content T are in sequence in the play queue. The reminding content P may be started to be played after the audio content U is played, and the dialogue content T may be started to be played after the reminding content P is played. In addition, the control strategy can also be set to insert P in the playing process of U, or insert T in the playing process of P.

An audio playing scheme of the present disclosure is described in detail with reference to fig. 1 to 5.

The control strategy mentioned above may also be determined by the server. The server may be, but is not limited to, a local server, an edge server, and a cloud server, the local server may also be, but is not limited to, a cell server, a home server, and in addition, the local server may also be other terminal devices having local processing capability.

Therefore, the present disclosure also provides an audio playing method suitable for being executed by an audio playing device, where the method includes: playing the first audio data; receiving second audio data to be played; receiving a control strategy which is issued by a server and determined according to the type of the first audio data and/or the type of the second audio data; and controlling the playing of the first audio data and the second audio data according to the control strategy. For details related to the method, see the above description, and are not repeated herein.

Fig. 6 shows a schematic block diagram of an audio playback apparatus capable of performing the audio playback method.

Referring to fig. 6, the audio playing device 600 includes a playing device 610, a first receiving device 620, a second receiving device 630, and a control device 640.

The first audio data may be played by the playing means 610. The second audio data to be played may be received by the first receiving means 620. The control policy determined according to the type of the first audio data and/or the type of the second audio data issued by the server may be received by the second receiving device 630. For the control strategy and the determination process thereof, reference may be made to the above-mentioned related description, which is not repeated herein. The playing of the first audio data and the second audio data may be controlled by the control means 640 according to a control policy.

The present disclosure also provides an audio playing method suitable for being executed by a server, the method comprising: issuing first audio data to an audio playing device; issuing second audio data to be played to an audio playing device; determining a control strategy according to the type of the first audio data and/or the type of the second audio data; and issuing a control strategy to the audio playing device.

Fig. 7 shows a schematic block diagram of a server capable of performing the audio playback method.

Referring to fig. 7, the server 700 includes a issuing means 710 and a decision means 720.

The first audio data and the second audio data to be played may be delivered to the audio playing apparatus by the delivering apparatus 710. The first audio data and the second audio data can be synchronously transmitted or asynchronously transmitted. For example, the first audio data may be audio data that is delivered by the server according to a previous request of the user, and the audio playing device plays the first audio data after receiving the first audio data; the second audio data may be audio data sent by the server according to a subsequent request of the user, that is, the audio playing apparatus may receive the second audio data sent by the server in the process of playing the first audio data.

The control policy may be determined by the decision means 720 depending on the type of the first audio data and/or the type of the second audio data. For the determination process of the control strategy, see the above related description, which is not repeated herein.

After determining the control policy, the issuing device 710 may also issue the control policy to the audio playing device. The control policy and the second audio data may be delivered to the audio playing device by the delivering device 710 together, or may be delivered asynchronously.

The present disclosure also provides an audio playing method suitable for being executed by an audio playing device, where the method includes: acquiring a play control parameter set by a user, wherein the play control parameter is used for representing the play duration and/or the play position of a second audio play event in the play process of a first audio play event; playing first audio data corresponding to the first audio playing event; receiving second audio data to be played corresponding to a second audio playing event; and controlling the playing of the first audio data and the second audio data according to the playing control parameter.

Fig. 8 shows a schematic block diagram of an audio playback apparatus capable of executing the audio playback method. The following describes an exemplary implementation of the method in conjunction with the audio playback apparatus 800.

Referring to fig. 8, the audio playback apparatus 800 includes an acquisition apparatus 810, a playback apparatus 820, a receiving apparatus 830, and a control apparatus 840.

The playback control parameter set by the user can be acquired by the acquisition means 810. The playing control parameter is used for representing the playing time length and/or the playing position of the second audio playing event in the playing process of the first audio playing event. The first audio playback event is different from the second audio playback event. As an example, the first audio play event may include, but is not limited to, a news play event, an audio-video play event, and the second audio play event may refer to an advertisement play event. Taking the second audio playing event as an example, the user can customize the playing position and/or the playing time of the advertisement in the playing process of the content. For example, the audio playing apparatus 800 may provide a fixed duration advertisement playing event that needs to be inserted to the user while providing the user with the content playing service, and the user may split the fixed duration into one or more discontinuous time periods, where each time period may be regarded as an advertisement insertion position. In this way, the server may also issue the corresponding advertisement (i.e., the second audio data) to the user according to the advertisement playing position and/or the activated playing time defined by the user.

The playing device 820 is used for playing the first audio data corresponding to the first audio playing event.

The receiving device 830 is configured to receive second audio data (sent by the server) to be played corresponding to the second audio playing event.

The control means 840 is adapted to control the playing of the first audio data and the second audio data according to the playing control parameter. That is, the control device 840 may determine when to play the second audio data for a certain period of time during the playing of the first audio data according to the playing time and/or the playing position of the second audio playing event characterized by the playing control parameter.

For example, assuming that the playing control parameters set by the user are the advertisement with the playing time length Δ t1 at mth second and the advertisement with the playing time length Δ t2 at nth second in the playing of the first audio data, the advertisement with the playing time length Δ t1 may be inserted when the playing of the first audio data reaches m seconds, the playing of the first audio data is continued after the insertion of the advertisement is finished, and the advertisement with the playing time length Δ t2 is inserted again at nth second.

The present disclosure also provides an audio playing method suitable for being executed by a server, the method comprising: acquiring a play control parameter set by a user, wherein the play control parameter is used for representing the play duration and/or the play position of a second audio play event in the play process of a first audio play event; and according to the playing control parameter, issuing first audio data and second audio data which accord with the playing sequence represented by the playing control parameter to the audio playing device, wherein the first audio data is audio data corresponding to the first audio playing event, and the second audio data is audio data corresponding to the second audio playing event.

Fig. 9 shows a schematic block diagram of a server capable of performing the audio playback method. The implementation of the method is illustrated below in connection with the server 900.

Referring to fig. 9, the server 900 includes an acquiring means 910 and a issuing means 920.

The obtaining device 910 may obtain a playing control parameter set by a user, where the playing control parameter is used to represent a playing time length and/or a playing position of a second audio playing event in a playing process of a first audio playing event.

The issuing device 920 may issue, to the audio playing device, first audio data and second audio data according to the playing order represented by the playing control parameter according to the playing control parameter, where the first audio data is audio data corresponding to a first audio playing event, and the second audio data is audio data corresponding to a second audio playing event.

For example, assuming that the playing control parameters set by the user are the m-th playing time Δ t1 advertisement and the n-th playing time Δ t2 advertisement in the playing of the first audio data, the issuing device 920 may issue the audio data of "m-second first audio data + Δ t1 advertisement + (n-m) second first audio data + Δ t2 advertisement + …" to the audio playing device, which conforms to the audio playing sequence characterized by the playing control parameters set by the user.

The present disclosure also provides an audio playing method, including: acquiring audio playing planning information of one or more established time periods, wherein the audio playing planning information is used for representing audio playing events needing to be executed in the established time periods; receiving second audio playing data corresponding to the audio playing event represented by the audio playing planning information; and responding to the current time reaching the set time period, and playing second audio playing data corresponding to the audio playing event represented by the audio playing planning information of the set time period.

Fig. 10 shows a schematic block diagram of an audio playback apparatus capable of executing the audio playback method. The following describes an exemplary implementation of the method in conjunction with the audio playback apparatus 1000.

Referring to fig. 10, the audio playing apparatus 1000 includes an acquiring apparatus 1010, a receiving apparatus 1020, and a playing apparatus 1030.

The obtaining means 1010 may obtain audio playing schedule information of one or more predetermined time periods, where the audio playing schedule information is used to characterize audio playing events that need to be executed in the predetermined time periods. Wherein the audio playing plan information may be a learning plan created by a first user (e.g., a parent) for a second user (e.g., a child), such as listening to a lesson or other important message between 4 o' clock and half-clock. Therefore, the audio playing apparatus 1000 may be an audio playing device (e.g., a smart speaker) used by a second user, and the audio playing apparatus 1000 may obtain the audio playing planning information set by the first user from the terminal device used by the first user.

The receiving device 1020 may receive second audio playing data corresponding to the audio playing event represented by the audio playing plan information. The receiving apparatus 1020 may acquire the second audio playing data to be played in the given time period before the time period comes.

The playing device 1030 may play the second audio playing data corresponding to the audio playing event represented by the audio playing planning information of the predetermined time period in response to the current time reaching the predetermined time period. The playing device 1030 may play the first audio data before the current time reaches the predetermined time period, and in response to the current time reaching the predetermined time period, if the current playing device 1030 is playing the first audio data, the playing device may stop playing the first audio data and may play the second audio data instead.

Referring to fig. 11, computing device 1100 includes memory 1110 and processor 1120.

The processor 1120 may be a multi-core processor or may include multiple processors. In some embodiments, processor 1120 may comprise a general-purpose host processor and one or more special purpose coprocessors such as a Graphics Processor (GPU), Digital Signal Processor (DSP), or the like. In some embodiments, processor 1120 may be implemented using custom circuits, such as an Application Specific Integrated Circuit (ASIC) or a Field Programmable Gate Array (FPGA).

The memory 1110 may include various types of storage units, such as system memory, Read Only Memory (ROM), and permanent storage. The ROM may store, among other things, static data or instructions for the processor 1120 or other modules of the computer. The persistent storage device may be a read-write storage device. The persistent storage may be a non-volatile storage device that does not lose stored instructions and data even after the computer is powered off. In some embodiments, the persistent storage device employs a mass storage device (e.g., magnetic or optical disk, flash memory) as the persistent storage device. In other embodiments, the permanent storage may be a removable storage device (e.g., floppy disk, optical drive). The system memory may be a read-write memory device or a volatile read-write memory device, such as a dynamic random access memory. The system memory may store instructions and data that some or all of the processors require at runtime. In addition, the memory 1110 may include any combination of computer-readable storage media, including various types of semiconductor memory chips (DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), magnetic and/or optical disks, as well. In some embodiments, memory 1110 may include a removable storage device that is readable and/or writable, such as a Compact Disc (CD), a digital versatile disc read only (e.g., DVD-ROM, dual layer DVD-ROM), a Blu-ray disc read only, an ultra-dense disc, a flash memory card (e.g., SD card, min SD card, Micro-SD card, etc.), a magnetic floppy disk, or the like. Computer-readable storage media do not contain carrier waves or transitory electronic signals transmitted by wireless or wired means.

The memory 1110 has stored thereon executable code, which when processed by the processor 1120, may cause the processor 1120 to perform the audio playback methods described above.

The problem that reasonable judgment is not available for audio forced interruption and recovery in the existing scheme can be solved through the task play queue and the priority task preemption mechanism. In addition, the recovery logic and dynamic allocation can be enhanced through cloud management and control.

The audio playing scheme according to the present invention has been described in detail above with reference to the accompanying drawings.

Furthermore, the method according to the invention may also be implemented as a computer program or computer program product comprising computer program code instructions for carrying out the above-mentioned steps defined in the above-mentioned method of the invention.

Alternatively, the invention may also be embodied as a non-transitory machine-readable storage medium (or computer-readable storage medium, or machine-readable storage medium) having stored thereon executable code (or a computer program, or computer instruction code) which, when executed by a processor of an electronic device (or computing device, server, etc.), causes the processor to perform the steps of the above-described method according to the invention.

Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems and methods according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

Having described embodiments of the present invention, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. An audio playback method, comprising:

playing the first audio data;

receiving second audio data to be played;

determining a control strategy according to the type of the first audio data and/or the type of the second audio data; and

and controlling the playing of the first audio data and the second audio data according to the control strategy.

2. The method of claim 1, wherein priorities are set for a plurality of types of audio data, respectively, the control policy comprising:

the second audio data is inserted in a case where the priority of the second audio data is higher than the priority of the first audio data.

3. The method of claim 2, wherein the control policy for inserting the second audio data is determined according to a type of the first audio data and/or a type of the second audio data from at least one of:

ending the playing of the first audio data;

pausing the playing of the first audio data and resuming the playing of the first audio data after the playing of the second audio data is finished;

continuing to play the first audio data, and simultaneously inserting second audio data, wherein the playing volume of the second audio data is higher than that of the first audio data;

and inserting the second audio data in the play queue before the audio data with lower priority than the second audio data.

4. The method of claim 1, wherein controlling playback of the first audio data and the second audio data according to the control policy comprises:

a state is maintained separately for the first audio data and the second audio data,

and controlling the state switching of the first audio data and the second audio data according to the control strategy.

5. The method of claim 4, wherein the status comprises at least one of:

waiting;

playing;

pausing;

insufficient cache;

stopping;

and (6) ending.

6. The method of claim 5, wherein the control policy for the state switch is determined from at least one of the following according to the type of the first audio data and/or the type of the second audio data:

maintaining the first audio data in a playing state, and putting the second audio data into a playing queue to enable the second audio data to be in a waiting state;

switching the playing state of the first audio data to pause, and enabling the second audio data to enter the playing state;

switching the playing state of the first audio data to be finished, and enabling the second audio data to enter the playing state;

and maintaining the first audio data in a playing state, and enabling the second audio data to enter the playing state, so that the first audio data and the second audio data are played simultaneously.

7. The method of claim 6, wherein,

when the first audio data is of the continuous interest type, switching the playing state of the first audio data to pause, and enabling the second audio data to enter the playing state;

and when the first audio data is of the short-time interest type, switching the playing state of the first audio data to be finished, and enabling the second audio data to enter the playing state.

8. The method of claim 7, wherein,

the continuous interest type comprises audio content and/or audio-video content; and/or

The short-term interest types include conversations and/or reminders.

9. The method of claim 1, further comprising:

acquiring audio playing priorities set by a user for one or more audio playing events,

wherein the step of determining the control strategy according to the type of the first audio data and/or the type of the second audio data comprises: and determining a control strategy according to the audio playing priority of the audio playing event to which the first audio data and the second audio data belong.

10. The method of any one of claims 1 to 8,

the second audio data is received in response to a request by a user.

11. The method of any one of claims 1 to 8,

different audio channels are used to implement different types of audio data playback, respectively.

12. An audio playback method, comprising:

acquiring a play control parameter set by a user, wherein the play control parameter is used for representing the play duration and/or the play position of a second audio play event in the play process of a first audio play event;

playing first audio data corresponding to the first audio playing event;

receiving second audio data to be played corresponding to the second audio playing event;

and controlling the playing of the first audio data and the second audio data according to the playing control parameter.

13. An audio playback method, comprising:

acquiring audio playing planning information of one or more established time periods, wherein the audio playing planning information is used for representing audio playing events needing to be executed in the established time periods;

receiving second audio playing data corresponding to the audio playing event represented by the audio playing planning information;

and responding to the current time reaching the established time period, and playing second audio playing data corresponding to the audio playing event represented by the audio playing planning information of the established time period.

14. The method of claim 13, further comprising:

playing first audio data before the current time reaches the set time period; and

and stopping playing the first audio data in response to the current time reaching the set time period.

15. An audio playback method, comprising:

and issuing first audio data and second audio data which accord with the playing sequence represented by the playing control parameter to an audio playing device according to the playing control parameter, wherein the first audio data is audio data corresponding to the first audio playing event, and the second audio data is audio data corresponding to the second audio playing event.

16. An audio playback method, comprising:

playing the first audio data;

receiving second audio data to be played;

receiving a control strategy which is issued by a server and determined according to the type of the first audio data and/or the type of the second audio data; and

17. An audio playback method, comprising:

issuing first audio data to an audio playing device;

issuing second audio data to be played to the audio playing device;

determining a control strategy according to the type of the first audio data and/or the type of the second audio data;

and issuing the control strategy to the audio playing device.

18. An audio playback apparatus comprising:

playing means for playing the audio data;

the receiving device is used for receiving second audio data to be played while playing the first audio data;

the decision-making device is used for determining a control strategy according to the type of the first audio data and/or the type of the second audio data; and

and the control device is used for controlling the playing of the first audio data and the second audio data according to the control strategy.

19. An audio playback apparatus comprising:

the device comprises an acquisition device and a playing control device, wherein the acquisition device is used for acquiring a playing control parameter set by a user, and the playing control parameter is used for representing the playing time length and/or the playing position of a second audio playing event in the playing process of a first audio playing event;

the playing device is used for playing first audio data corresponding to the first audio playing event;

receiving means for receiving second audio data to be played corresponding to the second audio playing event;

and the control device is used for controlling the playing of the first audio data and the second audio data according to the playing control parameter.

20. An audio playback apparatus comprising:

the device comprises an acquisition device, a processing device and a processing device, wherein the acquisition device is used for acquiring audio playing planning information of one or more established time periods, and the audio playing planning information is used for representing audio playing events needing to be executed in the established time periods;

the receiving device is used for receiving second audio playing data corresponding to the audio playing event represented by the audio playing planning information;

and the playing device is used for responding to the current time reaching the set time period and playing the second audio playing data corresponding to the audio playing event represented by the audio playing planning information of the set time period.

21. A server, comprising:

and the issuing device is used for issuing first audio data and second audio data which accord with the playing sequence represented by the playing control parameter to the audio playing device according to the playing control parameter, wherein the first audio data is the audio data corresponding to the first audio playing event, and the second audio data is the audio data corresponding to the second audio playing event.

22. An audio playback apparatus comprising:

playing means for playing the first audio data;

the first receiving device is used for receiving second audio data to be played;

the second receiving device is used for receiving a control strategy which is sent by a server and determined according to the type of the first audio data and/or the type of the second audio data; and

23. A server, comprising:

the issuing device is used for issuing the first audio data and the second audio data to be played to the audio playing device;

and the decision device is used for determining a control strategy according to the type of the first audio data and/or the type of the second audio data, wherein the issuing device also issues the control strategy to the audio playing device.

24. A computing device, comprising:

a processor; and

a memory having executable code stored thereon, which when executed by the processor, causes the processor to perform the method of any of claims 1 to 17.

25. A non-transitory machine-readable storage medium having stored thereon executable code, which when executed by a processor of an electronic device, causes the processor to perform the method of any of claims 1-17.