WO2023001054A1 - Priority configuration method and apparatus for audio playing, and device and storage medium - Google Patents

Abstract

A priority configuration method and apparatus for audio playing, and a device and a storage medium, which relate to the technical field of media playing. The method comprises: determining a target scenario mode of an audio playing device (410); acquiring user behavior data generated in the target scenario mode, wherein the user behavior data comprises data for controlling the audio playing device to switch the playing of different audio streams (420); and on the basis of the user behavior data, updating priority configuration information corresponding to the target scenario mode, wherein the priority configuration information is used for configuring the priority relationship between a variety of audio streams (430). By means of the method, automatic setting and updating of priority configuration information are realized without the assistance of other devices and manual setting by a user, thereby fully reducing the complexity. In addition, for different scenario modes, corresponding priority configuration information is set, such that audio playing control is more accurate, and user requirements are better satisfied.

Description

Priority configuration method, device, equipment and storage medium for audio playback

This application claims the priority of the Chinese patent application with the application number 202110831393.0 and the invention title "Priority configuration method, device, equipment and storage medium for audio playback" submitted on July 22, 2021, the entire content of which is by reference incorporated in this application.

technical field

The embodiments of the present application relate to the technical field of media playing, and in particular to a priority configuration method, device, device and storage medium for audio playing.

Background technique

Currently, a pair of headphones is capable of establishing wireless connections between multiple devices such as mobile phones, tablets, laptops, and more. The earphone can decide which device to play the audio stream according to the pre-stored priority configuration information.

Since the headset does not have a display screen, the user cannot directly set the above priority configuration information on the headset. In the related technology, the user sets the priority configuration information on the device (such as a mobile phone) connected to the headset, and then sends the priority configuration information to the headset through the device, and the headset stores the priority configuration information.

Contents of the invention

Embodiments of the present application provide a priority configuration method, device, device and storage medium for audio playback. Described technical scheme is as follows:

According to an aspect of the embodiment of the present application, a method for configuring priority for audio playback is provided, the method is performed by an audio playback device, and the method includes:

Determine the target scene mode where the audio playback device is located;

Acquiring user behavior data generated in the target scene mode, the user behavior data includes data for controlling the audio playback device to switch and play different audio streams;

Based on the user behavior data, the priority configuration information corresponding to the target scene mode is updated, and the priority configuration information is used to configure priority relationships among multiple audio streams.

According to an aspect of the embodiment of the present application, there is provided a priority configuration device for audio playback, the device comprising:

A mode determination module, configured to determine the target scene mode where the audio playback device is located;

A data acquisition module, configured to acquire user behavior data generated in the target scene mode, where the user behavior data includes data for controlling the audio playback device to switch and play different audio streams;

A configuration updating module, configured to update priority configuration information corresponding to the target scene mode based on the user behavior data, where the priority configuration information is used to configure priority relationships among various audio streams.

According to an aspect of the embodiments of the present application, an audio playback device is provided, the audio playback device includes a processor and a memory, a computer program is stored in the memory, and the computer program is executed by the processor to realize The above-mentioned priority configuration method for audio playback.

According to an aspect of an embodiment of the present application, a computer-readable storage medium is provided, and a computer program is stored in the storage medium, and the computer program is executed by a processor, so as to implement the above-mentioned priority configuration method for audio playback.

According to an aspect of the embodiments of the present application, a computer program product or computer program is provided, the computer program product or computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the audio playback device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the audio playback device executes the above-mentioned priority configuration method for audio playback.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained based on these drawings without creative effort.

Fig. 1 is a schematic diagram of a scheme implementation environment provided by an embodiment of the present application;

Fig. 2 is a schematic diagram of time slice division in LE Audio (Low Energy Audio, low power consumption audio) provided by an embodiment of the present application;

Fig. 3 is the schematic diagram of the state transition of the ASE (Audio Stream Endpoint, audio data stream end point) state machine provided by one embodiment of the present application;

Fig. 4 is a flowchart of a priority configuration method for audio playback provided by an embodiment of the present application;

FIG. 5 is a flowchart of an audio playback control method provided by an embodiment of the present application;

FIG. 6 is a flow chart of the connection establishment phase provided by an embodiment of the present application;

Fig. 7 is a flow chart of the initialization stage of the ASE state machine provided by one embodiment of the present application;

FIG. 8 is a flow chart of the audio stream playing and switching stages provided by an embodiment of the present application;

Fig. 9 is a block diagram of a priority configuration device for audio playback provided by an embodiment of the present application;

FIG. 10 is a block diagram of a device for configuring priorities for audio playback provided by another embodiment of the present application;

Fig. 11 is a structural block diagram of an audio playback device provided by an embodiment of the present application.

detailed description

In order to make the purpose, technical solution and advantages of the present application clearer, the implementation manners of the present application will be further described in detail below in conjunction with the accompanying drawings.

Please refer to FIG. 1 , which shows a schematic diagram of a solution implementation environment provided by an embodiment of the present application. The solution implementation environment may include an audio playback device 10 and multiple connection devices 20 .

The audio playing device 10 refers to an electronic device capable of playing audio. For example, the audio playback device 10 may be electronic devices such as earphones and speakers. In an example, the audio playback device 10 may be a TWS (True Wireless Stereo, true wireless stereo) earphone.

The connection device 20 refers to an electronic device that communicates with the audio playback device 10 . For example, the connection device 20 may be an electronic device such as a mobile phone, a tablet computer, a notebook computer, a desktop computer, a multimedia playback device, or a wearable device. In some scenarios, the audio playback device 10 can establish communication connections with multiple connection devices 20 . For example, in the scenario shown in FIG. 1 , the audio playback device 10 is an earphone, and the earphone establishes a communication connection with multiple connection devices 20 such as a mobile phone, a tablet computer, and a notebook computer. The connection device 20 may send an audio stream to the audio playback device 10 through the communication connection, and then the audio playback device 10 decodes and plays the audio stream.

In some embodiments, the communication connection between the audio playback device 10 and the connection device 20 is a wireless communication connection. For example, the communication connection between the audio playback device 10 and the connection device 20 is a Bluetooth connection.

In some embodiments, the audio playback device 10 and the connection device 20 communicate through Bluetooth LE Audio technology (hereinafter referred to as LE Audio). LE Audio is a Bluetooth audio technology standard. The concept of CIG (Connected Isochronous Group, Connection Synchronization Group)/CIS (Connected Isochronous Stream, Connection Synchronization Stream) is proposed in LE Audio, which is used to transmit audio streams. Simply put, a transmission channel and transmission strategy for time-dependent data are defined. That is, for the single-send-multiple-receive scenario, the protocol determines how the sender and receiver allocate sending and receiving time slices, so as to ensure that all receivers can meet the transmission requirements under certain synchronization requirements. As shown in FIG. 2 , each Event (event) can be regarded as a CIG, and each Subevent (subevent) can be regarded as a CIS, and an Event can include multiple Subevents. In each CIS, the Bluetooth master device will send data to the Bluetooth slave device, that is, M to S in Figure 2; the Bluetooth slave device will also reply to the Bluetooth master device, that is, S to M in Figure 2. In this way, a Bluetooth master device can communicate with several Bluetooth slave devices at the same time.

The concept of ASE is proposed in LE Audio to control the audio stream. Figure 3 is an ASE state machine for managing and controlling audio streams. For ASE, an operation can only be delivered in a certain state. The states shown in Figure 3 are described as follows:

Idle, the initial state;

Codec Configured (codec configuration complete status), the two parties connected by Bluetooth have configured the audio stream codec capability;

QoS Configured (parameter configuration completed state), the two parties of the Bluetooth connection have configured CIG/CIS related parameters;

Enabling (connection establishment status), the CIS connection and data path for transmitting audio streams have been established;

Streaming (transmitting state), the audio stream data has started to transmit;

Disabling (stop transmission status), audio streaming has stopped;

Releasing (connection release state), the CIS connection has been destroyed;

For the above CIS and ASE, CIS is bidirectional, ASE is unidirectional, and one ASE state machine is only used to manage and control data from one party to the other.

However, the above method of setting priority configuration information not only requires the assistance of other devices other than the earphone, but also needs manual setting by the user, which is complicated and cumbersome.

According to the technical solution provided by the embodiment of the present application, the audio playback device (such as earphones) can realize the setting of priority configuration information without the assistance of other devices. Specifically, the audio playback setting collects and records user behavior data, and the user behavior data includes Control the audio playback device to switch and play the data of different audio streams, and then automatically update the priority configuration information based on the user behavior data, realizing the automatic setting and updating of the priority configuration information, without the assistance of other devices, and without manual settings by the user, fully Reduced complexity. In addition, for different scene modes, the corresponding priority configuration information is set respectively, so that when the audio playback device is in different scene modes, the audio stream can be played and controlled with the priority configuration information suitable for the current scene mode, so that Audio playback control is more accurate and better meets user needs.

In the following, the technical solution of the present application will be described through several embodiments.

Please refer to FIG. 4 , which shows a flowchart of a method for configuring priorities for audio playback provided by an embodiment of the present application. The method can be applied in the solution implementation environment shown in FIG. 1 , as the execution subject of each step can be the audio playback device 10, the method can include the following steps (410-430):

Step 410, determine the target scene mode of the audio playback device.

The audio playback device can be in different scene modes, which can be preset and stored in the audio playback device by technicians (such as the staff of the manufacturer of the audio playback device), or can be set and stored in the audio playback device by the user. in the device. Different scenario modes correspond to different usage scenarios and also correspond to different priority requirements. Exemplarily, as shown in Table 1 below, scene configuration information is stored in the audio playback device, and the scene configuration information includes the corresponding relationship between the identifier of the scene mode and the name of the scene mode. Among them, the reserved scene modes can be added by users.

Table 1

scene mode	identifier
family	0x01
Meeting	0x02
Work	0x03
drive	0x04
reserve	0x00

The audio playback device determines the target scene mode it is currently in, and the target scene mode may be any one of the scene modes configured in the scene configuration information.

In some embodiments, the audio playback device uses one of the following methods to determine the target scene mode it is in:

Method 1: collect user voice data, and identify the user voice data to determine the target scene mode. The user can control the audio playback device to enter a certain target scene mode by voice. For example, when the user says "enter home mode", the audio playback device collects the user's voice data generated by the user's speech, and then recognizes the user's voice data through voice recognition, semantic analysis and other technologies to determine the current target scene mode.

Method 2: collect environmental audio data, and identify the environmental audio data to determine the target scene mode. Environmental audio data refers to audio data generated in the environment where the audio playback device is located. Exemplarily, at least one feature information corresponding to each scene mode is preset, and the feature information corresponding to the environmental audio data is obtained by identifying the environmental audio data. When the feature information corresponding to the environmental audio data corresponds to a certain scene mode When the feature information matches, it is determined that the matched scene mode is the target scene mode. For example, the feature information corresponding to the family scene mode includes but is not limited to at least one of the following: the volume is greater than a first threshold, there are multiple speakers, and the voices of the speakers appear irregularly, and so on. In the embodiment of the present application, the specific content of the feature information corresponding to each scene mode is not limited, which can be reasonably set according to requirements.

Mode 3: In response to a user operation on the audio playback device, determine a target scene mode based on the user operation. The user can also control the audio playback device to enter a certain target scene mode by touching or tapping the audio playback device. For example, double-tap for home mode, triple-tap for meeting mode, and so on.

Way 4: Receive scene switching information from the control device, and determine the target scene mode according to the scene switching information. The user may also send scene switching information to the audio playback device through the control device, the scene switching information may include an identifier of the target scene mode to switch to, and the audio playback device determines the target scene mode according to the scene switching information. The above-mentioned control device may be a device such as a mobile phone, a tablet computer, a PC (Personal Computer, personal computer) connected to the audio playback device, or other devices such as a router, which is not limited in this application.

The method for determining the target scene mode described above is only exemplary and explanatory, and the present application does not limit that the target scene mode may also be determined in other ways.

Step 420, acquiring user behavior data generated in the target scene mode, where the user behavior data includes data for controlling the audio playback device to switch and play different audio streams.

The user behavior data includes data for controlling a certain audio stream to preempt or not preempt another audio stream for playback.

Exemplarily, the user behavior data includes data for controlling the audio stream belonging to the target audio stream type, preempting or not preempting other audio streams for playback. The types of audio streams that can be played by the audio playback device may include two types: media and telephony. Currently, in some other embodiments, in addition to media and telephony, audio stream types can also be extended to other types or audio streams can be divided from different classification granularities. For example, media can be further subdivided into audio and video calls, Various types such as music playback and video playback, which are not limited in this application. For example, if the audio playback device is playing media and a call comes in at this time, if the user chooses to answer it, record the user behavior data that the phone preempts the media for playback, and if the user chooses to reject the call, record the user behavior that the phone does not preempt the media for playback data.

Exemplarily, the user behavior data includes data for controlling audio streams from the target connected device, preempting or not preempting other audio streams for playback. The target connection device refers to one connection device among the plurality of connection devices connected to the audio playback device. For example, the audio playback device connects device 1 and device 2, the audio playback device is playing the audio stream from device 1, and the user controls the audio stream from device 2 to preempt the audio stream from device 1 for playback, then record the audio from device 2 The stream preempts the audio stream from device 1 for playback of user behavior data.

Exemplarily, the user behavior data includes data for controlling the audio stream from the target connected device and belonging to the target audio stream type to preempt or not preempt other audio streams for playback. For example, the audio playback device is playing a phone call from device 1. At this time, device 2 has a phone call. If the user chooses to answer the phone call of device 2, the user behavior data that the phone of device 2 preempts the phone of device 1 to play will be recorded. If If the user chooses to reject the phone call of device 2, the user behavior data that the phone of device 2 does not preempt the phone of device 1 to play is recorded. For another example, the audio playback device is playing the media from device 1. At this time, device 1 has a phone call. If the user chooses to answer the phone call of device 1, the phone of device 1 will record the user behavior data of playing the media of device 1, If the user chooses to reject the phone call of device 1, the user behavior data that the phone call of device 1 does not seize the media of device 1 for playback is recorded. For another example, the audio playback device is playing the media from device 1. At this time, device 2 has a phone call. If the user chooses to answer the phone call of device 2, the phone of device 2 will record the user behavior data of playing the media of device 1, If the user chooses to reject the phone call of device 2, the user behavior data that the phone call of device 2 does not seize the media of device 1 for playback is recorded.

Step 430: Based on the user behavior data, update the priority configuration information corresponding to the target scene mode, where the priority configuration information is used to configure the priority relationship among multiple audio streams.

After acquiring the user behavior data generated in the target scene mode, the audio playback device updates the priority configuration information corresponding to the target scene mode based on the user behavior data.

In some embodiments, the priority configuration information is used to configure priority relationships among multiple audio stream types. Exemplarily, as shown in Table 2, the priority configuration information includes: an identifier of the audio stream type, and a priority value corresponding to the identifier of the audio stream type.

Table 2

audio stream type	Identifier of the audio stream type	priority value
Telephone	0x01	0
media	0x02	0
reserve	0x00	0

In the priority configuration information of initialization settings, the priority values corresponding to the identifiers of each audio stream type can be the same, for example, they are all 0; or, in the priority configuration information of initialization settings, the identifiers of each audio stream type correspond to The priority value of can also be different, for example, set according to the default priority value.

In addition, the larger the priority value, the higher the priority, and vice versa, the lower the priority; or, the smaller the priority value, the higher the priority, and vice versa, the lower the priority.

In some embodiments, if the user behavior data includes data that controls the audio stream belonging to the target audio stream type and preempts other audio streams for playback, then in the priority configuration information corresponding to the target scene mode, the priority corresponding to the target audio stream type The level value is updated to increase the priority of the target audio stream type. Taking the larger priority value as an example, the higher the priority, the above update of the priority value corresponding to the target audio stream type may add 1 to the priority value corresponding to the target audio stream type. For example, if the user behavior data includes controlling the phone to preempt the media to play, add 1 to the corresponding priority value of the phone; if the user behavior data includes controlling the phone not to preempt the media to play, then keep the respective priority values of the phone and the media unchanged.

In this example, priority relationships between different audio stream types can be automatically set based on user behavior data.

In some other embodiments, the priority configuration information is used to configure priority relationships among audio streams of multiple connected devices. Exemplarily, as shown in Table 3, the priority configuration information includes: an identifier of the connected device, and a priority value corresponding to the identifier of the connected device.

table 3

connect device	Identifier of the connected device	priority value
equipment 1	0x01	0
device 2	0x02	0
device 3	0x03	0
reserve	0x00	0

In the priority configuration information of initialization settings, the priority values corresponding to the identifiers of each connected device can be the same, for example, they are all 0; or, in the priority configuration information of initialization settings, the priority values corresponding to the identifiers of each connected device The priority value can also be different, for example, set according to the default priority value.

In addition, the larger the priority value, the higher the priority, and vice versa, the lower the priority; or, the smaller the priority value, the higher the priority, and vice versa, the lower the priority.

In some embodiments, if the user behavior data includes data that controls the audio stream from the target connected device and preempts other audio streams for playback, then in the priority configuration information corresponding to the target scene mode, the priority value corresponding to the target connected device Update to elevate the priority of the target connected device. Taking a larger priority value as an example, a higher priority value is used as an example. In the foregoing update of the priority value corresponding to the target connection device, 1 may be added to the priority value corresponding to the target connection device. For example, if the user behavior data includes controlling the audio stream from device 2 to preempt the audio stream from device 1 for playback, then add 1 to the corresponding priority value of device 2; the user behavior data includes controlling the audio stream from device 2 not to preempt the audio stream from device 1 1 audio stream, keep the corresponding priority value of each connected device unchanged.

In this example, priority relationships between audio streams of different connected devices can be automatically set based on user behavior data.

In some other embodiments, the priority configuration information is used to configure the priority relationship between multiple audio stream types, and is used to configure the priority relationship of the same or different audio stream types of different connected devices of the audio playback device.

Exemplarily, as shown in Table 4, the priority configuration information includes: an identifier of the connected device, an identifier of the audio stream type, and a priority value corresponding to the identifier of the connected device and the identifier of the audio stream type.

Table 4

Exemplarily, as shown in Table 5, the priority configuration information includes: a combination identifier and a priority value corresponding to the combination identifier, wherein the combination identifier is used to distinguish between different connection devices and the combination of the audio stream type .

table 5

combination	combination identifier	priority value
device 1 media	0x01	0
device 1 phone	0x02	0
device 2 media	0x03	0
device 2 phone	0x04	0
reserve	0x00	0

In some embodiments, if the user behavior data includes data that controls the audio stream from the target connected device and belongs to the target audio stream type, and preempts other audio streams for playback, then in the priority configuration information corresponding to the target scene mode, the target The priority value corresponding to the target audio stream type of the connected device is updated to increase the priority of the target audio stream type of the target connected device. Taking the larger priority value as an example, the higher the priority, the above update of the priority value corresponding to the target audio stream type of the target connected device may add 1 to the priority value corresponding to the target audio stream type of the target connected device. For example, if the user behavior data includes the phone of the control device 2 preempting the phone of the device 1 to play, then the priority value corresponding to the phone of the device 2 is increased by 1, and other priority values remain unchanged. For another example, if the user behavior data includes that the phone of the control device 1 preempts the media of the device 1 to play, then the priority value corresponding to the phone of the device 1 is increased by 1, and other priority values remain unchanged. For another example, if the user behavior data includes that the phone of the control device 2 preempts the media of the device 1 to play, then the priority value corresponding to the phone of the device 2 is increased by 1, and other priority values remain unchanged.

In this example, based on user behavior data, the priority relationship between different audio stream types of the same connected device can be automatically set, and the priority relationship between the same/different audio stream types of different connected devices can be set automatically.

To sum up, in the technical solution provided by the embodiment of the present application, the audio playback device (such as a headset) can realize the setting of priority configuration information without the assistance of other devices. Specifically, the audio playback setting collects and records user behavior data, The user behavior data includes the data that controls the audio playback device to switch and play different audio streams, and then automatically updates the priority configuration information based on the user behavior data, realizing the automatic setting and updating of the priority configuration information without the assistance of other devices or Manual setting by the user fully reduces the complexity. In addition, for different scene modes, the corresponding priority configuration information is set respectively, so that when the audio playback device is in different scene modes, the audio stream can be played and controlled with the priority configuration information suitable for the current scene mode, so that Audio playback control is more accurate and better meets user needs.

In an exemplary embodiment, as shown in FIG. 5, the audio playback device implements audio playback control by performing the following steps:

Step 510: During the process of playing the first audio stream in the target scene mode, if a playback instruction for the second audio stream is received, determine the first audio stream and the second audio stream according to the priority configuration information corresponding to the target scene mode. Priority relationship between streams.

In some embodiments, if the priority configuration information corresponding to the target scene mode is used to configure the priority relationship among multiple audio stream types in the target scene mode. For example, the priority configuration information is shown in Table 2 above. Then, the audio playback device can determine the first audio stream type and the second audio stream type, the first audio stream type refers to the audio stream type to which the first audio stream belongs, and the second audio stream type refers to the audio stream type to which the second audio stream belongs Audio stream type: determine the priority between the first audio stream and the second audio stream according to the priority relationship between the first audio stream type and the second audio stream type defined in the priority configuration information corresponding to the target scene mode relation.

For example, the first audio stream refers to an audio stream of a video service between an audio playback device (such as a headset) and a first connection device (such as a notebook computer), and the second audio stream refers to an audio stream between the audio playback device (such as a headset) and the first connection device (such as a notebook computer). The audio stream of the telephone service between two connected devices (such as a mobile phone), then the first audio stream type is media, and the second audio stream type is telephone, assuming that the priority of the telephone is determined to be higher than that of the media according to the priority configuration information priority, the priority of the second audio stream is higher than that of the first audio stream.

In some embodiments, if the priority configuration information corresponds to the target scene mode, it is used to configure a priority relationship between audio streams of multiple connected devices in the target scene mode. For example, the priority configuration information is shown in Table 3 above. Then, the audio playback device can determine the first connection device and the second connection device, the first connection device refers to the connection device to which the first audio stream belongs, and the second connection device refers to the connection device to which the second audio stream belongs; according to the target The priority relationship between the first connected device and the second connected device defined in the priority configuration information corresponding to the scene mode determines the priority relationship between the first audio stream and the second audio stream.

For example, the first audio stream refers to an audio stream of a video service between an audio playback device (such as a headset) and a first connection device (such as a notebook computer), and the second audio stream refers to an audio stream between the audio playback device (such as a headset) and the first connection device (such as a notebook computer). The audio stream of the telephone service between two connected devices (such as mobile phones), assuming that according to the priority configuration information, it is determined that the priority of the second connected device is higher than that of the first connected device, the priority of the second audio stream is high Priority for the first audio stream.

In other examples, if the priority configuration information corresponding to the target scene mode is used to configure the priority relationship between multiple audio stream types, and is used to configure the same or different audio stream types of different connected devices of the audio playback device priority relationship. For example, the priority configuration information is shown in Table 4 or Table 5 above. Then, the audio playback device can determine the first combination and the second combination, the first combination refers to the combination of the audio stream type to which the first audio stream belongs and the connection device, and the second combination refers to the audio stream type to which the second audio stream belongs A combination with the connected device; according to the priority relationship between the first combination and the second combination defined in the priority configuration information corresponding to the target scene mode, determine the priority relationship between the first audio stream and the second audio stream.

For example, the first audio stream refers to an audio stream of a video service between an audio playback device (such as a headset) and a first connection device (such as a notebook computer), and the second audio stream refers to an audio stream between the audio playback device (such as a headset) and the first connection device (such as a notebook computer). For the audio stream of the telephone service between two connected devices (such as mobile phones), the first combination is media + the first connected device, and the second combination is the phone + the second connected device. Assuming that the information is configured according to the priority, the second combination is determined If the priority of the second combination is higher than that of the first combination, then the priority of the second audio stream is higher than that of the first audio stream.

Step 520, if the priority of the second audio stream is higher than that of the first audio stream, pause playing the first audio stream and play the second audio stream.

In some embodiments, pausing the playback of the first audio stream includes: switching the first state machine from the transmitting state to the stop transmitting state, and the first state machine is a state machine corresponding to the first audio stream; disconnecting the audio playback device from the An audio stream transmission connection between first connected devices, where the first connected device is a device that transmits a first audio stream to an audio playback device. For example, the first state machine is the ASE state machine, and the transmitting state refers to the state in which the audio stream data has started to be transmitted, such as the Streaming state in the ASE state machine, and the stop transmission state refers to the state in which the audio stream transmission has stopped, such as the ASE state Disabled status of the machine.

In some embodiments, after switching the first state machine from the transmitting state to the stopped transmission state, further comprising: switching the first state machine from the stopped transmission state to the parameter configuration completed state. The parameter configuration completion state refers to the state in which the two parties of the Bluetooth connection have configured CIG/CIS related parameters, such as the QoS Configured state in the ASE state machine. By switching the first state machine from the stop transmission state to the parameter configuration completion state, after the completion of the second audio stream playback, the playback of the first audio stream can be resumed as quickly as possible.

In some embodiments, playing the second audio stream includes: switching the second state machine from the parameter configuration completion state to the connection establishment state, where the second state machine is a state machine corresponding to the second audio stream; The audio stream transmission connection between the two connected devices, the second connected device is a device that transmits the second audio stream to the audio playback device; the second state machine is switched from the connection establishment state to the transmitting state; through the connection with the second connected device The audio stream transmission connection between them receives the second audio stream from the second connected device; and plays the received second audio stream. Similarly, the second state machine can also be an ASE state machine, and the parameter configuration completion state refers to the state in which the two parties of the Bluetooth connection have configured CIG/CIS related parameters, such as the QoS Configured state in the ASE state machine; the connection establishment state is Refers to the state in which the CIS connection and data path used to transmit the audio stream have been established, such as the enabling state in the ASE state machine; the transmitting state refers to the state in which the audio stream data has begun to be transmitted, such as the streaming state in the ASE state machine.

In some embodiments, when the first audio stream and the second audio stream have the same priority, the audio playback device may also play prompt information in audio form, prompting the user to select the first audio stream or the second audio stream for playback. The user feeds back the audio stream to be played in voice form according to the prompt information, and the audio playback device determines the audio stream to be played through voice collection and semantic recognition.

To sum up, in the technical solution provided by the embodiment of the present application, by setting the priority configuration information in the audio playback device, the audio playback device can determine the priority relationship between each audio stream based on the priority configuration information, so as to The playback and switching of audio streams are automatically controlled, so that audio can be played more intelligently in multi-connection scenarios.

In the following, the technical solution of the present application will be exemplarily introduced and described by taking the audio playback device as an earphone, the first connection device as a notebook computer, and the second connection device as a mobile phone as an example.

As shown in Figure 6, in the connection establishment phase, the following steps (601-607) are included:

Step 601, the headset creates a default priority attribute table.

For example, the headset creates a default priority attribute table (that is, the priority configuration information described above) according to the format of Table 2, assuming that the priority of the phone is the highest.

Step 602, establish a connection between the mobile phone and the headset through BLE (Bluetooth Low Energy, Bluetooth Low Energy).

In step 603, the earphone creates three ASE state machines for the mobile phone, and the initial states of the three ASE state machines are all in the Idle state.

Wherein, each audio stream corresponds to an ASE state machine, which is used to manage and control the audio stream. For mobile phones, there are requirements for making calls and playing media, and three ASE state machines need to be created. Among them, one ASE state machine is used to receive the phone audio stream of the mobile phone, marked as ASE0_0, the other ASE state machine is used to transmit the audio stream of the microphone to the mobile phone, marked as ASE0_1, and another ASE state machine is used for media playback, marked as for ASE0_2.

Step 604, the mobile phone and the earphone interact with the audio codec capability to configure the audio codec and decoder.

In step 605, a connection is established between the notebook computer and the earphone through BLE.

Step 606, the earphone creates an ASE state machine for the notebook computer, and the initial state of the ASE state machine is the Idle state.

For laptops, there is a need to play media, and an ASE state machine is created, which is recorded as ASE1_0.

Step 607, the notebook computer and the earphone interact with the audio codec capability to configure the audio codec and decoder.

For each ASE state machine created, the headset needs to initialize it. As shown in Figure 7, in the initialization phase of the ASE state machine, the following steps (701-706) are included:

Step 701, after the BLE is connected, the initial state of the ASE state machine is the Idle state.

In step 702, the mobile phone determines the audio codec capabilities supported by both parties (the mobile phone and the headset).

Step 703, the mobile phone configures its own audio codec capability, and then sends an audio codec configuration command to the earphone.

Step 704, after the earphone receives the audio codec configuration instruction, configure its own audio codec capability, then switch the ASE state machine from the initial state to the codec configuration completion state (that is, switch from the Idle state to the Codec Configured state), and send to The mobile phone sends the CIS configuration parameters supported by the headset.

Step 705: After the mobile phone receives the CIS configuration parameters sent by the headset, it determines the CIS configuration parameters supported by both parties, then configures its own CIS, and sends a QoS configuration command to the headset, and the QoS configuration command is used to instruct the headset to configure its own CIS , the QoS configuration instruction includes the CIS parameters configured by the mobile phone.

Step 706, after the earphone receives the QoS configuration instruction, switch the ASE state machine from the codec configuration completion state to the parameter configuration completion state (that is, switch from the Codec Configured state to the QoS Configured state), and save the CIS configuration parameters sent by the mobile phone.

In FIG. 7 , only the initialization process of a certain ASE state machine in the mobile phone is used as an example for description. The initialization process of other ASE state machines in the mobile phone or notebook computer is the same or similar, and will not be repeated here.

In the priority configuration stage, the earphone can automatically set and update the priority attribute table (that is, the priority configuration information mentioned above) based on the user behavior data in the manner described in the above embodiments.

As shown in Figure 8, in the audio stream playing and switching stages, the following steps (801-808) may be included:

Step 801, when the notebook computer connected to the earphone wants to play media (such as music or video), the notebook computer will send an enable (Enable) command to the earphone, and the parameters carried in the activation command include that the audio stream type currently to be transmitted is media .

Step 802: After receiving the activation instruction, the earphone switches the state machine ASE1_0 in the parameter configuration completed state (QoS_Configured state) to the connection establishment state (Enabling state).

In step 803, the laptop computer sends an instruction to create a CIS to the headset, and a CIS connection is established between the laptop computer and the headset.

Step 804, after the headset preparation (configuration of CIS related parameters) is completed, it can automatically send the receiver start ready (Receiver Start Ready) command to itself, and switch the state machine ASE1_0 from the connection establishment state (Enabling state) to the transmitting state (Streaming state) status), and notify the laptop.

Step 805, after receiving the notification, the notebook computer starts to transmit the audio stream data of the media.

Step 806, when the earphone is currently playing the media in the notebook computer, if the earphone receives an activation (Enable) instruction from the mobile phone, the priority attribute table is retrieved, if the audio stream type (such as a phone) priority in the activation instruction is greater than the current The type of audio stream to play, continue the following operations, otherwise ignore the activation command.

In step 807, the headset automatically sends a Disable command to itself, switches the state machine ASE1_0 from the streaming state (Streaming state) to the stopping transmission state (Disabling state), and terminates the CIS connection between the headset and the notebook.

Step 808, the earphone automatically sends the receiver stop ready (Receiver Stop Ready) command to itself, and switches the state machine ASE1_0 from the stop transmission state (Disabling state) to the parameter configuration completion state (QoS_Configured state).

Subsequently, create a CIS connection between the headset and the mobile phone to transmit the audio stream data of the phone, as well as the state switching control of the corresponding state machine, create a CIS connection between the headset and the laptop to transmit the audio stream data of the media, and the corresponding state machine. The state switching control is similar and will not be repeated here.

It should be noted that the enable command is a standard command in LE Audio, which will carry parameters related to the context (Context) in the metadata (Metadata), which is defined as an audio stream type in this technical solution.

In an exemplary embodiment, different priority attribute tables (that is, the priority configuration information introduced above) may be set for different scene modes. In the target scene mode, the audio playback device determines the priority attribute table corresponding to the target scene mode from the multiple stored priority attribute tables. For example, for conference scenarios and non-conference scenarios, corresponding priority attribute tables are set respectively. In the priority attribute table corresponding to the meeting scene, the priority of the media is higher than the priority of the phone; in the priority attribute table corresponding to the non-conference scene, the priority of the phone is higher than the priority of the media. In this way, an appropriate priority attribute table can be used in different scenarios to determine the priority relationship between audio streams, so that the determination of the priority is adapted to the scenario and better meets the actual needs of the user.

In an exemplary embodiment, in response to an instruction to enable the automatic switching function, the audio playback device enables the automatic switching function, which refers to the function of automatically switching audio streams for playback according to the priority configuration information that meets the available conditions; wherein , the available condition means that the priority configuration information is generated based on user behavior data within a specific period of time. The user can independently choose to enable or disable the automatic switching function. When the automatic switching function is enabled, the audio playback device can determine the priority between different audio streams based on the priority configuration information in the manner described in the above embodiment. relationship; when the automatic switching function is turned off, the audio playback device can prompt the user to manually select different audio streams for switching and playing. In addition, the priority configuration information can be used only when the available conditions are met, so as to ensure the accuracy of the priority configuration information and avoid audio switching control errors as much as possible. For example, if a person develops a habit in 21 days, after collecting 21 days of user behavior data, priority configuration information that meets the available conditions can be generated based on the 21 days of user behavior data, and then the user is prompted whether to enable the automatic switching function.

The following are device embodiments of the present application, which can be used to implement the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

Please refer to FIG. 9 , which shows a block diagram of an apparatus for configuring priorities for audio playback provided by an embodiment of the present application. The device has the function of realizing the above-mentioned method example, and the function may be realized by hardware, or may be realized by executing corresponding software by the hardware. The apparatus may be the audio playback device described above, or may be set in the audio playback device. The device 900 includes: a mode determination module 910 , a data acquisition module 920 and a configuration update module 930 .

The mode determination module 910 is configured to determine the target scene mode of the audio playback device.

The data acquisition module 920 is configured to acquire user behavior data generated in the target scene mode, where the user behavior data includes data for controlling the audio playback device to switch and play different audio streams.

The configuration updating module 930 is configured to update priority configuration information corresponding to the target scene mode based on the user behavior data, where the priority configuration information is used to configure priority relationships among various audio streams.

In an exemplary embodiment, the priority configuration information is used to configure the priority relationship between multiple audio stream types, and the priority configuration information includes: the identifier of the audio stream type, and the audio The priority value corresponding to the stream type identifier.

In some embodiments, the configuration update module 930 is configured to: if the user behavior data includes data that controls the audio stream belonging to the target audio stream type and preempts other audio streams for playback, then update the corresponding audio stream of the target scene mode In the priority configuration information, the priority value corresponding to the target audio stream type is updated.

In an exemplary embodiment, the priority configuration information is used to configure the priority relationship between multiple audio stream types, and to configure the priority of the same or different audio stream types of different connected devices of the audio playback device. level relationship.

In some embodiments, the priority configuration information includes: the identifier of the connected device, the identifier of the audio stream type, and the identifier corresponding to the identifier of the connected device and the identifier of the audio stream type the priority value;

Alternatively, the priority configuration information includes: a combination identifier and a priority value corresponding to the combination identifier, wherein the combination identifier is used to distinguish between different combinations of the connection device and the audio stream type .

In some embodiments, the configuration update module 930 is configured to, if the user behavior data includes data that controls the audio stream from the target connected device and belongs to the target audio stream type to preempt other audio streams for playback, then update the In the priority configuration information corresponding to the target scene mode, the priority value corresponding to the target audio stream type of the target connection device is updated.

In an exemplary embodiment, the mode determining module 910 is configured to collect user voice data, identify the user voice data to determine the target scene mode; or collect environmental audio data, and perform Identify and determine the target scene mode; or, in response to a user operation on the audio playback device, determine the target scene mode based on the user operation; or receive scene switching information from the control device, and switch according to the scene information identifying the target scene mode.

In an exemplary embodiment, as shown in FIG. 10 , the apparatus 900 further includes: a priority determination module 940 and a playback control module 950 .

The priority determination module 940 is configured to, during the process of playing the first audio stream in the target scene mode, if a playback instruction for the second audio stream is received, according to the priority configuration information corresponding to the target scene mode, A priority relationship between the first audio stream and the second audio stream is determined.

The play control module 950 is configured to pause playing the first audio stream and play the second audio stream if the priority of the second audio stream is higher than the priority of the first audio stream.

In some embodiments, the playback control module 950 is configured to:

Switching the first state machine from the transmitting state to the stopping transmission state, the first state machine being the state machine corresponding to the first audio stream;

disconnecting the audio stream transmission connection between the audio playback device and a first connection device, where the first connection device is a device for transmitting the first audio stream to the audio playback device.

In some embodiments, the playback control module 950 is further configured to switch the first state machine from the transmission stop state to parameter configuration after switching the first state machine from the transmission state to the transmission stop state finished condition.

In some embodiments, the playback control module 950 is further configured to:

Switching the second state machine from the parameter configuration completion state to the connection establishment state, the second state machine being a state machine corresponding to the second audio stream;

Establishing an audio stream transmission connection between the audio playback device and a second connection device, the second connection device is a device that transmits the second audio stream to the audio playback device;

switching the second state machine from the connection establishment state to the transmitting state;

receiving the second audio stream from the second connected device via an audio streaming connection with the second connected device;

Play the received second audio stream.

In an exemplary embodiment, as shown in FIG. 10 , the device 900 further includes: a function enabling module 960 .

The function enabling module 960 is configured to enable the automatic switching function in response to the enabling instruction of the automatic switching function, and the automatic switching function refers to the function of automatically switching audio streams for playing according to the priority configuration information that meets the available conditions ; Wherein, the availability condition means that the priority configuration information is generated based on user behavior data within a specific period of time.

To sum up, in the technical solution provided by the embodiment of the present application, the audio playback device (such as a headset) can realize the setting of priority configuration information without the assistance of other devices. Specifically, the audio playback setting collects and records user behavior data, The user behavior data includes the data that controls the audio playback device to switch and play different audio streams, and then automatically updates the priority configuration information based on the user behavior data, realizing the automatic setting and updating of the priority configuration information without the assistance of other devices or Manual setting by the user fully reduces the complexity. In addition, for different scene modes, the corresponding priority configuration information is set respectively, so that when the audio playback device is in different scene modes, the audio stream can be played and controlled with the priority configuration information suitable for the current scene mode, so that Audio playback control is more accurate and better meets user needs.

It should be noted that, when realizing the functions of the device provided by the above-mentioned embodiments, the division of the above-mentioned functional modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional modules according to the needs. The internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and the method embodiment provided by the above embodiment belong to the same idea, and the specific implementation process thereof is detailed in the method embodiment, and will not be repeated here.

Please refer to FIG. 11 , which shows a structural block diagram of an audio playback device provided by an embodiment of the present application. The audio playback device can be used to realize the functions of the above-mentioned priority configuration method for audio playback. The audio playback device 110 may include: a processor 111 , a receiver 112 , a transmitter 113 , a memory 114 and a bus 115 .

The processor 111 includes one or more processing cores, and the processor 101 executes various functional applications and information processing by running software programs and modules.

The receiver 112 and the transmitter 113 can be implemented as a communication component, which can be a communication chip.

The memory 114 is connected to the processor 111 through the bus 115 .

The memory 114 may be used to store a computer program, and the processor 111 is used to execute the computer program, so as to implement various steps in the foregoing method embodiments.

In addition, memory 114 can be realized by any type of volatile or nonvolatile storage device or their combination, and volatile or nonvolatile storage device includes but not limited to: RAM (Random-Access Memory, random access memory) And ROM (Read-Only Memory, read-only memory), EPROM (Erasable Programmable Read-Only Memory, erasable programmable read-only memory), EEPROM (Electrically Erasable Programmable Read-Only Memory, electrically erasable programmable read-only memory memory), flash memory or other solid-state storage technology, CD-ROM (Compact Disc Read-Only Memory, CD-ROM), DVD (Digital Video Disc, high-density digital video disc) or other optical storage, tape cartridges, tapes, disks storage or other magnetic storage devices.

In an exemplary embodiment, a computer-readable storage medium is also provided, and a computer program is stored in the storage medium. When the computer program is executed by a processor of an audio playback device, the above-mentioned requirements for audio playback are realized. priority configuration method. In some embodiments, the computer-readable storage medium may include: ROM, RAM, SSD (Solid State Drives, solid state disk) or optical disc, etc. Wherein, the random access memory may include ReRAM (Resistance Random Access Memory, resistive random access memory) and DRAM (Dynamic Random Access Memory, dynamic random access memory).

In an exemplary embodiment, there is also provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the audio playback device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the audio playback device executes the above audio playback priority configuration method.

It should be understood that the "plurality" mentioned herein refers to two or more than two. "And/or" describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and/or B may indicate: A exists alone, A and B exist simultaneously, and B exists independently. The character "/" generally indicates that the contextual objects are an "or" relationship. In addition, the numbering of the steps described herein only exemplarily shows a possible sequence of execution among the steps. In some other embodiments, the above-mentioned steps may not be executed according to the order of the numbers, such as two different numbers The steps are executed at the same time, or two steps with different numbers are executed in the reverse order as shown in the illustration, which is not limited in this embodiment of the present application.

The above are only exemplary embodiments of the application, and are not intended to limit the application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the application shall be included in the protection of the application. within range.

Claims (20)

1. A priority configuration method for audio playback, the method is performed by an audio playback device, and the method includes:

   Determine the target scene mode where the audio playback device is located;

   Acquiring user behavior data generated in the target scene mode, the user behavior data includes data for controlling the audio playback device to switch and play different audio streams;

   Based on the user behavior data, the priority configuration information corresponding to the target scene mode is updated, and the priority configuration information is used to configure priority relationships among multiple audio streams.
2. The method according to claim 1, wherein the priority configuration information is used to configure a priority relationship between multiple audio stream types, and the priority configuration information includes: an identifier of the audio stream type, and The priority value corresponding to the identifier of the audio stream type.
3. The method according to claim 1, wherein the updating the priority configuration information corresponding to the target scene mode based on the user behavior data includes:

   If the user behavior data includes data that controls the audio stream belonging to the target audio stream type and preempts other audio streams for playback, then in the priority configuration information corresponding to the target scene mode, the priority corresponding to the target audio stream type Level values are updated.
4. The method according to claim 1, wherein the priority configuration information is used to configure the priority relationship between multiple audio stream types, and to configure the same or different audio streams of different connected devices of the audio playback device. The priority relationship of stream types.
5. The method according to claim 4, wherein,

   The priority configuration information includes: an identifier of the connected device, an identifier of the audio stream type, and a priority value corresponding to the identifier of the connected device and the identifier of the audio stream type;

   or,

   The priority configuration information includes: a combination identifier and a priority value corresponding to the combination identifier, wherein the combination identifier is used to distinguish different combinations of the connection device and the audio stream type.
6. The method according to claim 1, wherein the updating the priority configuration information corresponding to the target scene mode based on the user behavior data includes:

   If the user behavior data includes data that controls the audio stream from the target connected device and belongs to the target audio stream type, and preempts other audio streams for playback, then in the priority configuration information corresponding to the target scene mode, the target The priority value corresponding to the target audio stream type of the connected device is updated.
7. The method according to claim 1, wherein said determining the target scene mode of the audio playback device comprises:

   Collecting user voice data, identifying the user voice data to determine the target scene mode;

   or,

   Collecting environmental audio data, identifying the environmental audio data to determine the target scene mode;

   or,

   In response to a user operation on the audio playback device, determining the target scene mode based on the user operation;

   or,

   The scene switching information from the control device is received, and the target scene mode is determined according to the scene switching information.
8. The method according to claim 7, wherein the target scene mode is a scene mode configured in scene configuration information, and the scene mode includes at least one of family, meeting, work, driving, and reservation.
9. The method according to claim 8, wherein the scene mode is pre-configured and stored in the audio playback device by a technician, and the technician is a staff member of a manufacturer of the audio playback device;

   or,

   The scene mode is set by the user and stored in the audio playback device.
10. The method according to any one of claims 1 to 9, wherein the audio stream type includes at least one of telephony, media, and reservation.
11. A priority configuration device for audio playback, the device comprising:

    A mode determination module, configured to determine the target scene mode where the audio playback device is located;

    A data acquisition module, configured to acquire user behavior data generated in the target scene mode, where the user behavior data includes data for controlling the audio playback device to switch and play different audio streams;

    A configuration updating module, configured to update priority configuration information corresponding to the target scene mode based on the user behavior data, where the priority configuration information is used to configure priority relationships among various audio streams.
12. The device according to claim 11, wherein the priority configuration information is used to configure a priority relationship between multiple audio stream types, and the priority configuration information includes: an identifier of the audio stream type, and The priority value corresponding to the identifier of the audio stream type.
13. The device according to claim 11, wherein the configuration update module is configured to: if the user behavior data includes data that controls the audio stream belonging to the target audio stream type and preempts other audio streams for playback, then update the target In the priority configuration information corresponding to the scene mode, the priority value corresponding to the target audio stream type is updated.
14. The device according to claim 11, wherein the priority configuration information is used to configure the priority relationship between multiple audio stream types, and is used to configure the same or different audio streams of different connected devices of the audio playback device. The priority relationship of stream types.
15. The apparatus of claim 14, wherein,

    The priority configuration information includes: an identifier of the connected device, an identifier of the audio stream type, and a priority value corresponding to the identifier of the connected device and the identifier of the audio stream type;

    or,

    The priority configuration information includes: a combination identifier and a priority value corresponding to the combination identifier, wherein the combination identifier is used to distinguish different combinations of the connection device and the audio stream type.
16. The device according to claim 11, wherein the configuration update module is configured to control the audio stream from the target connected device, which belongs to the target audio stream type, and preempt other audio streams for playback if the user behavior data includes , update the priority value corresponding to the target audio stream type of the target connection device in the priority configuration information corresponding to the target scene mode.
17. The apparatus of claim 11, wherein,

    The mode determination module is configured to collect user voice data, and identify the user voice data to determine the target scene mode;

    or,

    The mode determination module is used to collect environmental audio data, and identify the environmental audio data to determine the target scene mode;

    or,

    The mode determination module is configured to determine the target scene mode based on the user operation in response to the user operation on the audio playback device;

    or,

    The mode determination module is configured to receive scene switching information from the control device, and determine the target scene mode according to the scene switching information.
18. The device according to claim 17, wherein the target scene mode is a scene mode configured in scene configuration information, and the scene mode includes at least one of family, meeting, work, driving, and reservation.
19. An audio playback device, the audio playback device includes a processor and a memory, and a computer program is stored in the memory, and the computer program is executed by the processor, so as to realize any one of claims 1 to 10. Methods.
20. A computer-readable storage medium, in which a computer program is stored, and the computer program is executed by a processor to implement the method according to any one of claims 1 to 10.

Images