CN114696961B

CN114696961B - Multimedia data transmission method and equipment

Info

Publication number: CN114696961B
Application number: CN202210559554.XA
Authority: CN
Inventors: 付雷; 唐能福; 林士博; 张勇
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2022-05-23
Filing date: 2022-05-23
Publication date: 2022-11-15
Anticipated expiration: 2042-05-23
Also published as: CN114696961A

Abstract

The embodiment of the application provides a multimedia data transmission method and equipment. The central device transmits the multimedia stream to the peripheral device at the first packet transmission rate. And when the central equipment and the peripheral equipment are in a state of increasing the distance, transmitting the multimedia stream to the peripheral equipment by adopting a second packet transmission rate which is greater than the first packet transmission rate. Before the distance between the central equipment and the peripheral equipment is increased to influence the data transmission quality, the central equipment transmits data to the peripheral equipment at a higher transmission rate in advance so that the peripheral equipment caches as much data as possible in advance, the peripheral equipment reads as much data as possible from the cache of the peripheral equipment when the link is poor, and the audio playing time is prolonged.

Description

Multimedia data transmission method and equipment

Technical Field

The present application relates to the field of short-distance communication, and in particular, to a method and device for transmitting multimedia data.

Background

The mobile phone and the Bluetooth headset inevitably have a scene that the distance between the mobile phone and the headset becomes large in the daily use process, for example, the headset is taken to be connected with water from an office, or to be washed, or in a scene of a playground, the mobile phone is placed beside the playground, a user wears the headset to run and other activities on the playground, the short distance is increased to cause the quality of Bluetooth signals to be deteriorated, the Bluetooth audio data is lost and retransmitted in a sending process, and then the Bluetooth audio is blocked, and the user experience is influenced.

Disclosure of Invention

The application provides a method and equipment for increasing multimedia stream transmission time, which can increase the multimedia stream playing time on peripheral equipment when the peripheral equipment and central equipment are in a state of becoming far away.

In order to achieve the purpose, the technical scheme is as follows:

in a first aspect, the present application provides a multimedia data transmission method, applied to a central device, the method including: transmitting a multimedia stream to the peripheral device at a first packet transmission rate; when the central equipment and the peripheral equipment are in a state of becoming far away, the multimedia stream is sent to the peripheral equipment by adopting a second packet sending rate; wherein the first packet sending rate is less than the second packet sending rate. Therefore, before the distance between the central equipment and the peripheral equipment is increased to influence the data transmission quality, the central equipment transmits data to the peripheral equipment at a higher transmission rate in advance, so that the peripheral equipment caches as much data as possible in advance, and further the peripheral equipment reads as much data as possible from the buffer of the peripheral equipment when the link is poor, and the playing time is prolonged.

In one possible implementation, the packet sending rate is a maximum transmission unit MTU or a transmission speed.

In a possible implementation, when the motion state of the central device is in a stationary or jogging state and the motion state of the peripheral device is a walking or running state, and/or the distance between the central device and the peripheral device reaches a second threshold value, then the central device and the peripheral device are in a state of distance increase.

In one possible implementation, the short-range communication mode is bluetooth communication.

In a possible implementation, before sending the multimedia stream to the peripheral device at the second packet sending rate, the method includes adding a first buffer space of the central device and requesting the peripheral device to add a second buffer space, where the second buffer space is in the peripheral device.

In a possible implementation, the increasing the first cache space of the central device and the requesting the peripheral device to increase the second cache space further comprise notifying an upper layer to increase the amount of data requested from a server or locally.

In a possible implementation manner, before the sending the multimedia stream to the peripheral device at the second packet sending rate when the central device and the peripheral device are in the state of increasing distance, the method further includes: and determining whether the central equipment and the peripheral equipment are in a state of being far away according to the sensor data and/or the distance measurement result of the central equipment and the peripheral equipment.

In a second aspect, a multimedia data transmission method of the present application is applied to a peripheral device, and the method includes: receiving a multimedia stream sent by the central equipment at a first packet sending rate; when the central equipment and the peripheral equipment are in a state of becoming far away, receiving a multimedia stream sent by the central equipment at a second packet sending rate; wherein the second packet sending rate is greater than the first packet sending rate.

In a possible implementation, the receiving of the multimedia stream sent by the central device at the second packet sending rate includes sending the sensor data of the peripheral device to the central device.

In one possible implementation, when the wearing state of the peripheral device is worn by the user and the exercise state of the peripheral device is running or walking, the sensor data of the peripheral device is sent to the central device.

In a possible implementation manner, before the receiving of the multimedia stream sent by the central device at the second packet sending rate, the method includes increasing a second buffer space of the peripheral device.

In a possible implementation manner, when the link between the peripheral device and the central device is disconnected or the signal quality between the peripheral device and the central device is less than a sixth threshold, the multimedia stream of the second buffer space is continuously played, or whether to continue playing the multimedia stream is selected according to an operation instruction of a user.

In a third aspect, the present application provides a center apparatus, including: a memory and one or more processors; the memory is coupled to the processor, the memory for storing computer program code comprising computer instructions which, when executed by the one or more processors, cause the central apparatus to perform the method of the first aspect and any of its possible designs.

In a fourth aspect, the present application provides a peripheral device comprising: a memory and one or more processors; the memory coupled to the processor for storing computer program code comprising computer instructions which, when executed by the one or more processors, cause the peripheral device to perform the method of the second aspect and any of its possible designs.

In a fifth aspect, the present application provides a computer readable medium comprising computer instructions which, when run on a central device, cause the central device to perform the method according to the first aspect and any one of its possible designs.

In a sixth aspect, the present application provides a computer readable medium comprising computer instructions which, when run on a peripheral device, cause the peripheral device to perform the method of the second aspect and any one of its possible designs.

Drawings

Fig. 1 is a schematic structural diagram of a center device 100 according to an embodiment of the present disclosure;

fig. 2 is a schematic structural diagram of a peripheral device 200 according to an embodiment of the present disclosure;

fig. 3 is a flowchart of interaction between a central device and a peripheral device according to an embodiment of the present application;

fig. 4 is a flowchart of performing buffer preparation and transmitting a multimedia stream on a central device according to an embodiment of the present disclosure;

fig. 5 is a flowchart illustrating a method for performing buffer preparation and playing a multimedia stream on a peripheral device according to an embodiment of the present disclosure;

fig. 6 is a schematic structural component diagram of a chip system according to an embodiment of the present disclosure.

Detailed Description

In order to facilitate clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, terms such as "first" and "second" are used to distinguish the same items or similar items with basically the same functions and actions, and the order of the items is not limited. Those skilled in the art will appreciate that the terms "first," "second," and the like do not denote any order or importance, but rather the terms "first," "second," and the like do not denote any order or importance.

It is noted that the words "exemplary," "for example," and "such as" are used herein to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "such as" is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present relevant concepts in a concrete fashion.

Further, "at least one" means one or more, "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone, wherein A and B can be singular or plural. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. "at least one of the following" or similar expressions refer to any combination of these items, including any combination of the singular or plural items. For example, at least one (one) of a, b, and c, may represent: a, or b, or c, or a and b, or a and c, or b and c, or a, b and c, wherein a, b and c can be single or multiple.

The technical solution in the present application will be described below with reference to the accompanying drawings.

In order to make the purpose and technical solution of the present application clearer and more intuitive, the method and the terminal device provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of and not restrictive on the broad application.

Fig. 1 shows a schematic structural diagram of a center device 100.

The center device 100 may be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a Personal Digital Assistant (PDA), an Augmented Reality (AR) device, a Virtual Reality (VR) device, an Artificial Intelligence (AI) device, a wearable device, a vehicle-mounted device, a smart home device, and/or a smart city device, and the embodiment of the present application does not particularly limit the specific type of the electronic device.

The center device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, a sensor module 180, keys 190, and a display screen 194, and a Subscriber Identification Module (SIM) card interface 195, etc. The sensor module 180 may include an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, and the like.

It is to be understood that the illustrated configuration of the embodiment of the present invention does not constitute a specific limitation to the center apparatus 100. In other embodiments of the present application, the central facility 100 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated into one or more processors.

The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.

In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

The I2S interface may be used for audio communication. In some embodiments, processor 110 may include multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 through an I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may communicate audio signals to the wireless communication module 160 via an I2S interface to enable answering a call via a peripheral device.

The PCM interface may also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, audio module 170 and wireless communication module 160 may be coupled by a PCM bus interface. In some embodiments, the audio module 170 may also communicate audio signals to the wireless communication module 160 via the PCM interface to enable answering a call via a peripheral device. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communications. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 110 with the wireless communication module 160. For example: the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 170 may transmit the audio signal to the wireless communication module 160 through the UART interface, so as to realize the function of playing music through the peripheral device.

It should be understood that the connection relationship between the modules according to the embodiment of the present invention is only illustrative, and does not form a structural limitation on the central device 100. In other embodiments of the present application, the center device 100 may also adopt different interface connection manners or a combination of a plurality of interface connection manners in the above embodiments.

The wireless communication function of the center apparatus 100 may be realized by an antenna, a wireless communication module 160, a modem processor, a baseband processor, and the like.

The antenna is used for transmitting and receiving electromagnetic wave signals. Each antenna in the central facility 100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be independent of the processor 110 and may be disposed in the same device as the other functional blocks.

The wireless communication module 160 may provide a solution for wireless communication applied to the center device 100, including Wireless Local Area Networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), global Navigation Satellite Systems (GNSS), frequency Modulation (FM), near Field Communication (NFC), infrared (IR), and the like. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via an antenna, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 110. Wireless communication module 160 may also receive signals to be transmitted from processor 110, frequency modulate them, amplify them, and convert them into electromagnetic waves via an antenna for radiation.

In some embodiments, the central device 100 may communicate with the network and other devices via wireless communication techniques. The wireless communication technology may include global system for mobile communications (GSM), general Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to extend the memory capability of the center device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music, video, etc. are saved in the external memory card.

The internal memory 121 may be used to store computer-executable program code, which includes instructions. The internal memory 121 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The storage data area may store data (such as audio data, a phonebook, etc.) created during use of the center apparatus 100, and the like. In addition, the internal memory 121 may include a high speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a Universal Flash Storage (UFS), and the like. The processor 110 executes various functional applications of the center apparatus 100 and data processing by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.

The center device 100 may implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also called a "horn", is used to convert the audio electrical signal into a sound signal. The center apparatus 100 can listen to music through the speaker 170A or listen to a handsfree call.

The receiver 170B, also called "earpiece", is used to convert the electrical audio signal into an acoustic signal. When the central apparatus 100 receives a call or voice information, it is possible to receive voice by placing the receiver 170B close to the human ear.

The microphone 170C, also referred to as a "microphone," is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can input a voice signal to the microphone 170C by speaking near the microphone 170C through the mouth. The center apparatus 100 may be provided with at least one microphone 170C. In other embodiments, the center device 100 may be provided with two microphones 170C, which may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the central device 100 may further include three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, perform directional recording, and so on.

The earphone interface 170D is used to connect a wired earphone. The headset interface 170D may be the USB interface 130, or may be a 3.5mm open mobile electronic device platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The acceleration sensor 180E can detect the magnitude of acceleration of the center apparatus 100 in various directions (generally, three axes). The magnitude and direction of gravity can be detected when the central apparatus 100 is stationary. The method can also be used for recognizing the posture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.

A distance sensor 180F for measuring a distance. The center device 100 may measure the distance by infrared or laser. In some embodiments, taking a picture of a scene, the center device 100 may utilize the distance sensor 180F to range to achieve fast focus.

Referring to fig. 2, the peripheral device 200 in fig. 2 of the present application may be an electronic device having a bluetooth connection function, such as a bluetooth headset, a smart speaker, a smart watch, a portable media player, a vehicle-mounted media player, and capable of decoding and playing media data (such as audio), and introduces the peripheral device provided in the present application. For example, where the peripheral device is a bluetooth headset, as shown in fig. 2, the peripheral device 200 may include: a processor 210, a memory 220, a sensor 230, a wireless communication module 240, a receiver 250, a microphone 260, a power supply 270, and an input/output interface 280.

The memory 220 can be used for storing application program codes, such as application program codes for establishing a wireless connection with another center device 100 included in the peripheral device 200 and enabling the peripheral device 200 to perform pairing connection with the center device 100. The processor 210 can control and execute the application program codes to realize the functions of the peripheral device 200 in the embodiment of the present application.

The memory 220 may also have stored therein a bluetooth address uniquely identifying the headset and a peripheral address of another headset of the peripheral 200. In addition, the memory 220 may also store connection data with a previously successfully paired central device of the peripheral device. For example, the connection data may be a bluetooth address of a central device that has successfully paired with the peripheral device. Based on the connection data, the peripheral device can automatically pair with the central device without having to configure a connection therewith, such as for validity verification or the like. The bluetooth address may be a Media Access Control (MAC) address.

The sensor 230 may be a distance sensor or a proximity light sensor. The peripheral device may determine whether it is worn by the user through the sensor 230. For example, the peripheral device may utilize a proximity light sensor to detect whether an object is nearby, thereby determining whether the peripheral device is being worn by the user. Upon determining that the headset is worn, the peripheral device may turn on the receiver 250.

In other embodiments, the peripheral device may include a fingerprint sensor for detecting a user's fingerprint, identifying a user's identity, and the like.

A wireless communication module 240 for supporting short-range data exchange between the peripheral device 200 and various central devices, such as the central device 100 described above. In some embodiments, the wireless communication module 240 may be a bluetooth transceiver or a Radio Frequency (RF) circuit. The peripheral device 200 can establish a wireless connection with the central device 100 through the bluetooth transceiver to realize short-distance data exchange between the two.

At least one receiver 250, which may also be referred to as a "headset," may be used to convert the electrical audio signals into sound signals and play them. For example, when the peripheral device 200 functions as the audio output device of the above-described center device 100, the receiver 250 may convert the received audio electric signal into a sound signal and play it.

At least one microphone 260, which may also be referred to as a "microphone," is used to convert sound signals into electrical audio signals. For example, when the peripheral device 200 is used as the audio input device of the central device 100, the microphone 260 can collect the voice signal of the user and convert the voice signal into an audio electrical signal during the process of speaking (such as a call or a voice message). The audio electrical signal is the audio data in the embodiment of the present application. In some embodiments, the microphone 260 may be a feed-forward microphone.

Power supply 270 may be used to power the various components included in peripheral device 200.

The various components shown in fig. 2 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing or application specific integrated circuits.

The methods in the following embodiments may be implemented in both the central device and the peripheral device having the above-described hardware structures. The method of the present embodiment will be explained.

Before performing the method of the embodiments of the present application, the central device may establish a connection with the peripheral device via bluetooth. Specifically, for the description of the connection between the central device and the peripheral device through bluetooth, reference may be made to a method for establishing connection between the central device and the peripheral device in the conventional technology, which is not described herein again.

Illustratively, the central device is a mobile phone, and the peripheral device is a bluetooth headset.

The central device transmits multimedia data to the peripheral device at a first packet transmission rate. A specific scenario may be that the user opens the music or video software of the mobile phone, wears the headset to start listening to music or watching video, and the mobile phone starts sending multimedia data to the headset at the first packet sending rate. In order to prevent the user from placing the handset in one room and carrying the headset into another room, which may result in an excessive increase in the distance between the handset and the headset, thereby affecting the link quality of multimedia data transmission, the communication system formed by the handset and the headset may perform the interaction process of fig. 3.

In fig. 3, the central device and the peripheral devices each include a bluetooth service, an Audio/Video Distribution Transport Protocol (AVDTP) service, and optionally a sensor.

The Bluetooth service is a functional module developed based on a framework layer, functions of acquiring sensor data, controlling a protocol layer and the like in the application can be realized, and developers can expand functions of the Bluetooth service according to needs.

The AVDPT service performs the functions of the AVDTP protocol layer. The AVDTP protocol is a transport protocol that specifies the distribution of audio or video, and transports streaming media audio or video over the air via bluetooth.

The central device and the peripheral devices may be equipped with one or more sensors. The sensor may be an acceleration sensor, a velocity sensor, a vibration sensor, a gravity sensor, or other types of sensors, but is not limited thereto. The sensor is used for collecting motion state data of the central equipment and the peripheral equipment.

The interaction flow between the central device and the peripheral device in fig. 3 is as follows:

s101, the central equipment judges whether the central equipment and the peripheral equipment are in a state of becoming far away. If the distance is far away, S102 is executed, otherwise, no processing is performed.

Specifically, the bluetooth service of the center device determines whether the center device is in a state of being distant from the center device. If yes, the Bluetooth service of the central equipment informs the AVDTP service of increasing the buffer space.

And S102, the central equipment increases the buffer space of the central equipment.

Specifically, the AVDTP service of the central device increases the buffer space.

The central device and the peripheral device are both allocated a block of buffer space for storing the received multimedia data.

S103, the central equipment requests the peripheral equipment to increase the cache space.

Specifically, the AVDTP service of the central device notifies the AVDTP service of the peripheral device to increase the cache space.

And S104, the peripheral equipment replies a response message agreeing to increase the cache space to the central equipment and increases the cache of the peripheral equipment.

Specifically, the AVDTP service of the peripheral device replies an add cache response message to the AVDTP service of the central device.

And S105, the central equipment increases the data volume requested to the server or the local.

Specifically, the bluetooth service of the center device increases the requested data amount to an Upper Layer (UL) protocol.

And S106, the central equipment increases the packet sending rate to a second packet sending rate, and sends the multimedia stream to the peripheral equipment based on the second packet sending rate.

Specifically, the AVDTP of the central device sends the multimedia data to the peripheral device at the second packet sending rate.

And S107, writing the multimedia data in the increased buffer memory by the peripheral equipment.

Steps S101-107 are performed before the link quality of the peripheral device and the central device is poor or broken, and the peripheral device increases the buffer memory in advance and writes more multimedia data, thereby prolonging the playing time of the multimedia stream after the link is degraded.

Fig. 4 shows a flow of the central device for buffer preparation and transmission of the multimedia stream. The flow of buffer preparation and multimedia stream transmission is described in detail in the perspective of the central device in conjunction with fig. 3 and 4:

s201, the central device determines whether the central device and the peripheral device are in a state of being far away according to sensor data of the central device and the peripheral device. The method specifically comprises the following steps:

and S2011, the Bluetooth service of the central device receives the sensor data sent by the Bluetooth service of the peripheral device.

The bluetooth service of the central device may receive the sensor data of the peripheral device from the bluetooth service of the peripheral device through the AVDTP protocol, and may also receive the sensor data through other short-range communication protocols, which is not limited herein.

S2012, the Bluetooth service of the central equipment receives the data collected by the sensor of the central equipment.

And S2013, the Bluetooth service of the central equipment judges whether the central equipment and the peripheral equipment are in a state of changing the distance or not according to the data acquired by the central equipment and the peripheral equipment.

In one embodiment, the bluetooth service of the central device determines the motion state of the device based on data collected by one or more sensors. The function of judging the motion state can also be realized in other software modules, and is not limited to the bluetooth service. The bluetooth service of the central device can determine the motion state of the device using the sensor data in a manner of the related art. The motion state includes the device being carried about by a user running or walking; the motion state also includes the device being in a stationary or jogging state. The bluetooth service of the central device determines that when the central device is in a stationary or jogging state and the peripheral device is carried by a user running or walking, or further, when it is determined that the duration of the state is greater than the first threshold, the bluetooth service determines that the central device and the peripheral device are in a state of becoming distant from each other, and S202 is performed. If the distance is not in the remote state, the process is not performed, and S201 is continuously executed.

As one embodiment, the step of S201 is replaced with S201A.

S201A, the central equipment determines whether the central equipment and the peripheral equipment are in a state of being far away according to the ranging results of the central equipment and the peripheral equipment.

As an embodiment, the relative distance between the central device and the peripheral device is estimated by an Angle of Arrival (AoA) or Angle of Departure (AoD) positioning technique, a tag is arranged as a transmitting end at the peripheral device, a locator is arranged as a receiving end at the central device, and the AoA is used for calculating the direction Angle of the transmitting end relative to the receiving end by the phase difference between the closest antenna and the farthest antenna of the signal wave reaching the receiving end to realize positioning; aoD is a calculation of the direction angle of the transmitting end with respect to the receiving end based on the phase difference when the signals transmitted by the antennas whose transmitting end is closest to and farthest from the receiving end are received. As another example, BLE (bluetooth low energy) ranging technology is used to estimate the relative distance between the central device and the peripheral device.

The distance measurement result comprises the distance between the central equipment and the peripheral equipment; optionally, the ranging result further includes a time that the distance between the central device and the peripheral device continuously increases. When the central equipment judges that the distance between the peripheral equipment and the central equipment reaches a second threshold value, the central equipment judges that the central equipment and the peripheral equipment are in a state of increasing the distance; or when the central device determines that the distance between the peripheral device and itself reaches the third threshold and the distance continuously increasing time reaches the fourth threshold, the central device determines that itself and the peripheral device are in a state of increasing distance, and executes 202.

The above steps 201 and 201A may be combined for determination. As an embodiment, a state in which the distance is determined to become longer in steps S201 and S201A is adopted, and when both of steps 201 and 201A satisfy the condition, S202 is executed. As another example, the bluetooth service of the central device may also receive sensor data transmitted by the portable device. The portable device can be a smart watch or a smart bracelet. The center device may determine whether or not it is in a state where the distance between itself and the peripheral device becomes longer, based on the sensor data of the portable device and the distance measurement result of S201A.

S202, the central equipment increases the buffer space of the central equipment.

The bluetooth service of the central device informs the AVDTP service to add a cache. The AVDTP service will then increase the buffer in order to buffer more multimedia data.

S203, the central device requests the peripheral device to increase the buffer space.

After the AVDTP service of the central device requests the AVDTP service of the peripheral device to increase the cache, if the AVDTP service of the peripheral device agrees to increase the cache, the AVDTP service of the central device receives an agreement response message sent by the AVDTP service of the peripheral device. The negotiation process may multiplex existing fields of the AVDTP protocol, and may also multiplex fields of other bluetooth communication protocols, which is not limited herein.

The execution order of S202-S203 is not limited.

And S204, the central equipment requests more data volume to the network side.

The bluetooth module of the center device notifies an upper layer protocol to increase the requested data amount, the upper layer protocol increasing the data amount requested to the server or the local.

S205, the center device increases a packet transmission rate at which the multimedia stream is transmitted to the peripheral device.

The packet sending rate comprises a Maximum Transmission Unit (MTU) and a transmission rate specification, and increasing the packet sending rate comprises increasing the MTU or the transmission rate. As an example, the bluetooth service of the center device informs its own AVDTP service to increase the MTU or transmission speed. For example, the AVDTP service may increase the transmission speed from 2Mbps to 3Mbps, and may also increase the MTU from 663 bytes to 1005 bytes.

The execution order of S204-S205 is not limited.

Since the distance between the center device and the peripheral device is continuously in a state of becoming far away, in order to prevent packet loss, the packet transmission rate adaptability is reduced. Therefore, optionally, execution continues with S206.

S206: the peripheral equipment reports the measured signal quality to the central equipment periodically, and the central equipment determines the signal quality received by the peripheral equipment. And when the central device judges that the quality of the signal received by the peripheral device is less than the fourth threshold value and/or the central device judges that the distance between the central device and the peripheral device is continuously increased to be greater than the fifth threshold value, reducing the packet sending rate, specifically reducing the maximum transmission unit MTU or the transmission speed. In one embodiment, the central device will transmit at a speed from 3Mbps to 2Mbps. The fifth threshold is greater than the second threshold or the third threshold.

Fig. 5 shows the flow of the peripheral device buffer preparation and playing the multimedia stream. In conjunction with fig. 3 and 5, the peripheral device performs the following steps:

and S301, the peripheral equipment sends the sensor data of the peripheral equipment to the central equipment.

Optionally, before the peripheral device sensor sends the acquired data to the bluetooth service of the peripheral device, the wearing state of the peripheral device sensor is determined. The wearing state of the peripheral device is whether the user is wearing the peripheral device. In one embodiment, an infrared sensor is mounted in the peripheral device and detects the distance between the peripheral device and the human ear. In another example, the peripheral device collects data via a micro-motion sensor to determine whether the user is wearing the peripheral device. If the peripheral device determines that the user is wearing the peripheral device, the Bluetooth service of the peripheral device sends the sensor data to the Bluetooth service of the central device.

Optionally, after receiving the data of the sensor, the bluetooth service of the peripheral device determines the motion state of the peripheral device, and if it is determined whether the user of the peripheral device is running or walking, the bluetooth service of the peripheral device sends the data of the sensor to the bluetooth service of the central device, which may specifically include that the bluetooth service of the peripheral device sends the motion state information of the peripheral device to the central device, and may also send data such as the motion speed detected by the sensor to the peripheral device. If the motion state of the peripheral device is static, no processing is performed, that is, if it is determined that the user of the peripheral device is static or jogging, the peripheral device does not send the sensor data to the center device.

S302, the AVDTP service of the peripheral equipment receives a cache increasing request message sent by the central equipment, and increases the cache of the peripheral equipment.

After the peripheral equipment receives the request message for increasing the cache space, if the peripheral equipment agrees to increase the cache space, the peripheral equipment sends a response message agreeing to increase the cache to the central equipment. The negotiation process may multiplex existing fields of the AVDTP protocol, and may also multiplex fields of other bluetooth communication protocols, which is not limited herein.

The central device sends the multimedia stream based on a larger packet sending rate, and the peripheral device continuously receives the multimedia stream, so that the expanded buffer space of the peripheral device is continuously filled, and meanwhile, the peripheral device plays multimedia data.

And S303, when the link is disconnected or the link quality of the peripheral equipment and the central equipment is poor (for example, the signal quality of the peripheral equipment and the signal quality of the central equipment are less than a sixth threshold), the AVDTP service of the peripheral equipment continuously reads the multimedia data in the self buffer. The peripheral device increases the buffer memory in advance and writes more multimedia data, thereby prolonging the playing time of the multimedia stream after the link is deteriorated. The sixth threshold is less than the fourth threshold.

In one embodiment, if the link is broken, the peripheral device prompts the user by voice, asks the user whether to continue playing music, and the user presses the play or stop button to select to continue playing music or stop playing music. In another embodiment, after prompting the user to disconnect, the peripheral device also guides the user to perform corresponding key operation through voice. And the user selects to continue playing the music or stop playing according to the key operation mode of the voice prompt. If the user plays the audio file, the process proceeds to S304.

S304, if the reading of the multimedia data in the buffer space of the peripheral equipment is finished, the AVDTP service continuously and circularly reads the multimedia data from the head, and the peripheral equipment continuously plays music to prevent the peripheral equipment from entering a silent state. In one embodiment, if the amount of data stored in the buffer is larger than the length of the whole song, the data frame corresponding to the beginning of one song is read during reading. Upon re-reading the buffered music, the user may hear the song playing from the beginning.

In the above embodiment, instead of the step S301, whether the distance between the peripheral device and the central device is far is determined by Angle of Arrival (AoA) or Angle of Departure (AoD).

Other embodiments of the present application provide a central facility (e.g., central facility 100 shown in fig. 1). The center device may include: a memory and one or more processors. The memory is coupled to the processor. The memory is for storing computer program code comprising computer instructions. When the processor executes the computer instructions, the central device may perform the various functions or steps performed in the above-described method embodiments. The structure of the center device can refer to the structure shown in fig. 1.

Other embodiments of the present application provide a peripheral device (e.g., a peripheral device 200 such as a bluetooth headset as shown in fig. 2). The peripheral device may include: a memory and one or more processors. The memory is coupled to the processor. The memory is for storing computer program code comprising computer instructions. When the processor executes the computer instructions, the peripheral device may perform various functions or steps performed by the handset in the above-described method embodiments. The structure of the peripheral device may refer to the structure of the peripheral device 200 shown in fig. 2.

An embodiment of the present application further provides a chip system, as shown in fig. 6, where the chip system includes at least one processor 601 and at least one interface circuit 602. The processor 601 and the interface circuit 602 may be interconnected by wires. For example, the interface circuit 602 may be used to receive signals from other devices (e.g., a memory of a hub device). As another example, the interface circuit 602 may be used to send signals to other devices, such as the processor 601. Illustratively, the interface circuit 602 may read instructions stored in the memory and send the instructions to the processor 601. The instructions, when executed by the processor 601, may cause the central device 100 or the peripheral device 200 to perform the various steps in the embodiments described above. Of course, the chip system may further include other discrete devices, which is not specifically limited in this embodiment of the present application.

Embodiments of the present application also provide a computer-readable storage medium, which includes computer instructions, and when the computer instructions are executed on the above-mentioned electronic device (such as the central device 100 shown in fig. 1 or the peripheral device 200 shown in fig. 2), the central device or the peripheral device performs various functions or steps performed in the above-mentioned method embodiments.

The embodiments of the present application further provide a computer program product, which when run on a computer, causes the computer to execute each function or step executed by the mobile phone in the above method embodiments.

Through the description of the above embodiments, it is clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above described functions.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the above-described device embodiments are merely illustrative, and for example, the division of the modules or units is only one logical functional division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another device, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may be one physical unit or a plurality of physical units, that is, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially or partially contributed to by the prior art, or all or part of the technical solutions may be embodied in the form of a software product, where the software product is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, or the like) or a processor (processor) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A multimedia data transmission method is applied to a central device, the central device and a peripheral device are connected in a short-distance communication mode, and the multimedia data transmission method is characterized in that:

increasing a first cache space of the central device and requesting the peripheral device to increase a second cache space;

transmitting a multimedia stream to the peripheral device at a first packet transmission rate;

when the central equipment and the peripheral equipment are in a state of becoming far away, the multimedia stream is sent to the peripheral equipment by adopting a second packet sending rate;

wherein the first packet sending rate is less than the second packet sending rate;

before the transmitting the multimedia stream to the peripheral device at the second packet transmission rate when the central device and the peripheral device are in the state of being far away, the method further comprises: the method comprises the steps of calculating the relative distance between the central equipment and the peripheral equipment through the AoA arrival angle or AoD departure angle positioning technology, and determining whether the peripheral equipment and the peripheral equipment are in a state of being far away from each other, wherein the peripheral equipment is used as a transmitting end to be provided with a tag, and the central equipment is used as a receiving end to be provided with a locator.

2. The method of claim 1, wherein: the first packet sending rate is a first Maximum Transmission Unit (MTU) or a first transmission speed, and the second packet sending rate is a second Maximum Transmission Unit (MTU) or a second transmission speed.

3. The method of claim 1 or 2, wherein: the state that the central equipment and the peripheral equipment are far away comprises that the motion state of the central equipment is in a static state or a micro-motion state, and the motion state of the peripheral equipment is in a walking state or a running state; and/or the distance between the central device and the peripheral device reaches a second threshold.

4. The method of any of claims 1-2, wherein: the short-distance communication mode is Bluetooth communication.

5. The method of claim 1, wherein: after the increasing the first cache space of the central device and requesting the peripheral device to increase the second cache space, the method further includes increasing an amount of data requested from a server or locally.

6. The method of any of claims 1-2, wherein the peripheral device is a bluetooth headset.

7. A multimedia data transmission method is applied to peripheral equipment, the peripheral equipment and central equipment are connected in a short-distance communication mode, and the multimedia data transmission method is characterized in that:

receiving a request sent by the central equipment and requiring the peripheral equipment to increase a second cache space, and increasing the second cache space of the peripheral equipment;

receiving a multimedia stream sent by the central equipment at a first packet sending rate;

when the central equipment and the peripheral equipment are in a state of becoming far away, receiving a multimedia stream sent by the central equipment at a second packet sending rate;

wherein the second packet sending rate is greater than the first packet sending rate;

before the receiving, when the central device and the peripheral device are in a state of being at a longer distance, a multimedia stream sent by the central device at a second packet sending rate, the method further includes: the method comprises the steps of calculating the relative distance between the central equipment and the peripheral equipment through the AoA arrival angle or the AoD departure angle positioning technology, and determining whether the central equipment and the peripheral equipment are in a state of changing the distance, wherein the peripheral equipment is used as a transmitting end to be provided with a tag, and the central equipment is used as a receiving end to be provided with a locator.

8. The method of claim 7, wherein: the first packet sending rate is a first Maximum Transmission Unit (MTU) or a first transmission speed, and the second packet sending rate is a second Maximum Transmission Unit (MTU) or a second transmission speed.

9. The method of claim 7, wherein: the state that the central device and the peripheral device are at a distance increasing distance includes that the motion state of the central device is at a static state or a jogging state, the motion state of the peripheral device is a walking state or a running state, and/or the distance between the central device and the peripheral device reaches a second threshold value.

10. The method of claim 7, wherein: before receiving the multimedia stream transmitted by the central device at the second packet transmission rate, the method includes transmitting the sensor data of the peripheral device to the central device.

11. The method of claim 10, wherein: the sending the sensor data of the peripheral device to the central device comprises: when the wearing state of the peripheral equipment is worn by a user and the motion state of the peripheral equipment is running or walking, sending the sensor data of the peripheral equipment to the central equipment.

12. The method of claim 7, wherein: and when the link between the peripheral equipment and the central equipment is disconnected or the signal quality between the peripheral equipment and the central equipment is less than a sixth threshold value, continuing to play the multimedia stream of the second cache space, or selecting whether to continue to play the multimedia stream according to an operation instruction of a user.

13. The method of claim 7, wherein: the short-distance communication mode is Bluetooth communication.

14. The method of any of claims 7-13, wherein the peripheral device is a bluetooth headset.

15. A center device, characterized in that the center device comprises: a memory and one or more processors; the memory coupled with the processor, the memory for storing computer program code comprising computer instructions that, when executed by the one or more processors, cause the hub device to perform the method of any of claims 1-6.

16. A peripheral device, characterized in that the peripheral device comprises: a memory and one or more processors; the memory coupled with the processor, the memory for storing computer program code comprising computer instructions that, when executed by the one or more processors, cause the peripheral device to perform the method of any of claims 7-14.

17. A computer-readable storage medium comprising computer instructions that, when executed on a central device, cause the central device to perform the method of any one of claims 1-6.

18. A computer readable storage medium comprising computer instructions which, when executed on a peripheral device, cause the peripheral device to perform the method of any one of claims 7-14.