WO2017107427A1 - 终端设备的控制方法、装置、设备及非易失性计算机存储介质 - Google Patents

终端设备的控制方法、装置、设备及非易失性计算机存储介质 Download PDF

Info

Publication number
WO2017107427A1
WO2017107427A1 PCT/CN2016/088120 CN2016088120W WO2017107427A1 WO 2017107427 A1 WO2017107427 A1 WO 2017107427A1 CN 2016088120 W CN2016088120 W CN 2016088120W WO 2017107427 A1 WO2017107427 A1 WO 2017107427A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio data
terminal device
sound source
played
original audio
Prior art date
Application number
PCT/CN2016/088120
Other languages
English (en)
French (fr)
Inventor
刘才权
唐杰
陈聪
Original Assignee
百度在线网络技术(北京)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 百度在线网络技术(北京)有限公司 filed Critical 百度在线网络技术(北京)有限公司
Publication of WO2017107427A1 publication Critical patent/WO2017107427A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/725Cordless telephones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages

Definitions

  • the present invention relates to communication technologies, and in particular, to a terminal device control method, apparatus, device, and non-volatile computer storage medium.
  • terminal devices integrate more and more functions, so that more and more corresponding applications (Applications, APPs) are included in the system function list of the terminal devices.
  • An application installed on some terminal devices which is referred to as an interconnection application in the present invention, needs to be installed by using a corresponding cooperation application on another terminal device connected thereto, otherwise there is no use value, especially for some vehicle interconnections. application.
  • the application may send the audio data and the play control information of the audio data to the interconnected application, and the interconnected application according to the obtained playback control information.
  • the playback control processing of the audio data is, for example, starting playback, pausing, resume playback, and the like.
  • the application needs to send audio data of multiple audio sources to the connected application, for example, song audio data matching the music function of the application, TTS audio data (TTS) matching the navigation function of the application, etc.
  • TTS TTS audio data
  • the audio module corresponding to the source needs to communicate synchronously with the audio module corresponding to other audio sources to determine whether it can transmit audio data. Only the audio module that determines the source of audio data transmission can transmit the audio data of the audio source to the connected application through cooperation with the application. In the process of transmitting audio data of a sound source, the audio module corresponding to the sound source also needs to monitor the audio data transmission condition of the audio module corresponding to other sound sources in real time, if the audio data transmission condition of the audio module corresponding to other sound sources changes. , the audio module corresponding to other audio sources needs to perform synchronous communication to determine whether to suspend audio data transmission or resume audio data transmission.
  • the audio module corresponding to each sound source needs to perform synchronous communication with the audio module corresponding to other sound sources to determine whether it can transmit audio data, the system resources of the terminal device are wasted.
  • aspects of the present invention provide a method, apparatus, and non-volatile computer storage medium for controlling a terminal device to avoid waste of system resources of the terminal device.
  • An aspect of the present invention provides a method for controlling a terminal device, including:
  • the original audio data of the second terminal device includes:
  • Audio data of the application other than the matching application on the second terminal device
  • the first terminal device is an in-vehicle terminal device
  • the second terminal device is a user terminal device.
  • Another aspect of the present invention provides a method for controlling another terminal device, including:
  • the sound source to which the original audio data belongs is different from the sound source of the currently played audio data, according to the start play instruction, the sound source priority information of the sound source to which the original audio data belongs, and the sound source priority information of the currently played sound source. Stopping playing the audio data of the currently playing sound source, starting to play the original audio data or continuing to play the audio data of the currently playing sound source.
  • the audio source priority information of the audio source to which the original audio data belongs includes:
  • the audio data of the currently played source is resumed.
  • the first terminal device is an in-vehicle terminal device
  • the second terminal device is a user terminal device.
  • Another aspect of the present invention provides a method for controlling another terminal device, including:
  • Parsing audio data to be played for each of the to-be-played audio data of the at least two sound sources to obtain original audio data of each of the audio sources, and starting playback instructions of the original audio data of each of the audio sources And sound source priority information of each of the sound sources;
  • the original audio data of one source is started to be played according to the start play command of the original audio data of each of the sound sources and the sound source priority information of each of the sound sources.
  • the play instruction and the sound source priority information of each of the sound sources including:
  • Parsing audio data to be played for each of the sound sources to obtain original audio data of each sound source, the start play instruction in the audio control frame, and the sound source priority in the audio control frame information.
  • the first terminal device is an in-vehicle terminal device
  • the second terminal device is a user terminal device.
  • Another aspect of the present invention provides a control device for a terminal device, including:
  • An acquiring unit configured to obtain original audio data of the second terminal device connected to the first terminal device where the interconnection application is located;
  • a framing unit configured to add a start play instruction of the original audio data and sound source priority information of a sound source to which the original audio data belongs to the original audio data to obtain audio data to be played;
  • a sending unit configured to send the to-be-played audio data to the connected application.
  • the original audio data of the second terminal device includes:
  • Audio data of the application other than the matching application on the second terminal device
  • the first terminal device is an in-vehicle terminal device
  • the second terminal device is a user terminal device.
  • Another aspect of the present invention provides a control device for another terminal device, including:
  • a receiving unit configured to receive audio data to be played by the second terminal device sent by the cooperation application on the second terminal device corresponding to the interconnection application on the first terminal device;
  • a parsing unit configured to parse the audio data to be played to obtain original audio data, a start play instruction of the original audio data, and sound source priority information of a sound source to which the original audio data belongs;
  • a playing unit configured to: if the sound source to which the original audio data belongs is different from the sound source of the currently played audio data, according to the start playing instruction, the sound source priority information of the sound source to which the original audio data belongs, and the current playing sound source The sound source priority information stops playing the audio data of the currently playing sound source, starts playing the original audio data or continues to play the audio data of the current playing sound source.
  • parsing unit is specifically configured to
  • the audio data of the currently played source is resumed.
  • the first terminal device is an in-vehicle terminal device
  • the second terminal device is a user terminal device.
  • Another aspect of the present invention provides a control device for another terminal device, including:
  • a receiving unit configured to receive audio data to be played of at least two audio sources on the second terminal device that are sent by the matching application on the second terminal device corresponding to the interconnected application on the first terminal device;
  • a parsing unit configured to parse audio data to be played of each of the audio data to be played of the at least two audio sources to obtain original audio data of each audio source, original audio of each audio source a start play command of data and sound source priority information of each of the sound sources;
  • a playing unit configured to start playing original audio data of a sound source according to a start playing instruction of the original audio data of each sound source and sound source priority information of each sound source.
  • parsing unit is specifically configured to
  • Parsing audio data to be played for each of the sound sources to obtain original audio data of each sound source, the start play instruction in the audio control frame, and the sound source priority in the audio control frame information.
  • the first terminal device is an in-vehicle terminal device
  • the second terminal device is a user terminal device.
  • an apparatus comprising:
  • One or more processors are One or more processors;
  • One or more programs the one or more programs being stored in the memory, when executed by the one or more processors:
  • an apparatus comprising:
  • One or more processors are One or more processors;
  • One or more programs the one or more programs being stored in the memory, when executed by the one or more processors:
  • the sound source to which the original audio data belongs is different from the sound source of the currently played audio data, according to the start play instruction, the sound source priority information of the sound source to which the original audio data belongs, and the sound source priority information of the currently played sound source. Stopping playing the audio data of the currently playing sound source, starting to play the original audio data or continuing to play the audio data of the currently playing sound source.
  • an apparatus comprising:
  • One or more processors are One or more processors;
  • One or more programs the one or more programs being stored in the memory, when executed by the one or more processors:
  • Parsing audio data to be played for each of the to-be-played audio data of the at least two sound sources to obtain original audio data of each of the audio sources, and starting playback instructions of the original audio data of each of the audio sources And sound source priority information of each of the sound sources;
  • the original audio data of one source is started to be played according to the start play command of the original audio data of each of the sound sources and the sound source priority information of each of the sound sources.
  • a nonvolatile computer storage medium storing one or more programs when the one or more programs are executed by a device causes The device:
  • a nonvolatile computer storage medium storing one or more programs when the one or more programs are executed by a device causes The device:
  • the sound source to which the original audio data belongs is different from the sound source of the currently played audio data, according to the start play instruction, the sound source priority information of the sound source to which the original audio data belongs, and the sound source priority information of the currently played sound source. Stopping playing the audio data of the currently playing sound source, starting to play the original audio data or continuing to play the audio data of the currently playing sound source.
  • a nonvolatile computer storage medium storing one or more programs when the one or more programs are executed by a device causes The device:
  • Parsing audio data to be played for each of the to-be-played audio data of the at least two sound sources to obtain original audio data of each of the audio sources, and starting playback instructions of the original audio data of each of the audio sources And sound source priority information of each of the sound sources;
  • the original audio data of one source is started to be played according to the start play command of the original audio data of each of the sound sources and the sound source priority information of each of the sound sources.
  • the embodiment of the present invention obtains the original audio data of the second terminal device connected to the first terminal device where the interconnection application is located, and then starts the initial playback command and the original audio data. Adding sound source priority information of the sound source to which the audio data belongs is added to the original audio data to obtain audio data to be played, so that the audio data to be played can be sent to the connected application, since it is not necessary for each audio source
  • the audio module performs synchronous communication with the audio module corresponding to the other audio sources to determine whether the audio data can be transmitted by itself, but adds the start playing instruction of the audio data and the sound source priority information of the audio source to which the audio data belongs to the audio data.
  • the data is sent to the interconnection application together, and the interconnection application uniformly performs the arbitration operation to play the audio data after the arbitration. Therefore, the problem of waste of system resources due to the synchronous communication between the audio modules in the prior art can be avoided.
  • the embodiment of the present invention receives the audio data to be played by the second terminal device that is sent by the cooperation application on the second terminal device corresponding to the interconnection application on the first terminal device. And performing parsing processing on the audio data to be played to obtain original audio data, a start play instruction of the original audio data, and the original.
  • the sound source priority information of the sound source to which the original audio data belongs is different, and if the sound source to which the original audio data belongs is different from the sound source of the currently played audio data, the sound source of the sound source to which the original audio data belongs may be prioritized according to the start play instruction.
  • the level information and the sound source priority information of the currently playing sound source stop playing the audio data of the current playing sound source, start playing the original audio data or continue playing the audio data of the current playing sound source, since the corresponding sound source is not required
  • the audio module performs synchronous communication with the audio module corresponding to the other audio sources to determine whether the audio data can be transmitted by itself, but adds the start playing instruction of the audio data and the sound source priority information of the audio source to which the audio data belongs to the audio data.
  • the data is sent to the interconnection application together, and the interconnection application uniformly performs the arbitration operation to play the audio data after the arbitration. Therefore, the problem of waste of system resources due to the synchronous communication between the audio modules in the prior art can be avoided.
  • the embodiment of the present invention receives at least two audio sources on the second terminal device that are sent by the cooperation application on the second terminal device corresponding to the interconnection application on the first terminal device. Audio data to be played, and then parsing audio data to be played for each of the audio data to be played of the at least two audio sources to obtain original audio data of each audio source, each of the audio sources.
  • the start play instruction of the original audio data and the sound source priority information of each of the sound sources enable the start of playing one according to the start play instruction of the original audio data of each sound source and the sound source priority information of each of the sound sources
  • the original audio data of the sound source because the audio module corresponding to each sound source does not need to be synchronously communicated with the audio module corresponding to the other sound source to determine whether it can transmit the audio data, but the start playing instruction of the audio data and the The audio source priority information of the audio source to which the audio data belongs is added to the audio data and sent to the interconnection.
  • Use by Internet The application performs the arbitration operation uniform
  • the technical solution provided by the present invention can greatly improve the user experience.
  • FIG. 1 is a schematic flowchart of a method for controlling a terminal device according to an embodiment of the present invention
  • FIG. 2 is a schematic flowchart of another method for controlling a terminal device according to another embodiment of the present invention.
  • FIG. 3 is a schematic flowchart diagram of another method for controlling a terminal device according to another embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of a device for controlling a terminal device according to another embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of another apparatus for controlling a terminal device according to another embodiment of the present invention.
  • FIG. 6 is a schematic structural diagram of another apparatus for controlling a terminal device according to another embodiment of the present invention.
  • the user terminal device involved in the embodiments of the present invention may include, but is not limited to, a mobile phone, a personal digital assistant (PDA), a wireless handheld device, a tablet computer, and a personal computer (Personal Computer). , PC), MP3 player, MP4 player, wearable device (for example, smart glasses, smart watches, smart bracelets, etc.).
  • the vehicle-mounted terminal device involved in the embodiment of the present invention may also be referred to as a vehicle, and refers to an abbreviation of an in-vehicle infotainment product installed in a car.
  • the car machine must be capable of realizing people and vehicles, vehicles and the outside world ( Information communication between car and car).
  • FIG. 1 is a schematic flowchart of a method for controlling a terminal device according to an embodiment of the present invention, as shown in FIG. 1 .
  • the first terminal device and the second terminal device pass, but are not limited to, a Bluetooth connection, a Universal Serial Bus (USB) connection, and a wireless compatibility authentication. At least one of the (Wireless Fidelity, WI-FI) connections is connected, and this embodiment is not particularly limited.
  • the execution body of the application of the second terminal device that is, the application corresponding to the interconnection application, or the application of the second terminal device (ie, the cooperation corresponding to the interconnection application)
  • the functional unit such as a plug-in or a software development kit (SDK) in the application is not particularly limited in this embodiment.
  • the application may be a local application installed on the second terminal device (nativeApp), or may also be a web application (webApp) of the browser on the second terminal device. Special restrictions are made.
  • the start playback instruction of the original audio data and the sound source priority information of the audio source to which the original audio data belongs are added to the In the original audio data, so that the audio data to be played can be sent to the interconnection application, because the audio module corresponding to each audio source is not required to be performed with the audio module corresponding to the other audio sources.
  • Synchronous communication to determine whether it is possible to transmit audio data, but to add the start playing instruction of the audio data and the sound source priority information of the audio source to which the audio data belongs to the audio data and send it to the interconnected application for unified arbitration by the interconnection application. Operation, playing audio data after arbitration, therefore, can avoid the prior art due to the The problem of wasted system resources caused by synchronous communication.
  • the first terminal device is preferably an in-vehicle terminal device; and the second terminal device is preferably a user terminal device.
  • the first terminal device may also be a user terminal device; the second terminal device may also be an in-vehicle terminal device.
  • the applications installed on the user terminal device can be executed separately, without relying on another terminal device connected thereto for normal use, or relying on a corresponding cooperation application on another terminal device connected thereto. Normal use.
  • the device connection between the first terminal device and the second terminal device is established, based on the established device connection, it is further required to further establish cooperation between the interconnected application on the first terminal device and the second terminal device. Communication connection between applications. In this way, the user can work with the application or cooperate with the second terminal device where the application is located through the interconnection application.
  • the communication connection may include, but is not limited to, at least one of a Bluetooth connection, a USB connection, and a WI-FI connection, which is not specifically limited in this embodiment.
  • the received original audio data of the second terminal device may be on the second terminal device corresponding to the interconnection application.
  • the applied audio data for example, the song audio data acquired by the application, the TTS audio data (TTS) outputted by the navigation function of the application, or the second terminal device
  • TTS TTS audio data
  • the audio data of the application other than the application, for example, the song audio data acquired by the QQ music, etc., is not particularly limited in this embodiment.
  • the so-called audio data refers to a digital signal converted from an audio signal, for example, a sampling, quantization and encoding process of the audio signal, and the obtained pulse code modulation (Pulse Code Modulation, PCM) data.
  • PCM Pulse Code Modulation
  • the audio file may include audio files of various encoding formats in the prior art, for example, Moving Picture Experts Group (MPEG) Layer 3 (MPEG Layer, MP3) format audio file, WMA (Windows)
  • MPEG Moving Picture Experts Group
  • MPEG Layer MP3
  • WMA Wideband Adaptive Binary Arithmetic Coding
  • AAC Advanced Audio Coding
  • APE APE format audio file
  • the audio file to be processed for example, the MP3 format audio file of the song to be played, etc.
  • the audio file to be processed may be obtained from the storage device of the second terminal device or the Internet, and then, The data block of the audio file to be processed is subjected to decoding processing to obtain the original audio data.
  • decoding processing For a detailed description of the decoding process, refer to related content in the prior art, and details are not described herein again.
  • the TTS audio data (Text To Speech, TTS) can be directly obtained.
  • the storage device of the second terminal device may be a slow storage device, which may be a hard disk of the computer system, or may be a non-operating memory of the mobile phone, that is, a physical memory, for example, a read only memory ( The Read-Only Memory (ROM), the memory card, and the like are not particularly limited in this embodiment.
  • a slow storage device which may be a hard disk of the computer system, or may be a non-operating memory of the mobile phone, that is, a physical memory, for example, a read only memory (The Read-Only Memory (ROM), the memory card, and the like are not particularly limited in this embodiment.
  • ROM Read-Only Memory
  • the storage device of the second terminal device may also be a fast storage device, which may be a memory of the computer system, or may be a running memory of the mobile phone, that is, a system memory, for example, a random access memory (The random access memory, RAM, and the like are not particularly limited in this embodiment.
  • the start play command which may also be referred to as an initialization command, is used to indicate that the audio track is performed.
  • the initialization operation uses the initialized audio track to start playing the audio data.
  • the start play command may include a format parameter, so that the receiving end may perform an initialization operation on the audio track according to the format parameter.
  • the format parameter may include, but is not limited to, at least one of a compression format, a sampling rate, a sampling depth, and a code rate.
  • sampling rate also known as the sampling speed or sampling frequency
  • sampling speed defines the number of samples extracted from the continuous signal and composed of discrete signals per second, expressed in Hertz (Hz).
  • the sampling depth refers to a value of a sampling point represented by a number of bits, which determines the number of bits of the value of each sampling point, for example, 8 bits, 16 bits or 24 bits.
  • the code rate refers to the number of bits processed per unit time, and the unit is bits per second (bps).
  • an operation of acquiring a start play instruction of the original audio data may be further performed.
  • the user may obtain audio related operation event data of the second terminal device, and then obtain a start play instruction of the original audio data according to the audio related operation event data, for example, The start playback command of the audio data of the song is output in conjunction with the music function in the application.
  • the so-called audio related operation event data is used to operate the operation event data of the audio data.
  • the audio related operation event data of the second terminal device is obtained by the user through the interconnection application on the first terminal device, based on the communication connection between the cooperation application and the interconnection application.
  • the audio-related operation event data of the second terminal device connected to the first terminal device refers to an audio-related operation behavior performed by the user in the interconnection application on the first terminal device, for example, clicking, double-clicking, dragging, etc.
  • the data related to the audio related operational events on the display device of the second terminal device may include, but is not limited to, audio related operational events and coordinate data of the audio related operational events.
  • the interconnection application on the first terminal device may project the interface output by the display device of the second terminal device on the display device of the first terminal device by using the cooperation application corresponding to the interconnection application on the second terminal device.
  • the user can operate on the interface projected in the connected application, for example, touch operation or physical button operation, etc., so that the audio of all applications on the second terminal device connected to the first terminal device connected thereto can be realized.
  • the data that is, the audio data of the cooperation application corresponding to the interconnection application and the audio data of the application other than the cooperation application corresponding to the interconnection application.
  • the interconnected application on the first terminal device may also be used as an operation terminal, such as a mouse or a remote controller, by using the corresponding application corresponding to the connected application on the second terminal device, and the user may pass the interconnection application.
  • Operation for example, a touch operation or a physical key operation, etc., so that audio data of all applications on the second terminal device connected to the first terminal device connected thereto can be realized, that is, the cooperative application corresponding to the interconnection application Audio data and audio data of other applications than the matching application corresponding to the interconnected application.
  • the operation behavior of the user in the interconnected application on the first terminal device may be specifically
  • the coordinate data is mapped to coordinate data of an operation event on the display device of the second terminal device.
  • the current terminal devices are all touch-type terminal devices, and the display device has a touch input function in addition to the display function. Any operational behavior on the display device of the terminal device needs to be decomposed into a set of several operational events, and the operating system can process the relevant data of these operational events accordingly.
  • the operation event includes at least one of the following events:
  • the so-called Down event is triggered only once in one operation, and is triggered when the finger just touches the display device of the terminal device.
  • the so-called Up event is triggered only once in one operation, and is triggered when the finger leaves the display device of the terminal device.
  • the so-called Move event will trigger 0, 1 or more Move events during an operation. If the finger has been moving on the display device of the terminal device, the Move event will be triggered all the time, and both are in the Down event. After the event with the Up.
  • the cooperation application on the second terminal device corresponding to the interconnection application or other applications on the second terminal device except the cooperation application may be acquired.
  • the start play instruction of the original audio data for example, the start play instruction triggered when the TTS audio data is output in conjunction with the navigation function of the application.
  • the start play instruction and the sound source priority information may be specifically added to a blank frame to generate an audio control frame, and then, The audio control frame may be inserted into the original audio data to obtain the audio data to be played.
  • the audio control frame where the start of the play instruction is inserted may be inserted in front of the original audio data, and further, the preset data size may be, for example, 30 kilobytes (k) bytes or a preset time size, such as 20 milliseconds (ms). And so on, the original audio data after the audio control frame is segmented to obtain a plurality of pieces of audio data, and each piece of audio data is added to the data portion of the blank frame to obtain a plurality of audio data frames. Thus, the audio data frame and the audio control frame obtained are composed of the audio data to be played.
  • the preset data size may be, for example, 30 kilobytes (k) bytes or a preset time size, such as 20 milliseconds (ms).
  • the start play instruction may be specifically added to the frame header of the audio control frame, or the start play instruction may be added to the data part of the audio control frame,
  • the embodiment is not particularly limited thereto.
  • the original audio data of the second terminal device connected to the first terminal device where the interconnection application is connected is obtained, and then the start playing instruction of the original audio data and the sound source priority information of the audio source to which the original audio data belongs are obtained. Adding to the original audio data to obtain audio data to be played, so that the audio data to be played can be sent to the interconnection application, since the audio module corresponding to each audio source does not need to correspond to other audio sources.
  • the audio module performs synchronous communication to determine whether it can transmit audio data, but adds the start playing instruction of the audio data and the sound source priority information of the audio source to which the audio data belongs to the audio data and sends the same to the interconnected application, and the interconnected application.
  • the arbitration operation is performed uniformly, and the audio data after the arbitration is played, and therefore, the problem of waste of system resources due to synchronous communication between the audio modules in the prior art can be avoided.
  • FIG. 2 is a flowchart of another method for controlling a terminal device according to another embodiment of the present invention. Schematic diagram, as shown in Figure 2.
  • the sound source to which the original audio data belongs is different from the sound source of the currently played audio data, according to the start play instruction, the sound source priority information of the sound source to which the original audio data belongs, and the sound source priority of the currently played sound source. Level information, stop playing the audio data of the currently playing sound source, start playing the original audio data or continue playing the audio data of the currently playing sound source.
  • execution body of 201 to 203 may be an application located at the first terminal device, that is, an interconnection application, or may be a plug-in or a software development kit disposed in an application (ie, an interconnection application) located in the first terminal device.
  • Functional units such as (Software Development Kit, SDK) are not particularly limited in this embodiment.
  • the interconnection application may be a local application installed on the first terminal device (nativeApp), or may also be a web application (webApp) of the browser on the first terminal device, which is used in this embodiment. No particular limitation is imposed.
  • the audio data to be played by the second terminal device sent by the cooperation application on the second terminal device corresponding to the interconnection application on the first terminal device is received, and then the audio data to be played is parsed and processed.
  • the start playback instruction and the sound source priority information of the audio source to which the audio data belongs are added to the audio data
  • the received audio data to be played is generated and transmitted by using the technical solution provided by the embodiment corresponding to FIG. 1.
  • the technical solution provided by the embodiment corresponding to FIG. 1 For details, refer to related content in the embodiment corresponding to FIG. 1, and details are not described herein again.
  • the audio data to be played may be parsed to obtain the original audio data, and the initial playback in the audio control frame. And the sound source priority information in the instruction and the audio control frame.
  • the frame header of the audio control frame in the audio data to be played may be parsed to obtain the start play command and the audio source priority information in the audio control frame. And audio data in the audio data to be played The data portion of the frame is parsed to obtain the original audio data in the audio data frame.
  • the data portion of the audio control frame in the audio data to be played may be parsed to obtain the start play command and the sound source priority information in the audio control frame. And parsing a data portion of the audio data frame in the audio data to be played to obtain the original audio data in the audio data frame.
  • the sound source priority information of the sound source to which the original audio data belongs is compared with the sound source priority information of the currently played sound source.
  • the audio data of the current playing sound source may be stopped, and then according to the format parameters included in the start playing instruction, The audio track is initialized, and the original audio data is started to be played using the initialized audio track. At this time, the received audio data that is not played by the currently played sound source may be discarded, and the playback processing of the audio data is no longer performed.
  • the audio data of the current playing sound source may continue to be played. At this time, the received original audio data can be discarded, and the playback processing of the audio data is no longer performed.
  • the original audio data is played in 203, the original audio data is played back, and the received audio data is still received.
  • the audio data of the currently playing sound source can continue to play the audio data of the current playing sound source.
  • the audio track may be re-initialized according to the format parameter corresponding to the current playing sound source, and the audio data of the current playing sound source may continue to be played.
  • the audio data to be played by the second terminal device sent by the cooperation application on the second terminal device corresponding to the interconnection application on the first terminal device is received, and then the audio data to be played is further performed. Parsing processing to obtain original audio data, a start play instruction of the original audio data, and sound source priority information of the sound source to which the original audio data belongs, if the sound source to which the original audio data belongs and the sound source of the currently played audio data are not Similarly, the audio data of the current playing source is stopped according to the start playing instruction, the sound source priority information of the sound source to which the original audio data belongs, and the sound source priority information of the current playing sound source, and the original audio is started to be played.
  • Audio Data or continue to play the audio data of the currently playing sound source because the audio module corresponding to each sound source does not need to synchronously communicate with the audio module corresponding to other sound sources to determine whether it can transmit audio data, but to audio
  • the start of playback of the data and the audio data The audio source priority information of the audio source is added to the audio data and sent to the interconnection application, and the interconnection application uniformly performs the arbitration operation to play the audio data after the arbitration, thereby avoiding the prior art due to the synchronous communication between the audio modules. The waste of system resources.
  • FIG. 3 is a schematic flowchart diagram of another method for controlling a terminal device according to another embodiment of the present invention, as shown in FIG. 3.
  • execution body of 301 to 303 may be an application located at the first terminal device, that is, an interconnection application, or may be a plug-in or a software development kit disposed in an application (ie, an interconnection application) located in the first terminal device.
  • Functional units such as (Software Development Kit, SDK) are not particularly limited in this embodiment.
  • the interconnection application may be a local application installed on the first terminal device (nativeApp), or may also be a web application (webApp) of the browser on the first terminal device, which is used in this embodiment. No particular limitation is imposed.
  • the at least two audio sources of the at least two sound sources on the second terminal device that are sent by the matching application on the second terminal device corresponding to the interconnected application on the first terminal device are received, and then the at least two Audio data to be played for each sound source in the audio data to be played of the sound source is parsed to obtain original audio data of each sound source, a start play instruction of the original audio data of each sound source, and each of the sound sources
  • the sound source priority information enables the original audio data of a sound source to be played according to the start play instruction of the original audio data of each sound source and the sound source priority information of each sound source, since it is not necessary for each sound source to correspond
  • the audio module is the same as the audio module corresponding to other audio sources.
  • Step communication to determine whether it can transmit audio data, but to add the audio playback start command and the audio source priority information of the audio data to the audio data, and send it to the interconnection application for unified arbitration by the interconnection application. Operation, the audio data after arbitration is played, and therefore, the problem of waste of system resources due to synchronous communication between audio modules in the prior art can be avoided.
  • the received audio data to be played is generated and transmitted by using the technical solution provided by the embodiment corresponding to FIG. 1.
  • the technical solution provided by the embodiment corresponding to FIG. 1 For details, refer to related content in the embodiment corresponding to FIG. 1, and details are not described herein again.
  • the audio data to be played by each of the audio sources may be parsed to obtain original audio data and audio of each audio source. Controlling the start play instruction in the frame and the sound source priority information in the audio control frame.
  • the frame header of the audio control frame in the audio data to be played by each audio source may be parsed to obtain original audio data of each audio source in the audio control frame. And a sound source priority information of each of the sound sources, and a data portion of the audio data frame in the audio data to be played of each of the sound sources is parsed to obtain the audio data frame Raw audio data for each source.
  • the to-be-played tone of each of the audio sources may be specifically
  • the data portion of the audio control frame in the frequency data is subjected to parsing processing to obtain a start play instruction of the original audio data of each of the audio sources in the audio control frame, and sound source priority information of each of the sound sources, and
  • the data portion of the audio data frame in the audio data to be played of each audio source is subjected to parsing processing to obtain original audio data of each of the audio sources in the audio data frame.
  • the sound source priority information of each audio source may be compared according to a start play instruction of the original audio data of each sound source. deal with.
  • the to-be-played audio data of the at least two audio sources on the second terminal device that are sent by the cooperation application on the second terminal device corresponding to the interconnection application on the first terminal device is further received.
  • Performing parsing processing of the audio data to be played for each of the at least two audio sources of the at least two audio sources to obtain original audio data of each of the audio sources, a start play instruction of the original audio data of each of the audio sources, and the The sound source priority information of each sound source enables starting to play the original audio data of one sound source according to the start play instruction of the original audio data of each sound source and the sound source priority information of each sound source, since each The audio module corresponding to the sound source is synchronously communicated with the audio module corresponding to the other sound source to determine whether it can transmit audio data, but the audio data.
  • the start play instruction and the sound source priority information of the sound source to which the audio data belongs are added to the audio data and sent to the interconnection application, and the interconnection application uniformly performs the arbitration operation to play the audio data after the arbitration, thereby avoiding the prior art due to A problem of wasted system resources caused by synchronous communication between audio modules.
  • FIG. 4 is a schematic structural diagram of a control apparatus for a terminal device according to another embodiment of the present invention, as shown in FIG. 4 .
  • the control device of the terminal device of this embodiment may include an obtaining unit 41, a framing unit 42, and a transmitting unit 43.
  • the acquiring unit 41 is configured to acquire original audio data of the second terminal device connected to the first terminal device where the interconnection application is located, and a framing unit 42 configured to start the initial playback command of the original audio data and the original audio.
  • the audio source priority information of the audio source to which the data belongs is added to the original audio data to obtain the audio data to be played, and the sending unit 43 is configured to send the audio data to be played to the connected application.
  • the first terminal device and the second terminal device pass at least, but are not limited to, a Bluetooth connection, a Universal Serial Bus (USB) connection, and at least a Wireless Fidelity (WI-FI) connection.
  • a Bluetooth connection a Universal Serial Bus (USB) connection
  • a Wireless Fidelity (WI-FI) connection a Wireless Fidelity connection.
  • One of the connections is not specifically limited in this embodiment.
  • control device of the terminal device in this embodiment may be an application corresponding to the second terminal device, that is, an application corresponding to the interconnection application, or may be an application located at the second terminal device (ie, an interconnection application office).
  • the functional unit such as a plug-in or a software development kit (SDK) in the corresponding application is not particularly limited in this embodiment.
  • the application may be a local application installed on the second terminal device (nativeApp), or may also be a web application (webApp) of the browser on the second terminal device. Special restrictions are made.
  • the first terminal device is preferably an in-vehicle terminal device; and the second terminal device is preferably a user terminal device.
  • the first terminal device may also be a user terminal device; the second terminal device may also be an in-vehicle terminal device.
  • the applications installed on the user terminal device can be executed separately, without relying on another terminal device connected thereto for normal use, or relying on a corresponding cooperation application on another terminal device connected thereto. Normal use.
  • the original audio data of the second terminal device acquired by the acquiring unit 41 may be the second terminal device corresponding to the interconnection application.
  • the audio data of the matching application for example, the song audio data acquired by the application, the TTS audio data (TTS) outputted by the navigation function of the application, or the like, or may also be on the second terminal device.
  • the audio data of the application other than the cooperation application for example, the song audio data acquired by the QQ music, etc., is not particularly limited in this embodiment.
  • the framing unit 42 may further be configured to acquire audio related operation event data of the second terminal device by the user; and obtain a start play instruction of the original audio data according to the audio related operation event data.
  • the framing unit 42 may be further configured to obtain a matching application or the foregoing on the second terminal device corresponding to the interconnection application.
  • the framing unit 42 is specifically configured to add the start play instruction and the sound source priority information to a blank frame to generate audio control. And inserting the audio control frame into the original audio data to obtain the audio data to be played.
  • the original audio data of the second terminal device connected to the first terminal device where the interconnection application is connected is obtained by the acquiring unit, and then the start playback instruction of the original audio data and the original audio data belong to by the framing unit.
  • the sound source priority information of the sound source is added to the original audio data to obtain audio data to be played, so that the sending unit can send the to-be-played audio data to the connected application, since the audio corresponding to each sound source is not needed
  • the module then performs synchronous communication with the audio module corresponding to the other audio sources to determine whether it can transmit audio data, and adds the audio playback start command and the audio source priority information of the audio data to the audio data.
  • Sent to the interconnection application the interconnection application uniformly performs the arbitration operation, and the audio data after the arbitration is played, so The problem of waste of system resources due to synchronous communication between audio modules in the prior art is avoided.
  • FIG. 5 is a schematic structural diagram of another apparatus for controlling a terminal device according to another embodiment of the present invention, as shown in FIG. 5.
  • the control device of the terminal device of this embodiment may include a receiving unit 51, a parsing unit 52, and a playing unit 53.
  • the receiving unit 51 is configured to receive audio data to be played by the second terminal device sent by the cooperation application on the second terminal device corresponding to the interconnection application on the first terminal device, and the parsing unit 52 is configured to The audio data to be played is subjected to parsing processing to obtain original audio data, a start play instruction of the original audio data, and audio source priority information of the audio source to which the original audio data belongs; a playing unit 53 for if the original audio The sound source to which the data belongs is different from the sound source of the currently played audio data, and the current play is stopped according to the start play command, the sound source priority information of the sound source to which the original audio data belongs, and the sound source priority information of the currently played sound source.
  • the audio data of the sound source starts playing the original audio data or continues to play the audio data of the currently played sound source.
  • control device of the terminal device in this embodiment may be an application located in the first terminal device, that is, an interconnection application, or may be a plug-in or software disposed in an application (ie, an interconnection application) located in the first terminal device.
  • a functional unit such as a Software Development Kit (SDK) is not particularly limited in this embodiment.
  • the interconnection application may be a local application installed on the first terminal device (nativeApp), or may also be a web application (webApp) of the browser on the first terminal device, which is used in this embodiment. No particular limitation is imposed.
  • first terminal device the interconnection application, the second terminal device, and the cooperation application, and the first terminal device and the interconnection in the embodiment corresponding to FIG. 4 should be The functions and descriptions of the second terminal device and the matching application are the same. For details, refer to related content in the embodiment corresponding to FIG. 4, and details are not described herein again.
  • the audio data to be played received by the receiving unit 51 is generated and transmitted by using the technical solution provided by the embodiment corresponding to FIG. 4.
  • the audio data to be played received by the receiving unit 51 is generated and transmitted by using the technical solution provided by the embodiment corresponding to FIG. 4.
  • the parsing unit 52 may be configured to perform parsing processing on the to-be-played audio data to obtain the original audio data and the audio control frame.
  • the playing unit 53 may be further configured to: if the original audio data is played back, and still receive audio data of the currently played audio source, recovering Playing the audio data of the currently playing sound source.
  • the audio data to be played by the second terminal device sent by the cooperation application on the second terminal device corresponding to the interconnection application on the first terminal device is received by the receiving unit, and then the parsing unit
  • the audio data to be played is subjected to parsing processing to obtain original audio data, a start play instruction of the original audio data, and sound source priority information of the sound source to which the original audio data belongs, if the original audio data belongs to the sound source and the currently played
  • the sound source of the audio data is different, so that the playing unit can stop playing the audio data of the currently playing sound source according to the start playing instruction, the sound source priority information of the sound source to which the original audio data belongs, and the sound source priority information of the currently playing sound source.
  • start playing the original Audio data or continue to play the audio data of the currently played sound source because the audio module corresponding to each sound source is not required to perform synchronous communication with the audio module corresponding to other sound sources to determine whether it can transmit audio data, but
  • the start playing instruction of the audio data and the sound source priority information of the sound source to which the audio data belongs are added to the audio data and sent to the interconnection application, and the interconnection application uniformly performs the arbitration operation to play the audio data after the arbitration, thereby avoiding the prior art
  • FIG. 6 is a schematic structural diagram of another apparatus for controlling a terminal device according to another embodiment of the present invention, as shown in FIG. 6.
  • the control device of the terminal device of this embodiment may include a receiving unit 61, a parsing unit 62, and a playing unit 63.
  • the receiving unit 61 is configured to receive audio data to be played of at least two audio sources on the second terminal device that are sent by the cooperation application on the second terminal device corresponding to the interconnection application on the first terminal device; 62. Perform parsing processing on the to-be-played audio data of each of the to-be-played audio data of the at least two audio sources to obtain original audio data of each of the audio sources, and original audio data of each of the audio sources.
  • the playing unit 63 is configured to start playing according to the start playing instruction of the original audio data of each sound source and the sound source priority information of each sound source The original audio data of a source.
  • control device of the terminal device in this embodiment may be an application located in the first terminal device, that is, an interconnection application, or may be a plug-in or software disposed in an application (ie, an interconnection application) located in the first terminal device.
  • a functional unit such as a Software Development Kit (SDK) is not particularly limited in this embodiment.
  • the interconnection application may be a local application installed on the first terminal device, or may also be a webpage of a browser on the first terminal device.
  • the program webApp is not particularly limited in this embodiment.
  • the audio data to be played received by the receiving unit 61 is generated and transmitted by using the technical solution provided by the embodiment corresponding to FIG. 4.
  • the audio data to be played received by the receiving unit 61 is generated and transmitted by using the technical solution provided by the embodiment corresponding to FIG. 4.
  • the parsing unit 62 may be configured to parse the audio data to be played by each of the audio sources to obtain the original of each audio source.
  • the receiving unit receives the to-be-played audio data of the at least two audio sources on the second terminal device that is sent by the matching application on the second terminal device corresponding to the interconnection application on the first terminal device, and further
  • the parsing unit parses the audio data to be played of each of the audio data to be played of the at least two audio sources to obtain original audio data of each audio source, and start of original audio data of each audio source Playing the instruction and the sound source priority information of each of the sound sources, so that the playing unit can start playing the original of the sound source according to the start playing instruction of the original audio data of each sound source and the sound source priority information of each sound source.
  • Audio data since there is no need for the audio module corresponding to each audio source
  • the audio module corresponding to the other audio sources performs synchronous communication to determine whether the audio data can be transmitted by itself, but adds the start playing instruction of the audio data and the sound source priority information of the audio source to which the audio data belongs to the audio data and sends the same to the audio data.
  • the interconnection operation is uniformly performed by the interconnection application, and the audio data after the arbitration is played. Therefore, the problem of waste of system resources due to synchronous communication between the audio modules in the prior art can be avoided.
  • the disclosed system, apparatus, and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the integrated unit can be implemented in the form of hardware or It is implemented in the form of hardware plus software functional units.
  • the integrated unit implemented in the form of a software functional unit can be stored in a computer readable storage medium.
  • the software functional unit is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, an audio processing engine, or a network device, etc.) or a processor to perform various embodiments of the present invention. Part of the steps of the method.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • Telephone Function (AREA)

Abstract

本发明提供终端设备的控制方法、装置、设备及非易失性计算机存储介质。本发明实施例由于无需每个音源所对应的音频模块再同其他音源所对应的音频模块进行同步通信,以确定自身是否可以进行音频数据发送,而是将音频数据的开始播放指令和该音频数据所属音源的音源优先级信息添加到音频数据中一起发送给互联应用,由互联应用统一进行仲裁操作,播放仲裁之后的音频数据,因此,能够避免现有技术中由于音频模块之间的同步通信而导致的系统资源的浪费的问题。

Description

终端设备的控制方法、装置、设备及非易失性计算机存储介质
本申请要求了申请日为2015年12月25日,申请号为201510994012.5发明名称为“终端设备的控制方法及装置”的中国专利申请的优先权。
技术领域
本发明涉及通信技术,尤其涉及终端设备的控制方法、装置、设备及非易失性计算机存储介质。
背景技术
随着通信技术的发展,终端设备集成了越来越多的功能,从而使得终端设备的系统功能列表中包含了越来越多相应的应用(Application,APP)。有些终端设备上所安装的应用,本发明中称为互联应用,需要通过与其连接的另一个终端设备上安装一个相应的配合应用才能正常使用,否则没有任何使用价值,特别是对于一些车机互联应用。
通常情况下,为了使得互联应用能够获取并控制配合应用所在终端设备的音频数据,配合应用可以向互联应用发送音频数据和该音频数据的播放控制信息,由互联应用根据所获得的播放控制信息,对音频数据进行播放控制处理例如,开始播放、暂停、恢复播放等。
在一些情况下,配合应用需要向互联应用发送多个音源的音频数据,例如,配合应用的音乐功能的歌曲音频数据、配合应用的导航功能的TTS音频数据(Text To Speech,TTS)等,在发送音频数据之前,每个音 源所对应的音频模块需要同其他音源所对应的音频模块进行同步通信,以确定自身是否可以进行音频数据发送。只有确定自身可以进行音频数据传输的音源的音频模块,才可以通过配合应用将该音源的音频数据发送给互联应用。在一个音源的音频数据的发送过程中,该音源所对应的音频模块还需要实时监测其他音源所对应的音频模块的音频数据发送情况,若其他音源所对应的音频模块的音频数据发送情况发生变化,则需要同其他音源所对应的音频模块进行同步通信,以确定自身是否暂停音频数据发送或者恢复音频数据发送。
然而,由于每个音源所对应的音频模块需要同其他音源所对应的音频模块进行同步通信,以确定自身是否可以进行音频数据发送,从而导致了终端设备的系统资源的浪费。
发明内容
本发明的多个方面提供终端设备的控制方法、装置、设备及非易失性计算机存储介质,用以避免终端设备的系统资源的浪费。
本发明的一方面,提供一种终端设备的控制方法,包括:
获取互联应用所在第一终端设备所连接的第二终端设备的原始音频数据;
将所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息添加到所述原始音频数据中,以获得待播放音频数据;
将所述待播放音频数据,发送给所述互联应用。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述第二终端设备的原始音频数据,包括:
所述互联应用所对应的所述第二终端设备上的配合应用的音频数据;或者
所述第二终端设备上除了所述配合应用之外的其他应用的音频数据。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述将所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息添加到所述原始音频数据中,以获得待播放音频数据之前,还包括:
获取用户操作所述第二终端设备的音频相关操作事件数据;以及根据所述音频相关操作事件数据,获得所述原始音频数据的开始播放指令;或者
获取所述互联应用所对应的所述第二终端设备上的配合应用或所述第二终端设备上除了所述配合应用之外的其他应用所触发的所述原始音频数据的开始播放指令。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述将所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息添加到所述原始音频数据中,以获得待播放音频数据,包括:
将所述开始播放指令和所述音源优先级信息添加到空白帧中,以生成音频控制帧;
将所述音频控制帧插入到所述原始音频数据中,以获得所述待播放音频数据。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,
所述第一终端设备为车载终端设备;
所述第二终端设备为用户终端设备。
本发明的另一方面,提供另一种终端设备的控制方法,包括:
接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备的待播放音频数据;
对所述待播放音频数据进行解析处理,以获得原始音频数据、所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息;
若所述原始音频数据所属的音源与当前播放的音频数据的音源不相同,根据所述开始播放指令、所述原始音频数据所属音源的音源优先级信息和所述当前播放音源的音源优先级信息,停止播放当前播放音源的音频数据,开始播放所述原始音频数据或者继续播放所述当前播放音源的音频数据。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述对所述待播放音频数据进行解析处理,以获得原始音频数据、所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息,包括:
对所述待播放音频数据进行解析处理,以获得所述原始音频数据、音频控制帧中的所述开始播放指令和所述音频控制帧中的所述音源优先级信息。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述方法还包括:
若播放完毕所述原始音频数据,且仍然接收到所述当前播放音源的音频数据,恢复播放所述当前播放音源的音频数据。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,
所述第一终端设备为车载终端设备;
所述第二终端设备为用户终端设备。
本发明的另一方面,提供另一种终端设备的控制方法,包括:
接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备上至少两个音源的待播放音频数据;
对所述至少两个音源的待播放音频数据中每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息;
根据所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,开始播放一个音源的原始音频数据。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式, 所述对所述至少两个音源的待播放音频数据中每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,包括:
对所述每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、音频控制帧中的所述开始播放指令和所述音频控制帧中的所述音源优先级信息。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,
所述第一终端设备为车载终端设备;
所述第二终端设备为用户终端设备。
本发明的另一方面,提供一种终端设备的控制装置,包括:
获取单元,用于获取互联应用所在第一终端设备所连接的第二终端设备的原始音频数据;
分帧单元,用于将所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息添加到所述原始音频数据中,以获得待播放音频数据;
发送单元,用于将所述待播放音频数据,发送给所述互联应用。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述第二终端设备的原始音频数据,包括:
所述互联应用所对应的所述第二终端设备上的配合应用的音频数据; 或者
所述第二终端设备上除了所述配合应用之外的其他应用的音频数据。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述分帧单元,还用于
获取用户操作所述第二终端设备的音频相关操作事件数据;以及根据所述音频相关操作事件数据,获得所述原始音频数据的开始播放指令;或者
获取所述互联应用所对应的所述第二终端设备上的配合应用或所述第二终端设备上除了所述配合应用之外的其他应用所触发的所述原始音频数据的开始播放指令。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述分帧单元,具体用于
将所述开始播放指令和所述音源优先级信息添加到空白帧中,以生成音频控制帧;以及
将所述音频控制帧插入到所述原始音频数据中,以获得所述待播放音频数据。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,
所述第一终端设备为车载终端设备;
所述第二终端设备为用户终端设备。
本发明的另一方面,提供另一种终端设备的控制装置,包括:
接收单元,用于接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备的待播放音频数据;
解析单元,用于对所述待播放音频数据进行解析处理,以获得原始音频数据、所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息;
播放单元,用于若所述原始音频数据所属的音源与当前播放的音频数据的音源不相同,根据所述开始播放指令、所述原始音频数据所属音源的音源优先级信息和所述当前播放音源的音源优先级信息,停止播放当前播放音源的音频数据,开始播放所述原始音频数据或者继续播放所述当前播放音源的音频数据。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述解析单元,具体用于
对所述待播放音频数据进行解析处理,以获得所述原始音频数据、音频控制帧中的所述开始播放指令和所述音频控制帧中的所述音源优先级信息。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述播放单元,还用于
若播放完毕所述原始音频数据,且仍然接收到所述当前播放音源的音频数据,恢复播放所述当前播放音源的音频数据。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,
所述第一终端设备为车载终端设备;
所述第二终端设备为用户终端设备。
本发明的另一方面,提供另一种终端设备的控制装置,包括:
接收单元,用于接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备上至少两个音源的待播放音频数据;
解析单元,用于对所述至少两个音源的待播放音频数据中每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息;
播放单元,用于根据所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,开始播放一个音源的原始音频数据。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,所述解析单元,具体用于
对所述每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、音频控制帧中的所述开始播放指令和所述音频控制帧中的所述音源优先级信息。
如上所述的方面和任一可能的实现方式,进一步提供一种实现方式,
所述第一终端设备为车载终端设备;
所述第二终端设备为用户终端设备。
本发明的另一方面,提供一种设备,包括:
一个或者多个处理器;
存储器;
一个或者多个程序,所述一个或者多个程序存储在所述存储器中,当被所述一个或者多个处理器执行时:
获取互联应用所在第一终端设备所连接的第二终端设备的原始音频数据;
将所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息添加到所述原始音频数据中,以获得待播放音频数据;
将所述待播放音频数据,发送给所述互联应用。
本发明的另一方面,提供一种设备,包括:
一个或者多个处理器;
存储器;
一个或者多个程序,所述一个或者多个程序存储在所述存储器中,当被所述一个或者多个处理器执行时:
接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备的待播放音频数据;
对所述待播放音频数据进行解析处理,以获得原始音频数据、所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息;
若所述原始音频数据所属的音源与当前播放的音频数据的音源不相同,根据所述开始播放指令、所述原始音频数据所属音源的音源优先级信息和所述当前播放音源的音源优先级信息,停止播放当前播放音源的音频数据,开始播放所述原始音频数据或者继续播放所述当前播放音源的音频数据。
本发明的另一方面,提供一种设备,包括:
一个或者多个处理器;
存储器;
一个或者多个程序,所述一个或者多个程序存储在所述存储器中,当被所述一个或者多个处理器执行时:
接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备上至少两个音源的待播放音频数据;
对所述至少两个音源的待播放音频数据中每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息;
根据所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,开始播放一个音源的原始音频数据。
本发明的另一方面,提供一种非易失性计算机存储介质,所述非易失性计算机存储介质存储有一个或者多个程序,当所述一个或者多个程序被一个设备执行时,使得所述设备:
获取互联应用所在第一终端设备所连接的第二终端设备的原始音频 数据;
将所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息添加到所述原始音频数据中,以获得待播放音频数据;
将所述待播放音频数据,发送给所述互联应用。
本发明的另一方面,提供一种非易失性计算机存储介质,所述非易失性计算机存储介质存储有一个或者多个程序,当所述一个或者多个程序被一个设备执行时,使得所述设备:
接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备的待播放音频数据;
对所述待播放音频数据进行解析处理,以获得原始音频数据、所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息;
若所述原始音频数据所属的音源与当前播放的音频数据的音源不相同,根据所述开始播放指令、所述原始音频数据所属音源的音源优先级信息和所述当前播放音源的音源优先级信息,停止播放当前播放音源的音频数据,开始播放所述原始音频数据或者继续播放所述当前播放音源的音频数据。
本发明的另一方面,提供一种非易失性计算机存储介质,所述非易失性计算机存储介质存储有一个或者多个程序,当所述一个或者多个程序被一个设备执行时,使得所述设备:
接收第一终端设备上的互联应用所对应的第二终端设备上的配合应 用所发送的所述第二终端设备上至少两个音源的待播放音频数据;
对所述至少两个音源的待播放音频数据中每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息;
根据所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,开始播放一个音源的原始音频数据。
由所述技术方案可知,一方面,本发明实施例通过获取互联应用所在第一终端设备所连接的第二终端设备的原始音频数据,进而将所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息添加到所述原始音频数据中,以获得待播放音频数据,使得能够将所述待播放音频数据,发送给所述互联应用,由于无需每个音源所对应的音频模块再同其他音源所对应的音频模块进行同步通信,以确定自身是否可以进行音频数据发送,而是将音频数据的开始播放指令和该音频数据所属音源的音源优先级信息添加到音频数据中一起发送给互联应用,由互联应用统一进行仲裁操作,播放仲裁之后的音频数据,因此,能够避免现有技术中由于音频模块之间的同步通信而导致的系统资源的浪费的问题。
由所述技术方案可知,另一方面,本发明实施例通过接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备的待播放音频数据,进而对所述待播放音频数据进行解析处理,以获得原始音频数据、所述原始音频数据的开始播放指令和所述原 始音频数据所属音源的音源优先级信息,若所述原始音频数据所属的音源与当前播放的音频数据的音源不相同,使得能够根据所述开始播放指令、所述原始音频数据所属音源的音源优先级信息和所述当前播放音源的音源优先级信息,停止播放当前播放音源的音频数据,开始播放所述原始音频数据或者继续播放所述当前播放音源的音频数据,由于无需每个音源所对应的音频模块再同其他音源所对应的音频模块进行同步通信,以确定自身是否可以进行音频数据发送,而是将音频数据的开始播放指令和该音频数据所属音源的音源优先级信息添加到音频数据中一起发送给互联应用,由互联应用统一进行仲裁操作,播放仲裁之后的音频数据,因此,能够避免现有技术中由于音频模块之间的同步通信而导致的系统资源的浪费的问题。
由所述技术方案可知,另一方面,本发明实施例通过接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备上至少两个音源的待播放音频数据,进而对所述至少两个音源的待播放音频数据中每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,使得能够根据所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,开始播放一个音源的原始音频数据,由于无需每个音源所对应的音频模块再同其他音源所对应的音频模块进行同步通信,以确定自身是否可以进行音频数据发送,而是将音频数据的开始播放指令和该音频数据所属音源的音源优先级信息添加到音频数据中一起发送给互联应用,由互联 应用统一进行仲裁操作,播放仲裁之后的音频数据,因此,能够避免现有技术中由于音频模块之间的同步通信而导致的系统资源的浪费的问题。
另外,采用本发明所提供的技术方案,能够极大提升用户体验。
附图说明
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。
图1为本发明一实施例提供的一种终端设备的控制方法的流程示意图;
图2为本发明另一实施例提供的另一种终端设备的控制方法的流程示意图;
图3为本发明另一实施例提供的另一种终端设备的控制方法的流程示意图;
图4为本发明另一实施例提供的一种终端设备的控制装置的结构示意图;
图5为本发明另一实施例提供的另一种终端设备的控制装置的结构示意图;
图6为本发明另一实施例提供的另一种终端设备的控制装置的结构示意图。
具体实施方式
为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的全部其他实施例,都属于本发明保护的范围。
需要说明的是,本发明实施例中所涉及的用户终端设备可以包括但不限于手机、个人数字助理(Personal Digital Assistant,PDA)、无线手持设备、平板电脑(Tablet Computer)、个人电脑(Personal Computer,PC)、MP3播放器、MP4播放器、可穿戴设备(例如,智能眼镜、智能手表、智能手环等)等。本发明实施例中所涉及的车载终端设备,还可以称为车机,指的是安装在汽车里面的车载信息娱乐产品的简称,车机在功能上要能够实现人与车,车与外界(车与车)的信息通信。
另外,本文中术语“和/或”,仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。另外,本文中字符“/”,一般表示前后关联对象是一种“或”的关系。
图1为本发明一实施例提供的一种终端设备的控制方法的流程示意图,如图1所示。
101、获取互联应用所在第一终端设备所连接的第二终端设备的原始音频数据。
本发明中,第一终端设备与第二终端设备通过但不限于蓝牙连接、通用串行总线(Universal Serial Bus,USB)连接和无线相容性认证 (Wireless Fidelity,WI-FI)连接中的至少一项进行连接,本实施例对此不进行特别限定。
102、将所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息添加到所述原始音频数据中,以获得待播放音频数据。
103、将所述待播放音频数据,发送给所述互联应用。
需要说明的是,101~103的执行主体可以为位于第二终端设备的应用即互联应用所对应的配合应用,或者还可以为设置在位于第二终端设备的应用(即互联应用所对应的配合应用)中的插件或软件开发工具包(Software Development Kit,SDK)等功能单元,本实施例对此不进行特别限定。
可以理解的是,所述应用可以是安装在第二终端设备上的本地程序(nativeApp),或者还可以是第二终端设备上的浏览器的一个网页程序(webApp),本实施例对此不进行特别限定。
这样,通过获取互联应用所在第一终端设备所连接的第二终端设备的原始音频数据,进而将所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息添加到所述原始音频数据中,以获得待播放音频数据,使得能够将所述待播放音频数据,发送给所述互联应用,由于无需每个音源所对应的音频模块再同其他音源所对应的音频模块进行同步通信,以确定自身是否可以进行音频数据发送,而是将音频数据的开始播放指令和该音频数据所属音源的音源优先级信息添加到音频数据中一起发送给互联应用,由互联应用统一进行仲裁操作,播放仲裁之后的音频数据,因此,能够避免现有技术中由于音频模块之间的 同步通信而导致的系统资源的浪费的问题。
可选地,在本实施例的一个可能的实现方式中,所述第一终端设备优选为车载终端设备;所述第二终端设备优选为用户终端设备。
反过来,所述第一终端设备也可以为用户终端设备;所述第二终端设备也可以为车载终端设备。但是,在实际应用中,用户终端设备上所安装的应用都可以单独执行,无需依赖与其连接的另一个终端设备才能正常使用,或者依赖与其连接的另一个终端设备上安装一个相应的配合应用才能正常使用。
本发明中,在完成第一终端设备与第二终端设备之间的设备连接建立之后,基于所建立的设备连接,还需要进一步建立第一终端设备上的互联应用与第二终端设备上的配合应用之间的通信连接。这样,用户才可以通过互联应用,操作配合应用或者配合应用所在第二终端设备。
可以理解的是,所述通信连接可以包括但不限于蓝牙连接、USB连接和WI-FI连接中的至少一项,本实施例对此不进行特别限定。
可选地,在本实施例的一个可能的实现方式中,在101中,所接收的所述第二终端设备的原始音频数据,可以为所述互联应用所对应的所述第二终端设备上的配合应用的音频数据,例如,配合应用所获取的歌曲音频数据、配合应用的导航功能所输出的TTS音频数据(Text To Speech,TTS)等,或者还可以为所述第二终端设备上除了所述配合应用之外的其他应用的音频数据,例如,QQ音乐所获取的歌曲音频数据等,本实施例对此不进行特别限定。
所谓的音频数据,是指由对音频信号转换而来的数字信号,例如,对所述音频信号进行抽样、量化和编码处理,所获得的脉冲编码调制 (Pulse Code Modulation,PCM)数据。编码处理的详细描述可以参见现有技术中的相关内容,此处不再赘述。最后,对音频数据进行格式编码之后,就形成了编码格式的音频文件。
其中,所述音频文件可以包括现有技术中各种编码格式的音频文件,例如,动态图像专家组(Moving Picture Experts Group,MPEG)层3(MPEGLayer-3,MP3)格式音频文件、WMA(Windows Media Audio,WMA)格式音频文件、高级音频编码(Advanced Audio Coding,AAC)格式音频文件或APE格式音频文件等,本实施例对此不进行特别限定。
具体地,若用户在使用配合应用的音乐功能,具体可以从第二终端设备的存储设备或者互联网上,获取待处理音频文件,例如,待播放歌曲的MP3格式音频文件等,进而,则可以对所述待处理音频文件的数据块进行解码处理,以获得所述原始音频数据。解码处理的详细描述可以参见现有技术中的相关内容,此处不再赘述。若用户在使用配合应用的导航功能,具体可以直接获取TTS音频数据(Text To Speech,TTS)。
在一个具体的实现过程中,所述第二终端设备的存储设备可以慢速存储设备,具体可以为计算机系统的硬盘,或者还可以为手机的非运行内存即物理内存,例如,只读存储器(Read-Only Memory,ROM)和内存卡等,本实施例对此不进行特别限定。
在另一个具体的实现过程中,所述第二终端设备的存储设备还可以为快速存储设备,具体可以为计算机系统的内存,或者还可以为手机的运行内存即系统内存,例如,随机存储器(Random Access Memory,RAM)等,本实施例对此不进行特别限定。
所述开始播放指令,又可以称为初始化指令,用以指示对音轨进行 初始化操作,利用经过初始化的音轨,开始播放音频数据。所谓的音轨,用于将音频数据记录在特定的时间位置,并进行播放处理。具体来说,开始播放指令中可以包括格式参数,这样,接收端则可以根据该格式参数,对音轨进行初始化操作。
其中,所述格式参数可以包括但不限于压缩格式、采样率、采样深度和码率中的至少一项。
所述采样率,也称为采样速度或者采样频率,定义了每秒从连续信号中提取并组成离散信号的采样个数,它用赫兹(Hz)来表示。
所述采样深度,指一个采样点的值由几比特数来表示,它决定了每个采样点的值的位数,例如,8比特(bit)、16位或24位等。
所述码率,是指单位时间内处理的比特的数量,单位是每秒比特(bps)。
可选地,在本实施例的一个可能的实现方式中,在102之前,还可以进一步执行获取所述原始音频数据的开始播放指令的操作。
在一个具体的实现过程中,具体可以获取用户操作所述第二终端设备的音频相关操作事件数据,进而则可以根据所述音频相关操作事件数据,获得所述原始音频数据的开始播放指令,例如,配合应用中音乐功能输出歌曲的音频数据的开始播放指令。
所谓的音频相关操作事件数据,用于操作音频数据的操作事件数据。具体地,具体可以基于配合应用与所述互联应用之间的通信连接,获取所述用户通过所述第一终端设备上的互联应用操作所述第二终端设备的音频相关操作事件数据。
本发明中,所谓的用户通过第一终端设备上的互联应用操作与所述 第一终端设备连接的第二终端设备的音频相关操作事件数据,是指用户在第一终端设备上的互联应用中所进行的音频相关操作行为,例如,单击、双击、拖动等操作,映射到第二终端设备的显示装置上的音频相关操作事件的相关数据,可以包括但不限于音频相关操作事件和所述音频相关操作事件的坐标数据。
例如,第一终端设备上的互联应用,可以通过第二终端设备上的该互联应用所对应的配合应用,在第一终端设备的显示装置上投射第二终端设备的显示装置所输出的界面,用户可以通过在互联应用中所投射的界面上进行操作,例如,触控操作或物理按键操作等,这样,就可以实现操作与其所在第一终端设备连接的第二终端设备上的全部应用的音频数据,即该互联应用所对应的配合应用的音频数据和除了该互联应用所对应的配合应用之外的其他应用的音频数据。
或者,再例如,第一终端设备上的互联应用,还可以通过第二终端设备上的该互联应用所对应的配合应用,作为一个操作端例如,鼠标或遥控器等,用户可以通过在互联应用中进行操作,例如,触控操作或物理按键操作等,这样,就可以实现操作与其所在第一终端设备连接的第二终端设备上的全部应用的音频数据,即该互联应用所对应的配合应用的音频数据和除了该互联应用所对应的配合应用之外的其他应用的音频数据。
可以理解的是,具体可以根据第一终端设备的显示装置的显示尺寸与第二终端设备的显示装置的显示尺寸的比值,将用户在第一终端设备上的互联应用中所进行的操作行为的坐标数据,映射到第二终端设备的显示装置上的操作事件的坐标数据。
通常,目前的终端设备都是触控类型的终端设备,其显示装置除了具有显示功能之外,还具有触控输入功能。在终端设备的显示装置上的任何一个操作行为,都需要被分解为若干个操作事件的集合,操作系统才能够对这些操作事件的相关数据进行相应处理。具体地,所述操作事件包括下列事件中的至少一项:
Down事件;
Up事件;以及
Move事件。
所谓的Down事件,在一次操作行为中仅会触发一次,是在手指刚接触终端设备的显示装置时触发。
所谓的Up事件,在一次操作行为中仅会触发一次,是在手指离开终端设备的显示装置时触发。
所谓的Move事件,在一次操作行为的过程中会触发0个、1个或者多个Move事件,如果手指一直在终端设备的显示装置上移动,就会一直触发Move事件,而且都是在Down事件之后与Up事件之前。
在另一个具体的实现过程中,具体可以获取所述互联应用所对应的所述第二终端设备上的配合应用或所述第二终端设备上除了所述配合应用之外的其他应用所触发的所述原始音频数据的开始播放指令,例如,配合应用的导航功能输出TTS音频数据时所触发的开始播放指令。
可选地,在本实施例的一个可能的实现方式中,在102中,具体可以将所述开始播放指令和所述音源优先级信息添加到空白帧中,以生成音频控制帧,进而,则可以将所述音频控制帧插入到所述原始音频数据中,以获得所述待播放音频数据。
具体地,具体可以将开始播放指令所在音频控制帧插入到所述原始音频数据的前面,进而,则可以按照预设数据大小如30千(k)字节或者预设时间大小如20毫秒(ms)等,对音频控制帧之后的原始音频数据进行分段处理,以获得若干段音频数据,将每段音频数据添加到空白帧的数据部分,以获得若干个音频数据帧。这样,由所获得的音频数据帧和音频控制帧,就组成了待播放音频数据。
在一个具体的实现过程中,具体可以将所述开始播放指令添加到所述音频控制帧的帧头中,或者还可以将所述开始播放指令添加到所述音频控制帧的数据部分中,本实施例对此不进行特别限定。
采用本发明所提供的技术方案,能够在多音频数据的发送过程中,减少不同音源之间直接的同步通信,降低系统音频同步和传输的设计难度,有效地利用了系统资源,同时,还能够有效增强系统稳定性。
本实施例中,通过获取互联应用所在第一终端设备所连接的第二终端设备的原始音频数据,进而将所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息添加到所述原始音频数据中,以获得待播放音频数据,使得能够将所述待播放音频数据,发送给所述互联应用,由于无需每个音源所对应的音频模块再同其他音源所对应的音频模块进行同步通信,以确定自身是否可以进行音频数据发送,而是将音频数据的开始播放指令和该音频数据所属音源的音源优先级信息添加到音频数据中一起发送给互联应用,由互联应用统一进行仲裁操作,播放仲裁之后的音频数据,因此,能够避免现有技术中由于音频模块之间的同步通信而导致的系统资源的浪费的问题。
图2为本发明另一实施例提供的另一种终端设备的控制方法的流程 示意图,如图2所示。
201、接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备的待播放音频数据。
202、对所述待播放音频数据进行解析处理,以获得原始音频数据、所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息。
203、若所述原始音频数据所属的音源与当前播放的音频数据的音源不相同,根据所述开始播放指令、所述原始音频数据所属音源的音源优先级信息和所述当前播放音源的音源优先级信息,停止播放当前播放音源的音频数据,开始播放所述原始音频数据或者继续播放所述当前播放音源的音频数据。
需要说明的是,201~203的执行主体可以为位于第一终端设备的应用即互联应用,或者还可以为设置在位于第一终端设备的应用(即互联应用)中的插件或软件开发工具包(Software Development Kit,SDK)等功能单元,本实施例对此不进行特别限定。
可以理解的是,所述互联应用可以是安装在第一终端设备上的本地程序(nativeApp),或者还可以是第一终端设备上的浏览器的一个网页程序(webApp),本实施例对此不进行特别限定。
这样,通过接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备的待播放音频数据,进而对所述待播放音频数据进行解析处理,以获得原始音频数据、所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息,若所述原始音频数据所属的音源与当前播放的音频数据的音源不相同, 使得能够根据所述开始播放指令、所述原始音频数据所属音源的音源优先级信息和所述当前播放音源的音源优先级信息,停止播放当前播放音源的音频数据,开始播放所述原始音频数据或者继续播放所述当前播放音源的音频数据,由于无需每个音源所对应的音频模块再同其他音源所对应的音频模块进行同步通信,以确定自身是否可以进行音频数据发送,而是将音频数据的开始播放指令和该音频数据所属音源的音源优先级信息添加到音频数据中一起发送给互联应用,由互联应用统一进行仲裁操作,播放仲裁之后的音频数据,因此,能够避免现有技术中由于音频模块之间的同步通信而导致的系统资源的浪费的问题。
需要说明的是,第一终端设备、互联应用、第二终端设备以及配合应用,的功能与描述,与图1对应的实施例中的第一终端设备、互联应用、第二终端设备以及配合应用,的功能与描述是一致的,详细描述可以参见图1对应的实施例中的相关内容,此处不再赘述。
本发明中,所接收的待播放音频数据,是采用图1对应的实施例所提供的技术方案,产生并发送的。详细描述可以参见图1对应的实施例中的相关内容,此处不再赘述。
可选地,在本实施例的一个可能的实现方式中,在202中,具体可以对所述待播放音频数据进行解析处理,以获得所述原始音频数据、音频控制帧中的所述开始播放指令和所述音频控制帧中的所述音源优先级信息。
在一个具体的实现过程中,具体可以对所述待播放音频数据中的音频控制帧的帧头进行解析处理,以获得该音频控制帧中的所述开始播放指令和所述音源优先级信息,以及对所述待播放音频数据中的音频数据 帧的数据部分进行解析处理,以获得该音频数据帧中的所述原始音频数据。
在另一个具体的实现过程中,具体可以对所述待播放音频数据中的音频控制帧的数据部分进行解析处理,以获得该音频控制帧中的所述开始播放指令和所述音源优先级信息,以及对所述待播放音频数据中的音频数据帧的数据部分进行解析处理,以获得该音频数据帧中的所述原始音频数据。
可选地,在本实施例的一个可能的实现方式中,在203中,若所述原始音频数据所属的音源与当前播放的音频数据的音源不相同,则可以根据所述开始播放指令,对所述原始音频数据所属音源的音源优先级信息和所述当前播放音源的音源优先级信息进行比较处理。
若所述原始音频数据所属音源的音源优先级信息高于所述当前播放音源的音源优先级信息,则可以停止播放当前播放音源的音频数据,进而根据开始播放指令中所包括的格式参数,对音轨进行初始化操作,利用经过初始化的音轨,开始播放所述原始音频数据。此时,可以将所接收的当前播放音源未播放的音频数据进行丢弃处理,不再对进行这些音频数据的播放处理。
若所述原始音频数据所属音源的音源优先级信息低于所述当前播放音源的音源优先级信息,则可以继续播放所述当前播放音源的音频数据。此时,可以将所接收的原始音频数据进行丢弃处理,不再对进行这些音频数据的播放处理。
可选地,在本实施例的一个可能的实现方式中,若在203中,播放了所述原始音频数据,在播放完毕所述原始音频数据,且仍然接收到所 述当前播放音源的音频数据,则可以继续播放所述当前播放音源的音频数据。
具体来说,可以根据所述当前播放音源所对应的格式参数,重新对音轨进行初始化操作,继续播放所述当前播放音源的音频数据。
采用本发明所提供的技术方案,能够在多音频数据的发送过程中,减少不同音源之间直接的同步通信,降低系统音频同步和传输的设计难度,有效地利用了系统资源,同时,还能够有效增强系统稳定性。
本实施例中,通过接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备的待播放音频数据,进而对所述待播放音频数据进行解析处理,以获得原始音频数据、所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息,若所述原始音频数据所属的音源与当前播放的音频数据的音源不相同,使得能够根据所述开始播放指令、所述原始音频数据所属音源的音源优先级信息和所述当前播放音源的音源优先级信息,停止播放当前播放音源的音频数据,开始播放所述原始音频数据或者继续播放所述当前播放音源的音频数据,由于无需每个音源所对应的音频模块再同其他音源所对应的音频模块进行同步通信,以确定自身是否可以进行音频数据发送,而是将音频数据的开始播放指令和该音频数据所属音源的音源优先级信息添加到音频数据中一起发送给互联应用,由互联应用统一进行仲裁操作,播放仲裁之后的音频数据,因此,能够避免现有技术中由于音频模块之间的同步通信而导致的系统资源的浪费的问题。
图3为本发明另一实施例提供的另一种终端设备的控制方法的流程示意图,如图3所示。
301、接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备上至少两个音源的待播放音频数据。
302、对所述至少两个音源的待播放音频数据中每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息。
303、根据所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,开始播放一个音源的原始音频数据。
需要说明的是,301~303的执行主体可以为位于第一终端设备的应用即互联应用,或者还可以为设置在位于第一终端设备的应用(即互联应用)中的插件或软件开发工具包(Software Development Kit,SDK)等功能单元,本实施例对此不进行特别限定。
可以理解的是,所述互联应用可以是安装在第一终端设备上的本地程序(nativeApp),或者还可以是第一终端设备上的浏览器的一个网页程序(webApp),本实施例对此不进行特别限定。
这样,通过接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备上至少两个音源的待播放音频数据,进而对所述至少两个音源的待播放音频数据中每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,使得能够根据所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,开始播放一个音源的原始音频数据,由于无需每个音源所对应的音频模块再同其他音源所对应的音频模块进行同 步通信,以确定自身是否可以进行音频数据发送,而是将音频数据的开始播放指令和该音频数据所属音源的音源优先级信息添加到音频数据中一起发送给互联应用,由互联应用统一进行仲裁操作,播放仲裁之后的音频数据,因此,能够避免现有技术中由于音频模块之间的同步通信而导致的系统资源的浪费的问题。
需要说明的是,第一终端设备、互联应用、第二终端设备以及配合应用,的功能与描述,与图1对应的实施例中的第一终端设备、互联应用、第二终端设备以及配合应用,的功能与描述是一致的,详细描述可以参见图1对应的实施例中的相关内容,此处不再赘述。
本发明中,所接收的待播放音频数据,是采用图1对应的实施例所提供的技术方案,产生并发送的。详细描述可以参见图1对应的实施例中的相关内容,此处不再赘述。
可选地,在本实施例的一个可能的实现方式中,在302中,具体可以对所述每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、音频控制帧中的所述开始播放指令和所述音频控制帧中的所述音源优先级信息。
在一个具体的实现过程中,具体可以对所述每个音源的待播放音频数据中的音频控制帧的帧头进行解析处理,以获得该音频控制帧中的所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,以及对所述每个音源的待播放音频数据中的音频数据帧的数据部分进行解析处理,以获得该音频数据帧中的所述每个音源的原始音频数据。
在另一个具体的实现过程中,具体可以对所述每个音源的待播放音 频数据中的音频控制帧的数据部分进行解析处理,以获得该音频控制帧中的所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,以及对所述每个音源的待播放音频数据中的音频数据帧的数据部分进行解析处理,以获得该音频数据帧中的所述每个音源的原始音频数据。
可选地,在本实施例的一个可能的实现方式中,在303中,具体可以根据所述每个音源的原始音频数据的开始播放指令,对所述每个音源的音源优先级信息进行比较处理。
选择音源优先级信息最高的音源,进而根据该音源的原始音频数据的开始播放指令中所包括的格式参数,对音轨进行初始化操作,利用经过初始化的音轨,开始播放该音源的原始音频数据。
采用本发明所提供的技术方案,能够在多音频数据的发送过程中,减少不同音源之间直接的同步通信,降低系统音频同步和传输的设计难度,有效地利用了系统资源,同时,还能够有效增强系统稳定性。
本实施例中,通过接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备上至少两个音源的待播放音频数据,进而对所述至少两个音源的待播放音频数据中每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,使得能够根据所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,开始播放一个音源的原始音频数据,由于无需每个音源所对应的音频模块再同其他音源所对应的音频模块进行同步通信,以确定自身是否可以进行音频数据发送,而是将音频数据 的开始播放指令和该音频数据所属音源的音源优先级信息添加到音频数据中一起发送给互联应用,由互联应用统一进行仲裁操作,播放仲裁之后的音频数据,因此,能够避免现有技术中由于音频模块之间的同步通信而导致的系统资源的浪费的问题。
需要说明的是,对于前述的各方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本发明并不受所描述的动作顺序的限制,因为依据本发明,某些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作和模块并不一定是本发明所必须的。
在所述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其他实施例的相关描述。
图4为本发明另一实施例提供的一种终端设备的控制装置的结构示意图,如图4所示。本实施例的终端设备的控制装置可以包括获取单元41、分帧单元42和发送单元43。其中,获取单元41,用于获取互联应用所在第一终端设备所连接的第二终端设备的原始音频数据;分帧单元42,用于将所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息添加到所述原始音频数据中,以获得待播放音频数据;发送单元43,用于将所述待播放音频数据,发送给所述互联应用。
本发明中,第一终端设备与第二终端设备通过但不限于蓝牙连接、通用串行总线(Universal Serial Bus,USB)连接和无线相容性认证(Wireless Fidelity,WI-FI)连接中的至少一项进行连接,本实施例对此不进行特别限定。
需要说明的是,本实施例的终端设备的控制装置可以为位于第二终端设备的应用即互联应用所对应的配合应用,或者还可以为设置在位于第二终端设备的应用(即互联应用所对应的配合应用)中的插件或软件开发工具包(Software Development Kit,SDK)等功能单元,本实施例对此不进行特别限定。
可以理解的是,所述应用可以是安装在第二终端设备上的本地程序(nativeApp),或者还可以是第二终端设备上的浏览器的一个网页程序(webApp),本实施例对此不进行特别限定。
可选地,在本实施例的一个可能的实现方式中,所述第一终端设备优选为车载终端设备;所述第二终端设备优选为用户终端设备。
反过来,所述第一终端设备也可以为用户终端设备;所述第二终端设备也可以为车载终端设备。但是,在实际应用中,用户终端设备上所安装的应用都可以单独执行,无需依赖与其连接的另一个终端设备才能正常使用,或者依赖与其连接的另一个终端设备上安装一个相应的配合应用才能正常使用。
可选地,在本实施例的一个可能的实现方式中,所述获取单元41所获取的所述第二终端设备的原始音频数据,可以为所述互联应用所对应的所述第二终端设备上的配合应用的音频数据,例如,配合应用所获取的歌曲音频数据、配合应用的导航功能所输出的TTS音频数据(Text To Speech,TTS)等,或者还可以为所述第二终端设备上除了所述配合应用之外的其他应用的音频数据,例如,QQ音乐所获取的歌曲音频数据等,本实施例对此不进行特别限定。
可选地,在本实施例的一个可能的实现方式中,所述分帧单元42, 还可以进一步用于获取用户操作所述第二终端设备的音频相关操作事件数据;以及根据所述音频相关操作事件数据,获得所述原始音频数据的开始播放指令。
可选地,在本实施例的一个可能的实现方式中,所述分帧单元42,还可以进一步用于获取所述互联应用所对应的所述第二终端设备上的配合应用或所述第二终端设备上除了所述配合应用之外的其他应用所触发的所述原始音频数据的开始播放指令。
可选地,在本实施例的一个可能的实现方式中,所述分帧单元42,具体可以用于将所述开始播放指令和所述音源优先级信息添加到空白帧中,以生成音频控制帧;以及将所述音频控制帧插入到所述原始音频数据中,以获得所述待播放音频数据。
需要说明的是,图1对应的实施例中方法,可以由本实施例提供的终端设备的控制装置实现。详细描述可以参见图1对应的实施例中的相关内容,此处不再赘述。
本实施例中,通过获取单元获取互联应用所在第一终端设备所连接的第二终端设备的原始音频数据,进而由分帧单元将所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息添加到所述原始音频数据中,以获得待播放音频数据,使得发送单元能够将所述待播放音频数据,发送给所述互联应用,由于无需每个音源所对应的音频模块再同其他音源所对应的音频模块进行同步通信,以确定自身是否可以进行音频数据发送,而是将音频数据的开始播放指令和该音频数据所属音源的音源优先级信息添加到音频数据中一起发送给互联应用,由互联应用统一进行仲裁操作,播放仲裁之后的音频数据,因此,能够 避免现有技术中由于音频模块之间的同步通信而导致的系统资源的浪费的问题。
图5为本发明另一实施例提供的另一种终端设备的控制装置的结构示意图,如图5所示。本实施例的终端设备的控制装置可以包括接收单元51、解析单元52和播放单元53。其中,接收单元51,用于接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备的待播放音频数据;解析单元52,用于对所述待播放音频数据进行解析处理,以获得原始音频数据、所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息;播放单元53,用于若所述原始音频数据所属的音源与当前播放的音频数据的音源不相同,根据所述开始播放指令、所述原始音频数据所属音源的音源优先级信息和所述当前播放音源的音源优先级信息,停止播放当前播放音源的音频数据,开始播放所述原始音频数据或者继续播放所述当前播放音源的音频数据。
需要说明的是,本实施例的终端设备的控制装置可以为位于第一终端设备的应用即互联应用,或者还可以为设置在位于第一终端设备的应用(即互联应用)中的插件或软件开发工具包(Software Development Kit,SDK)等功能单元,本实施例对此不进行特别限定。
可以理解的是,所述互联应用可以是安装在第一终端设备上的本地程序(nativeApp),或者还可以是第一终端设备上的浏览器的一个网页程序(webApp),本实施例对此不进行特别限定。
需要说明的是,第一终端设备、互联应用、第二终端设备以及配合应用,的功能与描述,与图4对应的实施例中的第一终端设备、互联应 用、第二终端设备以及配合应用,的功能与描述是一致的,详细描述可以参见图4对应的实施例中的相关内容,此处不再赘述。
本发明中,接收单元51所接收的待播放音频数据,是采用图4对应的实施例所提供的技术方案,产生并发送的。详细描述可以参见图4对应的实施例中的相关内容,此处不再赘述。
可选地,在本实施例的一个可能的实现方式中,所述解析单元52,具体可以用于对所述待播放音频数据进行解析处理,以获得所述原始音频数据、音频控制帧中的所述开始播放指令和所述音频控制帧中的所述音源优先级信息。
可选地,在本实施例的一个可能的实现方式中,所述播放单元53,还可以进一步用于若播放完毕所述原始音频数据,且仍然接收到所述当前播放音源的音频数据,恢复播放所述当前播放音源的音频数据。
需要说明的是,图2对应的实施例中方法,可以由本实施例提供的终端设备的控制装置实现。详细描述可以参见图2对应的实施例中的相关内容,此处不再赘述。
本实施例中,通过接收单元接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备的待播放音频数据,进而由解析单元对所述待播放音频数据进行解析处理,以获得原始音频数据、所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息,若所述原始音频数据所属的音源与当前播放的音频数据的音源不相同,使得播放单元能够根据所述开始播放指令、所述原始音频数据所属音源的音源优先级信息和所述当前播放音源的音源优先级信息,停止播放当前播放音源的音频数据,开始播放所述原始 音频数据或者继续播放所述当前播放音源的音频数据,由于无需每个音源所对应的音频模块再同其他音源所对应的音频模块进行同步通信,以确定自身是否可以进行音频数据发送,而是将音频数据的开始播放指令和该音频数据所属音源的音源优先级信息添加到音频数据中一起发送给互联应用,由互联应用统一进行仲裁操作,播放仲裁之后的音频数据,因此,能够避免现有技术中由于音频模块之间的同步通信而导致的系统资源的浪费的问题。
图6为本发明另一实施例提供的另一种终端设备的控制装置的结构示意图,如图6所示。本实施例的终端设备的控制装置可以包括接收单元61、解析单元62和播放单元63。其中,接收单元61,用于接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备上至少两个音源的待播放音频数据;解析单元62,用于对所述至少两个音源的待播放音频数据中每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息;播放单元63,用于根据所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,开始播放一个音源的原始音频数据。
需要说明的是,本实施例的终端设备的控制装置可以为位于第一终端设备的应用即互联应用,或者还可以为设置在位于第一终端设备的应用(即互联应用)中的插件或软件开发工具包(Software Development Kit,SDK)等功能单元,本实施例对此不进行特别限定。
可以理解的是,所述互联应用可以是安装在第一终端设备上的本地程序(nativeApp),或者还可以是第一终端设备上的浏览器的一个网页 程序(webApp),本实施例对此不进行特别限定。
需要说明的是,第一终端设备、互联应用、第二终端设备以及配合应用,的功能与描述,与图4对应的实施例中的第一终端设备、互联应用、第二终端设备以及配合应用,的功能与描述是一致的,详细描述可以参见图4对应的实施例中的相关内容,此处不再赘述。
本发明中,接收单元61所接收的待播放音频数据,是采用图4对应的实施例所提供的技术方案,产生并发送的。详细描述可以参见图4对应的实施例中的相关内容,此处不再赘述。
可选地,在本实施例的一个可能的实现方式中,所述解析单元62,具体可以用于对所述每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、音频控制帧中的所述开始播放指令和所述音频控制帧中的所述音源优先级信息。
需要说明的是,图3对应的实施例中方法,可以由本实施例提供的终端设备的控制装置实现。详细描述可以参见图3对应的实施例中的相关内容,此处不再赘述。
本实施例中,通过接收单元接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备上至少两个音源的待播放音频数据,进而由解析单元对所述至少两个音源的待播放音频数据中每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,使得播放单元能够根据所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,开始播放一个音源的原始音频数据,由于无需每个音源所对应的音频模块再 同其他音源所对应的音频模块进行同步通信,以确定自身是否可以进行音频数据发送,而是将音频数据的开始播放指令和该音频数据所属音源的音源优先级信息添加到音频数据中一起发送给互联应用,由互联应用统一进行仲裁操作,播放仲裁之后的音频数据,因此,能够避免现有技术中由于音频模块之间的同步通信而导致的系统资源的浪费的问题。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,所述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本发明所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。所述集成的单元既可以采用硬件的形式实现,也可以 采用硬件加软件功能单元的形式实现。
所述以软件功能单元的形式实现的集成的单元,可以存储在一个计算机可读取存储介质中。所述软件功能单元存储在一个存储介质中,包括若干指令用以使得一台计算机装置(可以是个人计算机,音频处理引擎,或者网络装置等)或处理器(processor)执行本发明各个实施例所述方法的部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
最后应说明的是:以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。

Claims (30)

  1. 一种终端设备的控制方法,其特征在于,包括:
    获取互联应用所在第一终端设备所连接的第二终端设备的原始音频数据;
    将所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息添加到所述原始音频数据中,以获得待播放音频数据;
    将所述待播放音频数据,发送给所述互联应用。
  2. 根据权利要求1所述的方法,其特征在于,所述第二终端设备的原始音频数据,包括:
    所述互联应用所对应的所述第二终端设备上的配合应用的音频数据;或者
    所述第二终端设备上除了所述配合应用之外的其他应用的音频数据。
  3. 根据权利要求1或2所述的方法,其特征在于,所述将所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息添加到所述原始音频数据中,以获得待播放音频数据之前,还包括:
    获取用户操作所述第二终端设备的音频相关操作事件数据;以及根据所述音频相关操作事件数据,获得所述原始音频数据的开始播放指令;或者
    获取所述互联应用所对应的所述第二终端设备上的配合应用或所述第二终端设备上除了所述配合应用之外的其他应用所触发的所述原始音频数据的开始播放指令。
  4. 根据权利要求1~3任一权利要求所述的方法,其特征在于,所述将所述原始音频数据的开始播放指令和所述原始音频数据所属音源的 音源优先级信息添加到所述原始音频数据中,以获得待播放音频数据,包括:
    将所述开始播放指令和所述音源优先级信息添加到空白帧中,以生成音频控制帧;
    将所述音频控制帧插入到所述原始音频数据中,以获得所述待播放音频数据。
  5. 根据权利要求1~4任一权利要求所述的方法,其特征在于,
    所述第一终端设备为车载终端设备;
    所述第二终端设备为用户终端设备。
  6. 一种终端设备的控制方法,其特征在于,包括:
    接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备的待播放音频数据;
    对所述待播放音频数据进行解析处理,以获得原始音频数据、所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息;
    若所述原始音频数据所属的音源与当前播放的音频数据的音源不相同,根据所述开始播放指令、所述原始音频数据所属音源的音源优先级信息和所述当前播放音源的音源优先级信息,停止播放当前播放音源的音频数据,开始播放所述原始音频数据或者继续播放所述当前播放音源的音频数据。
  7. 根据权利要求6所述的方法,其特征在于,所述对所述待播放音频数据进行解析处理,以获得原始音频数据、所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息,包括:
    对所述待播放音频数据进行解析处理,以获得所述原始音频数据、音频控制帧中的所述开始播放指令和所述音频控制帧中的所述音源优先级信息。
  8. 根据权利要求6或7所述的方法,其特征在于,所述方法还包括:
    若播放完毕所述原始音频数据,且仍然接收到所述当前播放音源的音频数据,恢复播放所述当前播放音源的音频数据。
  9. 根据权利要求6~8任一权利要求所述的方法,其特征在于,
    所述第一终端设备为车载终端设备;
    所述第二终端设备为用户终端设备。
  10. 一种终端设备的控制方法,其特征在于,包括:
    接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备上至少两个音源的待播放音频数据;
    对所述至少两个音源的待播放音频数据中每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息;
    根据所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,开始播放一个音源的原始音频数据。
  11. 根据权利要求10所述的方法,其特征在于,所述对所述至少两个音源的待播放音频数据中每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,包括:
    对所述每个音源的待播放音频数据进行解析处理,以获得所述每个 音源的原始音频数据、音频控制帧中的所述开始播放指令和所述音频控制帧中的所述音源优先级信息。
  12. 根据权利要求10或11所述的方法,其特征在于,
    所述第一终端设备为车载终端设备;
    所述第二终端设备为用户终端设备。
  13. 一种终端设备的控制装置,其特征在于,包括:
    获取单元,用于获取互联应用所在第一终端设备所连接的第二终端设备的原始音频数据;
    分帧单元,用于将所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息添加到所述原始音频数据中,以获得待播放音频数据;
    发送单元,用于将所述待播放音频数据,发送给所述互联应用。
  14. 根据权利要求13所述的装置,其特征在于,所述第二终端设备的原始音频数据,包括:
    所述互联应用所对应的所述第二终端设备上的配合应用的音频数据;或者
    所述第二终端设备上除了所述配合应用之外的其他应用的音频数据。
  15. 根据权利要求13或14所述的装置,其特征在于,所述分帧单元,还用于
    获取用户操作所述第二终端设备的音频相关操作事件数据;以及根据所述音频相关操作事件数据,获得所述原始音频数据的开始播放指令;或者
    获取所述互联应用所对应的所述第二终端设备上的配合应用或所述 第二终端设备上除了所述配合应用之外的其他应用所触发的所述原始音频数据的开始播放指令。
  16. 根据权利要求13~15任一权利要求所述的装置,其特征在于,所述分帧单元,具体用于
    将所述开始播放指令和所述音源优先级信息添加到空白帧中,以生成音频控制帧;以及
    将所述音频控制帧插入到所述原始音频数据中,以获得所述待播放音频数据。
  17. 根据权利要求13~16任一权利要求所述的装置,其特征在于,所述第一终端设备为车载终端设备;
    所述第二终端设备为用户终端设备。
  18. 一种终端设备的控制装置,其特征在于,包括:
    接收单元,用于接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备的待播放音频数据;
    解析单元,用于对所述待播放音频数据进行解析处理,以获得原始音频数据、所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息;
    播放单元,用于若所述原始音频数据所属的音源与当前播放的音频数据的音源不相同,根据所述开始播放指令、所述原始音频数据所属音源的音源优先级信息和所述当前播放音源的音源优先级信息,停止播放当前播放音源的音频数据,开始播放所述原始音频数据或者继续播放所述当前播放音源的音频数据。
  19. 根据权利要求18所述的装置,其特征在于,所述解析单元, 具体用于
    对所述待播放音频数据进行解析处理,以获得所述原始音频数据、音频控制帧中的所述开始播放指令和所述音频控制帧中的所述音源优先级信息。
  20. 根据权利要求18或19所述的装置,其特征在于,所述播放单元,还用于
    若播放完毕所述原始音频数据,且仍然接收到所述当前播放音源的音频数据,恢复播放所述当前播放音源的音频数据。
  21. 根据权利要求18~20任一权利要求所述的装置,其特征在于,所述第一终端设备为车载终端设备;
    所述第二终端设备为用户终端设备。
  22. 一种终端设备的控制装置,其特征在于,包括:
    接收单元,用于接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备上至少两个音源的待播放音频数据;
    解析单元,用于对所述至少两个音源的待播放音频数据中每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息;
    播放单元,用于根据所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,开始播放一个音源的原始音频数据。
  23. 根据权利要求22所述的装置,其特征在于,所述解析单元,具体用于
    对所述每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、音频控制帧中的所述开始播放指令和所述音频控制帧中的所述音源优先级信息。
  24. 根据权利要求22或23所述的装置,其特征在于,
    所述第一终端设备为车载终端设备;
    所述第二终端设备为用户终端设备。
  25. 一种设备,包括:
    一个或者多个处理器;
    存储器;
    一个或者多个程序,所述一个或者多个程序存储在所述存储器中,当被所述一个或者多个处理器执行时:
    获取互联应用所在第一终端设备所连接的第二终端设备的原始音频数据;
    将所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息添加到所述原始音频数据中,以获得待播放音频数据;
    将所述待播放音频数据,发送给所述互联应用。
  26. 一种设备,包括:
    一个或者多个处理器;
    存储器;
    一个或者多个程序,所述一个或者多个程序存储在所述存储器中,当被所述一个或者多个处理器执行时:
    接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备的待播放音频数据;
    对所述待播放音频数据进行解析处理,以获得原始音频数据、所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息;
    若所述原始音频数据所属的音源与当前播放的音频数据的音源不相同,根据所述开始播放指令、所述原始音频数据所属音源的音源优先级信息和所述当前播放音源的音源优先级信息,停止播放当前播放音源的音频数据,开始播放所述原始音频数据或者继续播放所述当前播放音源的音频数据。
  27. 一种非易失性计算机存储介质,所述非易失性计算机存储介质存储有一个或者多个程序,当所述一个或者多个程序被一个设备执行时,使得所述设备:
    获取互联应用所在第一终端设备所连接的第二终端设备的原始音频数据;
    将所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先级信息添加到所述原始音频数据中,以获得待播放音频数据;
    将所述待播放音频数据,发送给所述互联应用。
  28. 一种非易失性计算机存储介质,所述非易失性计算机存储介质存储有一个或者多个程序,当所述一个或者多个程序被一个设备执行时,使得所述设备:
    接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备的待播放音频数据;
    对所述待播放音频数据进行解析处理,以获得原始音频数据、所述原始音频数据的开始播放指令和所述原始音频数据所属音源的音源优先 级信息;
    若所述原始音频数据所属的音源与当前播放的音频数据的音源不相同,根据所述开始播放指令、所述原始音频数据所属音源的音源优先级信息和所述当前播放音源的音源优先级信息,停止播放当前播放音源的音频数据,开始播放所述原始音频数据或者继续播放所述当前播放音源的音频数据。
  29. 一种设备,包括:
    一个或者多个处理器;
    存储器;
    一个或者多个程序,所述一个或者多个程序存储在所述存储器中,当被所述一个或者多个处理器执行时:
    接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备上至少两个音源的待播放音频数据;
    对所述至少两个音源的待播放音频数据中每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息;
    根据所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,开始播放一个音源的原始音频数据。
  30. 一种非易失性计算机存储介质,所述非易失性计算机存储介质存储有一个或者多个程序,当所述一个或者多个程序被一个设备执行时,使得所述设备:
    接收第一终端设备上的互联应用所对应的第二终端设备上的配合应用所发送的所述第二终端设备上至少两个音源的待播放音频数据;
    对所述至少两个音源的待播放音频数据中每个音源的待播放音频数据进行解析处理,以获得所述每个音源的原始音频数据、所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息;
    根据所述每个音源的原始音频数据的开始播放指令和所述每个音源的音源优先级信息,开始播放一个音源的原始音频数据。
PCT/CN2016/088120 2015-12-25 2016-07-01 终端设备的控制方法、装置、设备及非易失性计算机存储介质 WO2017107427A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510994012.5 2015-12-25
CN201510994012.5A CN105554294A (zh) 2015-12-25 2015-12-25 终端设备的控制方法及装置

Publications (1)

Publication Number Publication Date
WO2017107427A1 true WO2017107427A1 (zh) 2017-06-29

Family

ID=55833225

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/088120 WO2017107427A1 (zh) 2015-12-25 2016-07-01 终端设备的控制方法、装置、设备及非易失性计算机存储介质

Country Status (2)

Country Link
CN (1) CN105554294A (zh)
WO (1) WO2017107427A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111831249A (zh) * 2020-07-07 2020-10-27 Oppo广东移动通信有限公司 音频播放方法、装置、存储介质及电子设备
CN112860938A (zh) * 2019-11-27 2021-05-28 湖北亿咖通科技有限公司 一种车载多媒体的多音源控制方法、存储介质及电子设备

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105611356A (zh) * 2015-12-25 2016-05-25 百度在线网络技术(北京)有限公司 终端设备的控制方法及装置
CN105609122A (zh) * 2015-12-25 2016-05-25 百度在线网络技术(北京)有限公司 终端设备的控制方法及装置
CN105554294A (zh) * 2015-12-25 2016-05-04 百度在线网络技术(北京)有限公司 终端设备的控制方法及装置
CN105973262A (zh) * 2016-07-18 2016-09-28 乐视控股(北京)有限公司 一种导航控制方法及导航系统
CN106775552B (zh) * 2016-11-14 2020-02-11 东软集团股份有限公司 音源处理方法、装置和系统
CN106775815B (zh) * 2016-11-16 2020-02-18 Oppo广东移动通信有限公司 一种应用程序数据迁移的方法及装置
CN112019484B (zh) * 2019-05-31 2024-06-07 阿里巴巴集团控股有限公司 获取音源数据的方法及相关设备
CN111221494B (zh) * 2019-12-26 2023-12-29 深圳市优必选科技股份有限公司 数据处理方法及装置、音频播报方法及装置

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050286481A1 (en) * 2004-06-29 2005-12-29 Fadell Anthony M Method for data transmission utlizing a portable multimedia device
CN103475436A (zh) * 2013-08-21 2013-12-25 东莞市凯泰科技有限公司 基于dlna技术的音频播放列表与播放位置传送的方法
CN103617806A (zh) * 2013-10-30 2014-03-05 成都市翻鑫家科技有限公司 一种带支架的录音录像笔
CN103814546A (zh) * 2011-09-07 2014-05-21 Lg电子株式会社 移动终端、被安装到车辆上的图像显示装置及其数据处理方法
CN105554294A (zh) * 2015-12-25 2016-05-04 百度在线网络技术(北京)有限公司 终端设备的控制方法及装置
CN105611356A (zh) * 2015-12-25 2016-05-25 百度在线网络技术(北京)有限公司 终端设备的控制方法及装置
CN105609122A (zh) * 2015-12-25 2016-05-25 百度在线网络技术(北京)有限公司 终端设备的控制方法及装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2792795B1 (fr) * 1999-04-20 2001-07-13 Sagem Systeme d'ecoute amplifiee et procede de telephonie mobile mains libres
ATE335353T1 (de) * 2002-06-05 2006-08-15 Cit Alcatel Freisprechkommunikationssystem für mobiltelefon wie auch ein mobiltelefon und ein audiosystem dafür
US20080195305A1 (en) * 2007-02-13 2008-08-14 Magnus Jendbro System and method for broadcasting navigation prompts
GB2478129A (en) * 2010-02-25 2011-08-31 Nokia Corp Transmission of radio signals by a portable apparatus using priority flagging
CN103617803A (zh) * 2013-11-08 2014-03-05 中标软件有限公司 一种车载系统上多音源自动切换方法及系统

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050286481A1 (en) * 2004-06-29 2005-12-29 Fadell Anthony M Method for data transmission utlizing a portable multimedia device
CN103814546A (zh) * 2011-09-07 2014-05-21 Lg电子株式会社 移动终端、被安装到车辆上的图像显示装置及其数据处理方法
CN103475436A (zh) * 2013-08-21 2013-12-25 东莞市凯泰科技有限公司 基于dlna技术的音频播放列表与播放位置传送的方法
CN103617806A (zh) * 2013-10-30 2014-03-05 成都市翻鑫家科技有限公司 一种带支架的录音录像笔
CN105554294A (zh) * 2015-12-25 2016-05-04 百度在线网络技术(北京)有限公司 终端设备的控制方法及装置
CN105611356A (zh) * 2015-12-25 2016-05-25 百度在线网络技术(北京)有限公司 终端设备的控制方法及装置
CN105609122A (zh) * 2015-12-25 2016-05-25 百度在线网络技术(北京)有限公司 终端设备的控制方法及装置

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112860938A (zh) * 2019-11-27 2021-05-28 湖北亿咖通科技有限公司 一种车载多媒体的多音源控制方法、存储介质及电子设备
CN112860938B (zh) * 2019-11-27 2023-04-11 亿咖通(湖北)技术有限公司 一种车载多媒体的多音源控制方法、存储介质及电子设备
CN111831249A (zh) * 2020-07-07 2020-10-27 Oppo广东移动通信有限公司 音频播放方法、装置、存储介质及电子设备

Also Published As

Publication number Publication date
CN105554294A (zh) 2016-05-04

Similar Documents

Publication Publication Date Title
WO2017107427A1 (zh) 终端设备的控制方法、装置、设备及非易失性计算机存储介质
WO2017107428A1 (zh) 终端设备的控制方法、装置、设备及非易失性计算机存储介质
WO2017107430A1 (zh) 终端设备的控制方法、装置、设备及非易失性计算机存储介质
US10249301B2 (en) Method and system for speech recognition processing
CN108133707B (zh) 一种内容分享方法及系统
WO2019223351A1 (zh) 基于视图的语音交互方法、装置、服务器、终端和介质
US10270736B2 (en) Account adding method, terminal, server, and computer storage medium
US20190196779A1 (en) Intelligent personal assistant interface system
CN107005800B (zh) 音频文件的传输、接收方法及装置、设备及其系统
CN104052846B (zh) 游戏应用中的语音通信方法及系统
CN107943834B (zh) 人机对话的实现方法、装置、设备及存储介质
WO2017045190A1 (zh) 指导终端设备操作的方法、装置和设备
JP2019015951A (ja) 電子機器のウェイクアップ方法、装置、デバイス及びコンピュータ可読記憶媒体
JP6814871B2 (ja) 電子デバイスの音声制御方法、電子デバイスの音声制御装置、コンピュータ機器及び記憶媒体
WO2017101260A1 (zh) 音频切换方法、装置以及存储介质
CN103797761A (zh) 通信方法、客户端和终端
CN110992955A (zh) 一种智能设备的语音操作方法、装置、设备及存储介质
CN109560913B (zh) 一种蓝牙音频设备之间数据时间同步的方法及装置
CN111816190A (zh) 用于上位机与下位机的语音交互方法和装置
WO2024131879A1 (zh) 3d数字人唇形驱动方法、装置、电子设备及存储介质
JP7375089B2 (ja) 音声応答速度確定方法、装置、コンピュータ読み取り可能な記憶媒体及びコンピュータプログラム
CN104702758B (zh) 一种终端及其管理多媒体记事本的方法
JP2020198077A (ja) 電子デバイスの音声制御方法、電子デバイスの音声制御装置、コンピュータ機器及び記憶媒体
CN108282720B (zh) 一种音频数据流的传输方法及装置
EP3203468A1 (en) Acoustic system, communication device, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16877240

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16877240

Country of ref document: EP

Kind code of ref document: A1