WO2017101327A1 - 多播放器共同播放高保真声音的方法及装置 - Google Patents

多播放器共同播放高保真声音的方法及装置 Download PDF

Info

Publication number
WO2017101327A1
WO2017101327A1 PCT/CN2016/088552 CN2016088552W WO2017101327A1 WO 2017101327 A1 WO2017101327 A1 WO 2017101327A1 CN 2016088552 W CN2016088552 W CN 2016088552W WO 2017101327 A1 WO2017101327 A1 WO 2017101327A1
Authority
WO
WIPO (PCT)
Prior art keywords
sound data
format
hifi
audio
sound
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/088552
Other languages
English (en)
French (fr)
Inventor
赵胜涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Le Holdings Beijing Co Ltd
Leshi Zhixin Electronic Technology Tianjin Co Ltd
Original Assignee
Le Holdings Beijing Co Ltd
Leshi Zhixin Electronic Technology Tianjin Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Le Holdings Beijing Co Ltd, Leshi Zhixin Electronic Technology Tianjin Co Ltd filed Critical Le Holdings Beijing Co Ltd
Priority to US15/247,811 priority Critical patent/US20170178636A1/en
Publication of WO2017101327A1 publication Critical patent/WO2017101327A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/0017—Lossless audio signal coding; Perfect reconstruction of coded audio signal by transmission of coding error
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B19/00—Driving, starting, stopping record carriers not specifically of filamentary or web form, or of supports therefor; Control thereof; Control of operating function ; Driving both disc and head
    • G11B19/02—Control of operating function, e.g. switching from recording to reproducing
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/00007—Time or data compression or expansion
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/167—Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B31/00—Arrangements for the associated working of recording or reproducing apparatus with related apparatus
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/00007—Time or data compression or expansion
    • G11B2020/00014—Time or data compression or expansion the compressed signal being an audio signal

Definitions

  • the present invention relates to the field of multimedia technologies, and in particular, to a method and apparatus for playing a high-fidelity (HIFI) sound by a multi-player.
  • HIFI high-fidelity
  • the system when playing music in the Android android system, if there is a tone sound, the system will mix the tone sound into the music being played, and then play it together. In addition, there are other situations. For example: if the background is playing music, open a webpage with background music, then the background concert will be broadcast together with the background music mixer; these prompts and the second player can be played together because android The system will play all the music in 48k 16bit format. When it needs to play multiple sounds at the same time, the system can directly play the music mixer of the same format from one channel.
  • the tone (48k 16bit format) tone or the music to be played by the second player is not necessarily the same as the HIFI music format played in the background, because the audio output device in this case cannot be directly mixed. Only headphones, so it is impossible to play two or more different data formats at the same time, which leads to the interruption of the currently playing music due to tone sounds and web pages when listening to HIFI music, affecting the normal playback of music. .
  • the embodiment of the invention provides a method and a device for playing a HIFI sound by a multi-player, which is used to solve the problem that the multiple music formats cannot be played simultaneously with the HIFI music in the prior art. Problems.
  • an embodiment of the present invention provides a method for a multi-player to jointly play a high-fidelity HIFI sound, including:
  • the first sound data and the second sound data of the HIFI audio format are mixed and played.
  • the embodiment of the present invention further provides a device for playing a high-fidelity HIFI sound by a multi-player, including:
  • a receiving module configured to receive the first sound data of the HIFI audio format and the second sound data of the second audio format, where the second audio format is an audio format other than the HIFI;
  • a decoding module configured to transmit the first sound data of the HIFI audio format to the first processor for decoding; and decode the second sound data of the second audio format into a second code of the pulse code modulation and PCM format Audio data
  • a conversion module configured to control the first processor to convert the second sound data of the PCM format into the second sound data of the HIFI audio format
  • the hybrid playing module is configured to mix the first sound data and the second sound data of the HIFI audio format and play the same.
  • the sound data for the non-HIFI format is firstly converted into the PCM format voice data, then converted into the HIFI format, and finally the technical means of mixing and playing the same HIFI format sound data.
  • the technical problem that the formatted sound data cannot be played together with the sound data of the HIFI format, and thus, when playing the HIFI sound format, if there is sound data of other formats, the sound of the other format can be heard without suspending the HIFI sound playback.
  • the technical effects of data, HIFI and all other formats of music can be played together.
  • FIG. 1 is an exemplary flowchart of a method for playing a HIFI sound by a multi-player according to an embodiment of the present invention
  • FIG. 2 is another exemplary flowchart of a method for playing a HIFI sound by a multi-player according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of internal execution of a method for playing a HIFI sound by a multi-player according to an embodiment of the present invention
  • FIG. 4 is a schematic structural diagram of an apparatus for playing a HIFI sound by a multi-player according to an embodiment of the present invention
  • FIG. 5 is a schematic structural diagram of an apparatus for playing a HIFI sound by a multi-player according to an embodiment of the present invention.
  • this embodiment provides a method for playing a HIFI sound by a multi-player, which is suitable for deployment in a voice and other different audio formats that are required to play HIFI format. Ready, such as mobile phones.
  • the method mainly includes:
  • opening HIFI music playback or playing HIFI music can be considered as receiving the first sound data of the HIFI audio format.
  • the second audio format in this embodiment may represent one or more audio formats other than HIFI, such as tone sound, music played on a webpage, or music in other formats.
  • the second sound data may also be sound data of a plurality of audio formats.
  • all audio formats except HIFI are The sound data may be one type or a plurality of second sound data collectively referred to as a second audio format.
  • the sound data in this embodiment may be music data, or may be other sounds such as voices.
  • the first audio data of the HIFI audio format is transmitted to a first processor for decoding, and the second audio data of the second audio format is decoded and converted into second audio data of a pulse code modulated PCM format.
  • the first sound data in the HIFI format is directly sent to the first processor for decoding in a hard decoding manner, and the second sound data in the second audio format is decoded in a soft decoding manner, and The decoded second sound data is converted into PCM format.
  • the first sound data is preferably played in a hardware decoding manner, but if the device has better performance or a more energy storage capability, The first sound data can also be decoded in a soft decoding manner.
  • the second sound data for the second audio format is preferably decoded in a soft decoding manner.
  • the device has multiple hard decoders or only one type of sound data in the second format,
  • the sound data of the second format can also be decoded by hard decoding.
  • the first processor normally decodes the first sound data in the HIFI format, and converts the second sound data in the PCM format into the HIFI format.
  • HIFI is not a fixed audio format, it mainly refers to the audio format that maintains the sampling rate of the source itself and the bit width. Therefore, the mixing process in this embodiment needs to be processed after the audio data stream participating in the mixing is decoded into the PCM format, so the second sound data needs to be decoded into the PCM format first, and then according to the first sound data currently being played. After the source format is resampled, the first sound is mixed with the resampled second sound source, so that the technical effect of playing after mixing can be realized.
  • the first sound data and the second sound data are all processed in the HIFI format after being processed by the above 102-103, and thus can be played together.
  • the alternative is to specifically convert the second sound data in 102 into a 48k 16bit PCM format.
  • the tone data is decoded into 48k 16bit PCM format sound data, so there is no need to convert, but for other audio formats, the sound data, such as the music format of the music format played on the web page, needs to be re-coded after decoding.
  • the sample is obtained in 48k 16bit PCM format.
  • the music format that can be played can only be one. If multiple audio streams are played simultaneously without mixing, only one audio stream can be played normally. Pause other audio streams. Therefore, in the prior art, the music currently being played is interrupted because of the tone sound and the web page, and the normal playback of the music is affected.
  • the player playing sound or the webpage's own voice is only used to remind the user of the existence of the webpage or the corresponding prompt information, in normal application scenarios, the user usually does not care about playing at the same time. Audio, so the sound data of non-HIFI format is converted into HIFI format sound data, and then mixed into the HIFI sound data to play the technical means, while enjoying the HIFI music, you can also receive the prompt tone or web page open at the same time. The sound played during the time ensures that the technical effect of the reminder can still be achieved when the multi-channel sound source is simultaneously mixed.
  • the foregoing method may still be used. Specifically, for example, when there are two output devices, one of them is used for playing. HIFI audio, the other is used to play audio in other formats (that is, the audio data of the second audio format mentioned above). If the HIFI audio is played at the same time, if the audio of the third format is to be played, the third format may be used. The audio is treated as the audio data of the second audio format in the above embodiment, and is played simultaneously with the HIFI audio.
  • the embodiment is specifically combined with the schematic diagram shown in FIG. 3, and provides a method for a multi-player to jointly play a HIFI sound, the method comprising:
  • the HIFI player on the mobile phone selects the hard decoding mode when playing the HIFI music, and the audio data stream is directly output to the ADSP decoding of the input audio signal processing chip;
  • the audio data is decoded into 48k 16bit pcm format and then sent to the mixing thread, such as audioflinger mixer (mixer) thread;
  • the Audioflinger mixing thread resamples all the sent sound data into a 48k 16bit pcm format and mixes them into an audio signal processing chip (ADSP);
  • ADSP audio signal processing chip
  • ADSP decodes the sound data of the HIFI audio format, and then resamples the other sound data of the pcm format that needs to be output into the HIFI audio format currently being played, and then mixes and outputs it to the HIFI chip;
  • the analog data is sent to the headset headset/headphone for playing.
  • the method provided in this embodiment can play the music in the HIFI format together with the music in other formats, without interrupting the music of the HIFI format being played, and improving the listening experience of the user.
  • the embodiment continues to provide a device for playing a high-fidelity HIFI sound by a multi-player, which is suitable for installation in addition to HIFI.
  • a device for playing a high-fidelity HIFI sound by a multi-player which is suitable for installation in addition to HIFI.
  • the receiving module 41 is configured to receive the first sound data of the HIFI audio format and the second sound data of the second audio format, where the second audio format is an audio format other than the HIFI;
  • the decoding module 42 is configured to transmit the first sound data of the HIFI audio format to the first processor for decoding, and decode the second sound data of the second audio format into a pulse code modulated PCM format. Second audio data;
  • the converting module 43 is configured to control the first processor to convert the second sound data of the PCM format into the second sound data of the HIFI audio format;
  • the hybrid playing module 44 is configured to mix and play the first sound data and the second sound data in the HIFI audio format.
  • the decoding module decodes the first audio data of the HIFI audio format by using a hard decoding manner; and the decoding module decodes the sound data of the second audio format by using a soft decoding manner.
  • the PCM format is a 48k 16bit PCM format.
  • the hybrid play module 44 includes:
  • a mixing unit configured to mix the first sound data and the second sound data in the HIFI audio format
  • a digital-to-analog conversion unit configured to perform digital-to-analog conversion on the mixed first and second sound mixed data
  • a conveying unit configured to send the converted first and second sound mixing data to the earphone to play.
  • the first processor includes: an ADSP.
  • the device provided in this embodiment has the function of playing the sound data of the non-HIFI format and the sound data of the HIFI format, and can realize the technology of playing other sounds such as the short message prompt sound without interrupting the HIFI music being played. effect.
  • FIG. 5 is a block diagram showing the structure of an apparatus for playing a HIFI sound together by a multi-player according to another embodiment of the present invention.
  • the device 1100 in which the multi-player plays the HIFI sound together may be a host server having a computing capability, a personal computer PC, or a portable computer or terminal that can be carried.
  • the specific embodiments of the present invention do not limit the specific implementation of the computing node.
  • the multi-player device 1100 that plays the HIFI sound together includes a processor 1110, a communication interface 1120, a memory array 1130, and a bus 1140.
  • the processor 1110, the communication interface 1120, and the memory 1130 complete communication with each other through the bus 1140.
  • the communication interface 1120 is configured to communicate with a network element, where the network element includes, for example, a virtual machine management center, shared storage, and the like.
  • the processor 1110 is configured to execute a program.
  • the processor 1110 may be a central processing unit CPU, or an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention.
  • ASIC Application Specific Integrated Circuit
  • the memory 1130 is used to store files.
  • the memory 1130 may include a high speed RAM memory and may also include a non-volatile memory such as at least one disk memory.
  • Memory 1130 can also be a memory array.
  • the memory 1130 may also be partitioned, and The blocks can be combined into virtual volumes according to certain rules.
  • the above program may be program code including computer operating instructions. This program can be used to execute:
  • the first sound data and the second sound data of the HIFI audio format are mixed and played.
  • the first audio data of the HIFI audio format is decoded by using a hard decoding manner; and the sound data of the second audio format is decoded by using a soft decoding manner.
  • the PCM format is a 48k 16bit PCM format.
  • the mixing of the first sound data and the second sound data of the HIFI audio format includes:
  • the converted first and second sound mixing data is sent to the headphone to play.
  • the first processor includes: an audio signal processing chip ADSP.
  • embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
  • the device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located One place, or it can be distributed to multiple networks On the unit. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Telephone Function (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

一种多播放器共同播放高保真声音的方法及装置，涉及多媒体技术领域，解决了现有技术中无法让多个音乐格式同时随HIFI音乐播放出来的技术问题。其中，方法包括：接收到HIFI音频格式的第一声音数据和第二音频格式的第二声音数据，其中，所述第二音频格式为除所述HIFI以外的音频格式；将所述HIFI音频格式的第一声音数据传送到第一处理器解码，以及将所述第二音频格式的第二声音数据解码后转换为脉码编码调制PCM格式的第二音频数据；控制第一处理器将所述PCM格式的第二声音数据转换成所述HIFI音频格式的第二声音数据；将所述HIFI音频格式的第一声音数据和第二声音数据混合后播放。

Description

多播放器共同播放高保真声音的方法及装置
本申请要求在2015年12月18日提交中国专利局、申请号为2015109743644、发明名称为“多播放器共同播放高保真声音的方法及装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本发明涉及多媒体技术领域，尤其涉及一种多播放器共同播放高保真(HIFI，High-Fidelity)声音的方法及装置。
背景技术
目前安卓android系统播放音乐时，如果有tone提示音时，系统会把tone音混合mixer到正在播放的音乐中，然后一起播放出来。此外，还有另外的情况。例如：若后台正在播放音乐的同时，打开一个有背景音乐的网页，此时背景音乐会与后台音乐mixer后一起播出来；这些提示音和第二个播放器之所以可以一起播放出来因为android系统会把所有的音乐多以48k 16bit格式播放，当遇到需要多个声音同时播放时，系统可以直接把相同格式的音乐mixer后从一个通道播放出来。
但是当后台播放HIFI音乐时，tone(48k 16bit格式)音或者第二个播放器要播放的音乐与后台播放的HIFI音乐格式不一定相同，由于无法直接混音，并且此情况下的音频输出设备只有耳机，因此不可能同时播放出两种或者多种不同数据格式的音乐，由此导致了在听HIFI音乐时，会因为tone音和网页等而中断当前正在播放的音乐，影响音乐的正常播放。
发明内容
本发明实施例提供一种多播放器共同播放HIFI声音的方法及装置，用于解决现有技术中无法让多个音乐格式同时随HIFI音乐播放出来的技 术问题。
一方面，本发明的实施例提供了一种多播放器共同播放高保真HIFI声音的方法，包括：
接收到HIFI音频格式的第一声音数据和第二音频格式的第二声音数据，其中，所述第二音频格式为除所述HIFI以外的音频格式；
将所述HIFI音频格式的第一声音数据传送到第一处理器解码，以及将所述第二音频格式的第二声音数据解码后转换为脉码编码调制PCM格式的第二音频数据；
控制第一处理器将所述PCM格式的第二声音数据转换成所述HIFI音频格式的第二声音数据；
将所述HIFI音频格式的第一声音数据和第二声音数据混合后播放。
另一方面，本发明实施例又提供了一种多播放器共同播放高保真HIFI声音的装置，包括：
接收模块，用于接收到HIFI音频格式的第一声音数据和第二音频格式的第二声音数据，其中，所述第二音频格式为除所述HIFI以外的音频格式；
解码模块，用于将所述HIFI音频格式的第一声音数据传送到第一处理器解码；以及将所述第二音频格式的第二声音数据解码后转换为脉码编码调制PCM格式的第二音频数据；
转换模块，用于控制第一处理器将所述PCM格式的第二声音数据转换成所述HIFI音频格式的第二声音数据；
混合播放模块，用于将所述HIFI音频格式的第一声音数据和第二声音数据混合后播放。
本发明实施例提供的上述方案中针对非HIFI格式的声音数据采用先将其转换成PCM格式的声音数据，再转换成HIFI格式，最后将同是HIFI格式的声音数据混合并播放的技术手段，解决了现有技术中不同于HIFI 格式的声音数据无法同HIFI格式的声音数据共同播放出来的技术问题，进而取得了当播放HIFI声音格式时，若有其他格式的声音数据，无需暂停HIFI声音播放便可听到该其他格式的声音数据、HIFI和其他所有格式的音乐可共同播放的技术效果。
下面通过附图和实施例，对本发明的技术方案做进一步的详细描述。
附图说明
附图用来提供对本发明的进一步理解，并且构成说明书的一部分，与本发明的实施例一起用于解释本发明，并不构成对本发明的限制。在附图中：
图1为本发明实施例中提供的一种多播放器共同播放HIFI声音的方法的示例性流程图；
图2为本发明实施例中提供的一种多播放器共同播放HIFI声音的方法的另一示例性流程图；
图3为本发明实施例中提供的一种多播放器共同播放HIFI声音的方法的内部执行示意图；
图4为本发明实施例中提供的一种多播放器共同播放HIFI声音的装置的结构示意图；
图5为本发明实施例中提供的一种多播放器共同播放HIFI声音的装置的结构示意图。
具体实施方式
以下结合附图对本发明的优选实施例进行说明，应当理解，此处所描述的优选实施例仅用于说明和解释本发明，并不用于限定本发明。
如图1所示，本实施例提供一种多播放器共同播放HIFI声音的方法，该方法适合部署在有需求播放HIFI格式的声音和其他不同音频格式的设 备上，如手机等。该方法主要包括：
101，接收到HIFI音频格式的第一声音数据和第二音频格式的第二声音数据。
其中，打开HIFI音乐播放或正在播放HIFI音乐都可以认为是接收到HIFI音频格式的第一声音数据。
其中，本实施例中的第二音频格式可代表除HIFI以外的一种或多种音频格式，如tone音、网页播放的音乐、或其他格式的音乐等。第二声音数据也可以是多种音频格式的声音数据，简而言之，在本实施中由于对第二种音频格式的声音数据的处理方式都相同，因此将除HIFI以外的所有音频格式的声音数据，可能是一种，也可能是多种都统称为第二音频格式的第二声音数据。进一步地，本实施例中的声音数据可以是音乐数据，也可以是一些如说话声等其他的声音。
102，将所述HIFI音频格式的第一声音数据传送到第一处理器解码，以及将所述第二音频格式的第二声音数据解码后转换为脉码编码调制PCM格式的第二音频数据；
可选的实施方案中，将HIFI格式的第一声音数据采用硬解码的方式直接发送到第一处理器进行解码，将第二音频格式的第二声音数据采用软解码的方式进行解码，并将解码后的第二声音数据都转换为PCM格式的。
由于硬解码的方式其功耗要比软解码方式功耗低，所以针对第一声音数据优选采用硬件解码方式播放，但若针对性能比较好的设备或储能能力较强或比较多的设备，则也可以采用软解码的方式对第一声音数据进行解码。
进一步地，考虑到软解码的优点是可以同时实现多路同时解码播放，所以针对第二音频格式的第二声音数据优选采用软解码方式进行解码。同样，若设备具有多个硬解码器，或仅有一种第二格式的声音数据的情况下， 也可以采用硬解码方式对第二格式的声音数据进行解码。
103，控制第一处理器将所述PCM格式的第二声音数据转换成所述HIFI音频格式的第二声音数据；
第一处理器正常对HIFI格式的第一声音数据进行解码，将PCM格式的第二声音数据转换成HIFI格式的。
考虑到HIFI并不是一种固定的音频格式，而是主要指保持音源自身的采样率和位宽播放的音频格式。因此本实施例中的混音处理需要参与混音的音频数据流解码为PCM格式后才可以处理，因此第二声音数据需要先经过解码为PCM格式后，然后根据当前正在播放的第一声音数据源格式重新采样后，再把第一声音与重新采样后的第二声音源进行混音，这样才能实现混合后播放出来的技术效果。
104，将所述HIFI音频格式的第一声音数据和第二声音数据混合后播放。
第一声音数据和第二声音数据经上述102-103的处理后都是HIFI格式，因此可以共同播放出来。
其中，可选方案是将102中的将第二声音数据具体转换48k 16bit PCM格式。需要说明的是tone音解码后即为48k 16bit PCM格式的声音数据，因此无需在转换，而对于其他的音频格式的声音数据，如网页上播放的音乐格式的声音数据则在解码后需要通过重新采样得到48k 16bit PCM格式。
可选方案中，上述104具体可通过如下方式实现：
将所述HIFI音频格式的第一声音数据和第二声音数据进行混合；将混合后的第一和第二声音混合数据进行数模转换；将转换后的第一和第二声音混合数据发送到听筒播放。
由于输出设备只有一个，因此播出的音乐格式只能是一个，如果多个音频流同时播放而不进行混音的情况下，只能保持一路音频流正常播放而 暂停其他音频流。因此现有技术中会因为要播放tone音和网页等而中断当前正在播放的音乐，影响了音乐的正常播放。
本实施例提供的上述方法中，因为考虑到播放提示音或网页自身声音只是为了提醒用户网页的存在或相应的提示信息出现，正常的应用场景下，用户通常也不会去在意同时播放时的音频，所以采用将非HIFI格式的声音数据转换成HIFI格式的声音数据，再混合到HIFI声音数据中播放的技术手段，实现了在欣赏HIFI音乐的同时，也可以同时接收到提示音或网页打开时播放的声音，保证了在多路音源同时混音播放时，仍旧可以做到提醒的技术效果。
可选的，上面描述的实施方式比较适合只有一个输出设备的情况下，若存在多个输出设备时，仍旧可以采用上述方法，具体来说，例如存在两个输出设备时，其中一个用来播放HIFI音频，另一个用来播放其他格式的音频(即上述的第二音频格式的音频数据)，若HIFI音频播放的同时，有第三格式的音频要播放时，可以采用将该第三格式的音频当作上述实施例中的第二音频格式的音频数据处理，让其与HIFI音频同时播放。
如图2所示，本实施例具体结合图3所示的示意图，提供一种多播放器共同播放HIFI声音的方法，该方法包括：
201，手机上的HIFI播放器播放HIFI音乐时选择硬解码方式播放，音频数据流被直接输出到送入音频信号处理芯片ADSP解码；
202，在HIFI播放时，又接收到Tone音要播放，则针对tone播放设置软解码方式播放，音频数据解码为48k 16bit pcm格式后送入混音线程，如audioflinger混音(mixer)线程；
203，后续更多播放采用软解码方式，如网页音乐的声音数据等，均送入audioflinger混音线程；
203，Audioflinger混音线程把所有送入的声音数据重新采样为48k 16bit pcm格式后混合，并送入音频信号处理芯片(ADSP)；
204，ADSP解码HIFI音频格式的声音数据，然后把其他需要输出的pcm格式的声音据全部重新采样为当前正在播放的HIFI音频格式，然后混合后，一并输出到HIFI芯片；
205，HIFI芯片对混合后的声音数据数模采样后，模拟数据送到耳机headset/headphone播放。
本实施例提供的方法可以将HIFI格式的音乐与其他格式的音乐共同播放出来，无需中断正在播放的HIFI格式的音乐，可提高用户的听觉体验。
为了便于上述图1或图2所示的实施例中方法的实现，如图4所示，本实施例继续提供一种多播放器共同播放高保真HIFI声音的装置，该装置适合安装在除HIFI格式外，还需要播放多种音频格式的设备上，如手机等。其包括：
接收模块41，用于接收到HIFI音频格式的第一声音数据和第二音频格式的第二声音数据，其中，所述第二音频格式为除所述HIFI以外的音频格式；
解码模块42，用于将所述HIFI音频格式的第一声音数据传送到第一处理器解码；以及将所述第二音频格式的第二声音数据解码后转换为脉码编码调制PCM格式的第二音频数据；
转换模块43，用于控制第一处理器将所述PCM格式的第二声音数据转换成所述HIFI音频格式的第二声音数据；
混合播放模块44，用于将所述HIFI音频格式的第一声音数据和第二声音数据混合后播放。
其中，所述解码模块对所述HIFI音频格式的第一音频数据采用硬解码方式解码；所述解码模块对第二音频格式的声音数据采用软解码方式解码。
其中，所述PCM格式为48k 16bit PCM格式。
可选地，混合播放模块44包括：
混合单元，用于将所述HIFI音频格式的第一声音数据和第二声音数据进行混合；
数模转换单元，用于将混合后的第一和第二声音混合数据进行数模转换；
输送单元，用于将转换后的第一和第二声音混合数据发送到耳机播放。
可选地，所述第一处理器包括：ADSP。
本实施例提供的装置具有将非HIFI格式的声音数据与HIFI格式的声音数据共同播放的功能，可以实现在不中断正在播放的HIFI音乐的情况下，播放其他的如来短信提示音等声音的技术效果。
图5示出了本发明的另一个实施例的一种多播放器共同播放HIFI声音的装置的结构框图。所述多播放器共同播放HIFI声音的装置1100可以是具备计算能力的主机服务器、个人计算机PC、或者可携带的便携式计算机或终端等。本发明具体实施例并不对计算节点的具体实现做限定。
该多播放器共同播放HIFI声音的装置1100包括处理器(processor)1110、通信接口(Communications Interface)1120、存储器(memory array)1130和总线1140。其中，处理器1110、通信接口1120、以及存储器1130通过总线1140完成相互间的通信。
通信接口1120用于与网元通信，其中网元包括例如虚拟机管理中心、共享存储等。
处理器1110用于执行程序。处理器1110可能是一个中央处理器CPU，或者是专用集成电路ASIC(Application Specific Integrated Circuit)，或者是被配置成实施本发明实施例的一个或多个集成电路。
存储器1130用于存放文件。存储器1130可能包含高速RAM存储器，也可能还包括非易失性存储器(non-volatile memory)，例如至少一个磁盘存储器。存储器1130也可以是存储器阵列。存储器1130还可能被分块，并且所 述块可按一定的规则组合成虚拟卷。
在一种可能的实施方式中，上述程序可为包括计算机操作指令的程序代码。该程序具体可用于执行：
接收到HIFI音频格式的第一声音数据和第二音频格式的第二声音数据，其中，所述第二音频格式为除所述HIFI以外的音频格式；
将所述HIFI音频格式的第一声音数据传送到第一处理器解码，以及将所述第二音频格式的第二声音数据解码后转换为脉码编码调制PCM格式的第二音频数据；
控制第一处理器将所述PCM格式的第二声音数据转换成所述HIFI音频格式的第二声音数据；
将所述HIFI音频格式的第一声音数据和第二声音数据混合后播放。
在一种可能的实现方式中，所述HIFI音频格式的第一音频数据采用硬解码方式解码；所述第二音频格式的声音数据采用软解码方式解码。
在一种可能的实现方式中，所述PCM格式为48k 16bit PCM格式。
在一种可能的实现方式中，将所述HIFI音频格式的第一声音数据和第二声音数据混合后播放包括：
将所述HIFI音频格式的第一声音数据和第二声音数据进行混合；
将混合后的第一和第二声音混合数据进行数模转换；
将转换后的第一和第二声音混合数据发送到耳机播放。
在一种可能的实现方式中，所述第一处理器包括：音频信号处理芯片ADSP。
本领域内的技术人员应明白，本发明的实施例可提供为方法、系统、或计算机程序产品。因此，本发明可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且，本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
前述对本发明的具体示例性实施方案的描述是为了说明和例证的目的。这些描述并非想将本发明限定为所公开的精确形式，并且很显然，根据上述教导，可以进行很多改变和变化。对示例性实施例进行选择和描述的目的在于解释本发明的特定原理及其实际应用，从而使得本领域的技术人员能够实现并利用本发明的各种不同的示例性实施方案以及各种不同的选择和改变。本发明的范围意在由权利要求书及其等同形式所限定。
以上所描述的装置实施例仅仅是示意性的，其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络 单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性的劳动的情况下，即可以理解并实施。

Claims (10)

  1. 一种多播放器共同播放高保真HIFI声音的方法，其特征在于，包括：
    接收到HIFI音频格式的第一声音数据和第二音频格式的第二声音数据，其中，所述第二音频格式为除所述HIFI以外的音频格式；
    将所述HIFI音频格式的第一声音数据传送到第一处理器解码，以及将所述第二音频格式的第二声音数据解码后转换为脉码编码调制PCM格式的第二音频数据；
    控制第一处理器将所述PCM格式的第二声音数据转换成所述HIFI音频格式的第二声音数据；
    将所述HIFI音频格式的第一声音数据和第二声音数据混合后播放。
  2. 根据权利要求1所述的方法，其特征在于，所述HIFI音频格式的第一音频数据采用硬解码方式解码；所述第二音频格式的声音数据采用软解码方式解码。
  3. 根据权利要求1或2所述的方法，其特征在于，所述PCM格式为48k 16bit PCM格式。
  4. 根据权利要求1或2所述的方法，其特征在于，将所述HIFI音频格式的第一声音数据和第二声音数据混合后播放包括：
    将所述HIFI音频格式的第一声音数据和第二声音数据进行混合；
    将混合后的第一和第二声音混合数据进行数模转换；
    将转换后的第一和第二声音混合数据发送到耳机播放。
  5. 根据权利要求1或2所述的方法，其特征在于，所述第一处理器包括：音频信号处理芯片ADSP。
  6. 一种多播放器共同播放高保真HIFI声音的装置，其特征在于，包括：
    接收模块，用于接收到HIFI音频格式的第一声音数据和第二音频格式的第二声音数据，其中，所述第二音频格式为除所述HIFI以外的音频格式；
    解码模块，用于将所述HIFI音频格式的第一声音数据传送到第一处理器解码；以及将所述第二音频格式的第二声音数据解码后转换为脉码编码调制PCM格式的第二音频数据；
    转换模块，用于控制第一处理器将所述PCM格式的第二声音数据转换成所述HIFI音频格式的第二声音数据；
    混合播放模块，用于将所述HIFI音频格式的第一声音数据和第二声音数据混合后播放。
  7. 根据权利要求6所述的装置，其特征在于，所述解码模块对所述HIFI音频格式的第一音频数据采用硬解码方式解码；所述解码模块对第二音频格式的声音数据采用软解码方式解码。
  8. 根据权利要求6或7所述的装置，其特征在于，所述PCM格式为48k 16bit PCM格式。
  9. 根据权利要求6或7所述的装置，其特征在于，混合播放模块包括：
    混合单元，用于将所述HIFI音频格式的第一声音数据和第二声音数据进行混合；
    数模转换单元，用于将混合后的第一和第二声音混合数据进行数模转换；
    输送单元，用于将转换后的第一和第二声音混合数据发送到耳机播放。
  10. 根据权利要求6或7所述的装置，其特征在于，所述第一处理器包括：ADSP。
PCT/CN2016/088552 2015-12-18 2016-07-05 多播放器共同播放高保真声音的方法及装置 Ceased WO2017101327A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/247,811 US20170178636A1 (en) 2015-12-18 2016-08-25 Method and electronic device for jointly playing high-fidelity sounds of multiple players

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510974364.4A CN105913860A (zh) 2015-12-18 2015-12-18 多播放器共同播放高保真声音的方法及装置
CN201510974364.4 2015-12-18

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/247,811 Continuation-In-Part US20170178636A1 (en) 2015-12-18 2016-08-25 Method and electronic device for jointly playing high-fidelity sounds of multiple players

Publications (1)

Publication Number Publication Date
WO2017101327A1 true WO2017101327A1 (zh) 2017-06-22

Family

ID=56744264

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/088552 Ceased WO2017101327A1 (zh) 2015-12-18 2016-07-05 多播放器共同播放高保真声音的方法及装置

Country Status (3)

Country Link
US (1) US20170178636A1 (zh)
CN (1) CN105913860A (zh)
WO (1) WO2017101327A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106412767B (zh) * 2016-11-29 2020-03-31 维沃移动通信有限公司 一种混音方法和混音电路
CN106782578B (zh) * 2016-12-06 2020-09-01 瑞安市海达服饰有限公司 一种分布式解码控制器、分布式解码方法及音频终端
CN111755017B (zh) * 2020-07-06 2021-01-26 全时云商务服务股份有限公司 云会议的音频录制方法、装置、服务器及存储介质
CN115729510A (zh) * 2021-09-01 2023-03-03 北京小米移动软件有限公司 音频播放方法、音频播放装置及计算机可读存储介质
CN114339388B (zh) * 2021-12-07 2024-09-10 海信视像科技股份有限公司 一种音频输出模式的控制方法及装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1738320A (zh) * 2005-07-04 2006-02-22 惠州Tcl移动通信有限公司 一种在通话过程中播放音乐的手机及其方法
US20070123192A1 (en) * 2005-11-26 2007-05-31 David Sinai Audio device and method
CN101911662A (zh) * 2007-11-21 2010-12-08 高通股份有限公司 将音频与铃声数据混合的方法及系统
CN102355309A (zh) * 2011-08-09 2012-02-15 中兴通讯股份有限公司 一种支持多种采样率的蓝牙立体声的实现方法和装置
CN102572588A (zh) * 2011-12-14 2012-07-11 中兴通讯股份有限公司 一种实现机顶盒混音的方法及装置
CN103077003A (zh) * 2012-12-27 2013-05-01 中兴通讯股份有限公司 一种HiFi音频输出方法、装置和系统

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101697644A (zh) * 2009-10-29 2010-04-21 青岛海信移动通信技术股份有限公司 移动终端的输出混音方法及相关装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1738320A (zh) * 2005-07-04 2006-02-22 惠州Tcl移动通信有限公司 一种在通话过程中播放音乐的手机及其方法
US20070123192A1 (en) * 2005-11-26 2007-05-31 David Sinai Audio device and method
CN101911662A (zh) * 2007-11-21 2010-12-08 高通股份有限公司 将音频与铃声数据混合的方法及系统
CN102355309A (zh) * 2011-08-09 2012-02-15 中兴通讯股份有限公司 一种支持多种采样率的蓝牙立体声的实现方法和装置
CN102572588A (zh) * 2011-12-14 2012-07-11 中兴通讯股份有限公司 一种实现机顶盒混音的方法及装置
CN103077003A (zh) * 2012-12-27 2013-05-01 中兴通讯股份有限公司 一种HiFi音频输出方法、装置和系统

Also Published As

Publication number Publication date
CN105913860A (zh) 2016-08-31
US20170178636A1 (en) 2017-06-22

Similar Documents

Publication Publication Date Title
US10097902B2 (en) System and method for using multiple audio input devices for synchronized and position-based audio
WO2020063146A1 (en) Data transmission method and system, and bluetooth headphone
US9501259B2 (en) Audio output device to dynamically generate audio ports for connecting to source devices
US20170286055A1 (en) Method and Apparatus for Audio Mixing and Playing
US8930590B2 (en) Audio device and method of operating the same
KR20210130789A (ko) 블루투스 장치 동작 방법
US10812423B2 (en) Method, apparatus, system, and non-transitory computer readable medium for chatting on mobile device using an external device
CN107005800B (zh) 音频文件的传输、接收方法及装置、设备及其系统
CN102932567B (zh) 终端和音频处理方法
CN102568513B (zh) 一种音频数据处理方法和交互方法
CN105679345B (zh) 一种音频处理方法及电子设备
WO2017101327A1 (zh) 多播放器共同播放高保真声音的方法及装置
CN109862475A (zh) 音频播放设备及方法、存储介质、通信终端
US11120808B2 (en) Audio playing method and apparatus, and terminal
KR20240042430A (ko) 오디오 싱크 장치로의 멀티-소스 오디오 브로드캐스트
US9332370B2 (en) Method and apparatus for using spatial audio rendering for a parallel playback of call audio and multimedia content
CN111049709B (zh) 一种基于蓝牙的互联音箱控制方法、设备及存储介质
WO2017185602A1 (zh) 一种耳机模式切换方法和电子设备
US20160111093A1 (en) Efficient load sharing and accelerating of audio post-processing
US9271079B2 (en) Data processing method and electronic device
CN110868621A (zh) 一种音频播放方法、装置、设备及计算机可读介质
CN113360117A (zh) 电子设备的控制方法、装置、终端和存储介质
CN116017312A (zh) 一种数据处理方法及电子设备
WO2015109844A1 (zh) 便携式宽带无线装置
US11922234B2 (en) Multi-agent ring-buffer

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16874390

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16874390

Country of ref document: EP

Kind code of ref document: A1