ES2356277T3 - AUDIO MANAGEMENT IN A DOUBLE PROCESSOR ENVIRONMENT. - Google Patents

Abstract

In a dual processor mobile device one processor being a radio processor and one processor being an application processor, the mobile device further comprising a polyphonic audio chip, a method of audio control. The method comprisies the steps of: connecting the polyphonic audio chip between the controller and a highly integrated audio codec having a voice codec, a multiplexer and an amplifier; connecting the radio processor to the highly integrated audio codec; controlling the highly integrated audio codec from the radio processor; and synchronizing the application processor and the radio processor by having the application processor control the highly integrated audio codec through the radio processor. The synchronizing step sends all control commands from the application processor through the radio processor, where the radio processor receives the commands and generates an appropriate command to the highly integrated audio codec.

Description

The present application relates generally to audio functionality in a dual processor wireless device, and more specifically to a method and apparatus for controlling audio output in a dual processor wireless device.

Mobile or wireless devices are increasingly being used for a variety of tasks. These 5 tasks may require different hardware and configurations in order to be executed more efficiently, and in some cases the different hardware is made up of several processors that have specialized tasks. For example, a processor can be used to run user applications, while a second processor can be used to control the radio and voice path on the mobile device.

In multiprocessor environments where the audio path can be generated from either a 10-application processor (controller processor) or a radio processor, a complex series of tasks is necessary to generate the output of audio in one of a plurality of audio outputs. This is further complicated if additional hardware such as an audio chip is added, referred to herein as a music chip. With the previous dual processor configuration, the music chip is controlled by the application processor. fifteen

The audio source with the previous configuration can be either the music chip or a voice codec. In this case, it is necessary to amplify the analog output of the musical chip before sending it through a multiplexer to choose between the musical chip and the output of the voice codec chip. Once multiplexed, the audio can go to the output, such as a speaker, headphones, a handset, Bluetooth ™ or any other audio output of this type. This requires considerable hardware and coordination in the audio output. twenty

Document US2005 / 0136992 discloses an auxiliary hardware device that can be shared between two processors in a mobile device, for example, to reduce power consumption. As an example, the auxiliary hardware device may be a codec. Processors can have an interface to independently access the auxiliary hardware device. As a consequence, it may be unnecessary to activate both processors to access the shared auxiliary hardware device. 25

A publication entitled "Cellular Handset Audio Revolution - pt3", by Kenneth Boyce, Audio Design Line, August 29, 2005, discloses a synthesizer with an output to an audio subsystem. The synthesizer is controlled by an analog baseband processor.

GENERALITIES

The present method and apparatus overcome the shortcomings of the prior art by providing a highly integrated audio codec within the dual processor environment. Highly integrated audio codec (HIAC) control is achieved through the radio processor. In addition, user applications can assume control of the audio output through control signals between the application processor and the radio processor. The ordering of these control signals is important to ensure that unwanted noise is avoided. 35

The use of an HIAC integrated circuit can provide flexibility and savings by ensuring that amplifier circuits, as well as audio path control circuits, can be used for input from both a music chip and a radiocommunication processor.

Therefore, the present application provides an audio control method for a dual processor mobile device as indicated in claim 1. Advantageous features are provided in the preceding claims.

A mobile device according to claim 9 is also provided. Advantageous features are provided in the dependent claims thereof.

A computer program product according to claim 17 is also provided. A wireless communication system according to claim 18. is also provided.

BRIEF DESCRIPTION OF THE DRAWINGS

The present application will be better understood in reference to the drawings, in which:

Figure 1 is a block diagram of an audio path showing the problems associated with having two audio sources or input that propagate to a multitude of audio output sources;

Figure 2 shows a block diagram of a preferred embodiment of the present apparatus; fifty

Figure 3 shows an alternative embodiment in which a Bluetooth ™ chip is added to the form of

embodiment of Figure 2;

Figure 4 shows a block diagram of an illustrative mobile device incorporating the present method and apparatus; Y

Figure 5 is a state diagram showing several states according to the present method.

DESCRIPTION OF PREFERRED EMBODIMENTS 5

Reference is now made to Figure 1. Mobile devices include a variety of chips to accommodate the various functionalities that are required of the mobile device. In data devices, it is sometimes preferable to include dual processors, in which a first processor is used for digital signal processing and communication by interface with the radiocommunication circuitry in the mobile device. The second processor is preferably an application processor that is used to run several user applications. 10

In one embodiment, other chips can also be added for specialized purposes. For example, a polyphonic audio chip, referred to in the art as a music chip, can be used to play a file of the musical instrument digital interface (MIDI) format, WAV files, certain voice files, MP3 files, advanced audio coding files (AAC) or other types of audio files known to those skilled in the art. fifteen

Referring to Figure 1, an application processor 10 controls the music chip 12. This is a preferred embodiment, since many of the applications that require the processing of the music chip would run on the application processor 10.

A second processor, referred to herein as radiocommunication processor 14, is used to control the voice path and radiocommunications. Preferably, the radio processor 14 20 includes a DSP and interacts with a voice codec 15 as illustrated in Figure 1.

As those skilled in the art will appreciate, a voice call will generally be processed by the radio processor 14 and the audio output of this call will proceed to various output sources such as a speaker 16, a headset 18 or a speaker 20 of a handset.

The problem with the above situation is that the analog output of the music chip 12 also needs to go to the speaker 16, the handset 18 or the handset 20. To achieve this, the solution of Figure 1 shows that the music output is sent in first through an amplifier 30, 32 or 34 and towards a multiplexer 36, 38 or 40. In the multiplexer 36, 38 or 40 the signal is multiplexed with the signal from the radiocommunication processor 14 to determine which signal is to be output to speaker 16, headset 18 or handset 20.

Thus, the solution of Figure 1 requires three independent audio amplifiers and three multiplexers to be multiplexed with the voice codec. Thus, this is an expensive solution and does not allow a simple extension of the circuit for additional audio inputs or outputs.

Reference is now made to Figure 2. Figure 2 shows a preferred embodiment of the present apparatus. In Figure 2, the application processor 10 interacts with the music chip 12 to produce an analog output that is sent to a highly integrated audio codec 50 (HIAC 50). The HIAC 50 provides a variety of functionalities including a voice codec, as well as a multiplexer and amplifier, all built into the same chip.

The radio processor 14 also provides a digital input to the HIAC 50.

As will be appreciated by those skilled in the art, to ensure that control of the audio path is maintained and that noise is reduced or eliminated, a synchronization between the processor 10 of 40 applications and the processor 14 of the processor is necessary. Radiocommunications

In the preferred embodiment of Figure 2, the radio processor 14 includes a control line 52 for controlling the serial interface for peripherals ™ (SPI) of the HIAC 50. It can be used to send instructions such as HIAC 50 which line to use as audio input, which line to use as audio output, volume control instructions, as well as other instructions known in the art. Four. Five

As will be appreciated, an alternative embodiment allows the application processor 10 to have the main control of HIAC 50, and the present application is not intended to be limited to a chip that has HIAC 50 control over the other.

In order for the application processor 10 to give control over an audio output such as the speaker 16, the handset 18 or the handset 20 to a music chip 12, it is necessary that synchronization occurs between the application processor 10 and the Radiocommunication processor 14. This is achieved through a communications link 60.

In a preferred embodiment, the communication link 60 acts as a modem. AT commands can be sent between the application processor 10 and the radio processor 14. Those skilled in the art will note that AT orders are not the only form of communication that could be used, but instead any form of communication between processors could be used, and in this case AT orders are used only as an example. . These commands may indicate to the radio processor that the application processor wishes to take control of the HIAC 50 to send audio out, control the volume, select the audio output hardware, or that the application processor has terminated the HIAC fifty.

In an example situation, a user wishes to perform a function that requires the music chip 12 to output a sound to the speaker 16. To achieve this, the application processor 10 sends an AT command to the radio processor 14 which first place switches the output path to speaker 16. 10

Once the application processor 10 receives a confirmation that the output path has been switched to the speaker 16, then the application processor 10 switches the audio input for the HIAC 50 so that it is from the music chip 12 This can be done by identifying an external input source on the HIAC 50 to be the location from which the HIAC 50 should receive its audio stream.

Once the radiocommunication processor 14 receives the order to switch the audio path, it then sends the appropriate order to HIAC 50 to use the audio stream of the music chip 12.

The above can be summarized by sending the following by the processor:

AT + OUTPUT This switches the exit path to a perimeter specified in this order.

AT + MULTIMEDIA = 1, “EXT: O” This changes the source in HIAC 50 to be external port 0 and 20 tells HIAC 50 to reproduce what is found in external source 0.

Once the Musical 12 chip has finished playing any audio that is required by the application processor 10, then the application processor 10 can tell the radio processor 14 to stop playing. This can be sent with an order such as AT + MULTIMEDIA = 0, in which this order tells HIAC 50 to stop playing. 25

As those skilled in the art will appreciate, in some cases it may be necessary for the audio being played at that time to be interrupted by other audio. For example, if a phone call is received while the music chip 12 is playing audio, it may be necessary to stop the audio source of the music chip 12. In this case, a stop order can be sent from the application processor 10 to the processor 14 radiocommunications before specifying the new audio source and issuing a start order. 30

The above sequence is also important. If the path is not switched before a source is specified, then the audio output may create a noise such as a "pop." This situation is not desirable and therefore should be avoided. Thus, it is important first to switch the audio path and then to switch the source.

Other orders that may be important between the application processor 10 and the radio processor 14 include a volume control. As those skilled in the art will appreciate, the volume 35 can be controlled either on the music chip 12 or on the HIAC 50. If it is controlled on the HIAC 50, then an order can be sent from the processor 10 of applications such as AT + VOLUME to radiocommunication processor 14, which can then use control line 52 to control volume output from HIAC 50.

The output of the radiocommunication processor 14 is digital and if this source is to be used, the HIAC 50 can be properly configured using a control line 52.

Thus, the illustrative orders to the radio processor 14 from an application processor 10 could be:

1. Switching of pre-Musical audio output

AT + AUDIT OUTPUT = x 45

(x = 2-Speaker, 3-Headset, 4-Handset and 5-Headset BlueTooth)

2. Pre-Musical audio volume setting

AT + VOLUME = x, y

(x has the same definition as the previous one in stage 1 and y is between 0 and 7)

3. Switching the pre-Musical audio source to musical and changing gain settings

AT + OUTPUT = 2 (in case the above has not been fixed)

AT + GAIN = MEDIA = 0,0,10,13,13,0,0

0-Table number and currently 0 is used

0- not used in Warbler 5

10- Speaker gain

13- Earphone gain

13- Gain of the handset

0- BlueTooth earphone gain

0- Gain of the Kit for Bluetooth cars 10

4. Send AT request to the patriot to play melody

AT + MULTIMEDIA = 1, ”EXT: 0”

5. Send AT request to patriot to switch audio source to patriot

AT + MULTIMEDIA = 0

6. Post-musical audio input switching and volume setting 15

AT + OUTPUT = = (the same as before the melody was played)

AT + VOLUME = x, y

The foregoing is not intended to be limiting. Several numbers of audio outputs may be available. Three audio outputs are illustrated simply for convenience and several other audio outputs may be possible.

Reference is now made to Figure 3. If the user also wishes to use a Bluetooth ™ chip to provide additional audio output, this can be achieved by adding a Bluetooth ™ 70 chip as seen in Figure 3. The components The remaining ones in Figure 3 are identical to those in Figure 2 and similar numbering is used.

The Bluetooth ™ 70 chip can receive an audio input either from the radiocommunication processor 14 or in the form of an audio output independent of HIAC 50. 25

The foregoing therefore provides a single HIAC 50 that replaces multiple amplifiers and multiplexers. The HIAC 50 also provides multiple audio channels. The foregoing also provides synchronization between a multiprocessor environment in which one processor is an application processor and therefore controls user applications, and the other is a radiocommunication processor in which voice audio can be processed and can be given. output to said audio from it. 30

Reference is now made to Figure 4. Figure 4 is a block diagram illustrating a mobile station that includes preferred embodiments of the apparatus and the method of the present application. Station 100 is preferably a wireless and bidirectional communication device.

The mobile station 100 incorporates a communications subsystem having both a receiver 112 and a transmitter 114, as well as associated components such as one or more antenna elements 116 and 118, preferably incorporated or internal, local oscillators (LOs) 113, and a processing module such as a digital signal processor (DSP) 120.

As will be apparent to those experts in the field of communications, the particular design of the communications subsystem will depend on the communications network in which the device is intended to operate. 40

When the required procedures for registering or activating the network have been completed, the mobile station 100 can send and receive communications signals through the network 119. The signals received by the antenna 116 through the communications network 119 are input at receiver 112, which can perform common functions of the receivers such as signal amplification, frequency down conversion, filtering, channel selection and the like, and in the system of the example shown in Figure 4, an analog to digital conversion (A / D). The 45 A / D conversion of a received signal allows more complex communication functions such as DSP 120 to be performed.

demodulation and decoding.

In a similar way, the signals to be transmitted are processed, including for example modulation and coding, by the DSP 120 and are introduced into the transmitter 114 for digital to analog conversion, up frequency conversion, filtering, amplification and transmission through the communication network 119 via the antenna 118. The DSP 120 not only processes communications signals, but also provides control of the receiver and the transmitter. For example, the gains applied to the communications signals in the receiver 112 and the transmitter 114 can be adaptively controlled through automatic gain control algorithms implemented in the DSP 120.

The mobile station 100 preferably includes a radiocommunication processor 111 and a microprocessor 138, which jointly control the overall operation of the device. The DSP 120 is located in the radiocommunication processor 111. The communication functions are performed through the radiocommunication processor 111.

Radiocommunication processor 111 interacts with receiver 112 and transmitter 114, and also with flash memory 162, random access memory (RAM) 160, subscriber identity module 164, and a highly integrated audio codec 165 ( HIAC 165). fifteen

A headset 168, a speaker 170, and a handset 172 and a Bluetooth ™ 167 chip all interact through the HIAC 165.

Application processor 138 interacts with subsystems of additional devices such as display 122, flash memory 140, random access memory (RAM) 136, auxiliary input / output (I / O) subsystems 128, serial port or USB 130, keyboard 132, button 134 of the push-to-talk type, other 20 communications 142 and other device subsystems generally designated with reference 144.

Some of the subsystems shown in Figure 4 perform functions related to communications, while other subsystems may provide "resident" or available functions on the device. Especially, some subsystems, such as, for example, keyboard 132 and screen 122, can be used for both communication-related functions, such as the introduction of a text message for transmission via a communications network, as for functions resident in devices, such as a calculator or a task list.

The software used by the radio processor 111 and application processor 138 is preferably stored in persistent storage media such as flash memory 140 and 162, which may alternatively be a read-only memory (ROM) or a storage element similar (not shown 30). Those skilled in the art will appreciate that the operating system, specific device applications, or portions thereof, can be temporarily loaded into volatile memory such as RAM 136 and RAM 160. RAM signals 136 can also store signals from Communications received

As shown, flash memory 140 can be divided into different areas for computer programs 146, device status 148, address book 150, other personal information management (PIM) 152 and other functionality generally designated as 154 These different types of storage indicate that each program can allocate a portion of flash memory 140 for its own data storage requirements. In addition to its operating system functions, the application processor 138 preferably enables the execution of software applications in the mobile station.

For voice communications, the overall operation of the mobile station 100 is similar, except that the 40 received signals would preferably be output to a speaker 170 or headset 168 and the signals for transmission would be generated by a microphone 172. In the station Mobile 100 can also implement alternative voice or audio I / O subsystems, such as a voice message recording subsystem. In addition, the speaker 170 could be either a speaker to be used, for example, with hands-free operation or conference calls, or it could be the speaker of a handset that a user could approach his ear. Four. Five

The serial or USB port 130 in Figure 4 would normally be implemented in a mobile personal assistant type (PDA) mobile station, for which synchronization with a user's desktop computer (not shown) may be desirable, although it is a component Optional device. A port or USB 130 of this type would allow a user to set preferences through an external device or software application and expand the capabilities of the mobile station 100 by providing downloads of information or software to the mobile station 100 50 through a means different from a wireless communications network. The alternative download path can be used, for example, to load an encryption key into the device through a direct and therefore reliable and reliable connection in order to enable secure communication of the device.

Other communications subsystems 144, such as a short-range communications subsystem, are an additional optional component that can provide communication between the mobile station 100 and 55 different systems or devices, which do not have to be similar devices. For example, subsystem 144

it can include an infrared device and associated circuits and components or a Bluetooth ™ communications module to provide communication with similarly enabled systems and devices.

Alternatively, the Bluetooth ™ communication module could be the module 167 that communicates with the HIAC 165 and that receives control from the control application processor 138.

A music chip 169 interacts with the HIAC 165 and is further controlled by the processor 5 of 5 applications, as described above.

Reference is now made to Figure 5. Figure 5 shows a state diagram for various states corresponding to the music chip. The music chip originally begins in the initial musical state 510. If a playback request event is made from a control application processor, the music chip sends a playback request event (AC_SOLICITUD_REPRODUCCIÓN) 512. The music chip continues 10 towards a state 514 Pending Musical Reproduction.

The musical chip will remain in the pending playback state until the confirmation of the playback request is received on said musical chip. Once the confirmation 516 reproduction event has been received, the chip then proceeds to a 518 State of Musical Reproduction.

In State 518 of musical reproduction, the audio introduced in HIAC 50 comes from musical chip 12, as 15 can best be seen in Figure 2. Once the musical chip finishes playing the file being played, a event request 520 stop. The stop request event causes the music chip to proceed to a Pending Stop Status 522 until a Stop Confirmation Event 524 is received.

Once the Stop Confirmation Event has been received, the music chip continues back to 20 an Initial Musical Status 510 and waits for the next request for playback.

As those skilled in the art will appreciate, the stop request event 520 can also be generated when disputing audio sources require an audio source to anticipate the current music reproduction status.

The above describes an Audio Status Machine. As will be appreciated, the finite state radiocommunication machine can influence the above.

The above-described embodiments of the present application are intended to be illustrative of preferred embodiments and are not intended to limit the scope of the present application. There are several modifications, which will be clearly evident to a person skilled in the art, intended to be included within the scope of this application. The only limitations to the scope of the present application are set forth in claims 30 attached thereto.

Claims (18)

1. An audio control method for a dual processor mobile device (100) having a radiocommunication processor (14; 111) and an application processor (10; 138), the mobile device also including a chip (12; 169) of polyphonic audio, the polyphonic audio chip communicating with both the application processor and a highly integrated audio codec (50; 165) that has a voice codec, a multiplexer and an amplifier, 5 communicating the radio processor with the highly integrated audio codec, the method comprising the steps of: control the highly integrated audio codec from one of the application processor and the radiocommunication processor, characterized by: synchronize the application processor and the radiocommunication processor by sending orders through a communication link (60) between the application processor (10; 138) and the radiocommunication processor (14; 111), indicate to the radio processor (14; 111) the orders that the application processor (10; 138) wishes to take control of the highly integrated audio codec (50; 165) or that the application processor is made with the codec of highly integrated audio (50; 165). fifteen 2. The method of claim 1, wherein the sending of orders comprises an order specifying the audio input source in the highly integrated audio codec (50; 165). 3. The method of claim 1 or claim 2, wherein the sending of orders comprises an order to tell the highly integrated audio codec (50; 165) to accept and process the audio from the audio input source . twenty 4. The method of any one of claims 1 to 3, wherein sending orders comprises specifying the destination of audio output to the highly integrated audio codec (50; 165). 5. The method of any one of claims 1 to 4, wherein sending orders comprises specifying the output volume to the highly integrated audio codec (50; 165). 6. The method of claim 4 or claim 5, wherein sending orders first sends the order specifying the destination of the audio output before sending orders specifying the source of audio input and Accept and process the audio from the audio input source. 7. The method of any of claims 1 to 6, wherein the step of sending orders involves sending orders by modem. 8. The method of claim 4, wherein the destination of the audio output comprises any of a speaker (16; 170), a handset (20; 172), a headset (20; 168) and / or a Bluetooth ™ output (70; 167). 9. A mobile device (100) that has improved audio management, the mobile device comprising: a radio subsystem (112, 113, 114, 116, 118) adapted to communicate with a network (119); a radiocommunication processor (14; 111) having a digital signal processor (120) and adapted to interact with said radiocommunication subsystem; an application processor (10; 138) adapted to execute user applications, the application processor also being adapted to interact with memory (136, 140), a screen (122) and a keyboard (132); a highly integrated audio codec (50; 165) having a voice codec, a multiplexer and an amplifier, 40 adapted to interact with media (16, 18, 20, 70; 167, 168, 170, 172) output audio and further adapted to interact with said radiocommunication processor; a polyphonic audio chip (12; 169) adapted to communicate with said application processor and said highly integrated audio codec; Y characterized in that it also includes 45 a communication link (60) between the application processor and the radiocommunication processor, said communication link being adapted to allow synchronization of said application processor and said radiocommunication processor by sending orders through said communication link between the processor of applications and the radiocommunication processor, indicating to the radiocommunication processor (14; 111) the orders that the application processor 50 (10; 138) want to take control of the highly integrated audio codec (50; 165) or that the application processor is made with the highly integrated audio codec (50; 165). 10. The mobile device (100) of claim 9, wherein said audio output means comprises any one or a combination of a speaker (16; 170), a handset (20; 172), a headset (18 ; 168) and / or a Bluetooth ™ output (70; 167). 5 11. The mobile device (100) of claim 9 or claim 10, wherein the order specifies the audio input source in the highly integrated audio codec (50; 165). 12. The mobile device (100) of any one of claims 9 to 11, wherein the order sent through said communication link (60) specifies the highly integrated audio codec (50; 165) that accepts and processes The audio from the audio input source. 10 13. The mobile device (100) of any one of claims 9 to 12, wherein the order sent through said communication link (60) specifies the destination of the audio output for the highly integrated audio codec ( 50; 165). 14. The mobile device (100) of any one of claims 9 to 13, wherein the order sent through said communication link (60) specifies the output volume for the highly integrated audio codec (50; 165). 15. The mobile device (100) of claim 14, wherein a first order specifies the destination of the audio output before a second order specifies the audio input source and accepts and processes the audio from the audio source. audio input 16. The mobile device (100) of any of claims 9 to 15, wherein the communication link (60) uses modem communications. 17. A computer program product for controlling audio in a dual processor mobile device (100) having a processor as a radiocommunication processor (14; 111) and a processor as an application processor (10; 138), further comprising the mobile device a polyphonic audio chip (12; 169), the computer program product comprising a computer-readable medium or support (140) that materializes 25 program code means for implementing in the mobile device the method of any one of claims 1 to 8. 18. A wireless communication system comprising a plurality of mobile devices (100) according to any one of claims 9 to 16.