WO2017215158A1

WO2017215158A1 - Communication terminal sound processing control method, device and communication terminal

Info

Publication number: WO2017215158A1
Application number: PCT/CN2016/101802
Authority: WO
Inventors: 盛光辉
Original assignee: 中兴通讯股份有限公司
Priority date: 2016-06-17
Filing date: 2016-10-11
Publication date: 2017-12-21
Also published as: CN107517302A

Abstract

Provided in embodiments of the present invention are a communication terminal sound processing control method, device and communication terminal, capable of acquiring a current orientation of a speaker unit on a communication terminal, and then determining whether a current operation mode of the speaker unit matches the current orientation thereof; when there is no match, the operation mode of the speaker unit is updated according to the current orientation of the speaker unit. Therefore, the embodiments of the present invention may achieve the corresponding adjustment of the operation mode of the communication terminal speaker unit according to the current orientation of the communication terminal, so as to achieve optimized sound effect for the communication terminal as much as possible, thereby enhancing user experience satisfaction.

Description

Communication terminal sound processing control method, device and communication terminal

Technical field

The present invention relates to the field of terminal control, and in particular, to a communication terminal sound processing control method, apparatus, and communication terminal.

Background technique

At present, mobile smart terminals such as mobile phones are becoming more powerful and portable, and people are increasingly dependent on terminals. There are more and more scenes using terminal playback and recording and recording. Therefore, the requirements for the stereoscopic effect of the terminal sound are getting higher and higher. Therefore, the existing terminal sets two speakers, four speakers or even more than four speakers to restore the stereo effect of the scene as much as possible. However, in the existing terminal, the configuration of the working mode of the speaker on the terminal is fixed. When the user wants to change, the channel switching module or other function module must be activated to enter the corresponding sound switching interface to manually change the The working mode of each speaker is set, and many ordinary users do not know how to change the working mode manually or do not know how to change the working mode of the speaker. When the user uses the terminal, the terminal is often rotated or flipped according to different usage habits, or the terminal is rotated or flipped according to different usage scenarios, so that the orientation of the speaker on the terminal changes, and the existing terminal cannot follow the orientation of the speaker on the terminal. The change automatically changes the working mode of the speaker, resulting in the sound played by the terminal not achieving the best effect, reducing the satisfaction of the user experience.

Summary of the invention

The communication terminal sound processing control method, device and communication terminal provided by the embodiments of the present invention mainly solve the technical problem that the working mode of the speaker cannot be automatically changed when the speaker orientation change on the existing terminal is solved, and the sound effect of the terminal is played. The problem of not achieving the best results and low user experience satisfaction is low.

To solve the above technical problem, an embodiment of the present invention provides a voice processing control method for a communication terminal, including:

Obtaining an orientation of a speaker unit on the communication terminal;

When it is determined that the current working mode of the speaker unit does not match the current location, the operating mode of the speaker unit is correspondingly updated according to the current location of the speaker unit.

In order to solve the above technical problem, an embodiment of the present invention further provides a communication terminal sound processing control apparatus, including:

a speaker position detecting module configured to acquire an orientation of a speaker unit on the communication terminal;

The speaker control module is configured to, when determining that the current working mode of the speaker unit does not match the current orientation, update the working mode of the speaker unit according to the current orientation of the speaker unit.

In order to solve the above technical problem, an embodiment of the present invention further provides a communication terminal, including the communication terminal sound processing control apparatus as described above.

The embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the foregoing communication terminal sound processing control method.

The beneficial effects of the invention are:

The communication terminal sound processing control method, apparatus, communication terminal and computer storage medium provided by the embodiment of the present invention can acquire the current orientation of the speaker unit on the communication terminal, and then determine whether the current working mode of the speaker unit matches its current location. When matching, the operating mode of the speaker unit is updated correspondingly according to the current orientation of the speaker unit. Therefore, the embodiment of the present invention can implement corresponding adjustment of the working mode of the speaker unit of the communication terminal according to the current location of the communication terminal, so as to maximize the sound effect played by the communication terminal and improve the satisfaction of the user experience.

DRAWINGS

1 is a sound processing control of a communication terminal based on a speaker unit according to Embodiment 1 of the present invention; Method flow diagram;

2 is a schematic flowchart of determining whether a working mode of a speaker unit matches a current location in the first embodiment of the present invention;

3 is a schematic flowchart of a sound processing control method of a communication terminal based on a microphone unit according to Embodiment 1 of the present invention;

4 is a schematic flowchart of determining whether a working mode of a microphone unit matches a current location in the first embodiment of the present invention;

5 is a schematic structural diagram of a sound processing control apparatus for a communication terminal according to Embodiment 2 of the present invention;

6 is a schematic structural diagram of another communication terminal sound processing control apparatus according to Embodiment 2 of the present invention;

7 is a schematic diagram of setting a microphone and a speaker of a communication terminal according to Embodiment 2 of the present invention;

8 is a schematic structural diagram of a sound processing control apparatus of the communication terminal of FIG. 7;

9 is a schematic diagram of a sound processing control process of the communication terminal in FIG. 7;

10 is a schematic diagram of calculating coordinates of the orientation of the communication terminal in FIG. 7;

11 is a schematic diagram of the communication terminal of FIG. 7 after being rotated by more than 180 degrees;

12 is a schematic diagram of setting left and right channels after the communication terminal of FIG. 11 rotates by more than 180 degrees;

Figure 13 is a schematic view of the communication terminal of Figure 7 after being rotated by 30°;

Figure 14 is a schematic view of the communication terminal of Figure 7 after being rotated by 90°;

Figure 15 is a schematic view of the communication terminal of Figure 7 after being rotated by 160°;

FIG. 16 is a schematic diagram of the communication terminal of FIG. 7 rotated by 180 degrees.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts are protected by the present invention. range.

Embodiment 1:

In this embodiment, the current orientation of the speaker unit and/or the microphone unit on the communication terminal can be detected, and the working mode of the sound unit and/or the microphone unit is automatically adjusted correspondingly according to the current orientation of the sound unit and/or the microphone unit. It may make the sound effect played by the communication terminal to the best, and improve the satisfaction of the user experience. Referring to FIG. 1, the communication terminal sound processing control method in this embodiment includes:

S101: Acquire an orientation of a speaker unit on the communication terminal.

In this embodiment, obtaining the orientation of the speaker unit on the communication terminal may be specifically determined according to the current orientation of the communication terminal and the position of each speaker unit on the communication terminal, and of course, the orientation of the speaker unit on the communication terminal may be separately performed by the corresponding sensor. Detection.

The solution provided by this embodiment is suitable for controlling each communication terminal having a speaker. Since the present embodiment relates to switching of a plurality of operation modes of the multi-speaker unit, the present embodiment can perform control for a communication terminal having a plurality of speaker units. For example, a communication terminal having a dual speaker unit, a communication terminal of a four-speaker unit, or a communication terminal of a plurality of other speaker units.

S102: Determine whether the current working mode of the speaker unit matches the current location, and if yes, go to S103; otherwise, go to S104.

In this embodiment, a speaker orientation and a working mode correspondence table may be preset, and the speaker orientation and the working mode correspondence table include correspondences between the orientations of the speaker units and the working modes in different scenarios, and the corresponding relationship may be a terminal manufacturer. The factory setting can also be flexibly set or adjusted according to the user's own needs or application scenarios.

In this embodiment, determining whether the current working mode of the speaker unit matches the current orientation of the speaker is as shown in FIG. 2, including:

S201: Matching the first target working mode in the preset speaker orientation and the working mode correspondence table according to the current orientation of the speaker unit.

S202: determining whether the first target working mode is the same as the current working mode of the speaker unit, If no, go to S203, otherwise, go to S204.

S203: Determine that the current working mode of the speaker unit does not match the current orientation of the speaker unit.

S204: Determine that the current working mode of the speaker unit matches its current location.

S103: Correspondingly update the working mode of the speaker unit according to the current orientation of the speaker unit.

In this embodiment, the corresponding updating of the working mode of the speaker unit specifically includes: updating the current working mode of the speaker unit to a first target working mode corresponding to the current location of the speaker unit. In this way, the working mode of the speaker unit matches its current position, so that the effect of playing the sound is optimal.

S104: No change is made to the operating mode of the speaker unit.

It should be understood that one speaker unit in this embodiment may be composed of one speaker (horn), or may be composed of two or more speakers (horns).

Through the control process shown in FIG. 1, the working mode of the speaker unit of the communication terminal can be correspondingly adjusted according to the current location of the communication terminal, so as to maximize the sound effect played by the communication terminal and improve the satisfaction of the user experience. .

In this embodiment, the operating mode of the speaker can be updated and controlled according to its current orientation in different sound playing scenes of the communication terminal. For example, the working mode of the speaker unit in the multimedia playing scene and/or the call scene may be adjusted correspondingly. The following three scenarios are illustrated separately.

Scene 1: When only the working mode of the speaker unit in the multimedia playing scene is adjusted, the correspondence table between the speaker orientation and the working mode is as shown in Table 1:

Table 1

扬声器单元所在方位The location of the speaker unit	目标工作模式Target work mode
左方Left	左声道声音播放模式Left channel sound playback mode
右方Right side	右声道声音播放模式Right channel sound playback mode

下方Below	左声道声音播放模式Left channel sound playback mode
上方Above	右声道声音播放模式Right channel sound playback mode

Scenario 2: When the working mode of the speaker unit is adjusted in the call scene, the correspondence between the speaker orientation and the working mode is shown in Table 2:

Table 2

扬声器单元所在方位The location of the speaker unit	目标工作模式Target work mode
下方Below	非听筒模式Non-alarm mode
上方Above	听筒模式Earpiece mode

Scenario 3: When the working mode of the speaker unit is adjusted for both the multimedia playing scene and the calling scene, the correspondence table between the speaker orientation and the working mode is shown in Table 3:

table 3

终端工作场景Terminal work scene	扬声器单元所在方位The location of the speaker unit	目标工作模式Target work mode
多媒体播放Multimedia playback	左方Left	左声道声音播放模式Left channel sound playback mode
多媒体播放Multimedia playback	右方Right side	右声道声音播放模式Right channel sound playback mode
多媒体播放Multimedia playback	下方Below	左声道声音播放模式Left channel sound playback mode
多媒体播放Multimedia playback	上方Above	右声道声音播放模式Right channel sound playback mode
通话call	下方Below	非听筒模式Non-alarm mode
通话call	上方Above	听筒模式Earpiece mode

Through the above speaker orientation and working mode correspondence table, in the process of multimedia playback (including but not limited to sound playing and video playing), no matter how the user turns or flips the terminal, it can ensure that the speaker unit is in the left channel when it is below and left. The sound playback mode is in the right channel sound playback mode when the speaker unit is on the right and above, to fully restore the stereo effect of the scene to ensure the user experience. During the call, regardless of how the user turns or flips the terminal, it is ensured that the speaker unit that is above (ie, closest to the user's ear) is in the earpiece mode. In the following, based on the above Table 3, in S103, the speaker list is based on the current orientation of the speaker unit. The working mode of the meta is described in the corresponding update.

In the multimedia playback phase:

When it is detected that the current orientation of the speaker unit is left and its current working mode is the right channel sound playing mode, it is updated to the left channel sound playing mode;

When it is detected that the current orientation of the speaker unit is right and its current working mode is the left channel sound playing mode, it is updated to the right channel sound playing mode;

When it is detected that the current orientation of the speaker unit is below, and its current working mode is the right channel sound playing mode, it is updated to the left channel sound playing mode;

When it is detected that the current orientation of the speaker unit is above and its current working mode is the left channel sound playing mode, it is updated to the right channel sound playing mode.

During the call phase:

When it is detected that the current orientation of the speaker unit is below, and its current working mode is the earpiece mode, it is updated to the non-handset mode;

When it is detected that the current orientation of the speaker unit is above and its current working mode is the non-handset mode, it is updated to the earpiece mode.

In this embodiment, in addition to performing the above control on the speaker operating mode of the communication terminal, similar control can be performed on the microphone unit of the communication terminal. The same applies to any communication terminal having a plurality of microphone communication units. The microphone unit in this embodiment may be composed of one or two or more microphones. The control process for the microphone unit is shown in Figure 3, including:

S301: Acquire an orientation of a microphone unit on the communication terminal.

In this embodiment, obtaining the orientation of the microphone unit on the communication terminal may be specifically determined according to the current orientation of the communication terminal and the position of each microphone unit on the communication terminal. Of course, the orientation of the speaker unit on the communication terminal may be separately performed by the corresponding sensor. Detection.

S302: Determine whether the current working mode of the microphone unit matches the current location, and if yes, go to S303; otherwise, go to S304.

In this embodiment, a correspondence table between the microphone orientation and the working mode may be preset, the wheat Correspondence relationship between the wind direction and the working mode includes the correspondence between the orientation of the microphone unit and the working mode in different scenarios. These correspondences may be factory settings of the terminal manufacturer, or may be flexibly set by the user according to his own needs or application scenarios. Or adjust.

In this embodiment, determining whether the current working mode of the microphone unit matches the current location of the microphone is as shown in FIG. 4, and includes:

S401: Match the second target working mode in the preset microphone orientation and the working mode correspondence table according to the current orientation of the microphone unit.

S402: Determine whether the second target working mode is the same as the current working mode of the microphone unit. If no, go to S403; otherwise, go to S404.

S403: Determine that the current working mode of the microphone unit does not match the current orientation of the microphone unit.

S404: Determine that the current working mode of the microphone unit matches its current location.

S303: Correspondingly update the working mode of the microphone unit according to the current location of the microphone unit. In this embodiment, the corresponding updating of the working mode of the microphone unit specifically includes: updating a current working mode of the microphone unit to a second target working mode corresponding to a current location of the microphone unit. In this way, the working mode of the microphone unit matches its current position, so that the collected sound effect is optimal.

S304: No change is made to the working mode of the microphone unit.

Set the scene to the microphone's working mode to update control according to its current orientation. For example, the working mode of the microphone unit in the multimedia recording (including but not limited to video recording and sound recording) and/or the call scene may be adjusted correspondingly. The following three scenarios are illustrated separately.

Scenario 1: When the working mode of the microphone unit is adjusted in the multimedia recording scene, the correspondence between the microphone orientation and the working mode is shown in Table 4:

Table 4

麦克风单元所在方位Position of the microphone unit	目标工作模式Target work mode
左方Left	左声道声音采集模式Left channel sound collection mode

右方Right side	右声道声音采集模式Right channel sound collection mode
下方Below	左声道声音采集模式Left channel sound collection mode
上方Above	右声道声音采集模式Right channel sound collection mode

Scenario 2: When the working mode of the microphone unit is adjusted in the call scenario, the correspondence between the microphone orientation and the working mode is as shown in Table 5:

table 5

麦克风单元所在方位Position of the microphone unit	目标工作模式Target work mode
下方Below	主声音采集模式Main sound collection mode
上方Above	消噪音模式Noise cancellation mode

Scenario 3: When the working mode of the microphone unit is adjusted for both the multimedia recording scene and the call scene, the correspondence table between the microphone orientation and the working mode is as shown in Table 6:

Table 6

终端工作场景Terminal work scene	麦克风单元所在方位Position of the microphone unit	目标工作模式Target work mode
多媒体录制Multimedia recording	左方Left	左声道声音采集模式Left channel sound collection mode
多媒体录制Multimedia recording	右方Right side	右声道声音采集模式Right channel sound collection mode
多媒体录制Multimedia recording	下方Below	左声道声音采集模式Left channel sound collection mode
多媒体录制Multimedia recording	上方Above	右声道声音采集模式Right channel sound collection mode
通话call	下方Below	主声音采集模式Main sound collection mode
通话call	上方Above	消噪音模式Noise cancellation mode

Through the correspondence table between the microphone orientation and the working mode, in the multimedia recording process, no matter how the user rotates or flips the terminal, the microphone unit can be in the left channel sound collection mode when the microphone unit is below and to the left, and the microphone unit is on the right and above. It is in the right channel sound collection mode to ensure full restoration of the live stereo effect during subsequent playback to ensure the user experience. During the call, regardless of how the user turns or flips the terminal, it can be ensured that the microphone unit above (ie, closest to the user's ear) is in the noise canceling mode, below The microphone (that is, closest to the user's mouth) is in the main sound collection mode to ensure normal call progress.

In the following, based on the above-mentioned Table 6 in S303, the corresponding update of the operating mode of the microphone unit according to the current orientation of the microphone unit is exemplified.

In the multimedia recording phase:

When it is detected that the current orientation of the microphone unit is the left side and the current working mode is the right channel sound collection mode, it is updated to the left channel sound collection mode;

When it is detected that the current orientation of the microphone unit is right and its current working mode is the left channel sound collection mode, it is updated to the right channel sound collection mode;

When it is detected that the current orientation of the microphone unit is below, and its current working mode is the right channel sound collection mode, it is updated to the left channel sound collection mode;

When it is detected that the current orientation of the microphone unit is above and its current working mode is the left channel sound collection mode, it is updated to the right channel sound collection mode.

During the call phase:

When it is detected that the current orientation of the microphone unit is below, and its current working mode is the noise cancellation mode, it is updated to the main sound collection mode;

When it is detected that the current orientation of the microphone unit is above and its current working mode is the main sound collection mode, it is updated to the noise cancellation mode.

Through the control process shown in FIG. 3, the working mode of the communication terminal microphone unit can be correspondingly adjusted according to the current location of the communication terminal, so that the sound effect collected by the communication terminal is optimized as much as possible, and the satisfaction of the user experience is improved.

Embodiment 2:

The present embodiment further provides a communication terminal, which may be a variety of mobile terminals, and the communication terminal includes a communication terminal sound processing control device. As shown in FIG. 5, the method includes:

The speaker position detecting module 51 is configured to acquire the current orientation of the speaker unit on the communication terminal; the speaker position detecting module 51 obtains the orientation of the speaker unit on the communication terminal. According to the current orientation of the communication terminal and the position of each speaker unit on the communication terminal, it is of course possible to separately detect the orientation of the speaker unit on the communication terminal through the corresponding sensor.

The speaker control module 52 is configured to determine whether the current working mode of the speaker unit matches the current location, and if not, update the working mode of the speaker unit according to the current orientation of the speaker unit; if the judgment result is that the two match, then The operating mode of the speaker unit is not changed.

The speaker orientation and the working mode correspondence table in this embodiment may be preset. The speaker orientation and the working mode correspondence table include correspondences between the orientations of the speaker units and the working modes in different scenarios, and the corresponding relationship may be the terminal manufacturer. The factory setting can also be flexibly set or adjusted according to the user's own needs or application scenarios.

The speaker control module 52 determines whether the current working mode of the speaker unit matches the current location of the speaker unit, including: matching the first target working mode in the preset speaker orientation and the working mode correspondence table according to the current orientation of the speaker unit; Whether the target working mode is the same as the current operating mode of the speaker unit, and if not, it is determined that the current working mode of the speaker unit does not match its current position. If the same, it is determined that the current working mode of the speaker unit matches its current position.

The speaker control module 52 correspondingly updates the working mode of the speaker unit, and specifically updates the current working mode of the speaker unit to the first target working mode corresponding to the current location of the speaker unit.

In this embodiment, the operating mode of the speaker can be updated and controlled according to its current orientation in different sound playing scenes of the communication terminal. For example, the working mode of the speaker unit in the multimedia playing scene and/or the call scene may be adjusted correspondingly. In the different sound playing scenes, the correspondence between the speaker orientation and the working mode is shown in Tables 1 to 3 of the first embodiment. For the specific update process, refer to the example shown in the first embodiment, and details are not described herein again.

Referring to FIG. 6, the communication terminal sound processing control apparatus further includes:

The microphone position detecting module 53 is configured to acquire the current microphone unit on the communication terminal. Positioning; the position of the microphone unit on the communication terminal can be determined according to the current orientation of the communication terminal and the position of each microphone unit on the communication terminal, and of course, the speaker unit on the communication terminal can be separately used by the corresponding sensor. Azimuth is detected.

The microphone control module 54 is configured to update the working mode of the microphone unit according to the current location of the microphone unit when the current working mode of the microphone unit does not match the current orientation.

In this embodiment, the correspondence between the microphone orientation and the working mode may also be preset. The correspondence between the microphone orientation and the working mode includes the correspondence between the orientation of the microphone unit and the working mode in different scenarios, and the corresponding relationship may be the terminal. The factory setting of the factory can also be flexibly set or adjusted according to the user's own needs or application scenarios.

The microphone control module 54 determines whether the current working mode of the microphone unit matches the current orientation of the microphone, and includes: matching the second target working mode in the preset microphone orientation and the working mode correspondence table according to the current orientation of the microphone unit; determining the second Whether the target working mode is the same as the current working mode of the microphone unit. If not, it is determined that the current working mode of the microphone unit does not match its current position; otherwise, it is determined that the current working mode of the microphone unit matches its current position.

In this embodiment, the corresponding update of the working mode of the microphone unit by the microphone control module 54 specifically includes: updating the current working mode of the microphone unit to a second target working mode corresponding to the current location of the microphone unit. In this way, the working mode of the microphone unit matches its current position, so that the collected sound effect is optimal.

In this embodiment, the working mode of the speaker can be updated and controlled according to the current orientation of the sound collection scene in the communication terminal. For example, the working mode of the microphone unit in the video, sound playing and/or calling scene can be adjusted correspondingly. For the relationship between the microphone orientation and the working mode in different sound collection scenarios, refer to Table 4 to Table 6 of the first embodiment. For the specific update process, refer to the example shown in the first embodiment, and details are not described herein again.

It should be understood that the speaker position detecting module 51 and the microphone position in this embodiment The detecting module 53 can be implemented by the same position detecting module, or can be implemented by different position detecting modules, and the functions thereof can be specifically implemented by a processor or a controller in the communication terminal. The speaker control module 52 and the microphone control module 54 in this embodiment may also be implemented by the same control module, or may be implemented by different control modules, and the functions thereof may be implemented by a processor or a controller in the communication terminal.

For a better understanding of the present invention, the communication terminal is a mobile terminal, and one end of the bottom of the mobile terminal is provided with a microphone unit 1 and a speaker unit 1, and the top is provided with a microphone unit 2 and a speaker unit 2, as shown in FIG. It should be understood that the specific position and shape of the microphone unit 1, the speaker unit 1 and the microphone unit 2 and the speaker unit 2 disposed at the bottom and the top in the embodiment can be flexibly set according to the requirements of different terminals, and the top and bottom. The position and shape of the speaker and microphone settings between the two can be the same or different. In this embodiment, the speaker position detecting module 51 and the microphone position detecting module 53 are implemented by a position detecting module. Referring to FIG. 8, the terminal position detecting module 71, the speaker control module 52 and the microphone control module 54 are referred to in this example. It is implemented by a control module, referred to as a sound control module 72 in this example, and includes an audio playback module 73 and an audio recording module 74 coupled to the sound control module 72. In the sound playing state and the sound recording state, when the mobile terminal is in the state shown in FIG. 7, the setting manners of the left and right channels are as shown in FIG. 8. The bottom of the state mobile terminal shown in Figure 7 can be considered to be at 0° and the top at 180°. In the playback or recording state, when the bottom is at 0°, it is determined that the microphone unit 1 and the speaker unit 1 are below, and when the bottom is at 180°, it is determined that the microphone unit 1 and the speaker unit 1 are above; the bottom is between 0° and 180°, It is determined that the microphone unit 1 and the speaker unit 1 are on the left side; the bottom portion is between 180° and 360°, and it is determined that the microphone unit 1 and the speaker unit 1 are on the right side. The orientation determination manners of the microphone unit 2 and the speaker unit 2 are the same, and are not described herein. Based on the above settings, the sound processing method of the embodiment will be exemplified below by taking the sound recording process as an example. See Figure 9, which includes:

S801: The audio recording module 74 starts the recording function, and sends information corresponding to the number of channels and the sampling rate to the sound control module 72.

S802: The terminal orientation detecting module 71 needs to read the current terminal after receiving the sound control module 72. When the control command of the end position information is obtained, the current gravity acceleration of the mobile terminal and the data information of the geomagnetic sensor are obtained in real time, and the current mobile terminal rotation orientation information is calculated and transmitted back to the terminal orientation detecting module 71.

S803: The sound control module 72 receives the corresponding recording parameter information and determines the left and right channel path configuration according to the rotation direction information of the mobile terminal (that is, sets the working mode of each microphone unit), and opens the corresponding left and right microphone units for recording.

S804: The sound control module 72 returns the acquired recording data of the left and right microphone units to the audio recording module 74 for storage.

During the audio recording process, the above S802 and S803 may be repeated according to certain rules to quickly and flexibly adjust the working mode of the microphone according to the real-time orientation information of the mobile terminal.

The control process for the audio playback process is similar to the audio recording control process, and is mainly configured by the sound control module 72 to configure the corresponding left and right channel speaker units according to the rotation direction of the current terminal device.

In this embodiment, for the detection of the orientation of the mobile terminal, any existing method for detecting the orientation of the terminal can be used. The following is an example of calculating the direction and angle of the current rotation of the mobile terminal by using the coordinates of the acceleration sensor in the mobile terminal as an example. See the coordinate system shown in Figure 10. The calculation process is as follows:

When the mobile terminal is vertically upward, x=0, y=9.8, z=0 (where z represents the orientation of the mobile terminal, in general, the mobile terminal faces up, so the value of z is 0<z<9.8) The test can be defined as the reference direction of the mobile terminal (0 degree angle direction).

When x=-9.8y=0, z=0 means that the mobile terminal rotates 90 degrees clockwise (to the right).

When x=0, y=-9.8, and z=0, it means that the mobile terminal rotates 180 degrees clockwise with respect to the reference direction.

When x=9.8, y=0, and x=0, the mobile terminal is rotated 270 degrees clockwise (90 degrees counterclockwise) with respect to the reference direction.

Referring to Figure 11, it is assumed that during the audio recording or playback, when the bottom of the mobile terminal is When the rotation angle is greater than 180° on the basis of FIG. 7, the left and right channels need to be exchanged on the basis of FIG. 8 according to the rules of the present embodiment, and the exchanged figures are shown in FIG.

During audio recording or playback, when the bottom of the mobile terminal is rotated by more than 0° and less than 180° on the basis of FIG. 7, the regular left and right channel settings according to the present embodiment are the same as those shown in FIG. 8. Preferably, for example, referring to Figs. 13, 14, and 15, respectively, the rotation angles are 30, 90, and 160 on the basis of Fig. 7.

Referring to FIG. 16, it is assumed that, during audio recording or playback, when the bottom of the mobile terminal is rotated by 180° on the basis of FIG. 7, the rule according to the embodiment needs to exchange left and right sounds on the basis of FIG. 8. The road after the exchange is shown in Figure 12.

In the sound playback device or recording state, no matter how the user takes the mobile terminal, during the sound playback, the speaker unit located on the left side is in the left channel sound playing state, and the speaker unit located on the right side is in the right channel sound playing state; During the recording process, the microphone unit located on the left is in the left channel sound collection state, and the microphone unit on the right side is in the right channel sound collection state.

In the mobile terminal call state, the bottom of the mobile terminal shown in FIG. 7 can be considered to be at 0° and the top at 180°. In the call state, when the bottom is between 0° and 90° (0° and 90°) or 270° to 360° (270° and 360°), it is determined that the microphone unit 1, the speaker unit 1 is below, and the bottom is at 90°. When it is 180° (180°) or 180° to 270° (270°), it is determined that the microphone unit 1 and the speaker unit 1 are above. For the microphone unit 2, the orientation of the speaker unit 2 is determined in the same manner.

In the hand-held call scenario, the user normally takes the mobile terminal, the bottom microphone unit 1 serves as the pickup main microphone, and the top microphone unit 2 is the noise canceling microphone; the top speaker unit 2 is configured as the earpiece mode as the output device for the call downlink data. When the user reverses the mobile terminal upside down, the top microphone unit 2 serves as the pickup main microphone, and the bottom microphone unit 1 is the noise canceling microphone; the bottom speaker unit 1 is configured as the handset mode as the output device for the call downlink data. No matter how the user takes the mobile terminal, the main microphone is always close to the talking position during the call, and the noise is far away from the speaking position; the earpiece is closer to the speaker unit than the ear.

It should be understood by those skilled in the art that the modules or steps of the above embodiments of the present invention may be implemented by a general-purpose computing device, which may be centralized on a single computing device or distributed over a network of multiple computing devices. Alternatively, they may be implemented by program code executable by a computing device such that they may be stored in a computer storage medium (ROM/RAM, diskette, optical disk) by a computing device, and in some cases The steps shown or described may be performed in a different order than that herein, or they may be separately fabricated into individual integrated circuit modules, or a plurality of the modules or steps may be implemented as a single integrated circuit module. Therefore, the invention is not limited to any particular combination of hardware and software.

According to the current rotation angle of the mobile terminal, the position of the left and right channels or the sound collecting microphone and the sound emitting speaker is automatically switched when the mobile terminal records/plays or talks. Preferably, in the recording and recording scene, regardless of the rotation angle of the mobile terminal, the left microphone is always the left channel, the right microphone is the right channel, and the call is also played during the playback to keep the left speaker playing the left microphone recording. Left channel data, the right speaker plays the right channel data recorded by the right microphone, which can truly restore the stereo effect of the scene; in the mobile terminal call state, regardless of whether the mobile terminal is taken down, it is always kept from the mouth. The microphone, close to the ear is the earpiece. And all the rotation angle judgments only depend on the geomagnetic sensor (the horizontal rotation direction judgment basis) and the gravity acceleration sensor (the vertical rotation angle judgment basis) commonly used in the mobile terminal. There is no additional hardware cost.

Embodiments of the present invention also provide a storage medium. Optionally, in this embodiment, an execution instruction is stored in the storage medium, and the execution instruction is used to execute the foregoing method.

Optionally, in the embodiment, the foregoing storage medium may include, but is not limited to, a USB flash drive, a Read-Only Memory (ROM), and a Random Access Memory (RAM). A variety of media that can store program code, such as a hard disk, a disk, or an optical disk.

The above is a detailed description of the embodiments of the present invention in conjunction with the specific embodiments, and the specific embodiments of the present invention are not limited to the description. For those skilled in the art to which the present invention pertains, it can also be made without departing from the inventive concept. A number of simple deductions or substitutions are considered to be within the scope of the invention.

Industrial applicability

As described above, the communication terminal sound processing control method and apparatus and the communication terminal provided by the embodiments of the present invention have the following beneficial effects: the corresponding adjustment of the working mode of the communication terminal speaker unit can be completed according to the current location of the communication terminal, As far as possible, the sound effect played by the communication terminal is optimized to improve the satisfaction of the user experience.

Claims

A communication terminal sound processing control method includes:

Obtaining an orientation of a speaker unit on the communication terminal;

When it is determined that the current working mode of the speaker unit does not match the current location, the operating mode of the speaker unit is correspondingly updated according to the current location of the speaker unit.
The communication terminal sound processing control method according to claim 1, wherein determining whether the current operating mode of the speaker unit matches its current location includes:

Matching the first target working mode in the preset speaker orientation and the working mode correspondence table according to the current orientation of the speaker unit;

Determining whether the first target working mode is the same as the current working mode of the speaker unit, and if not, determining that the current operating mode of the speaker unit does not match the current location thereof.
The communication terminal sound processing control method according to claim 2, wherein updating the current operating mode of the speaker unit according to the current orientation of the speaker unit comprises:

Updating a current working mode of the speaker unit to a first target working mode corresponding to a current location of the speaker unit.
The communication terminal sound processing control method according to claim 3, wherein said speaker orientation and operation mode correspondence table includes the following correspondence:

During multimedia playback: when the orientation of the speaker unit is left or below, the corresponding working mode is the left channel sound playback mode; when the speaker unit is located to the right or above, the corresponding working mode is the right channel sound playback. mode;

and / or,

During the call: when the speaker unit orientation is above, the corresponding first target working mode is the earpiece mode.
The communication terminal sound processing control method according to any one of claims 1 to 4, further comprising:

Obtaining a current location of the microphone unit on the communication terminal;

When the current working mode of the microphone unit does not match the current location, the working mode of the microphone unit is updated correspondingly according to the current location of the microphone unit.
The communication terminal sound processing control method according to claim 5, wherein determining whether the current operating mode of the microphone unit matches its current location includes:

And matching the second target working mode in the preset microphone orientation and the working mode correspondence table according to the current orientation of the microphone unit;

Determining whether the second target working mode is the same as the current working mode of the microphone unit, and if not, determining that the current working mode of the microphone unit does not match the current location thereof.
The communication terminal sound processing control method of claim 6, wherein updating the current working mode of the microphone unit according to the current location of the microphone unit comprises:

Updating a current working mode of the microphone unit to a second target working mode corresponding to a current location of the microphone unit.
The communication terminal sound processing control method according to claim 7, wherein the microphone orientation and operation mode correspondence table includes the following correspondence:

In the multimedia recording process: when the orientation of the microphone unit is left or below, the corresponding working mode is the left channel sound collection state; when the microphone unit is located to the right or above, the corresponding working mode is the right channel sound collection. status;

and / or,

During the call: when the microphone unit is in the upper position, the corresponding second target works The mode is the noise canceling mode; when the microphone unit orientation is below, the corresponding second target working mode is the main sound collecting mode.
A communication terminal sound processing control device includes:

a speaker position detecting module configured to acquire an orientation of a speaker unit on the communication terminal;

The speaker control module is configured to, when determining that the current working mode of the speaker unit does not match the current orientation, update the working mode of the speaker unit according to the current orientation of the speaker unit.
The communication terminal sound processing control apparatus according to claim 9, further comprising:

a microphone position detecting module, configured to acquire an orientation of a microphone unit on the communication terminal;

The microphone control module is configured to update the working mode of the microphone unit according to the current location of the microphone unit when the current working mode of the microphone unit does not match the current orientation.
A communication terminal comprising the communication terminal sound processing control device according to any one of claims 9 or 10.