CN112604266A

CN112604266A - Mobile terminal, vibration control method thereof and computer readable storage medium

Info

Publication number: CN112604266A
Application number: CN202011488161.1A
Authority: CN
Inventors: 杨宪昌; 张立振; 邓永庆; 梁川
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2020-12-16
Filing date: 2020-12-16
Publication date: 2021-04-06

Abstract

The embodiment of the invention discloses a mobile terminal, a vibration control method thereof and a computer readable storage medium, wherein when the mobile terminal is determined to run a target game application in a foreground, an audio signal output by the mobile terminal is obtained by monitoring touch operation aiming at a touch panel of the mobile terminal, and then vibration of a motor of the mobile terminal is controlled according to a touch operation monitoring result and the audio signal. Because the mobile terminal does not control the vibration of the motor according to the output audio signal in a game scene independently any more, but controls the vibration in combination with the touch operation detected by the touch panel, the mobile terminal can identify the scene that the audio signal meets the vibration condition but the user does not execute the touch operation meeting the vibration condition, the motor is prevented from vibrating in the scene, the false vibration probability is reduced, the precision degree of the vibration of the 4D intelligent vibration function is improved, the reality of the game scene and the precision degree of the user operation are improved, and the game experience of the user is greatly enhanced.

Description

Mobile terminal, vibration control method thereof and computer readable storage medium

Technical Field

The embodiment of the invention relates to the technical field of communication, in particular to a mobile terminal, a vibration control method thereof and a computer readable storage medium.

Background

"4D intelligence tremolo" is that mobile terminal producer launches complementary function to the hand trip: in the process of running the game application by the mobile terminal, whether special sounds such as a gunshot sound and a vehicle engine sound are contained or not is identified according to the audio signal output by the mobile terminal, and if the special sounds are identified, the motor of the mobile terminal is controlled to vibrate, so that real touch feeling is simulated for a user in the game process, and the game experience of the user is improved. However, in the current "4D intelligent vibration" function, the motor often vibrates when the vibration should not occur, that is, "mistaken vibration" occurs, and the mistaken vibration not only affects the realistic effect of the game scene simulation, but also may even affect the accuracy of the game operation of the user. Therefore, it is desirable to provide a solution for reducing the false vibration of the motor of the mobile terminal.

Disclosure of Invention

The technical problem to be solved by the embodiment of the invention is as follows: aiming at the technical problem that a motor of a mobile terminal is easy to vibrate by mistake in a game scene to influence the fidelity of the game scene and the operation of a user, the mobile terminal, the vibration control method thereof and a computer readable storage medium are provided.

In order to solve the above technical problem, an embodiment of the present invention provides a mobile terminal vibration control method, where the mobile terminal vibration control method includes:

determining that the mobile terminal runs a target game application in a foreground;

monitoring touch operation aiming at a touch panel of the mobile terminal, and acquiring an audio signal output by the mobile terminal;

and controlling the vibration of the motor of the mobile terminal by combining the audio signal according to the touch operation monitoring result.

Optionally, the mode of acquiring the audio signal output by the mobile terminal includes any one of the following:

acquiring an audio signal to be output by the mobile terminal through an audio output unit;

and acquiring the audio signal output by the mobile terminal through the audio acquisition unit.

Optionally, before determining that the mobile terminal runs the target game application in the foreground, the method further includes:

receiving a game space entering instruction;

and displaying a game space interface according to the game space entry instruction, wherein the icons in the game space interface only comprise at least one of game application icons and game control icons.

Optionally, the game control includes a vibration feedback function enabling control and an anti-false vibration function enabling control;

before the audio signal output by the mobile terminal is obtained, the method further comprises the following steps:

determining that a touch operation for the vibration feedback function enabling control is detected;

before controlling the vibration of the motor of the mobile terminal by combining the audio signal according to the touch operation monitoring result, the method further comprises the following steps:

and determining that the touch operation aiming at the false vibration prevention function enabling control is detected.

Optionally, the controlling the vibration of the motor of the mobile terminal according to the touch operation monitoring result and the audio signal includes:

determining a touch position of the touch operation according to the touch operation monitoring result;

determining that the touch position belongs to a vibration demand area;

and controlling a motor of the mobile terminal to vibrate according to the audio signal.

Optionally, before controlling the motor of the mobile terminal to vibrate according to the audio signal, the method further includes:

processing the audio signal;

and determining that the audio signal comprises a target sound signal, wherein the target sound signal is a sound signal accompanying the motor vibration when the output is required.

Optionally, the controlling the motor of the mobile terminal to vibrate according to the audio signal includes:

determining a vibration parameter of the motor according to the audio signal, wherein the vibration parameter comprises at least one of vibration frequency and vibration amplitude;

and controlling a motor of the mobile terminal to vibrate according to the vibration parameters.

Optionally, determining the vibration parameter according to the audio signal includes:

filtering the audio signal through audio track separation processing to obtain a target sound signal;

identifying the target sound signal based on the pre-stored audio characteristics to determine the type of the target sound signal;

the vibration parameter is determined according to the type of the target sound signal.

Alternatively to this, the first and second parts may,

further, the embodiment of the present invention further provides a mobile terminal, where the mobile terminal includes a processor, a memory, a motor driver, a motor, and a communication bus;

the processor is respectively communicated with the memory and the motor drive through a communication bus, and the motor drive is in communication connection with the motor;

the processor is configured to execute one or more programs stored in the memory to implement the steps of the mobile terminal vibration control method of any one of the above.

Further, an embodiment of the present invention also provides a computer-readable storage medium, where one or more programs are stored, and the one or more programs are executable by one or more processors to implement the steps of the mobile terminal vibration control method according to any one of the above.

Advantageous effects

The embodiment of the invention provides a mobile terminal, a vibration control method thereof and a computer readable storage medium, and aims to solve the problem that a game scene needing vibration cannot be accurately identified by a 4D intelligent vibration sense function in the related technology, so that a motor frequently vibrates by mistake and the game experience of a user is influenced. Because the mobile terminal does not control the vibration of the motor according to the output audio signal in a game scene independently any more, but controls the vibration in combination with the touch operation detected by the touch panel, the mobile terminal can identify the scene that the audio signal meets the vibration condition but the user does not execute the touch operation meeting the vibration condition, the motor is prevented from vibrating in the scene, the false vibration probability is reduced, the precision degree of the vibration of the 4D intelligent vibration function is improved, the reality of the game scene and the precision degree of the user operation are improved, and the game experience of the user is greatly enhanced.

Drawings

Embodiments of the invention will be further described with reference to the accompanying drawings and embodiments, in which:

fig. 1 is a schematic diagram of a hardware structure of an optional mobile terminal for implementing various embodiments of the present invention.

FIG. 2 is a diagram of a wireless communication system for the mobile terminal shown in FIG. 1;

fig. 3 is a flowchart of a vibration control method for a mobile terminal according to a first embodiment of the present invention;

fig. 4 is a flowchart illustrating that the mobile terminal controls the motor to vibrate according to the touch operation monitoring result and the audio signal according to the first embodiment of the invention;

fig. 5 is a schematic view of an interactive interface of a mobile terminal provided in a first embodiment of the present invention;

FIG. 6 is a schematic diagram of a user setting a vibration requirement area according to a first embodiment of the present invention;

fig. 7 is a flowchart illustrating a method for controlling a motor to vibrate based on an audio signal by a mobile terminal according to a first embodiment of the present invention;

fig. 8 is a flowchart of determining a vibration parameter according to an audio signal by a mobile terminal provided in the first embodiment of the present invention;

fig. 9 is a flowchart of a vibration control method of a mobile terminal according to a second embodiment of the present invention;

fig. 10 is a schematic view of an interactive interface of a mobile terminal according to a second embodiment of the present invention;

fig. 11 is a schematic view of another interactive interface of the mobile terminal according to the second embodiment of the present invention;

fig. 12 is a schematic hardware structure diagram of a mobile terminal according to a third embodiment of the present invention.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the embodiments of the invention and are not limiting of the embodiments of the invention.

In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the description of the embodiments of the present invention, and have no specific meaning in themselves. Thus, "module", "component" or "unit" may be used mixedly.

The terminal may be implemented in various forms. For example, the terminal described in the embodiments of the present invention may include a mobile terminal such as a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a Personal Digital Assistant (PDA), a Portable Media Player (PMP), a navigation device, a wearable device, a smart band, a pedometer, and the like, and a fixed terminal such as a Digital TV, a desktop computer, and the like.

The following description will be given taking a mobile terminal as an example, and it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for mobile purposes.

Referring to fig. 1, which is a schematic diagram of a hardware structure of a mobile terminal for implementing various embodiments of the present invention, the mobile terminal 100 may include: RF (Radio Frequency) unit 101, WiFi module 102, audio output unit 103, a/V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the mobile terminal architecture shown in fig. 1 is not intended to be limiting of mobile terminals, which may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The following describes each component of the mobile terminal in detail with reference to fig. 1:

the radio frequency unit 101 may be configured to receive and transmit signals during information transmission and reception or during a call, and specifically, receive downlink information of a base station and then process the downlink information to the processor 110; in addition, the uplink data is transmitted to the base station. Typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with a network and other devices through wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA2000(Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division duplex Long Term Evolution), and TDD-LTE (Time Division duplex Long Term Evolution).

WiFi belongs to short-distance wireless transmission technology, and the mobile terminal can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the WiFi module 102, and provides wireless broadband internet access for the user. Although fig. 1 shows the WiFi module 102, it is understood that it does not belong to the essential constitution of the mobile terminal, and may be omitted entirely as needed within the scope not changing the essence of the invention.

The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the mobile terminal 100 is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

The a/V input unit 104 is used to receive audio or video signals. The a/V input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, the Graphics processor 1041 Processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 may receive sounds (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, or the like, and may be capable of processing such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or a backlight when the mobile terminal 100 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, further description is omitted here.

The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect a touch operation performed by a user on or near the touch panel 1071 (e.g., an operation performed by the user on or near the touch panel 1071 using a finger, a stylus, or any other suitable object or accessory), and drive a corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. In particular, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like, and are not limited to these specific examples.

Further, the touch panel 1071 may cover the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although the touch panel 1071 and the display panel 1061 are shown in fig. 1 as two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the mobile terminal, and is not limited herein.

The interface unit 108 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and external devices.

The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 110 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by operating or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the mobile terminal. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The mobile terminal 100 may further include a power supply 111 (e.g., a battery) for supplying power to various components, and preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system.

Although not shown in fig. 1, the mobile terminal 100 may further include a bluetooth module or the like, which is not described in detail herein.

In order to facilitate understanding of the embodiment of the present invention, a communication network system on which the mobile terminal according to the embodiment of the present invention is based is described below.

Referring to fig. 2, fig. 2 is an architecture diagram of a communication Network system according to an embodiment of the present invention, where the communication Network system is an LTE system of a universal mobile telecommunications technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203, and an IP service 204 of an operator, which are in communication connection in sequence.

Specifically, the UE201 may be the terminal 100 described above, and is not described herein again.

The E-UTRAN202 includes eNodeB2021 and other eNodeBs 2022, among others. Among them, the eNodeB2021 may be connected with other eNodeB2022 through backhaul (e.g., X2 interface), the eNodeB2021 is connected to the EPC203, and the eNodeB2021 may provide the UE201 access to the EPC 203.

The EPC203 may include an MME (Mobility Management Entity) 2031, an HSS (Home Subscriber Server) 2032, other MMEs 2033, an SGW (Serving gateway) 2034, a PGW (PDN gateway) 2035, and a PCRF (Policy and Charging Rules Function) 2036, and the like. The MME2031 is a control node that handles signaling between the UE201 and the EPC203, and provides bearer and connection management. HSS2032 is used to provide registers to manage functions such as home location register (not shown) and holds subscriber specific information about service characteristics, data rates, etc. All user data may be sent through SGW2034, PGW2035 may provide IP address assignment for UE201 and other functions, and PCRF2036 is a policy and charging control policy decision point for traffic data flow and IP bearer resources, which selects and provides available policy and charging control decisions for a policy and charging enforcement function (not shown).

The IP services 204 may include the internet, intranets, IMS (IP Multimedia Subsystem), or other IP services, among others.

Although the LTE system is described as an example, it should be understood by those skilled in the art that the embodiments of the present invention are not limited to the LTE system, but may also be applied to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems.

Based on the above mobile terminal hardware structure and communication network system, the embodiments of the method of the embodiments of the present invention are provided.

First embodiment

In order to solve the problem that the mobile terminal in the related art cannot accurately identify a game scene requiring motor vibration, which causes frequent motor vibration errors and affects the game experience of a user, the embodiment provides a mobile terminal vibration control method, please refer to the flowchart of the method shown in fig. 3:

s302: and determining that the mobile terminal runs the target game application in the foreground.

In this embodiment, the mobile terminal may monitor its current foreground application and determine whether the current foreground application is a target game application. For example, the mobile terminal may monitor its own Process List (Process List), and if the target game application starts running, the Process of the target game application may appear in the Process List, so that when the mobile terminal detects that the Process of the target game application appears in the Process List, it may be determined that the target game application is started. However, it will be understood by those skilled in the art that the application to which the process in the process list belongs is not necessarily a foreground application, and for example, some applications run in the background, but the process is in the process list, so based on the process list, the mobile terminal can only determine that the application to which the process that has just been added to the process list belongs is a foreground application. In some other examples of this embodiment, the mobile terminal may monitor whether the target game application is running in the foreground in other ways: for example, the mobile terminal may monitor its own Active window (Activity), and if the Active window is the window (Activity) of the target game application, it indicates that the target game application is running in the foreground of the mobile terminal.

It should be appreciated that in the present embodiment, the target game application is a game application that has a motor vibration requirement during operation, for example, the target game application may include, but is not limited to, at least one of a shooting game application, a racing game application. It should be noted that the shooting game application and the racing game application are not specific applications, but refer to all game applications that relate to shooting scenes or racing scenes. For example, so-called shooting in shooting game applications may include firearm shooting, arrow shooting, slingshot shooting, cannonball shooting, and the like. In some examples of this embodiment, the shots may also include throw-type shots such as darts, and the like. If a plurality of shooting game applications are installed in the mobile terminal, the mobile terminal needs to monitor whether each of the plurality of game applications is running in the foreground.

In some cases, there is only one game application in the mobile terminal that may require motor vibration during operation, and the target game application that the terminal needs to monitor is only one, but in other cases, if more game applications requiring motor vibration are installed in the mobile terminal, the target game application monitored by the mobile terminal includes a plurality of game applications. Alternatively, the mobile terminal may identify itself whether the installed application belongs to the target game application according to the profile, type, and the like of the application. For example, when the user instructs the mobile terminal to install an application a, the mobile terminal may obtain information from an installation package of the application a or obtain information from a server corresponding to the application a to determine whether the application a is a target game application. In some other examples of this embodiment, the target game application that the mobile terminal needs to monitor may be set by a user of the mobile terminal in a customized manner, for example, the user sets a target game application list, and the mobile terminal may directly monitor whether the current foreground application is the target game application according to the list.

S304: and monitoring touch operation aiming at a touch panel of the mobile terminal, and acquiring an audio signal output by the mobile terminal.

When the mobile terminal determines that the target game application runs in the foreground, the touch operation of the user can be detected through the touch panel, and meanwhile, the audio signal output by the mobile terminal is obtained. The monitoring result of the touch operation of the touch panel can show whether the user has the touch operation or not, and show whether the user performs the specific touch operation or not. The acquired audio signal comprises the audio currently output by the target game application, and various sounds in the current game scene of the target game application can be reflected.

In the present embodiment, the touch panel of the mobile terminal includes at least one touch screen, and for a single-screen mobile terminal, the touch panel includes one touch screen. However, for a dual-screen mobile terminal, the touch panel may include a front touch screen and a back touch screen. However, in other examples, the touch panel may also include a touch panel without a display function, such as a touch panel including a fingerprint recognition module, which is generally smaller in area and is generally disposed on a side of the mobile terminal.

It should be understood that the mobile terminal monitoring the touch operation through the touch panel is mainly intended to determine the game operation of the user in the target game application through the touch operation monitoring result, for example, determine whether the user issues the operation to trigger the mobile terminal to emit the target sound through the touch panel, taking a shooting game application as an example, the target sound includes a gunshot sound, so when the foreground application is the shooting game application, the touch operation monitoring result of the mobile terminal needs to reflect whether the user issues a gun firing instruction. It can be understood that, in different target game applications, the touch operation for triggering the mobile terminal to emit the target sound is usually different, for example, in the shooting game application a, the user can issue the gun firing instruction by clicking the area a on the touch screen, but in the related game application B, the user needs to operate the area B on the touch screen to issue the gun firing instruction. Even in some examples, the type of touch operation that triggers the mobile terminal to emit the target sound may be different, for example, the type of touch operation that triggers the mobile terminal to emit the target sound in a shooting game application is a click on the screen, but in other types of game applications, the type of touch operation that triggers the mobile terminal to emit the target sound is a long press, or a continuous click. Therefore, in some examples of this embodiment, the touch operation monitoring result of the mobile terminal needs to represent at least one of several information such as a touch position and an operation type of the touch operation.

In some examples of this embodiment, when the mobile terminal acquires the audio signal output by itself, the mobile terminal may directly acquire the audio signal through its own audio acquisition unit, and in this scheme of acquiring the output audio signal, the mobile terminal acquires the audio signal that has been output. However, it is needless to say that this scheme for acquiring the output audio signal is only suitable for the situation that the mobile terminal outputs the sound corresponding to the audio signal to the environment through a speaker or a sound device, and if the mobile terminal outputs the audio signal of the target game application through an earphone, the audio acquisition unit of the mobile terminal cannot acquire the output audio signal of the mobile terminal. In addition, this scheme of acquiring an audio signal is not suitable for a noisy environment, because other sounds in the environment may cause a large interference to the identification of the output audio signal by the mobile terminal.

In other examples of this embodiment, the mobile terminal may directly capture audio signals to be output through its own audio output unit, in which case, the captured audio signals also include audio signals output by the target game application, which also belongs to "output audio signals", except that the audio signals are captured and not output. The scheme for collecting the audio signal can not introduce noise in the external environment, and is beneficial to the subsequent identification of the audio signal by the mobile terminal. Meanwhile, the audio signal acquisition scheme is not limited by the audio output mode of the mobile terminal, and the application scene is wider.

S306: and controlling the vibration of the motor of the mobile terminal by combining the audio signal according to the touch operation monitoring result.

After acquiring the touch operation monitoring result and the audio signal, the mobile terminal may control the vibration of the motor according to the touch operation monitoring result and the audio signal, in some examples of this embodiment, the mobile terminal may determine whether to control the vibration of the motor according to the audio signal and the touch operation monitoring result; in other examples, the mobile terminal may determine whether the motor vibrates according to the touch operation monitoring result, and determine how the motor vibrates according to the audio signal when it is determined that the motor needs to vibrate. A scheme of controlling the vibration of the motor in accordance with the touch operation monitoring result in combination with the audio signal will be described below with reference to the flowchart shown in fig. 4:

s402: and determining the touch position of the touch operation according to the touch operation monitoring result.

In the example given in fig. 4, the touch operation that triggers the mobile terminal to emit the target sound is a touch operation for a specific area on the screen, in which case, after the mobile terminal acquires the touch operation monitoring result, the mobile terminal may determine the touch position of the touch operation.

S404: and determining that the touch position belongs to a vibration demand area.

For example, please refer to an interactive interface schematic diagram of a mobile terminal shown in fig. 5: in fig. 5, a user can implement issuing a gun firing instruction by touching the first shooting function control 501 and the second shooting function control 502, so that if the touch panel monitors that the user touches the area where the first shooting function control 501 is located or monitors that the user touches the area where the second shooting function control 502 is located, the mobile terminal can determine that the user issues the gun firing instruction, and therefore, the gun sound needs to be played while the motor vibrates. As can be seen from fig. 5, the area where the first shooting function control 501 and the area where the second shooting function control 502 are located are areas where vibration needs to be performed after being touched, that is, "vibration-needed areas". For the mobile terminal, after determining the touch position of the touch operation, it may determine whether the touch position of the touch operation is located in the vibration demand area.

It can be understood that the vibration demand areas corresponding to different target game applications are different, and therefore, the mobile terminal can determine the vibration demand area corresponding to the target game application running on the current foreground. The vibration requirement area corresponding to one game application is related to the layout of the function control on the game application display interface, and in some examples of this embodiment, the vibration requirement area in one game application may be set by a user in a customized manner, or may be set by a programmer and then stored in the mobile terminal. In fig. 6, a schematic diagram of a user indicating a vibration requirement area on an interactive interface of a game application is shown, and the user can indicate the position of the vibration requirement area by dragging an area setting icon 600 shown in dotted lines on the interactive interface and indicate the range of the vibration requirement area by zooming the area setting icon 600.

S406: and controlling a motor of the mobile terminal to vibrate according to the audio signal.

If the touch position of the touch operation is determined to be in the vibration demand area, the mobile terminal may control a motor of the mobile terminal to vibrate according to the audio signal.

Alternatively, the mobile terminal may control the motor vibration based on the audio signal with reference to the flowchart shown in fig. 7:

s702: vibration parameters of the motor are determined from the audio signal.

In this embodiment, the vibration parameter may include at least one of a vibration frequency and a vibration amplitude. Of course, it will be understood by those skilled in the art that the vibration parameters of the mobile terminal may include vibration time, vibration waveform, etc. in addition to vibration frequency and vibration amplitude. The mobile terminal may determine one or more of these vibration parameters from the audio signal only, and for other parameters default set values may be used. The process of the mobile terminal determining the vibration parameter according to the audio signal can be seen in fig. 8:

s802: and filtering the audio signal through audio track separation processing to obtain a target sound signal.

It should be understood that even though the audio signal acquired by the mobile terminal is only the audio of the target game application, two or more sounds may be included, such as a sound generated by the game operation of the local user (e.g., a gunshot sound generated by the gun-firing operation of the local user, etc.), a sound generated by the game operation of teammates (e.g., an engine sound generated by the driving operation of the teammates, etc.), a sound for simulating a scene in a game scene (e.g., a wind sound, a rain sound, a thunder sound, etc.), and a sound for the local user to communicate with the peer user through voice. In other words, the audio signal collected by the mobile terminal may also include audio of other applications, for example, if the user plays a song with an audio playing application during a game, the mobile terminal may also collect the audio signal of the audio playing application when collecting the audio signal of the target game application. And if the mobile terminal adopts the audio acquisition unit to acquire the output audio signal, the audio signal probably also comprises a sound signal in the external environment.

In fact, however, the mobile terminal only needs to perform the determination of the vibration parameter according to the sound related to the triggering of the motor vibration, that is, the mobile terminal actually needs to output the sound signal accompanied by the motor vibration. Alternatively, the mobile terminal may filter the acquired audio signal through an audio track separation processing technique, screen out other irrelevant audio signals, and only retain the audio signal that may trigger the motor to vibrate, that is, the target sound signal.

S804: the target sound signal is identified based on the pre-stored audio features to determine the type of the target sound signal.

After the target sound signal is acquired, the mobile terminal may identify the target sound signal according to the pre-stored audio features, for example, assuming that the target sound signal is a gunshot, the mobile terminal may pre-store the audio features of the gunshots of various types of firearms, and then determine which type of firearm the target sound signal has been emitted by using the audio features. Assuming that the target sound signal is an engine sound, the mobile terminal may store audio features corresponding to multiple engine types in advance, and then after the target sound signal is acquired, identify which engine the target sound signal corresponds to through the pre-stored audio features.

S806: the vibration parameter is determined according to the type of the target sound signal.

It can be understood that in real-world situations, different firearms have different recoil, firing jarring, etc.; different types of engines may also provide different ride experiences, so in order to simulate reality in a gaming application as much as possible, the mobile terminal may determine the vibration parameters according to the type of the target sound signal after determining the type of the target sound signal. Optionally, in some examples of this embodiment, the programmer or the user may set a corresponding vibration parameter for each firearm based on real experience in advance, and store a corresponding relationship between the vibration parameter and the sound signal type in the mobile terminal in a form of a mapping table or the like. Therefore, after the mobile terminal determines the type of the target sound signal, the corresponding vibration parameter can be determined by inquiring the mapping relation stored by the mobile terminal.

S704: and controlling a motor of the mobile terminal to vibrate according to the vibration parameters.

After the mobile terminal determines the vibration parameters, the motor can be controlled to vibrate according to the vibration parameters. In some examples of this embodiment, before controlling a motor of the mobile terminal to vibrate, the mobile terminal needs to determine that an acquired audio signal includes a target sound signal, and if the audio signal acquired by the mobile terminal does not include a sound signal that is required to vibrate along with the motor when being output, even if the mobile terminal detects a touch operation that meets a condition through a touch panel, the mobile terminal may not control the motor to vibrate; and only when the touch operation monitoring result of the mobile terminal represents that the user performs the touch operation meeting the conditions, and meanwhile, the audio signal output by the mobile terminal comprises the target sound signal, the mobile terminal controls the motor to vibrate. Therefore, the situation that the motor vibrates when no vibration is needed originally can be further avoided, the probability of mistaken vibration of the motor is reduced, and the game experience of a user is enhanced.

Therefore, in some examples of this embodiment, after acquiring the output audio signal, the mobile terminal may process the audio signal to determine whether the audio signal includes a target sound signal, and if the determination result is yes, the mobile terminal further determines whether a touch operation meeting the condition is monitored in the touch operation monitoring result, and if so, the mobile terminal may control the motor to vibrate; if the mobile terminal determines that the acquired audio signal does not include the target sound signal, the mobile terminal may not even further determine whether the touch operation monitoring result includes a touch operation meeting the condition.

In another example, the mobile terminal may also determine whether the touch operation meets the condition based on the touch operation monitoring result, and only if the determination result is yes, the mobile terminal further determines whether the acquired audio signal includes the target sound signal. In some examples, the mobile terminal may synchronously determine whether the acquired audio signal includes a target sound signal, determine whether the touch operation monitoring result determines that a touch operation meeting a condition is included, and finally control the motor to vibrate only when both the determination results are yes.

The vibration control method of the mobile terminal provided in this embodiment does not simply control the motor vibration according to the output audio signal, but determines whether the user really performs the touch operation that triggers the motor vibration by combining the touch operation monitoring result of the touch panel, thereby determining whether the motor really is expected to vibrate. Therefore, the problem that the motor of the mobile terminal vibrates along with the operation of other users can be avoided, the accuracy of the vibration of the motor is improved, the fidelity of a game scene is improved, the accuracy of game operation of the users is improved, and the game experience of the users is improved.

Second embodiment

In order to make the advantages and details of the foregoing mobile terminal vibration control method clearer for those skilled in the art, the present embodiment will continue to describe the foregoing solution with reference to an example, please refer to a flowchart of a terminal vibration control method shown in fig. 9:

s902: a game space entry instruction is received.

In this embodiment, the game space entry instruction is used to instruct the mobile terminal to present a game space interface.

S904: and displaying the game space interface according to the game space entry instruction.

In the game space interface, only content related to the game application is displayed, e.g., the displayed icons may include only at least one of game application icons and game control icons. For example, fig. 10 shows a display interface before the mobile terminal enters the game space, and the display interface shown in fig. 10 includes social application icons (microblog, WeChat, etc.), and also includes game application icons (such as an icon 1001 of game application A and an icon 1002 of game application B). In the game space interface 1100, the mobile terminal only displays an icon 1001 of the game application a and an icon 1002 of the game application B, and also displays a vibration feedback function enabling control 1101 and an anti-shake function enabling control 1102, wherein the vibration feedback function enabling control 1101 is used for controlling whether to start the vibration feedback function, that is, whether to start the "4D smart sense of shake" function by the user. The false vibration prevention function enabling control 1102 is used for a user to determine whether to control the motor according to the output audio signal or to control the motor by combining the audio signal and the touch operation monitoring result.

S906: monitoring whether a starting instruction for a target game application is received.

If yes, go to S908, otherwise, go to S906.

S908: and monitoring touch operation aiming at a touch panel of the mobile terminal, and acquiring an audio signal output by the mobile terminal.

It can be understood that the monitoring of the touch operation on the touch panel is performed by the mobile terminal under a normal condition, but the obtaining of the audio signal output by the mobile terminal is performed only after the vibration feedback function is turned on, so in some examples of the embodiment, before the mobile terminal obtains the audio signal output by the mobile terminal, it is ensured that the touch operation on the vibration feedback function enabling control is detected by the mobile terminal, that is, it is determined that the vibration feedback function is turned on by the user.

S910: the audio signal is filtered by a soundtrack separation process.

After the output audio signal is obtained, the mobile terminal can filter the audio signal through audio track separation processing, and some unimportant sound signals are filtered.

S912: and judging whether the audio signals retained by the filtering contain the target sound signals.

If so, the process proceeds to S914, otherwise, S926 may be executed since the audio signal outputted from the mobile terminal does not include a sound signal that requires vibration of the motor at the time of output.

S914: the target sound signal is identified based on the pre-stored audio features to determine the type of the target sound signal.

In this embodiment, the mobile terminal may identify the target sound signal according to the pre-stored audio characteristics to determine the type of the target sound signal.

S916: and judging whether the target sound signal reaches a corresponding energy threshold value.

If yes, the process proceeds to S918, otherwise, S926 is executed. In this embodiment, the mobile terminal determines whether the target sound signal reaches the corresponding energy threshold, which is actually a way to reduce the false vibration of the motor, because in general, if the user's own touch operation triggers the output of the target sound signal, the target sound signal should be relatively large, but conversely, if the touch operation of another person triggers the output of the target sound signal, the sound heard at the angle of the user will be relatively small because the place where the target sound signal occurs is a certain distance away from the user in the game application. Therefore, if the energy of the target sound signal is low and does not reach the corresponding energy threshold, it may be basically determined that the target sound signal is not the target sound signal triggered by the user' S own touch operation, and thus, the mobile terminal may perform S926.

S918: and determining the touch position of the touch operation according to the touch operation monitoring result.

S920: and judging whether the touch position belongs to a vibration demand area.

If yes, the process proceeds to S922, otherwise, S926 is executed.

S922: the vibration parameter is determined according to the type of the target sound signal.

The vibration parameters determined in this embodiment include vibration frequency and vibration amplitude.

S924: and controlling the motor to vibrate according to the corresponding vibration parameters.

After the vibration parameters are determined, the mobile terminal can control the motor to vibrate according to the determined vibration parameters.

S926: it is determined whether an exit instruction for the target game application is received.

If yes, the process is ended, otherwise, S908 is continuously executed.

According to the mobile terminal vibration control method provided by the embodiment, the motor vibration is not controlled according to the output audio signal independently, and when the target sound signal is identified, through various means including determining whether the touch operation meeting the conditions exists or not, determining whether the size of the target sound signal meets the requirements or not and the like, some scenes that the motor vibration is not required are eliminated, so that the accuracy of the motor vibration is improved, and the game experience of a user is enhanced.

Third embodiment

The present embodiments provide a computer-readable storage medium including volatile or non-volatile, removable or non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, computer program modules or other data. Computer-readable storage media include, but are not limited to, RAM (Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), flash Memory or other Memory technology, CD-ROM (Compact disk Read-Only Memory), Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer.

The computer readable storage medium may store one or more computer programs that can be read, compiled and executed by one or more processors, and in this embodiment, the computer readable storage medium may store a mobile terminal vibration control program that can be executed by one or more processors to implement a process of implementing any one of the mobile terminal vibration control methods described in the foregoing embodiments.

The present embodiments also provide a computer program product comprising a computer readable means on which a computer program as shown above is stored. The computer readable means in this embodiment may include a computer readable storage medium as shown above. For example, the computer program product includes a mobile terminal, such as a mobile phone, a tablet, a wearable device, etc., as shown in fig. 12:

the mobile terminal 120 includes a processor 121, a memory 122, a motor driver 123, a motor 124, and a communication bus 125, wherein the processor 121 communicates with the memory 122 and the motor driver 123 through the communication bus 125, the motor driver 123 communicates with the motor 124, and the memory 122 may be the storage medium storing the mobile terminal vibration control program. The processor 121 may read the mobile terminal vibration control program, compile and execute a flow implementing the mobile terminal vibration control method described in the foregoing embodiment:

the processor 121 monitors a touch operation for a touch panel of the mobile terminal 120 when the mobile terminal 120 is determined to run the target game application in the foreground, and acquires an audio signal output by the mobile terminal 120. The processor 121 then controls the vibration of the motor of the mobile terminal 120 according to the touch operation monitoring result in combination with the audio signal.

In some examples of the embodiment, the manner in which the processor 121 obtains the audio signal output by the mobile terminal 120 includes any one of the following:

the first method is as follows: the processor 121 acquires an audio signal to be output through the audio output unit by the mobile terminal 120;

the second method comprises the following steps: the processor 121 collects an audio signal output from the mobile terminal 120 through an audio collecting unit.

In some examples of this embodiment, the processor 121 may determine that before the mobile terminal 120 runs the target game application in the foreground, the game space entry instruction may be further received, and then the game space interface is displayed according to the game space entry instruction, where an icon in the game space interface only includes at least one of a game application icon and a game control icon.

In some examples of this embodiment, the game control includes a vibration feedback function enabling control and an anti-shake function enabling control. Before the processor 121 acquires the audio signal output by the mobile terminal 120, it may be determined that a touch operation for the vibration feedback function enabling control is detected.

Optionally, in some examples of this embodiment, before the processor 121 controls the vibration of the motor of the mobile terminal 120 according to the touch operation monitoring result and the audio signal, it may be ensured that the touch operation directed to the anti-shake function enabling control is detected.

In some examples of the embodiment, when the processor 121 controls the vibration of the motor of the mobile terminal 120 according to the touch operation monitoring result and the audio signal, the touch position of the touch operation may be determined according to the touch operation monitoring result, and then it is determined that the touch position belongs to the vibration demand area, and then the processor 121 controls the motor of the mobile terminal 120 to vibrate according to the audio signal.

Optionally, before the processor 121 controls the motor of the mobile terminal 120 to vibrate according to the audio signal, the audio signal may be processed first, and it is determined that the audio signal includes a target sound signal, where the target sound signal is a sound signal accompanying the motor vibration when output is required.

In some examples, when the processor 121 controls the motor of the mobile terminal 120 to vibrate according to the audio signal, a vibration parameter of the motor may be determined according to the audio signal, where the vibration parameter includes at least one of a vibration frequency and a vibration amplitude. The processor 121 then controls the motor of the mobile terminal 120 to vibrate according to the vibration parameters.

Alternatively, when the processor 121 determines the vibration parameter according to the audio signal, the target sound signal may be obtained by filtering the audio signal through a track separation process, and then the target sound signal is identified based on the pre-stored audio features to determine the type of the target sound signal, and then the processor 121 determines the vibration parameter according to the type of the target sound signal.

When it is determined that the mobile terminal runs the target game application in the foreground, the mobile terminal and the computer-readable storage medium provided by the embodiment monitor the touch operation on the touch panel of the mobile terminal, acquire the audio signal output by the mobile terminal, and then control the vibration of the motor of the mobile terminal according to the touch operation monitoring result and the audio signal. Because the mobile terminal does not control the vibration of the motor according to the output audio signal in a game scene independently any more, but controls the vibration in combination with the touch operation detected by the touch panel, the mobile terminal can identify the scene that the audio signal meets the vibration condition but the user does not execute the touch operation meeting the vibration condition, the motor is prevented from vibrating in the scene, the false vibration probability is reduced, the precision degree of the vibration of the 4D intelligent vibration function is improved, the reality of the game scene and the precision degree of the user operation are improved, and the game experience of the user is greatly enhanced.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the embodiments of the present invention may be substantially or partially embodied in the form of a software product, where the computer software product is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk), and includes several instructions for enabling a terminal (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the methods described in the embodiments of the present invention.

While the embodiments of the present invention have been described with reference to the accompanying drawings, the embodiments of the present invention are not limited to the above-described embodiments, which are merely illustrative and not restrictive, and those skilled in the art can make various modifications without departing from the spirit and scope of the embodiments of the present invention as defined in the appended claims.

Claims

1. A mobile terminal vibration control method is characterized by comprising the following steps:

2. The mobile terminal vibration control method according to claim 1, wherein the manner of acquiring the audio signal output by the mobile terminal includes any one of:

acquiring an audio signal to be output by an audio output unit of the mobile terminal;

and acquiring the audio signal output by the mobile terminal through an audio acquisition unit.

3. The mobile terminal vibration control method of claim 1, wherein said determining that the mobile terminal is running the target game application in the foreground further comprises:

receiving a game space entering instruction;

4. The mobile terminal vibration control method according to claim 3, wherein the game control includes a vibration feedback function enabling control and an anti-shake function enabling control;

before the obtaining of the audio signal output by the mobile terminal, the method further includes:

5. The method for controlling vibration of a mobile terminal according to any one of claims 1-4, wherein the controlling vibration of the motor of the mobile terminal in combination with the audio signal according to the touch operation monitoring result comprises:

determining that the touch position belongs to a vibration demand area;

6. The mobile terminal vibration control method according to claim 5, wherein before controlling the motor of the mobile terminal to vibrate according to the audio signal, further comprising:

processing the audio signal;

and determining that the audio signal comprises a target sound signal, wherein the target sound signal is a sound signal accompanying the vibration of the motor when the target sound signal is required to be output.

7. The mobile terminal vibration control method according to claim 5, wherein said controlling a motor of the mobile terminal to vibrate according to the audio signal comprises:

determining a vibration parameter of the motor from the audio signal, the vibration parameter including at least one of a vibration frequency and a vibration amplitude;

8. The mobile terminal vibration control method of claim 7 wherein said determining a vibration parameter from said audio signal comprises:

identifying the target sound signal based on pre-stored audio features to determine the type of the target sound signal;

and determining the vibration parameter according to the type of the target sound signal.

9. A mobile terminal, characterized in that the mobile terminal comprises a processor, a memory, a motor drive, a motor and a communication bus;

the processor is respectively communicated with the memory and the motor drive through the communication bus, and the motor drive is in communication connection with the motor;

the processor is configured to execute one or more programs stored in the memory to implement the steps of the mobile terminal vibration control method according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores one or more programs which are executable by one or more processors to implement the steps of the mobile terminal vibration control method according to any one of claims 1 to 8.