WO2022116297A1

WO2022116297A1 - Method and apparatus for generating vibration effect, and terminal device and storage medium

Info

Publication number: WO2022116297A1
Application number: PCT/CN2020/137713
Authority: WO
Inventors: 向征; 张燕昕; 张玉蕾
Original assignee: 瑞声声学科技(深圳)有限公司; 瑞声光电科技(常州)有限公司
Priority date: 2020-12-01
Filing date: 2020-12-18
Publication date: 2022-06-09
Also published as: CN112506341B; CN112506341A

Abstract

A method and apparatus for generating a vibration effect, and a terminal device and a storage medium. The method comprises: acquiring a vibration data stream (101); acquiring a position and a size of a local peak point on an envelope curve of the vibration data stream (102); acquiring an intensity value of the vibration data stream according to the size of the local peak point (103); acquiring a spectrum curve of an adjacent local peak point according to the position of the local peak point (104); acquiring a sharpness value according to the frequency at which a peak point on the spectrum curve is located (105); and writing a correlation between the intensity value and the sharpness value into a file that can be identified by a corehaptics interface (106). By means of the method, the time consumption and labor cost of data conversion can be reduced.

Description

Method, device, terminal device and storage medium for generating vibration effect

The present invention requires the priority of the Chinese patent application filed on December 01, 2020 with the application number 202011392359.X and the invention titled "A method, device, terminal device and storage medium for generating a vibration effect", Its entire contents are incorporated herein by reference.

technical field

The present invention relates to the technical field of terminal device interaction, and in particular, to a method, device, terminal device and storage medium for generating a vibration effect.

Background technique

The CoreHaptics interface can add custom haptic feedback to applications, greatly enhancing the richness of human-machine interaction. It is convenient for developers to call down the iOS system to achieve rich vibration effects. Vibration data in the form of any data stream cannot be played through the haptic vibration interface. This requires converting the vibration data into data recognizable by the haptic vibration interface.

For designers, the haptic vibration interface only opens up two degrees of freedom, intensity and sharpness, for the design of vibration effects. In this way, for some long-term known vibration effects, such as vibration data obtained by sound effect conversion, it is necessary to find a kind of parameter description from "point-by-point vibration data" to "intensity + sharpness". conversion method.

In the prior art, the length of the point-by-point vibration effect is usually large, and manual conversion is used, which is very time-consuming and labor costs are high.

Therefore, it is necessary to provide an automatic conversion method.

technical problem

The purpose of the present invention is to provide a method for generating a vibration effect, which is used to solve the problems in the prior art that manual conversion is very time-consuming and labor costs are high.

technical solutions

In order to achieve one or part or all of the above purposes or other purposes, a first aspect of the embodiments of the present invention provides a method for testing non-linear parameters of a motor, including:

Get the vibration data stream;

Obtain the position and size of the local peak point on the envelope curve of the vibration data stream;

Obtain the intensity value of the vibration data stream according to the size of the local peak point;

According to the position of the local peak point, obtain the spectral curve of the adjacent local peak point;

Obtain the sharpness value according to the frequency at which the peak point on the spectrum curve is located;

The corresponding relationship between the intensity value and the sharpness value is written into a file identifiable by the haptic vibration interface.

In one embodiment, the vibration data stream includes displacement data, and the acquiring the vibration data stream includes:

The displacement data is normalized to the maximum displacement to obtain relative displacement data.

In one embodiment, the obtaining the position and size of the local peak point on the envelope curve of the vibration data stream includes:

obtaining an envelope curve of the relative displacement data;

Obtain the location and size of the local local peak point on the envelope curve.

In one of the embodiments, obtaining the spectral curve of adjacent local peak points according to the position of the local peak point includes:

Get the position of the current local peak point;

Get the position of the next local peak point;

According to the position of the current local peak point and the position of the next local peak point, a spectrum curve from the current local peak point to the next local peak point is acquired.

In one embodiment, the obtaining the sharpness value according to the frequency at which the peak point on the spectrum curve is located includes:

obtaining the frequency at which the peak point on the spectrum curve is located;

Normalize the frequency at which the peak point is located according to the range of the sharpness value to obtain a relative frequency value;

The corresponding sharpness value is obtained according to the relative frequency value.

In one of the embodiments, before the acquiring the vibration data stream, the method further comprises:

Get the current data stream;

If the current data stream is a non-vibration data stream, converting the non-vibration data stream into the vibration data stream.

In one embodiment, if the current data stream is a non-vibration data stream, converting the non-vibration data stream to the vibration data stream includes:

If the current data stream is a non-vibration data stream, the frequency range of the non-vibration data stream is mapped to the vibration frequency range of the vibration data stream.

A second aspect of the embodiments of the present invention provides an apparatus for generating a vibration effect, including:

The first acquisition module is used to acquire the vibration data stream;

The second acquisition module is used for acquiring the position and size of the local peak point on the envelope curve of the vibration data stream;

a third acquiring module, configured to acquire the intensity value of the vibration data stream according to the size of the local peak point;

a fourth acquisition module, configured to acquire spectrum curves of adjacent local peak points according to the positions of the local peak points;

a fifth acquisition module, configured to acquire a sharpness value according to the frequency at which the peak point on the spectrum curve is located;

The writing module is used for writing the corresponding relationship between the intensity value and the sharpness value into a file identifiable by the haptic vibration interface.

A third aspect of the embodiments of the present invention provides a computer-readable storage medium on which a computer program is stored, when the computer program is executed on a computer, the computer is caused to perform the above-mentioned generation of the vibration effect method.

A fourth aspect of the embodiments of the present invention provides a terminal device, including a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor executes all When the computer program is described, the steps of the method for generating the vibration effect as described above are realized.

beneficial effect

Embodiments of the present invention provide a method, device, terminal device and storage medium for generating a vibration effect, through which the position and size of a local peak point on an envelope curve of a vibration data stream can be obtained. Then, the intensity value of the vibration data stream is obtained according to the size of the local peak point; according to the position of the local peak point, the spectral curve of the adjacent local peak point is obtained. After that, the sharpness value is obtained according to the frequency at which the peak point on the spectrum curve is located. Finally, the corresponding relationship between the intensity value and the sharpness value is written into a file identifiable by the tactile vibration interface. The process of this method is completed automatically and does not require manual conversion. And in the embodiment of the present invention, the haptic vibration interface can automatically identify the corresponding relationship between the intensity value and the sharpness value in the file, so as to play the vibration effect. Therefore, the embodiments of the present invention can reduce the time-consuming and labor costs of data conversion.

Description of drawings

1 is a schematic flowchart of a method for generating a vibration effect according to Embodiment 1 of the present invention;

2 is a schematic flowchart of a method for generating a vibration effect according to Embodiment 2 of the present invention;

3 is a schematic structural diagram of a device for generating a vibration effect provided in Embodiment 3 of the present invention;

FIG. 4 is a schematic structural diagram of a terminal device according to Embodiment 4 of the present invention.

Embodiments of the present invention

The present invention will be further described below with reference to the accompanying drawings and embodiments.

The Haptic Vibration Interface is a brand-new Application Program Interface (API) that can add custom haptic feedback to applications, greatly enhancing the richness of human-computer interaction. The Haptic Vibration interface lets applications play custom haptic patterns made from basic building blocks called haptic events. Events can be transient, like the feedback you get from a toggle switch, or continuous, like a vibration from a bell. Developers can use either transient or continuous modes independently, or build rich modes based on precise combinations of the two. Of course, the haptic vibration interface can also be used to play custom audio content.

Vibration data in the form of any data stream cannot be played through the haptic vibration interface. This requires converting the vibration data into data recognizable by the haptic vibration interface.

For designers, the haptic vibration interface only opens up two degrees of freedom, intensity and sharpness, for the design of vibration effects. In this way, for some long-term known vibration effects, such as vibration data obtained by sound effect conversion, it is necessary to find a conversion method from "point-by-point vibration data" to "parametric description of intensity + sharpness".

Therefore, it is necessary to provide an automatic conversion method, so that the haptic vibration interface can play the desired vibration effect.

FIG. 1 is a schematic flowchart of a method for generating a vibration effect provided by Embodiment 1 of the present invention. As shown in FIG. 1 , the method for generating a vibration effect provided by Embodiment 1 may include the following steps:

Step 101: Acquire a vibration data stream.

The execution subject of this embodiment is a device for generating a vibration effect, and the device for generating a vibration effect may specifically be a terminal device, such as a smart phone, a tablet computer, a desktop computer, a notebook, and the like.

In this embodiment, the vibration data stream is obtained, and the vibration data stream has a certain frequency range, for example, the bandwidth of the vibration data stream is 30 Hz to 500 Hz. This frequency range characterizes the vibration frequency range that the human hand can perceive. Displacement data is often used to characterize the data flow of vibration.

Step 102: Obtain the position and size of the local peak point on the envelope curve of the vibration data stream.

Each event has two properties that control the haptics represented by the haptic event parameter (CHHapticEventParameter). Each attribute has a parameter ID and a value between 0 and 1. For example, the parameter with ID .hapticIntensity represents the intensity of the feeling; the higher the parameter value, the stronger the intensity of the feeling. The parameter with ID .hapticSharpness represents a physical quality, sharpness, that has a precise mechanical feel at the high end of the scale. On the low end, it has a more rounded organic feel. It should be noted that both the intensity value and the sharpness value are relative values, and both are values between 0 and 1.

In the haptic vibration interface, whichever building block is chosen to generate a custom haptic, its strength and sharpness can be controlled. Intensity changes the magnitude or force of a haptic sensation, and sharpness allows the user to characterize the haptic experience. For example, sharpness can be used to convey a clear, precise, and mechanical experience (a sharpness value à 1), or a soft, rounded, and natural experience (a sharpness value à 0).

The vibration data stream can be a transient data stream, a continuous data stream, or a combined data stream of the transient data stream and the continuous data stream.

In order to obtain the intensity value of different points in the vibration data stream, that is, the haptic intensity control point (HapticIntensityControl). It is necessary to extract the envelope curve of the vibration data stream, and find the position and size of the local peak point on the envelope curve, that is, find the abscissa and ordinate of the local peak point, where the abscissa is the time, and the ordinate is the intensity value. It can be seen that the position of the local peak point is the abscissa of the local peak point on the envelope curve, which can be used for the extraction of frequency information in the next step, and the size of the local peak point is the ordinate of the local peak point on the envelope curve, which can be used for extracting intensity information. The data processing of this part can be carried out in software, such as in MATLAB software. Using software for data processing can save labor costs while improving data processing efficiency and accuracy.

Step 103: Obtain the intensity value of the vibration data stream according to the size of the local peak point.

After obtaining the position and size of the local peak point on the envelope curve of the vibration data stream, according to the size of the local peak point, that is, according to the ordinate of the local peak point on the envelope curve, the intensity value of the vibration data stream can be directly obtained. . The intensity value is a relative value with a magnitude between 0 and 1. In this way, the intensity value can be limited to a certain range, so as to eliminate the bad influence caused by the singular sample data, and also prevent the data overflow.

Step 104: Acquire spectral curves of adjacent local peak points according to the positions of the local peak points.

In order to obtain the sharpness value of different points, that is, the haptic sharpness control point (HapticSharpnessControl). After obtaining the position and size of the local peak point on the envelope curve of the vibration data stream, the spectral curve of the adjacent local peak point can be obtained according to the position of the local peak point, that is, the local peak point and its adjacent local peak point spectrum curve. When there are multiple local peak points, the spectral curves of two adjacent local peak points can be obtained separately, that is, the spectral curves of every two adjacent local peak points can be obtained in sections. In this way, the sharpness values of multiple different points can be obtained later.

Step 105: Acquire a sharpness value according to the frequency at which the peak point on the spectrum curve is located.

Spectrum refers to the representation of a signal in the time domain in the frequency domain. It can be obtained by performing Fourier transform on the signal. The result can be an amplitude spectrum. The amplitude spectrum takes the amplitude as the vertical axis and the frequency as the horizontal axis. frequency changes. Based on this, after obtaining the spectral curve of the adjacent local peak points, the frequency corresponding to the peak point on the spectral curve can be found, and the point with the largest absolute value of the amplitude is the peak point. Therefore, according to the point corresponding to the point with the largest absolute value of the amplitude frequency, the frequency corresponding to the peak point on the spectrum curve can be directly obtained.

Sharpness describes the feeling related to frequency components, which is the comparison of high-frequency energy and total energy in the vibration data stream. Therefore, according to the frequency of the peak point on the spectrum curve, the sharpness value can be obtained. Since the spectrum curve is the spectrum curve of two adjacent local peak points, when there are multiple local peak points, sharpness values of different points will be obtained.

Step 106: Write the corresponding relationship between the intensity value and the sharpness value into a file identifiable by the haptic vibration interface.

In the haptic vibration interface, linear interpolation can be performed between parameter values through the haptic parameter curve (CHHapticParameterCurve) to ensure a smooth transition, which is suitable for the design of custom curves. Haptic parameter curves define multi-point haptic effects.

After obtaining the intensity value and sharpness value of each point, the two parts of information need to be written into a file that can be recognized by the haptic vibration interface by means of a haptic parameter curve, such as a file in .AHAP format, and then the The above-mentioned intensity values and sharpness values that can express the vibration effect are stored in the .AHAP format file in a parameterized form, and the .AHAP format file is described in the form of JSON. Usually a simple script is needed to implement this function, which is used to drive the motor of the terminal device to vibrate, so as to play the vibration effect expected by the designer.

It can be understood that, in this embodiment of the present invention, the terminal device can acquire the position and size of the local peak point on the envelope curve of the vibration data stream. Then, the intensity value of the vibration data stream is obtained according to the size of the local peak point; according to the position of the local peak point, the spectral curve of the adjacent local peak point is obtained. After that, the sharpness value is obtained according to the frequency at which the peak point on the spectrum curve is located. Finally, the corresponding relationship between the intensity value and the sharpness value is written into a file identifiable by the tactile vibration interface. The process of this method is completed automatically and does not require manual conversion. And in the embodiment of the present invention, the haptic vibration interface can automatically identify the corresponding relationship between the intensity value and the sharpness value in the file, so as to play the vibration effect. Therefore, the embodiments of the present invention can reduce the time-consuming and labor costs of data conversion.

FIG. 2 is a schematic flowchart of a method for generating a vibration effect provided by Embodiment 2 of the present invention. As shown in FIG. 2 , the method for generating a vibration effect provided by Embodiment 2 may include the following steps:

Step 201: Acquire the current data stream.

In this embodiment, the terminal device can acquire the current data stream.

Step 202: If the current data stream is a non-vibration data stream, convert the non-vibration data stream into a vibration data stream.

After obtaining the current data stream, determine whether the current data stream is a vibration data stream. If the current data stream is a non-vibration data stream, for example, the non-vibration data stream can be an audio data stream or some other effect files, such as Animation effect files, etc. When it is determined that the current data stream is a non-vibration data stream, in order to obtain data that can be recognized by the haptic vibration interface, it is first necessary to convert the non-vibration data stream into a vibration data stream. The vibration data stream can be displacement data, or other than displacement data. Other vibration data streams other than the data, in order to facilitate the subsequent conversion from the vibration data streams to the two parameters of intensity and sharpness.

Since the frequency range of non-vibration data stream and vibration data stream is different, taking audio data stream as an example, the bandwidth of audio data is usually 20Hz~20kHz, while the bandwidth of vibration data stream is 30Hz~500Hz. The former characterizes the sound range that the human ear can hear, while the latter characterizes the vibration frequency range that the human hand can perceive. Therefore, when converting the non-vibration data stream into the vibration data stream, it is necessary to map the frequency range of the non-vibration data stream to the vibration frequency range of the vibration data stream. When the non-vibration data stream is converted into a vibration data stream, the scope of application of the present invention can be expanded, that is, the vibration data stream can be converted into parameters such as the intensity and sharpness of the vibration effect, and the non-vibration data stream can be converted into After vibrating the data stream, the converted vibration data stream is converted into parameters such as the intensity and sharpness of the vibration effect. Therefore, the present invention is applicable to both non-vibration data streams and vibration data streams, and has a wide range of applications.

Based on this, in an embodiment, if the current data stream is a non-vibration data stream, converting the non-vibration data stream into a vibration data stream may include:

If the current data stream is a non-vibration data stream, map the frequency range of the non-vibration data stream to the vibration frequency range of the vibration data stream.

When performing frequency range mapping, methods such as feature mapping or frequency shifting may be used to perform data conversion in different frequency ranges. Since it is an existing method, it will not be repeated here.

Step 203: Normalize the displacement data to the maximum displacement to obtain relative displacement data.

It should be noted that since the intensity parameter in the haptic vibration interface is a relative value, in order to correspond to it, it is necessary to normalize the displacement data with the maximum displacement Xmax to obtain the relative displacement value, that is, convert the displacement data into a value between 0 and 0. The relative displacement data between 1. In this way, the displacement data can be limited within a certain range, so as to eliminate the adverse effects caused by the singular sample data, and also prevent data overflow.

Step 204: Obtain an envelope curve of the relative displacement data.

After normalizing the displacement data, the relative displacement data is obtained. For the relative displacement data, the information of the envelope curve of the relative displacement data can be extracted. For example, the information of the envelope curve of the relative displacement data can be extracted by using the envelope command. Specifically, the envelope function in MATLAB software, such as the envelope function, can be used. , directly generate the signal envelope and modify its calculation method. For example, you can adjust the length of the Hilbert filter used to obtain the envelope of the analyzed signal, because using too small a filter length will lead to envelope distortion, Therefore, by adjusting the length of the Hilbert filter, the distortion of the signal envelope can be prevented. Thus, the envelope curve of the relative displacement data can be obtained.

Step 205: Obtain the position and size of the local peak point on the envelope curve.

When the envelope curve of the relative displacement data is obtained, the local peak point on the envelope curve can be found, and then the position and size of the local peak point on the envelope curve can be obtained, for example, by finding the peak function (findpeaks) To obtain the position and size of the local peak, the abscissa and ordinate of the local peak point on the envelope curve can be obtained, where the abscissa is the time and the ordinate is the intensity value. It should be noted that when there are multiple local peak points, the positions and sizes of multiple different local peak points can be obtained. Among them, the size represents the intensity information, and the position is used for the extraction of the frequency information in the next step.

Step 206: Obtain the intensity value of the vibration data stream according to the size of the local peak point.

The intensity value of the vibration data stream can be obtained according to the size of the local peak point (ie, the ordinate), and the specific embodiment of step 206 can refer to the embodiment of step 103, which will not be repeated here.

Step 207: Obtain the position of the current local peak point.

Since there may be multiple acquired local peak points, the positions of multiple local peak points are idx_k, k=1, 2, 3... . Obtain the position of the current local peak point, for example, the position of the current local peak point is the ith position, that is, idx_k(i).

Step 208: Obtain the position of the next local peak point.

Since the spectrum curve is obtained in segments, each segment of the spectrum curve is the spectrum curve of two adjacent local peak points. Therefore, after obtaining the position idx_k(i) of the current local peak point, it is necessary to obtain the next local peak point. The position idx_k(i+1) of the next local peak point is the local peak point adjacent to the position of the current local peak point. By obtaining the position idx_k(i+1) of the next local peak point, it is easy to find The spectral curve of the two adjacent local peak points.

Step 209: Acquire a spectrum curve from the current local peak point to the next local peak point according to the position of the current local peak point and the position of the next local peak point.

After obtaining the position idx_k(i) of the current local peak point and the position idx_k(i+1) of the next local peak point, the position idx_k(i) of the current local peak point can be obtained to the next local peak point idx_k( i+1) spectrum curve, that is, perform fast Fourier transform:

X = fft(x( idx_k(i) : idx_k(i+1) ))

Among them, X is the spectrum curve, x( idx_k(i) ) represents the function of the signal at the time of idx_k(i), fft is the fast Fourier transform, which is a fast algorithm of discrete Fourier transform, which converts the time domain function into frequency Domain functions, of course, Laplace transform can also be used to convert time domain functions into frequency domain functions. On the spectrum curve, the abscissa is the frequency, and the ordinate is the amplitude (amplitude).

Only the acquisition method of the spectral curves of two adjacent local peak points is given here. Since there may be multiple local peak points, the acquisition method of the spectral curves of other adjacent local peak points is the same, that is, for different local peak points For the adjacent local peak points, fast Fourier transform can be performed in segments, which will not be repeated here, so that the segmental acquisition of the spectral curves of different adjacent local peak points can be completed.

Step 210: Acquire the frequency at which the peak point on the spectrum curve is located.

On the obtained spectrum curve, find the peak point on the spectrum curve, that is, solve the absolute value of X, find the maximum absolute value, and the point corresponding to the maximum absolute value is the peak point. Next, according to the position of the abscissa of the peak point, the frequency at which the peak point is located, that is, the main energy frequency, can be obtained. When there are multiple peak points, multiple frequencies corresponding to the multiple peak points can be obtained. Since each spectrum curve has one main energy frequency, multiple main energy frequencies corresponding to the multiple spectrum curves can be obtained.

Step 211: Normalize the frequency at which the peak point is located according to the range of the sharpness value to obtain a relative frequency value.

After obtaining the frequency of the peak point on the spectrum curve, normalize the frequency of the peak point based on the range of the sharpness value of the haptic vibration interface, such as mapping the frequency to the frequency range of [80, 230], if the frequency exceeds the upper limit of the frequency The frequency of , use the upper limit to normalize the frequency to 1, and use the lower limit to normalize the frequency to 0. After normalization, the relative frequency value can be obtained. In this way, the frequency can be limited within a certain range, thereby eliminating the adverse effects caused by singular sample data, and also preventing data overflow.

Step 212: Obtain a corresponding sharpness value according to the relative frequency value.

Sharpness describes the feeling related to frequency components, which is the comparison of high-frequency energy and total energy in the vibration data stream. Therefore, according to the relative frequency value corresponding to the frequency at which the peak point on the spectrum curve is located, the sharpness value can be obtained. Since the spectrum curve is the spectrum curve of two adjacent local peak points, when there are multiple local peak points, sharpness values of different points will be obtained.

Step 213: Write the corresponding relationship between the intensity value and the sharpness value into a file identifiable by the haptic vibration interface.

For the specific embodiment of step 213, reference may be made to the embodiment of step 106, and details are not repeated here.

As an example, for example, by defining the duration of the continuous vibration (HapticContinuous) 0.055625s, its basic strength value is 1, and its basic sharpness value is 0; Perform segment definition: where the intensity value of each point is multiplied by the base intensity value, and the sharpness value of each point is added to the base sharpness value. In this way, the point-by-point vibration data stream (such as displacement data) is converted offline into parameters in the parameter curve type of the haptic vibration interface, and the converted parameters can be written into the AHAP file.

It can be understood that, in this embodiment of the present invention, for any vibration data stream (such as displacement data) in the form of a data stream, or a non-vibration data stream, it cannot be played through the haptic vibration interface itself, and the vibration data stream must be Convert the data to a certain rule, or, now convert the non-vibration data stream to a vibration data stream, and then convert the vibration data stream to data of a certain rule, such as a haptic parameter curve. In the embodiment of the present invention, calculation and conversion are performed from the two dimensions of intensity and sharpness, and finally abstract data that can be recognized by the haptic vibration interface is obtained, which is convenient for playing the vibration effect on the terminal device. The process of this method is completed automatically, and no manual conversion is required. And in the embodiment of the present invention, the haptic vibration interface can automatically identify the corresponding relationship between the intensity value and the sharpness value in the file, so as to play the vibration effect. Therefore, the embodiments of the present invention can reduce the time-consuming and labor costs of data conversion.

FIG. 3 is a schematic structural diagram of a device for generating vibration effects provided in Embodiment 3 of the present invention. As shown in FIG. 3 , the device for generating vibration effects provided by this embodiment includes the following modules:

The first acquisition module 301 is used to acquire the vibration data stream;

The second acquisition module 302 is used to acquire the position and size of the local peak point on the envelope curve of the vibration data stream;

The third obtaining module 303 is configured to obtain the intensity value of the vibration data stream according to the size of the local peak point;

a fourth obtaining module 304, configured to obtain spectral curves of adjacent local peak points according to the positions of the local peak points;

The fifth obtaining module 305 is configured to obtain the sharpness value according to the frequency at which the peak point on the spectrum curve is located;

The writing module 306 is configured to write the corresponding relationship between the intensity value and the sharpness value into a file identifiable by the haptic vibration interface.

The third embodiment provides an apparatus for generating a vibration effect, which is used to implement the method for generating a vibration effect described in the first embodiment, wherein the functions of each module can refer to the corresponding description in the method embodiment, and its realization principle and technical effect similar, and will not be repeated here.

FIG. 4 is a schematic diagram of a terminal device according to Embodiment 4 of the present invention. As shown in FIG. 4 , the terminal device 40 of this embodiment includes: a processor 400, a memory 401, and a computer program 402 stored in the memory 401 and executable on the processor 400, such as a program for generating vibration effects . When the processor 400 executes the computer program 402 , the steps in the foregoing embodiments of the methods for generating vibration effects are implemented, for example, steps 101 to 106 shown in FIG. 1 . Alternatively, when the processor 400 executes the computer program 402, the functions of the modules in the foregoing device embodiments are implemented, for example, the functions of the modules 301 to 306 shown in FIG. 3 .

Exemplarily, the computer program 402 can be divided into one or more modules/units, and the one or more modules/units are stored in the memory 401 and executed by the processor 400 to complete the this invention. The one or more modules/units may be a series of computer program instruction segments capable of performing specific functions, and the instruction segments are used to describe the execution process of the computer program 402 in the terminal device 40 . For example, the computer program 402 can be divided into a first acquisition module, a second acquisition module, a third acquisition module, a fourth acquisition module, a fifth acquisition module and a writing module (unit modules in a virtual device), each module The specific functions are as follows:

The first acquisition module is used to acquire the vibration data stream;

The second acquisition module is used to acquire the position and size of the local peak point on the envelope curve of the vibration data stream;

The third obtaining module is used to obtain the intensity value of the vibration data stream according to the size of the local peak point;

a fourth acquisition module, used for acquiring the spectral curve of adjacent local peak points according to the position of the local peak point;

The fifth acquisition module is used to acquire the sharpness value according to the frequency at which the peak point on the spectrum curve is located;

The writing module is used to write the corresponding relationship between the intensity value and the sharpness value into a file identifiable by the haptic vibration interface.

The terminal device 40 may be a computing device such as a smart phone, a tablet computer, a desktop computer, and a notebook. The terminal device 40 may include, but is not limited to, a processor 400 and a memory 401 . Those skilled in the art can understand that FIG. 4 is only an example of the terminal device 40 , and does not constitute a limitation on the terminal device 40 , and may include more or less components than shown, or combine some components, or different components For example, the terminal device 40 may further include an input and output device, a network access device, a bus, and the like.

The so-called processor 400 may be a central processing unit (Central Processing Unit, CPU), other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application-specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf Programmable Gate Array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The memory 401 may be an internal storage unit of the terminal device 40 , such as a hard disk or a memory of the terminal device 40 . The memory 401 may also be an external storage device of the terminal device 40, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) equipped on the terminal device 40 card, flash card (Flash Card) and so on. Further, the memory 401 may also include both an internal storage unit of the terminal device 40 and an external storage device. The memory 401 is used to store the computer program and other programs and data required by the terminal device 40 . The memory 401 can also be used to temporarily store data that has been output or will be output.

Those skilled in the art can clearly understand that, for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. The module is completed, that is, the internal structure of the terminal device is divided into different functional units or modules, so as to complete all or part of the functions described above. Each functional unit and module in the embodiment may be integrated in one processing unit, or each unit may exist physically alone, or two or more units may be integrated in one unit, and the above-mentioned integrated units may adopt hardware. It can also be realized in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing from each other, and are not used to limit the protection scope of the present invention. For the specific working processes of the units and modules in the above-mentioned system, reference may be made to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

In the foregoing embodiments, the description of each embodiment has its own emphasis. For parts that are not described or described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of the present invention.

In the embodiments provided by the present invention, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other manners. For example, the apparatus/terminal device embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units. Or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

The integrated modules/units, if implemented in the form of software functional units and sold or used as independent products, may be stored in a computer-readable storage medium. Based on this understanding, the present invention can implement all or part of the processes in the methods of the above embodiments, and can also be completed by instructing relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium. When the program is executed by the processor, the steps of the foregoing method embodiments can be implemented. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file or some intermediate form, and the like. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, removable hard disk, magnetic disk, optical disk, computer memory, Read-Only Memory (ROM) , Random Access Memory Memory, RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content contained in the computer-readable media may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, the computer-readable media Electric carrier signals and telecommunication signals are not included.

It should be understood that the size of the sequence numbers of the steps in the above embodiments does not mean the sequence of execution, and the execution sequence of each process should be determined by its functions and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.

The technical features of the above embodiments can be combined arbitrarily. In order to make the description simple, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features It is considered to be the range described in this specification.

The above are only the embodiments of the present invention. It should be pointed out that for those of ordinary skill in the art, improvements can be made without departing from the inventive concept of the present invention, but these belong to the present invention. scope of protection.

Claims

A method for generating a vibration effect, comprising:

Get the vibration data stream;

Obtain the position and size of the local peak point on the envelope curve of the vibration data stream;

Obtain the intensity value of the vibration data stream according to the size of the local peak point;

According to the position of the local peak point, obtain the spectral curve of the adjacent local peak point;

Obtain the sharpness value according to the frequency at which the peak point on the spectrum curve is located;

The corresponding relationship between the intensity value and the sharpness value is written into a file identifiable by the haptic vibration interface.
The method for generating a vibration effect according to claim 1, wherein the vibration data stream comprises displacement data, and the acquiring the vibration data stream comprises:

The displacement data is normalized to the maximum displacement to obtain relative displacement data.
The method for generating a vibration effect according to claim 2, wherein the obtaining the position and size of the local peak point on the envelope curve of the vibration data stream comprises:

obtaining an envelope curve of the relative displacement data;

Obtain the location and size of the local local peak point on the envelope curve.
The method for generating a vibration effect according to claim 3, wherein the obtaining the spectral curve of the adjacent local peak points according to the position of the local peak point comprises:

Get the position of the current local peak point;

Get the position of the next local peak point;

According to the position of the current local peak point and the position of the next local peak point, a spectrum curve from the current local peak point to the next local peak point is acquired.
The method for generating a vibration effect according to claim 4, wherein the obtaining the sharpness value according to the frequency at which the peak point on the spectrum curve is located comprises:

obtaining the frequency at which the peak point on the spectrum curve is located;

Normalize the frequency at which the peak point is located according to the range of the sharpness value to obtain a relative frequency value;

The corresponding sharpness value is obtained according to the relative frequency value.
The method for generating a vibration effect according to claim 1, wherein before the acquiring the vibration data stream, the method further comprises:

Get the current data stream;

If the current data stream is a non-vibration data stream, the non-vibration data stream is converted into the vibration data stream.
The method for generating a vibration effect according to claim 6, wherein if the current data stream is a non-vibration data stream, converting the non-vibration data stream to the vibration data stream comprises:

If the current data stream is a non-vibration data stream, the frequency range of the non-vibration data stream is mapped to the vibration frequency range of the vibration data stream.
A device for generating a vibration effect, comprising:

The first acquisition module is used to acquire the vibration data stream;

The second acquisition module is used for acquiring the position and size of the local peak point on the envelope curve of the vibration data stream;

a third acquiring module, configured to acquire the intensity value of the vibration data stream according to the size of the local peak point;

a fourth acquisition module, configured to acquire spectrum curves of adjacent local peak points according to the positions of the local peak points;

a fifth acquisition module, configured to acquire a sharpness value according to the frequency at which the peak point on the spectrum curve is located;

The writing module is used for writing the corresponding relationship between the intensity value and the sharpness value into a file identifiable by the haptic vibration interface.
A terminal device, comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that, when the processor executes the computer program, the process according to claim 1 to Steps of the method for generating a vibration effect according to any one of 7.
A computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed on a computer, the computer is made to execute the vibration according to any one of claims 1 to 7 How to generate the effect.