CN112466267A - Vibration generation method, vibration control method and related equipment - Google Patents
Vibration generation method, vibration control method and related equipment Download PDFInfo
- Publication number
- CN112466267A CN112466267A CN202011326608.5A CN202011326608A CN112466267A CN 112466267 A CN112466267 A CN 112466267A CN 202011326608 A CN202011326608 A CN 202011326608A CN 112466267 A CN112466267 A CN 112466267A
- Authority
- CN
- China
- Prior art keywords
- vibration
- note
- energies
- audio
- audio signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 230000005236 sound signal Effects 0.000 claims abstract description 59
- 238000010606 normalization Methods 0.000 claims abstract description 24
- 230000000694 effects Effects 0.000 claims abstract description 22
- 238000007781 pre-processing Methods 0.000 claims abstract description 13
- 238000004590 computer program Methods 0.000 claims description 12
- 238000004364 calculation method Methods 0.000 claims description 7
- 230000033764 rhythmic process Effects 0.000 claims description 4
- 238000005070 sampling Methods 0.000 description 12
- 230000008447 perception Effects 0.000 description 6
- 230000035807 sensation Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- METKIMKYRPQLGS-UHFFFAOYSA-N atenolol Chemical compound CC(C)NCC(O)COC1=CC=C(CC(N)=O)C=C1 METKIMKYRPQLGS-UHFFFAOYSA-N 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/0008—Associated control or indicating means
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/36—Accompaniment arrangements
- G10H1/40—Rhythm
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02P—CONTROL OR REGULATION OF ELECTRIC MOTORS, ELECTRIC GENERATORS OR DYNAMO-ELECTRIC CONVERTERS; CONTROLLING TRANSFORMERS, REACTORS OR CHOKE COILS
- H02P25/00—Arrangements or methods for the control of AC motors characterised by the kind of AC motor or by structural details
- H02P25/02—Arrangements or methods for the control of AC motors characterised by the kind of AC motor or by structural details characterised by the kind of motor
- H02P25/032—Reciprocating, oscillating or vibrating motors
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02P—CONTROL OR REGULATION OF ELECTRIC MOTORS, ELECTRIC GENERATORS OR DYNAMO-ELECTRIC CONVERTERS; CONTROLLING TRANSFORMERS, REACTORS OR CHOKE COILS
- H02P7/00—Arrangements for regulating or controlling the speed or torque of electric DC motors
- H02P7/02—Arrangements for regulating or controlling the speed or torque of electric DC motors the DC motors being of the linear type
Abstract
The invention relates to a vibration generation method and device, a vibration control method and system, an electronic device and a storage medium. The vibration generation method includes: identifying audio beats in an audio signal; acquiring a plurality of note energies of the audio signal according to the audio beat; respectively carrying out normalization preprocessing on the multiple note energies to obtain multiple normalized energies; and generating a haptic vibration file corresponding to the audio signal according to the plurality of normalized energies. By adopting the method, the touch vibration effect can be flexibly matched with the beat of the audio signal, and the matching accuracy is high.
Description
Technical Field
The present invention relates to the field of vibration driving technologies, and in particular, to a vibration generation method and apparatus, a vibration control method and system, an electronic device, and a storage medium.
Background
With the improvement of living standard, the requirement of people on the listening experience of music is higher and higher. People desire not only good auditory perception but also tactile perception.
In the related art, a vibration motor is provided in a music playing device, and when music is played, the motor is controlled to vibrate so that the music playing device generates a haptic vibration effect.
However, in the current vibration control method, since the haptic vibration effect generated by the motor and the tempo of the music are not matched with each other, when the music is played, the auditory sensation and the haptic sensation are not coordinated, so that the user experience of listening sensation is poor.
Disclosure of Invention
In view of the above, it is desirable to provide a vibration generation method and apparatus, a vibration control method and system, an electronic device, and a storage medium, which can flexibly match a haptic vibration effect with a beat of an audio signal and have high matching accuracy.
The invention provides a vibration generation method, which comprises the following steps:
identifying audio beats in an audio signal;
acquiring a plurality of note energies of the audio signal according to the audio beat;
respectively carrying out normalization preprocessing on the multiple note energies to obtain multiple normalized energies; wherein the note energy and the normalized energy are arranged in a one-to-one correspondence manner;
and generating a haptic vibration file corresponding to the audio signal according to the plurality of normalized energies.
Preferably, the obtaining of the plurality of note energies of the audio signal according to the audio beat includes:
acquiring a plurality of notes in the audio beat according to a preset time interval; wherein, the time interval between two adjacent notes is the preset time interval;
the note energy of each of the notes is obtained.
Preferably, the step of obtaining the note energy of each note comprises:
and in the same audio rhythm, calculating and obtaining the note energy of each note according to the amplitude of the audio signal corresponding to each note.
Preferably, the performing normalization preprocessing on the plurality of note energies respectively to obtain a plurality of normalized energies includes:
and in the same audio rhythm, obtaining the normalized energy corresponding to each note according to the maximum value of the energies of the notes and the note energy of each note.
Preferably, the step of generating a haptic vibration file corresponding to the audio signal according to the normalized energy includes:
marking the note corresponding to the normalized energy higher than a preset energy threshold value as a tactile vibration point;
and generating a haptic vibration file corresponding to the audio signal according to each haptic vibration point.
The present invention provides a vibration control method, including the steps of the vibration generation method of the present invention, further including:
extracting a touch vibration point in a touch vibration file;
generating a vibration driving voltage corresponding to the tactile vibration points according to each tactile vibration point;
according to the vibration driving voltage, the motor is driven to vibrate to generate a haptic vibration effect.
The present invention provides a vibration generation device, including:
the audio processing module is used for identifying audio beats in the audio signal; and the number of the first and second groups,
the calculation processing module is used for acquiring a plurality of note energies of the audio signal according to the audio beat; the energy normalization device is used for respectively carrying out normalization preprocessing on the multiple note energies to obtain multiple normalization energies, wherein the note energies and the normalization energies are arranged in a one-to-one correspondence manner; for generating a haptic vibration file corresponding to the audio signal based on the plurality of normalized energies.
The present invention provides a vibration control system, comprising:
the vibration generation device is used for inputting a tactile vibration file;
the tactile vibration identification module is used for extracting tactile vibration points in a tactile vibration file and generating vibration driving voltages corresponding to the tactile vibration points according to the tactile vibration points; and the number of the first and second groups,
and the vibration unit is used for vibrating according to the vibration driving voltage to generate a tactile vibration effect.
The invention provides an electronic device comprising a memory storing a computer program and a processor implementing the steps of the vibration generation method and/or the vibration control method of the invention when executing the computer program.
The present invention provides a computer-readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the vibration generation method of the invention and/or the steps of the vibration control method of the invention.
According to the vibration generation method and the device, the normalized energy of each note is obtained by calculating the note energy of each note through a normalized optimization algorithm, the haptic vibration file corresponding to the audio signal is generated according to the normalized energy, the flexible matching between the haptic vibration effect and the beat of the audio signal is realized, meanwhile, the problem of insufficient local audio intensity is effectively avoided due to the fact that the normalized energy of each note is higher than the note energy of the note, the matching accuracy between the haptic vibration effect and the beat of the audio signal is improved, the harmony between the auditory sensation and the haptic sensation is good, and conditions are provided for improving the auditory sensation experience of a user; in addition, the vibration generation method is applied to the vibration control method and the system thereof, when the audio signal is played, the vibration control method and the system thereof can generate the touch vibration effect according to the touch vibration file, the touch vibration effect is highly matched with the beat of the audio signal, the harmony between the auditory perception and the touch perception of the user is improved, and the listening experience of the user is effectively improved.
Drawings
FIG. 1 is a schematic flow diagram of a vibration generation method of the present invention;
FIG. 2 is a schematic flow chart of step S24 in FIG. 1;
FIG. 3 is a schematic flow chart of step S28 in FIG. 1;
FIG. 4 is a schematic flow chart of a vibration control method of the present invention;
FIG. 5 is a block diagram of the vibration generating device of the present invention;
fig. 6 is a block diagram of the vibration control system of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, the present invention provides a vibration generating method, including the following steps:
step 22, the audio beats in the audio signal are identified.
And 24, acquiring a plurality of note energies of the audio signal according to the audio beat.
Step 26, respectively carrying out normalization preprocessing on the multiple note energies to obtain multiple normalized energies; and the note energy and the normalized energy are arranged in a one-to-one correspondence mode.
And step 28, generating a haptic vibration file corresponding to the audio signal according to the plurality of normalized energies.
According to the vibration generation method, the normalized energy of each note is obtained by calculating the note energy of each note through a normalized optimization algorithm, the touch vibration file corresponding to the audio signal is generated according to the normalized energy, the flexible matching between the touch vibration effect and the beat of the audio signal is realized, meanwhile, the problem of insufficient local audio intensity is effectively avoided due to the fact that the normalized energy of each note is higher than the note energy of the note, the matching accuracy between the touch vibration effect and the beat of the audio signal is improved, the harmony between auditory perception and tactile perception is good, and the listening experience of a user is improved.
In order to further understand the above method, please refer to fig. 1-3, the following steps of the above method will be described in detail:
in step S22, audio beats in the audio signal are identified.
Specifically, before the step S22, a signal preprocessing process may be added according to actual needs, where the signal preprocessing process is: the method comprises the steps of importing an audio file, obtaining an audio signal of the audio file, extracting audio characteristic information of the audio signal, identifying beat moments of a plurality of beat points according to the audio characteristic information, and obtaining an audio beat sequence Bp from the audio signal according to the beat moments of the beat points, wherein the audio beat sequence Bp comprises a plurality of audio beats.
And step S24, acquiring a plurality of note energies of the audio signal according to the audio beat.
Specifically, the step S24 includes:
step S241, obtaining a plurality of notes in the audio beat according to a preset time interval; the time interval between two adjacent notes is the preset time interval and is recorded as T0。
Specifically, in the step S241, the preset time interval T is set0It can be specifically determined according to the practical application, and the notes in the same audio beat are denoted as T (n), where n is the note number in the same audio beat, for example, in the present embodiment, the preset time interval is specifically set to be a quarter of the duration of one beat, that is, it is equivalent to that there are four notes with the same time interval in each beat, where n denotes the numbers of the 1 st, 2 nd, 3 rd, and 4 th notes in the same audio beat, and the first to fourth notes in the same audio beat are denoted as T (1), T (2), T (3), and T (4) in sequence.
In step S242, the note energy of each note is obtained.
Wherein the same will beThe note energy within the audio beat is denoted P0(n) in this embodiment, note energies of the first to fourth notes in the same audio beat are sequentially represented as P0(1)、P0(2)、P0(3)、P0(4)。
Specifically, in step S242, in the same audio beat, the note energy of each note is calculated and obtained according to the amplitude of the audio signal corresponding to each note. Meanwhile, before this step S242, it is necessary to detect the sampling rate, denoted as f, of the audio signal in advances。
For note energy P0The specific calculation formula of (n) is expressed as:
P0(n)＝sqrt(X0(tn)2+X0(tn+1)2+…+X0(tn+k)2)/(k+1)，
K＝T0×fs，
in the formula, X0(tn) T for the nth notenAmplitude, X, of the audio signal corresponding to the moment0(tn+k) T for the nth noten+kAmplitude of the audio signal corresponding to the time instant, where tnThe time is the start time of the nth note, tn+kThe time is the termination time of the nth note, k is the sampling point number of the nth note, and T0Time interval of two adjacent notes, fsIs the sampling rate.
The 2 nd note T (2) of the 3 rd audio beat occurs at the 3 second moment and lasts for 0.2 second (i.e., time interval T)00.2 seconds) and the signal sampling rate fs is 48000. Wherein:
the number k of sampling points of the 2 nd note T (2) of the 3 rd audio beat is 0.2 × 48000 9600,
sequentially calculating the corresponding time of each sampling point, the time (namely the starting time) t of the 1 st sampling pointn144000, time t of the 2 nd sampling pointn+1Time (i.e., termination time) t of 9600 th sampling point, 144001, … …, 3 × 48000+1n+k＝3×48000+9600＝144000+9600；
According to formula X0(tn)＝sin(2π·100·tn/fs) Calculating the amplitude corresponding to each sampling point, specifically, the first sampling point time tnCorresponding amplitude X0(144000) sin (2 pi · 100 · 144000/9600), the second sample point time tn+1Corresponding amplitude X0(144001) ═ sin (2 pi · 100 · 144001/9600), … …, at the 9600 th sampling point time tn+kCorresponding amplitude X0(144000+9600)＝sin[2π·100·(144000+9600)/9600]。
According to the numerical values, calculating and obtaining the normalized energy P corresponding to the 2 nd note T (2) of the 3 rd audio beat0(2)＝sqrt(X0(144000)2+X0(144001)2+…+X0(144000+9600)2)/(9600+1)。
In another embodiment, in step S242, a specific calculation mode of the note energy may be selected according to actual conditions.
Step S26, respectively carrying out normalization preprocessing on the multiple note energies to obtain multiple normalization energies; and the note energy and the normalized energy are arranged in a one-to-one correspondence mode.
The normalized energy in the same audio beat is denoted as P (n), and in the present embodiment, the normalized energy of the first to fourth notes in the same audio beat is denoted as P (1), P (2), P (3), and P (4) in sequence.
Specifically, in the step S26, in the same audio beat, the normalized energy corresponding to each note is obtained according to the maximum value of the energies of the notes and the note energy of each note.
In the same beat, the calculation formula of the normalized energy p (n) corresponding to any note is shown as follows:
P(n)＝P0(n)/max(P0(n))，
where P (n) represents the normalized energy corresponding to any note in the beat, max (P)0(n)) represents within the same audio beatNote energy sequence P of0(n) and max (P) in the present embodiment0(n)) i.e. note energy P0(1)、P0(2)、P0(3)、P0(4) The maximum value among them.
Step S28 is to generate a haptic vibration file corresponding to the audio signal according to the plurality of normalized energies.
Specifically, step S28 includes:
in step S281, the note corresponding to the normalized energy higher than the preset energy threshold is marked as a tactile vibration point.
The preset energy threshold value is represented as Ph, and the value of the preset energy threshold value Ph can be specifically set according to the actual application situation, the smaller the value of the preset energy threshold value Ph is set, the more the audio signal can match with the haptic vibration effect, and conversely, the larger the value of the preset energy threshold value Ph is set, the less the audio signal can match with the haptic vibration effect, and in the present embodiment, the preset energy threshold value Ph is set to 0.5 · max (p (n)), and max (p (n)) represents the maximum normalized energy in the normalized energy sequence p (n) in the same audio beat, that is, the preset energy threshold value Ph is set to be one half of the maximum normalized energy in the normalized energy sequence p (n) in the same audio beat.
Specifically, it is determined whether or not four normalized energies (P (1), P (2), P (3), and P (4)) in each audio beat are higher than an energy threshold Ph (i.e., 0.5 · max (P (n)), and if so, notes corresponding to normalized energies higher than the energy threshold Ph in the four normalized energies (P (1), P (2), P (3), and P (4)) are marked as tactile vibration points.
It should be noted that, by setting the preset energy threshold Ph to 0.5 · max (p (n)), the distribution of the haptic vibration points on the audio signal can be more uniform, and when the audio signal is played, a haptic vibration effect can be uniformly generated, so that it is avoided that a user is caused by a vibration pain due to an excessively high vibration frequency and the haptic vibration effect is not obvious due to an excessively low vibration frequency, the haptic feeling of the user is effectively improved, and the experience feeling is better.
Step S282 generates a haptic vibration file corresponding to the audio signal from each of the haptic vibration points.
Referring to fig. 4, the present invention provides a vibration control method using the above vibration generation method, and the vibration control method includes the following steps:
step 302, extracting the haptic vibration points in the haptic vibration file.
Step 304, generating a vibration driving voltage corresponding to each of the tactile vibration points according to each of the tactile vibration points.
And step 306, driving the motor to vibrate according to the vibration driving voltage so as to generate a haptic vibration effect.
According to the vibration control method, when the audio signal is played, the vibration control method can generate the touch vibration effect according to the touch vibration file, the matching degree of the touch vibration effect and the audio beat of the audio signal is high, the harmony between the auditory sense and the touch sense of a user is improved, and the listening experience of the user is effectively improved.
It should be understood that although the various steps in the flow charts of fig. 1-4 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 1-4 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed in turn or alternately with other steps or at least some of the other steps.
Referring to fig. 5, the present invention provides a vibration generating apparatus 100, which includes an audio processing module 101 and a calculating processing module 102, wherein:
the audio processing module 101 is configured to identify an audio beat in an audio signal;
the calculation processing module 102 is configured to obtain a plurality of note energies of the audio signal according to the audio beat; the energy normalization device is used for respectively carrying out normalization preprocessing on the multiple note energies to obtain multiple normalization energies, wherein the note energies and the normalization energies are arranged in a one-to-one correspondence manner; for generating a haptic vibration file corresponding to the audio signal based on the plurality of normalized energies.
The audio processing module 101 is further configured to obtain a plurality of notes in the audio beat according to a preset time interval, where a time interval between two adjacent notes is the preset time interval; and the note corresponding to the normalized energy higher than the preset energy threshold value is marked as a tactile vibration point.
The calculation processing module 102 is further configured to obtain a plurality of note energies of the audio signal according to the audio beat, specifically, obtain a note energy of each note; the energy normalization device is used for respectively carrying out normalization preprocessing on the multiple note energies to obtain multiple normalization energies, wherein the note energies and the normalization energies are arranged in a one-to-one correspondence manner; the audio processing device is configured to generate a haptic vibration file corresponding to the audio signal according to the plurality of normalized energies, specifically, identify a note corresponding to the normalized energy higher than a preset energy threshold as a haptic vibration point, and generate a haptic vibration file corresponding to the audio signal according to each haptic vibration point.
Referring to fig. 6, the present invention provides a vibration control system 200, which includes the vibration generating device 100, a haptic vibration recognition module 201 and a vibration unit 202, wherein:
the vibration generation apparatus 100 is configured to input a haptic vibration file.
The tactile vibration identification module 201 is configured to extract tactile vibration points in a tactile vibration file, and further configured to generate a vibration driving voltage corresponding to the tactile vibration points according to each of the tactile vibration points.
The vibration unit 202 is used for vibrating according to the vibration driving voltage to generate a haptic vibration effect; specifically, the structural form of the vibration unit 202 may be specifically selected according to the actual use situation, for example, in the present embodiment, the vibration unit 202 is a vibration motor.
For the specific definition of the vibration generation device, the above definition of the vibration generation method may be referred to, and for the specific definition of the vibration control system, the above definition of the vibration control method may be referred to, and will not be described herein again. The respective modules in the vibration generation apparatus or the vibration control system described above may be implemented in whole or in part by software, hardware, and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
The invention provides an electronic device comprising a memory storing a computer program and a processor implementing the steps of the vibration generation method and/or the vibration control method of the invention when executing the computer program. The vibration generation device and the vibration control system described above may be applied to the electronic apparatus.
The present invention provides a computer-readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the vibration generation method of the invention and/or the steps of the vibration control method of the invention.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in embodiments provided herein may include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A vibration generation method, characterized in that the method comprises:
identifying audio beats in an audio signal;
acquiring a plurality of note energies of the audio signal according to the audio beat;
respectively carrying out normalization preprocessing on the multiple note energies to obtain multiple normalized energies; wherein the note energy and the normalized energy are arranged in a one-to-one correspondence manner;
and generating a haptic vibration file corresponding to the audio signal according to the plurality of normalized energies.
2. The vibration generation method according to claim 1, wherein said obtaining a plurality of note energies of the audio signal according to the audio beat comprises:
acquiring a plurality of notes in the audio beat according to a preset time interval; wherein, the time interval between two adjacent notes is the preset time interval;
the note energy of each of the notes is obtained.
3. A vibration generation method according to claim 2, wherein said step of obtaining the note energy of each of said notes comprises:
and in the same audio rhythm, calculating and obtaining the note energy of each note according to the amplitude of the audio signal corresponding to each note.
4. The vibration generation method according to claim 2, wherein the normalization preprocessing is performed on the respective note energies, and obtaining a plurality of normalized energies includes:
and in the same audio rhythm, obtaining the normalized energy corresponding to each note according to the maximum value of the energies of the notes and the note energy of each note.
5. The vibration generation method according to claim 4, wherein the step of generating a haptic vibration file corresponding to the audio signal from the normalized energy includes:
marking the note corresponding to the normalized energy higher than a preset energy threshold value as a tactile vibration point;
and generating a haptic vibration file corresponding to the audio signal according to each haptic vibration point.
6. A vibration control method comprising the steps of the vibration generation method according to any one of claims 1 to 5 above, the vibration control method further comprising:
extracting a touch vibration point in a touch vibration file;
generating a vibration driving voltage corresponding to the tactile vibration points according to each tactile vibration point;
according to the vibration driving voltage, the motor is driven to vibrate to generate a haptic vibration effect.
7. A vibration generation device, characterized by comprising:
the audio processing module is used for identifying audio beats in the audio signal; and the number of the first and second groups,
the calculation processing module is used for acquiring a plurality of note energies of the audio signal according to the audio beat; the energy normalization device is used for respectively carrying out normalization preprocessing on the multiple note energies to obtain multiple normalization energies, wherein the note energies and the normalization energies are arranged in a one-to-one correspondence manner; for generating a haptic vibration file corresponding to the audio signal based on the plurality of normalized energies.
8. A vibration control system, comprising:
a vibration generation apparatus according to claim 7, for inputting a haptic vibration file;
the tactile vibration identification module is used for extracting tactile vibration points in a tactile vibration file and generating vibration driving voltages corresponding to the tactile vibration points according to the tactile vibration points; and the number of the first and second groups,
and the vibration unit is used for vibrating according to the vibration driving voltage to generate a tactile vibration effect.
9. An electronic device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor, when executing the computer program, implements the steps of the vibration generation method of any of claims 1 to 5 and/or the steps of the vibration control method of claim 6.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the vibration generation method of any one of claims 1 to 5 and/or the steps of the vibration control method of claim 6.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011326608.5A CN112466267B (en) | 2020-11-24 | 2020-11-24 | Vibration generation method, vibration control method and related equipment |
| PCT/CN2020/133228 WO2022110259A1 (en) | 2020-11-24 | 2020-12-02 | Vibration generation method, vibration control method, and related device thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011326608.5A CN112466267B (en) | 2020-11-24 | 2020-11-24 | Vibration generation method, vibration control method and related equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112466267A true CN112466267A (en) | 2021-03-09 |
| CN112466267B CN112466267B (en) | 2024-04-02 |
Family
ID=74799354
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011326608.5A Active CN112466267B (en) | 2020-11-24 | 2020-11-24 | Vibration generation method, vibration control method and related equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112466267B (en) |
| WO (1) | WO2022110259A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114327040A (en) * | 2021-11-25 | 2022-04-12 | 歌尔股份有限公司 | Vibration signal generation method, device, electronic device and storage medium |
| CN116185165A (en) * | 2022-06-17 | 2023-05-30 | 武汉市聚芯微电子有限责任公司 | Haptic sensation generation method, system, device and computer storage medium |
| WO2023217224A1 (en) * | 2022-05-12 | 2023-11-16 | 北京有竹居网络技术有限公司 | Tactile signal generation method and apparatus, readable medium, and electronic device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011048023A (en) * | 2009-08-25 | 2011-03-10 | Pioneer Electronic Corp | Somesthetic vibration generating device and somesthetic vibration generation method |
| CN108777747A (en) * | 2018-08-09 | 2018-11-09 | 瑞声科技(新加坡)有限公司 | A kind of method for oscillating, mobile terminal and computer readable storage medium |
| US20190005935A1 (en) * | 2016-03-07 | 2019-01-03 | Yamaha Corporation | Sound signal processing method and sound signal processing apparatus |
| CN109670074A (en) * | 2018-12-12 | 2019-04-23 | 北京字节跳动网络技术有限公司 | A kind of rhythm point recognition methods, device, electronic equipment and storage medium |
| CN110010151A (en) * | 2018-12-31 | 2019-07-12 | 瑞声科技(新加坡)有限公司 | A kind of acoustic signal processing method and equipment, storage medium |
| CN110215607A (en) * | 2019-05-31 | 2019-09-10 | Oppo广东移动通信有限公司 | Massage method and device based on electro photoluminescence |
| CN111726684A (en) * | 2019-03-22 | 2020-09-29 | 腾讯科技（深圳）有限公司 | Audio and video processing method and device and storage medium |
-
2020
- 2020-11-24 CN CN202011326608.5A patent/CN112466267B/en active Active
- 2020-12-02 WO PCT/CN2020/133228 patent/WO2022110259A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011048023A (en) * | 2009-08-25 | 2011-03-10 | Pioneer Electronic Corp | Somesthetic vibration generating device and somesthetic vibration generation method |
| US20190005935A1 (en) * | 2016-03-07 | 2019-01-03 | Yamaha Corporation | Sound signal processing method and sound signal processing apparatus |
| CN108777747A (en) * | 2018-08-09 | 2018-11-09 | 瑞声科技(新加坡)有限公司 | A kind of method for oscillating, mobile terminal and computer readable storage medium |
| CN109670074A (en) * | 2018-12-12 | 2019-04-23 | 北京字节跳动网络技术有限公司 | A kind of rhythm point recognition methods, device, electronic equipment and storage medium |
| CN110010151A (en) * | 2018-12-31 | 2019-07-12 | 瑞声科技(新加坡)有限公司 | A kind of acoustic signal processing method and equipment, storage medium |
| CN111726684A (en) * | 2019-03-22 | 2020-09-29 | 腾讯科技（深圳）有限公司 | Audio and video processing method and device and storage medium |
| CN110215607A (en) * | 2019-05-31 | 2019-09-10 | Oppo广东移动通信有限公司 | Massage method and device based on electro photoluminescence |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114327040A (en) * | 2021-11-25 | 2022-04-12 | 歌尔股份有限公司 | Vibration signal generation method, device, electronic device and storage medium |
| WO2023093333A1 (en) * | 2021-11-25 | 2023-06-01 | 歌尔股份有限公司 | Vibration signal generation method and apparatus, electronic device, and storage medium |
| WO2023217224A1 (en) * | 2022-05-12 | 2023-11-16 | 北京有竹居网络技术有限公司 | Tactile signal generation method and apparatus, readable medium, and electronic device |
| CN116185165A (en) * | 2022-06-17 | 2023-05-30 | 武汉市聚芯微电子有限责任公司 | Haptic sensation generation method, system, device and computer storage medium |
| CN116185165B (en) * | 2022-06-17 | 2024-04-02 | 武汉市聚芯微电子有限责任公司 | Haptic sensation generation method, system, device and computer storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022110259A1 (en) | 2022-06-02 |
| CN112466267B (en) | 2024-04-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112466267A (en) | Vibration generation method, vibration control method and related equipment | |
| CN110782962A (en) | Hearing language rehabilitation device, method, electronic equipment and storage medium | |
| Lee et al. | Feature extraction based on the non-negative matrix factorization of convolutional neural networks for monitoring domestic activity with acoustic signals | |
| TW201833730A (en) | Information interaction method and device | |
| JP2022539867A (en) | Audio separation method and device, electronic equipment | |
| CN106844639B (en) | Method and system for matching music with sports | |
| US9269045B2 (en) | Auditory source separation in a spiking neural network | |
| JP4876133B2 (en) | Method, apparatus and computer program for generating control signals for cochlear implants based on audio signals | |
| CN112116922A (en) | Noise blind source signal separation method, terminal equipment and storage medium | |
| CN115423054B (en) | Uncertain training and exciting method and system based on personality characteristics of cognitive disorder patient | |
| CN109841232B (en) | Method and device for extracting note position in music signal and storage medium | |
| EP4120259A1 (en) | Audio generation methods and systems | |
| WO2014042718A2 (en) | Methods, systems, and computer readable media for synthesizing sounds using estimated material parameters | |
| US20190197415A1 (en) | User state modeling | |
| WO2021187395A1 (en) | Parameter inferring method, parameter inferring system, and parameter inferring program | |
| CN113450811B (en) | Method and equipment for performing transparent processing on music | |
| KR20190061460A (en) | question answering system and method based on reliability | |
| Sawata et al. | The extraction of individual music preference based on deep time-series CCA | |
| Milligan et al. | A review of software for note onset detection | |
| EP4120258A1 (en) | Audio generation methods and systems | |
| Vázquez et al. | Hetero-associative memories for voice signal and image processing | |
| WO2021199141A1 (en) | Image processing device, image processing method, and recording medium | |
| Weger et al. | A hear-through system for plausible auditory contrast enhancement | |
| Kostlan | BIOLOGICALLY-INFORMED COMPUTATIONAL MODELS OF HARMONIC SOUND DETECTION AND IDENTIFICATION | |
| Kar | Improved vocal isolation from varying repeating structures for musical signals |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |