CN105096987B - A kind of processing method and terminal of audio data - Google Patents
A kind of processing method and terminal of audio data Download PDFInfo
- Publication number
- CN105096987B CN105096987B CN201510292227.2A CN201510292227A CN105096987B CN 105096987 B CN105096987 B CN 105096987B CN 201510292227 A CN201510292227 A CN 201510292227A CN 105096987 B CN105096987 B CN 105096987B
- Authority
- CN
- China
- Prior art keywords
- musical instrument
- data
- frequency spectrum
- audio file
- replaced
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Telephone Function (AREA)
Abstract
The invention discloses a kind of processing method of audio data and terminals, which comprises obtains audio file, is decoded according to the format of the audio file to the audio file, obtains the original waveform data of the audio file；The original waveform data is analyzed, voice Wave data and musical instrument Wave data are isolated；According to the musical instrument Wave data, the corresponding musical instrument type of the audio file is obtained；Prompt the corresponding musical instrument type of the audio file；Based on the musical instrument replacement operation of user's selection, the frequency spectrum data in musical instrument frequency spectrum data library is read, and according to the intensity and rhythm of the audio file, generates new musical instrument Wave data.
Description
Technical field
The present invention relates to the processing methods and terminal of audio signal processing technique more particularly to a kind of audio data.
Background technique
With the intelligent development of terminal, intelligent terminal is used by more and more users.When user uses intelligent terminal,
The application of music type can be installed on the terminal device, current terminal cannot be sentenced for playing the musical instrument accompaniment in melody
Disconnected identification can not carry out one-to-one replacement for the type of musical instrument accompaniment, and playability is not high, not humanized enough.
Summary of the invention
In order to solve the above technical problems, the embodiment of the invention provides a kind of processing method of audio data and terminals.
The processing method of audio data provided in an embodiment of the present invention includes:
Audio file is obtained, the audio file is decoded according to the format of the audio file, obtains the sound
The original waveform data of frequency file；
The original waveform data is analyzed, voice Wave data and musical instrument Wave data are isolated；
According to the musical instrument Wave data, the corresponding musical instrument type of the audio file is obtained；
Prompt the corresponding musical instrument type of the audio file；
Based on the musical instrument replacement operation of user's selection, the frequency spectrum data in musical instrument frequency spectrum data library is read, and according to described
The intensity and rhythm of audio file generate new musical instrument Wave data.
It is described that the original waveform data is analyzed in the embodiment of the present invention, isolate voice Wave data and pleasure
Device Wave data, comprising:
The original waveform data is carried out by voice detection algorithm (VAD, Voice Activity Detection)
Detection, obtains voice Wave data；
The voice Wave data is filtered out by multiband bandstop filter, obtains musical instrument Wave data.
It is described according to the musical instrument Wave data in the embodiment of the present invention, obtain the corresponding musical instrument kind of the audio file
Class, comprising:
According to the musical instrument Wave data, the fundamental tone and overtone ratio of musical instrument are determined；
The fundamental tone and overtone ratio are compared with the musical instrument frequency spectrum in musical instrument frequency spectrum data library, obtain the audio
The corresponding musical instrument type of file.
In the embodiment of the present invention, the musical instrument replacement operation based on user's selection is read in musical instrument frequency spectrum data library
Frequency spectrum data, and according to the intensity and rhythm of the audio file, generate new musical instrument Wave data, comprising:
Based on the musical instrument replacement operation of user's selection, the spectrum number of replaced musical instrument is read in musical instrument frequency spectrum data library
According to；
Intensity and rhythm when being played according to the audio file, the frequency spectrum data for being replaced musical instrument is replaced with and is replaced
The frequency spectrum data of musical instrument generates new musical instrument Wave data.
In the embodiment of the present invention, the method also includes:
When the frequency spectrum data for being replaced musical instrument is replaced with the frequency spectrum data of replaced musical instrument, replace in seclected time period
Frequency spectrum data.
Terminal provided in an embodiment of the present invention includes:
Audio decoder module, for obtaining audio file, according to the format of the audio file to the audio file into
Row decoding, obtains the original waveform data of the audio file；
Music preprocessing module isolates voice Wave data and pleasure for analyzing the original waveform data
Device Wave data；
Musical instrument type judgment module, for obtaining the corresponding musical instrument of the audio file according to the musical instrument Wave data
Type；
Musical instrument replacement module, the musical instrument replacement operation for being selected based on user read the frequency in musical instrument frequency spectrum data library
Modal data, and according to the intensity and rhythm of the audio file, generate new musical instrument Wave data.
In the embodiment of the present invention, the music preprocessing module includes:
Detection sub-module obtains voice for detecting by voice detection algorithm VAD to the original waveform data
Wave data；
Filtering submodule is found pleasure in for being filtered out by multiband bandstop filter to the voice Wave data
Device Wave data.
In the embodiment of the present invention, the musical instrument type judgment module includes:
Submodule is determined, for determining the fundamental tone and overtone ratio of musical instrument according to the musical instrument Wave data；
Comparative sub-module, for comparing the fundamental tone and overtone ratio with the musical instrument frequency spectrum in musical instrument frequency spectrum data library
Compared with obtaining the corresponding musical instrument type of the audio file.
In the embodiment of the present invention, the musical instrument replacement module includes:
Reading submodule, the musical instrument replacement operation for being selected based on user are read in musical instrument frequency spectrum data library and are replaced
Change the frequency spectrum data of musical instrument；
Submodule is replaced, intensity and rhythm when for playing according to the audio file will be replaced the frequency spectrum of musical instrument
Data replace with the frequency spectrum data of replaced musical instrument, generate new musical instrument Wave data.
In the embodiment of the present invention, the replacement submodule is also used to replace with the frequency spectrum data for being replaced musical instrument and be replaced
When changing the frequency spectrum data of musical instrument, the frequency spectrum data in seclected time period is replaced.
In the technical solution of the embodiment of the present invention, when terminal gets audio file, which is decoded,
Obtain original waveform data.Then it analyzes it, obtains musical instrument Wave data, and then obtain musical instrument type, in man-machine friendship
Shown on mutual interface the musical instrument accompaniment in current music be which or which, and allow user that needs voluntarily select to replace
Musical instrument, to be replaced one by one, playability is higher, also more humanized.
Detailed description of the invention
The hardware structural diagram of Fig. 1 mobile terminal of each embodiment to realize the present invention；
Fig. 2 is the wireless communication system schematic diagram of mobile terminal as shown in Figure 1；
Fig. 3 is the flow diagram of the processing method of the audio data of the embodiment of the present invention；
Fig. 4 is the fundamental tone overtone schematic diagram of the embodiment of the present invention；
Fig. 5 is the structure composition schematic diagram of the terminal of the embodiment of the present invention.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The terminal of each embodiment of the present invention is realized in description with reference to the drawings.In subsequent description, using being used for
Indicate the suffix of such as " module ", " component " or " unit " of element only for being conducive to the explanation of the embodiment of the present invention,
There is no specific meanings for body.Therefore, " module " can be used mixedly with " component ".
Terminal can be implemented in a variety of manners.For example, terminal described in the embodiment of the present invention may include such as moving
Mobile phone, smart phone, laptop, digit broadcasting receiver, personal digital assistant (PDA, Personal Digital
Assistant), tablet computer (PAD), portable media player (PMP, Portable Media Player), navigation dress
The fixed terminal of the terminal and such as number TV, desktop computer etc. set etc..Hereinafter it is assumed that terminal is mobile terminal.
However, it will be understood by those skilled in the art that other than the element for being used in particular for mobile purpose, implementation according to the present invention
The construction of mode can also apply to the terminal of fixed type.
Fig. 1 to realize the present invention the mobile terminal of each embodiment hardware configuration signal.
Mobile terminal 100 may include wireless communication unit 110, audio/video (A/V) input unit 120, user's input
Unit 130, sensing unit 140, output unit 150, memory 160, interface unit 170, controller 180 and power supply unit 190
Etc..Fig. 1 shows the mobile terminal with various assemblies, it should be understood that being not required for implementing all groups shown
Part.More or fewer components can alternatively be implemented.The element of mobile terminal will be discussed in more detail below.
Wireless communication unit 110 generally includes one or more components, allows mobile terminal 100 and wireless communication system
Or the radio communication between network.For example, wireless communication unit may include broadcasting reception module 111, mobile communication module
112, at least one of wireless Internet module 113, short range communication module 114 and location information module 115.
Broadcasting reception module 111 receives broadcast singal and/or broadcast from external broadcast management server via broadcast channel
Relevant information.Broadcast channel may include satellite channel and/or terrestrial channel.Broadcast management server, which can be, to be generated and sent
The broadcast singal and/or broadcast related information generated before the server or reception of broadcast singal and/or broadcast related information
And send it to the server of terminal.Broadcast singal may include TV broadcast singal, radio signals, data broadcasting
Signal etc..Moreover, broadcast singal may further include the broadcast singal combined with TV or radio signals.Broadcast phase
Closing information can also provide via mobile communications network, and in this case, broadcast related information can be by mobile communication mould
Block 112 receives.Broadcast singal can exist in a variety of manners, for example, its can with digital multimedia broadcasting (DMB,
Digital Multimedia Broadcasting) electronic program guides (EPG, Electronic Program Guide),
The electronic service guidebooks of digital video broadcast-handheld (DVB-H, Digital Video Broadcasting-Handheld)
The form of (ESG, Electronic Service Guide) etc. and exist.Broadcasting reception module 111 can be by using each
The broadcast system of seed type receives signal broadcast.Particularly, broadcasting reception module 111 can be by using such as multi-media broadcast
Broadcast-ground (DMB-T, Digital Multimedia Broadcasting-Terrestrial), digital multimedia broadcasting-defend
Star (DMB-S, Digital Multimedia Broadcasting-Satellite), digital video broadcast-handheld (DVB-H),
The Radio Data System of forward link media (MediaFLO, Media Forward Link Only), received terrestrial digital broadcasting are comprehensive
The number for servicing (ISDB-T, Integrated Services Digital Broadcasting-Terrestrial) etc. is wide
It broadcasts system and receives digital broadcasting.Broadcasting reception module 111 may be constructed such that the various broadcast systems for being adapted to provide for broadcast singal
And above-mentioned digit broadcasting system.It can be deposited via the received broadcast singal of broadcasting reception module 111 and/or broadcast related information
Storage is in memory 160 (or other types of storage medium).
Mobile communication module 112 sends radio signals to base station (for example, access point, node B etc.), exterior terminal
And at least one of server and/or receive from it radio signal.Such radio signal may include that voice is logical
Talk about signal, video calling signal or according to text and/or Multimedia Message transmission and/or received various types of data.
The Wi-Fi (Wireless Internet Access) of the support mobile terminal of wireless Internet module 113.The module can be internally or externally
It is couple to terminal.Wi-Fi (Wireless Internet Access) technology involved in the module may include Wireless LAN (WLAN, Wireless
Local Area Networks) (Wi-Fi), WiMAX (Wibro), worldwide interoperability for microwave accesses (Wimax), high-speed downstream
Link packet accesses (HSDPA, High Speed Downlink Packet Access) etc..
Short range communication module 114 is the module for supporting short range communication.Some examples of short-range communication technology include indigo plant
Tooth, radio frequency identification (RFID, Radio Frequency Identification), Infrared Data Association (IrDA, Infrared
Data Association), ultra wide band (UWB, Ultra Wideband), purple honeybee etc..
Location information module 115 is the module for checking or obtaining the location information of mobile terminal.Location information module
Typical case be global positioning system (GPS, Global Positioning System).According to current technology, GPS mould
Block 115 calculates range information from three or more satellites and correct time information and for the Information application of calculating three
Angle, to according to longitude, latitude and highly accurately calculate three-dimensional current location information.Currently, it is used for calculating position
Method with temporal information is using three satellites and by using the other calculated position of satellite correction and time
The error of information.In addition, GPS module 115 can be by Continuous plus current location information in real time come calculating speed information.
A/V input unit 120 is for receiving audio or video signal.A/V input unit 120 may include 121 He of camera
Microphone 1220, camera 121 is to the static map obtained in video acquisition mode or image capture mode by image capture apparatus
The image data of piece or video is handled.Treated, and picture frame may be displayed on display unit 151.At camera 121
Picture frame after reason can store in memory 160 (or other storage mediums) or carry out via wireless communication unit 110
It sends, two or more cameras 1210 can be provided according to the construction of mobile terminal.Microphone 122 can be in telephone relation mould
Sound (audio data) is received via microphone in formula, logging mode, speech recognition mode etc. operational mode, and can be incited somebody to action
Such acoustic processing is audio data.Audio that treated (voice) data can be converted in the case where telephone calling model
For the format output that can be sent to mobile communication base station via mobile communication module 112.Various types can be implemented in microphone 122
Noise eliminate (or inhibit) algorithm with eliminate noise that (or inhibition) generates during sending and receiving audio signal or
Person's interference.
The order that user input unit 130 can be inputted according to user generates key input data to control each of mobile terminal
Kind operation.User input unit 130 allows user to input various types of information, and may include keyboard, metal dome, touch
Plate (for example, the sensitive component of detection due to the variation of resistance, pressure, capacitor etc. caused by being contacted), idler wheel, rocking bar etc.
Deng.Particularly, when touch tablet is superimposed upon in the form of layer on display unit 151, touch screen can be formed.
Sensing unit 140 detects the current state of mobile terminal 100, (for example, mobile terminal 100 opens or closes shape
State), the position of mobile terminal 100, user is for the presence or absence of contact (that is, touch input) of mobile terminal 100, mobile terminal
100 orientation, the acceleration or deceleration movement of mobile terminal 100 and direction etc., and generate for controlling mobile terminal 100
The order of operation or signal.For example, sensing unit 140 can sense when mobile terminal 100 is embodied as sliding-type mobile phone
The sliding-type phone is to open or close.In addition, sensing unit 140 be able to detect power supply unit 190 whether provide electric power or
Whether person's interface unit 170 couples with external device (ED).Sensing unit 140 may include that proximity sensor 1410 will combine below
Touch screen is described this.
Interface unit 170 be used as at least one external device (ED) connect with mobile terminal 100 can by interface.For example,
External device (ED) may include wired or wireless headphone port, external power supply (or battery charger) port, wired or nothing
Line data port, memory card port, the port for connecting the device with identification module, audio input/output (I/O) end
Mouth, video i/o port, ear port etc..Identification module can be storage and use each of mobile terminal 100 for verifying user
Kind of information and may include subscriber identification module (UIM, User Identify Module), client identification module (SIM,
Subscriber Identity Module), Universal Subscriber identification module (USIM, Universal Subscriber
Identity Module) etc..In addition, the device (hereinafter referred to as " identification device ") with identification module can take intelligence
The form of card, therefore, identification device can be connect via port or other attachment devices with mobile terminal 100.Interface unit 170
It can be used for receiving the input (for example, data information, electric power etc.) from external device (ED) and transmit the input received
One or more elements in mobile terminal 100 can be used for transmitting data between mobile terminal and external device (ED).
In addition, when mobile terminal 100 is connect with external base, interface unit 170 may be used as allowing will be electric by it
Power, which is provided from pedestal to the path or may be used as of mobile terminal 100, allows the various command signals inputted from pedestal to pass through it
It is transferred to the path of mobile terminal.The various command signals or electric power inputted from pedestal, which may be used as mobile terminal for identification, is
The no signal being accurately fitted on pedestal.Output unit 150 is configured to provide with vision, audio and/or tactile manner defeated
Signal (for example, audio signal, vision signal, alarm signal, vibration signal etc.) out.Output unit 150 may include display
Unit 151, audio output module 152, alarm unit 153 etc..
Display unit 151 may be displayed on the information handled in mobile terminal 100.For example, when mobile terminal 100 is in electricity
When talking about call mode, display unit 151 can show and converse or other communicate (for example, text messaging, multimedia file
Downloading etc.) relevant user interface (UI, User Interface) or graphic user interface (GUI, Graphical User
Interface).When mobile terminal 100 is in video calling mode or image capture mode, display unit 151 can be shown
Show captured image and/or received image, the UI or GUI that show video or image and correlation function etc..
Meanwhile when display unit 151 and touch tablet in the form of layer it is superposed on one another to form touch screen when, display unit
151 may be used as input unit and output device.Display unit 151 may include liquid crystal display (LCD, Liquid
Crystal Display), thin film transistor (TFT) LCD (TFT-LCD, Thin Film Transistor-LCD), organic light-emitting diodes
It manages in (OLED, Organic Light-Emitting Diode) display, flexible display, three-dimensional (3D) display etc.
It is at least one.Some in these displays may be constructed such that transparence to allow user to watch from outside, this is properly termed as
Transparent display, typical transparent display can be, for example, transparent organic light emitting diode (TOLED) display etc..According to
Specific desired embodiment, mobile terminal 100 may include two or more display units (or other display devices), example
Such as, mobile terminal may include outernal display unit (not shown) and inner display unit (not shown).Touch screen can be used for examining
Survey touch input pressure and touch input position and touch input area.
Audio output module 152 can mobile terminal be in call signal reception pattern, call mode, logging mode,
It is when under the isotypes such as speech recognition mode, broadcast reception mode, wireless communication unit 110 is received or in memory 160
The audio data transducing audio signal of middle storage and to export be sound.Moreover, audio output module 152 can provide and movement
The relevant audio output of specific function (for example, call signal receives sound, message sink sound etc.) that terminal 100 executes.
Audio output module 152 may include loudspeaker, buzzer etc..
Alarm unit 153 can provide output notifying event to mobile terminal 100.Typical event can be with
Including calling reception, message sink, key signals input, touch input etc..Other than audio or video output, alarm unit
153 can provide output in different ways with the generation of notification event.For example, alarm unit 153 can be in the form of vibration
Output is provided, when receiving calling, message or some other entrance communications (incomingcommunication), alarm list
Member 153 can provide tactile output (that is, vibration) to notify to user.By providing such tactile output, even if
When the mobile phone of user is in the pocket of user, user also can recognize that the generation of various events.Alarm unit 153
The output of the generation of notification event can be provided via display unit 151 or audio output module 152.
Memory 160 can store the software program etc. of the processing and control operation that are executed by controller 180, Huo Zheke
Temporarily to store oneself data (for example, telephone directory, message, still image, video etc.) through exporting or will export.And
And memory 160 can store about the vibrations of various modes and audio signal exported when touching and being applied to touch screen
Data.
Memory 160 may include the storage medium of at least one type, and the storage medium includes flash memory, hard disk, more
Media card, card-type memory (for example, SD or DX memory etc.), random access storage device (RAM, Random Access
Memory), static random-access memory (SRAM, Static Random Access Memory), read-only memory (ROM,
Read Only Memory), electrically erasable programmable read-only memory (EEPROM, Electrically Erasable
Programmable Read Only Memory), programmable read only memory (PROM, Programmable Read Only
Memory), magnetic storage, disk, CD etc..Moreover, mobile terminal 100 can execute memory with by network connection
The network storage device of 160 store function cooperates.
The overall operation of the usually control mobile terminal of controller 180.For example, controller 180 executes and voice communication, data
Communication, video calling etc. relevant control and processing.In addition, controller 180 may include for reproducing (or playback) more matchmakers
The multi-media module 1810 of volume data, multi-media module 1810 can construct in controller 180, or can be structured as and control
Device 180 processed separates.Controller 180 can be with execution pattern identifying processing, by the handwriting input executed on the touchscreen or figure
Piece draws input and is identified as character or image.
Power supply unit 190 receives external power or internal power under the control of controller 180 and provides operation each member
Electric power appropriate needed for part and component.
Various embodiments described herein can be to use the calculating of such as computer software, hardware or any combination thereof
Machine readable medium is implemented.Hardware is implemented, embodiment described herein can be by using application-specific IC
(ASIC, Application Specific Integrated Circuit), digital signal processor (DSP, Digital
Signal Processing), digital signal processing device (DSPD, Digital Signal Processing Device), can
Programmed logic device (PLD, Programmable Logic Device), field programmable gate array (FPGA, Field
Programmable Gate Array), processor, controller, microcontroller, microprocessor, be designed to execute it is described herein
At least one of the electronic unit of function implement, in some cases, such embodiment can be in controller 180
Middle implementation.For software implementation, the embodiment of such as process or function can with allow to execute at least one functions or operations
Individual software module implement.Software code can be by the software application write with any programming language appropriate
(or program) is implemented, and software code can store in memory 160 and executed by controller 180.
So far, oneself is through describing mobile terminal according to its function.In the following, for the sake of brevity, will description such as folded form,
Slide type mobile terminal in various types of mobile terminals of board-type, oscillating-type, slide type mobile terminal etc., which is used as, to be shown
Example.Therefore, the present invention can be applied to any kind of mobile terminal, and be not limited to slide type mobile terminal.
Mobile terminal 100 as shown in Figure 1 may be constructed such that using via frame or grouping send data it is all if any
Line and wireless communication system and satellite-based communication system operate.
Referring now to Fig. 2 description communication system that wherein mobile terminal according to an embodiment of the present invention can operate.
Different air interface and/or physical layer can be used in such communication system.For example, used by communication system
Air interface includes such as frequency division multiple access (FDMA, Frequency Division Multiple Access), time division multiple acess
(TDMA, Time Division Multiple Access), CDMA (CDMA, Code Division Multiple
Access) and Universal Mobile Communication System (UMTS, Universal Mobile Telecommunications System) is (special
Not, long term evolution (LTE, Long Term Evolution)), global system for mobile communications (GSM) etc..As unrestricted
Property example, description below is related to cdma communication system, but such introduction is equally applicable to other types of system.
With reference to Fig. 2, cdma wireless communication system may include multiple mobile terminals 100, multiple base station (BS, Base
Station) 270, base station controller (BSC, Base Station Controller) 275 and mobile switching centre (MSC,
Mobile Switching Center)280.MSC280 is configured to and Public Switched Telephony Network (PSTN, Public
Switched Telephone Network) 290 formation interfaces.MSC280 is also structured to and can couple via back haul link
BSC275 to base station 270 forms interface.Back haul link can be constructed according to any in several known interfaces, described
Interface includes such as E1/T1, ATM, IP, PPP, frame relay, HDSL, ADSL or xDSL.It will be appreciated that as shown in Figure 2
System may include multiple BSC275.
Each BS270 can service one or more subregions (or region), by multidirectional antenna or the day of direction specific direction
Each subregion of line covering is radially far from BS270.Alternatively, each subregion can be by two or more for diversity reception
Antenna covering.Each BS270, which may be constructed such that, supports multiple frequency distribution, and the distribution of each frequency has specific frequency spectrum
(for example, 1.25MHz, 5MHz etc.).
What subregion and frequency were distributed, which intersects, can be referred to as CDMA Channel.BS270 can also be referred to as base station transceiver
System (BTS, Base Transceiver Station) or other equivalent terms.In this case, term " base station "
It can be used for broadly indicating single BSC275 and at least one BS270.Base station can also be referred to as " cellular station ".Alternatively, special
Each subregion for determining BS270 can be referred to as multiple cellular stations.
As shown in Figure 2, broadcast singal is sent to by broadcsting transmitter (BT, Broadcast Transmitter) 295
The mobile terminal 100 operated in system.Broadcasting reception module 111 as shown in Figure 1 is arranged at mobile terminal 100 to connect
Receive the broadcast singal sent by BT295.In fig. 2 it is shown that several global positioning system (GPS) satellites 300.Satellite 300 is helped
Help at least one of multiple mobile terminals 100 of positioning.
In Fig. 2, multiple satellites 300 are depicted, it is understood that, it is useful to can use any number of satellite acquisition
Location information.GPS module 115 as shown in Figure 1 is generally configured to cooperate with satellite 300 to obtain desired positioning and believe
Breath.It substitutes GPS tracking technique or except GPS tracking technique, the other of the position that can track mobile terminal can be used
Technology.In addition, at least one 300 property of can choose of GPS satellite or extraly processing satellite dmb transmission.
As a typical operation of wireless communication system, BS270 receives the reverse link from various mobile terminals 100
Signal.Mobile terminal 100 usually participates in call, information receiving and transmitting and other types of communication.Certain base station 270 is received each anti-
It is handled in specific BS270 to link signal.The data of acquisition are forwarded to relevant BSC275.BSC provides call
The mobile management function of resource allocation and the coordination including the soft switching process between BS270.The number that BSC275 will also be received
According to MSC280 is routed to, the additional route service for forming interface with PSTN290 is provided.Similarly, PSTN290 with
MSC280 forms interface, and MSC and BSC275 form interface, and BSC275 controls BS270 correspondingly with by forward link signals
It is sent to mobile terminal 100.
Based on above-mentioned mobile terminal hardware configuration and communication system, each embodiment of the method for the present invention is proposed.
Fig. 3 is the flow diagram of the processing method of the audio data of the embodiment of the present invention, as shown in figure 3, the audio
The processing methods of data the following steps are included:
Step 301: obtaining audio file, the audio file is decoded according to the format of the audio file, is obtained
To the original waveform data of the audio file.
The processing method of audio data in the embodiment of the present invention is applied to terminal, which at least configures following device:
For playing melody/music excerpt speaker system, audio decoding apparatus, for judging and changing in musical instrument accompaniment type
Central processor (CPU, Central Processing Unit) or digital signal processor (DSP, Digital Signal
Processor), the touch control display apparatus for being interacted with user.
In the embodiment of the present invention, terminal reads the audio file (music file) of external storage, according to different audio texts
The format of part is decoded, and restores the original waveform data of audio file.
Step 302: the original waveform data being analyzed, voice Wave data and musical instrument Wave data are isolated.
In the embodiment of the present invention, the original waveform data is detected by voice detection algorithm VAD, obtains voice
Wave data；The voice Wave data is filtered out by multiband bandstop filter, obtains musical instrument Wave data.
Specifically, currently playing voice is detected by voice detection algorithm VAD, then passes through multiband bandstop filter
Voice is filtered out, makes only to be left accompaniment (musical instrument Wave data) in music.
Step 303: according to the musical instrument Wave data, obtaining the corresponding musical instrument type of the audio file.
In the embodiment of the present invention, according to the musical instrument Wave data, the fundamental tone and overtone ratio of musical instrument are determined；It will be described
Fundamental tone and overtone ratio are compared with the musical instrument frequency spectrum in musical instrument frequency spectrum data library, obtain the corresponding musical instrument of the audio file
Type.
Specifically, it is carried out by the musical instrument frequency spectrum in the fundamental tone of musical instrument accompaniment and overtone ratio and musical instrument frequency spectrum data library
Compare, show that is currently accompanied is the judgement of which kind of musical instrument.The frequency spectrum data of various musical instruments be it is different, particularly, just
It is because being constructed by different musical instruments, the influence of resonant cavity and manufacture craft etc. is stirred by taking violin as an example when with finger
When string, there is 60% energy to be converted into the vibration of entire string, produce fundamental tone 1000Hz；But 20% is also had simultaneously
Energy is converted into the frequency of 2000Hz ingredient, and 15% energy is converted into the ingredient of 3000Hz, subsequent higher hamonic wave ratio
Example is different, respectively accounts for the different proportion in remaining 5%.Referring to Fig. 4, the fundamental tone of piano, the first overtone, the second overtone ratio then
It is 80%, 10%, 5% etc., so calculates, situation is extremely complex, exactly because also this complexity, just will lead to musical instrument man
Race it is huge；Just will lead to each musical instrument is unique presence, possesses their unique tone colors.
Step 304: prompting the corresponding musical instrument type of the audio file.
In the embodiment of the present invention, musical instrument type is fed back to user by human-computer interaction interface, selects to need to replace by user
The musical instrument changed；Certainly this selection, is rule of thumb before can also being played by user or interest, leading setting need to replace
Musical instrument and the musical instrument that is replaced.In addition, the part that user can also select replacement is special time period or whole song.
Step 305: the musical instrument replacement operation based on user's selection reads the frequency spectrum data in musical instrument frequency spectrum data library, and
According to the intensity and rhythm of the audio file, new musical instrument Wave data is generated.
In the embodiment of the present invention, based on the musical instrument replacement operation of user's selection, reads and replaced in musical instrument frequency spectrum data library
Change the frequency spectrum data of musical instrument；Intensity and rhythm when being played according to the audio file, the frequency spectrum data for being replaced musical instrument is replaced
It is changed to the frequency spectrum data of replaced musical instrument, generates new musical instrument Wave data.
In the embodiment of the present invention, when the frequency spectrum data for being replaced musical instrument is replaced with the frequency spectrum data of replaced musical instrument, replace
Change the frequency spectrum data in seclected time period.
In the embodiment of the present invention, after getting the selection instruction of user, the frequency spectrum data in musical instrument frequency spectrum data library is read,
According to current music play in intensity and rhythm, generate the Wave data of new musical instrument, the time for needing to replace selected to user
The such performance data of former musical instrument is replaced in section.
The technical solution of the embodiment of the present invention can automatically identify the musical instrument type in currently playing melody, while can root
It is selected according to user, at the appointed time section replacement plays the musical instrument accompaniment in melody, and the type progress for musical instrument accompaniment is one-to-one
Replacement, have higher playability and interest, it is more humanized.
Fig. 5 is the structure composition schematic diagram of the terminal of the embodiment of the present invention, as shown in figure 5, the terminal includes:
Audio decoder module 51, for obtaining audio file, according to the format of the audio file to the audio file
It is decoded, obtains the original waveform data of the audio file；
Music preprocessing module 52, for analyzing the original waveform data, isolate voice Wave data and
Musical instrument Wave data；
Musical instrument type judgment module 53, for obtaining the corresponding pleasure of the audio file according to the musical instrument Wave data
Device type；
Musical instrument replacement module 54, the musical instrument replacement operation for being selected based on user are read in musical instrument frequency spectrum data library
Frequency spectrum data, and according to the intensity and rhythm of the audio file, generate new musical instrument Wave data.
In the embodiment of the present invention, the music preprocessing module 52 includes:
Detection sub-module 521 is obtained for being detected by voice detection algorithm VAD to the original waveform data
Voice Wave data；
Filtering submodule 522 is obtained for being filtered out by multiband bandstop filter to the voice Wave data
Musical instrument Wave data.
In the embodiment of the present invention, the musical instrument type judgment module 53 includes:
Submodule 531 is determined, for determining the fundamental tone and overtone ratio of musical instrument according to the musical instrument Wave data；
Comparative sub-module 532, for by the musical instrument frequency spectrum in the fundamental tone and overtone ratio and musical instrument frequency spectrum data library into
Row compares, and obtains the corresponding musical instrument type of the audio file.
In the embodiment of the present invention, the musical instrument replacement module 54 includes:
Reading submodule 541, the musical instrument replacement operation for being selected based on user read institute in musical instrument frequency spectrum data library
Replace the frequency spectrum data of musical instrument；
Submodule 542 is replaced, intensity and rhythm when for playing according to the audio file will be replaced the frequency of musical instrument
Modal data replaces with the frequency spectrum data of replaced musical instrument, generates new musical instrument Wave data.
In the embodiment of the present invention, the replacement submodule 542 is also used to the frequency spectrum data for being replaced musical instrument replacing with institute
When replacing the frequency spectrum data of musical instrument, the frequency spectrum data in seclected time period is replaced.
It will be appreciated by those skilled in the art that the function that each unit in above-mentioned terminal is realized can refer to aforementioned audio number
According to the associated description of processing method understand.
Above-mentioned modules and each unit in practical applications, can by be located at terminal in central processing unit (CPU,
Central Processing Unit) or microprocessor (MPU, MicroProcessor Unit) or digital signal processor
(DSP, Digital Signal Processor) or field programmable gate array (FPGA, Field-Programmable
Gate Array) it realizes.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that the process, method, article or the device that include a series of elements not only include those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or device institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do
There is also other identical elements in the process, method of element, article or device.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art
The part contributed out can be embodied in the form of software products, which is stored in a storage medium
In (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that a terminal device (can be mobile phone, computer, clothes
Business device, air conditioner or the network equipment etc.) execute method described in each embodiment of the present invention.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (8)
1. a kind of processing method of audio data, which is characterized in that the described method includes:
Audio file is obtained, the audio file is decoded according to the format of the audio file, obtains the audio text
The original waveform data of part；
The original waveform data is analyzed, voice Wave data and musical instrument Wave data are isolated；It is described to the original
Beginning Wave data is analyzed, and voice Wave data and musical instrument Wave data are isolated, comprising: passes through voice detection algorithm VAD
The original waveform data is detected, voice Wave data is obtained；By multiband bandstop filter to the voice wave
Graphic data is filtered out, and musical instrument Wave data is obtained；
According to the musical instrument Wave data, the corresponding musical instrument type of the audio file is obtained；
Prompt the corresponding musical instrument type of the audio file；
Based on the musical instrument replacement operation of user's selection, the frequency spectrum data in musical instrument frequency spectrum data library is read, and according to the audio
The intensity and rhythm of file generate new musical instrument Wave data.
2. the processing method of audio data according to claim 1, which is characterized in that described according to the musical instrument waveform number
According to obtaining the corresponding musical instrument type of the audio file, comprising:
According to the musical instrument Wave data, the fundamental tone and overtone ratio of musical instrument are determined；
The fundamental tone and overtone ratio are compared with the musical instrument frequency spectrum in musical instrument frequency spectrum data library, obtain the audio file
Corresponding musical instrument type.
3. the processing method of audio data according to claim 1, which is characterized in that the musical instrument based on user's selection
Replacement operation reads the frequency spectrum data in musical instrument frequency spectrum data library, and according to the intensity and rhythm of the audio file, generates new
Musical instrument Wave data, comprising:
Based on the musical instrument replacement operation of user's selection, the frequency spectrum data of replaced musical instrument is read in musical instrument frequency spectrum data library；
Intensity and rhythm when being played according to the audio file, replace with replaced musical instrument for the frequency spectrum data for being replaced musical instrument
Frequency spectrum data, generate new musical instrument Wave data.
4. the processing method of audio data according to claim 3, which is characterized in that the method also includes:
When the frequency spectrum data for being replaced musical instrument is replaced with the frequency spectrum data of replaced musical instrument, the frequency spectrum in seclected time period is replaced
Data.
5. a kind of terminal, which is characterized in that the terminal includes:
Audio decoder module solves the audio file according to the format of the audio file for obtaining audio file
Code, obtains the original waveform data of the audio file；
Music preprocessing module isolates voice Wave data and musical instrument wave for analyzing the original waveform data
Graphic data；The music preprocessing module includes: detection sub-module, for passing through voice detection algorithm VAD to the original wave
Graphic data is detected, and voice Wave data is obtained；Submodule is filtered, for passing through multiband bandstop filter to the voice
Wave data is filtered out, and musical instrument Wave data is obtained；
Musical instrument type judgment module, for obtaining the corresponding musical instrument type of the audio file according to the musical instrument Wave data；
Musical instrument replacement module, the musical instrument replacement operation for being selected based on user read the spectrum number in musical instrument frequency spectrum data library
According to, and according to the intensity and rhythm of the audio file, generate new musical instrument Wave data.
6. terminal according to claim 5, which is characterized in that the musical instrument type judgment module includes:
Submodule is determined, for determining the fundamental tone and overtone ratio of musical instrument according to the musical instrument Wave data；
Comparative sub-module, for the fundamental tone and overtone ratio to be compared with the musical instrument frequency spectrum in musical instrument frequency spectrum data library,
Obtain the corresponding musical instrument type of the audio file.
7. terminal according to claim 5, which is characterized in that the musical instrument replacement module includes:
Reading submodule, the musical instrument replacement operation for being selected based on user are read in musical instrument frequency spectrum data library and replace pleasure
The frequency spectrum data of device；
Submodule is replaced, intensity and rhythm when for playing according to the audio file will be replaced the frequency spectrum data of musical instrument
The frequency spectrum data for replacing with replaced musical instrument generates new musical instrument Wave data.
8. terminal according to claim 7, which is characterized in that the replacement submodule is also used to that musical instrument will be replaced
When frequency spectrum data replaces with the frequency spectrum data of replaced musical instrument, the frequency spectrum data in seclected time period is replaced.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510292227.2A CN105096987B (en) | 2015-06-01 | 2015-06-01 | A kind of processing method and terminal of audio data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510292227.2A CN105096987B (en) | 2015-06-01 | 2015-06-01 | A kind of processing method and terminal of audio data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105096987A CN105096987A (en) | 2015-11-25 |
| CN105096987B true CN105096987B (en) | 2019-01-15 |
Family
ID=54577256
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510292227.2A Active CN105096987B (en) | 2015-06-01 | 2015-06-01 | A kind of processing method and terminal of audio data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105096987B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108399921B (en) * | 2018-02-27 | 2021-09-24 | 北京酷我科技有限公司 | Generation method of audio vertical line oscillogram |
| CN110796918A (en) * | 2019-10-29 | 2020-02-14 | 维沃移动通信有限公司 | Training method and device and mobile terminal |
| CN110782864A (en) * | 2019-11-02 | 2020-02-11 | 朝阳聚声泰（信丰）科技有限公司 | Vehicle-mounted intelligent sound effect system and implementation method thereof |
| CN113516971B (en) * | 2021-07-09 | 2023-09-29 | 深圳万兴软件有限公司 | Lyric conversion point detection method, device, computer equipment and storage medium |
| CN113781989B (en) * | 2021-09-23 | 2024-08-02 | 广州酷狗计算机科技有限公司 | Audio animation playing and rhythm stuck point identifying method and related device |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4315101B2 (en) * | 2004-12-20 | 2009-08-19 | ヤマハ株式会社 | Music content providing apparatus and program |
| CA2843437A1 (en) * | 2011-07-29 | 2013-02-28 | Matt Serletic | System and method for producing a more harmonious musical accompaniment and for applying a chain of effects to a musical composition |
| CN103761965B (en) * | 2014-01-09 | 2016-05-25 | 太原科技大学 | A kind of sorting technique of instrument signal |
| CN104616663A (en) * | 2014-11-25 | 2015-05-13 | 重庆邮电大学 | Music separation method of MFCC (Mel Frequency Cepstrum Coefficient)-multi-repetition model in combination with HPSS (Harmonic/Percussive Sound Separation) |
-
2015
- 2015-06-01 CN CN201510292227.2A patent/CN105096987B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN105096987A (en) | 2015-11-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105101366B (en) | Method for controlling mobile terminal and mobile terminal | |
| CN105096987B (en) | A kind of processing method and terminal of audio data | |
| CN104778067B (en) | Start method and the terminal unit of audio | |
| CN104809221B (en) | The recommendation method and device of music information | |
| CN104917896A (en) | Data pushing method and terminal equipment | |
| CN104766604B (en) | The labeling method and device of voice data | |
| CN105100892A (en) | Video playing device and method | |
| CN105208194A (en) | Voice broadcast device and method | |
| CN105897995B (en) | A kind of method and apparatus for adding contact information | |
| CN106303088A (en) | Prompting control method and mobile terminal | |
| CN105100477B (en) | Terminal notifying device and method | |
| CN106453878A (en) | Sound-based prompt method and mobile terminal | |
| CN106356065A (en) | Mobile terminal and voice conversion method | |
| CN105245938B (en) | The device and method for playing multimedia file | |
| CN106448665A (en) | Voice processing device and method | |
| CN106157970A (en) | A kind of audio identification methods and terminal | |
| CN106453939A (en) | Streaming media access method and apparatus | |
| CN106357886A (en) | Method and device for managing alarm of intelligent watch | |
| CN106534500A (en) | Customization service system and method based on figure attributes | |
| CN106776270A (en) | A kind of code detection method, device and terminal | |
| CN104731508B (en) | Audio frequency playing method and device | |
| CN106027492A (en) | Data transmission terminal and method | |
| CN104810033B (en) | Audio frequency playing method and device | |
| CN104834473B (en) | The method and device of input | |
| CN106793159A (en) | A kind of screen prjection method and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |