CN108337367A - A kind of instrument playing method and device based on mobile terminal - Google Patents
A kind of instrument playing method and device based on mobile terminal Download PDFInfo
- Publication number
- CN108337367A CN108337367A CN201810032252.0A CN201810032252A CN108337367A CN 108337367 A CN108337367 A CN 108337367A CN 201810032252 A CN201810032252 A CN 201810032252A CN 108337367 A CN108337367 A CN 108337367A
- Authority
- CN
- China
- Prior art keywords
- target
- musical instrument
- mobile terminal
- sound
- instrument
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/63—Querying
- G06F16/632—Query formulation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/68—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/686—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title or artist information, time, location or usage information, user ratings
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/36—Accompaniment arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72442—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for playing music files
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Mathematical Physics (AREA)
- Acoustics & Sound (AREA)
- Environmental & Geological Engineering (AREA)
- Library & Information Science (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Electrophonic Musical Instruments (AREA)
- Telephone Function (AREA)
Abstract
The instrument playing method based on mobile terminal that an embodiment of the present invention provides a kind of, wherein the method includes：During multi-medium data plays, the target instrument parameters accompanied to the multi-medium data are determined；Detection acts on the accompaniment operation of mobile terminal；Based on the target instrument parameters, determine that the accompaniment operates corresponding target musical instrument source of sound；When playing the multi-medium data, the target musical instrument source of sound is played.The embodiment of the present invention uses mobile terminal replacement instrument sounding, and it exports played out to playback equipment in real time, it mixes and plays with currently playing multi-medium data, achieve the purpose that play for multi-medium data using mobile terminal, the function of multimedia is enriched, the interaction of user and mobile terminal are enhanced.
Description
Technical field
The present embodiments relate to multimedia data processing field more particularly to a kind of musical instruments based on mobile terminal
Playing method and device.
Background technology
With the development of information technology, the function having in mobile terminal is more and more, greatly enriches the life of user
Living and work.For example, in mobile terminal have multimedia player, user can use the multimedia player play audio or
Video.But the function of existing multimedia player is excessively single, less with the interaction of user.
Invention content
The embodiment of the present invention provides a kind of instrument playing method based on mobile terminal, to solve existing multimedia
The function of device is excessively single, the less problem with the interaction of user.
In order to solve the above-mentioned technical problem, the invention is realized in this way：A kind of instrument playing side based on mobile terminal
Method, including：During multi-medium data plays, the target instrument parameters accompanied to the multi-medium data are determined；
Detection acts on the accompaniment operation of mobile terminal；Based on the target instrument parameters, determine that the accompaniment operates corresponding target
Musical instrument source of sound；When playing the multi-medium data, the target musical instrument source of sound is played.
In a first aspect, the embodiment of the present invention additionally provides a kind of instrument playing device based on mobile terminal, described device
Including：Target instrument parameters determining module, for during multi-medium data plays, determination to the multi-medium data into
The target instrument parameters of row accompaniment；Accompaniment operation detection module, for detecting the accompaniment operation for acting on mobile terminal；Target is found pleasure in
Device source of sound determining module determines that the accompaniment operates corresponding target musical instrument source of sound for being based on the target instrument parameters；It broadcasts
Amplification module, for when playing the multi-medium data, playing the target musical instrument source of sound.
In embodiments of the present invention, during multi-medium data plays, user can by trigger accompaniment operation come
Make the corresponding target musical instrument source of sound of mobile terminal playing, using mobile terminal replacement instrument sounding, and output in real time is to broadcasting
Equipment plays out and the mixing of currently playing multi-medium data plays, and reaches and is played for multi-medium data using mobile terminal
Purpose, enrich the function of multimedia, enhance the interaction of user and mobile terminal.
Description of the drawings
Fig. 1 is a kind of step flow chart of instrument playing embodiment of the method based on mobile terminal of the embodiment of the present invention；
Fig. 2 is a kind of step flow of another embodiment of instrument playing method based on mobile terminal of the embodiment of the present invention
Figure；
Fig. 3 is the specified control interface schematic diagram of the embodiment of the present invention；
Fig. 4 is the boundary division schematic diagram of the embodiment of the present invention；
Fig. 5 is the mobile terminal partial schematic diagram of the embodiment of the present invention；
Fig. 6 is a kind of structure diagram of instrument playing device embodiment based on mobile terminal of the embodiment of the present invention；
Fig. 7 is a kind of hardware architecture diagram of mobile terminal of the embodiment of the present invention.
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation describes, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair
Embodiment in bright, the every other implementation that those of ordinary skill in the art are obtained without creative efforts
Example, shall fall within the protection scope of the present invention.
Referring to Fig.1, a kind of step of instrument playing embodiment of the method based on mobile terminal of the embodiment of the present invention is shown
Rapid flow chart, can specifically include following steps：
Step 101, it during multi-medium data plays, determines and finds pleasure in the target that the multi-medium data is accompanied
Device parameter；
In embodiments of the present invention, in the process of the multi-medium datas such as mobile terminal playing picture, audio and/or video
In, user can use mobile terminal to carry out musical accompaniment.
It is possible, firstly, to determine the target instrument parameters accompanied to multi-medium data.When realizing, target musical instrument ginseng
Number can be the instrument parameters that user is selected by interactive interface (such as multimedia play interface, instrument playing interface), can be with
The including but not limited to information such as musical instrument mark, musical instrument pitch parameter.
Step 102, detection acts on the accompaniment operation of mobile terminal；
In the concrete realization, the companion acted in mobile terminal can be detected by the gravity sensor in mobile terminal
Operation is played, when gravity sensor detects pressure parameter, then can be determined that detect the accompaniment acted in mobile terminal
Operation.
Step 103, the target instrument parameters are based on, determine that the accompaniment operates corresponding target musical instrument source of sound；
In the concrete realization, when detecting accompaniment operation, it is corresponding that the embodiment of the present invention can obtain accompaniment operation
Pressure parameter, and the corresponding target musical instrument source of sound of the pressure parameter is determined by way of tabling look-up.
Step 104, when playing the multi-medium data, the target musical instrument source of sound is played.
After obtaining target musical instrument source of sound, the target musical instrument source of sound can be played, then in the playing process of multi-medium data
In, which plays simultaneously with multi-medium data, to achieve the effect that accompaniment.
In embodiments of the present invention, during multi-medium data plays, user can by trigger accompaniment operation come
Make the corresponding target musical instrument source of sound of mobile terminal playing, using mobile terminal replacement instrument sounding, and output in real time is to broadcasting
Equipment plays out and the mixing of currently playing multi-medium data plays, and reaches and is played for multi-medium data using mobile terminal
Purpose, enrich the function of multimedia, enhance the interaction of user and mobile terminal.
With reference to Fig. 2, a kind of another embodiment of instrument playing method based on mobile terminal of the embodiment of the present invention is shown
Step flow chart, can specifically include following steps：
Step 201, it during multi-medium data plays, determines and finds pleasure in the target that the multi-medium data is accompanied
Device parameter；
In embodiments of the present invention, performance pattern can be set, under performance pattern, in the process that multi-medium data plays
In, user can use the mobile terminal of currently playing multi-medium data to accompany the multi-medium data.
In specific implementation, by APK (AndroidPackage, Android installation kit) or mobile terminal can be integrated in
System in switch be arranged performance pattern.
Specifically, in one embodiment, an application program with performance pattern can be downloaded and install this and answered
With program, then when the application program is opened, while playing multi-medium data, user can add the multi-medium data
Musical instrument sound source is accompanied.
In another embodiment, the switch of performance pattern can be set in the system of mobile terminal, in the switch
When unlatching, if playing multi-medium data, musical instrument sound source can be added to the multi-medium data and accompanied.
It is possible, firstly, to determine the target instrument parameters accompanied to multi-medium data.
As a kind of preferable example of the embodiment of the present invention, target instrument parameters may include target musical instrument mark, target
Pitch parameter etc..And musical instrument mark can use musical instrument title and/or musical instrument icon to identify, for example, for percussion instrument, it is happy
Device mark can include but is not limited to timpani, xylophone, Ma Linba, vibraphone, bell, tubular bells etc..
Pitch parameter can be the parameter for indicating pitch, wherein pitch is the height of sound, and pitch is determined by frequency, unit
It is hertz (HZ), indicates to have vibrated how many in one second, frequency is fast, and sound is then high, and frequency is slow, and sound is then low.
In a kind of preferred embodiment of the embodiment of the present invention, if target instrument parameters identify for target musical instrument, step
201 may include following sub-step：
Sub-step S11 shows musical instrument identification list；
In embodiments of the present invention, can presetting a sound source data library, (generating mode about sound source data library will
Illustrate in step 204), the corresponding source of sound of one or more pitches of a variety of musical instruments can be stored in the sound source data library
Data, then the musical instrument of musical instrument all in sound source data library, which identifies, can be organized into musical instrument identification list.
After obtaining musical instrument identification list, the musical instrument identification list can be shown in specified control interface, wherein the pleasure
Musical instrument mark in device identification list can be selected.
In a kind of preferred embodiment of the embodiment of the present invention, sub-step S11 may further be：
The musical instrument identification list is illustrated in a specified region at displaying interface for terminal.
For example, as shown in figure 3, the displaying interface of terminal can be specified control interface, which can wrap
Specified region is included, specified region can be the region where musical instrument mark 301, when realizing, the region where musical instrument mark 301
It can be a numerical selector, a control of musical instrument identification list, the musical instrument identification list are provided by numerical selector
It can be implemented as drop-down list.
In figure 3, specified control interface can also include musical instrument control area, a musical instrument as above mark 302, next
Musical instrument mark 303, pause instrument playing 304 etc., specified control interface can also include multimedia control region, the multimedia control
Region processed can include but is not limited to song title 305, last track 306, next track 307, pause 308 etc..
In another preferred embodiment of the embodiment of the present invention, sub-step S11 may further be：
Each musical instrument mark in the musical instrument identification list is illustrated in the different zones at the displaying interface of terminal respectively
In.
When realizing, the displaying interface (i.e. specified control interface) of terminal can be divided into multiple regions for example, such as Fig. 4
Shown in boundary division schematic diagram, if in having 8 in musical instrument identification list musical instrument identify, can by specified control boundary division at
8 regions 401, each region show a kind of musical instrument mark.
In practice, can also include switching in the specified control interface of Fig. 4 in order to realize the broadcasting control of song
Region 402 clicks this and Zone switched 402 changing interface may be implemented, musical instrument control interface is switched to song control interface,
Song information and song control information are shown in the song control interface.
Sub-step S12 identifies the chosen musical instrument mark detected as target musical instrument.
When realizing, for the exhibition method of Fig. 3, it can obtain in drop-down list and the corresponding musical instrument mark of value is chosen to make
It is identified for target musical instrument, for example, the method for calling cardNumber obtains in drop-down list and chooses value.
For the exhibition method of Fig. 4, after showing musical instrument identification list, the selected behaviour of user on the screen can be detected
Make, determines the corresponding location information of the selected operation, and determine the corresponding region of the location information, as target area, and root
Determine that the corresponding target musical instrument in the target area identifies according to region and the incidence relation that musical instrument identifies.
In the present embodiment, if musical instrument is the musical instrument of fixed pitch, it is determined that i.e. executable step after target musical instrument mark
202。
In another preferred embodiment of the embodiment of the present invention, if target instrument parameters are target pitch parameter, walk
Rapid 201 can also include following sub-step：
Sub-step S13 shows the pitch adjustment list of the target musical instrument, and the pitch adjustment list includes a variety of pitches
Parameter；
Sub-step S14, using the chosen pitch parameter detected as target pitch parameter.
For the adjustable musical instrument of pitch, a plurality of types of pitches that can be had according to its musical instrument featured configuration musical instrument are joined
Number is stored in pitch adjustment list, when user's selected target musical instrument, pitch setting interface can be popped up or jump to, in sound
Show that pitch adjusts list in the form of drop-down list or list etc. in high setting interface, detection user adjusts list to the pitch
Selected operation, the pitch parameter that user is selected is as target pitch parameter.
In the present embodiment, if musical instrument is the musical instrument for being not fixed pitch, it is determined that target musical instrument identifies and target pitch
Step 202 is executed after parameter.
Step 202, detection acts on the accompaniment operation of mobile terminal；
In embodiments of the present invention, in the process of the multi-medium datas such as mobile terminal playing picture, audio and/or video
In, after determining target instrument parameters, in the state that specified control interface is opened, it can detect and act in mobile terminal
Accompaniment operation.
In one embodiment, it can be acted in mobile terminal by the gravity sensor in mobile terminal to detect
Accompaniment operation, when gravity sensor detects pressure parameter, then can be determined that and acted in mobile terminal to detect
Accompaniment operation.
In the concrete realization, mobile terminal partial schematic diagram as shown in Figure 5, mobile terminal may include mainboard 501, master
Upper and screen module 503, battery 504, mobile terminal rear cover 505, gravity sensor 502 (i.e. gravity sensor chip) setting
In on mainboard 501.
As shown in figure 5, accompaniment operation can act on the rear cover 505 of mobile terminal, i.e. accompaniment operation in Fig. 5
F1, alternatively, accompaniment operation may also act on the screen module 503 of mobile terminal, i.e. accompaniment operation F2 in Fig. 5 (makees
It is preferably operated under screen state of going out when on screen module 503).The embodiment of the present invention does not make the action direction of accompaniment operation
It limits.
In Figure 5, when there is accompaniment to act on mobile terminal, the vibrations of mobile terminal can be caused, which makes
Gravity sensor 502 measures the pressure data variation of vertical direction (Z-direction), is acted in mobile terminal to which judgement detects
Accompaniment operation.
Step 203, obtain what the gravity sensor in mobile terminal measured, the accompaniment operates corresponding goal pressure ginseng
Number；
In the concrete realization, after gravity sensor detects accompaniment operation, accompaniment operation can further be obtained
Pressure parameter, as goal pressure parameter.
In a kind of preferred embodiment of the embodiment of the present invention, step 203 can further include following sub-step：
Sub-step S21 determines the caused movement of the accompaniment operation when triggering accompaniment operation to mobile terminal
The vibrations duration of terminal；
Sub-step S22 obtains the maximum value for all pressure datas that the gravity sensor measures in the vibrations duration
And minimum value, and maximum value goal pressure corresponding as the accompaniment operation with the difference of the minimum value is joined
Number.
For example, as shown in Figure 3, it is assumed that the accompaniment operation of user's triggering is the operation that user covers beating after terminal, is clapped
There are one force effects in terminal for meeting after playing operation, this power is denoted as F1, and F1 can cause terminal to shake, and the in different size of F1 is drawn
The terminal shock momentum of hair is different, and terminal shakes so that gravity sensor measures the data variation of vertical direction (Z-direction).Generally
, the time that terminal shakes due to by beating is fixed, and the duration of vibrations is denoted as S0, in S0Interior gravity sensor data dithering
Variable quantity, operate corresponding goal pressure parameter as accompaniment, i.e. Z=| Zmax-Zmin |, wherein Z is gravity sensitive in formula
The variable quantity of device vertical direction, Zmax are the maximum value of gravity sensor Z-direction data, and Zmin is gravity sensor Z-direction number
According to minimum value.
Step 204, from the corresponding sound source data library of the target instrument parameters, the goal pressure parameter is matched, is obtained
Obtain corresponding target musical instrument source of sound；
After determining goal pressure parameter, the reference for the target musical instrument that can be stored from preset sound source data library
Pressure parameter searches goal pressure parameter, obtains the corresponding target of goal pressure parameter with the correspondence of musical instrument source of sound
Musical instrument source of sound.
In the concrete realization, for the musical instrument that pitch is fixed pitch, then each type can be stored in sound source data library
Musical instrument and corresponding reference pressure data incidence relation；For the musical instrument that pitch is on-fixed pitch, then sound source data
The incidence relation that the pitch parameter of each type of musical instrument and corresponding one or more pitch types can be stored in library, with
And the incidence relation of each pitch parameter and corresponding a variety of reference pressure data.
In practice, sound source data library can identify according to musical instrument and be divided into multiple consonant source databases, i.e. each musical instrument
Mark has corresponding sound source data library.
In a kind of preferred embodiment of the embodiment of the present invention, each musical instrument identifies corresponding sound source data library and may be used
As under type generates：
Step S1, detection user are directed to each source of sound in default source of sound list, the reference accompaniment operation of triggering；
In the concrete realization, source of sound list can be pre-set, may include in the source of sound list it is gathered in advance, currently
Musical instrument identifies what corresponding musical instrument can be sent out, the corresponding various tone sources of one or more pitches.
For each source of sound in source of sound list, user can be prompted to input with reference to accompaniment operation, and use gravity sensitive
Device detects accompaniment operation.
Step S2 is obtained described with reference to the corresponding reference pressure parameter of accompaniment operation；
With reference to the acquisition modes of above-mentioned goal pressure parameter, gravity sensor can be detected with reference to caused by accompaniment operation
Vibrations duration in pressure parameter variable quantity, as with reference to pressure parameter.
Step S3 generates the reference pressure parameter and the corresponding correspondence with reference to accompaniment operation, and will be described right
It should be related to and be stored in sound source data library.
After obtaining reference pressure parameter, the reference pressure parameter can be generated with corresponding with reference to the corresponding of accompaniment operation
Relationship, and the correspondence is stored in sound source data library.In embodiments of the present invention, user can be according to the use of itself
Custom triggers the corresponding reference accompaniment operation of each source of sound, and obtained sound source data library meets the individual demand of user.
It should be noted that the embodiment of the present invention is not limited to the mode in above-mentioned generation sound source data library, art technology
Personnel generate sound source data library using other modes and are possible, for example, the sound source data library of one acquiescence of setting.Having
During body is realized, musical instrument source of sound can be stored in an encoded form.The sound source data library can be stored in the local of terminal
In depositing, and/or, it can also store in the server, when storing in server, client needs to send goal pressure parameter
To server, matching operation is carried out by server and returns to target musical instrument source of sound, the embodiment of the present invention is not construed as limiting this.
Step 205, when playing the multi-medium data, the target musical instrument source of sound is played.
After obtaining target musical instrument source of sound, the target musical instrument source of sound can be played, then in the playing process of multi-medium data
In, which plays simultaneously with multi-medium data, to achieve the effect that accompaniment.
When realizing, the mode that multithreading may be used played while musical instrument source of sound and multi-medium data, example
Such as, the broadcasting that first thread control musical instrument source of sound may be used, the broadcasting of multi-medium data is controlled using the second thread, to reach
To the purpose accompanied for multi-medium data.
In embodiments of the present invention, mobile after determining target instrument parameters during multi-medium data plays
Terminal can be operated by detecting the accompaniment of user's triggering to determine goal pressure parameter, and be determined by goal pressure parameter
Target musical instrument source of sound, so that playing target musical instrument source of sound while mobile terminal playing multi-medium data, the present invention is implemented
Example uses mobile terminal replacement instrument sounding, and exports played out to playback equipment and currently playing multimedia number in real time
It is played according to mixing, achievees the purpose that play for multi-medium data using mobile terminal, enrich the function of multimedia, enhance
The interaction of user and mobile terminal.
In order to make those skilled in the art can better understand that the embodiment of the present invention, below by way of a specific example pair
The embodiment of the present invention illustrates, but it should be recognized that the embodiment of the present invention is not limited to this：
Performance pattern is opened by APK or the switch being integrated in the system of mobile terminal, can be used under this pattern
Loudspeaker or earphone play local and online song.The power for the rear cover or screen that user pats mobile terminal after selected musical instrument is moved
The gravity sensor of dynamic terminal measures (impact screen preferably operates under screen state of going out), and calling of tabling look-up strikes musical instrument to this power
The source of sound of sounding takes out the source of sound from memory, multimedia layer decoding source of sound with currently after the song of broadcasting does audio mixing
It plays together.
It should be noted that for embodiment of the method, for simple description, therefore it is all expressed as a series of action group
It closes, but those skilled in the art should understand that, the embodiment of the present invention is not limited by the described action sequence, because according to
According to the embodiment of the present invention, certain steps can be performed in other orders or simultaneously.Secondly, those skilled in the art also should
Know, embodiment described in this description belongs to preferred embodiment, and the involved action not necessarily present invention is implemented
Necessary to example.
With reference to Fig. 6, a kind of knot of instrument playing device embodiment based on mobile terminal of the embodiment of the present invention is shown
Structure block diagram, can specifically include following module：
Target instrument parameters determining module 601, for during multi-medium data plays, determining to the multimedia
The target instrument parameters that data are accompanied；
Accompaniment operation detection module 602, for detecting the accompaniment operation for acting on mobile terminal；
Target musical instrument source of sound determining module 603 determines that the accompaniment operation corresponds to for being based on the target instrument parameters
Target musical instrument source of sound；
Playing module 604, for when playing the multi-medium data, playing the target musical instrument source of sound.
In a kind of preferred embodiment of the embodiment of the present invention, the target musical instrument source of sound determining module 603 further may be used
To include following submodule：
Goal pressure parameter determination submodule, for determining corresponding goal pressure parameter based on accompaniment operation；
Goal pressure parameter matched sub-block, for from the corresponding sound source data library of the target instrument parameters, matching
The goal pressure parameter obtains corresponding target musical instrument source of sound.
In a kind of preferred embodiment of the embodiment of the present invention, the target instrument parameters include target musical instrument mark, institute
It may include following submodule to state target instrument parameters determining module 601：
Musical instrument identification list shows submodule, for showing musical instrument identification list；
Musical instrument mark selectes submodule, for identifying the chosen musical instrument mark detected as target musical instrument.
In a kind of preferred embodiment of the embodiment of the present invention, the target instrument parameters further include the target of target musical instrument
Pitch parameter, the target instrument parameters determining module 601 further includes following submodule：
Pitch adjusts list and shows submodule, for showing that the pitch of the target musical instrument adjusts list, the pitch tune
Permutation table includes a variety of pitch parameters；
Pitch selectes submodule, for using the chosen pitch parameter detected as target pitch parameter.
In a kind of preferred embodiment of the embodiment of the present invention, the goal pressure parameter determination submodule includes：
Submodule is measured, for obtaining the measurement of the gravity sensor in mobile terminal, the accompaniment operates corresponding mesh
Mark pressure parameter.
In a kind of preferred embodiment of the embodiment of the present invention, the measurement submodule includes：
Duration determination unit is shaken, for when triggering accompaniment operation to mobile terminal, determining that the accompaniment operation is drawn
The vibrations duration of the mobile terminal risen；
Difference computational unit, for obtaining all pressure datas of the gravity sensor measurement in the vibrations duration
Maximum value and minimum value, and using maximum value target pressure corresponding as the accompaniment operation with the difference of the minimum value
Force parameter.
In a kind of preferred embodiment of the embodiment of the present invention, described device further includes：
Sound source data library generation module, for generating sound source data library, including：
Detection sub-module is operated with reference to accompaniment, each source of sound in default source of sound list is directed to for detecting user, triggering
It is operated with reference to accompaniment；
Reference pressure parameter acquiring submodule, it is described with reference to the corresponding reference pressure parameter of accompaniment operation for obtaining；
Correspondence generates submodule, for generating the reference pressure parameter with corresponding with reference to the corresponding of accompaniment operation
Relationship, and the correspondence is stored in sound source data library.
For mobile terminal embodiment, since it is basically similar to the method embodiment, so description is fairly simple,
The relevent part can refer to the partial explaination of embodiments of method.
Mobile terminal provided in an embodiment of the present invention can realize that mobile terminal is realized in the embodiment of the method for Fig. 1 to Fig. 2
Each process, to avoid repeating, which is not described herein again.The mobile terminal is during multi-medium data plays, Yong Huke
To be operated such that the corresponding target musical instrument source of sound of mobile terminal playing by triggering accompaniment, sent out using mobile terminal replacement instrument
Sound, and export played out to playback equipment and the mixing of currently playing multi-medium data plays in real time, reach using it is mobile eventually
End is the purpose that multi-medium data is played, and enriches the function of multimedia, enhances the interaction of user and mobile terminal.
A kind of hardware architecture diagram of Fig. 7 mobile terminals of each embodiment to realize the present invention, the mobile terminal 70
Including but not limited to：Radio frequency unit 71, network module 72, audio output unit 73, input unit 74, sensor 75, display are single
The components such as member 76, user input unit 77, interface unit 78, memory 79, processor 710 and power supply 711.This field skill
Art personnel are appreciated that mobile terminal structure shown in Fig. 7 does not constitute the restriction to mobile terminal, and mobile terminal can wrap
It includes than illustrating more or fewer components, either combines certain components or different components arrangement.In the embodiment of the present invention
In, mobile terminal include but not limited to mobile phone, tablet computer, laptop, palm PC, car-mounted terminal, wearable device,
And pedometer etc..
Wherein, processor 710, for during multi-medium data plays, determining and being carried out to the multi-medium data
The target instrument parameters of accompaniment；Detection acts on the accompaniment operation of mobile terminal；Based on the target instrument parameters, determine described in
Accompaniment operates corresponding target musical instrument source of sound；When playing the multi-medium data, the target musical instrument source of sound is played.
For the mobile terminal of the embodiment of the present invention during multi-medium data plays, user can be by triggering accompaniment behaviour
Make to make the corresponding target musical instrument source of sound of mobile terminal playing, using mobile terminal replacement instrument sounding, and output is given in real time
Playback equipment plays out and the mixing of currently playing multi-medium data plays, and it is multi-medium data to reach using mobile terminal
The purpose of performance enriches the function of multimedia, enhances the interaction of user and mobile terminal.
It should be understood that the embodiment of the present invention in, radio frequency unit 71 can be used for receiving and sending messages or communication process in, signal
It sends and receivees, specifically, after the downlink data from base station is received, is handled to processor 710；In addition, by the number of uplink
According to being sent to base station.In general, radio frequency unit 71 include but not limited to antenna, at least one amplifier, transceiver, coupler,
Low-noise amplifier, duplexer etc..In addition, radio frequency unit 71 can also system and network and other equipment be logical by radio communication
Letter.
Mobile terminal has provided wireless broadband internet to the user by network module 72 and has accessed, and such as helps user's transmitting-receiving
Email, browsing webpage and access streaming video etc..
It is that audio output unit 73 can receive radio frequency unit 71 or network module 72 or stored in memory 79
Audio data be converted into audio signal and export be sound.Moreover, audio output unit 73 can also be provided with movement eventually
The relevant audio output of specific function (for example, call signal receives sound, message sink sound etc.) that end 70 executes.Audio
Output unit 73 includes loud speaker, buzzer and receiver etc..
Input unit 74 is for receiving audio or video signal.Input unit 74 may include graphics processor
(Graphics Processing Unit, GPU) 741 and microphone 742, graphics processor 741 in video acquisition mode or
The image data of the static images or video that are obtained by image capture apparatus (such as camera) in image capture mode is handled.
Treated, and picture frame may be displayed on display unit 76.Through graphics processor 741, treated that picture frame can be stored in
It is sent in memory 79 (or other storage mediums) or via radio frequency unit 71 or network module 72.Microphone 742 can
To receive sound, and can be audio data by such acoustic processing.Treated, and audio data can be in telephone relation
The format output of mobile communication base station can be sent to via radio frequency unit 71 by being converted in the case of pattern.
Mobile terminal 70 further includes at least one sensor 75, such as optical sensor, motion sensor and other sensings
Device.Specifically, optical sensor includes ambient light sensor and proximity sensor, wherein ambient light sensor can be according to ambient light
The light and shade of line adjusts the brightness of display panel 761, and proximity sensor can close display when mobile terminal 70 is moved in one's ear
Panel 761 and/or backlight.As a kind of motion sensor, accelerometer sensor can detect in all directions (generally three
Axis) acceleration size, size and the direction of gravity are can detect that when static, it is (such as horizontal to can be used to identify mobile terminal posture
Vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap) etc.；Sensor
75 can also include fingerprint sensor, pressure sensor, iris sensor, molecule sensor, gyroscope, barometer, hygrometer,
Thermometer, infrared sensor etc., details are not described herein.
Display unit 76 is for showing information input by user or being supplied to the information of user.Display unit 76 may include
Liquid crystal display (Liquid Crystal Display, LCD), Organic Light Emitting Diode may be used in display panel 761
Forms such as (Organic Light-Emitting Diode, OLED) configure display panel 761.
User input unit 77 can be used for receiving the number or character information of input, and generate the user with mobile terminal
Setting and the related key signals input of function control.Specifically, user input unit 77 include touch panel 771 and other
Input equipment 772.Touch panel 771, also referred to as touch screen collect user on it or neighbouring touch operation (for example are used
Family uses the behaviour of any suitable object or attachment on touch panel 771 or near touch panel 771 such as finger, stylus
Make).Touch panel 771 may include both touch detecting apparatus and touch controller.Wherein, touch detecting apparatus detection is used
The touch orientation at family, and the signal that touch operation is brought is detected, transmit a signal to touch controller；Touch controller is from touch
Touch information is received in detection device, and is converted into contact coordinate, then gives processor 710, is received processor 710 and is sent
Order and executed.Furthermore, it is possible to be realized using multiple types such as resistance-type, condenser type, infrared ray and surface acoustic waves
Touch panel 771.In addition to touch panel 771, user input unit 77 can also include other input equipments 772.Specifically,
His input equipment 772 can include but is not limited to physical keyboard, function key (such as volume control button, switch key etc.), rail
Mark ball, mouse, operating lever, details are not described herein.
Further, touch panel 771 can be covered on display panel 761, when touch panel 771 detect on it or
After neighbouring touch operation, processor 710 is sent to determine the type of touch event, is followed by subsequent processing device 710 according to touch thing
The type of part provides corresponding visual output on display panel 761.Although in the figure 7, touch panel 771 and display panel
761 be realize the function that outputs and inputs of mobile terminal as two independent components, but in some embodiments it is possible to
The function that outputs and inputs of touch panel 771 and display panel 761 being integrated and realized mobile terminal, does not limit specifically herein
It is fixed.
Interface unit 78 is the interface that external device (ED) is connect with mobile terminal 70.For example, external device (ED) may include wired
Or wireless head-band earphone port, external power supply (or battery charger) port, wired or wireless data port, storage card end
Mouth, port, the port audio input/output (I/O), video i/o port, earphone end for connecting the device with identification module
Mouthful etc..Interface unit 78 can be used for receiving the input (for example, data information, electric power etc.) from external device (ED) and will
The one or more elements or can be used in mobile terminal 70 and outside that the input received is transferred in mobile terminal 70
Transmission data between device.
Memory 79 can be used for storing software program and various data.Memory 79 can mainly include storing program area and
Storage data field, wherein storing program area can storage program area, application program (such as the sound needed at least one function
Playing function, image player function etc.) etc.；Storage data field can be stored uses created data (such as sound according to mobile phone
Frequency evidence, phone directory etc.) etc..In addition, memory 79 may include high-speed random access memory, can also include non-volatile
Memory, for example, at least a disk memory, flush memory device or other volatile solid-state parts.
Processor 710 is the control centre of mobile terminal, utilizes each of various interfaces and the entire mobile terminal of connection
A part by running or execute the software program and/or module that are stored in memory 79, and calls and is stored in memory
Data in 79 execute the various functions and processing data of mobile terminal, to carry out integral monitoring to mobile terminal.Processor
710 may include one or more processing units；Preferably, processor 710 can integrate application processor and modem processor,
Wherein, the main processing operation system of application processor, user interface and application program etc., modem processor mainly handles nothing
Line communicates.It is understood that above-mentioned modem processor can not also be integrated into processor 710.
Mobile terminal 70 can also include the power supply 711 (such as battery) powered to all parts, it is preferred that power supply 711
Can be logically contiguous by power-supply management system and processor 710, to realize management charging by power-supply management system, put
The functions such as electricity and power managed.
In addition, mobile terminal 70 includes some unshowned function modules, details are not described herein.
Preferably, the embodiment of the present invention also provides a kind of mobile terminal, including processor 710, and memory 79 is stored in
It is real when which is executed by processor 710 on reservoir 79 and the computer program that can be run on the processor 710
Existing above-mentioned each process in the instrument playing embodiment of the method based on mobile terminal, and identical technique effect can be reached, it is
It avoids repeating, which is not described herein again.
The embodiment of the present invention also provides a kind of computer readable storage medium, and meter is stored on computer readable storage medium
Calculation machine program, the computer program realize the above-mentioned instrument playing embodiment of the method based on mobile terminal when being executed by processor
Each process, and identical technique effect can be reached, to avoid repeating, which is not described herein again.Wherein, described computer-readable
Storage medium, such as read-only memory (Read-Only Memory, abbreviation ROM), random access memory (Random Access
Memory, abbreviation RAM), magnetic disc or CD etc..
It should be noted that herein, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that process, method, article or device including a series of elements include not only those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or device institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including this
There is also other identical elements in the process of element, method, article or device.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical scheme of the present invention substantially in other words does the prior art
Going out the part of contribution can be expressed in the form of software products, which is stored in a storage medium
In (such as ROM/RAM, magnetic disc, CD), including some instructions are used so that a station terminal (can be mobile phone, computer, service
Device, air conditioner or network equipment etc.) execute method described in each embodiment of the present invention.
The embodiment of the present invention is described with above attached drawing, but the invention is not limited in above-mentioned specific
Embodiment, the above mentioned embodiment is only schematical, rather than restrictive, those skilled in the art
Under the inspiration of the present invention, without breaking away from the scope protected by the purposes and claims of the present invention, it can also make very much
Form belongs within the protection of the present invention.
Claims (10)
1. a kind of instrument playing method based on mobile terminal, which is characterized in that the method includes：
During multi-medium data plays, the target instrument parameters accompanied to the multi-medium data are determined；
Detection acts on the accompaniment operation of mobile terminal；
Based on the target instrument parameters, determine that the accompaniment operates corresponding target musical instrument source of sound；
When playing the multi-medium data, the target musical instrument source of sound is played.
2. according to the method described in claim 1, it is characterized in that, it is described be based on the target instrument parameters, determine the companion
Playing the step of operating corresponding target musical instrument source of sound includes：
Corresponding goal pressure parameter is determined based on accompaniment operation；
From the corresponding sound source data library of the target instrument parameters, the goal pressure parameter is matched, corresponding target is obtained
Musical instrument source of sound.
3. method according to claim 1 or 2, which is characterized in that the target instrument parameters include target musical instrument mark,
The step of target instrument parameters that the determination accompanies to the multi-medium data includes：
Show musical instrument identification list；
The chosen musical instrument mark detected is identified as target musical instrument.
4. according to the method described in claim 3, it is characterized in that, the target instrument parameters further include the target of target musical instrument
The step of pitch parameter, the target instrument parameters that the determination accompanies to the multi-medium data includes：
Show the pitch adjustment list of the target musical instrument, the pitch adjustment list includes a variety of pitch parameters；
Using the chosen pitch parameter detected as target pitch parameter.
5. according to the method described in claim 2, it is characterized in that, described determine corresponding target pressure based on accompaniment operation
The step of force parameter includes：
Obtain what the gravity sensor in mobile terminal measured, the accompaniment operates corresponding goal pressure parameter.
6. according to the method described in claim 5, it is characterized in that, the gravity sensor obtained in mobile terminal measures
, the step of accompaniment operates corresponding goal pressure parameter includes：
When triggering accompaniment operation to mobile terminal, when determining the vibrations of the caused mobile terminal of the accompaniment operation
It is long；
The maximum value and minimum value of all pressure datas that the gravity sensor measures in the vibrations duration are obtained, and will
The maximum value and the difference of the minimum value are as the corresponding goal pressure parameter of the accompaniment operation.
7. according to the method described in claim 2, it is characterized in that, the sound source data library generates in the following way：
It detects user and is directed to each source of sound in default source of sound list, the reference accompaniment operation of triggering；
It obtains described with reference to the corresponding reference pressure parameter of accompaniment operation；
The reference pressure parameter and the corresponding correspondence with reference to accompaniment operation are generated, and the correspondence is stored in
In sound source data library.
8. a kind of instrument playing device based on mobile terminal, which is characterized in that described device includes：
Target instrument parameters determining module, for during multi-medium data plays, determination to the multi-medium data into
The target instrument parameters of row accompaniment；
Accompaniment operation detection module, for detecting the accompaniment operation for acting on mobile terminal；
Target musical instrument source of sound determining module determines that the accompaniment operates corresponding target for being based on the target instrument parameters
Musical instrument source of sound；
Playing module, for when playing the multi-medium data, playing the target musical instrument source of sound.
9. device according to claim 8, which is characterized in that the target musical instrument source of sound determining module includes：
Goal pressure parameter determination submodule, for determining corresponding goal pressure parameter based on accompaniment operation；
Goal pressure parameter matched sub-block is used for from the corresponding sound source data library of the target instrument parameters, described in matching
Goal pressure parameter obtains corresponding target musical instrument source of sound.
10. device according to claim 8 or claim 9, which is characterized in that the target instrument parameters include target musical instrument mark
Know, the target instrument parameters determining module includes：
Musical instrument identification list shows submodule, for showing musical instrument identification list；
Musical instrument mark selectes submodule, for identifying the chosen musical instrument mark detected as target musical instrument.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810032252.0A CN108337367B (en) | 2018-01-12 | 2018-01-12 | Musical instrument playing method and device based on mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810032252.0A CN108337367B (en) | 2018-01-12 | 2018-01-12 | Musical instrument playing method and device based on mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108337367A true CN108337367A (en) | 2018-07-27 |
| CN108337367B CN108337367B (en) | 2021-01-12 |
Family
ID=62924951
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810032252.0A Active CN108337367B (en) | 2018-01-12 | 2018-01-12 | Musical instrument playing method and device based on mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108337367B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110223664A (en) * | 2019-05-22 | 2019-09-10 | 上海墩庐生物医学科技有限公司 | The methods and applications of opera gong and drum are played in a kind of mobile phone and plate mobile terminal |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2005122138A1 (en) * | 2004-06-14 | 2005-12-22 | Condition30 Inc. | Cellular automata music generator |
| CN101465121A (en) * | 2009-01-14 | 2009-06-24 | 苏州瀚瑞微电子有限公司 | Method for implementing touch virtual electronic organ |
| CN101673540A (en) * | 2009-08-13 | 2010-03-17 | 上海酷吧信息技术有限公司 | Method and device for realizing playing music of mobile terminal |
| CN103258529A (en) * | 2013-04-16 | 2013-08-21 | 初绍军 | Performance method of electronic musical instrument and music |
| US20150082973A1 (en) * | 2013-07-12 | 2015-03-26 | Apple Inc. | Selecting audio samples based on excitation state |
| CN105391864A (en) * | 2015-11-26 | 2016-03-09 | 努比亚技术有限公司 | Apparatus and method for controlling vibration of mobile terminal based on pressure |
| CN105635458A (en) * | 2015-12-28 | 2016-06-01 | 广东欧珀移动通信有限公司 | Percussion music playing method and device |
| CN105700808A (en) * | 2016-02-18 | 2016-06-22 | 广东欧珀移动通信有限公司 | Music playing method and device and terminal device |
| CN105739995A (en) * | 2016-03-03 | 2016-07-06 | 上海与德通讯技术有限公司 | Playing simulating method and playing simulating module |
| CN105824529A (en) * | 2016-03-11 | 2016-08-03 | 深圳还是威健康科技有限公司 | Method for controlling music playing and intelligent wearable equipment |
| CN106297760A (en) * | 2016-08-08 | 2017-01-04 | 西北工业大学 | A kind of algorithm of software quick playing musical instrument |
-
2018
- 2018-01-12 CN CN201810032252.0A patent/CN108337367B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2005122138A1 (en) * | 2004-06-14 | 2005-12-22 | Condition30 Inc. | Cellular automata music generator |
| CN101465121A (en) * | 2009-01-14 | 2009-06-24 | 苏州瀚瑞微电子有限公司 | Method for implementing touch virtual electronic organ |
| CN101673540A (en) * | 2009-08-13 | 2010-03-17 | 上海酷吧信息技术有限公司 | Method and device for realizing playing music of mobile terminal |
| CN103258529A (en) * | 2013-04-16 | 2013-08-21 | 初绍军 | Performance method of electronic musical instrument and music |
| US20150082973A1 (en) * | 2013-07-12 | 2015-03-26 | Apple Inc. | Selecting audio samples based on excitation state |
| CN105391864A (en) * | 2015-11-26 | 2016-03-09 | 努比亚技术有限公司 | Apparatus and method for controlling vibration of mobile terminal based on pressure |
| CN105635458A (en) * | 2015-12-28 | 2016-06-01 | 广东欧珀移动通信有限公司 | Percussion music playing method and device |
| CN105700808A (en) * | 2016-02-18 | 2016-06-22 | 广东欧珀移动通信有限公司 | Music playing method and device and terminal device |
| CN105739995A (en) * | 2016-03-03 | 2016-07-06 | 上海与德通讯技术有限公司 | Playing simulating method and playing simulating module |
| CN105824529A (en) * | 2016-03-11 | 2016-08-03 | 深圳还是威健康科技有限公司 | Method for controlling music playing and intelligent wearable equipment |
| CN106297760A (en) * | 2016-08-08 | 2017-01-04 | 西北工业大学 | A kind of algorithm of software quick playing musical instrument |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110223664A (en) * | 2019-05-22 | 2019-09-10 | 上海墩庐生物医学科技有限公司 | The methods and applications of opera gong and drum are played in a kind of mobile phone and plate mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108337367B (en) | 2021-01-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107396137A (en) | The method, apparatus and system of online interaction | |
| CN109448761B (en) | Method and device for playing songs | |
| KR20110064530A (en) | Operation method of device based on a alteration ratio of touch area and apparatus using the same | |
| CN108762640A (en) | A kind of display methods and terminal of barrage information | |
| CN108509660A (en) | A kind of broadcasting object recommendation method and terminal device | |
| CN108319445A (en) | A kind of audio frequency playing method and mobile terminal | |
| CN108737921A (en) | A kind of control method for playing back, system, earphone and mobile terminal | |
| CN110465080A (en) | Control method, apparatus, mobile terminal and the computer readable storage medium of vibration | |
| CN106210266B (en) | A kind of acoustic signal processing method and audio signal processor | |
| CN109194899A (en) | A kind of method and terminal of audio-visual synchronization | |
| WO2021139535A1 (en) | Method, apparatus and system for playing audio, and device and storage medium | |
| CN110796918A (en) | Training method and device and mobile terminal | |
| CN107743178A (en) | A kind of message player method and mobile terminal | |
| CN109407832A (en) | A kind of control method and terminal device of terminal device | |
| CN108228882A (en) | The recommendation method and terminal device of a kind of audition for the songs segment | |
| CN110365853A (en) | A kind of reminding method and electronic equipment | |
| CN109862430A (en) | Multi-medium play method and terminal device | |
| US20120090447A1 (en) | Information processing terminal and system | |
| KR100617719B1 (en) | Apparatus and method for generating movement dependent sound in a mobile communication terminal equipment | |
| CN107743268A (en) | The edit methods and mobile terminal of a kind of video | |
| CN108735194B (en) | Beat prompting method and device | |
| CN107908348B (en) | The method and mobile terminal of display | |
| CN109949809A (en) | A kind of sound control method and terminal device | |
| CN108430004A (en) | A kind of loud speaker amplitude regulating device, adjusting method and mobile terminal | |
| CN108337367A (en) | A kind of instrument playing method and device based on mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |