CN106709427B - Keyboard action detection method and device - Google Patents
Keyboard action detection method and device Download PDFInfo
- Publication number
- CN106709427B CN106709427B CN201611087070.0A CN201611087070A CN106709427B CN 106709427 B CN106709427 B CN 106709427B CN 201611087070 A CN201611087070 A CN 201611087070A CN 106709427 B CN106709427 B CN 106709427B
- Authority
- CN
- China
- Prior art keywords
- keyboard
- specified
- button
- key
- key area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Input From Keyboards Or The Like (AREA)
Abstract
The present invention provides a kind of keyboard action detection method and device.The embodiment of the present invention plays the keyboard image of specified keyboard by obtaining the player that image collecting device is gathered, the player for making it possible to be gathered according to described image harvester plays the reference picture of the keyboard image and the specified keyboard built in advance of specifying keyboard, obtain the detection actuation of keys of the specified keyboard, the keyboard image of keyboard is specified by being played according to player, reproduce player and play the keyboard state for specifying keyboard, it is achieved thereby that the purpose of the keyboard action of button kind musical instrument such as detection piano.
Description
【Technical field】
The present invention relates to detection technique, more particularly to a kind of keyboard action detection method and device.
【Background technology】
Piano, it is musical instrument most commonly seen in button kind musical instrument.Ordinary listener, can not on the premise of no professional knowledge
Evaluate the performance level of the button kind musical instruments such as the playing piano of player.
Therefore, it is a kind of to detect the method for the keyboard action of the button kind musical instrument such as piano to need offer badly, is played with evaluating
The performance level of person.
【The content of the invention】
The many aspects of the present invention provide a kind of keyboard action detection method and device, to detect the button such as piano class pleasure
The keyboard action of device.
An aspect of of the present present invention, there is provided a kind of keyboard action detection method, including：
Obtain the player that image collecting device is gathered and play the keyboard image for specifying keyboard；
The player that is gathered according to described image harvester plays the keyboard image for specifying keyboard and built in advance
The reference picture of the specified keyboard, obtain the detection actuation of keys of the specified keyboard.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, the assignment key
Disk includes the first key area and the second key area；First key area include at least one first button and it is described extremely
Mark in few first button set by the specified location of each first button；Second key area includes at least one
Individual second button；Described image harvester is arranged at the surface of first key area；It is described to be adopted according to described image
The player that acquisition means are gathered plays the reference picture of the keyboard image and the specified keyboard built in advance of specifying keyboard,
The detection actuation of keys of the specified keyboard is obtained, including：
Mark according to the keyboard image of first key area set by the specified location of each first button
Described in the reference picture of note and first key area built in advance set by the specified location of each first button
Mark, obtain the misalignment of each first button；And the misalignment according to each first button, obtain institute
State the detection actuation of keys of the first key area；Or
Each second button at least one second button, is obtained according to the keyboard image of second key area
Each second button is obtained by the circumstance of occlusion of other the second buttons；And according to each second button by other buttons
Circumstance of occlusion and second key area built in advance reference picture described in each second button by other second
The circumstance of occlusion of button, obtain the detection actuation of keys of second key area.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, described each the
Mark set by the specified location of one button includes the paster of particular geometric figure.
Aspect as described above and any possible implementation, it is further provided a kind of implementation,
First key area is the intermediate region of the specified keyboard；
Second key area is in the beside of the intermediate region both sides in the specified keyboard.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, it is described according to institute
State the player that image collecting device gathered and play the specified keyboard specifying the keyboard image of keyboard and build in advance
Reference picture, before the detection actuation of keys for obtaining the specified keyboard, in addition to：
Build the reference picture of the specified keyboard.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, it is described according to institute
State the player that image collecting device gathered and play the specified keyboard specifying the keyboard image of keyboard and build in advance
Reference picture, after the detection actuation of keys for obtaining the specified keyboard, in addition to：
Acted according to the detection actuation of keys of the specified keyboard and the standard key of current reference, obtain the player
Play the key-case of the specified keyboard.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, it is described according to institute
The detection actuation of keys of specified keyboard and the standard key action of current reference are stated, the player is obtained and plays the assignment key
After the key-case of disk, in addition to：
Export the key-case that the player plays the specified keyboard.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, the output institute
The key-case that player plays the specified keyboard is stated, including：
Obtain the original video information that the player that video acquisition device is gathered plays the specified keyboard；
The key-case of the specified keyboard is played according to the original video information and the player, obtains described point
Enjoy video information；
Export the sharing video frequency information.
Another aspect of the present invention, there is provided a kind of keyboard action detection means, including：
Acquiring unit, the keyboard image of specified keyboard is played for obtaining the player that image collecting device is gathered；
Analytic unit, the player for being gathered according to described image harvester play the keyboard image for specifying keyboard
The reference picture of the specified keyboard built in advance, obtain the detection actuation of keys of the specified keyboard.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, the assignment key
Disk includes the first key area and the second key area；First key area include at least one first button and it is described extremely
Mark in few first button set by the specified location of each first button；Second key area includes at least one
Individual second button；The analytic unit, is specifically used for
Mark according to the keyboard image of first key area set by the specified location of each first button
Described in the reference picture of note and first key area built in advance set by the specified location of each first button
Mark, obtain the misalignment of each first button；And the misalignment according to each first button, obtain institute
State the detection actuation of keys of the first key area；Or
Each second button at least one second button, is obtained according to the keyboard image of second key area
Each second button is obtained by the circumstance of occlusion of other the second buttons；And according to each second button by other buttons
Circumstance of occlusion and second key area built in advance reference picture described in each second button by other second
The circumstance of occlusion of button, obtain the detection actuation of keys of second key area.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, described each the
Mark set by the specified location of one button includes the paster of particular geometric figure.
Aspect as described above and any possible implementation, it is further provided a kind of implementation,
First key area is the intermediate region of the specified keyboard；
Second key area is in the beside of the intermediate region both sides in the specified keyboard.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, the analysis are single
Member, it is additionally operable to
Build the reference picture of the specified keyboard.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, the analysis are single
Member, it is additionally operable to
Acted according to the detection actuation of keys of the specified keyboard and the standard key of current reference, obtain the player
Play the key-case of the specified keyboard.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, the analysis are single
Member, it is additionally operable to
Export the key-case that the player plays the specified keyboard.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, the analysis are single
Member, it is specifically used for
Obtain the original video information that the player that video acquisition device is gathered plays the specified keyboard；
The key-case of the specified keyboard is played according to the original video information and the player, obtains described point
Enjoy video information；And
Export the sharing video frequency information.
As shown from the above technical solution, the embodiment of the present invention is played by obtaining the player that image collecting device is gathered
Specify the keyboard image of keyboard, enabling the player gathered according to described image harvester plays the key for specifying keyboard
The reference picture of disk image and the specified keyboard built in advance, the detection actuation of keys of the specified keyboard is obtained, is passed through
The keyboard image for specifying keyboard is played according to player, player is reproduced and plays the keyboard state for specifying keyboard, it is achieved thereby that
Detect the purpose of the keyboard actions of button kind musical instrument such as piano.
In addition, using technical scheme provided by the present invention, by being moved according to the detection button of the specified keyboard obtained
Make and the standard key of current reference acts, obtain the key-case that player plays the specified keyboard, and then by the button
Situation is exported, and can effectively strengthen the visualization of keyboard action detection.
【Brief description of the drawings】
Technical scheme in order to illustrate the embodiments of the present invention more clearly, below will be to embodiment or description of the prior art
In the required accompanying drawing used be briefly described, it should be apparent that, drawings in the following description be the present invention some realities
Example is applied, for those of ordinary skill in the art, without having to pay creative labor, can also be attached according to these
Figure obtains other accompanying drawings.
Fig. 1 is the schematic flow sheet for the keyboard action detection method that one embodiment of the invention provides；
Fig. 2 is the structural representation for the keyboard action detection means that another embodiment of the present invention provides.
【Embodiment】
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
Part of the embodiment of the present invention, rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art
The whole other embodiments obtained under the premise of creative work is not made, belong to the scope of protection of the invention.
It should be noted that terminal involved in the embodiment of the present invention can include but is not limited to mobile phone, individual digital
Assistant (Personal Digital Assistant, PDA), radio hand-held equipment, tablet personal computer (Tablet Computer),
PC (Personal Computer, PC), MP3 player, MP4 players, wearable device (for example, intelligent glasses,
Intelligent watch, Intelligent bracelet etc.) etc..
In addition, the terms "and/or", only a kind of incidence relation for describing affiliated partner, represents there may be
Three kinds of relations, for example, A and/or B, can be represented：Individualism A, while A and B be present, these three situations of individualism B.Separately
Outside, character "/" herein, it is a kind of relation of "or" to typically represent forward-backward correlation object.
Fig. 1 is the schematic flow sheet for the keyboard action detection method that one embodiment of the invention provides, as shown in Figure 1.
101st, obtain the player that image collecting device is gathered and play the keyboard image for specifying keyboard.
So-called image collecting device, can specifically imaging sensor be used to realize.Wherein, described image sensor can be with
For charge coupled cell (Charge Coupled Device, CCD) sensor, or it can also be metal-oxide semiconductor (MOS)
Element (Complementary Metal-Oxide Semiconductor, CMOS) sensor, the present embodiment is to this without spy
Do not limit.
If detecting current light than dark, further keyboard can also be specified to carry out light filling on object to be collected
Processing, for example, opening light emitting diode (Light Emitting Diode, LED) light compensating lamp.
Alternatively, in a possible implementation of the present embodiment, used image collecting device can be set
Where keyboard is specified in equipment, it is fixed using supporting structure set in equipment.For example, the string storehouse lid plane of piano
Upper set support unit, etc..
102nd, the player gathered according to described image harvester plays the keyboard image for specifying keyboard and advance structure
The reference picture for the specified keyboard built, obtain the detection actuation of keys of the specified keyboard.
In the present invention, the player that can be gathered by contrasting obtained described image harvester plays assignment key
The reference anaglyph of the keyboard image of disk and the specified keyboard built in advance, as long as drilling of being gathered of described image harvester
The person of playing plays and has differences part between the keyboard image for specifying keyboard and reference anaglyph, it is possible to by the difference section institute
Corresponding button, it is defined as the button and is pressed.
It should be noted that 101~102 executive agent can be partly or entirely the application for being located locally terminal,
Or can also be the plug-in unit being arranged in the application of local terminal or SDK (Software
Development Kit, SDK) etc. functional unit, can also be either processing engine in network side server or
Can also be the distributed system positioned at network side, the present embodiment is to this without being particularly limited to.
It is understood that the application can be mounted in the local program (nativeApp) in terminal, or may be used also
To be a web page program (webApp) of browser in terminal, the present embodiment is to this without limiting.
So, the player gathered by obtaining image collecting device plays the keyboard image for specifying keyboard so that energy
Enough players gathered according to described image harvester play the finger specified the keyboard image of keyboard and built in advance
Determine the reference picture of keyboard, obtain the detection actuation of keys of the specified keyboard, keyboard is specified by being played according to player
Keyboard image, reproduce player and play the keyboard state for specifying keyboard, it is achieved thereby that the key of the button kind musical instrument such as detection piano
The purpose of disk action.
Alternatively, in a possible implementation of the present embodiment, the specified keyboard can include but is not limited to
First key area and the second key area, the present embodiment is to this without being particularly limited to.
Specifically, first key area can be the intermediate region of the specified keyboard, correspondingly, described second
Key area can be then in the beside of the intermediate region both sides in the specified keyboard.
Wherein, first key area can include but is not limited at least one first button and described at least one
Mark in one button set by the specified location of each first button.Specifically, the specific bit of each first button
The paster of particular geometric figure can be included but is not limited to by putting set mark.For example, in the keyboard intermediate region of piano
One dot is set on button, black round dot is set on white key, white round dot is set on black key.
Second key area can include but is not limited at least one second button.
Specifically, described image harvester, the surface of first key area can be specifically arranged at.
So, correspondingly,, specifically can be according to first key zone in 102 during a concrete implementation
First button for marking and building in advance described in the keyboard image in domain set by the specified location of each first button
Mark described in the reference picture in region set by the specified location of each first button, obtain each first button
Misalignment, and then, then the detection of first key area according to the misalignment of each first button, can be obtained
Actuation of keys.
In the implementation process, specifically button detection can be carried out, to obtain described each first according to the position of mark
The misalignment of button.
, specifically can be according to the keyboard layout of second key area in 102 during another concrete implementation
Each second button at least one second button as described in, obtains each second button by the screening of other the second buttons
Gear situation, and then, then can according to each second button by the circumstance of occlusion of other buttons and build in advance described
Each second button described in the reference picture of two key areas is pressed by the circumstance of occlusion of other the second buttons, acquisition described second
The detection actuation of keys of key range.
In the implementation process, specifically button detection can be carried out, according to the key features of diverse location with described in acquisition
The misalignment of each second button.
Further, in the implementation, the inter-frame information method of difference, color character analytic approach can also further be used
Etc. processing method, the hand of player is split, so, then can be according to the hand being partitioned into, estimating may quilt
The button pressed, so, then image scanning, the i.e. key to the specified button can be carried out to the key area that may be pressed
The key area that may be pressed in disk image corresponds to key area with the reference picture of the specified button built in advance
Images match is carried out, can effectively avoid the technology that sweep time is grown caused by specifying the full keyboard image scanning of keyboard
Problem, so as to improve the efficiency of keyboard action detection.
Alternatively, in a possible implementation of the present embodiment, before 102, institute can also further be built
State the reference picture of specified keyboard.
It in the implementation, can specifically be analyzed using standard picture, obtain normal data and specify keyboard
Standard flat image.So, after the standard flat image of specified keyboard is obtained, keyboard can arbitrarily be specified to analyze
Keyboard image to be detected, as long as there is difference between keyboard image to be detected and standard flat image, then can analyze button
Action.
Specifically, position and angle of image collecting device etc. by man-machine interaction, can specifically be adjusted, it is ensured that
Gatherer process meets the requirement of vision algorithm analysis.Image collecting device, supporting structure set in equipment can be used to enter
Row is fixed.For example, support unit set in the string storehouse lid plane of piano, etc..Supporting structure allows to image collector
Put and carry out the adjustment such as upper and lower, front and rear and angle.In the laying of initial image collecting device, have necessarily to its approximate location
Requirement.For example, image collecting device needs to be arranged on the top in the centre position of specified keyboard；By adjusting image collector
The position put and/or angle, ensure to specify all images of keyboard to be collected.
, it is necessary to Real-time Feedback problem in building process, and prompt to carry out the adjustment of image collecting device.For example, image
The height fine adjusting function of harvester, front and rear fine setting, gradient fine setting and site light environment adjustment, etc..
After the standard picture for the specified keyboard that the image collecting device after being adjusted is gathered, Ke Yijin
One step carries out image cutting-out, image gray processing and image to the standard picture and goes the pretreatment operation such as dry.It is then possible to enter
One step utilizes maximum between-cluster variance (OTSU) algorithm or improved OTSU algorithms etc., in the standard picture after pre-processing
Middle carry out keyboard detection, and it is partitioned into keyboard envelope.Then, algorithm of region growing or improved region growing can be utilized to calculate
Method etc., it is partitioned into each button.
Alternatively,, can also be further according to institute after 102 in a possible implementation of the present embodiment
The detection actuation of keys of specified keyboard and the standard key action of current reference are stated, the player is obtained and plays the assignment key
The key-case of disk.
If the detection actuation of keys of the specified keyboard and the standard key of current reference are kept strokes, can illustrate
The key-case that player plays the specified keyboard is standard key situation；If the detection actuation of keys of the specified keyboard
It is inconsistent with the standard key action of current reference, then it can be obtained according to inconsistent situation described in player's performance
The key-case of keyboard is specified, for example, inconsistent place is fewer, then illustrates that player plays the button feelings of the specified keyboard
Condition is better, and inconsistent place is more, then illustrates that the key-case of player's performance specified keyboard is poorer.
During a concrete implementation, obtain the player play the specified keyboard key-case it
Afterwards, the key-case that the player plays the specified keyboard can also further be exported.
Specifically, it can specifically obtain the player that video acquisition device is gathered and play the specified keyboard
Original video information, and then, then pressing for the specified keyboard can be played according to the original video information and the player
Key situation, the sharing video frequency information is obtained, and export the sharing video frequency information.
Wherein, video acquisition device, where specified keyboard can be arranged in equipment, using support set in equipment
Structure is fixed.For example, support unit set in the string storehouse lid plane of piano, etc..
In the present embodiment, the player gathered by obtaining image collecting device plays the keyboard image for specifying keyboard,
Make it possible to the player that is gathered according to described image harvester to play the keyboard image for specifying keyboard and build in advance
The reference picture of the specified keyboard, the detection actuation of keys of the specified keyboard is obtained, specified by being played according to player
The keyboard image of keyboard, reproduce player and play the keyboard state for specifying keyboard, it is achieved thereby that the button class pleasure such as detection piano
The purpose of the keyboard action of device.
In addition, using technical scheme provided by the present invention, by being moved according to the detection button of the specified keyboard obtained
Make and the standard key of current reference acts, obtain the key-case that player plays the specified keyboard, and then by the button
Situation is exported, and can effectively strengthen the visualization of keyboard action detection.
It should be noted that for foregoing each method embodiment, in order to be briefly described, therefore it is all expressed as a series of
Combination of actions, but those skilled in the art should know, the present invention is not limited by described sequence of movement because
According to the present invention, some steps can use other orders or carry out simultaneously.Secondly, those skilled in the art should also know
Know, embodiment described in this description belongs to preferred embodiment, and involved action and module are not necessarily of the invention
It is necessary.
In the above-described embodiments, the description to each embodiment all emphasizes particularly on different fields, and does not have the portion being described in detail in some embodiment
Point, it may refer to the associated description of other embodiment.
Fig. 2 is the structural representation for the keyboard action detection means that another embodiment of the present invention provides, as shown in Figure 2.This
The keyboard action detection means of embodiment can include acquiring unit 21 and analytic unit 22.Wherein, acquiring unit 21, for obtaining
The player for taking image collecting device to be gathered plays the keyboard image for specifying keyboard；Analytic unit 22, for according to the figure
As player that harvester is gathered plays the reference of the keyboard image and the specified keyboard built in advance of specifying keyboard
Image, obtain the detection actuation of keys of the specified keyboard.
It should be noted that the keyboard action detection means that the present embodiment is provided can be partly or entirely positioned at this
The application of ground terminal, or can also be the plug-in unit or SDK being arranged in the application of local terminal
Functional units such as (Software Development Kit, SDK), or can also be the processing in network side server
Engine, or can also be the distributed system positioned at network side, the present embodiment is to this without being particularly limited to.
It is understood that the application can be mounted in the local program (nativeApp) in terminal, or may be used also
To be a web page program (webApp) of browser in terminal, the present embodiment is to this without limiting.
Alternatively, in a possible implementation of the present embodiment, the specified keyboard can include but is not limited to
First key area and the second key area, the present embodiment is to this without being particularly limited to.
Specifically, first key area can be the intermediate region of the specified keyboard, correspondingly, described second
Key area can be then in the beside of the intermediate region both sides in the specified keyboard.
Wherein, first key area can include but is not limited at least one first button and described at least one
Mark in one button set by the specified location of each first button.Specifically, the specific bit of each first button
The paster of particular geometric figure can be included but is not limited to by putting set mark.For example, in the keyboard intermediate region of piano
One dot is set on button, black round dot is set on white key, white round dot is set on black key.
Second key area can include but is not limited at least one second button.
Specifically, described image harvester, the surface of first key area can be specifically arranged at.
The analytic unit 22, specifically can be used for
Mark according to the keyboard image of first key area set by the specified location of each first button
Described in the reference picture of note and first key area built in advance set by the specified location of each first button
Mark, obtain the misalignment of each first button；And the misalignment according to each first button, obtain institute
State the detection actuation of keys of the first key area；Or
Each second button at least one second button, is obtained according to the keyboard image of second key area
Each second button is obtained by the circumstance of occlusion of other the second buttons；And according to each second button by other buttons
Circumstance of occlusion and second key area built in advance reference picture described in each second button by other second
The circumstance of occlusion of button, obtain the detection actuation of keys of second key area.
Alternatively, in a possible implementation of the present embodiment, the analytic unit 22, can also further use
In the reference picture for building the specified keyboard.
Alternatively, in a possible implementation of the present embodiment, the analytic unit 22, can also further use
Acted in the detection actuation of keys according to the specified keyboard and the standard key of current reference, obtain the player and play institute
State the key-case of specified keyboard.
Alternatively, in a possible implementation of the present embodiment, the analytic unit 22, can also further use
In the key-case for exporting player's performance specified keyboard.
Specifically, the analytic unit 22, specifically can be used for obtaining the performance that video acquisition device is gathered
Person plays the original video information of the specified keyboard；Described specify is played according to the original video information and the player
The key-case of keyboard, obtain the sharing video frequency information；And the output sharing video frequency information.
It should be noted that method in embodiment corresponding to Fig. 1, the keyboard action that can be provided by the present embodiment detects dress
Put realization.The related content that may refer in embodiment corresponding to Fig. 1 is described in detail, here is omitted.
In the present embodiment, the key for the specified keyboard of player's performance that image collecting device is gathered is obtained by acquiring unit
Disk image so that analytic unit can play the keyboard layout for specifying keyboard according to the player that described image harvester is gathered
The reference picture of picture and the specified keyboard built in advance, the detection actuation of keys of the specified keyboard is obtained, passes through basis
Player plays the keyboard image for specifying keyboard, reproduces player and plays the keyboard state for specifying keyboard, it is achieved thereby that detection
The purpose of the keyboard action of the button kind musical instrument such as piano.
In addition, using technical scheme provided by the present invention, by being moved according to the detection button of the specified keyboard obtained
Make and the standard key of current reference acts, obtain the key-case that player plays the specified keyboard, and then by the button
Situation is exported, and can effectively strengthen the visualization of keyboard action detection.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, the corresponding process in preceding method embodiment is may be referred to, will not be repeated here.
In several embodiments provided by the present invention, it should be understood that disclosed system, apparatus and method can be with
Realize by another way.For example, device embodiment described above is only schematical, for example, the unit
Division, only a kind of division of logic function, can there is other dividing mode, such as multiple units or component when actually realizing
Another system can be combined or be desirably integrated into, or some features can be ignored, or do not perform.It is another, it is shown or
The mutual coupling discussed or direct-coupling or communication connection can be the indirect couplings by some interfaces, device or unit
Close or communicate to connect, can be electrical, mechanical or other forms.
The unit illustrated as separating component can be or may not be physically separate, show as unit
The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units it is integrated in a unit.Above-mentioned integrated list
Member can both be realized in the form of hardware, can also be realized in the form of hardware adds SFU software functional unit.
The above-mentioned integrated unit realized in the form of SFU software functional unit, can be stored in one and computer-readable deposit
In storage media.Above-mentioned SFU software functional unit is stored in a storage medium, including some instructions are causing a computer
It is each that equipment (can be personal computer, server, or network equipment etc.) or processor (processor) perform the present invention
The part steps of embodiment methods described.And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (Read-
Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disc or CD etc. it is various
Can be with the medium of store program codes.
Finally it should be noted that：The above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although
The present invention is described in detail with reference to the foregoing embodiments, it will be understood by those within the art that：It still may be used
To be modified to the technical scheme described in foregoing embodiments, or equivalent substitution is carried out to which part technical characteristic；
And these modification or replace, do not make appropriate technical solution essence depart from various embodiments of the present invention technical scheme spirit and
Scope.
Claims (12)
- A kind of 1. keyboard action detection method, it is characterised in that including：Obtain the player that image collecting device is gathered and play the keyboard image for specifying keyboard；Described in building according to the keyboard image for the specified keyboard of player's performance that described image harvester is gathered and in advance The reference picture of keyboard is specified, obtains the detection actuation of keys of the specified keyboard；Wherein,The specified keyboard includes the first key area and the second key area；First key area is the specified keyboard Intermediate region；Second key area is in the beside of the intermediate region both sides in the specified keyboard；It is described First key area includes the specific bit of each first button at least one first button and at least one first button Put set mark；Second key area includes at least one second button；Described image harvester is arranged at institute State the surface of the first key area；The player gathered according to described image harvester plays the key for specifying keyboard The reference picture of disk image and the specified keyboard built in advance, the detection actuation of keys of the specified keyboard is obtained, including：Mark according to the keyboard image of first key area set by the specified location of each first button and Mark described in the reference picture of first key area built in advance set by the specified location of each first button, Obtain the misalignment of each first button；And the misalignment according to each first button, obtain described the The detection actuation of keys of one key area；OrEach second button at least one second button according to the keyboard image of second key area, obtain institute Each second button is stated by the circumstance of occlusion of other the second buttons；And according to each second button by the screening of other buttons Each second button is by other the second buttons described in the reference picture of gear situation and second key area built in advance Circumstance of occlusion, obtain the detection actuation of keys of second key area.
- 2. according to the method for claim 1, it is characterised in that the mark set by the specified location of each first button Note includes the paster of particular geometric figure.
- 3. according to the method for claim 1, it is characterised in that the performance gathered according to described image harvester Person plays the reference picture of the keyboard image and the specified keyboard built in advance of specifying keyboard, obtains the specified keyboard Before detecting actuation of keys, in addition to：Build the reference picture of the specified keyboard.
- 4. according to the method described in claims 1 to 3 any claim, it is characterised in that described to be gathered according to described image The player that device is gathered plays the reference picture of the keyboard image and the specified keyboard built in advance of specifying keyboard, obtains After the detection actuation of keys for obtaining the specified keyboard, in addition to：Acted according to the detection actuation of keys of the specified keyboard and the standard key of current reference, obtain the player and play The key-case of the specified keyboard.
- 5. according to the method for claim 4, it is characterised in that the detection actuation of keys according to the specified keyboard and The standard key action of current reference, after obtaining the key-case that the player plays the specified keyboard, in addition to：Export the key-case that the player plays the specified keyboard.
- 6. according to the method for claim 5, it is characterised in that the output player plays the specified keyboard Key-case, including：Obtain the original video information that the player that video acquisition device is gathered plays the specified keyboard；The key-case of the specified keyboard is played according to the original video information and the player, shares described in acquisition and regards Frequency information；Export the sharing video frequency information.
- A kind of 7. keyboard action detection means, it is characterised in that including：Acquiring unit, the keyboard image of specified keyboard is played for obtaining the player that image collecting device is gathered；Analytic unit, the keyboard image of specifying keyboard and pre- is played for the player that is gathered according to described image harvester The reference picture of the specified keyboard first built, obtain the detection actuation of keys of the specified keyboard；Wherein,The specified keyboard includes the first key area and the second key area；First key area is the specified keyboard Intermediate region；Second key area is in the beside of the intermediate region both sides in the specified keyboard；It is described First key area includes the specific bit of each first button at least one first button and at least one first button Put set mark；Second key area includes at least one second button；The analytic unit, is specifically used forMark according to the keyboard image of first key area set by the specified location of each first button and Mark described in the reference picture of first key area built in advance set by the specified location of each first button, Obtain the misalignment of each first button；And the misalignment according to each first button, obtain described the The detection actuation of keys of one key area；OrEach second button at least one second button according to the keyboard image of second key area, obtain institute Each second button is stated by the circumstance of occlusion of other the second buttons；And according to each second button by the screening of other buttons Each second button is by other the second buttons described in the reference picture of gear situation and second key area built in advance Circumstance of occlusion, obtain the detection actuation of keys of second key area.
- 8. device according to claim 7, it is characterised in that the mark set by the specified location of each first button Note includes the paster of particular geometric figure.
- 9. device according to claim 7, it is characterised in that the analytic unit, be additionally operable toBuild the reference picture of the specified keyboard.
- 10. according to the device described in claim 7~9 any claim, it is characterised in that the analytic unit, be additionally operable toActed according to the detection actuation of keys of the specified keyboard and the standard key of current reference, obtain the player and play The key-case of the specified keyboard.
- 11. device according to claim 10, it is characterised in that the analytic unit, be additionally operable toExport the key-case that the player plays the specified keyboard.
- 12. device according to claim 11, it is characterised in that the analytic unit, be specifically used forObtain the original video information that the player that video acquisition device is gathered plays the specified keyboard；The key-case of the specified keyboard is played according to the original video information and the player, shares described in acquisition and regards Frequency information；AndExport the sharing video frequency information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611087070.0A CN106709427B (en) | 2016-12-01 | 2016-12-01 | Keyboard action detection method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611087070.0A CN106709427B (en) | 2016-12-01 | 2016-12-01 | Keyboard action detection method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106709427A CN106709427A (en) | 2017-05-24 |
| CN106709427B true CN106709427B (en) | 2018-02-09 |
Family
ID=58935661
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611087070.0A Active CN106709427B (en) | 2016-12-01 | 2016-12-01 | Keyboard action detection method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106709427B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107610550A (en) * | 2017-09-12 | 2018-01-19 | 北京银河润泰科技有限公司 | The implementation method and device of Online class |
| CN109460743A (en) * | 2018-11-22 | 2019-03-12 | 北京哆咪大狮科技有限公司 | A kind of key motion recognition system |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7878905B2 (en) * | 2000-02-22 | 2011-02-01 | Creative Kingdoms, Llc | Multi-layered interactive play experience |
| CN105608953A (en) * | 2016-03-06 | 2016-05-25 | 广州市贝斯曼乐器有限公司 | Intelligent electronic piano teaching system |
-
2016
- 2016-12-01 CN CN201611087070.0A patent/CN106709427B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN106709427A (en) | 2017-05-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110740259B (en) | Video processing method and electronic equipment | |
| CN107610550A (en) | The implementation method and device of Online class | |
| CN103207728B (en) | The method of augmented reality is provided and the terminal of this method is supported | |
| CN107809598B (en) | A kind of image pickup method, mobile terminal and server | |
| CN108093171A (en) | A kind of photographic method, terminal and computer readable storage medium | |
| CN106845390A (en) | Video title generation method and device | |
| EP3759707B1 (en) | A method and system for musical synthesis using hand-drawn patterns/text on digital and non-digital surfaces | |
| CN106463152A (en) | Automatically curating video to fit display time | |
| CN107665697A (en) | The adjusting method and mobile terminal of a kind of screen intensity | |
| CN106782464A (en) | Keyboard action detection method and device | |
| CN107741898A (en) | A kind of game player based on big data operates preference analysis method and system | |
| CN110554831B (en) | Operation synchronization method, device, equipment and storage medium | |
| CN108062404A (en) | Processing method, device, readable storage medium storing program for executing and the terminal of facial image | |
| CN107451455A (en) | Solve lock control method and Related product | |
| CN106709427B (en) | Keyboard action detection method and device | |
| KR20220098027A (en) | Video display methods, electronic devices and media | |
| CN107831989A (en) | A kind of Application Parameters method of adjustment and mobile terminal | |
| CN107943390A (en) | A kind of word clone method and mobile terminal | |
| CN107566749A (en) | Image pickup method and mobile terminal | |
| CN106575163A (en) | Feedback provision method, system, and analysis device | |
| KR20160017461A (en) | Device for controlling play and method thereof | |
| CN107864353A (en) | A kind of video recording method and mobile terminal | |
| CN107704828A (en) | Methods of exhibiting, mobile terminal and the computer-readable recording medium of reading information | |
| CN107248407A (en) | A kind of gesture musical performance device | |
| CN107765942A (en) | A kind of method, equipment and computer-readable recording medium for realizing presentation of information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |