CN104898981A - Gesture recognizing method, device and terminal - Google Patents

Gesture recognizing method, device and terminal Download PDF

Info

Publication number
CN104898981A
CN104898981A CN201510370188.3A CN201510370188A CN104898981A CN 104898981 A CN104898981 A CN 104898981A CN 201510370188 A CN201510370188 A CN 201510370188A CN 104898981 A CN104898981 A CN 104898981A
Authority
CN
China
Prior art keywords
gesture
matching degree
rectangle
divergent
convergent
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510370188.3A
Other languages
Chinese (zh)
Other versions
CN104898981B (en
Inventor
赵俊博
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Anyi Hengtong Beijing Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Anyi Hengtong Beijing Technology Co Ltd filed Critical Anyi Hengtong Beijing Technology Co Ltd
Priority to CN201510370188.3A priority Critical patent/CN104898981B/en
Publication of CN104898981A publication Critical patent/CN104898981A/en
Application granted granted Critical
Publication of CN104898981B publication Critical patent/CN104898981B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Image Analysis (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a gesture recognizing method, device and terminal. According to an embodiment, the method includes responding to the gesture operation of a user, and acquiring the trace of the gesture operation; matching the trace of the gesture operation with each preset gesture template to acquire the corresponded degree of similarity; judging whether the acquired highest degree of similarity is not smaller than a preset threshold or not; if so, determining the gesture template with the highest degree of similarity to be a relevant gesture template of the gesture operation to execute the operation corresponding to the relevant gesture template. By the aid of the method for recognizing the user's gesture operation, the technical problems that in the prior art, the recognizable gestures are limited and the gesture recognizing rate is low are solved, and the using efficiency of the terminal is improved.

Description

For identifying the method for gesture, device and terminal
Technical field
The application relates to field of computer technology, is specifically related to technical field of hand gesture recognition, particularly relates to the method for identifying gesture, device and terminal.
Background technology
At present, along with the development of electronic technology, various electronic equipment is widely used in daily life, and function also gets more and more, and becomes the important tool of people's live and work.There is the method that the gesture by user carries out scheduled operation now, facilitated the operation of user, improve the experience of user.
The method of existing identification gesture has the gesture identification method based on neural network and the gesture identification method etc. based on editing distance.The defect of these technology existing is: the gesture that can identify is limited, and the accuracy rate of gesture identification is lower.
Summary of the invention
This application provides a kind of method, device and terminal for identifying gesture.Solve the gesture that can identify in prior art limited, the technical matters that the accuracy rate of gesture identification is lower.
First aspect, this application provides a kind of method for identifying gesture, described method comprises: in response to the gesture operation of user, obtains the track of described gesture operation; The track of described gesture operation is mated with each default gesture template respectively, to obtain corresponding similarity; Judge whether the highest similarity got is more than or equal to predetermined threshold; If so, gesture template the highest for similarity is defined as the association gesture template of described gesture operation, to perform operation corresponding to described association gesture template.
In some embodiments, the track of described gesture operation is mated with the gesture template preset, comprise: using the track of described gesture operation as scaled reference figure, the gesture template preset is as the comparative pattern treating convergent-divergent, and the comparison performing scaled reference figure and comparative pattern operates to obtain the first matching degree; Using default gesture template as scaled reference figure, the track of described gesture operation is as the comparative pattern treating convergent-divergent, and the comparison performing scaled reference figure and comparative pattern operates to obtain the second matching degree; Corresponding similarity is determined according to described first matching degree and described second matching degree.
In some embodiments, the comparison of described scaled reference figure and comparative pattern, comprise: convergent-divergent is carried out to described comparative pattern, wherein, the minimum enclosed rectangle of described comparative pattern is the first rectangle, the minimum enclosed rectangle of described scaled reference figure is the second rectangle, make the first rectangle after convergent-divergent and described second rectangle congruence, and the first rectangle after convergent-divergent is also equal with the ratio of the length of side on the described second horizontal and vertical direction of rectangle; Corresponding matching degree is determined with the comparative pattern after convergent-divergent based on described scaled reference figure.
In some embodiments, describedly determine corresponding matching degree based on described scaled reference figure with the comparative pattern after convergent-divergent, comprising: the similarity determining described first rectangle and described second rectangle, as compression cost value; Determine that the equalization point of the comparative pattern after described convergent-divergent and scaled reference figure is apart from minimum value; Corresponding matching degree is determined apart from minimum value at least partly based on described compression cost value and equalization point.
In some embodiments, describedly determine corresponding matching degree based on described scaled reference figure with the comparative pattern after convergent-divergent, also comprise: the comparative pattern after described convergent-divergent is rotated; Determine the anglec of rotation of described rotation; Obtain the default weight that the anglec of rotation and equalization point are corresponding apart from minimum value respectively; The described matching degree determining correspondence at least partly based on described compression cost value and equalization point distance minimum value, comprise: based on the product of described equalization point distance minimum value with corresponding default weight, the product of the described anglec of rotation and corresponding default weight and described compression cost value, determine corresponding matching degree.
In some embodiments, describedly determine described compression cost value, comprising: the ratio determining the length of side on the described first horizontal and vertical direction of rectangle, as the first ratio; Determine the ratio of the length of side on the described second horizontal and vertical direction of rectangle, as the second ratio; Value maximum in described first ratio and the second ratio is defined as described compression cost value divided by the result of minimum value.
In some embodiments, determine corresponding similarity according to described first matching degree and described second matching degree, comprising: by described first matching degree and described second matching degree be defined as corresponding similarity.
In some embodiments, described gesture operation comprises following at least one item: mouse gestures operation and the user touch gestures operation on touch screen.
Second aspect, this application provides a kind of device for identifying gesture, described device comprises: acquiring unit, for the gesture operation in response to user, obtains the track of described gesture operation; Matching unit, for being mated with each default gesture template respectively by the track of described gesture operation, to obtain corresponding similarity; Judging unit, for judging whether the highest similarity got is more than or equal to predetermined threshold; Determining unit, during for being more than or equal to predetermined threshold in the highest similarity got, is defined as the association gesture template of described gesture operation by gesture template the highest for similarity, to perform operation corresponding to described association gesture template.
In some embodiments, described matching unit comprises: comparer unit, for using the track of described gesture operation as scaled reference figure, default gesture template is as the comparative pattern treating convergent-divergent, and the comparison performing scaled reference figure and comparative pattern operates to obtain the first matching degree; And using default gesture template as scaled reference figure, the track of described gesture operation is as the comparative pattern treating convergent-divergent, and the comparison performing scaled reference figure and comparative pattern operates to obtain the second matching degree; Similarity determination subelement, for determining corresponding similarity according to described first matching degree and described second matching degree.
In some embodiments, described comparer unit comprises: Zoom module, for carrying out convergent-divergent to described comparative pattern, wherein, the minimum enclosed rectangle of described comparative pattern is the first rectangle, the minimum enclosed rectangle of described scaled reference figure is the second rectangle, make the first rectangle after convergent-divergent and described second rectangle congruence, and the first rectangle after convergent-divergent is also equal with the ratio of the length of side on the described second horizontal and vertical direction of rectangle; Matching degree determination module, for determining corresponding matching degree based on described scaled reference figure with the comparative pattern after convergent-divergent.
In some embodiments, described matching degree determination module, comprising: first determines submodule, for determining the similarity of described first rectangle and described second rectangle, as compression cost value; Second determines submodule, for determining that the equalization point of the comparative pattern after described convergent-divergent and scaled reference figure is apart from minimum value; 3rd determines submodule, determines corresponding matching degree at least part of based on described compression cost value and equalization point apart from minimum value.
In some embodiments, described matching degree determination module, also comprises gyrator module, angle determination submodule, Weight Acquisition submodule; Described gyrator module, for rotating the comparative pattern after described convergent-divergent; Described angle determination submodule, for determining the anglec of rotation of described rotation; Described Weight Acquisition submodule, for obtaining the anglec of rotation and the equalization point default weight corresponding apart from minimum value respectively; Described 3rd determines submodule, also for based on described equalization point apart from the product of minimum value with corresponding default weight, the product of the described anglec of rotation and corresponding default weight and described compression cost value, determine the matching degree of correspondence.
In some embodiments, described first determines that submodule is configured for: the ratio determining the length of side on the described first horizontal and vertical direction of rectangle, as the first ratio; Determine the ratio of the length of side on the described second horizontal and vertical direction of rectangle, as the second ratio; Value maximum in described first ratio and the second ratio is defined as described compression cost value divided by the result of minimum value.
In some embodiments, described similarity determination subelement is configured for: by described first matching degree and described second matching degree and be defined as corresponding similarity.
In some embodiments, described gesture operation comprises following at least one item: mouse gestures operation and the user touch gestures operation on touch screen.
The third aspect, this application provides a kind of terminal, and described terminal comprises processor, user interface, wherein, user interface is used for user and described terminal is carried out alternately, described processor obtains the track of described gesture operation by the gesture operation of described user interface on the operation interface of described terminal based on user, and the track of described gesture operation is mated with each default gesture template respectively, to obtain corresponding similarity, judge whether the highest similarity got is more than or equal to predetermined threshold, when the highest similarity got is more than or equal to predetermined threshold, gesture template the highest for similarity is defined as the association gesture template of described gesture operation, to perform operation corresponding to described association gesture template.
In some embodiments, described processor is configured for: using the track of described gesture operation as scaled reference figure, the gesture template preset is as the comparative pattern treating convergent-divergent, the comparison performing scaled reference figure and comparative pattern operates to obtain the first matching degree, and using default gesture template as scaled reference figure, the track of described gesture operation is as the comparative pattern treating convergent-divergent, the comparison performing scaled reference figure and comparative pattern operates to obtain the second matching degree, and determine corresponding similarity according to described first matching degree and described second matching degree.
The application provide for identifying the method for gesture, device and terminal, mated with each default gesture template respectively by the track of the gesture operation by user, obtain corresponding similarity, and when the highest similarity is more than or equal to predetermined threshold, gesture template the highest for similarity is defined as the association gesture template of gesture operation, to perform operation corresponding to this association gesture template.Solve the gesture that can identify in prior art limited, the technical matters that the accuracy rate of gesture identification is lower, improve the service efficiency of terminal.
Accompanying drawing explanation
By reading the detailed description done non-limiting example done with reference to the following drawings, the other features, objects and advantages of the application will become more obvious:
Fig. 1 is the process flow diagram of an embodiment of the method for identifying gesture that the embodiment of the present application provides;
Fig. 2 is the process flow diagram track of gesture operation and the gesture template preset being carried out an embodiment of the method for mating that the embodiment of the present application provides;
Fig. 3 is the process flow diagram of an embodiment of the comparison method of the scaled reference figure that provides of the embodiment of the present application and comparative pattern;
Fig. 4 is schematic diagram comparative pattern being carried out to convergent-divergent that the embodiment of the present application provides;
Fig. 5 is the structural representation of an embodiment of the device that the embodiment of the present application provides;
Fig. 6 is the structural representation of an embodiment of the terminal that the embodiment of the present application provides.
Embodiment
Below in conjunction with drawings and Examples, the application is described in further detail.Be understandable that, specific embodiment described herein is only for explaining related invention, but not the restriction to this invention.It also should be noted that, for convenience of description, in accompanying drawing, illustrate only the part relevant to Invention.
It should be noted that, when not conflicting, the embodiment in the application and the feature in embodiment can combine mutually.Below with reference to the accompanying drawings and describe the application in detail in conjunction with the embodiments.
Terminal involved by the application can include but not limited to smart mobile phone, panel computer, personal digital assistant, pocket computer on knee and desktop computer etc.Describe object and for simplicity for example, in ensuing discussion, describe the exemplary embodiment of the application in conjunction with desktop computer.
Please refer to Fig. 1, it illustrates the flow process 100 of an embodiment of the method for identifying gesture according to the application.
As shown in Figure 1, in a step 101, in response to the gesture operation of user, the track of this gesture operation is obtained.
In the present embodiment, the gesture figure that can be user be drawn by mouse or other input equipment (as touch-screen, or Trackpad etc.).Gesture operation can be the mouse gestures operation that user uses mouse control cursor to carry out on screen interface, also can be the touch gestures operation of user on touch screen, be appreciated that gesture operation can also be the gesture operation of alternate manner, the concrete mode of the application to gesture operation does not limit.
In the present embodiment, in response to the gesture operation of user, obtain the track of this gesture operation.Particularly, at screen place, plane sets up two-dimensional direct angle coordinate system, distance between pixel adjacent on screen is set as unit length, gives a coordinate figure to each pixel on screen, obtain the two-dimensional coordinate sequence of pixel corresponding to the track of this gesture operation.Such as, represent the track of the gesture operation of user with b, b=(< X b0, Y b0>, < X b1, Y b1> ... < X bn, Y bn>).
Then, in a step 102, the track of above-mentioned gesture operation is mated with each default gesture template respectively, to obtain corresponding similarity.
In the present embodiment, gesture template is a figure, is the coupling normative reference of gesture operation.Gesture template can have multiple, can be that user is pre-rendered, also can be system default, each gesture template correspondence one is operation associated (as closed webpage, refresh page etc.), gesture template and operation associated between incidence relation can be that user is pre-set, also can be system default.
In the present embodiment, after user carries out gesture operation, obtain the track of this gesture operation, the track of this gesture operation is mated with each gesture template, obtain corresponding similarity.Wherein, the determined figure of track of this gesture operation of the higher explanation of similarity is more close with the figure of corresponding gesture template.
Then, in step 103, judge whether the highest similarity got is more than or equal to predetermined threshold.
In general, user unavoidably has some little tricks in the process using terminal, and these little tricks may make user carry out maloperation because of carelessness, and now user may not wish that terminal performs any operation.Because the maloperation that user the carries out action that to be user random, so the similarity that track and each gesture template of maloperation carry out mating generally can be lower.Now, if gesture template corresponding for the highest similarity to be directly defined as the association gesture template of maloperation, perform the operation that this association gesture template is corresponding, much unnecessary trouble can be brought to user.
In the present embodiment, first to judge whether the highest similarity got is more than or equal to predetermined threshold, if the highest similarity got is less than predetermined threshold, then illustrate that user's is operating as maloperation, now can not perform any operation.
Finally, at step 104, if the highest similarity got is more than or equal to predetermined threshold, gesture template corresponding for this similarity is defined as the association gesture template of above-mentioned gesture operation, to perform operation corresponding to this association gesture template.
In the present embodiment, if the highest similarity got is more than or equal to predetermined threshold, then illustrate that the operation of user is not maloperation, now gesture template corresponding for this highest similarity can be defined as the association gesture template of above-mentioned gesture operation, and perform operation corresponding to this association gesture template.
In the present embodiment, operation corresponding to association gesture template can be that user uses during terminal and operates arbitrarily, as closed webpage, refresh page, advancing, retreating, page turning etc., and the application does not limit the particular content of operation corresponding to association gesture template and form.
The method that above-described embodiment of the application provides, mated with each default gesture template respectively by the track of the gesture operation by user, obtain corresponding similarity, and when the highest similarity is more than or equal to predetermined threshold, gesture template the highest for similarity is defined as the association gesture template of gesture operation, to perform operation corresponding to this association gesture template.Solve the gesture that can identify in prior art limited, the technical matters that the accuracy rate of gesture identification is lower, improve the service efficiency of terminal.
With further reference to Fig. 2, it illustrates the flow process 200 of the track of gesture operation and the gesture template preset being carried out an embodiment of the method for mating.
As shown in Figure 2, in step 201, using the track of above-mentioned gesture operation as scaled reference figure, default gesture template is as the comparative pattern treating convergent-divergent, and the comparison performing scaled reference figure and comparative pattern operates to obtain the first matching degree.
Then, in step 202., using default gesture template as scaled reference figure, the track of above-mentioned gesture operation is as the comparative pattern treating convergent-divergent, and the comparison performing scaled reference figure and comparative pattern operates to obtain the second matching degree.
In the present embodiment, the track of gesture operation is carried out mating need to carry out twice comparison with the gesture template preset.Be once using the track of gesture operation as scaled reference figure, default gesture template, as the comparative pattern treating convergent-divergent, performs comparison operation to obtain the first matching degree.Another time is using default gesture template as scaled reference figure, and the track of above-mentioned gesture operation, as the comparative pattern treating convergent-divergent, performs comparison operation to obtain the second matching degree.Wherein, when scaled reference figure is for carrying out convergent-divergent to comparative pattern, as the reference pattern of convergent-divergent benchmark, in comparison process, convergent-divergent is not carried out to scaled reference figure.Comparative pattern is the figure needing to carry out convergent-divergent, and carries out convergent-divergent based on the size of scaled reference figure, to match with the size of scaled reference figure.
It should be noted that, why the present embodiment carries out twice comparison, when being because of some, carry out the result difference (the first matching degree namely obtained is different with the second matching degree) of twice comparison gained according to the method described above, even the difference of two times result can be larger.If only carry out a comparison, comparatively big error may be produced, thus matching result accurately cannot be provided.Carry out twice comparison and can reduce error, improve the accuracy rate of matching result.
Finally, in step 203, corresponding similarity is determined according to the first matching degree and the second matching degree.
In the present embodiment, if once the matching degree of comparison is lower in the result of twice comparison, differing greatly of scaled reference figure and comparative pattern is described, similarity is lower, therefore, the result (the first matching degree and the second matching degree) of twice comparison is added up mutually, more can embody the similarity of scaled reference figure and comparative pattern.Concrete, according to the first matching degree and the second matching degree determine corresponding similarity can comprise by the first matching degree and the second matching degree be defined as corresponding similarity.
With further reference to Fig. 3, it illustrates the flow process 300 of an embodiment according to the scaled reference figure of the application and the comparison method of comparative pattern.
As shown in Figure 3, in step 301, convergent-divergent is carried out to comparative pattern.
In the present embodiment, for benchmark, convergent-divergent is carried out to comparative pattern with scaled reference figure, enable the minimum enclosed rectangle of the comparative pattern after convergent-divergent identical with the minimum enclosed rectangle of scaled reference figure, thus can overlap completely.Particularly, if the minimum enclosed rectangle of comparative pattern is the first rectangle, the minimum enclosed rectangle of scaled reference figure is the second rectangle, make the first rectangle after convergent-divergent and the second rectangle congruence, and the first rectangle after convergent-divergent is also equal with the ratio of the length of side on the second horizontal and vertical direction of rectangle.Fig. 4 shows schematic diagram comparative pattern being carried out to convergent-divergent, as shown in Figure 4, the minimum enclosed rectangle of scaled reference figure 401 is the second rectangle 402, the minimum enclosed rectangle of comparative pattern 403 is the first rectangle 404, for benchmark, convergent-divergent is carried out to comparative pattern 403 with reference to figure 401, minimum enclosed rectangle (first rectangle after convergent-divergent) 406 of the comparative pattern 405 after convergent-divergent is identical with the second rectangle 402, namely the first rectangle 406 after convergent-divergent is equal with the second rectangle 402 length of side in a lateral direction, and the length of side on longitudinal direction is also equal.
Finally, in step 302, corresponding matching degree is determined based on scaled reference figure with the comparative pattern after convergent-divergent.
In the one of the present embodiment realizes, because will carry out convergent-divergent to comparative pattern, and this convergent-divergent might not be the convergent-divergent of equal proportion, and therefore, distortion to a certain degree may appear in the comparative pattern after convergent-divergent, thus can affect final matching result.So need introducing one to compress cost parameter, this parameter embodies the similarity degree of the minimum enclosed rectangle (i.e. the first rectangle) of comparative pattern and the minimum enclosed rectangle (i.e. the second rectangle) of scaled reference figure.The similarity degree of the first rectangle and the second rectangle is higher, and distortion level when carrying out convergent-divergent to comparative pattern is lower.The similarity degree of the first rectangle and the second rectangle is lower, and distortion level when carrying out convergent-divergent to comparative pattern is higher.
Particularly, if on the first horizontal and vertical direction of rectangle on the ratio of the length of side and the horizontal and vertical direction of the second rectangle the ratio of the length of side more close, the similarity of these two rectangles is higher.Therefore, can based on the value of above-mentioned two ratio-dependent compression costs.First, the ratio of the length of side on the first horizontal and vertical direction of rectangle is determined, as the first ratio.Then the ratio of the length of side on the second horizontal and vertical direction of rectangle is determined, as the second ratio.The result of value maximum in first ratio and the second ratio divided by minimum value can be defined as compressing cost value.It should be noted that, the value compressing cost in above-mentioned twice comparison is identical.
Such as, note compression cost is γ, then
Wherein, c xarepresent the first rectangle length of side in a lateral direction, c yarepresent the length of side on the first rectangle longitudinal direction, c xbrepresent the second rectangle length of side in a lateral direction, c ybrepresent the length of side on the second rectangle longitudinal direction, represent with in minimum value, represent with in maximum value.
In addition, also the comparative pattern after convergent-divergent and scaled reference figure to be carried out overlapping (carrying out overlapping with the second rectangle by the first rectangle after convergent-divergent), determine that the equalization point of the comparative pattern after convergent-divergent and scaled reference figure is apart from minimum value, this equalization point is less apart from minimum value, illustrate the comparative pattern after convergent-divergent and scaled reference shape similarity higher, more close.
Such as, remember that above-mentioned equalization point is δ apart from minimum value, then
Wherein, the number of the point selected in n presentation graphic, and air line distance between adjacent 2 is equal, X ajrepresent the value of the horizontal ordinate of the jth point selected in scaled reference figure, X bjrepresent the value of the horizontal ordinate of the point of the jth selected in comparative pattern after convergent-divergent, Y ajrepresent the value of the ordinate of the jth point selected in scaled reference figure, Y bjrepresent the value of the ordinate of the point of the jth selected in comparative pattern after convergent-divergent.
Finally, corresponding matching degree can be determined based on compression cost value and equalization point apart from minimum value at least partly.Particularly, can using the product of compression cost value and equalization point distance minimum value as corresponding matching degree.
In the another kind of the present embodiment realizes, except determining that according to the method for above-described embodiment the equalization point of the comparative pattern after compressing cost and convergent-divergent and scaled reference figure is except minimum value, comparative pattern after convergent-divergent can also be rotated a certain angle, to correct the angular error of comparative pattern.In addition, if angle rotation is excessive, the accuracy of net result can also be affected, therefore, apart from minimum value, a weight is set respectively to the above-mentioned anglec of rotation and above-mentioned equalization point, and these two weighted values and be 1, above-mentioned can be that user presets, and also can be system default.After determining the above-mentioned anglec of rotation and above-mentioned default weight, can based on the product of equalization point apart from minimum value and corresponding default weight, the product of the anglec of rotation and corresponding default weight and compress cost value, determines the matching degree of correspondence.
Such as, the matching degree of note correspondence is P, then P=γ [ω * δ+(1-ω) * a],
Wherein, γ represents compression cost, and ω represents that the default weight that equalization point is corresponding apart from minimum value, δ represent that equalization point is apart from minimum value, and a represents the above-mentioned anglec of rotation.
Although it should be noted that the operation describing the inventive method in the accompanying drawings with particular order, this is not that requirement or hint must perform these operations according to this particular order, or must perform the result that all shown operation could realize expectation.On the contrary, the step described in process flow diagram can change execution sequence.Such as, in the flow process 200 of Fig. 2, first can perform step 202, using default gesture template as scaled reference figure, the track of above-mentioned gesture operation is as the comparative pattern treating convergent-divergent, the comparison performing scaled reference figure and comparative pattern operates to obtain the second matching degree, and then perform step 201, using the track of above-mentioned gesture operation as scaled reference figure, the gesture template preset is as the comparative pattern treating convergent-divergent, and the comparison performing scaled reference figure and comparative pattern operates to obtain the first matching degree.Additionally or alternatively, some step can be omitted, multiple step be merged into a step and perform, and/or a step is decomposed into multiple step and perform.
With further reference to Fig. 5, it illustrates the structural representation of an embodiment of the device according to the application.
As shown in Figure 5, the device 500 of the present embodiment comprises: acquiring unit 501, matching unit 502, judging unit 503 and determining unit 504.Wherein, acquiring unit 501, for the gesture operation in response to user, obtains the track of above-mentioned gesture operation.Matching unit 502 for the track of above-mentioned gesture operation is mated with each default gesture template respectively, to obtain corresponding similarity.Judging unit 503 is for judging whether the highest similarity got is more than or equal to predetermined threshold.When determining unit 504 is for being more than or equal to predetermined threshold in the highest similarity got, gesture template the highest for similarity is defined as the association gesture template of above-mentioned gesture operation, to perform operation corresponding to this association gesture template.
In some Alternate embodiments, matching unit 502 comprises comparer unit, similarity determination subelement (not shown).Wherein, comparer unit is used for using the track of above-mentioned gesture operation as scaled reference figure, and default gesture template is as the comparative pattern treating convergent-divergent, and the comparison performing scaled reference figure and comparative pattern operates to obtain the first matching degree.And using default gesture template as scaled reference figure, the track of above-mentioned gesture operation is as the comparative pattern treating convergent-divergent, and the comparison performing scaled reference figure and comparative pattern operates to obtain the second matching degree.Similarity determination subelement is used for determining corresponding similarity according to the first matching degree and the second matching degree.
In some Alternate embodiments, comparer unit comprises Zoom module, matching degree determination module (not shown).Zoom module is used for carrying out convergent-divergent to comparative pattern, wherein, the minimum enclosed rectangle of comparative pattern is the first rectangle, the minimum enclosed rectangle of scaled reference figure is the second rectangle, make the first rectangle after convergent-divergent and described second rectangle congruence, and the first rectangle after convergent-divergent is also equal with the ratio of the length of side on the described second horizontal and vertical direction of rectangle.Matching degree determination module is used for determining corresponding matching degree based on scaled reference figure with the comparative pattern after convergent-divergent.
In some Alternate embodiments, matching degree determination module comprises: first determines submodule, and second determines submodule, and the 3rd determines submodule.Wherein, first determines that submodule is for determining the similarity of the first rectangle and the second rectangle, as compression cost value.Second determines that submodule is for determining that the equalization point of the comparative pattern after convergent-divergent and scaled reference figure is apart from minimum value.3rd determines that submodule determines corresponding matching degree based on compression cost value and equalization point apart from minimum value at least part of.
In some Alternate embodiments, matching degree determination module also comprises gyrator module, angle determination submodule, Weight Acquisition submodule.Gyrator module is used for rotating the comparative pattern after convergent-divergent.Angle determination submodule is for determining the anglec of rotation rotated.Weight Acquisition submodule is used for obtaining the anglec of rotation and the equalization point default weight corresponding apart from minimum value respectively.3rd determines submodule also for based on the product of equalization point apart from minimum value and corresponding default weight, the product of the anglec of rotation and corresponding default weight and compress cost value, determines the matching degree of correspondence.
In some Alternate embodiments, first determines that submodule is configured for: the ratio determining the length of side on the first horizontal and vertical direction of rectangle, as the first ratio.Determine the ratio of the length of side on the second horizontal and vertical direction of rectangle, as the second ratio.The result of value maximum in first ratio and the second ratio divided by minimum value is defined as compressing cost value.
In some Alternate embodiments, similarity determination subelement is configured for: by the first matching degree and the second matching degree and be defined as corresponding similarity.
In some Alternate embodiments, above-mentioned gesture operation comprises following at least one item: mouse gestures operation and the user touch gestures operation on touch screen.
Should be appreciated that all unit or the module of record in device 500 are corresponding with each step in the method described with reference to figure 1-4.Thus, above for the unit that operation and the feature of method description are equally applicable to device 500 and wherein comprise, do not repeat them here.Device 500 can pre-set in the terminal, also can be loaded in terminal by modes such as downloads.Corresponding units in device 500 can cooperatively interact the scheme realized for identifying gesture with the unit in terminal.
With further reference to Fig. 6, it illustrates the structural representation of an embodiment of the terminal according to the application.
As shown in Figure 6, the terminal 600 of the present embodiment comprises: at least one processor 601, such as CPU (Central Processing Unit, central processing unit), at least one communication interface 602, at least one user interface 603, storer 604, at least one communication bus 605.Communication bus 605 is for realizing the connection communication between said modules.Terminal 600 optionally comprises user interface 603, as display module, and keyboard or pointing device (such as, mouse, trace ball (trackball), touch-sensitive plate or touch sensitive display screen) etc.Storer 604 may comprise high-speed RAM (Random Access Memory, random access memory), still may comprise nonvolatile memory (non-volatile memory), such as at least one magnetic disk memory.Storer 604 optionally can comprise at least one and be positioned at memory storage away from aforementioned processor 601.
In some embodiments, storer 604 stores following element, executable module or data structure, or their subset, or their superset:
Operating system 614, comprises various system program, for realizing various basic business and processing hardware based task.
Application program 624, comprises various application program, for realizing various applied business.
In the present embodiment, processor 601 is by calling the program or instruction execution corresponding steps that store in storer 604.Particularly, user interface 603 carries out alternately for user and described terminal 600, described processor 601 obtains the track of described gesture operation by the gesture operation of described user interface 603 on the operation interface of described terminal 600 based on user, and the track of described gesture operation is mated with each default gesture template respectively, to obtain corresponding similarity, judge whether the highest similarity got is more than or equal to predetermined threshold, when the highest similarity got is more than or equal to predetermined threshold, gesture template the highest for similarity is defined as the association gesture template of described gesture operation, to perform operation corresponding to described association gesture template.
Further, processor 601 is configured for the track of described gesture operation as scaled reference figure, the gesture template preset is as the comparative pattern treating convergent-divergent, the comparison performing scaled reference figure and comparative pattern operates to obtain the first matching degree, and using default gesture template as scaled reference figure, the track of described gesture operation is as the comparative pattern treating convergent-divergent, the comparison performing scaled reference figure and comparative pattern operates to obtain the second matching degree, and determines corresponding similarity according to described first matching degree and described second matching degree.
Be described in unit module involved in the embodiment of the present application to be realized by the mode of software, also can be realized by the mode of hardware.Described unit module also can be arranged within a processor, such as, can be described as: a kind of processor comprises acquiring unit, matching unit, judging unit, determining unit.Wherein, the title of these unit modules does not form the restriction to this unit module itself under certain conditions, and such as, acquiring unit can also be described to " for the gesture operation in response to user, obtaining the unit of the track of described gesture operation ".
As another aspect, present invention also provides a kind of computer-readable recording medium, this computer-readable recording medium can be the computer-readable recording medium comprised in device described in above-described embodiment; Also can be individualism, be unkitted the computer-readable recording medium allocated in terminal.Described computer-readable recording medium stores more than one or one program, and described program is used for performance description in the method for identifying gesture of the application by one or more than one processor.
More than describe and be only the preferred embodiment of the application and the explanation to institute's application technology principle.Those skilled in the art are to be understood that, invention scope involved in the application, be not limited to the technical scheme of the particular combination of above-mentioned technical characteristic, also should be encompassed in when not departing from described inventive concept, other technical scheme of being carried out combination in any by above-mentioned technical characteristic or its equivalent feature and being formed simultaneously.The technical characteristic that such as, disclosed in above-mentioned feature and the application (but being not limited to) has similar functions is replaced mutually and the technical scheme formed.

Claims (18)

1. for identifying a method for gesture, it is characterized in that, described method comprises:
In response to the gesture operation of user, obtain the track of described gesture operation;
The track of described gesture operation is mated with each default gesture template respectively, to obtain corresponding similarity;
Judge whether the highest similarity got is more than or equal to predetermined threshold;
If so, gesture template the highest for similarity is defined as the association gesture template of described gesture operation, to perform operation corresponding to described association gesture template.
2. method according to claim 1, is characterized in that, is mated by the track of described gesture operation, comprising with the gesture template preset:
Using the track of described gesture operation as scaled reference figure, default gesture template is as the comparative pattern treating convergent-divergent, and the comparison performing scaled reference figure and comparative pattern operates to obtain the first matching degree;
Using default gesture template as scaled reference figure, the track of described gesture operation is as the comparative pattern treating convergent-divergent, and the comparison performing scaled reference figure and comparative pattern operates to obtain the second matching degree;
Corresponding similarity is determined according to described first matching degree and described second matching degree.
3. method according to claim 2, is characterized in that, the comparison of described scaled reference figure and comparative pattern, comprising:
Convergent-divergent is carried out to described comparative pattern, wherein, the minimum enclosed rectangle of described comparative pattern is the first rectangle, the minimum enclosed rectangle of described scaled reference figure is the second rectangle, make the first rectangle after convergent-divergent and described second rectangle congruence, and the first rectangle after convergent-divergent is also equal with the ratio of the length of side on the described second horizontal and vertical direction of rectangle;
Corresponding matching degree is determined with the comparative pattern after convergent-divergent based on described scaled reference figure.
4. method according to claim 3, is characterized in that, describedly determines corresponding matching degree based on described scaled reference figure with the comparative pattern after convergent-divergent, comprising:
Determine the similarity of described first rectangle and described second rectangle, as compression cost value;
Determine that the equalization point of the comparative pattern after described convergent-divergent and scaled reference figure is apart from minimum value;
Corresponding matching degree is determined apart from minimum value at least partly based on described compression cost value and equalization point.
5. method according to claim 4, is characterized in that, describedly determines corresponding matching degree based on described scaled reference figure with the comparative pattern after convergent-divergent, also comprises:
Comparative pattern after described convergent-divergent is rotated;
Determine the anglec of rotation of described rotation;
Obtain the default weight that the anglec of rotation and equalization point are corresponding apart from minimum value respectively;
The described matching degree determining correspondence at least partly based on described compression cost value and equalization point distance minimum value, comprising:
Based on described equalization point apart from the product of minimum value with corresponding default weight, the product of the described anglec of rotation and corresponding default weight and described compression cost value, determine the matching degree of correspondence.
6. method according to claim 4, is characterized in that, describedly determines described compression cost value, comprising:
Determine the ratio of the length of side on the described first horizontal and vertical direction of rectangle, as the first ratio;
Determine the ratio of the length of side on the described second horizontal and vertical direction of rectangle, as the second ratio;
Value maximum in described first ratio and the second ratio is defined as described compression cost value divided by the result of minimum value.
7. method according to claim 2, is characterized in that, determines corresponding similarity, comprising according to described first matching degree and described second matching degree:
By described first matching degree and described second matching degree and be defined as corresponding similarity.
8. according to the method in claim 1-7 described in any one, it is characterized in that, described gesture operation comprises following at least one item: mouse gestures operation and the user touch gestures operation on touch screen.
9. for identifying a device for gesture, it is characterized in that, described device comprises:
Acquiring unit, for the gesture operation in response to user, obtains the track of described gesture operation;
Matching unit, for being mated with each default gesture template respectively by the track of described gesture operation, to obtain corresponding similarity;
Judging unit, for judging whether the highest similarity got is more than or equal to predetermined threshold;
Determining unit, during for being more than or equal to predetermined threshold in the highest similarity got, is defined as the association gesture template of described gesture operation by gesture template the highest for similarity, to perform operation corresponding to described association gesture template.
10. device according to claim 9, is characterized in that, described matching unit comprises:
Comparer unit, for using the track of described gesture operation as scaled reference figure, default gesture template is as the comparative pattern treating convergent-divergent, and the comparison performing scaled reference figure and comparative pattern operates to obtain the first matching degree; And using default gesture template as scaled reference figure, the track of described gesture operation is as the comparative pattern treating convergent-divergent, and the comparison performing scaled reference figure and comparative pattern operates to obtain the second matching degree;
Similarity determination subelement, for determining corresponding similarity according to described first matching degree and described second matching degree.
11. devices according to claim 10, is characterized in that, described comparer unit comprises:
Zoom module, for carrying out convergent-divergent to described comparative pattern, wherein, the minimum enclosed rectangle of described comparative pattern is the first rectangle, the minimum enclosed rectangle of described scaled reference figure is the second rectangle, make the first rectangle after convergent-divergent and described second rectangle congruence, and the first rectangle after convergent-divergent is also equal with the ratio of the length of side on the described second horizontal and vertical direction of rectangle;
Matching degree determination module, for determining corresponding matching degree based on described scaled reference figure with the comparative pattern after convergent-divergent.
12. devices according to claim 11, is characterized in that, described matching degree determination module, comprising:
First determines submodule, for determining the similarity of described first rectangle and described second rectangle, as compression cost value;
Second determines submodule, for determining that the equalization point of the comparative pattern after described convergent-divergent and scaled reference figure is apart from minimum value;
3rd determines submodule, determines corresponding matching degree at least part of based on described compression cost value and equalization point apart from minimum value.
13. devices according to claim 12, is characterized in that, described matching degree determination module, also comprises gyrator module, angle determination submodule, Weight Acquisition submodule;
Described gyrator module, for rotating the comparative pattern after described convergent-divergent;
Described angle determination submodule, for determining the anglec of rotation of described rotation;
Described Weight Acquisition submodule, for obtaining the anglec of rotation and the equalization point default weight corresponding apart from minimum value respectively;
Described 3rd determines submodule, also for based on described equalization point apart from the product of minimum value with corresponding default weight, the product of the described anglec of rotation and corresponding default weight and described compression cost value, determine the matching degree of correspondence.
14. devices according to claim 12, is characterized in that, described first determines that submodule is configured for:
Determine the ratio of the length of side on the described first horizontal and vertical direction of rectangle, as the first ratio;
Determine the ratio of the length of side on the described second horizontal and vertical direction of rectangle, as the second ratio;
Value maximum in described first ratio and the second ratio is defined as described compression cost value divided by the result of minimum value.
15. devices according to claim 10, is characterized in that, described similarity determination subelement is configured for:
By described first matching degree and described second matching degree and be defined as corresponding similarity.
16., according to the device in claim 9-15 described in any one, is characterized in that, described gesture operation comprises following at least one item: mouse gestures operation and the user touch gestures operation on touch screen.
17. 1 kinds of terminals, is characterized in that, described terminal comprises processor, user interface;
Wherein, user interface is used for user and described terminal is carried out alternately, described processor obtains the track of described gesture operation by the gesture operation of described user interface on the operation interface of described terminal based on user, and the track of described gesture operation is mated with each default gesture template respectively, to obtain corresponding similarity, judge whether the highest similarity got is more than or equal to predetermined threshold, when the highest similarity got is more than or equal to predetermined threshold, gesture template the highest for similarity is defined as the association gesture template of described gesture operation, to perform operation corresponding to described association gesture template.
18. terminals according to claim 17, it is characterized in that, described processor is configured for: using the track of described gesture operation as scaled reference figure, the gesture template preset is as the comparative pattern treating convergent-divergent, the comparison performing scaled reference figure and comparative pattern operates to obtain the first matching degree, and using default gesture template as scaled reference figure, the track of described gesture operation is as the comparative pattern treating convergent-divergent, the comparison performing scaled reference figure and comparative pattern operates to obtain the second matching degree, and determine corresponding similarity according to described first matching degree and described second matching degree.
CN201510370188.3A 2015-06-29 2015-06-29 Gesture recognition method and device and terminal Active CN104898981B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510370188.3A CN104898981B (en) 2015-06-29 2015-06-29 Gesture recognition method and device and terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510370188.3A CN104898981B (en) 2015-06-29 2015-06-29 Gesture recognition method and device and terminal

Publications (2)

Publication Number Publication Date
CN104898981A true CN104898981A (en) 2015-09-09
CN104898981B CN104898981B (en) 2018-10-16

Family

ID=54031666

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510370188.3A Active CN104898981B (en) 2015-06-29 2015-06-29 Gesture recognition method and device and terminal

Country Status (1)

Country Link
CN (1) CN104898981B (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105549884A (en) * 2015-12-11 2016-05-04 杭州勺子网络科技有限公司 Gesture input identification method of touch screen
CN106037808A (en) * 2016-07-01 2016-10-26 飞依诺科技(苏州)有限公司 Operating method and device of ultrasonic diagnosis equipment
CN106055098A (en) * 2016-05-24 2016-10-26 北京小米移动软件有限公司 Air gesture operation method and apparatus
CN106527817A (en) * 2016-12-15 2017-03-22 青岛海信电器股份有限公司 Touch-operated identification method and device thereof
CN107085469A (en) * 2017-04-21 2017-08-22 深圳市茁壮网络股份有限公司 A kind of recognition methods of gesture and device
CN107728817A (en) * 2017-11-29 2018-02-23 哈尔滨拓博科技有限公司 Air mouse control system based on gesture control
CN107908277A (en) * 2017-09-30 2018-04-13 珠海格力电器股份有限公司 A kind of control device, equipment and control method
CN108205399A (en) * 2016-12-19 2018-06-26 北京嘀嘀无限科技发展有限公司 Cancel the method and device of service request
CN108804907A (en) * 2018-06-13 2018-11-13 中新国际电子有限公司 Touch-screen equipment unlocking method and system, computer readable storage medium, terminal
CN109524853A (en) * 2018-10-23 2019-03-26 珠海市杰理科技股份有限公司 Gesture identification socket and socket control method
CN110908581A (en) * 2019-11-20 2020-03-24 网易(杭州)网络有限公司 Gesture recognition method and device, computer storage medium and electronic equipment
CN111880927A (en) * 2017-12-05 2020-11-03 创新先进技术有限公司 Resource allocation method, device and equipment
CN112068759A (en) * 2020-11-11 2020-12-11 湖南新云网科技有限公司 Trajectory-based terminal control method and apparatus, terminal and readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110072400A1 (en) * 2009-09-22 2011-03-24 Samsung Electronics Co., Ltd. Method of providing user interface of mobile terminal equipped with touch screen and mobile terminal thereof
CN102622225A (en) * 2012-02-24 2012-08-01 合肥工业大学 Multipoint touch application program development method supporting user defined gestures
CN102841712A (en) * 2012-07-11 2012-12-26 广州市久邦数码科技有限公司 Method and system for identifying and editing gestures
CN103870180A (en) * 2012-12-13 2014-06-18 腾讯科技(武汉)有限公司 Method and device for unlocking touch screen
CN103995661A (en) * 2013-02-20 2014-08-20 腾讯科技(深圳)有限公司 Method for triggering application programs or application program functions through gestures, and terminal

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110072400A1 (en) * 2009-09-22 2011-03-24 Samsung Electronics Co., Ltd. Method of providing user interface of mobile terminal equipped with touch screen and mobile terminal thereof
CN102622225A (en) * 2012-02-24 2012-08-01 合肥工业大学 Multipoint touch application program development method supporting user defined gestures
CN102841712A (en) * 2012-07-11 2012-12-26 广州市久邦数码科技有限公司 Method and system for identifying and editing gestures
CN103870180A (en) * 2012-12-13 2014-06-18 腾讯科技(武汉)有限公司 Method and device for unlocking touch screen
CN103995661A (en) * 2013-02-20 2014-08-20 腾讯科技(深圳)有限公司 Method for triggering application programs or application program functions through gestures, and terminal

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105549884A (en) * 2015-12-11 2016-05-04 杭州勺子网络科技有限公司 Gesture input identification method of touch screen
CN106055098A (en) * 2016-05-24 2016-10-26 北京小米移动软件有限公司 Air gesture operation method and apparatus
CN106055098B (en) * 2016-05-24 2019-03-15 北京小米移动软件有限公司 Every empty gesture operation method and device
CN106037808A (en) * 2016-07-01 2016-10-26 飞依诺科技(苏州)有限公司 Operating method and device of ultrasonic diagnosis equipment
CN106527817A (en) * 2016-12-15 2017-03-22 青岛海信电器股份有限公司 Touch-operated identification method and device thereof
CN106527817B (en) * 2016-12-15 2020-02-14 青岛海信电器股份有限公司 Touch operation identification method and device
CN108205399A (en) * 2016-12-19 2018-06-26 北京嘀嘀无限科技发展有限公司 Cancel the method and device of service request
CN107085469A (en) * 2017-04-21 2017-08-22 深圳市茁壮网络股份有限公司 A kind of recognition methods of gesture and device
CN107908277B (en) * 2017-09-30 2019-12-03 珠海格力电器股份有限公司 A kind of control device, equipment and control method
CN107908277A (en) * 2017-09-30 2018-04-13 珠海格力电器股份有限公司 A kind of control device, equipment and control method
CN107728817A (en) * 2017-11-29 2018-02-23 哈尔滨拓博科技有限公司 Air mouse control system based on gesture control
CN111880927A (en) * 2017-12-05 2020-11-03 创新先进技术有限公司 Resource allocation method, device and equipment
CN111880927B (en) * 2017-12-05 2024-02-06 创新先进技术有限公司 Resource allocation method, device and equipment
CN108804907B (en) * 2018-06-13 2020-06-30 中新国际电子有限公司 Unlocking method and system for touch screen device, computer readable storage medium and terminal
CN108804907A (en) * 2018-06-13 2018-11-13 中新国际电子有限公司 Touch-screen equipment unlocking method and system, computer readable storage medium, terminal
CN109524853A (en) * 2018-10-23 2019-03-26 珠海市杰理科技股份有限公司 Gesture identification socket and socket control method
CN109524853B (en) * 2018-10-23 2020-11-24 珠海市杰理科技股份有限公司 Gesture recognition socket and socket control method
CN110908581A (en) * 2019-11-20 2020-03-24 网易(杭州)网络有限公司 Gesture recognition method and device, computer storage medium and electronic equipment
CN110908581B (en) * 2019-11-20 2021-04-23 网易(杭州)网络有限公司 Gesture recognition method and device, computer storage medium and electronic equipment
CN112068759A (en) * 2020-11-11 2020-12-11 湖南新云网科技有限公司 Trajectory-based terminal control method and apparatus, terminal and readable storage medium
CN112068759B (en) * 2020-11-11 2021-03-02 湖南新云网科技有限公司 Trajectory-based terminal control method and apparatus, terminal and readable storage medium

Also Published As

Publication number Publication date
CN104898981B (en) 2018-10-16

Similar Documents

Publication Publication Date Title
CN104898981A (en) Gesture recognizing method, device and terminal
JP5854442B2 (en) Handwriting input method to write multiple characters continuously
US9721391B2 (en) Positioning of projected augmented reality content
US20160154564A1 (en) Electronic device and method for providing desktop user interface
CN107704157B (en) Multi-screen interface operation method and device and storage medium
US9025878B2 (en) Electronic apparatus and handwritten document processing method
US9588678B2 (en) Method of operating electronic handwriting and electronic device for supporting the same
US20160062637A1 (en) Method, apparatus and non-transitory storage medium for processing punctuation mark
CN104267867A (en) Content input method and device
CN110321759B (en) Video feature extraction method and device
US20140359516A1 (en) Sensing user input to change attributes of rendered content
CN104714675A (en) Gesture recognition method and device
CN115589786A (en) Method, device and system for recognizing hand-drawn figure and computer readable storage medium
CN106020712B (en) Touch gesture recognition method and device
CN112835497A (en) Method and device for quickly entering electronic whiteboard and storage medium
US20170085784A1 (en) Method for image capturing and an electronic device using the method
US9870143B2 (en) Handwriting recognition method, system and electronic device
KR20200087742A (en) Method for resizing window area and electronic device for the same
US11069326B2 (en) Processing method for character stroke and related device
CN111275683A (en) Image quality grading processing method, system, device and medium
CN103309617A (en) Method and device for rapidly recognizing gesture
US20230004528A1 (en) Systems and methods for template-based data processing and visualization
CN111382831A (en) Method and device for accelerating forward reasoning of convolutional neural network model
CN104407763A (en) Content input method and system
CN104754373A (en) Video acquisition method and electronic device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20190827

Address after: 100085 Beijing, Haidian District, No. ten on the ground floor, No. 10 Baidu building, layer 2

Patentee after: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd.

Address before: 100091 Beijing, Haidian District, northeast Wang West Road, No. 4, Zhongguancun Software Park, building C, block, 1-03

Patentee before: Pacify a Heng Tong (Beijing) Science and Technology Ltd.