CN108363599A - User interface shows recognition methods and terminal device - Google Patents
User interface shows recognition methods and terminal device Download PDFInfo
- Publication number
- CN108363599A CN108363599A CN201810029553.8A CN201810029553A CN108363599A CN 108363599 A CN108363599 A CN 108363599A CN 201810029553 A CN201810029553 A CN 201810029553A CN 108363599 A CN108363599 A CN 108363599A
- Authority
- CN
- China
- Prior art keywords
- sectional drawing
- feature vector
- target
- interface
- user interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention is suitable for technical field of mobile terminals, provides a kind of user interface and shows recognition methods and terminal device.This method includes：The target interface sectional drawing of user interface to be detected is obtained, the feature vector of target interface sectional drawing is extracted；The normal interface sectional drawing of the normal user interface to prestore is obtained, the feature vector of normal interface sectional drawing is extracted；According to the feature vector of the feature vector of target interface sectional drawing and normal interface sectional drawing, the COS distance of target interface sectional drawing and normal interface sectional drawing is determined；Judge whether COS distance is more than predetermined threshold value；If it is determined that being more than predetermined threshold value, then level and the position of each element control of user interface to be detected are obtained；Whether level and the position for detecting each element control are abnormal；If detecting, the level of each element control and position are normal, judge that user interface to be detected is shown normally, solve the problems, such as that existing user interface shows that script maintenance efficiency existing for detection method is low.
Description
Technical field
The invention belongs to technical field of mobile terminals more particularly to a kind of user interface to show that recognition methods and terminal are set
It is standby.
Background technology
Currently, several operation systems, such as Android operation system can be applied on the mobile terminals such as mobile phone, due to not
The mobile phone resolution ratio of same type machine is different, and several operation systems are applied to the mobile phone of different resolution, it is necessary to different resolution
Mobile phone is adapted, and can just user interface be made normally to show.Existing detection user interface show is examined by test script
It surveys, that is, executes entire test script, be compared test result with the fixed value of setting after the completion of test, if the two one
It causes, test user interface is shown normally, and otherwise, test user interface shows abnormal.But there are scripts for existing detection method
The low problem of maintenance efficiency needs to rewrite entire test case, while being also required to reset if user interface has adjustment
Fixed value, testing cost is high, is not suitable for practical application.
Invention content
A kind of user interface of offer of the embodiment of the present invention shows recognition methods and terminal device, to solve existing user circle
Face shows the problem that script maintenance efficiency is low existing for detection method.
The first aspect of the embodiment of the present invention provides a kind of user interface display recognition methods, including：
The target interface sectional drawing for obtaining user interface to be detected extracts the feature vector of the target interface sectional drawing；
The normal interface sectional drawing for obtaining the normal user interface to prestore, extracts the feature vector of the normal interface sectional drawing；
According to the feature vector of the feature vector of the target interface sectional drawing and the normal interface sectional drawing, determine described in
The COS distance of target interface sectional drawing and the normal interface sectional drawing；
Judge whether the COS distance is more than predetermined threshold value；
If it is determined that the COS distance is more than the predetermined threshold value, then each member of the user interface to be detected is obtained
The level of plain control and position；
Whether level and the position for detecting each element control are abnormal；
If detecting, the level of each element control and position are normal, judge the user interface to be detected
Display is normal.
Optionally, the feature vector of the extraction target interface sectional drawing includes：
The first preset number sample, the second preset number of each sample extraction are chosen from the target interface sectional drawing
A feature；
According to the second preset number feature of the first preset number sample and each sample extraction, the is constituted
One matrix；
The second matrix is obtained according to the transposed matrix of first matrix and first matrix；
The feature vector for calculating second matrix determines target circle according to the feature vector of second matrix
The feature vector of face sectional drawing.
Optionally, the feature vector according to the target interface sectional drawing and the feature of the normal interface sectional drawing to
Amount, determines that the COS distance of the target interface sectional drawing and the normal interface sectional drawing includes：
Calculate separately the length of the feature vector of the target interface sectional drawing and the feature vector of the normal interface sectional drawing
Degree；
Obtain the inner product of the feature vector of the target interface sectional drawing and the feature vector of the normal interface sectional drawing；
According to the length of the feature vector of the target interface sectional drawing, the length of the feature vector of the normal interface sectional drawing
Degree and the inner product, determine the COS distance of the target interface sectional drawing and the normal interface sectional drawing.
Optionally, the level of each element control for obtaining the user interface to be detected and position include：
It is obtained and is ordered by Software Development Kit (Software Development Kit, SDK) generating run state
It enables；
The layer that order obtains each element control of the user interface to be detected in real time is obtained according to the operating status
Grade and position.
Optionally, the level of each element control of the detection and position whether include extremely：
The child control and child control in each element control are determined according to the level of each element control
Corresponding mother's control；
Whether the position of detection target child control is arranged in the front end of the corresponding target mother control of the target child control,
And detecting whether range shared by the target child control exceeds range shared by the target mother control, the target child control is
Any one child control in child control in determining each element control.
The second aspect of the embodiment of the present invention provides a kind of user interface and shows identification terminal equipment, including memory,
Processor and it is stored in the computer program that can be run in the memory and on the processor, the processor is held
Following steps are realized when the row computer program：
The target interface sectional drawing for obtaining user interface to be detected extracts the feature vector of the target interface sectional drawing；
The normal interface sectional drawing for obtaining the normal user interface to prestore, extracts the feature vector of the normal interface sectional drawing；
According to the feature vector of the feature vector of the target interface sectional drawing and the normal interface sectional drawing, determine described in
The COS distance of target interface sectional drawing and the normal interface sectional drawing；
Judge whether the COS distance is more than predetermined threshold value；
If it is determined that the COS distance is more than the predetermined threshold value, then each member of the user interface to be detected is obtained
The level of plain control and position；
Whether level and the position for detecting each element control are abnormal；
If detecting, the level of each element control and position are normal, judge the user interface to be detected
Display is normal.
Optionally, the feature vector of the extraction target interface sectional drawing includes：
The first preset number sample, the second preset number of each sample extraction are chosen from the target interface sectional drawing
A feature；
According to the second preset number feature of the first preset number sample and each sample extraction, the is constituted
One matrix；
The second matrix is obtained according to the transposed matrix of first matrix and first matrix；
The feature vector for calculating second matrix determines target circle according to the feature vector of second matrix
The feature vector of face sectional drawing.
Optionally, the feature vector according to the target interface sectional drawing and the feature of the normal interface sectional drawing to
Amount, determines that the COS distance of the target interface sectional drawing and the normal interface sectional drawing includes：
Calculate separately the length of the feature vector of the target interface sectional drawing and the feature vector of the normal interface sectional drawing
Degree；
Obtain the inner product of the feature vector of the target interface sectional drawing and the feature vector of the normal interface sectional drawing；
According to the length of the feature vector of the target interface sectional drawing, the length of the feature vector of the normal interface sectional drawing
Degree and the inner product, determine the COS distance of the target interface sectional drawing and the normal interface sectional drawing.
Optionally, the level of each element control of the detection and position whether include extremely：
The child control and child control in each element control are determined according to the level of each element control
Corresponding mother's control；
Whether the position of detection target child control is arranged in the front end of the corresponding target mother control of the target child control,
And detecting whether range shared by the target child control exceeds range shared by the target mother control, the target child control is
Any one child control in child control in determining each element control.
The third aspect of the embodiment of the present invention provides a kind of computer readable storage medium, described computer-readable to deposit
Storage media is stored with computer program, realizes that above-mentioned user interface display such as is known when the computer program is executed by processor
The step of other method.
Existing advantageous effect is the embodiment of the present invention compared with prior art：The embodiment of the present invention is to be checked by obtaining
The target interface sectional drawing for surveying user interface, determines the COS distance of target interface sectional drawing and normal interface sectional drawing, is judging that this is remaining
When chordal distance is more than predetermined threshold value, whether level and the position for detecting each element control of user interface to be detected are abnormal,
When detection is all normal, judge that user interface to be detected is shown normally, solves existing user interface and show foot existing for detection method
The low problem of this maintenance efficiency, each element control of sectional drawing and user interface to be detected in combination with user interface to be detected
The level of part and position, detection user interface whether abnormal show, improve user interface show recognition accuracy, reduce test
Cost is suitble to practical application.
Description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, embodiment or the prior art will be retouched below
Attached drawing needed in stating is briefly described, it should be apparent that, the accompanying drawings in the following description is only the one of the present invention
A little embodiments for those of ordinary skill in the art without having to pay creative labor, can also basis
These attached drawings obtain other attached drawings.
Fig. 1 is the schematic flow diagram that a kind of user interface provided in an embodiment of the present invention shows recognition methods；
Fig. 2 is the schematic flow diagram that a kind of user interface that another embodiment of the present invention provides shows recognition methods；
Fig. 3 is the schematic flow diagram that a kind of user interface that yet another embodiment of the invention provides shows recognition methods；
Fig. 4 is the schematic flow diagram that a kind of user interface that further embodiment of this invention provides shows recognition methods；
Fig. 5 is the schematic flow diagram that a kind of user interface that further embodiment of this invention provides shows recognition methods；
Fig. 6 is the schematic block diagram that a kind of user interface provided in an embodiment of the present invention shows recognizer；
Fig. 7 is the schematic block diagram that a kind of user interface provided in an embodiment of the present invention shows identification terminal equipment.
Specific implementation mode
In being described below, for illustration and not for limitation, it is proposed that such as particular system structure, technology etc
Detail, to understand thoroughly the embodiment of the present invention.However, it will be clear to one skilled in the art that in these no tools
The present invention can also be realized in the other embodiments of body details.In other situations, omit to well-known system, device,
The detailed description of circuit and method, in case unnecessary details interferes description of the invention.
In order to illustrate technical solutions according to the invention, illustrated below by specific embodiment.
It is the schematic flow diagram that a kind of user interface provided in an embodiment of the present invention shows recognition methods referring to Fig. 1, Fig. 1,
In this embodiment, it is illustrated by taking the triggering of the angle of terminal as an example, here, terminal can be smart mobile phone, tablet computer etc.
Mobile terminal.As shown in Figure 1, in this embodiment, the processing procedure of terminal may comprise steps of：
S101：The target interface sectional drawing for obtaining user interface to be detected, extract the feature of the target interface sectional drawing to
Amount.
Here, user interface to be detected is the user interface that any one needs detects, and user interface is referred to as making
User interface is the medium interacted between system and user with information exchange, it realizes internal form and the mankind of information
It can receive the conversion between form.
The mode for obtaining the target interface sectional drawing of user interface to be detected can be to obtain in real time, or default
Time obtains, and specific acquisition modes can be set according to actual needs.In the target interface sectional drawing for obtaining user interface to be detected
Later, the target interface sectional drawing that can show acquisition, can also generate the prompt for whether reacquiring sectional drawing, if receiving weight
It is new to obtain sectional drawing request, the target interface sectional drawing of user interface to be detected is reacquired according to the request, it can be by repeatedly obtaining
The target interface sectional drawing for taking user interface to be detected, selection one is satisfactory from multiple target interface sectional drawings of acquisition
Target interface sectional drawing, such as selection picture most clearly target interface sectional drawing.
After the feature vector for extracting the target interface sectional drawing, the feature vector of extraction can be preserved, it is convenient follow-up
Data query.
S102：The normal interface sectional drawing for obtaining the normal user interface to prestore, extracts the feature of the normal interface sectional drawing
Vector.
Specifically, the mode for obtaining the normal user interface to prestore includes：Can prestore user interface type with just
The correspondence of normal user interface, obtains the type of user interface to be detected, determines that the type obtained is corresponded to according to above-mentioned relation
Normal user interface.
Interface when the above-mentioned normal user interface to prestore can also normally be shown by obtaining user interface to be detected is true
It is fixed.
Obtain the mode of the normal interface sectional drawing of the normal user interface to prestore and the target for obtaining user interface to be detected
The mode of interface sectional drawing is identical, can be to obtain in real time, or obtained in preset time.It here, can also be by multiple
The normal interface sectional drawing of normal user interface to prestore is obtained, selecting one from multiple normal interface sectional drawings of acquisition meets
It is required that normal interface sectional drawing.
S103：According to the feature vector of the feature vector of the target interface sectional drawing and the normal interface sectional drawing, determine
The COS distance of the target interface sectional drawing and the normal interface sectional drawing.
Here, COS distance, also referred to as cosine similarity are made with two vectorial angle cosine values in vector space
For the measurement of the size of two inter-individual differences of measurement.
Vector is directive line segment in hyperspace, if two vectorial directions are consistent, i.e. angle close to zero, that
The two vectors are just close.
S104：Judge whether the COS distance is more than predetermined threshold value.
Specifically, predetermined threshold value is arranged according to actual needs, if above-mentioned COS distance is more than the predetermined threshold value, executes step
It is different can directly to judge that above-mentioned user interface to be detected is shown if above-mentioned COS distance is less than the predetermined threshold value by rapid S105
Often, it may further be reminded by alarm.
It is abnormal above by the above-mentioned user interface display to be detected of COS distance judgement, it is directed to user circle to be detected
The abnormal bigger situation of face display, this is because above-mentioned after the target interface sectional drawing for obtaining user interface to be detected, extraction
The feature vector of target interface sectional drawing, i.e., carry out that subsequent image display is abnormal to be judged according to the feature vector of image, feature to
Amount is the global feature of image, this judgment mode is being sentenced in the case where user interface to be detected display is abnormal smaller
When fixed above-mentioned COS distance is more than predetermined threshold value, it is susceptible to erroneous judgement, therefore judging that above-mentioned COS distance is more than predetermined threshold value
When to execute following detection step.
S105：If it is determined that the COS distance is more than the predetermined threshold value, then each of the user interface to be detected is obtained
The level of a element control and position.
Here, the level of each element control of above-mentioned user interface to be detected may include application in Mac, browsing
Device, iOS APP etc..
The level and position for obtaining each element control of the user interface to be detected can be in automatic test courses
In or obtain during multimachine compatibility test.
S106：Whether level and the position for detecting each element control are abnormal.
Specifically, use to be detected can be obtained with the correspondence of pre-set user interface type and abnormal control detected rule
The type at family interface determines the corresponding abnormal control detection rule of the type of the user interface to be detected obtained according to above-mentioned relation
Then, according to the exception control detected rule detect above-mentioned each element control level and position it is whether abnormal.
S107：If detecting, the level of each element control and position are normal, judge the user to be detected
Interface display is normal.
Here, if in detecting the level of each element control there are one or multiple element controls level it is abnormal,
Then judge that the user interface display to be detected is abnormal, the first exception information can be generated, it further can also be different according to first
Normal information generates the first warning message, is alarmed according to the first warning message.If detecting the position of each element control
In setting there are one or multiple element controls malposition, then judge that the user interface to be detected display is abnormal, can generate
Second exception information, further can also according to the second exception information generate the second warning message, according to the second warning message into
Row alarm.
It is evidenced from the above discussion that the user interface of the embodiment of the present invention shows recognition methods, existing user circle can be solved
Face shows the problem that script maintenance efficiency is low existing for detection method, simultaneously because can by the sectional drawing of user interface to be detected
To detect the bigger abnormal show of user interface to be detected, in conjunction with the level of each element control of user interface to be detected
And position can further detect the smaller abnormal show of user interface, improve user interface and show recognition accuracy, drop
Low testing cost is suitble to practical application.
Referring to Fig. 2, a kind of user interface that Fig. 2, which is another embodiment of the present invention, to be provided shows the signal of recognition methods
Flow chart.Embodiment corresponding with Fig. 1 difference lies in：The target interface sectional drawing for obtaining user interface to be detected, extraction
The feature vector of the target interface sectional drawing may include S201.Wherein S202~S207 and the S102 in a upper embodiment~
S107 is identical, referring specifically to the associated description of S102~S107 in above-described embodiment, does not repeat herein.Specifically, S201 can
To include S2011~S2014：
S2011：The target interface sectional drawing for obtaining user interface to be detected chooses first from the target interface sectional drawing
Preset number sample, each sample extraction the second preset number feature.
Here, the first preset number and the second preset number can be set according to actual needs, such as can be from acquisition
M sample, n feature of each sample extraction are chosen in sectional drawing.
S2012：According to the second preset number feature of the first preset number sample and each sample extraction,
Constitute the first matrix.
It specifically,, can be with for n feature of each sample extraction to choose m sample in the above-mentioned sectional drawing from acquisition
Using each sample as a line, the first matrix A of m*n is constituted.
S2013：The second matrix is obtained according to the transposed matrix of first matrix and first matrix.
Here it is possible to which the matrix transposition of the first matrix is obtained the second Matrix C=A (t) * A multiplied by with original matrix.
S2014：The feature vector for calculating second matrix, according to the determination of the feature vector of second matrix
The feature vector of target interface sectional drawing.
Specifically, the feature vector of above-mentioned Matrix C is found out, this feature vector is the feature vector of sectional drawing.
Here, it by choosing sample from target interface sectional drawing, from each sample extraction feature, obtains target interface and cuts
The feature vector of figure, method is simple, and the result of acquisition is accurate, is suitble to application.
Referring to Fig. 3, a kind of user interface that Fig. 3, which is yet another embodiment of the invention, to be provided shows the signal of recognition methods
Flow chart.Embodiment corresponding with Fig. 1 difference lies in：The feature vector according to the target interface sectional drawing and described
The feature vector of normal interface sectional drawing determines that the COS distance of the target interface sectional drawing and the normal interface sectional drawing can be with
Including S303.Wherein S301~S302 is identical as S101~S102 in a upper embodiment, S304~S307 and a upper embodiment
In S104~S107 it is identical, referring specifically to the associated description of S101~S102, S104~S107 in above-described embodiment, this
Place does not repeat.Specifically, S303 may include S3031~S3033：
S3031：Calculate separately the feature vector of the feature vector and the normal interface sectional drawing of the target interface sectional drawing
Length.
S3032：Obtain the interior of the feature vector of the target interface sectional drawing and the feature vector of the normal interface sectional drawing
Product.
S3033：According to the length of the feature vector of the target interface sectional drawing, the feature of the normal interface sectional drawing to
The length of amount and the inner product determine the COS distance of the target interface sectional drawing and the normal interface sectional drawing.
Specifically, the cosine law describes the relationship of any one angle and three sides in triangle.Given triangle
Three sides can use the cosine law to find out the angle at each angle of triangle.It is assumed that three sides of a triangle are a, b and c, it is right
Three angles answered are A, B and C, then the cosine of angle A is：
If regarding the both sides b and c of triangle as two vectors, above-mentioned formula is equivalent to：
Wherein denominator indicates that two vectorial length, molecule indicate two vectorial inner products.
For a specific example, if the feature vector of target interface sectional drawing X and the feature of normal interface sectional drawing Y to
Measuring is respectively：X1, x2 ..., x10 and y1, y2 ..., y10.
Then, the COS distance between them can be indicated with the cosine value of angle between them：
When the co sinus vector included angle of two sectional drawings is equal to 1, the two sectional drawings repeat completely, when the cosine value of angle connects
When being bordering on 1, two sectional drawings are similar, and folder cosine of an angle is smaller, and two sectional drawings are more uncorrelated.
Referring to Fig. 4, a kind of user interface that Fig. 4, which is further embodiment of this invention, to be provided shows the signal of recognition methods
Flow chart.Embodiment corresponding with Fig. 1 difference lies in：It is described if it is determined that the COS distance be more than the predetermined threshold value, then
The level and position for obtaining each element control of the user interface to be detected may include S405.Wherein S401~S404
Identical as S101~S104 in a upper embodiment, S406~S407 is identical as S106~S107 in a upper embodiment, specifically
The associated description for please referring to S101~S104 in above-described embodiment, S106~S107, does not repeat herein.Specifically, S405 can be with
Including S4051~S4052：
S4051：If it is determined that the COS distance is more than the predetermined threshold value, is then obtained and ordered by SDK generating run states
It enables.
S4052：Each element control that order obtains the user interface to be detected in real time is obtained according to the operating status
The level of part and position.
Here, it is obtained and is ordered by SDK generating run states, obtained in real time according to operating status acquisition order to be checked
The level and location information for surveying each element control of user interface (return to the rectangle seat of upper left and the coordinate points of bottom right two
Mark), simply, conveniently, accelerate subsequent processing.
Referring to Fig. 5, a kind of user interface that Fig. 5, which is further embodiment of this invention, to be provided shows the signal of recognition methods
Flow chart.Embodiment corresponding with Fig. 1 difference lies in：Whether the level of each element control of the detection and position
Exception may include S506.Wherein S501~S505 is identical as S101~S105 in a upper embodiment, and S507 is implemented with upper one
S107 in example is identical, referring specifically to the associated description of S101~S105, S107 in above-described embodiment, does not repeat herein.Tool
Body, S506 may include S5061~S5062：
S5061：The child control in each element control is determined according to the level of each element control, and
The corresponding female control of child control.
S5062：Whether the position of detection target child control is arranged in the corresponding target mother control of the target child control
Front end, and whether range shared by the target child control is detected beyond range, the target control shared by the target mother control
Part is any one child control in the child control in determining each element control.
Specifically, by taking control one, control two as an example, control two is the child control of control one, and control one is the mother of control two
Control, for control two in the front end of control one, control one is rectangle frame, and position is (x1, y1) (x2, y2), represents a left side for rectangle frame
Inferior horn and the lower right corner, control two are also rectangle frame, and position is (x3, y3) (x4, y4).Above-mentioned user interface to be detected is corresponding
Detected rule can be：Child control is arranged in the front end of female control, and range shared by child control cannot exceed model shared by female control
It encloses.I.e. above-mentioned control two is in one front end of control, and x3>X1, x4<X2, y1>Y3, y2<Y4 just meets rule, otherwise use to be detected
Family interface display is with regard to problematic.
Here, whether user interface to be detected is judged by the level and position that detect above-mentioned each element control extremely
Display whether problematic, due to being judged according to control location, it is abnormal to find smaller interface display, meets real
Border application needs.
It should be understood that the size of the serial number of each step is not meant that the order of the execution order in above-described embodiment, each process
Execution sequence should be determined by its function and internal logic, the implementation process without coping with the embodiment of the present invention constitutes any limit
It is fixed.
Show that recognition methods, Fig. 6 show that the embodiment of the present invention provides corresponding to the user interface described in foregoing embodiments
User interface show recognizer running environment schematic diagram.For convenience of description, it illustrates only related to the present embodiment
Part.
In the present embodiment, the user interface shows that recognizer 600 is installed and run in terminal device 60.
The terminal device 60 can be mobile terminal, palm PC, server etc..The terminal device 60 may include, but be not limited only to,
Memory 601, processor 602 and display 603.Fig. 6 illustrates only the terminal device 60 with component 601-603, but answers
What is understood is, it is not required that implements all components shown, the implementation that can be substituted is more or less component.
The memory 601 can be the internal storage unit of the terminal device 60 in some embodiments, such as should
The hard disk or memory of terminal device 60.The memory 601 can also be the terminal device 60 in further embodiments
The plug-in type hard disk being equipped on External memory equipment, such as the terminal device 60, intelligent memory card (Smart Media
Card, SMC), secure digital (Secure Digital, SD) card, flash card (Flash Card) etc..Further, described to deposit
Reservoir 601 can also both include the terminal device 60 internal storage unit and also including External memory equipment.The memory
601 for storing the application software and Various types of data for being installed on the terminal device 60, such as user interface display identification
The program code etc. of program 600.The memory 601, which can be also used for temporarily storing, have been exported or will export
Data.
The processor 602 can be a central processing unit (Central Processing in some embodiments
Unit, CPU), microprocessor or other data processing chips, for run the program code stored in the memory 601 or
Data are handled, such as executes the user interface and shows recognizer 600 etc..
The display 603 can be that light-emitting diode display, liquid crystal display, touch control type LCD are shown in some embodiments
Device and Organic Light Emitting Diode (Organic Light-Emitting Diode, OLED) touch device etc..The display
603 for being shown in the information handled in the terminal device 60 and for showing visual user interface, such as using
Menu interface, application icon interface etc..The component 601-603 of the terminal device 60 is in communication with each other by system bus.
Referring to Fig. 7, being the functional block diagram that user interface provided in an embodiment of the present invention shows recognizer 600.
In the present embodiment, the user interface shows that recognizer 600 can be divided into one or more modules, one
Or multiple modules are stored in the memory 601, and (the present embodiment is the processing by one or more processors
Device 602) it is performed, to complete the present invention.For example, in Fig. 7, the user interface shows that recognizer 600 can be divided
The first sectional drawing processing unit 701, the second sectional drawing processing unit 702, COS distance determination unit 703, COS distance is cut into judge
Unit 704, element control acquiring unit 705, element control detection unit 706 and user interface show judging unit 707.This
It is the series of computation machine program instruction section for referring to complete specific function to invent so-called unit, than program more suitable for retouching
It states the user interface and shows implementation procedure of the recognizer 600 in the terminal device 60.Being described below specifically to introduce
The function of the module 701-707.
Wherein, the first sectional drawing processing unit 701, the target interface sectional drawing for obtaining user interface to be detected extract institute
State the feature vector of target interface sectional drawing.Second sectional drawing processing unit 702, for obtaining the normal user interface to prestore just
Normal interface sectional drawing, extracts the feature vector of the normal interface sectional drawing.COS distance determination unit 703, for according to the mesh
Demarcate face sectional drawing feature vector and the normal interface sectional drawing feature vector, determine the target interface sectional drawing with it is described
The COS distance of normal interface sectional drawing.COS distance judging unit 704, for judging whether the COS distance is more than default
Threshold value.Element control acquiring unit 705 is used for if it is determined that the COS distance then waits for described in acquisition more than the predetermined threshold value
Detect level and the position of each element control of user interface.Element control detection unit 706, it is each described for detecting
Whether the level of element control and position are abnormal.User interface shows judging unit 707, if for detecting each member
The level of plain control and position are normal, then judge that the user interface to be detected is shown normally.
Optionally, the first sectional drawing processing unit 701 can be divided into sample selection unit 7011, the first matrix
Component units 7012, the second matrix obtaining unit 7013 and feature vector determination unit 7014.
Wherein, sample selection unit 7011, the target interface sectional drawing for obtaining user interface to be detected, from the mesh
It demarcates and chooses the first preset number sample, each sample extraction the second preset number feature in the sectional drawing of face.First matrix structure
At unit 7012, it is used for the second preset number feature according to the first preset number sample and each sample extraction,
Constitute the first matrix.Second matrix obtaining unit 7013, for the transposition square according to first matrix and first matrix
Battle array obtains the second matrix.Feature vector determination unit 7014, the feature vector for calculating second matrix, according to described
The feature vector of second matrix determines the feature vector of the target interface sectional drawing.
Optionally, the COS distance determination unit 703 can be divided into vector length computing unit 7031, vector
Inner product obtaining unit 7032 and COS distance processing unit 7033.
Wherein, vector length computing unit 7031, the feature vector for calculating separately the target interface sectional drawing and institute
State the length of the feature vector of normal interface sectional drawing.Inner product of vectors obtaining unit 7032, for obtaining the target interface sectional drawing
Feature vector and the normal interface sectional drawing feature vector inner product.COS distance processing unit 7033, for according to institute
The length of the feature vector of target interface sectional drawing, the length of the feature vector of the normal interface sectional drawing and the inner product are stated, really
The COS distance of fixed the target interface sectional drawing and the normal interface sectional drawing.
Optionally, the element control acquiring unit 705 can be divided into order generation unit 7051 and element control
Processing unit 7052.
Wherein, order generation unit 7051 is used for if it is determined that the COS distance then passes through more than the predetermined threshold value
SDK generating run states obtain order.Element control processing unit 7052, it is real for obtaining order according to the operating status
When obtain the user interface to be detected each element control level and position.
Optionally, the element control detection unit 706 can also be divided into primary and secondary control determination unit 7061 and son
Female control detection unit 7062.
Wherein, primary and secondary control determination unit 7061, it is each described for being determined according to the level of each element control
The corresponding female control of child control and child control in element control.Primary and secondary control detection unit 7062, for detecting target
Whether the position of child control is arranged in the front end of the corresponding target mother control of the target child control, and detects target
Whether beyond range shared by the target mother control, the target child control is each member of determination to range shared by control
Any one child control in child control in plain control.
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each work(
Can unit, module division progress for example, in practical application, can be as needed and by above-mentioned function distribution by difference
Functional unit, module complete, i.e., the internal structure of described device is divided into different functional units or module, with complete
All or part of function described above.Each functional unit, module in embodiment can be integrated in a processing unit
In, can also be that each unit physically exists alone, can also during two or more units are integrated in one unit, on
The form realization that hardware had both may be used in integrated unit is stated, can also be realized in the form of SFU software functional unit.In addition,
Each functional unit, module specific name also only to facilitate mutually distinguish, the protection model being not intended to limit this application
It encloses.The specific work process of unit in above system, module, can refer to corresponding processes in the foregoing method embodiment,
This is repeated no more.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, is not described in detail or remembers in some embodiment
The part of load may refer to the associated description of other embodiments.
Those of ordinary skill in the art may realize that described in conjunction with the examples disclosed in the embodiments of the present disclosure
Unit and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions
It is implemented in hardware or software actually, depends on the specific application and design constraint of technical solution.Professional technique
Personnel can use different methods to achieve the described function each specific application, but this realization should not be recognized
It is beyond the scope of this invention.
In embodiment provided by the present invention, it should be understood that disclosed device/terminal device and method, it can be with
It realizes by another way.For example, device described above/terminal device embodiment is only schematical, for example,
The division of the module or unit, only a kind of division of logic function, formula that in actual implementation, there may be another division manner,
Such as multiple units or component can be combined or can be integrated into another system, or some features can be ignored, or do not hold
Row.Another point, shown or discussed mutual coupling or direct-coupling or communication connection can be connect by some
Mouthful, the INDIRECT COUPLING or communication connection of device or unit can be electrical, machinery or other forms.
The unit illustrated as separating component may or may not be physically separated, as unit
The component of display may or may not be physical unit, you can be located at a place, or may be distributed over more
In a network element.Some or all of unit therein can be selected according to the actual needs to realize this embodiment scheme
Purpose.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, it can also
It is that each unit physically exists alone, it can also be during two or more units be integrated in one unit.Above-mentioned integrated list
The form that hardware had both may be used in member is realized, can also be realized in the form of SFU software functional unit.
If the integrated module/unit is realized in the form of SFU software functional unit and is sold as independent product
Or it in use, can be stored in a computer read/write memory medium.Based on this understanding, the present invention realizes above-mentioned
All or part of flow in embodiment method can also instruct relevant hardware to complete by computer program, described
Computer program can be stored in a computer readable storage medium, which, can be real when being executed by processor
The step of existing above-mentioned each embodiment of the method.Wherein, the computer program includes computer program code, the computer
Program code can be source code form, object identification code form, executable file or certain intermediate forms etc..The computer
Readable medium may include：Any entity or device, recording medium, USB flash disk, the shifting of the computer program code can be carried
Dynamic hard disk, magnetic disc, CD, computer storage, read-only memory (Read-Only Memory, ROM), random access memory
Device (Random Access Memory, RAM), electric carrier signal, telecommunication signal and software distribution medium etc..It needs to illustrate
, content that the computer-readable medium includes can according to legislation in jurisdiction and the requirement of patent practice into
Row increase and decrease appropriate, such as in certain jurisdictions, according to legislation and patent practice, computer-readable medium does not include electricity
Carrier signal and telecommunication signal.
Embodiment described above is merely illustrative of the technical solution of the present invention, rather than its limitations；Although with reference to aforementioned reality
Applying example, invention is explained in detail, it will be understood by those of ordinary skill in the art that：It still can be to aforementioned each
Technical solution recorded in embodiment is modified or equivalent replacement of some of the technical features；And these are changed
Or replace, the spirit and scope for various embodiments of the present invention technical solution that it does not separate the essence of the corresponding technical solution should all
It is included within protection scope of the present invention.
Claims (10)
1. a kind of user interface shows recognition methods, which is characterized in that including：
The target interface sectional drawing for obtaining user interface to be detected extracts the feature vector of the target interface sectional drawing；
The normal interface sectional drawing for obtaining the normal user interface to prestore, extracts the feature vector of the normal interface sectional drawing；
According to the feature vector of the feature vector of the target interface sectional drawing and the normal interface sectional drawing, target circle is determined
The COS distance of face sectional drawing and the normal interface sectional drawing；
Judge whether the COS distance is more than predetermined threshold value；
If it is determined that the COS distance is more than the predetermined threshold value, then each element control of the user interface to be detected is obtained
Level and position；
Whether level and the position for detecting each element control are abnormal；
If detecting, the level of each element control and position are normal, judge that the user interface to be detected is shown just
Often.
2. user interface as described in claim 1 shows recognition methods, which is characterized in that the extraction target interface is cut
The feature vector of figure includes：
The first preset number sample is chosen from the target interface sectional drawing, the second preset number of each sample extraction is special
Sign；
According to the second preset number feature of the first preset number sample and each sample extraction, the first square is constituted
Battle array；
The second matrix is obtained according to the transposed matrix of first matrix and first matrix；
The feature vector for calculating second matrix determines the target interface sectional drawing according to the feature vector of second matrix
Feature vector.
3. user interface as described in claim 1 shows recognition methods, which is characterized in that described to be cut according to the target interface
The feature vector of the feature vector of figure and the normal interface sectional drawing determines that the target interface sectional drawing is cut with the normal interface
The COS distance of figure includes：
Calculate separately the length of the feature vector of the target interface sectional drawing and the feature vector of the normal interface sectional drawing；
Obtain the inner product of the feature vector of the target interface sectional drawing and the feature vector of the normal interface sectional drawing；
According to the length of the feature vector of the target interface sectional drawing, the length of the feature vector of the normal interface sectional drawing and institute
Inner product is stated, determines the COS distance of the target interface sectional drawing and the normal interface sectional drawing.
4. user interface as described in claim 1 shows recognition methods, which is characterized in that described to obtain the user to be detected
The level of each element control at interface and position include：
It is obtained and is ordered by Software Development Kit SDK generating run states；
According to the operating status obtain order obtain in real time the user interface to be detected each element control level and
Position.
5. user interface as described in claim 1 shows recognition methods, which is characterized in that each element control of detection
The level of part and position whether include extremely：
Determine that child control in each element control and child control are corresponding according to the level of each element control
Female control；
Whether the position of detection target child control is arranged in the front end of the corresponding target mother control of the target child control, and detects
Whether beyond range shared by the target mother control, the target child control is each of determination to range shared by the target child control
Any one child control in child control in a element control.
6. a kind of user interface shows identification terminal equipment, which is characterized in that including memory, processor and be stored in described
In memory and the computer program that can run on the processor, the processor are realized when executing the computer program
Following steps：
The target interface sectional drawing for obtaining user interface to be detected extracts the feature vector of the target interface sectional drawing；
The normal interface sectional drawing for obtaining the normal user interface to prestore, extracts the feature vector of the normal interface sectional drawing；
According to the feature vector of the feature vector of the target interface sectional drawing and the normal interface sectional drawing, target circle is determined
The COS distance of face sectional drawing and the normal interface sectional drawing；
Judge whether the COS distance is more than predetermined threshold value；
If it is determined that the COS distance is more than the predetermined threshold value, then each element control of the user interface to be detected is obtained
Level and position；
Whether level and the position for detecting each element control are abnormal；
If detecting, the level of each element control and position are normal, judge that the user interface to be detected is shown just
Often.
7. user interface as claimed in claim 6 shows identification terminal equipment, which is characterized in that extraction target circle
The feature vector of face sectional drawing includes：
The first preset number sample is chosen from the target interface sectional drawing, the second preset number of each sample extraction is special
Sign；
According to the second preset number feature of the first preset number sample and each sample extraction, the first square is constituted
Battle array；
The second matrix is obtained according to the transposed matrix of first matrix and first matrix；
The feature vector for calculating second matrix determines the target interface sectional drawing according to the feature vector of second matrix
Feature vector.
8. user interface as claimed in claim 6 shows identification terminal equipment, which is characterized in that described according to target circle
The feature vector of the feature vector of face sectional drawing and the normal interface sectional drawing determines the target interface sectional drawing and the normal boundary
The COS distance of face sectional drawing includes：
Calculate separately the length of the feature vector of the target interface sectional drawing and the feature vector of the normal interface sectional drawing；
Obtain the inner product of the feature vector of the target interface sectional drawing and the feature vector of the normal interface sectional drawing；
According to the length of the feature vector of the target interface sectional drawing, the length of the feature vector of the normal interface sectional drawing and institute
Inner product is stated, determines the COS distance of the target interface sectional drawing and the normal interface sectional drawing.
9. user interface as claimed in claim 6 shows identification terminal equipment, which is characterized in that each member of detection
The level of plain control and position whether include extremely：
Determine that child control in each element control and child control are corresponding according to the level of each element control
Female control；
Whether the position of detection target child control is arranged in the front end of the corresponding target mother control of the target child control, and detects
Whether beyond range shared by the target mother control, the target child control is each of determination to range shared by the target child control
Any one child control in child control in a element control.
10. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, feature to exist
In realization user interface as described in any one of claim 1 to 5 shows identification side when the computer program is executed by processor
The step of method.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810029553.8A CN108363599B (en) | 2018-01-12 | 2018-01-12 | User interface shows recognition methods and terminal device |
| PCT/CN2018/097518 WO2019136961A1 (en) | 2018-01-12 | 2018-07-27 | User interface display identification method, terminal device, storage medium and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810029553.8A CN108363599B (en) | 2018-01-12 | 2018-01-12 | User interface shows recognition methods and terminal device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108363599A true CN108363599A (en) | 2018-08-03 |
| CN108363599B CN108363599B (en) | 2019-07-19 |
Family
ID=63011346
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810029553.8A Active CN108363599B (en) | 2018-01-12 | 2018-01-12 | User interface shows recognition methods and terminal device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108363599B (en) |
| WO (1) | WO2019136961A1 (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109144868A (en) * | 2018-08-15 | 2019-01-04 | 无线生活（杭州）信息科技有限公司 | A kind of page judgment method and device |
| CN109240923A (en) * | 2018-08-31 | 2019-01-18 | 福建天泉教育科技有限公司 | The generation method and computer readable storage medium of interface testing script |
| CN109446061A (en) * | 2018-09-17 | 2019-03-08 | 平安科技（深圳）有限公司 | A kind of page detection method, computer readable storage medium and terminal device |
| CN109857673A (en) * | 2019-02-25 | 2019-06-07 | 广州云测信息技术有限公司 | Control recognition methods and device |
| CN109886431A (en) * | 2019-01-25 | 2019-06-14 | 北京首都国际机场股份有限公司 | A kind of aobvious terminal automatic tour inspection system of airport boat |
| CN109976854A (en) * | 2019-03-22 | 2019-07-05 | 维沃移动通信有限公司 | A kind of applied program processing method and terminal device |
| CN110309073A (en) * | 2019-06-28 | 2019-10-08 | 上海交通大学 | Mobile applications user interface mistake automated detection method, system and terminal |
| CN111475396A (en) * | 2019-01-24 | 2020-07-31 | 北京嘀嘀无限科技发展有限公司 | Program detection method, device, electronic equipment and storage medium |
| CN111880984A (en) * | 2020-06-09 | 2020-11-03 | 上海容易网电子商务股份有限公司 | Monitoring system for android interactive screen application running state |
| CN112231034A (en) * | 2019-12-23 | 2021-01-15 | 北京来也网络科技有限公司 | Software interface element identification method and device combining RPA and AI |
| CN117971641A (en) * | 2023-11-24 | 2024-05-03 | 北京东舟技术股份有限公司 | Traversal testing method of application interface and electronic equipment |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111600995A (en) * | 2020-05-15 | 2020-08-28 | 上海莉莉丝科技股份有限公司 | Mobile device and method for correcting deviation of game user interface of mobile device |
| CN112686338A (en) * | 2021-03-10 | 2021-04-20 | 卡斯柯信号(北京)有限公司 | Image information identification method, device, equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110235902A1 (en) * | 2010-03-29 | 2011-09-29 | Ebay Inc. | Pre-computing digests for image similarity searching of image-based listings in a network-based publication system |
| CN103927480A (en) * | 2013-01-14 | 2014-07-16 | 腾讯科技（深圳）有限公司 | Method, device and system for identifying malicious web page |
| CN106874753A (en) * | 2016-12-30 | 2017-06-20 | 中国建设银行股份有限公司 | The method and device at the abnormal interface of identification |
| CN107025174A (en) * | 2017-04-06 | 2017-08-08 | 网易（杭州）网络有限公司 | For the method for the user interface abnormality test of equipment, device and readable storage media |
| CN107315682A (en) * | 2017-06-22 | 2017-11-03 | 北京凤凰理理它信息技术有限公司 | Test browser-safe method, device, storage medium and electronic equipment |
-
2018
- 2018-01-12 CN CN201810029553.8A patent/CN108363599B/en active Active
- 2018-07-27 WO PCT/CN2018/097518 patent/WO2019136961A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110235902A1 (en) * | 2010-03-29 | 2011-09-29 | Ebay Inc. | Pre-computing digests for image similarity searching of image-based listings in a network-based publication system |
| CN103927480A (en) * | 2013-01-14 | 2014-07-16 | 腾讯科技（深圳）有限公司 | Method, device and system for identifying malicious web page |
| CN106874753A (en) * | 2016-12-30 | 2017-06-20 | 中国建设银行股份有限公司 | The method and device at the abnormal interface of identification |
| CN107025174A (en) * | 2017-04-06 | 2017-08-08 | 网易（杭州）网络有限公司 | For the method for the user interface abnormality test of equipment, device and readable storage media |
| CN107315682A (en) * | 2017-06-22 | 2017-11-03 | 北京凤凰理理它信息技术有限公司 | Test browser-safe method, device, storage medium and electronic equipment |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109144868A (en) * | 2018-08-15 | 2019-01-04 | 无线生活（杭州）信息科技有限公司 | A kind of page judgment method and device |
| CN109144868B (en) * | 2018-08-15 | 2022-02-01 | 无线生活（杭州）信息科技有限公司 | Page judgment method and device |
| CN109240923A (en) * | 2018-08-31 | 2019-01-18 | 福建天泉教育科技有限公司 | The generation method and computer readable storage medium of interface testing script |
| CN109240923B (en) * | 2018-08-31 | 2021-06-04 | 福建天泉教育科技有限公司 | Interface test script generation method and computer readable storage medium |
| CN109446061A (en) * | 2018-09-17 | 2019-03-08 | 平安科技（深圳）有限公司 | A kind of page detection method, computer readable storage medium and terminal device |
| CN109446061B (en) * | 2018-09-17 | 2022-06-10 | 平安科技（深圳）有限公司 | Page detection method, computer readable storage medium and terminal device |
| CN111475396A (en) * | 2019-01-24 | 2020-07-31 | 北京嘀嘀无限科技发展有限公司 | Program detection method, device, electronic equipment and storage medium |
| CN109886431A (en) * | 2019-01-25 | 2019-06-14 | 北京首都国际机场股份有限公司 | A kind of aobvious terminal automatic tour inspection system of airport boat |
| CN109886431B (en) * | 2019-01-25 | 2021-05-07 | 北京首都国际机场股份有限公司 | Automatic inspection system for airport navigation display terminal |
| CN109857673A (en) * | 2019-02-25 | 2019-06-07 | 广州云测信息技术有限公司 | Control recognition methods and device |
| CN109976854A (en) * | 2019-03-22 | 2019-07-05 | 维沃移动通信有限公司 | A kind of applied program processing method and terminal device |
| CN109976854B (en) * | 2019-03-22 | 2023-02-24 | 维沃移动通信有限公司 | Application processing method and terminal equipment |
| CN110309073B (en) * | 2019-06-28 | 2021-07-27 | 上海交通大学 | Method, system and terminal for automatically detecting user interface errors of mobile application program |
| CN110309073A (en) * | 2019-06-28 | 2019-10-08 | 上海交通大学 | Mobile applications user interface mistake automated detection method, system and terminal |
| CN112231034A (en) * | 2019-12-23 | 2021-01-15 | 北京来也网络科技有限公司 | Software interface element identification method and device combining RPA and AI |
| CN111880984A (en) * | 2020-06-09 | 2020-11-03 | 上海容易网电子商务股份有限公司 | Monitoring system for android interactive screen application running state |
| CN117971641A (en) * | 2023-11-24 | 2024-05-03 | 北京东舟技术股份有限公司 | Traversal testing method of application interface and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108363599B (en) | 2019-07-19 |
| WO2019136961A1 (en) | 2019-07-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108363599A (en) | User interface shows recognition methods and terminal device | |
| CN107247540B (en) | Application icon adjusting method and device | |
| CN107920246B (en) | The gradient test method and device of camera module | |
| CN108044627A (en) | Detection method, device and the mechanical arm of crawl position | |
| US11112908B2 (en) | Method of determining whether touch data valid, and device and storage medium for the same | |
| CN106331254B (en) | A kind of protection processing method and processing device that mobile terminal falls | |
| CN109272772A (en) | A kind of parking position detection method, device and terminal device | |
| CN109408303A (en) | Test data analysis method and Related product | |
| CN105190546B (en) | Cost computing device, the method for cost accounting and computer readable recording medium storing program for performing | |
| CN108955901A (en) | A kind of infrared measurement of temperature method, system and terminal device | |
| CN108876857A (en) | Localization method, system, equipment and the storage medium of automatic driving vehicle | |
| CN108692735A (en) | Processing method, device, storage medium and the electronic equipment of navigation routine | |
| CN112649720A (en) | Board card testing method and device and computer readable storage medium | |
| CN108182708A (en) | A kind of scaling method of binocular camera, caliberating device and terminal device | |
| CN110489259A (en) | A kind of memory failure detection method and equipment | |
| CN112787713B (en) | Terminal state identification method and device, terminal, medium and optical distribution network equipment | |
| CN112711051A (en) | Flight control system positioning method, device, equipment and storage medium | |
| CN104637781B (en) | A method of generating the processing procedure for positioning wafer on processing board | |
| US20130227591A1 (en) | Electronic device capable of adapting to different types of peripheral devices and method thereof | |
| CN105912417A (en) | Detection method of virtual system, related software running method and related device | |
| US9916412B2 (en) | Automatic generation of test layouts for testing a design rule checking tool | |
| CN110413531A (en) | Realize IOMT automatic test approach, device, computer equipment and storage medium | |
| US9940235B2 (en) | Method and system for valid memory module configuration and verification | |
| CN107734324A (en) | A kind of measuring method, system and the terminal device of flash lamp illuminance uniformity | |
| CN112241697B (en) | Corner color determination method and device, terminal device and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1257521 Country of ref document: HK |