CN109165151A - The evaluation method and device of computer based image conversion interface alternation operation - Google Patents

The evaluation method and device of computer based image conversion interface alternation operation Download PDF

Info

Publication number
CN109165151A
CN109165151A CN201810731427.7A CN201810731427A CN109165151A CN 109165151 A CN109165151 A CN 109165151A CN 201810731427 A CN201810731427 A CN 201810731427A CN 109165151 A CN109165151 A CN 109165151A
Authority
CN
China
Prior art keywords
picture
intercepted
mouse
screen
normal pictures
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810731427.7A
Other languages
Chinese (zh)
Inventor
罗晓
茅晴晴
王莲
王建
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Sunshine Education Polytron Technologies Inc
Original Assignee
Beijing Sunshine Education Polytron Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sunshine Education Polytron Technologies Inc filed Critical Beijing Sunshine Education Polytron Technologies Inc
Priority to CN201810731427.7A priority Critical patent/CN109165151A/en
Publication of CN109165151A publication Critical patent/CN109165151A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3466Performance evaluation by tracing or monitoring
    • G06F11/349Performance evaluation by tracing or monitoring for interfaces, buses
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Human Computer Interaction (AREA)
  • Digital Computer Display Output (AREA)

Abstract

The embodiment of the present invention provides the evaluation method and device of a kind of computer based image conversion interface alternation operation, belongs to field of image processing.This method comprises: the operation of detection mouse and/or keyboard;Screen picture is obtained according to the operation of the mouse and/or the keyboard;It is matched using an at least normal pictures with the screen picture intercepted;And in an at least normal pictures and the screen picture successful match intercepted, the operating procedure for judging that an at least normal pictures indicate is normal.The present invention can be convenient and accurately judge operator whether by operation requirement interact operation.

Description

The evaluation method and device of computer based image conversion interface alternation operation
Technical field
The present invention relates to image procossings, more particularly to the evaluation method of computer based image conversion interface alternation operation And device.
Background technique
To computer, (computer mentioned in this article includes physical entity machine and passes through virtualization technology in physics user The virtual machine run in physical machine) graphic interface interactive operation, be usually all by input equipment (such as mouse, keyboard), Equipment (such as display) is shown to complete.Input equipment is used to for inputting information, display equipment through graphic interface reality When display operation during system mode and operating result.In the man-machine interactive operation of the graphic interface of some pairs of computers In, need to judge whether the operation of computer user meets defined operating process.For example student completes meter using computer When calculation machine experimental courses, teacher wishes to can know that student tests either with or without by experimental procedure.In the prior art, Zhi Nengtong Cross the examination for submitting laboratory report to be tested after student experimenting.The form for the information that may include in laboratory report is different, The method needs artificial participation, and whether not only time-consuming and laborious nor energy accurate judgement student experimental procedure complies fully with It is required that.
Summary of the invention
The purpose of the embodiment of the present invention is that providing a kind of evaluation method of computer based image conversion interface alternation operation And device, the evaluation method and device of computer based image conversion interface alternation operation can be convenient and accurately judge operation Person whether by operation requirement interact operation.
To achieve the goals above, the embodiment of the present invention provides a kind of operation of computer based image conversion interface alternation Evaluation method, this method comprises: the operation of detection mouse and/or keyboard;According to the mouse and/or the keyboard Operation obtain screen picture;It is matched using an at least normal pictures with the screen picture intercepted;And described When an at least normal pictures are with the screen picture successful match intercepted, the behaviour that an at least normal pictures indicate is judged It is normal to make step.
Preferably, the normal pictures are obtained by following operation: in the case where standard operation, according to the mouse At least one operation picture of operation intercept of mark and/or the keyboard;According at least operation diagram on piece intercepted The object and current operation step that screen focus is chosen carry out emphasis label at least one operation picture intercepted;Choose institute The operation picture of label is as the normal pictures.
Preferably, object and current operation that the mouse according at least operation diagram on piece intercepted is chosen It includes: at least operation diagram on piece that judgement is intercepted that step, which carries out emphasis label at least one operation picture intercepted, Whether the object that the screen focus is chosen is the unique selection for executing current operation step;It is in the object that the mouse is chosen When executing the unique selection of current operation step, emphasis label is carried out to the object.
Preferably, the normal pictures are obtained by following operation: in the case where standard operation, according to the mouse At least one operation picture of operation intercept of mark and/or the keyboard;Receive pair that picture is operated to described at least one Instruction as carrying out emphasis label;Emphasis label is carried out to the object according to described instruction;Choose marked operation picture As the normal pictures.
Preferably, after obtaining screen picture according to the operation of the mouse and/or the keyboard, this method is also It include: to be matched by the object that emphasis marks with the screen picture intercepted using in an at least normal pictures;? When there is the object of the object matching marked with institute's emphasis in the screen picture intercepted, an at least normal pictures are judged The operating procedure of expression is normal.
Preferably, which includes: detection module, screen capture module and processing module, wherein the detection module is used for Detect the operation of mouse and/or keyboard;The screen capture module is used for the behaviour according to the mouse and/or the keyboard Make acquisition screen picture;The processing module is used for using an at least normal pictures and the screen picture intercepted progress Match;And in an at least normal pictures and the screen picture successful match intercepted, judgement at least one mark The operating procedure that quasi- picture indicates is normal.
Preferably, the normal pictures are obtained by following operation: the screen capture module is the standard operation the case where Under, according at least one operation picture of the operation intercept of the mouse and/or the keyboard;The processing module is according to institute The object and current operation step that an at least operation diagram on piece screen focus for interception is chosen are at least one behaviour intercepted Make picture and carries out emphasis label;And marked operation picture is chosen as the normal pictures.
Preferably, object and current operation that the mouse according at least operation diagram on piece intercepted is chosen It includes: at least operation diagram on piece that judgement is intercepted that step, which carries out emphasis label at least one operation picture intercepted, Whether the object that the screen focus is chosen is the unique selection for executing current operation step;It is in the object that the mouse is chosen When executing the unique selection of current operation step, emphasis label is carried out to the object.
Preferably, the normal pictures are obtained by following operation: the screen capture module is the standard operation the case where Under, according at least one operation picture of the operation intercept of the mouse and/or the keyboard;The processing module reception pair The object of at least one operation picture carries out the instruction of emphasis label;Emphasis mark is carried out to the object according to described instruction Note;And marked operation picture is chosen as the normal pictures.
Preferably, after obtaining screen picture according to the operation of the mouse and/or the keyboard, the processing Module is also used to: being carried out using the object marked in an at least normal pictures by emphasis and the screen picture that is intercepted Match;When there is the object of the object matching marked with institute's emphasis in the screen picture intercepted, judgement at least one mark The operating procedure that quasi- picture indicates is normal.
Through the above technical solutions, the judge operated using computer based image conversion interface alternation provided by the invention Method and apparatus obtain screen picture when mouse and/or keyboard are operated, and use normal pictures and screen picture Match, when there is normal pictures matching, illustrates that the screen picture is correct operating procedure, can be convenient and accurately judge operator Whether by operation requirement interact operation.
The other feature and advantage of the embodiment of the present invention will the following detailed description will be given in the detailed implementation section.
Detailed description of the invention
Attached drawing is to further understand for providing to the embodiment of the present invention, and constitute part of specification, under The specific embodiment in face is used to explain the present invention embodiment together, but does not constitute the limitation to the embodiment of the present invention.Attached In figure:
Fig. 1 is the stream of the evaluation method for the computer based image conversion interface alternation operation that one embodiment of the invention provides Cheng Tu;
Fig. 2 is the flow chart of the acquisition methods for the normal pictures that one embodiment of the invention provides;
Fig. 3 be another embodiment of the present invention provides normal pictures acquisition methods flow chart;
Fig. 4 be another embodiment of the present invention provides computer based image conversion interface alternation operation evaluation method Flow chart;
Fig. 5 is the behaviour of the evaluation method for the computer based image conversion interface alternation operation that one embodiment of the invention provides Make flow diagram;
Fig. 6 is the knot of the judge device for the computer based image conversion interface alternation operation that one embodiment of the invention provides Structure schematic diagram.
Description of symbols
1 detection module, 2 screen capture module
3 processing modules.
Specific embodiment
It is described in detail below in conjunction with specific embodiment of the attached drawing to the embodiment of the present invention.It should be understood that this Locate described specific embodiment and be merely to illustrate and explain the present invention embodiment, is not intended to restrict the invention embodiment.
Fig. 1 is the stream of the evaluation method for the computer based image conversion interface alternation operation that one embodiment of the invention provides Cheng Tu.As shown in Figure 1, this method comprises:
Step S11 detects the operation of mouse and/or keyboard;
Step S12 obtains screen picture according to the operation of the mouse and/or the keyboard;
Step S13 is matched using an at least normal pictures with the screen picture intercepted;And
Step S14, in an at least normal pictures and the screen picture successful match intercepted, judgement is described extremely The operating procedure that few normal pictures indicate is normal.
The realization such as C#, C, Python can be used in above-mentioned steps S11 and S12.JavaScript+ is utilized under cloud platform Html5 obtains user and inputs to mouse, the keyboard of virtual machine, and intercept virtual machine screen recording user's operation.In Microsoft In Windows operating system, can be used provided in Windows API Hook Function detection mouse, keyboard input, below with For C# code under Windows, function call code is as follows:
(enter key and space bar can be mainly judged) when detecting that mouse down or keyboard are pressed, and are carried out screen and are cut It takes, Graphics object acquisition screen picture can be used, function call code is as follows:
Above-mentioned steps S13, the matchTemplate function that can be used in OpenCV carry out template matching calculating, can also OpenCV or other image processing function libraries is called to realize to use the technologies such as C#, Python.Following example code is C++ volume The OpenCV write calls code, and function call code is as follows:
In embodiments of the present invention, normal pictures are that staff led in a manner of above-described embodiment when standard operation The picture crossing screen printing image and obtaining, every normal pictures can at least indicate an operating procedure, therefore, in step In S14, if the result that step S13 is obtained is that can find matching screen map for carrying out matched normal pictures Picture then illustrates that operator executed the operation of normal pictures expression, and the operating procedure for judging that the normal pictures indicate is normal, symbol Regulation in standardization operating process, on the contrary think that operating procedure does not meet the regulation in Standard Operating Procedure.
Fig. 2 is the flow chart of the acquisition methods for the normal pictures that one embodiment of the invention provides.As shown in Fig. 2, the mark Quasi- picture is obtained by following operation:
Step S21, in the case where standard operation, extremely according to the operation intercept of the mouse and/or the keyboard A few operation picture;
Step S22, whether the object for judging that at least operation diagram on piece focus intercepted is chosen is to execute current behaviour Make the unique selection of step;
Step S23, when the object that the mouse is chosen is to execute the unique selection of current operation step, to the object Carry out emphasis label;
Step S24, when the object that the mouse is chosen is not to execute the unique selection of current operation step, without place Reason;
Step S25 chooses marked operation picture as the normal pictures.
In the present embodiment, the equally operation of detection mouse and/or keyboard, and according to mouse and/or keyboard Operation intercept screen picture, as operation picture.Unlike last embodiment, operation is interacted in the present embodiment It is staff, that is, what is executed is the standard operation that process formulation person makes.Standard operation needs the requirement of clearly each step, Illustrate wherein alternative step.When mouse and/or keyboard carry out after operation executes a certain operating procedure (at this time due to mouse And/or keyboard is operated so having intercepted operation picture), when computer may determine that mouse and keyboard are operated Whether the object that screen focus (such as by mouse or the cursor of Keyboard Control etc.) is chosen executes unique choosing of the operating procedure Select (such as the operating procedure of execution is entered a new line automatically when closing on edge, then it is unique choosing that " closing on edge " is clicked in drop-down menu It selects).When the object that the screen focus is chosen is to execute the unique selection of current operation step, then screen focus is chosen Object carries out emphasis label, so that the operation picture comprising the object be made also to be provided with emphasis label, finally has emphasis to mark Operation picture is selected as normal pictures.
Fig. 3 be another embodiment of the present invention provides normal pictures acquisition methods flow chart.As shown in figure 3, described Normal pictures are obtained by following operation:
Step S31, in the case where standard operation, extremely according to the operation intercept of the mouse and/or the keyboard A few operation picture;
Step S32 receives the instruction that the object for operating picture to described at least one carries out emphasis label;
Step S33 carries out emphasis label to the object according to described instruction;
Step S34 chooses marked operation picture as the normal pictures.
In the present embodiment, it is self-determining by staff for which object carrying out emphasis label to, that is, according to mouse After the operation intercept of mark and/or keyboard operation picture, which object which is operated picture to is assigned by staff The instruction of emphasis label is carried out, so that computer carries out emphasis label accordingly, after to all operation picture counterpoise points label, The operation picture for having emphasis to mark is selected as normal pictures.
Fig. 4 be another embodiment of the present invention provides computer based image conversion interface alternation operation evaluation method Flow chart.As shown in figure 4,
Step S41 detects the operation of mouse and/or keyboard;
Step S42 obtains screen picture according to the operation of the mouse and/or the keyboard;
Step S43 uses the object marked in an at least normal pictures by emphasis and the screen picture that is intercepted It is matched;
Step S44 judges the object for whether having with the object matching of institute's emphasis label in the screen picture intercepted;
Step S45 judges institute when having the object of the object matching marked with institute's emphasis in the screen picture intercepted The operating procedure for stating the expression of an at least normal pictures is normal;
Step S46, in the screen picture intercepted not with institute's emphasis label object matching object when, judge institute The operating procedure for stating the expression of an at least normal pictures is abnormal.
In the present embodiment, it is carried out using the object marked in normal pictures by emphasis and the screen picture that is intercepted Match.Also, in all screen pictures intercepted, as long as the object with the object matching marked by emphasis can be found The operating procedure for thinking that normal pictures indicate is normal.The object marked using emphasis is carried out matched advantage and is, by standard drawing The emphasis of piece further embodies, and makes to match more accurate, while also avoiding between normal pictures and screen picture due to difference It is different it is excessive can not match cause judgement occur error.
Fig. 5 is the behaviour of the evaluation method for the computer based image conversion interface alternation operation that one embodiment of the invention provides Make flow diagram.As shown in figure 5, process of the present invention can have 4 class roles, wherein
Standard setter formulates Standard Operating Procedure step first, this Standard Operating Procedure is to require or constrain practical operation Person must be executed the operating process and operation requirement of graphical interfaces interactive operation by this, and specification user is to computer graphical interface Operation behavior, while also after the completion of user's operation as the judge whether satisfactory foundation of user's operation.
Normal process producer is according to the Standard Operating Procedure formulated, in the computer environment met the requirements of the standard In, the operation of computer graphical interface alternation is completely executed according to Standard Operating Procedure, whole operation process all can be by backstage journey Sequence carries out screen picture recording and is labeled to the committed step in the operating process recorded.
Actual operator is that the use of computer graphical interface alternation operation is actually carried out according to Standard Operating Procedure requirement Family.Whole operation process can carry out screen picture recording by background program, and operating process may be because that various reasons are not Comply fully with the Standard Operating Procedure of standard setter's formulation.
The Standard Operating Procedure and foundation is labeled as to emphasis step that computer is recorded according to normal process producer, Result is recorded to the operating process of actual operator to judge, obtain which step of the operation of actual operator meet the requirements, Which step is without operation and wherein specific incorrect details as required.
Fig. 6 is the knot of the judge device for the computer based image conversion interface alternation operation that one embodiment of the invention provides Structure schematic diagram.As shown in fig. 6, the device includes: detection module 1, screen capture module 2 and processing module 3, wherein the detection Module 1 is used to detect the operation of mouse and/or keyboard;The screen capture module 2 is used for according to the mouse and/or the key The operation of disk key obtains screen picture;The processing module 3 is used for using an at least normal pictures and the screen intercepted Image is matched;And in an at least normal pictures and the screen picture successful match intercepted, described in judgement The operating procedure that an at least normal pictures indicate is normal.
Preferably, the normal pictures are obtained by following operation: the screen capture module 2 is the standard operation the case where Under, according at least one operation picture of the operation intercept of the mouse and/or the keyboard;3 basis of processing module The object and current operation step that at least operation diagram on piece screen focus intercepted is chosen are at least one intercepted It operates picture and carries out emphasis label;And marked operation picture is chosen as the normal pictures.
Preferably, object and current operation that the mouse according at least operation diagram on piece intercepted is chosen It includes: at least operation diagram on piece that judgement is intercepted that step, which carries out emphasis label at least one operation picture intercepted, Whether the object that the screen focus is chosen is the unique selection for executing current operation step;It is in the object that the mouse is chosen When executing the unique selection of current operation step, emphasis label is carried out to the object.
Preferably, the normal pictures are obtained by following operation: the screen capture module 2 is the standard operation the case where Under, according at least one operation picture of the operation intercept of the mouse and/or the keyboard;The processing module 3 receives The object for operating picture to described at least one carries out the instruction of emphasis label;Emphasis is carried out to the object according to described instruction Label;And marked operation picture is chosen as the normal pictures.
Preferably, after obtaining screen picture according to the operation of the mouse and/or the keyboard, the processing Module 3 is also used to: being carried out by the object that emphasis marks with the screen picture intercepted using in an at least normal pictures Matching;When having the object of the object matching marked with institute's emphasis in the screen picture intercepted, judgement is at least one described The operating procedure that normal pictures indicate is normal.
Since the embodiment of device is similar with the embodiment of method described above, details are not described herein.
Through the above technical solutions, the judge operated using computer based image conversion interface alternation provided by the invention Method and apparatus obtain screen picture when mouse and/or keyboard are operated, and use normal pictures and screen picture Match, when there is normal pictures matching, illustrates that the screen picture is correct operating procedure, can be convenient and accurately judge operator Whether by operation requirement interact operation.
The optional embodiment of the embodiment of the present invention is described in detail in conjunction with attached drawing above, still, the embodiment of the present invention is simultaneously The detail being not limited in above embodiment can be to of the invention real in the range of the technology design of the embodiment of the present invention The technical solution for applying example carries out a variety of simple variants, these simple variants belong to the protection scope of the embodiment of the present invention.
It is further to note that specific technical features described in the above specific embodiments, in not lance In the case where shield, it can be combined in any appropriate way.In order to avoid unnecessary repetition, the embodiment of the present invention pair No further explanation will be given for various combinations of possible ways.
It will be appreciated by those skilled in the art that implementing the method for the above embodiments is that can pass through Program is completed to instruct relevant hardware, which is stored in a storage medium, including some instructions are used so that single Piece machine, chip or processor (processor) execute all or part of the steps of each embodiment the method for the application.And it is preceding The storage medium stated includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory The various media that can store program code such as (RAM, Random Access Memory), magnetic or disk.
In addition, any combination can also be carried out between a variety of different embodiments of the embodiment of the present invention, as long as it is not The thought of the embodiment of the present invention is violated, equally should be considered as disclosure of that of the embodiment of the present invention.

Claims (10)

1. a kind of evaluation method of computer based image conversion interface alternation operation, which is characterized in that this method comprises:
Detect the operation of mouse and/or keyboard;
Screen picture is obtained according to the operation of the mouse and/or the keyboard;
It is matched using an at least normal pictures with the screen picture intercepted;And
In an at least normal pictures and the screen picture successful match intercepted, an at least standard drawing is judged The operating procedure that piece indicates is normal.
2. the evaluation method of computer based image conversion interface alternation operation according to claim 1, which is characterized in that The normal pictures are obtained by following operation:
In the case where standard operation, according to the operation intercept of a mouse and/or the keyboard at least operation diagram Piece;
The object chosen according at least operation diagram on piece screen focus intercepted and current operation step are to being intercepted At least one operation picture carries out emphasis label;
Marked operation picture is chosen as the normal pictures.
3. the evaluation method of computer based image conversion interface alternation operation according to claim 2, which is characterized in that Object that the mouse according at least operation diagram on piece intercepted is chosen and current operation step are to being intercepted At least one operation picture carries out emphasis label
Judge whether the object that screen focus described in at least operation diagram on piece intercepted is chosen is to execute current operation step Rapid unique selection;
When the object that the mouse is chosen is to execute the unique selection of current operation step, emphasis mark is carried out to the object Note.
4. the evaluation method of computer based image conversion interface alternation operation according to claim 1, which is characterized in that The normal pictures are obtained by following operation:
In the case where standard operation, according to the operation intercept of a mouse and/or the keyboard at least operation diagram Piece;
Receive the instruction that the object for operating picture to described at least one carries out emphasis label;
Emphasis label is carried out to the object according to described instruction;
Marked operation picture is chosen as the normal pictures.
5. the evaluation method of computer based image conversion interface alternation operation according to claim 3 or 4, feature exist In, after obtaining screen picture according to the operation of the mouse and/or the keyboard, this method further include:
It is matched by the object that emphasis marks with the screen picture intercepted using in an at least normal pictures;
When there is the object of the object matching marked with institute's emphasis in the screen picture intercepted, judgement at least one mark The operating procedure that quasi- picture indicates is normal.
6. a kind of judge device of computer based image conversion interface alternation operation, which is characterized in that the device includes:
Detection module, screen capture module and processing module, wherein
The detection module is used to detect the operation of mouse and/or keyboard;
The screen capture module is used to obtain screen picture according to the operation of the mouse and/or the keyboard;
The processing module is used to be matched using an at least normal pictures with the screen picture intercepted;And described When an at least normal pictures are with the screen picture successful match intercepted, the behaviour that an at least normal pictures indicate is judged It is normal to make step.
7. the judge device of computer based image conversion interface alternation operation according to claim 6, which is characterized in that The normal pictures are obtained by following operation:
The screen capture module is in the case where standard operation, extremely according to the operation intercept of the mouse and/or the keyboard A few operation picture;
The object and current operation that the processing module is chosen according at least operation diagram on piece screen focus intercepted walk Suddenly emphasis label is carried out at least one operation picture intercepted;And marked operation picture is chosen as the standard Picture.
8. the judge device of computer based image conversion interface alternation operation according to claim 7, which is characterized in that Object that the mouse according at least operation diagram on piece intercepted is chosen and current operation step are to being intercepted At least one operation picture carries out emphasis label
Judge whether the object that screen focus described in at least operation diagram on piece intercepted is chosen is to execute current operation step Rapid unique selection;
When the object that the mouse is chosen is to execute the unique selection of current operation step, emphasis mark is carried out to the object Note.
9. the judge device of computer based image conversion interface alternation operation according to claim 6, which is characterized in that The normal pictures are obtained by following operation:
The screen capture module is in the case where standard operation, extremely according to the operation intercept of the mouse and/or the keyboard A few operation picture;
The processing module receives the instruction that the object for operating picture to described at least one carries out emphasis label;According to the finger It enables and emphasis label is carried out to the object;And marked operation picture is chosen as the normal pictures.
10. the judge device of computer based image conversion interface alternation operation according to claim 8 or claim 9, feature It is, after obtaining screen picture according to the operation of the mouse and/or the keyboard, the processing module is also used In:
It is matched by the object that emphasis marks with the screen picture intercepted using in an at least normal pictures;
When there is the object of the object matching marked with institute's emphasis in the screen picture intercepted, judgement at least one mark The operating procedure that quasi- picture indicates is normal.
CN201810731427.7A 2018-07-05 2018-07-05 The evaluation method and device of computer based image conversion interface alternation operation Pending CN109165151A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810731427.7A CN109165151A (en) 2018-07-05 2018-07-05 The evaluation method and device of computer based image conversion interface alternation operation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810731427.7A CN109165151A (en) 2018-07-05 2018-07-05 The evaluation method and device of computer based image conversion interface alternation operation

Publications (1)

Publication Number Publication Date
CN109165151A true CN109165151A (en) 2019-01-08

Family

ID=64897399

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810731427.7A Pending CN109165151A (en) 2018-07-05 2018-07-05 The evaluation method and device of computer based image conversion interface alternation operation

Country Status (1)

Country Link
CN (1) CN109165151A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110334142A (en) * 2019-06-18 2019-10-15 北京红云融通技术有限公司 Intelligent data acquisition method, terminal, server and interactive system
CN113380000A (en) * 2021-04-30 2021-09-10 青岛海纳云科技控股有限公司 Fire alarm controller alarm condition processing operation monitoring method based on video

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070211147A1 (en) * 2006-03-08 2007-09-13 Benq Corporation Image capture systems and methods
CN105786316A (en) * 2016-02-26 2016-07-20 湖北汽车工业学院 Computer recognition method for evaluating software operating level
CN105957469A (en) * 2016-04-27 2016-09-21 南京巨鲨显示科技有限公司 Display system and method with image freezing function

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070211147A1 (en) * 2006-03-08 2007-09-13 Benq Corporation Image capture systems and methods
CN105786316A (en) * 2016-02-26 2016-07-20 湖北汽车工业学院 Computer recognition method for evaluating software operating level
CN105957469A (en) * 2016-04-27 2016-09-21 南京巨鲨显示科技有限公司 Display system and method with image freezing function

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110334142A (en) * 2019-06-18 2019-10-15 北京红云融通技术有限公司 Intelligent data acquisition method, terminal, server and interactive system
CN110334142B (en) * 2019-06-18 2022-05-17 北京红云融通技术有限公司 Intelligent data acquisition method, terminal, server and interaction system
CN113380000A (en) * 2021-04-30 2021-09-10 青岛海纳云科技控股有限公司 Fire alarm controller alarm condition processing operation monitoring method based on video
CN113380000B (en) * 2021-04-30 2022-12-16 海纳云物联科技有限公司 Video-based fire alarm processing operation monitoring method for fire alarm controller

Similar Documents

Publication Publication Date Title
CN109961008B (en) Table analysis method, medium and computer equipment based on text positioning recognition
CN103518393B (en) The system and method for detecting mobile communication equipment content
KR101825154B1 (en) Overlapped handwriting input method
US9703462B2 (en) Display-independent recognition of graphical user interface control
US10657036B2 (en) Determining visual testing coverages
CN104063063B (en) The mathematical computations input method and input method system of input method
CN109189519B (en) Universal user desktop behavior simulation system and method
US20120110459A1 (en) Automated adjustment of input configuration
CN104794050A (en) Application program test method, device and system
CN104715203B (en) The method and system of the quantitative analysis of leakage of information leak
CN111665941B (en) Virtual experiment-oriented multi-mode semantic fusion human-computer interaction system and method
CN104252410A (en) Method and equipment for testing control in page
US9405558B2 (en) Display-independent computerized guidance
CN106843737A (en) Text entry method, device and terminal device
US11194596B2 (en) Simulating human interface interaction resilient to user interface changes
CN109359043B (en) Mobile game automatic testing method based on machine learning
CN105700727B (en) With the exchange method and information processing system of hyaline layer application layer below
JP2011081778A (en) Method and device for display-independent computerized guidance
CN107861684A (en) Writing recognition method and device, storage medium and computer equipment
CN104268083A (en) Software automatic testing method and device
CN109165151A (en) The evaluation method and device of computer based image conversion interface alternation operation
Havranek et al. V2s: A tool for translating video recordings of mobile app usages into replayable scenarios
CN111382643B (en) Gesture detection method, device, equipment and storage medium
Cheng et al. YOLOv5‐MGC: GUI Element Identification for Mobile Applications Based on Improved YOLOv5
US12038832B2 (en) Electronic product testing systems for providing automated product testing with human-in-the loop component and/or object detection

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: Room 0001, 1f, block B, No. 18, Zhongguancun Street, Haidian District, Beijing 100080

Applicant after: Beijing Xipu Sunshine Technology Co.,Ltd.

Address before: Room 0001, 1f, block B, No. 18, Zhongguancun Street, Haidian District, Beijing 100080

Applicant before: BEIJING SIMPLEWARE EDUCATION TECHNOLOGY CO.,LTD.

CB02 Change of applicant information
RJ01 Rejection of invention patent application after publication

Application publication date: 20190108

RJ01 Rejection of invention patent application after publication