CN102841789A - Method and device for recording and playing back user operations in browser - Google Patents
Method and device for recording and playing back user operations in browser Download PDFInfo
- Publication number
- CN102841789A CN102841789A CN2012102272336A CN201210227233A CN102841789A CN 102841789 A CN102841789 A CN 102841789A CN 2012102272336 A CN2012102272336 A CN 2012102272336A CN 201210227233 A CN201210227233 A CN 201210227233A CN 102841789 A CN102841789 A CN 102841789A
- Authority
- CN
- China
- Prior art keywords
- information
- browser
- keyboard
- mouse
- note
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 89
- 230000009471 action Effects 0.000 claims description 45
- 238000004321 preservation Methods 0.000 claims description 15
- 238000012217 deletion Methods 0.000 claims description 9
- 230000037430 deletion Effects 0.000 claims description 9
- 238000007689 inspection Methods 0.000 claims description 6
- 238000012544 monitoring process Methods 0.000 claims description 5
- 238000006243 chemical reaction Methods 0.000 claims description 2
- 230000006870 function Effects 0.000 abstract description 52
- 230000008569 process Effects 0.000 abstract description 30
- 238000010586 diagram Methods 0.000 description 19
- BQCADISMDOOEFD-UHFFFAOYSA-N Silver Chemical compound [Ag] BQCADISMDOOEFD-UHFFFAOYSA-N 0.000 description 7
- 238000004590 computer program Methods 0.000 description 7
- 229910052709 silver Inorganic materials 0.000 description 7
- 239000004332 silver Substances 0.000 description 7
- 238000012545 processing Methods 0.000 description 5
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 4
- 230000005611 electricity Effects 0.000 description 3
- 238000012856 packing Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000000977 initiatory effect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 241000931705 Cicada Species 0.000 description 1
- 238000009835 boiling Methods 0.000 description 1
- 238000004883 computer application Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- QSHDDOUJBYECFT-UHFFFAOYSA-N mercury Chemical compound [Hg] QSHDDOUJBYECFT-UHFFFAOYSA-N 0.000 description 1
- 229910052753 mercury Inorganic materials 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
Images
Landscapes
- User Interface Of Digital Computer (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides a method and a device for recording and playing back user operations in a browser. The method comprises the following steps of: starting to record the user operations; storing the configuration information of the current browser; acquiring the operation message of keyboard operations, and/or the operation message of mouse operation, and generating operation records; and converting the configuration information and the operation records of the browser into a single operation program block, and storing the single operation program block. The method and the device can be used for accurately and completely recording the operation steps of a program used by a user, and also can play back the operation steps. The stability and the reliability in the recording process and the playback process are improved, and the user operations are simplified; and functions can be conveniently integrated in the browser.
Description
Technical field
The present invention relates to the technical field of program intelligence operation, particularly relate to and a kind of the method with playback is recorded in user in browser operation, and, a kind of the device with playback is recorded in the operation of user in the browser.
Background technology
Computer applications now more and more widely, many things can solve through network, but for some old men or special population (like the disabled), complicated computation makes them more and more unable to do what one wishes.Therefore, need facilitate by some program intelligence operations.As: can a procedure operation recorded, generate a shortcut, can only click shortcut when needing to use next time, and system will accomplish said procedure operation automatically.
More existing technical solutions are: QuickTestProfessional (being called for short QTP) is a kind of automatic testing instrument of Mercury company exploitation; When the user operates; The mechanism of recording of QTP can be got off user's each operation steps and operated object record, generates the test script statement automatically and supplies user's playback operation at any time.QTP provides 3 kinds to record mode: normally record (Normal Recording), analogue recording (Analog Recording), rudimentary recording (Low Level Recording).
But there is the place of a lot of deficiencies in the mode of recording of QTP.
1, normal recording mode is direct operation to standard control, can't discern non-standard control;
2, the analogue recording pattern is the track and the button operation of analog mouse, keyboard, and a lot of invalid operation are arranged, and when window coordinates move, is easy to maloperation;
3, rudimentary recording mode is to be identified as WinObject to all objects, and more strictness can not moving window to status requirement, need set the x/y coordinate when recording, and process is too complicated.
And QTP software too huge (hundreds of MB) is program independently, can easily not be integrated in the browser.
Therefore, the problem that those skilled in the art press for solution is: provide a kind of user in the browser is operated the method and apparatus of recording with playback, and in order to the accurate complete operation steps of recording the employed program of user, and can playback.Improve stability and the reliability recorded with replayed section, simplify user's operation; And can function be integrated in the browser easily.
Summary of the invention
Technical matters to be solved by this invention provides a kind ofly records the method with playback to the user in browser operation, in order to the accurate complete operation steps of recording the employed program of user, and can playback.Improve stability and the reliability recorded with replayed section, simplify user's operation; And can function be integrated in the browser easily.
Accordingly, the present invention also provides a kind of user in the browser has been operated the device of recording with playback, in order to ensure the application of said method in reality.
In order to address the above problem, the invention discloses a kind of method that the operation of user in the browser is recorded, it is characterized in that, comprising:
Startup is recorded user's operation;
Preserve the configuration information of current browsing device;
Operation information when gathering keyboard operation, and/or the operation information during mouse action, the generating run record;
Converting the configuration information of said browser and operation note to the single operation program block preserves.
Preferably, the step of the configuration information of said preservation current browsing device can comprise:
Preserve the window size and the positional information of current browsing device;
Preserve the information that is provided with on interface tool hurdle, status bar and collection hurdle.
Preferably, the operation information during said collection keyboard operation, and/or the operation information during mouse action, the generating run recorded steps can comprise:
Gather the typing operation and the blocked operation of keyboard;
And/or collection mouse moving incident and click event;
Obtain the typing operation and the blocked operation of said keyboard, and/or be kept at the lParam parameter of HookProc function when mouse moving incident and click event;
Generate should keyboard and/or the operation note of mouse action according to this lParam parameter information.
Preferably, the typing operation of said collection keyboard and the step of blocked operation may further include:
Start the text edit tool, log-on message is inputed to text edit tool;
The log-on message of the text formatting of this input is encrypted, and be written among the said lParam.
Preferably, said collection mouse moving incident and click event can comprise:
Monitoring mouse moving incident and click event after moving event triggers, are obtained the coordinate and the color of current mouse;
When mouse click event takes place, be saved in the coordinate of moving event preservation before and color among the click color parameter clickcolor.
Preferably, said configuration information and operation note with said browser converts the step that the single operation program block preserves to and can comprise:
The corresponding browser window size and the information that is provided with on positional information and interface tool hurdle, status bar and collection hurdle when each said recording operation is carried out in preservation;
The configuration information and the operation note of said browser are kept in the same running program piece, preserve as the single operation program block.
Preferably, described method may further include:
Analyze the lParam parameter information in the operation note that is generated;
The time interval of deleting said mouse moving event be lower than preset ineffective time threshold value operation;
With the time interval before the said keyboard operation, be revised as the time of presetting;
With the typing operation and the blocked operation of said keyboard, and/or mouse moving incident and click event write down the generating run record according to the order of sequence.
Preferably, said threshold value ineffective time that presets can be 20 milliseconds, and the said time of presetting can be 5 milliseconds.
Preferably, said startup recording step and can comprise to user operation:
The shortcut of the recording operation that setting is preset or shortcut;
Click and start this shortcut or shortcut.
Preferably, described method may further include:
Click said shortcut that presets or shortcut and finish recording operation;
The operation note that shortcut that the deletion click is preset in the running program piece that generates or shortcut end are recorded.
The invention also discloses a kind of method of the register in the browser being carried out playback, specifically can comprise based on the running program piece of record described in the claim 1:
Load the browser configuration information in the said single operation program block;
Read said operation note, the operation information when being reduced to keyboard operation, and/or the operation information during mouse action;
Operation information during according to said keyboard operation, and/or the operation information during mouse action is carried out respective operations in the browser target location.
Preferably, described method can also comprise:
Through the DocumentComplete function of WebBrowser, judge whether said operation playback is normally accomplished;
If then finish said operation and record and playback program;
If not, then point out the user to record again.
Preferably, the said step of judging whether said operation playback is normally accomplished may further include:
Check whether loaded of said current browsing device configuration information;
Checking whether operation information in the said operation note returns finishes.
Preferably, said read operation record, the operation information when being reduced to keyboard operation, and/or the step of the operation information during mouse action can comprise:
Said operation note is turned back to the position of the sensing of lParam;
Resolve the operation note of the position that said lParam points to, and the operation information when being reduced to keyboard operation, and/or the operation information during mouse action.
Preferably, the step of the browser configuration information in the said single operation program block of said loading can comprise:
Resolve the browser configuration information in the said single operation program block;
Obtain the window size and the positional information of operation in each operation note browser when carrying out, and the information that is provided with on interface tool hurdle, status bar and collection hurdle.
Preferably, said operation information during according to keyboard operation, and/or the operation information during mouse action is carried out respective operations in the browser target location step can comprise:
Through calling the message playback function of PlayProc, the operation information when resolving said keyboard operation, and/or the operation information during mouse action;
Obtain the typing operation and the blocked operation of said keyboard in order, and/or mouse moving incident and click event;
The window size and the positional information of browser when carrying out according to the operation in the operation note of obtaining; And the information that is provided with on interface tool hurdle, status bar and collection hurdle; Carry out the typing operation and the blocked operation of said keyboard accordingly in order, and/or mouse moving incident and click event.
Preferably, said operation information during according to the mouse action step of carrying out respective operations in the browser target location can comprise:
After mouse moves to the target location, obtain the color value of target location, the click color parameter clickcolor that contrast operation's program block is preserved if equate, then carries out corresponding mouse action record in this target location.
The present invention discloses a kind of device that the operation of user in the browser is recorded, specifically can comprise:
Record start unit, it is configured to start recording user's operation;
Configuration information is preserved the unit, and it is configured to preserve the configuration information of current browsing device;
The operation note generation module, the operation information when it is configured to gather keyboard operation, and/or the operation information during mouse action, generating run record;
The running program piece is preserved module, and it is configured to convert the configuration information of said browser and operation note to the single operation program block and preserves.
Preferably, said configuration information is preserved the unit and can be comprised:
Spatial information is preserved submodule, and it is configured to preserve the window size and the positional information of current browsing device;
Function information is preserved submodule, and it is configured to preserve the information that is provided with on interface tool hurdle, status bar and collection hurdle.
Preferably, said operation note generation module can comprise:
Submodule is gathered in keyboard operation, and it is configured to gather the typing operation and the blocked operation of keyboard;
Mouse event is gathered submodule, and it is configured to gather mouse moving incident and click event;
Operation and incident preservation submodule, it is configured to obtain the typing operation and the blocked operation of said keyboard, and/or is kept at the lParam parameter of HookProc function when mouse moving incident and click event;
Operation note generates submodule, and it is configured to generate should keyboard and/or the operation note of mouse action according to this lParam parameter information.
Preferably, said running program piece preservation module can comprise:
The information that is provided with is preserved submodule, and it is configured to preserve the browser window size corresponding when carrying out each said recording operation and the information that is provided with on positional information and interface tool hurdle, status bar and collection hurdle;
Program block is preserved submodule, and it is configured to the configuration information of said browser and operation note are kept in the same running program piece, preserves as the single operation program block.
Preferably, described device may further include:
Submodule is analyzed in operation note, and it is configured to analyze the lParam parameter information in the operation note that is generated;
Invalid operation deletion submodule, its time interval that is configured to delete said mouse moving event be lower than preset ineffective time threshold value operation;
The time interval is revised submodule, and it is configured to the time interval before the said keyboard operation is revised as the time of presetting;
With the typing operation and the blocked operation of said keyboard, and/or mouse moving incident and click event write down the generating run record according to the order of sequence.
The invention also discloses a kind of device that register in the browser is carried out playback based on the running program piece of record described in the claim 18, specifically can comprise:
The configuration information load-on module, it is configured to load the browser configuration information in the said single operation program block;
The operation note read module, it is configured to read said operation note, the operation information when being reduced to keyboard operation, and/or the operation information during mouse action;
The respective operations execution module, the operation information when it is configured to according to said keyboard operation, and/or the operation information during mouse action is carried out respective operations in the browser target location.
Preferably, described device can also comprise:
The playback operation judge module, it is configured to the DocumentComplete function through WebBrowser, judges whether said operation playback is normally accomplished;
The EOP (end of program) module, it is configured to finish said operation and records and playback program;
The system of rerecording reminding module, it is configured to point out the user to record again.
Preferably, said playback operation judge module can comprise:
Environment is provided with the inspection submodule, and it is configured to check that whether said current system environments is provided with loaded;
Operation information inspection submodule, it is configured to check whether operation information in the said operation note returns finishes.
Compared with prior art, the present invention has the following advantages:
The present invention records with playback program through configuration operation and generates message recording subroutine and message playback subroutine.Operation information when gathering the operation of key mouse by the message recording subroutine, the generating run record; Convert corresponding one group of operation note packing to the single operation program block.Click the single operation program block, the message playback subroutine starts, and the operation information in the said operation note is turned back in the zone of lParam sensing; System carries out the corresponding key mouse operation of said operation information, accomplishes the playback of key mouse operation in the corresponding single operation program block.
And,, generate the message recording subroutine through the message recording function of HookProc function as recording operation is set; The corresponding memory location of lParam of HookProc function is set, generates recording operation and preserve the position; The message playback function of PlayProc as recording operation is set, generates the message playback subroutine.Made things convenient for operation to record and playback program integrated in browser like this.
Description of drawings
Fig. 1 is a kind of process flow diagram of user in the browser being operated the method embodiment that records of the present invention;
Fig. 2 is a kind of substep process flow diagram of user in the browser being operated step 101 among the method embodiment that records of the present invention;
Fig. 3 is a kind of substep process flow diagram of user in the browser being operated step 102 among the method embodiment that records of the present invention;
Fig. 4 is a kind of substep process flow diagram of user in the browser being operated step 103 among the method embodiment that records of the present invention;
Fig. 5 is a kind of substep process flow diagram of user in the browser being operated step 104 among the method embodiment that records of the present invention;
Fig. 6 is a kind of running program piece based on record of the present invention carries out the method embodiment of playback to the register in the browser a process flow diagram;
Fig. 7 is a kind of running program piece based on record of the present invention carries out step 201 among the method embodiment of playback to the register in the browser a substep process flow diagram;
Fig. 8 is a kind of running program piece based on record of the present invention carries out step 202 among the method embodiment of playback to the register in the browser a substep process flow diagram;
Fig. 9 is a kind of running program piece based on record of the present invention carries out step 203 among the method embodiment of playback to the register in the browser a substep process flow diagram;
Figure 10 is a kind of running program piece based on record of the present invention carries out step 204 among the method embodiment of playback to the register in the browser a substep process flow diagram;
Figure 11 is a kind of structured flowchart of user in the browser being operated the device embodiment that records of the present invention;
Figure 12 is a kind of sub modular structure block diagram of user in the browser being operated record generation module 303 among the device embodiment that records of the present invention;
Figure 13 is a kind of sub modular structure block diagram of user in the browser being operated running program piece preservation module 304 among the device embodiment that records of the present invention;
Figure 14 is a kind of running program piece based on record of the present invention carries out the device embodiment of playback to the register in the browser a structured flowchart.
Embodiment
For make above-mentioned purpose of the present invention, feature and advantage can be more obviously understandable, below in conjunction with accompanying drawing and embodiment the present invention done further detailed explanation.
One of core idea of the embodiment of the invention is, records with playback program through configuration operation and generates message recording subroutine and message playback subroutine.Operation information when gathering the operation of key mouse by the message recording subroutine, the generating run record; Convert corresponding one group of operation note packing to the single operation program block.Click the single operation program block, the message playback subroutine starts, and the operation information in the said operation note is turned back in the zone of lParam sensing; System carries out the corresponding key mouse operation of said operation information, accomplishes the playback of key mouse operation in the corresponding single operation program block.
And,, generate the message recording subroutine through the message recording function of HookProc function as recording operation is set; The corresponding memory location of lParam of HookProc function is set, generates recording operation and preserve the position; The message playback function of PlayProc as recording operation is set, generates the message playback subroutine.Made things convenient for operation to record and playback program integrated in browser like this.
With reference to Fig. 1, show a kind of process flow diagram that user in the browser is operated the method embodiment that records, specifically can may further comprise the steps:
In a kind of preferred embodiment of the present invention, said step 101 specifically can comprise following substep:
The shortcut or the shortcut of the recording operation that substep S01, setting are preset;
Substep S02, click start this shortcut or shortcut.
Substep S03, the said shortcut that presets of click or shortcut finish recording operation;
Substep S04, deletion is clicked the shortcut that presets or shortcut and is finished the operation note of recording in the running program piece that generates.
The configuration information of step 102, preservation current browsing device;
In a kind of preferred embodiment of the present invention, said step 102 specifically can comprise following substep:
Substep S11, the window size and the positional information of preserving the current browsing device;
Substep S12, the information that is provided with of preserving interface tool hurdle, status bar and collection hurdle.
In concrete the realization; The window size of browser and position; And in the browser interface information that is provided with on toolbar, status bar and collection hurdle can influence record with replayed section in the accuracy of coordinate position of mouse; So when recording, will guarantee the window size and the position of browser, and consistance of the information that is provided with on toolbar, status bar and collection hurdle in the browser interface with playback.
In concrete the realization, preserve current system configuration information and can comprise the configuration information of preserving the Windows system and the configuration information of preserving the current browsing device.
As: 360 extremely fast browsers are example, the Preferences file logging window size and position, whether start information such as collection hurdle, status bar.
In a kind of preferred embodiment of the present invention, said step 103 specifically can comprise following substep:
The typing operation and the blocked operation of substep S21, collection keyboard;
In a kind of preferred embodiment of the present invention, said substep S21 specifically can comprise with lower unit:
Start the text edit tool, log-on message is inputed to text edit tool;
The log-on message of the text formatting of this input is encrypted, and be written among the said lParam.
In concrete the realization, can adopt and record function and come recording operation message, as:
SetWindowsHookEx (idHook:WH_JOURNALRECORD; Lpfn:HookProc; Hmod:HInstance; DwThreadId:0) wherein WH_JOURNALRECORD is the call method of " recording "; HookProc is the message function of recording operation; When having mouse-keyboard message to take place; This function all can call in system, and information just is kept among the lParam of HookProc function, and the information in lParam can generate current operation note.
Substep S22 and/or collection mouse moving incident and click event;
In a kind of preferred embodiment of the present invention, said substep S22 specifically can comprise with lower unit:
Monitoring mouse moving incident and click event after moving event triggers, are obtained the coordinate and the color of current mouse;
When mouse click event takes place, be saved in the coordinate of moving event preservation before and color among the click color parameter clickcolor.
In concrete the realization, preserve mouse color judgment point operation can for:
Monitoring mouse moving incident and click event (the WH_MOUSE method with SetWindowsHookEx is hung overall hook) after moving event triggers, are obtained the coordinate and the color of current mouse.When mouse click event takes place, be saved in the coordinate and the color of moving event preservation before among the clickcolor.
Substep S23, obtain the typing operation and the blocked operation of said keyboard, and/or be kept at the lParam parameter of HookProc function when mouse moving incident and click event;
Substep S24, generate should keyboard and/or the operation note of mouse action according to this lParam parameter information.
In concrete the realization; Windows provides api function SetwindowsHookEx to set up a Hook; Can a program be added in the Hook chain through this function and keep watch on windows messaging, the function grammer is: SetWindowsHookEx (idHook:Integer; Lpfn:TFNHookProc; Hmod:HINST; DwThreadId:DWORD) wherein parameter idHook specifies the supervision type function of setting up.WH_JOURNALRECORD and WH_JOURNALPLAYBACK are that it is configured to keep watch on and playback keyboard, mouse action.
In concrete the realization, in the Windows system, document (Document) can conduct interviews to it through the window.document attribute to liking the part of Windows object.The HTML of each loading browsers (HTML, Hypertext Markup Language) document all can become the Document object.Utilization Document object can conduct interviews to all elements in the html page from script, such as: click click (), search element getElementById users such as the () operation of specifying id.It is configured to operation recorded with playback program and is integrated in the browser.
In concrete the realization; In the time of needs input bank account, password, open the notepad program by [*] key, be input to the user name password among the notepad; And be interpreted as code language with the mode of code analysis text message, be integrated among the function lParam that records.Close notepad and continue the Net silver operation.So just can will be referred to the operation generating run records such as Net silver of password and authentication.
In a kind of preferred embodiment of the present invention, said step 103 further can comprise following substep:
LParam parameter information in the operation note that substep S25, analysis are generated;
Substep S26, the deletion said mouse moving event the time interval be lower than preset ineffective time threshold value operation;
Substep S27, with the time interval before the said keyboard operation, be revised as the time of presetting;
Substep S28, with the typing operation and the blocked operation of said keyboard, and/or mouse moving incident and click event write down the generating run record according to the order of sequence.
In a kind of preferred embodiment of the present invention, said threshold value ineffective time that presets can be 20 milliseconds, and the said time of presetting can be 5 milliseconds.
In concrete the realization, analysis operation record before the packing.When the time interval of mouse moving event is within the 20ms (millisecond) time, can delete waiting time with its before a mouse moving event.Purpose is the invalid mouse move operation of deletion, lets playback carry out faster.Free at interval the time before the keyboard operation, can revise the stand-by period is 5ms; The interval of stand-by period can be set according to client's needs, but for fear of the situation that machine of delaying and card occur, minimum setting may be controlled to 5ms.
In a kind of preferred embodiment of the present invention, said step 104 specifically can comprise following substep:
Substep S31, preserve the browser window size corresponding when carrying out each said recording operation and the information that is provided with on positional information and interface tool hurdle, status bar and collection hurdle;
Substep S32, the configuration information and the operation note of said browser is kept in the same running program piece, preserves as the single operation program block.
In concrete the realization, after end is recorded, can delete the operation of last clickable icon.The form realization that can use plug-in unit with playback program is recorded in the operation that is integrated in the browser, can on browser, show an icon.Starting and stopping the message recording subroutine all needs clickable icon to accomplish, and the clicking operation that therefore finishes to record is not user's valid function, so deletion.
In concrete the realization, can one step completed operation note be generated corresponding running program piece.The client uses for ease, can the running program piece be generated shortcut at desktop or file, and the user clicks the operation note of shortcut in both can the playback operation program block.
With reference to Fig. 6, show a kind of running program piece the register in the browser is carried out the process flow diagram of the method embodiment of playback based on record, specifically can may further comprise the steps:
Browser configuration information in step 201, the said single operation program block of loading;
In a kind of preferred embodiment of the present invention, said step 201 specifically can comprise following substep:
Browser configuration information in substep S41, the said single operation program block of parsing;
Substep S42, obtain the window size and the positional information of operation in each operation note browser when carrying out and the information that is provided with on interface tool hurdle, status bar and collection hurdle.
Step 202, read said operation note, the operation information when being reduced to keyboard operation, and/or the operation information during mouse action;
In a kind of preferred embodiment of the present invention, said step 202 specifically can comprise following substep:
Substep S51, said operation note turned back to the position of the sensing of lParam;
Substep S52, resolve the operation note of the position that said lParam points to, and the operation information when being reduced to keyboard operation, and/or the operation information during mouse action.
Step 203, the operation information during according to said keyboard operation, and/or the operation information during mouse action is carried out respective operations in the browser target location;
In a kind of preferred embodiment of the present invention, said step 203 specifically can comprise following substep:
Substep S61, through calling the message playback function of PlayProc, the operation information when resolving said keyboard operation, and/or the operation information during mouse action;
Substep S62, obtain the typing operation and the blocked operation of said keyboard and/or mouse moving incident and click event in order;
The window size and the positional information of browser when the operation in substep S63, the foundation operation note of obtaining is carried out; And the information that is provided with on interface tool hurdle, status bar and collection hurdle; Carry out the typing operation and the blocked operation of said keyboard accordingly in order, and/or mouse moving incident and click event;
Substep S64, after mouse moves to the target location, obtain the color value of target location, the click color parameter clickcolor that contrast operation's program block is preserved if equate, then carries out corresponding mouse action record in this target location.
In concrete the realization, system environments setting can comprise the configuration information of each item element of recording process.Wherein, for the method for judging whether element has represented, can whether operation information is identical with configuration information to the correspondence position that generates at operation information in the recording process.
As: after mouse moves to the target location, obtain the color of mouse, the color clickcolor of the insertion before the contrast.If equate, explain that the action required element can click.If mouse in the zone of browser, need not judged.
With certain browser is example, judges that mouse is whether in browser page:
Enumerate all windows, preserve type handle of Internet Explorer_Server by name to MainHwnd.
Obtain the coordinate of the page then with the GetWindowRect function.
Step 204, the DocumentComplete function through WebBrowser judge whether said operation playback is normally accomplished; If then finish said operation and record and playback program; If not, then point out the user to record again.
In concrete the realization, can whether load through the page that operation information is carried out and accomplish the whether smoothly execution of decision operation message.As: the DocumentComplete with WebBrowser can judge whether the page loads completion.
In a kind of preferred embodiment of the present invention, said step 204 specifically can comprise following substep:
Whether substep S71, the said current browsing device configuration information of inspection loaded;
Whether the operation information in substep S72, the said operation note of inspection returns and finishes.
In concrete the realization, the playback operation record can opening operation be recorded and playback program, selects playback operation; Also can click corresponding single operation program block, directly initiation message playback subroutine.
The method of playback mouse key operation can for:
SetWindowsHookEx(idHook：WH_JOURNALPLAYBACK；lpfn：PlayProc；hmod：HInstance；dwThreadId：0)
Wherein WH_JOURNALPLAYBACK is the call method of " playback "; PlayProc is the message playback function; When system can the executable operations message playback, call this function; Program just turns back to the operation information value of precedence record in the zone of lParam sensing, and system will carry out this operation information, thereby has realized playback.
Those skilled in the art understand the present invention better for ease, below illustrate further the present invention through a complete example:
1, in certain browser, sets up the message recording function of recording operation, generate the message recording subroutine through api function SetwindowsHookEx.And the position is preserved as recording operation in the memory location that the lParam of function is corresponding.Utilize PlayProc to set up the message playback function of recording operation, generate the message playback subroutine.
2, open certain browser, start said operation and record and playback program, preparation will hand over the operation of water power to record.At first preserve the configuration information of current browsing device.
3, can use the WH_MOUSE method of SetWindowsHookEx to hang overall hook monitoring mouse moving incident and click event, after moving event triggers, obtain the coordinate and the color of current mouse.When mouse click event takes place, be saved in the coordinate and the color of moving event preservation before among the clickcolor.Simultaneously can obtain the clicking operation of mouse and the operation information of keyboard move operation is kept among the lParam of HookProc function, generate current operation note with HookProc message function.
4, change the Net silver page over to when needs, in the time of input Bank Account Number and password, open the notepad program, be input to the user name password among the notepad, and be interpreted as code language, be integrated among the function lParam that records with the mode of code analysis text message.Will be referred to the operation generating run records such as Net silver of password and authentication.
5, after the operation that will hand over water power is all accomplished; Arrangement is recorded in the operation note of the lParam of function; Delete the operation note of last clickable icon, convert other operation notes to the operation information value, be packaged as the running program piece that the charges for water and electricity Net silver is submitted to according to the order of sequence.Generate corresponding shortcut at desktop.
6, click the shortcut of the correspondence of desktop generation, the running program piece that the electricity charge Net silver of fetching boiling water is submitted to.Initiation message playback subroutine can load; Can be the message playback function, the operation information value of previous operation note is turned back in the zone that lParam points to that system will carry out corresponding operation information through PlayProc.Operation information according to correspondence loads corresponding browser configuration information and corresponding page.
7, find that corresponding browser configuration information and corresponding page can't load completion, then send information to the user; Inform that change appears in elements such as partial page, browser configuration in the operation that user's charges for water and electricity Net silver submits to, need record corresponding complete operation again.
Need to prove; For method embodiment, for simple description, so it all is expressed as a series of combination of actions; But those skilled in the art should know; The present invention does not receive the restriction of described sequence of movement, because according to the present invention, some step can adopt other orders or carry out simultaneously.Secondly, those skilled in the art also should know, the embodiment described in the instructions all belongs to preferred embodiment, and related action might not be that the present invention is necessary.
With reference to Figure 11, show a kind of structured flowchart that user in the browser is operated the device embodiment that records, specifically can comprise:
Configuration information is preserved unit 302, and it is configured to preserve the configuration information of current browsing device;
In a kind of preferred embodiment of the present invention, said configuration information is preserved unit 302 specifically can comprise following submodule:
Spatial information is preserved submodule, and it is configured to preserve the window size and the positional information of current browsing device;
Function information is preserved submodule, and it is configured to preserve the information that is provided with on interface tool hurdle, status bar and collection hurdle.
Operation note generation module 303, the operation information when it is configured to gather keyboard operation, and/or the operation information during mouse action, generating run record;
In a kind of preferred embodiment of the present invention, said operation note generation module 303 specifically can comprise following submodule:
Submodule S81 is gathered in keyboard operation, and it is configured to gather the typing operation and the blocked operation of keyboard;
Mouse event is gathered submodule S82, and it is configured to gather mouse moving incident and click event;
Operation and incident preservation submodule S83, it is configured to obtain the typing operation and the blocked operation of said keyboard, and/or is kept at the lParam parameter of HookProc function when mouse moving incident and click event;
Operation note generates submodule S84, and it is configured to generate should keyboard and/or the operation note of mouse action according to this lParam parameter information;
Submodule S85 is analyzed in operation note, and it is configured to analyze the lParam parameter information in the operation note that is generated;
Invalid operation deletion submodule S86, its time interval that is configured to delete said mouse moving event be lower than preset ineffective time threshold value operation;
The time interval is revised submodule S87, and it is configured to the time interval before the said keyboard operation is revised as the time of presetting;
Operation note conversion submodule S88, it is configured to typing operation and blocked operation with said keyboard, and/or mouse moving incident and click event write down the generating run record according to the order of sequence.
The running program piece is preserved module 304, and it is configured to convert the configuration information of said browser and operation note to the single operation program block and preserves.
In a kind of preferred embodiment of the present invention, said running program piece is preserved module 304 specifically can comprise following submodule:
The information that is provided with is preserved submodule S91, and it is configured to preserve the browser window size corresponding when carrying out each said recording operation and the information that is provided with on positional information and interface tool hurdle, status bar and collection hurdle;
Program block is preserved submodule S92, and it is configured to the configuration information of said browser and operation note are kept in the same running program piece, preserves as the single operation program block.
With reference to Figure 14, show a kind of running program piece the register in the browser is carried out the structured flowchart of the device embodiment of playback based on record, specifically can comprise:
Configuration information load-on module 401, it is configured to load the browser configuration information in the said single operation program block;
Operation note read module 402, it is configured to read said operation note, the operation information when being reduced to keyboard operation, and/or the operation information during mouse action;
Respective operations execution module 403, the operation information when it is configured to according to said keyboard operation, and/or the operation information during mouse action is carried out respective operations in the browser target location;
Playback operation judge module 404, it is configured to the DocumentComplete function through WebBrowser, judges whether said operation playback is normally accomplished;
EOP (end of program) module 405, it is configured to finish said operation and records and playback program;
The system of rerecording reminding module 406, it is configured to point out the user to record again.
Because said device embodiment is basically corresponding to preceding method embodiment, so not detailed part in the description of present embodiment can just not given unnecessary details at this referring to the related description in the previous embodiment.
Those skilled in the art should understand that embodiments of the invention can be provided as method, system or computer program.Therefore, the present invention can adopt the form of the embodiment of complete hardware embodiment, complete software implementation example or combination software and hardware aspect.And the present invention can be employed in the form that one or more computer-usable storage medium (including but not limited to magnetic disk memory, CD-ROM, optical memory etc.) that wherein include computer usable program code go up the computer program of implementing.
The present invention is that reference is described according to the process flow diagram and/or the block scheme of method, equipment (system) and the computer program of the embodiment of the invention.Should understand can be by the flow process in each flow process in computer program instructions realization flow figure and/or the block scheme and/or square frame and process flow diagram and/or the block scheme and/or the combination of square frame.Can provide these computer program instructions to the processor of multi-purpose computer, special purpose computer, Embedded Processor or other programmable data processing device to produce a machine, make the instruction of carrying out through the processor of computing machine or other programmable data processing device produce to be used for the device of the function that is implemented in flow process of process flow diagram or a plurality of flow process and/or square frame of block scheme or a plurality of square frame appointments.
These computer program instructions also can be stored in ability vectoring computer or the computer-readable memory of other programmable data processing device with ad hoc fashion work; Make the instruction that is stored in this computer-readable memory produce the manufacture that comprises command device, this command device is implemented in the function of appointment in flow process of process flow diagram or a plurality of flow process and/or square frame of block scheme or a plurality of square frame.
These computer program instructions also can be loaded on computing machine or other programmable data processing device; Make on computing machine or other programmable devices and to carry out the sequence of operations step producing computer implemented processing, thereby the instruction of on computing machine or other programmable devices, carrying out is provided for being implemented in the step of the function of appointment in flow process of process flow diagram or a plurality of flow process and/or square frame of block scheme or a plurality of square frame.
Although described the preferred embodiments of the present invention, in a single day those skilled in the art get the basic inventive concept could of cicada, then can make other change and modification to these embodiment.So accompanying claims is intended to be interpreted as all changes and the modification that comprises preferred embodiment and fall into the scope of the invention.
Method among the invention described above embodiment, device and server are applicable in diverse network or the client environment; For example can be implemented in the computer equipment such as PC device, perhaps can be implemented in such as in other portable electric appts such as mobile phone, mobile communication equipment, PDA(Personal Digital Assistant) or the non-portable electric appts.What therefore those skilled in the art will be clear and definite is; Protection scope of the present invention is not limited to PC and goes up operation recording function and operation playback function in the running browser, only is that operation recording function and operation playback function that adopted PC to go up in the running browser are in embodiments of the present invention described from the succinct and convenient of description.
More than to a kind of method that user in browser operation is recorded provided by the present invention, a kind of method of the register in the browser being carried out playback based on the running program piece of record; And; A kind of device that the operation of user in the browser is recorded; A kind of running program piece based on record has carried out detailed introduction to the device that the register in the browser carries out playback; Used concrete example among this paper principle of the present invention and embodiment are set forth, the explanation of above embodiment just is used for helping to understand method of the present invention and core concept thereof; Simultaneously, for one of ordinary skill in the art, according to thought of the present invention, the part that on embodiment and range of application, all can change, in sum, this description should not be construed as limitation of the present invention.
Claims (25)
1. the method that the operation of the user in the browser is recorded is characterized in that, comprising:
Startup is recorded user's operation;
Preserve the configuration information of current browsing device;
Operation information when gathering keyboard operation, and/or the operation information during mouse action, the generating run record;
Converting the configuration information of said browser and operation note to the single operation program block preserves.
2. the method for claim 1 is characterized in that, the step of the configuration information of said preservation current browsing device comprises:
Preserve the window size and the positional information of current browsing device;
Preserve the information that is provided with on interface tool hurdle, status bar and collection hurdle.
3. the method for claim 1 is characterized in that, the operation information during said collection keyboard operation, and/or the operation information during mouse action, and the generating run recorded steps comprises:
Gather the typing operation and the blocked operation of keyboard;
And/or collection mouse moving incident and click event;
Obtain the typing operation and the blocked operation of said keyboard, and/or be kept at the lParam parameter of HookProc function when mouse moving incident and click event;
Generate should keyboard and/or the operation note of mouse action according to this lParam parameter information.
4. method as claimed in claim 3 is characterized in that, the typing operation of said collection keyboard and the step of blocked operation further comprise:
Start the text edit tool, log-on message is inputed to text edit tool;
The log-on message of the text formatting of this input is encrypted, and be written among the said lParam.
5. method as claimed in claim 3 is characterized in that, said collection mouse moving incident and click event comprise:
Monitoring mouse moving incident and click event after moving event triggers, are obtained the coordinate and the color of current mouse;
When mouse click event takes place, be saved in the coordinate of moving event preservation before and color among the click color parameter clickcolor.
6. method as claimed in claim 2 is characterized in that, said configuration information and operation note with said browser converts the step that the single operation program block preserves to and comprise:
The corresponding browser window size and the information that is provided with on positional information and interface tool hurdle, status bar and collection hurdle when each said recording operation is carried out in preservation;
The configuration information and the operation note of said browser are kept in the same running program piece, preserve as the single operation program block.
7. method as claimed in claim 3 is characterized in that, further comprises:
Analyze the lParam parameter information in the operation note that is generated;
The time interval of deleting said mouse moving event be lower than preset ineffective time threshold value operation;
With the time interval before the said keyboard operation, be revised as the time of presetting;
With the typing operation and the blocked operation of said keyboard, and/or mouse moving incident and click event write down the generating run record according to the order of sequence.
8. method as claimed in claim 7 is characterized in that, said threshold value ineffective time that presets is 20 milliseconds, and the said time of presetting is 5 milliseconds.
9. the method for claim 1 is characterized in that, said startup comprises the step of recording of user's operation:
The shortcut of the recording operation that setting is preset or shortcut;
Click and start this shortcut or shortcut.
10. method as claimed in claim 9 is characterized in that, further comprises:
Click said shortcut that presets or shortcut and finish recording operation;
The operation note that shortcut that the deletion click is preset in the running program piece that generates or shortcut end are recorded.
11. one kind based on described in the claim 1 record the running program piece to the method that the register in the browser carries out playback, it is characterized in that, comprising:
Load the browser configuration information in the said single operation program block;
Read said operation note, the operation information when being reduced to keyboard operation, and/or the operation information during mouse action;
Operation information during according to said keyboard operation, and/or the operation information during mouse action is carried out respective operations in the browser target location.
12. method as claimed in claim 11 is characterized in that, also comprises:
Through the DocumentComplete function of WebBrowser, judge whether said operation playback is normally accomplished;
If then finish said operation and record and playback program;
If not, then point out the user to record again.
13. method as claimed in claim 12 is characterized in that, the said step of judging whether said operation playback is normally accomplished further comprises:
Check whether loaded of said current browsing device configuration information;
Checking whether operation information in the said operation note returns finishes.
14. method as claimed in claim 11 is characterized in that, said read operation record, and the operation information when being reduced to keyboard operation, and/or the step of the operation information during mouse action comprises:
Said operation note is turned back to the position of the sensing of lParam;
Resolve the operation note of the position that said lParam points to, and the operation information when being reduced to keyboard operation, and/or the operation information during mouse action.
15. method as claimed in claim 11 is characterized in that, the step of the browser configuration information in the said single operation program block of said loading comprises:
Resolve the browser configuration information in the said single operation program block;
Obtain the window size and the positional information of operation in each operation note browser when carrying out, and the information that is provided with on interface tool hurdle, status bar and collection hurdle.
16. method as claimed in claim 15 is characterized in that, said operation information during according to keyboard operation, and/or the operation information during mouse action is carried out respective operations in the browser target location step comprises:
Through calling the message playback function of PlayProc, the operation information when resolving said keyboard operation, and/or the operation information during mouse action;
Obtain the typing operation and the blocked operation of said keyboard in order, and/or mouse moving incident and click event;
The window size and the positional information of browser when carrying out according to the operation in the operation note of obtaining; And the information that is provided with on interface tool hurdle, status bar and collection hurdle; Carry out the typing operation and the blocked operation of said keyboard accordingly in order, and/or mouse moving incident and click event.
17. method as claimed in claim 11 is characterized in that, said operation information during according to mouse action is carried out respective operations in the browser target location step comprises:
After mouse moves to the target location, obtain the color value of target location, the click color parameter clickcolor that contrast operation's program block is preserved if equate, then carries out corresponding mouse action record in this target location.
18. the device that the operation of the user in the browser is recorded is characterized in that, comprising:
Record start unit, it is configured to start recording user's operation;
Configuration information is preserved the unit, and it is configured to preserve the configuration information of current browsing device;
The operation note generation module, the operation information when it is configured to gather keyboard operation, and/or the operation information during mouse action, generating run record;
The running program piece is preserved module, and it is configured to convert the configuration information of said browser and operation note to the single operation program block and preserves.
19. device as claimed in claim 18 is characterized in that, said configuration information is preserved the unit and is comprised:
Spatial information is preserved submodule, and it is configured to preserve the window size and the positional information of current browsing device;
Function information is preserved submodule, and it is configured to preserve the information that is provided with on interface tool hurdle, status bar and collection hurdle.
20. device as claimed in claim 18 is characterized in that, said operation note generation module comprises:
Submodule is gathered in keyboard operation, and it is configured to gather the typing operation and the blocked operation of keyboard;
Mouse event is gathered submodule, and it is configured to gather mouse moving incident and click event;
Operation and incident preservation submodule, it is configured to obtain the typing operation and the blocked operation of said keyboard, and/or is kept at the lParam parameter of HookProc function when mouse moving incident and click event;
Operation note generates submodule, and it is configured to generate should keyboard and/or the operation note of mouse action according to this lParam parameter information.
21. device as claimed in claim 19 is characterized in that, said running program piece is preserved module and is comprised:
The information that is provided with is preserved submodule, and it is configured to preserve the browser window size corresponding when carrying out each said recording operation and the information that is provided with on positional information and interface tool hurdle, status bar and collection hurdle;
Program block is preserved submodule, and it is configured to the configuration information of said browser and operation note are kept in the same running program piece, preserves as the single operation program block.
22. device as claimed in claim 20 is characterized in that, further comprises:
Submodule is analyzed in operation note, and it is configured to analyze the lParam parameter information in the operation note that is generated;
Invalid operation deletion submodule, its time interval that is configured to delete said mouse moving event be lower than preset ineffective time threshold value operation;
The time interval is revised submodule, and it is configured to the time interval before the said keyboard operation is revised as the time of presetting;
Operation note conversion submodule, it is configured to typing operation and blocked operation with said keyboard, and/or mouse moving incident and click event write down the generating run record according to the order of sequence.
23. one kind based on described in the claim 18 record the running program piece to the device that the register in the browser carries out playback, it is characterized in that, comprising:
The configuration information load-on module, it is configured to load the browser configuration information in the said single operation program block;
The operation note read module, it is configured to read said operation note, the operation information when being reduced to keyboard operation, and/or the operation information during mouse action;
The respective operations execution module, the operation information when it is configured to according to said keyboard operation, and/or the operation information during mouse action is carried out respective operations in the browser target location.
24. device as claimed in claim 23 is characterized in that, also comprises:
The playback operation judge module, it is configured to the DocumentComplete function through WebBrowser, judges whether said operation playback is normally accomplished;
The EOP (end of program) module, it is configured to finish said operation and records and playback program;
The system of rerecording reminding module, it is configured to point out the user to record again.
25. device as claimed in claim 24 is characterized in that, said playback operation judge module comprises:
Environment is provided with the inspection submodule, and it is configured to check that whether said current system environments is provided with loaded;
Operation information inspection submodule, it is configured to check whether operation information in the said operation note returns finishes.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210227233.6A CN102841789B (en) | 2012-06-29 | 2012-06-29 | A kind of method and apparatus of recording with playback that user in browser is operated |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210227233.6A CN102841789B (en) | 2012-06-29 | 2012-06-29 | A kind of method and apparatus of recording with playback that user in browser is operated |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102841789A true CN102841789A (en) | 2012-12-26 |
| CN102841789B CN102841789B (en) | 2016-05-25 |
Family
ID=47369193
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210227233.6A Expired - Fee Related CN102841789B (en) | 2012-06-29 | 2012-06-29 | A kind of method and apparatus of recording with playback that user in browser is operated |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102841789B (en) |
Cited By (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103327069A (en) * | 2013-05-16 | 2013-09-25 | 北京神鹰城讯科技有限公司 | WEB-based remote client service support method and system |
| WO2013189406A2 (en) * | 2013-06-19 | 2013-12-27 | 中兴通讯股份有限公司 | Method and system for demonstrating and generating demonstration script |
| CN103488507A (en) * | 2013-09-18 | 2014-01-01 | 北京思特奇信息技术股份有限公司 | User behavior trajectory playback method |
| CN103678506A (en) * | 2013-11-20 | 2014-03-26 | 北京奇虎科技有限公司 | Method and device for loading application program shortcuts in browser and browser |
| CN103713905A (en) * | 2013-12-29 | 2014-04-09 | 广州视源电子科技股份有限公司 | Method, device and system for customizing operation steps |
| CN103870272A (en) * | 2014-03-06 | 2014-06-18 | 联想(北京)有限公司 | Information processing method and device |
| CN103927182A (en) * | 2014-04-29 | 2014-07-16 | 朱林 | Picture recording method by utilization of screen capture combined with operation of mouse and keyboard |
| CN104572464A (en) * | 2014-12-31 | 2015-04-29 | 广东欧珀移动通信有限公司 | Automated test state saving method and device of Android platform |
| CN104714948A (en) * | 2013-12-11 | 2015-06-17 | 部落邦（北京）科技有限责任公司 | Method, system and thermodynamic diagram display device for replaying user web page operation behavior |
| CN104731687A (en) * | 2013-12-24 | 2015-06-24 | 镇江金钛软件有限公司 | Real-time computer activity monitoring method |
| WO2015107401A1 (en) * | 2013-12-05 | 2015-07-23 | Language Garden Ltd | Manipulating graphic representations of words |
| CN104915244A (en) * | 2015-06-30 | 2015-09-16 | 北京奇虎科技有限公司 | Method and device for keyboard-and-mouse script playback |
| CN104915243A (en) * | 2015-06-30 | 2015-09-16 | 北京奇虎科技有限公司 | Playback method and device of keyboard and mouse script |
| CN105159672A (en) * | 2015-08-28 | 2015-12-16 | 小米科技有限责任公司 | Remote assistance method and client |
| CN105824742A (en) * | 2015-01-08 | 2016-08-03 | 阿里巴巴集团控股有限公司 | Operation recording method and device of user interface |
| WO2016173223A1 (en) * | 2015-04-30 | 2016-11-03 | 百度在线网络技术（北京）有限公司 | Method and device for determining user experience and for assisting in determining user experience |
| CN106155886A (en) * | 2015-03-31 | 2016-11-23 | 北京奇虎科技有限公司 | The method and apparatus that a kind of key Mus script processes |
| CN106155760A (en) * | 2015-03-31 | 2016-11-23 | 北京奇虎科技有限公司 | The method and device of key Mus script playback |
| CN106155473A (en) * | 2015-04-28 | 2016-11-23 | 中兴通讯股份有限公司 | A kind of terminal applies processing method and device thereof |
| CN106155771A (en) * | 2015-03-31 | 2016-11-23 | 北京奇虎科技有限公司 | The method and device of key Mus script playback |
| CN106610825A (en) * | 2015-10-23 | 2017-05-03 | 中兴通讯股份有限公司 | Shortcut establishment method and apparatus for intelligent terminal |
| CN107133072A (en) * | 2017-04-27 | 2017-09-05 | 紫光华山信息技术有限公司 | One kind operation performs method and apparatus |
| CN107844331A (en) * | 2017-11-23 | 2018-03-27 | 腾讯科技(成都)有限公司 | Generate the method, apparatus and equipment of boot configuration file |
| CN108459848A (en) * | 2017-02-20 | 2018-08-28 | 深圳市北斗智研科技有限公司 | A kind of script acquisition methods and system applied to Excel softwares |
| CN108693976A (en) * | 2018-08-10 | 2018-10-23 | 唐山数通科技有限公司 | Transcripter |
| CN109446025A (en) * | 2018-10-17 | 2019-03-08 | 北京字节跳动网络技术有限公司 | A kind of back method of operation behavior, device, electronic equipment and readable medium |
| CN109656704A (en) * | 2018-12-21 | 2019-04-19 | 北京天融信网络安全技术有限公司 | A kind of information processing method and information processing unit |
| CN110046009A (en) * | 2019-02-19 | 2019-07-23 | 阿里巴巴集团控股有限公司 | Method for recording, device, server and readable storage medium storing program for executing |
| CN110209557A (en) * | 2019-03-16 | 2019-09-06 | 平安科技（深圳）有限公司 | User's operation records restoring method, device, equipment and readable storage medium storing program for executing |
| CN111522608A (en) * | 2019-02-03 | 2020-08-11 | 北京数聚鑫云信息技术有限公司 | Method and device for improving execution rate of simulation operation |
| CN111858364A (en) * | 2020-07-24 | 2020-10-30 | 中国建设银行股份有限公司 | Parameter configuration method, device and system of test terminal |
| CN112131085A (en) * | 2020-08-01 | 2020-12-25 | 青岛希望鸟科技有限公司 | Method, system and device for recording and playing back Internet business process |
| CN113326144A (en) * | 2020-02-29 | 2021-08-31 | 华为技术有限公司 | Method and equipment for generating task guide |
| CN113360824A (en) * | 2021-06-30 | 2021-09-07 | 四川效率源信息安全技术股份有限公司 | Webpage evidence obtaining and data extracting method based on Chrome browser debugging protocol |
| CN113590092A (en) * | 2021-07-15 | 2021-11-02 | 远光软件股份有限公司 | Script generation method and device and computer readable storage medium |
| CN117974331A (en) * | 2024-03-28 | 2024-05-03 | 探保网络科技(广州)有限公司 | Insurance recommendation method and system based on electronic commerce platform |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1313034A2 (en) * | 2001-11-14 | 2003-05-21 | Hitachi, Ltd. | Storage system having means for acquiring execution information of a database management system |
| CN101399821A (en) * | 2007-09-28 | 2009-04-01 | 国际商业机器公司 | Recording/reproducing system, recorder/player, and method |
| CN102142016A (en) * | 2010-01-29 | 2011-08-03 | 微软公司 | Cross-browser interactivity recording, playback and editing |
| CN102508773A (en) * | 2011-10-18 | 2012-06-20 | 深圳市易聆科信息技术有限公司 | Method and device for monitoring WEB service system simulation based on Internet explorer (IE) kernel |
-
2012
- 2012-06-29 CN CN201210227233.6A patent/CN102841789B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1313034A2 (en) * | 2001-11-14 | 2003-05-21 | Hitachi, Ltd. | Storage system having means for acquiring execution information of a database management system |
| CN101399821A (en) * | 2007-09-28 | 2009-04-01 | 国际商业机器公司 | Recording/reproducing system, recorder/player, and method |
| CN102142016A (en) * | 2010-01-29 | 2011-08-03 | 微软公司 | Cross-browser interactivity recording, playback and editing |
| CN102508773A (en) * | 2011-10-18 | 2012-06-20 | 深圳市易聆科信息技术有限公司 | Method and device for monitoring WEB service system simulation based on Internet explorer (IE) kernel |
Cited By (52)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103327069B (en) * | 2013-05-16 | 2016-09-21 | 北京神鹰城讯科技股份有限公司 | Remote client's service support method based on WEB and system |
| CN103327069A (en) * | 2013-05-16 | 2013-09-25 | 北京神鹰城讯科技有限公司 | WEB-based remote client service support method and system |
| WO2013189406A2 (en) * | 2013-06-19 | 2013-12-27 | 中兴通讯股份有限公司 | Method and system for demonstrating and generating demonstration script |
| WO2013189406A3 (en) * | 2013-06-19 | 2014-05-15 | 中兴通讯股份有限公司 | Method and system for demonstrating and generating demonstration script |
| CN104239018A (en) * | 2013-06-19 | 2014-12-24 | 中兴通讯股份有限公司 | Methods and systems for demonstrating and generating demonstration scripts |
| CN103488507A (en) * | 2013-09-18 | 2014-01-01 | 北京思特奇信息技术股份有限公司 | User behavior trajectory playback method |
| CN103678506A (en) * | 2013-11-20 | 2014-03-26 | 北京奇虎科技有限公司 | Method and device for loading application program shortcuts in browser and browser |
| CN103678506B (en) * | 2013-11-20 | 2018-10-12 | 北京奇虎科技有限公司 | The method, apparatus and browser of loading application programs shortcut in a browser |
| WO2015107401A1 (en) * | 2013-12-05 | 2015-07-23 | Language Garden Ltd | Manipulating graphic representations of words |
| CN104714948A (en) * | 2013-12-11 | 2015-06-17 | 部落邦（北京）科技有限责任公司 | Method, system and thermodynamic diagram display device for replaying user web page operation behavior |
| CN104731687A (en) * | 2013-12-24 | 2015-06-24 | 镇江金钛软件有限公司 | Real-time computer activity monitoring method |
| CN103713905A (en) * | 2013-12-29 | 2014-04-09 | 广州视源电子科技股份有限公司 | Method, device and system for customizing operation steps |
| CN103870272A (en) * | 2014-03-06 | 2014-06-18 | 联想(北京)有限公司 | Information processing method and device |
| CN103870272B (en) * | 2014-03-06 | 2017-09-22 | 联想(北京)有限公司 | A kind of information processing method and device |
| CN103927182A (en) * | 2014-04-29 | 2014-07-16 | 朱林 | Picture recording method by utilization of screen capture combined with operation of mouse and keyboard |
| CN104572464A (en) * | 2014-12-31 | 2015-04-29 | 广东欧珀移动通信有限公司 | Automated test state saving method and device of Android platform |
| CN104572464B (en) * | 2014-12-31 | 2018-01-19 | 广东欧珀移动通信有限公司 | The automatic test state saving approach and device of a kind of Android platform |
| CN105824742B (en) * | 2015-01-08 | 2018-10-02 | 阿里巴巴集团控股有限公司 | Operating user interface method for recording and device |
| CN105824742A (en) * | 2015-01-08 | 2016-08-03 | 阿里巴巴集团控股有限公司 | Operation recording method and device of user interface |
| CN106155886A (en) * | 2015-03-31 | 2016-11-23 | 北京奇虎科技有限公司 | The method and apparatus that a kind of key Mus script processes |
| CN106155760A (en) * | 2015-03-31 | 2016-11-23 | 北京奇虎科技有限公司 | The method and device of key Mus script playback |
| CN106155771A (en) * | 2015-03-31 | 2016-11-23 | 北京奇虎科技有限公司 | The method and device of key Mus script playback |
| CN106155886B (en) * | 2015-03-31 | 2019-05-14 | 北京奇虎科技有限公司 | A kind of method and apparatus of key mouse script processing |
| CN106155760B (en) * | 2015-03-31 | 2019-09-17 | 北京奇虎科技有限公司 | The method and device of key mouse script playback |
| CN106155473A (en) * | 2015-04-28 | 2016-11-23 | 中兴通讯股份有限公司 | A kind of terminal applies processing method and device thereof |
| WO2016173223A1 (en) * | 2015-04-30 | 2016-11-03 | 百度在线网络技术（北京）有限公司 | Method and device for determining user experience and for assisting in determining user experience |
| CN104915244A (en) * | 2015-06-30 | 2015-09-16 | 北京奇虎科技有限公司 | Method and device for keyboard-and-mouse script playback |
| CN104915243B (en) * | 2015-06-30 | 2018-08-10 | 北京奇虎科技有限公司 | The method and device of key mouse script playback |
| CN104915244B (en) * | 2015-06-30 | 2018-02-16 | 北京奇虎科技有限公司 | The method and device of key mouse script playback |
| CN104915243A (en) * | 2015-06-30 | 2015-09-16 | 北京奇虎科技有限公司 | Playback method and device of keyboard and mouse script |
| CN105159672A (en) * | 2015-08-28 | 2015-12-16 | 小米科技有限责任公司 | Remote assistance method and client |
| CN106610825A (en) * | 2015-10-23 | 2017-05-03 | 中兴通讯股份有限公司 | Shortcut establishment method and apparatus for intelligent terminal |
| CN108459848A (en) * | 2017-02-20 | 2018-08-28 | 深圳市北斗智研科技有限公司 | A kind of script acquisition methods and system applied to Excel softwares |
| CN108459848B (en) * | 2017-02-20 | 2021-12-14 | 深圳市北斗智研科技有限公司 | Script obtaining method and system applied to Excel software |
| CN107133072A (en) * | 2017-04-27 | 2017-09-05 | 紫光华山信息技术有限公司 | One kind operation performs method and apparatus |
| CN107844331A (en) * | 2017-11-23 | 2018-03-27 | 腾讯科技(成都)有限公司 | Generate the method, apparatus and equipment of boot configuration file |
| CN108693976A (en) * | 2018-08-10 | 2018-10-23 | 唐山数通科技有限公司 | Transcripter |
| CN109446025A (en) * | 2018-10-17 | 2019-03-08 | 北京字节跳动网络技术有限公司 | A kind of back method of operation behavior, device, electronic equipment and readable medium |
| CN109656704A (en) * | 2018-12-21 | 2019-04-19 | 北京天融信网络安全技术有限公司 | A kind of information processing method and information processing unit |
| CN111522608A (en) * | 2019-02-03 | 2020-08-11 | 北京数聚鑫云信息技术有限公司 | Method and device for improving execution rate of simulation operation |
| CN111522608B (en) * | 2019-02-03 | 2023-09-22 | 北京数聚鑫云信息技术有限公司 | Method and device for improving execution rate of analog operation |
| CN110046009A (en) * | 2019-02-19 | 2019-07-23 | 阿里巴巴集团控股有限公司 | Method for recording, device, server and readable storage medium storing program for executing |
| CN110209557A (en) * | 2019-03-16 | 2019-09-06 | 平安科技（深圳）有限公司 | User's operation records restoring method, device, equipment and readable storage medium storing program for executing |
| CN110209557B (en) * | 2019-03-16 | 2022-05-17 | 平安科技（深圳）有限公司 | User operation recording and restoring method, device and equipment and readable storage medium |
| CN113326144A (en) * | 2020-02-29 | 2021-08-31 | 华为技术有限公司 | Method and equipment for generating task guide |
| CN113326144B (en) * | 2020-02-29 | 2023-12-12 | 华为技术有限公司 | Method and device for generating task wizard |
| CN111858364A (en) * | 2020-07-24 | 2020-10-30 | 中国建设银行股份有限公司 | Parameter configuration method, device and system of test terminal |
| CN112131085A (en) * | 2020-08-01 | 2020-12-25 | 青岛希望鸟科技有限公司 | Method, system and device for recording and playing back Internet business process |
| CN113360824A (en) * | 2021-06-30 | 2021-09-07 | 四川效率源信息安全技术股份有限公司 | Webpage evidence obtaining and data extracting method based on Chrome browser debugging protocol |
| CN113590092A (en) * | 2021-07-15 | 2021-11-02 | 远光软件股份有限公司 | Script generation method and device and computer readable storage medium |
| CN117974331A (en) * | 2024-03-28 | 2024-05-03 | 探保网络科技(广州)有限公司 | Insurance recommendation method and system based on electronic commerce platform |
| CN117974331B (en) * | 2024-03-28 | 2024-06-11 | 探保网络科技(广州)有限公司 | Insurance recommendation method and system based on electronic commerce platform |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102841789B (en) | 2016-05-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102841789A (en) | Method and device for recording and playing back user operations in browser | |
| US9383903B2 (en) | Systems and methods for providing programmable macros | |
| WO2017172659A1 (en) | Enabling stateful dynamic links in mobile applications | |
| EP3436943B1 (en) | Validating stateful dynamic links in mobile applications | |
| US11755293B2 (en) | Code execution and data processing pipeline | |
| CN106126424B (en) | A kind of visual automated testing method of script, device and mobile terminal | |
| CN104866416B (en) | The method and apparatus for realizing application program capacity analysis | |
| CN111857681B (en) | Software-defined key function positioning and extracting method of C + + system | |
| CN110381026B (en) | Business service packaging and accessing system, method and device for rich client | |
| EP3195115A1 (en) | Code development tool with multi-context intelligent assistance | |
| CN106844181A (en) | Method, system and mobile terminal for recording user behavior | |
| CN114297700B (en) | Dynamic and static combined mobile application privacy protocol extraction method and related equipment | |
| CN109947624A (en) | Method for monitoring state and device | |
| CN104216646A (en) | Method and device for creating application program based on gesture | |
| CN114035829A (en) | Page component updating method and device, electronic equipment and storage medium | |
| CN112231197A (en) | Page testing method and device and storage medium | |
| CN113672826B (en) | Page jump method, device, computer equipment and storage medium | |
| CN106897387B (en) | Service detection method based on action simulation | |
| CN109408057A (en) | Method, apparatus, medium and the calculating equipment of automatic code generating | |
| CN105868092A (en) | Log file processing method and device | |
| US20240361993A1 (en) | Code execution and data processing pipeline | |
| CN116974653B (en) | Class loading method and system | |
| CN114385499A (en) | Test case generation method and device, computer equipment and storage medium | |
| CN118474169A (en) | Data acquisition method, system, device, storage medium, processor and program product | |
| Azim et al. | uLink: user-defined deep links in mobile apps |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20160518 Address after: 100015, room 5, room 501-506, building 2, building 6, Jiuxianqiao Road, Chaoyang District, Beijing, Patentee after: QIFEIXIANGYI (BEIJING) SOFTWARE CO.,LTD. Address before: 100088 Beijing city Xicheng District xinjiekouwai Street 28, block D room 112 (Desheng Park) Patentee before: BEIJING QIHOO TECHNOLOGY Co.,Ltd. Patentee before: Qizhi software (Beijing) Co.,Ltd. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160525 Termination date: 20190629 |
|
| RR01 | Reinstatement of patent right |
Former decision: termination of patent right due to unpaid annual fee Former decision publication date: 20200623 |
|
| RR01 | Reinstatement of patent right | ||
| CP01 | Change in the name or title of a patent holder |
Address after: Room 501-506, floor 5, building a, building 2, yard 6, Jiuxianqiao Road, Chaoyang District, Beijing 100015 Patentee after: Beijing Qi flying Business Consulting Co.,Ltd. Address before: Room 501-506, floor 5, building a, building 2, yard 6, Jiuxianqiao Road, Chaoyang District, Beijing 100015 Patentee before: QIFEIXIANGYI (BEIJING) SOFTWARE CO.,LTD. |
|
| CP01 | Change in the name or title of a patent holder | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220129 Address after: Room 801, 8th floor, No. 104, 1st to 19th floors, building 2, yard 6, Jiuxianqiao Road, Chaoyang District, Beijing 100020 Patentee after: BEIJING QIHOO TECHNOLOGY Co.,Ltd. Address before: Room 501-506, floor 5, building a, building 2, yard 6, Jiuxianqiao Road, Chaoyang District, Beijing 100015 Patentee before: Beijing Qi flying Business Consulting Co.,Ltd. |
|
| TR01 | Transfer of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160525 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |