CN102568529A - Recording and playing back method, device and system of operation process - Google Patents
Recording and playing back method, device and system of operation process Download PDFInfo
- Publication number
- CN102568529A CN102568529A CN2010105826965A CN201010582696A CN102568529A CN 102568529 A CN102568529 A CN 102568529A CN 2010105826965 A CN2010105826965 A CN 2010105826965A CN 201010582696 A CN201010582696 A CN 201010582696A CN 102568529 A CN102568529 A CN 102568529A
- Authority
- CN
- China
- Prior art keywords
- video record
- video
- action events
- record
- video file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention belongs to the technical field of computers and provides a recording and playing back method, a device and a system of an operation process. The method comprises the following steps: receiving a triggering notification of an operation event, recording a system interface and generating a video record; correlating the operation event with the video record; generating a video file according to a video record set corresponding to an operation event set; and synchronously playing back the operation event and the video record by operating the video file. According to the invention, the operation event and the corresponding operation video are automatically correlated while recording the operation process to synchronously display the current operation video and the corresponding operation event while playing back the operation process so as to clearly and visually play back the operation process.
Description
Technical field
The invention belongs to field of computer technology, relate in particular to a kind of operating process recording/playback method, Apparatus and system.
Background technology
Operating process is made up of some use-cases; And each use-case is formed by some Action Events; Wherein, Action Events is an operational motion on operating system, carrying out, but for example click, in input area, carries out literal input etc.; Use-case then is the set of one group of Action Events, normally in order to realize certain function or to reach the orderly Action Events set of a group of certain purpose.
In application scenarios such as automatic test; Operating process is normally unattended, and each the execution use-case in its operating process, and each carries out each operation steps in use-case; All need carry out record through certain mode; As a result the time, come clearly to show the whole operation process at analytical test with convenient, do not omit any details through playback.
The existing mode that operating process is write down has two kinds, and the one, through the film recording instrument, merely record is carried out in the variation of screen in the operating process; In real time operation steps is not carried out association; Simultaneously, when playback is carried out in operating process, must strictly follow time shaft; If operation interface also must be waited for identical computing time because the backstage is calculated and do not changed for a long time when playback.The another kind of mode that operating process is write down is a single step free hand drawing sheet mode; I.e. screen-picture of intercepting when whenever carrying out an operation steps; Mode through the related operation steps of a picture is carried out playback; This mode is because the noncontinuity of picture is lost the details in a lot of operating process easily.
Summary of the invention
The purpose of the embodiment of the invention is to provide a kind of operating process recording/playback method, is intended to solve in the prior art and can't operation steps be carried out related problem in real time with the operation video when recording.
The embodiment of the invention is achieved in that a kind of operating process recording/playback method, and said method comprises the steps:
Receive the trigger notice of Action Events, the register system interface generates video record;
Carry out related with said video record said Action Events;
According to the set of the pairing said video record of set of said Action Events, generate video file;
Through moving said video file said Action Events and said video record are carried out synchronized playback.
Another purpose of the embodiment of the invention is to provide a kind of operating process recording/displaying device, and said device comprises:
The video record generation unit is used for the register system interface, generates video record;
Associative cell is used for carrying out related with said video record said Action Events;
The video file generation unit is used for the set according to the pairing said video record of set of said Action Events, generates video file;
The synchronized playback unit is used for through moving said video file said Action Events and said video record being carried out synchronized playback.
Another purpose of the embodiment of the invention is to provide a kind of system that comprises aforesaid operations process recording/displaying device.
In embodiments of the present invention; Through in the process that operating process is recorded; Its corresponding operation video of current Action Events is carried out real-time auto-associating; Make when playback is carried out in the operating process of recording, can be clear that getting in touch between each concrete Action Events and its operation video, realize reproduction directly perceived operating process.
Description of drawings
Fig. 1 is the realization flow figure of the operating process recording/playback method that provides of first embodiment of the invention;
Fig. 2 is the realization flow figure of the operating process recording/playback method that provides of second embodiment of the invention;
Fig. 3 is the structural drawing of the operating process recording/displaying device that provides of third embodiment of the invention.
Embodiment
In order to make the object of the invention, technical scheme and advantage clearer,, the present invention is further elaborated below in conjunction with accompanying drawing and embodiment.Should be appreciated that specific embodiment described herein only in order to explanation the present invention, and be not used in qualification the present invention.
In embodiments of the present invention; Through in the process that operating process is recorded; Its corresponding operation video of current Action Events is carried out real-time auto-associating; Make when playback is carried out in the operating process of recording, can be clear that getting in touch between each concrete Action Events and its operation video, realize reproduction directly perceived operating process.
Fig. 1 shows the operating process recording/playback method realization flow that first embodiment of the invention provides, and details are as follows:
In step S101, receive the trigger notice of Action Events, the register system interface generates video record.
In the present embodiment, before execution in step S101, can monitor,, then produce the trigger notice of this Action Events, begin the variation of system interface is recorded with apprizing system in case there is Action Events to take place through the Action Events of setting up operating system.
When aforesaid operations action listener process takes place at no Action Events; Can not produce any output data; In case and it is when sending the trigger notice of Action Events, the Action Events that then shown system triggers, the system interface that need begin that this Action Events is caused changes and carries out record.
In the present embodiment, can the video record that generate all be kept in the temporary file, with convenient follow-up processing.
In the present embodiment, the operational motion of Action Events on operating system, carrying out comprise mouse, keyboard and forms operational motion, and system interface comprises whole on-screen display (osd) area, the window area that changes, and do not limit at this.
In step S102, the video record that Action Events and its is corresponding carries out related.
In the present embodiment, the corresponding Action Events sign of each Action Events likewise, when each video record generates, produces unique video record sign, is used to distinguish this video record and other video records.Carry out relatedly through this Action Events sign and video record are identified, set up the incidence relation of this Action Events video record corresponding with this Action Events.In the present embodiment, can be recorded in the system database as one group of data through related Action Events sign and video record sign above-mentioned.
In step S103,, generate video file according to the set of the pairing video record of set of Action Events.
In the present embodiment, video file is the set of one group of video record, is used to be recorded as the Action Events that reaches the required execution of a certain purpose, and the variation of system interface in the implementation.Before execution in step S103, to the set of each Action Events, can generate the video record index according to the sequencing that its video record generates, conveniently in replayed section, carry out playback in order.
Simultaneously; In the present embodiment, the set of each Action Events, i.e. use-case; Corresponding unique use-case sign; Can be related through in database, this use-case sign and the filename of video file being carried out, set up the incidence relation of this use-case and this video file, make things convenient for and in replayed section, as required different video files is called playback.
In the present embodiment; Can adopt the mode of compressed file; Video file together with its relevant information, is comprised that information such as video record index, video file size together compress, when needs are play this video file, carry out decompress(ion) again; Reduce the size of video file thus, saved system resource.
In step S104, Action Events and its corresponding video record are carried out synchronized playback through the operation video file.
In the present embodiment; According to the incidence relation of use-case sign with the filename of video file, operation realizes the video file of the operating process of this use-case, because when this operating process is recorded; Carried out related with its corresponding video record Action Events wherein in real time; Therefore can realize the synchronized playback of Action Events and its corresponding video record, concrete operating process replay procedure is as shown in Figure 2, repeats no more at this.
Fig. 2 shows the realization flow of the operating process recording/playback method that second embodiment of the invention provides, and present embodiment is the refinement to step S104 among first embodiment, and its concrete realization flow is following:
In step S201, extract the index of video record in the video file.
In embodiments of the present invention, according to the incidence relation of use-case sign with the filename of video file, the pairing video file of operation use-case extracts the video record index in the video file, and the sequencing of video record in the video file indicated in this index.If this video file has passed through compression, then need pass through decompress(ion), again the video record index is extracted.
In step S202, play the video record in the video file according to index.
In step S203, the Action Events that this video record is related is showed synchronously.
In the present embodiment; Through the incidence relation of video record and Action Events, when playing video record, the Action Events that the location is associated with this video record; And this Action Events carried out the synchronous displaying with video record, realized the synchronized playback of video record and Action Events.
In the process that the video record of present embodiment is play; Can shorten the stand-by period in the operating process through setting a time threshold; Between two video records interval greater than this time threshold, when promptly after finishing an Action Events, wait for surpassing certain hour and just carrying out next Action Events, because system interface is unconverted during this period; Therefore this moment this time interval is shortened to this time threshold and play, with the speed of the process playback that speeds operations.
As a realization example of the present invention, can this time threshold be set at 1 second.
In the present embodiment, in the process of carrying out the operating process synchronized playback, can the playback progress be located fast through specifying concrete Action Events.In case specified concrete Action Events, according to the incidence relation of this Action Events video record corresponding, select this video record to play with it, promptly realized quick location to the playback progress, promoted the effect experience that playback is watched.In the present embodiment; Quick location to the playback progress can also be realized through the progress bar that directly drags video file; Use the assigned operation incident to position and accurately to navigate to the video location at this Action Events place, drag the video file progress bar and position and to locate the video location that to watch faintly and use.
Fig. 3 shows the structure of the operating process recording/displaying device that third embodiment of the invention provides, and for the ease of explanation, only shows the part relevant with present embodiment.
With reference to Fig. 3, this operating process recording/displaying device can be used for comprising in the system of windows operating system, linux operating system, handheld device operating system etc., is software unit, hardware cell or the soft or hard combining unit that runs on said system, comprising:
Video record generation unit 31, the system interface after the recording operation Event triggered changes, and generates video record.
Video file generation unit 33 according to the set of the pairing video record of set of Action Events, generates video file.In the present embodiment, the set of Action Events, i.e. use-case, pairing unique use-case sign can be carried out relatedly with the filename of the video file that generates, and also is recorded in the system database as one group of data, conveniently calls.
Synchronized playback unit 34 through the operation video file, carries out synchronized playback to Action Events and its corresponding video record.
In the present embodiment; When 31 pairs of operating process of video record generation unit are recorded; Carried out related through associative cell 32 video record that Action Events and its is corresponding in real time; Make when carrying out playback, can realize the synchronized playback of Action Events and its corresponding video record, promoted viewing experience through the 34 pairs of operating process in synchronized playback unit.
This operating process recording/displaying device also comprises:
Time threshold setup unit 38; Through setting a time threshold, when between two video records interval greater than this time threshold the time, then this time interval is shortened to this time threshold and plays; To shorten the stand-by period, the speed of the process that speeds operations playback.
In the unit of above-mentioned composition operating process recording/displaying device, synchronized playback unit 34 comprises:
Action Events display unit 343, the incidence relation of setting up according to 32 pairs of video records of associative cell and Action Events, when playing video record, the Action Events that the location is associated with this video record, and show synchronously with video record.
In embodiments of the present invention; Through when operating process is recorded to Action Events and operate video accordingly and carry out auto-associating; Make when playback is carried out in operating process; Can show synchronously current operation video and corresponding Action Events thereof, know and intuitively playback is carried out in operating process.Simultaneously, apace the operation video is positioned, under the prerequisite of not losing any details, accelerate the playback process, promote viewing experience through the stand-by period in the shortening operating process and through incidence relation.
The above is merely preferred embodiment of the present invention, not in order to restriction the present invention, all any modifications of within spirit of the present invention and principle, being done, is equal to and replaces and improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. an operating process recording/playback method is characterized in that, said method comprises the steps:
Receive the trigger notice of Action Events, the register system interface generates video record;
Carry out related with said video record said Action Events;
According to the set of the pairing said video record of set of said Action Events, generate video file;
Through moving said video file said Action Events and said video record are carried out synchronized playback.
2. the method for claim 1 is characterized in that, in the trigger notice that receives Action Events, the register system interface generates before the step of video record, and said method also comprises the steps:
When said Action Events takes place, produce the trigger notice of said Action Events.
3. the method for claim 1 is characterized in that, the set of the said pairing said video record of set according to said Action Events generates before the step of video file, and said method also comprises the steps:
Sequencing according to said video record generates generates the video record index.
4. method as claimed in claim 3 is characterized in that, saidly through the operation video file step that said Action Events and said video record carry out synchronized playback is specially:
Extract the said video record index in the said video file;
Play the said video record in the said video file according to said video record index;
Show synchronously carrying out related said Action Events with said video record.
5. the method for claim 1 is characterized in that, said method also comprises the steps:
Through setting a time threshold, when between two said video records interval greater than said time threshold the time, the said time interval is shortened to said time threshold plays.
6. an operating process recording/displaying device is characterized in that, said device comprises:
The video record generation unit is used for the register system interface, generates video record;
Associative cell is used for carrying out related with said video record said Action Events;
The video file generation unit is used for the set according to the pairing said video record of set of said Action Events, generates video file;
The synchronized playback unit is used for through moving said video file said Action Events and said video record being carried out synchronized playback.
7. device as claimed in claim 6 is characterized in that, said device also comprises:
The index generation unit is used for the sequencing according to said video record generation, generates the video record index.
8. device as claimed in claim 7 is characterized in that, said synchronized playback unit comprises:
The index extraction unit is used for extracting the said video record index of said video file;
The video record broadcast unit is used for playing according to said video record index the said video record of said video file;
The Action Events display unit is used for showing synchronously the said Action Events related with said video record.
9. device as claimed in claim 6 is characterized in that, said device also comprises:
The notice generation unit is used for when said Action Events takes place, producing the trigger notice of said Action Events;
Notify receiving element, be used to receive the trigger notice of Action Events;
The time threshold setup unit is used to set two shortest times between the said video record at interval.
10. one kind comprises each the system of operating process recording/displaying device of claim 6 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010582696.5A CN102568529B (en) | 2010-12-10 | 2010-12-10 | Recording and playing back method, device and system of operation process |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010582696.5A CN102568529B (en) | 2010-12-10 | 2010-12-10 | Recording and playing back method, device and system of operation process |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102568529A true CN102568529A (en) | 2012-07-11 |
| CN102568529B CN102568529B (en) | 2015-06-03 |
Family
ID=46413761
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010582696.5A Active CN102568529B (en) | 2010-12-10 | 2010-12-10 | Recording and playing back method, device and system of operation process |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102568529B (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103019899A (en) * | 2012-11-28 | 2013-04-03 | 广东欧珀移动通信有限公司 | Method and system for replaying intelligent terminal event as well as intelligent terminal |
| CN103778048A (en) * | 2012-10-18 | 2014-05-07 | 腾讯科技（深圳）有限公司 | Mobile terminal test method and system |
| CN103929607A (en) * | 2014-03-27 | 2014-07-16 | 山西协康云享科技有限公司 | Communication method based on screen recording, and application client-side |
| CN103927182A (en) * | 2014-04-29 | 2014-07-16 | 朱林 | Picture recording method by utilization of screen capture combined with operation of mouse and keyboard |
| CN104486517A (en) * | 2014-11-28 | 2015-04-01 | 北京佳讯飞鸿电气股份有限公司 | Method for intelligently restoring operation of telephone operator |
| CN105159672A (en) * | 2015-08-28 | 2015-12-16 | 小米科技有限责任公司 | Remote assistance method and client |
| CN105426295A (en) * | 2015-11-18 | 2016-03-23 | 广东欧珀移动通信有限公司 | Video production method and device |
| CN106034174A (en) * | 2015-03-13 | 2016-10-19 | 展讯通信（上海）有限公司 | Operation playback system, operation playback method and mobile terminal |
| CN106875968A (en) * | 2017-01-21 | 2017-06-20 | 上海量明科技发展有限公司 | The method of information gathering, client and system |
| CN107577489A (en) * | 2017-08-03 | 2018-01-12 | 捷开通讯(深圳)有限公司 | Method, mobile terminal and the storage device of remote assistance |
| CN108109088A (en) * | 2016-11-25 | 2018-06-01 | 网易（杭州）网络有限公司 | The processing method and equipment of a kind of stalling event |
| WO2019056333A1 (en) * | 2017-09-25 | 2019-03-28 | 深圳传音制造有限公司 | Screen recording method for mobile terminal testing and mobile terminal |
| WO2021142607A1 (en) * | 2020-01-14 | 2021-07-22 | 深圳市元征科技股份有限公司 | Vehicle diagnosis process playback method, apparatus, and readable storage medium |
| CN113784205A (en) * | 2020-06-10 | 2021-12-10 | 腾讯科技（上海）有限公司 | Audit file generation method and device and computer storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101242621A (en) * | 2008-01-21 | 2008-08-13 | 中兴通讯股份有限公司 | An automatic testing method and system based on interface |
| CN101620564A (en) * | 2008-06-30 | 2010-01-06 | 福建升腾资讯有限公司 | Method for automatically testing recording playback mode of terminal system |
-
2010
- 2010-12-10 CN CN201010582696.5A patent/CN102568529B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101242621A (en) * | 2008-01-21 | 2008-08-13 | 中兴通讯股份有限公司 | An automatic testing method and system based on interface |
| CN101620564A (en) * | 2008-06-30 | 2010-01-06 | 福建升腾资讯有限公司 | Method for automatically testing recording playback mode of terminal system |
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103778048A (en) * | 2012-10-18 | 2014-05-07 | 腾讯科技（深圳）有限公司 | Mobile terminal test method and system |
| CN103778048B (en) * | 2012-10-18 | 2017-12-26 | 腾讯科技（深圳）有限公司 | Mobile terminal test method and system |
| CN103019899A (en) * | 2012-11-28 | 2013-04-03 | 广东欧珀移动通信有限公司 | Method and system for replaying intelligent terminal event as well as intelligent terminal |
| CN103929607A (en) * | 2014-03-27 | 2014-07-16 | 山西协康云享科技有限公司 | Communication method based on screen recording, and application client-side |
| CN103927182A (en) * | 2014-04-29 | 2014-07-16 | 朱林 | Picture recording method by utilization of screen capture combined with operation of mouse and keyboard |
| CN104486517A (en) * | 2014-11-28 | 2015-04-01 | 北京佳讯飞鸿电气股份有限公司 | Method for intelligently restoring operation of telephone operator |
| CN106034174B (en) * | 2015-03-13 | 2019-09-24 | 展讯通信（上海）有限公司 | A kind of operation playback system and method and mobile terminal |
| CN106034174A (en) * | 2015-03-13 | 2016-10-19 | 展讯通信（上海）有限公司 | Operation playback system, operation playback method and mobile terminal |
| US9800666B2 (en) | 2015-08-28 | 2017-10-24 | Xiaomi Inc. | Method and client terminal for remote assistance |
| CN105159672B (en) * | 2015-08-28 | 2019-08-30 | 小米科技有限责任公司 | Remote assistance method and client |
| WO2017036039A1 (en) * | 2015-08-28 | 2017-03-09 | 小米科技有限责任公司 | Method for remote assistance and client |
| CN105159672A (en) * | 2015-08-28 | 2015-12-16 | 小米科技有限责任公司 | Remote assistance method and client |
| CN105426295A (en) * | 2015-11-18 | 2016-03-23 | 广东欧珀移动通信有限公司 | Video production method and device |
| CN108109088B (en) * | 2016-11-25 | 2021-08-20 | 网易（杭州）网络有限公司 | Method and equipment for processing stalling event |
| CN108109088A (en) * | 2016-11-25 | 2018-06-01 | 网易（杭州）网络有限公司 | The processing method and equipment of a kind of stalling event |
| CN106875968A (en) * | 2017-01-21 | 2017-06-20 | 上海量明科技发展有限公司 | The method of information gathering, client and system |
| CN106875968B (en) * | 2017-01-21 | 2024-03-22 | 上海量明科技发展有限公司 | Information acquisition method, client and system |
| CN107577489A (en) * | 2017-08-03 | 2018-01-12 | 捷开通讯(深圳)有限公司 | Method, mobile terminal and the storage device of remote assistance |
| WO2019056333A1 (en) * | 2017-09-25 | 2019-03-28 | 深圳传音制造有限公司 | Screen recording method for mobile terminal testing and mobile terminal |
| WO2021142607A1 (en) * | 2020-01-14 | 2021-07-22 | 深圳市元征科技股份有限公司 | Vehicle diagnosis process playback method, apparatus, and readable storage medium |
| CN113784205A (en) * | 2020-06-10 | 2021-12-10 | 腾讯科技（上海）有限公司 | Audit file generation method and device and computer storage medium |
| CN113784205B (en) * | 2020-06-10 | 2023-07-18 | 腾讯科技（上海）有限公司 | Method and device for generating audit file and computer storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102568529B (en) | 2015-06-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102568529A (en) | Recording and playing back method, device and system of operation process | |
| TWI509409B (en) | Methods and systems for viewing log data recorded during execution of a program | |
| US9794605B2 (en) | Using time-stamped event entries to facilitate synchronizing data streams | |
| EP3537278A1 (en) | Recording and playing method for screen video, and screen recording terminal and playing terminal | |
| CN105592331A (en) | Method for processing barrage messages, related equipment, and system | |
| WO2019051938A1 (en) | Live video preservation method and device, and server, anchor terminal and medium | |
| CN103544021A (en) | Screen capturing method and device for screen content of mobile terminal | |
| CN103702214A (en) | Video playing method and electronic equipment | |
| CN103019899A (en) | Method and system for replaying intelligent terminal event as well as intelligent terminal | |
| CN109446025B (en) | Operation behavior playback method and device, electronic equipment and readable medium | |
| CN108111903A (en) | Record screen document play-back method, device and terminal | |
| US20140193140A1 (en) | System and method for slow motion display, analysis and/or editing of audiovisual content on a mobile device | |
| CN112218115B (en) | Control method and device for streaming media audio and video synchronization and computer equipment | |
| CN105045823A (en) | Method and device for generating demo file of mobile terminal based on screen capture | |
| US10261966B2 (en) | Video searching method and video searching system | |
| EP4171006A1 (en) | Previewing method and apparatus for effect application, and device and storage medium | |
| JP2017538328A (en) | Promotion information processing method, apparatus, device, and computer storage medium | |
| CN102141957B (en) | Auxiliary test method, device and system for remote real machine | |
| CN103605456A (en) | Method for hiding and displaying system bars and intelligent terminal | |
| CN110618904A (en) | Stuck detection method and device | |
| CN101931827A (en) | Set-top box test method for event replay | |
| CN112887794B (en) | Video editing method and device | |
| CN112711368B (en) | Operation guidance method and device and electronic equipment | |
| CN103500122A (en) | Multimedia file playing method and electronic equipment | |
| CN104967911A (en) | Multimedia file insertion position determining method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |