CN109783328A - A method of user's operation screen is recorded and played based on application filtering piecemeal - Google Patents
A method of user's operation screen is recorded and played based on application filtering piecemeal Download PDFInfo
- Publication number
- CN109783328A CN109783328A CN201711113291.5A CN201711113291A CN109783328A CN 109783328 A CN109783328 A CN 109783328A CN 201711113291 A CN201711113291 A CN 201711113291A CN 109783328 A CN109783328 A CN 109783328A
- Authority
- CN
- China
- Prior art keywords
- record
- user
- screen
- recording
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 72
- 238000001914 filtration Methods 0.000 title claims abstract description 30
- 239000003086 colorant Substances 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 238000004321 preservation Methods 0.000 description 3
- 241001269238 Data Species 0.000 description 2
- 238000012550 audit Methods 0.000 description 2
- 230000033001 locomotion Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002045 lasting effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Landscapes
- Television Signal Processing For Recording (AREA)
Abstract
The invention proposes one kind to be applied under Windows/Linux operating system, real-time judge user is operating the process title of application program, the method that the range shown on the screen for it compares the image difference before and after user's operation, discontinuous feature is acted when according to user's operation mouse and keyboard, record screen deblocking is saved, user's operation screen recording file size is reduced to realize, the video playback capability that can be arbitrarily switched play position and improve video playing fluency is provided.The present invention proposes, administrator can understand user's program process title currently in use in real time, strategy is recorded in the program process title etc. of server setting filtering, client is tactful according to recording, window ranges when operating certain application programs only for user are recorded, the file size recorded and generated when screen record can be effectively reduced, reduce transmitted data on network amount, reduce the not smooth degree of operation that user experiences in operating system.
Description
Technical field
The present invention relates to computer management of process, network communication and computerized image fields, especially a kind of to be based on filtration application
The method that deblocking is recorded and plays user's operation screen.
Background technique
Currently, in the typical case of host monitor (how to use user system to carry out behavior auditing in the future),
Keyboard input record and screen recording are carried out to the movement of user's operation host, and record screen data are centrally stored, so as to behavior
Playing out when audit is typical monitor mode.Generally when playing video, user requires that play time can be arbitrarily switched
Point, convenient for quickly checking record screen content.
In above-mentioned application, since the recording of current user's operation screen is generally directed to whole operation screen content, compares and use
Family operation front and back screen picture difference it is computationally intensive, may cause user experienced in operating system operation it is not smooth, simultaneously
Very big data volume can be generated, it is larger not to only result in consumption network flow, and occupancy server hard disc space is larger, can not save
Too many record screen file.If all screen data of played in order when screen plays simultaneously, there are clients, and time-consuming to be needed to take
Play time can be just switched fast by obtaining all screen data, and there are some problems in terms of realizing and being applied.
Summary of the invention
In order to overcome the above-mentioned deficiencies of the prior art, the present invention provides one kind based on application filtering piecemeal record and
The method for playing user's operation screen.This method enable system manager understand in real time user's application program currently in use into
Journey title is arranged program process title of filtering etc. in server and records strategy, and client is tactful according to recording, only for
Window ranges when user is operating certain application programs are recorded, and the file recorded and generated when screen record can be effectively reduced
Size reduces transmitted data on network amount, reduces the not smooth degree of operation that user experiences in operating system.This method is for use
Family operates discontinuous feature and records record screen deblocking so that user can arbitrarily switch play position and phase when playing video
To smooth result of broadcast.
The technical scheme adopted by the invention is that: record screen when not to entire screen picture content carry out user's operation before and after
It compares, but is compared for interested process context shown on user's screen；Meanwhile it being grasped according to user
Make discontinuous feature, by record screen deblocking record；Client end of playing back can received using full duplex mode by recording ping server
Transmission demand block number while asynchronous offer block video data.Client end of playing back improves video in client-cache video data
Play smooth degree.
The present invention provides a kind of methods for recording user's operation screen based on application filtering piecemeal, are applied to record screen
Client, which is characterized in that the described method includes:
It monitoring whether that the user's operation that triggering is recorded a video occurs, the user's operation includes the operation that user executes mouse, or
The operation of person user's execution keyboard；
If monitoring user's operation, the process title of the application program of screen the top is obtained with from record ping server
Known process List Names in process title matched；
If successful match, screen record is carried out according to the corresponding recording strategy of the process title obtained from record ping server
System；The recording strategy includes recording screen number corresponding with process title, record screen color, record screen range；
Record ping server is sent by the video data of recording.
Further, by the process title of the application program of screen the top and the known process from record ping server acquisition
When process title in List Names is matched, the method also includes:
If it fails to match, the process of the application program is nominally passed into the record ping server, so that the record is shielded
Server is updated to by the process title of the application program into the known process List Names.
Further, the method also includes:
Screen strategy is recorded from the service acquisition according to certain time interval；
After obtaining record screen strategy, screen recording is carried out according to the record screen strategy of acquisition.
Further, the method also includes:
Send IP information to record ping server, receive this IP corresponding record screen strategy that record ping server returns with it is known into
Journey List Names.
Further, carrying out screen recording method includes:
It is whether continuous according to the user's operation, piecemeal, and correspondence markings block number are carried out to the video data data of recording；
Present frame picture and frame number are obtained according to the window ranges of the application program of recording on the screen, is shielded according to the record
It is compared with former frame picture, obtains the variance data of each frame number, recorded by the variance data of all frames by strategy
Video data.
Further, sending the step of recording ping server for the video data data of recording includes:
Record ping server is sent to the block number of corresponding blocks after variance data is compressed；
Record ping server is sent by the corresponding label data of each block number；
The label data includes size, number of colors, image lattice size, block count and the frame per second of video data.
The present invention also provides a kind of methods for playing user's operation screen based on application filtering, are applied to record screen visitor
Family end, the record screen client are connect with record ping server, and the record ping server preserves the view that the method is recorded
Frequency evidence, which is characterized in that the described method includes:
Video tab data are obtained from the record ping server, the video tab data include, the size of video data,
Number of colors, image lattice size, total block count；
The block number for wanting to play is sent to the record ping server；
Receive the video data for the block number that record ping server is returned according to block number；
The video data received is stored in spatial cache.
Further, which comprises
After detecting user's operation playing controller, the block number to be played after changing and frame number are obtained；
Judge whether the corresponding data of frame number have been saved in the spatial cache, if so, directly from described from caching
Space obtains this auspicious data and plays out, if whether, it sends the block number where the frame number and corresponding frame to described
Ping server is recorded, obtains corresponding video data from the record ping server.
Further, which comprises
After the data for having obtained a frame, judge whether to get the last one frame of the block,
If so, judge whether the video data of block number where the frame has obtained,
If so, being obtained since the first frame of the video data of the block.
Further, if all frames of the corresponding video data of a block number have all obtained, start from record screen clothes
Business device obtains next block number and corresponds to video data；
If next block number corresponds to video data and has obtained, or when being the last one block number, other is selected not have
There is the video of the block number of acquisition to continue to obtain, until obtaining all videos data.
The present invention has following advantageous effects:
Image contrast conting amount and network traffic data are smaller, occupy less server hard disc space, intelligence, which obtains, to be needed
It seeks data block data and being cached in client makes user that can arbitrarily switch play position, be obviously improved the user's body of video playing
It tests.
Detailed description of the invention
Fig. 1 is that the application is based on the recording of application filtering piecemeal and plays user's operation screen system the general frame；
Fig. 2 is the record screen client and clothes that the application was recorded and played user's operation screen based on application filtering piecemeal
Data exchange schematic diagram when business device line；
Fig. 3 is that the application is recorded and played the picture diversity ratio of user's operation screen based on application filtering piecemeal to simultaneously
It is sent to the schematic illustration of server preservation；
Fig. 4 is the client end of playing back video that the application was recorded and played user's operation screen based on application filtering piecemeal
Playing principles schematic diagram；
Fig. 5 is that the application is recorded and played the on-demand from record screen service of user's operation screen based on application filtering piecemeal
Device fetches video data to the schematic illustration of client end of playing back.
Specific embodiment
The following further describes the present invention with reference to the drawings.
As shown in Figure 1, the application, which is based on application filtering piecemeal, records and plays user's operation screen system.Entire base
In application filtering piecemeal user's operation screen system is recorded and played by record screen client, record ping server, record screen management
Four parts of system and record screen client end of playing back form, and record screen client, which is used to carry out recording to its screen, generates corresponding view
Frequency evidence, and it is uploaded to record ping server.The record screen strategy and application process title that record screen client recording video is relied on are clear
It is single, it is issued by the record screen service module of record ping server from the database of record ping server.Record shields management system by backstage
System administrator controls, and for managing application process List Names and record screen strategy, system manager can pass through record screen pipe
It manages system login to be adjusted to record ping server, application processes List Names and the content for recording screen strategy, and is shielded again by record
Service module feeds back to record screen client.The video data that record screen client recording obtains carries out after being uploaded to record ping server
It saves.Audit administrator logs on to record ping server by record screen client end of playing back, initiates video by record screen client end of playing back
Corresponding video data is issued to record screen by record screen broadcasting service module and plays client by the request of broadcasting, record ping server
End.
As shown in Fig. 2, the application is recorded and is played the record screen client of user's operation screen based on application filtering piecemeal
End and data exchange schematic diagram when server line.
Record screen client establishes connection with record ping server first.Then receive the record screen plan sent by record ping server
Slightly.During record screen client is connect with record ping server, record ping server can refer to the record screen strategy of update and control
Order is sent to record screen client.Record screen client is linked up in a manner of sending heartbeat packet with record ping server, while will test
The process title of application program be sent to record ping server.
Specifically, when record screen client and server line, the information such as the IP of oneself are sent to server first, simultaneously
Obtain the current record screen strategy of this IP and all known process titles of current server；When user's triggering mouse-keyboard event, sentence
The process title of disconnected catalog screen the top application, is judged with process title known per se, if the process title that discovery is new
Server is sent by this process title immediately.Heartbeat packet is sent to server with the timing of client at this time, and can receive at any time
All record screen strategies, control command after server setting etc.；
As shown in figure 3, the application is recorded and is played the picture difference of user's operation screen based on application filtering piecemeal
Compare and be sent to the schematic illustration of server preservation.
Record screen client triggers the recording of video by detection user's operation.Wherein user's operation includes that user executes mouse
Target operation or user execute the operation of keyboard.When user triggers mouse-keyboard event, client first determines whether to exist at present
The process title of the most preceding application of screen whether there is in from the known process List Names that server obtains.If it is present
It is recorded according to the record screen strategy of the application program obtained from record ping server.The content for recording strategy includes answering for this
With relevant parameters such as the recording screen number of program, record screen color, record screen ranges.If it does not, just needing the application program
Process nominally reaches record ping server, and waiting system administrator judges, if needs to formulate new record screen strategy.
During recorded video, record screen client by user's operation whether continuously come the video data to recording
Piecemeal (block), and the video data of recording is successively marked into block number (blockid), by one lasting operational motion of user
The video data of recording is denoted as one piece.The mode of recorded video data is the picture for obtaining present frame, by the picture of itself and former frame
Face is handled in such a way that picture compares, and the variance data of present frame and former frame is obtained, by recording each frame data
Variance data obtain entire video data.Record screen is sent to after finally being compressed all variance datas and corresponding frame number
Server.
Specific address, when detecting user's operation, triggering Timer (Timer time value determines recording and broadcasting speed,
For example 500 expression records, plays 2 frames for 1 second).Timer, which is triggered, takes out this frame picture, root according to the range of process on the screen
According to record screen strategy, color range is reduced, " picture comparison class " is given and carries out diversity ratio to (difference for comparing this 1 frame Yu preceding 1 frame), by this
It detects after variance data is compressed and re-sends to server, server based on data block number saves video file.
As shown in figure 4, the application is recorded and is played the broadcasting client of user's operation screen based on application filtering piecemeal
Hold video playing schematic illustration.
Client end of playing back asks for video tab data, including image size, data block to server first when playing video
Number etc..First data block number is sent when playing for the first time to server, server is according to block number, by the corresponding video counts of block number
According to being sent to client end of playing back since first frame.Client end of playing back starts to play after receiving data, and will receive number
According to preservation into local spatial cache.
During broadcasting, user can operate playing controller, change the video location of broadcasting.Client end of playing back root
Video playing position after changing according to user calculates the block number where present frame, and searching in local spatial cache first is
The corresponding video data of the no block number has existed, if it is, directly playing after taking out.If it is not, then block number is sent
To record ping server, the transmission of video data is carried out according to block number by record ping server.
As shown in figure 5, the application is recorded and is played the on-demand from record of user's operation screen based on application filtering piecemeal
Ping server fetches video data to the schematic illustration of client end of playing back.
After record ping server receives block number, since the first frame of the corresponding screen data of block number, video data is sent
To client end of playing back.It is every to have sent a frame data during transmission, a block number is detected, if still identical, after supervention
Next frame data are sent, if it is different, then sending since the first frame of the block.If being sent to the last frame data of the block
It is to need to be marked, informs that client end of playing back, the video data of a block have been sent completely.It is being sent completely a block
Data after, the corresponding video data of next block number is successively sent, until all video datas have all been sent.If
It is the video data of the last one block number, then the video data for the block number not sent before finding is sent.
The present invention is described in detail above and records and play user's operation screen based on application filtering piecemeal in one kind
Specific embodiment.
Claims (10)
1. a kind of method for recording user's operation screen based on application filtering piecemeal is applied to record screen client, feature
It is, which comprises
It monitors whether that the user's operation that triggering is recorded a video occurs, the user's operation includes the operation that user executes mouse, Huo Zheyong
The operation of family execution keyboard；
If monitoring user's operation, the process title of the application program of screen the top is obtained with from record ping server
Know that the process title in process List Names is matched；
If successful match, screen recording is carried out according to the corresponding recording strategy of the process title obtained from record ping server；
The recording strategy includes recording screen number corresponding with process title, record screen color, record screen range；
Record ping server is sent by the video data of recording.
2. the method according to claim 1 for recording user's operation screen based on application filtering piecemeal, feature exist
In, by the process title of the application program of screen the top with from record ping server obtain known process List Names in into
When journey title is matched, the method also includes:
If it fails to match, the process of the application program is nominally passed into the record ping server, so that record screen service
Device is updated to by the process title of the application program into the known process List Names.
3. the method according to claim 1 for recording user's operation screen based on application filtering piecemeal, feature exist
In, the method also includes:
Screen strategy is recorded from the service acquisition according to certain time interval；
After obtaining record screen strategy, screen recording is carried out according to the record screen strategy of acquisition.
4. the method according to claim 1 for recording user's operation screen based on application filtering piecemeal, feature exist
In, the method also includes:
IP information is sent to record ping server, receives the corresponding record screen strategy of this IP and known process name that record ping server returns
Claim inventory.
5. the method according to claim 1 for recording user's operation screen based on application filtering piecemeal, feature exist
In carrying out screen recording method includes:
It is whether continuous according to the user's operation, piecemeal, and correspondence markings block number are carried out to the video data data of recording；
Present frame picture and frame number are obtained according to the window ranges of the application program of recording on the screen, shields plan according to the record
Slightly, it is compared with former frame picture, obtains the variance data of each frame number, is recorded by the variance data of all frames
Video data.
6. the method according to claim 5 for recording user's operation screen based on application filtering piecemeal, feature exist
In sending the step of recording ping server for the video data data of recording includes:
Record ping server is sent to the block number of corresponding blocks after variance data is compressed；
Record ping server is sent by the corresponding label data of each block number；
The label data includes size, number of colors, image lattice size, block count and the frame per second of video data.
7. a kind of method for playing user's operation screen based on application filtering is applied to record screen client, the record screen visitor
Family end is connect with record ping server, and the record ping server saves the view that the method any just like claim 5-6 is recorded
Frequency evidence, which is characterized in that the described method includes:
Video tab data are obtained from the record ping server, the video tab data include the size of video data, color
Number, image lattice size, block count and frame per second；
The block number for wanting to play is sent to the record ping server；
Receive the video data for the block number that record ping server is returned according to block number；
The video data received is stored in spatial cache.
8. the method according to claim 7 for playing user's operation screen based on application filtering, which is characterized in that institute
The method of stating includes:
After detecting user's operation playing controller, the block number to be played after changing and frame number are obtained；
Judge whether the corresponding data of frame number have been saved in the spatial cache, if so, directly from described from spatial cache
It obtains this auspicious data and plays out, if whether, the record, which is sent, by the block number where the frame number and corresponding frame shields
Server obtains corresponding video data from the record ping server.
9. the method according to claim 8 for playing user's operation screen based on application filtering, which is characterized in that institute
The method of stating includes:
After the data for having obtained a frame, judge whether to get the last one frame of the block,
If so, judge whether the video data of block number where the frame has obtained,
If so, being obtained since the first frame of the video data of the block.
10. the method according to claim 7 for playing user's operation screen based on application filtering, which is characterized in that
If all frames of the corresponding video data of a block number have all obtained, start to obtain next piece from record ping server
Number corresponding video data；
If next block number corresponds to video data and has obtained, or when being the last one block number, other is selected not obtain
The video of the block number taken continues to obtain, until obtaining all videos data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711113291.5A CN109783328A (en) | 2017-11-13 | 2017-11-13 | A method of user's operation screen is recorded and played based on application filtering piecemeal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711113291.5A CN109783328A (en) | 2017-11-13 | 2017-11-13 | A method of user's operation screen is recorded and played based on application filtering piecemeal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109783328A true CN109783328A (en) | 2019-05-21 |
Family
ID=66485731
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711113291.5A Pending CN109783328A (en) | 2017-11-13 | 2017-11-13 | A method of user's operation screen is recorded and played based on application filtering piecemeal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109783328A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110807184A (en) * | 2019-09-23 | 2020-02-18 | 上海意略明数字科技股份有限公司 | Method for intelligently recording screen and acquiring behavior data of computer and mobile terminal user |
| CN111314022A (en) * | 2020-02-12 | 2020-06-19 | 四川大学 | Screen updating transmission method based on reinforcement learning and fountain codes |
| WO2021109786A1 (en) * | 2019-12-02 | 2021-06-10 | 中兴通讯股份有限公司 | Terminal desktop content monitoring method, platform, terminal, system and storage medium |
-
2017
- 2017-11-13 CN CN201711113291.5A patent/CN109783328A/en active Pending
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110807184A (en) * | 2019-09-23 | 2020-02-18 | 上海意略明数字科技股份有限公司 | Method for intelligently recording screen and acquiring behavior data of computer and mobile terminal user |
| CN110807184B (en) * | 2019-09-23 | 2021-08-27 | 上海意略明数字科技股份有限公司 | Method for intelligently recording screen and acquiring behavior data of computer and mobile terminal user |
| WO2021109786A1 (en) * | 2019-12-02 | 2021-06-10 | 中兴通讯股份有限公司 | Terminal desktop content monitoring method, platform, terminal, system and storage medium |
| CN112995577A (en) * | 2019-12-02 | 2021-06-18 | 中兴通讯股份有限公司 | Method, platform, terminal, system and storage medium for monitoring terminal desktop content |
| CN111314022A (en) * | 2020-02-12 | 2020-06-19 | 四川大学 | Screen updating transmission method based on reinforcement learning and fountain codes |
| CN111314022B (en) * | 2020-02-12 | 2021-04-06 | 四川大学 | Screen updating transmission method based on reinforcement learning and fountain codes |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2066128B1 (en) | Method, apparatus and system for displaying video data | |
| AU2005202356B2 (en) | Frame scattering for video scrubbing | |
| CN104333770B (en) | The method and device of a kind of net cast | |
| JP4612906B2 (en) | Method, apparatus and computer program for transmitting sequence | |
| CN105227930B (en) | Video inspection method and device in a kind of video monitoring system | |
| CN106559697B (en) | A kind of recorded file cover display methods and system based on PVR set-top boxes | |
| US8026944B1 (en) | Method and apparatus for hosting a network camera with image degradation | |
| KR102146042B1 (en) | Method and system for playing back recorded video | |
| US20040227817A1 (en) | Motion detecting system, motion detecting method, motion detecting apparatus, and program for implementing the method | |
| CN109783328A (en) | A method of user's operation screen is recorded and played based on application filtering piecemeal | |
| US9997203B2 (en) | System and method for streaming and recording video | |
| US7177448B1 (en) | System and method for selecting and transmitting images of interest to a user | |
| US8639796B2 (en) | Monitoring the performance of a streaming media server using server-side and client-side measurements | |
| CN102938854A (en) | Method and apparatus for use in tracking playback of media streams while in stand-by mode | |
| CN109981628A (en) | The monitoring method and device of network direct broadcasting software performance, electronic equipment | |
| US9490992B2 (en) | Remote conference saving system for managing missing media data and storage medium | |
| US11039187B2 (en) | Self-adaptive software background update method and device | |
| JP2020523871A (en) | Interactive video content display detection and response to display | |
| WO2005071965A1 (en) | Video distribution device | |
| CN111013150A (en) | Game video editing method, device, equipment and storage medium | |
| CN111526428A (en) | Method, system and medium for realizing HTML5 video playing in cloud desktop | |
| KR102659702B1 (en) | Data storage and retrieval system for non-connected medical device operation data | |
| TW201806380A (en) | Video splitting device and monitoring method | |
| JP2007180829A (en) | Monitoring system, monitoring method, and program for executing method | |
| CN106385562A (en) | Video abstract generation method, device and video monitoring system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190521 |