CN106101830A - A kind of video flow detection method combined based on region detection and applying detection - Google Patents
A kind of video flow detection method combined based on region detection and applying detection Download PDFInfo
- Publication number
- CN106101830A CN106101830A CN201610533722.2A CN201610533722A CN106101830A CN 106101830 A CN106101830 A CN 106101830A CN 201610533722 A CN201610533722 A CN 201610533722A CN 106101830 A CN106101830 A CN 106101830A
- Authority
- CN
- China
- Prior art keywords
- video
- detection
- display area
- region
- video display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/4424—Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
Abstract
The present invention relates to a kind of video flow detection method combined based on region detection and applying detection, including: S1: server calls wake up procedure；S2: call application monitoring programme；S3: when receiving the message of the screen-picture renewal that wake up procedure sends, perform step S4；S4: obtain screen-picture update area and the renewal frequency of correspondence, and recorded in renewal historical queue；S5: according to the information in historical queue, obtains video display area；S6: utilize application monitoring programme to obtain the application process corresponding with video display area, and judge whether this application process is video player process, if so, perform step S7, if it is not, jump procedure S3；S7: the output detections message to video and the video display area of correspondence.Compared with prior art, the advantage such as false dismissal probability that the present invention has the accuracy rate improving Video Detection, reduces Video Detection.
Description
Technical field
The present invention relates to electronic information technology of sharing field, especially relate to a kind of based on region detection and applying detection phase
In conjunction with video flow detection method.
Background technology
Technical problem is how to ensure to ensure long-range table under limited bandwidth in run into now at remote desktop
The change such as the video in face or game very quickly region can be in local smooth display.In existing public network technology,
In the case of family's ADSL access bandwidth as only has 1～10Mbps, if using lossless compression algorithm certainly cannot reach
The picture of the HD video play on smoothness display remote desktop, so lossy compression method must be used.On the other hand, entirely
Portion uses lossy compression method can cause the fuzzy of picture, it is therefore desirable to have a kind of method certain the block region on remote desktop can be detected
Playing video, carrying out lossy compression method only for this video area and will effectively lower the network bandwidth, and do not hinder other districts
The display resolution in territory.
ADSL: be a kind of asymmetrical DSL (digital subscriber line) technology, the so-called asymmetric upper scanning frequency referring to subscribers feeder
Rate is different from downstream rate, and upstream rate is low, and downstream rate is high, is particularly suitable for transmitting Multimedia Messaging Service, such as video request program
(VOD), multimedia information retrieval and other interactive services.ADSL support on a pair copper cash upstream rate 512Kbps～
1Mbps, downstream rate 1Mbps～8Mbps, effective propagation path is within 3～5 kilometer range.
The scheme that existing remote desktop presents has the video detection technology of VirtualBox and SPICE protocol.Its technology is former
Reason is the video area of the current change of monitoring, if detecting that within the regular hour certain fixing regional change frequency exceedes
Certain threshold value, then it is assumed that video flowing detected, thus this region is converted into lossy compression method and sends.Threshold value: strong also known as threshold
Degree, refers to discharge the minimum stimulation intensity required for a behavior reaction.Behavior can not be caused to discharge less than the stimulation of threshold value.
The video of Virtual Box turns the technology of M-JPEG:
M-JPEG (Motion-Join Photographic Experts Group) technology i.e. motor rest image (or by
Frame) compress technique, it is widely used in non-linear editing field and can be accurate to frame-editing and multi-layer image process, the video of motion
Sequence processes as continuous print rest image, and this compress mode the most intactly compresses each frame, can in editing process
The each frame of random storage, can carry out being accurate to the editor of frame, and compression and the decompression of M-JPEG is symmetrical in addition, can be by identical
Hardware and software realize.But the spatial redundancy in frame is only compressed by M-JPEG.The time redundancy of interframe is not pressed
Contracting, therefore compression efficiency is the highest.Use M-JPEG digital compressed format, as compression ratio 7:1, it is possible to provide be equivalent to Betecam SP
The program of quality image.
Joint Photographic Experts Group institute according to algorithm be based on DCT (discrete cosine transform) and Variable Length Code.The crucial skill of JPEG
Art has transition coding, quantization, differential coding, motion compensation, huffman coding and Run-Length Coding etc., Run-Length Coding: also known as " running
Length coding " or " run-length encoding ", it is a kind of statistical coding, this coding belongs to lossless compression-encoding, is raster data compression
Important coded method.
And the shortcoming of M-JPEG to be compression efficiency the highest.
Additionally, this compress mode of M-JPEG is not a monolithic compression standard, the encoding and decoding of different manufacturers
Device and storage mode do not have unified prescribed form.This is it is to say, the video server of each model or encoding board have certainly
Oneself M-JPEG version, so data transmission between servers, non-linear making network are to the data transmission of server all
It is impossible at all.
SPICE:(Simple Protocol for Independent Computing Environment) virtual desktop
Agreement.SPICE can be used on server and remote computer such as desktop and thin client device disposing virtual desktop.It is similar to
Agreement is rendered, such as Remote Desktop Protocol or Citrix of Microsoft for remote desktop management in other
Independent Computing Architecture.It supports Windows XP, Windows 7 and Red Hat
The virtual machine instance such as Enterprise Linux.
Existing remote desktop presents the defect of technology:
One, the region not necessarily video detected according to existing Region detection algorithms, the most improper employing has
Damage compression and transmit picture.Fixed area change can be produced when such as IE browser mouse rollovers is frequent, but whether video, as
Really lossy compression method picture is by unintelligible, affects Consumer's Experience；
Two, in the video display process having, there is fixing region constantly to do picture refreshing, but frequency may constantly become
Changing, and different according to the frame per second of film, change frequency is different, if there being single threshold value interpretation, when can produce but video
The problem of video flowing frequently during stream.
Summary of the invention
Defect that the purpose of the present invention is contemplated to overcome above-mentioned prior art to exist and provide a kind of based on region detection
The video flow detection method combined with applying detection, the missing inspection there is the accuracy rate improving Video Detection, reducing Video Detection
The advantages such as probability.
The purpose of the present invention can be achieved through the following technical solutions:
A kind of video flow detection method combined based on region detection and applying detection comprises the following steps:
S1: server calls is for monitoring the wake up procedure whether screen-picture of remote desktop updates；
S2: call the application monitoring programme of application process running status for monitoring remote desktop；
S3: when receiving the message of the screen-picture renewal that wake up procedure sends, perform step S4；
S4: obtain screen-picture update area and the renewal frequency of correspondence, and recorded in renewal historical queue；
S5: according to the information in historical queue, obtains video display area, and described video display area was the upper time
In section, renewal frequency exceedes the union of the Flat-picture update area setting threshold value；
S6: utilize application monitoring programme to obtain the application process corresponding with video display area, and judge this application process
Whether it is video player process, if so, performs step S7, if it is not, jump procedure S3；
S7: the output detections message to video and the video display area of correspondence.
After the video display area of obtaining step S7, monitor whether application process corresponding to this video display area terminates,
The application process corresponding when video display area terminates, then jump procedure S3.
Described wake up procedure is Hook Function, driver or virtual machine processing routine.
Described application monitoring programme is Hook Function or driver.
Server creates video player process list, when application process corresponding with video display area in step S6 is deposited
With video player process list, then this application process is video player process.
Described step S5, particularly as follows: use Region Matching method, obtains a time in the historical queue of step S4
In section, renewal frequency exceedes the union of the Flat-picture update area setting threshold value, as video display area.
Described Region Matching method is Region Matching method based on fuzzy matching.
In described step S2, application process running status includes that application process creates message and application program DLL/SO library text
Part open message.
Described screen-picture update area is with rectangle frame zoning.
When being applied to remote desktop display, the video display area obtaining step S7 carries out lossy compression method transmission, to removing
The region beyond video display area that step S7 obtains carries out lossless compress transmission.
Compared with prior art, the invention have the advantages that
1) method using continuance area change-detection and applying detection to combine detects whether as video flowing, step
S3-S5 realizes continuance area change-detection, and step S2, S6 realize applying detection, only becomes in applying detection to this fixed area
When change is to be produced by video player, just thinks and detect video, be detected as regarding by IE browser roll screen thus without causing
The problem of frequency stream, reduces the false dismissal probability of Video Detection while improving the accuracy rate of Video Detection.
2) the inventive method is once detect that the change of this fixed area is to be produced by video player, can assert always
This region is video area, until corresponding application process terminates, from without producing whether continuous switching detects video
Problem.
3) present invention selects Hook Function etc. as wake up procedure or application monitoring programme, utilizes Hook Function to catch
Your process or other process event, it is achieved system can be notified when the screen-picture of remote desktop updates
Purpose, and the purpose of corresponding application process monitoring running state, it is adaptable to all Windows system operation context.
4) apply the present invention in the coding system that remote desktop shows, it is ensured that remote desktop smooth and clearly in
Existing, and there is not bandwidth restriction.
Accompanying drawing explanation
Fig. 1 is the inventive method flow chart.
Detailed description of the invention
The present invention is described in detail with specific embodiment below in conjunction with the accompanying drawings.The present embodiment is with technical solution of the present invention
Premised on implement, give detailed embodiment and concrete operating process, but protection scope of the present invention be not limited to
Following embodiment.
As it is shown in figure 1, a kind of video flow detection method combined based on region detection and applying detection includes following step
Rapid:
S1: use System hook function (User space) or driver (kernel state) or the processing routine etc. of virtual machine
Method, builds for monitoring the wake up procedure whether screen-picture of remote desktop updates, server calls wake up procedure.
S2: use System hook function (User space) or the method for driver (kernel state), builds and is used for monitoring far
The application monitoring programme of the application process running status of journey desktop, server calls application monitoring programme, the establishment of monitoring process
With opening of DLL/SO library file, server creates video player process list simultaneously.
Video player process list is as applying detection criterion, for efficiently identifying video player rapidly
Process, contrasts with video player process list when having process creation or DLL/SO is opened, arranges if present in system
In table, then it is assumed that be video player process.
S3: when receiving the message of the screen-picture renewal that wake up procedure sends, perform step S4.
S4: obtain screen-picture update area and the renewal frequency of correspondence, and recorded in renewal historical queue.Its
In, screen-picture update area be scattered region or irregular area are divided with multiple rectangle frames after the region that obtains,
Be conducive to the quick identification in subsequent video player region.
The generation of object video suffers from important application in many aspects, and it is not only content-based video coding
Basis, and be an important step in video image tracking and identifying system.Owing to object video (Moving Objects) exists
Among Motion-changed Region, a kind of important method that therefore object video generates is exactly first to detect Motion-changed Region, so
After in Motion-changed Region, combine other features generate object video, wherein the accurately detection of Motion-changed Region is this kind of side
The key of method.Frame differential method is not limited by background image and is affected, and algorithm is only sensitive to Motion-changed Region, and detection is effectively
And it is stable.Space-time method based on Changing Area Detection generally utilizes the frame difference operation of adjacent image in video sequence to detect change
Region, the pixel that difference is big is considered as Moving Objects, and the pixel that difference is little is considered as background.
S5: by searching in historical queue in step s 4, uses accurately or the Region Matching method of fuzzy matching
Judge that whether this same or approximation area update frequency reaches threshold value within a period of time in past, obtains video viewing area
Territory.Fuzzy matching refers to that the rectangle allowing change has certain deviation at screen coordinate and size.
S6: utilize application monitoring programme to obtain the application process corresponding with video display area, read video player and enter
Cheng Liebiao, and judge whether this application process is video player process, if so, perform step S7, if it is not, jump procedure S3.
S7: the output detections message to video and the video display area of correspondence, thus without causing IE browser
The problem that roll screen is detected as video flowing.
After the video display area of obtaining step S7, monitor whether application process corresponding to this video display area terminates,
The application process corresponding when video display area terminates, then jump procedure S3, from without producing whether continuous switching detects
The problem of video.
When being applied to remote desktop display, the video display area obtaining step S7 carries out lossy compression method transmission, to removing
The region beyond video display area that step S7 obtains carries out lossless compress transmission, effectively lowers the network bandwidth, and not
Hinder the display resolution in other regions.
A kind of server of the video flow detection method for combining based on region detection and applying detection, including:
Wake module, for monitoring whether the screen-picture of remote desktop updates；
Application monitoring module, for monitoring the application process running status of remote desktop；
Continue domain transformation identification module, obtain for the renewal frequency according to screen-picture update area and correspondence and regard
Frequently viewing area；
Video display area identification module, for mistake from the video display area that lasting domain transformation identification module obtains
Leach the video display area for video player process, and export.
Above-mentioned server coordinates video encoder, can realize video coding system, and step S7 is obtained by video encoder
Video display area carries out lossy compression method transmission, and the region in addition to the video display area that step S7 obtains is carried out lossless pressure
Contracting transmission.
Claims (10)
1. the video flow detection method combined based on region detection and applying detection, it is characterised in that include following step
Rapid:
S1: server calls is for monitoring the wake up procedure whether screen-picture of remote desktop updates；
S2: call the application monitoring programme of application process running status for monitoring remote desktop；
S3: when receiving the message of the screen-picture renewal that wake up procedure sends, perform step S4；
S4: obtain screen-picture update area and the renewal frequency of correspondence, and recorded in renewal historical queue；
S5: according to the information in historical queue, obtains video display area, in described video display area was a upper time period
Renewal frequency exceedes the union of the Flat-picture update area setting threshold value；
S6: utilize application monitoring programme to obtain the application process corresponding with video display area, and whether judge this application process
For video player process, if so, perform step S7, if it is not, jump procedure S3；
S7: the output detections message to video and the video display area of correspondence.
A kind of video flow detection method combined based on region detection and applying detection the most according to claim 1, its
It is characterised by, after the video display area of obtaining step S7, monitors whether application process corresponding to this video display area terminates,
The application process corresponding when video display area terminates, then jump procedure S3.
A kind of video flow detection method combined based on region detection and applying detection the most according to claim 1, its
Being characterised by, described wake up procedure is Hook Function, driver or virtual machine processing routine.
A kind of video flow detection method combined based on region detection and applying detection the most according to claim 1, its
Being characterised by, described application monitoring programme is Hook Function or driver.
A kind of video flow detection method combined based on region detection and applying detection the most according to claim 1, its
Being characterised by, server creates video player process list, when application process corresponding with video display area in step S6
Exist with video player process list, then this application process is video player process.
A kind of video flow detection method combined based on region detection and applying detection the most according to claim 1, its
Being characterised by, described step S5, particularly as follows: use Region Matching method, obtains a time in the historical queue of step S4
In section, renewal frequency exceedes the union of the Flat-picture update area setting threshold value, as video display area.
A kind of video flow detection method combined based on region detection and applying detection the most according to claim 6, its
Being characterised by, described Region Matching method is Region Matching method based on fuzzy matching.
A kind of video flow detection method combined based on region detection and applying detection the most according to claim 1, its
Being characterised by, in described step S2, application process running status includes that application process creates message and application program DLL/SO library text
Part open message.
A kind of video flow detection method combined based on region detection and applying detection the most according to claim 1, its
Being characterised by, described screen-picture update area is with rectangle frame zoning.
A kind of video flow detection method combined based on region detection and applying detection the most according to claim 1, its
Being characterised by, when being applied to remote desktop display, the video display area obtaining step S7 carries out lossy compression method transmission, to removing
The region beyond video display area that step S7 obtains carries out lossless compress transmission.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610533722.2A CN106101830A (en) | 2016-07-08 | 2016-07-08 | A kind of video flow detection method combined based on region detection and applying detection |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610533722.2A CN106101830A (en) | 2016-07-08 | 2016-07-08 | A kind of video flow detection method combined based on region detection and applying detection |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106101830A true CN106101830A (en) | 2016-11-09 |
Family
ID=57213486
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610533722.2A Pending CN106101830A (en) | 2016-07-08 | 2016-07-08 | A kind of video flow detection method combined based on region detection and applying detection |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106101830A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110401875A (en) * | 2018-04-24 | 2019-11-01 | 深信服科技股份有限公司 | A kind of virtual desktop video pictures method of quality control, system and equipment |
| CN113347413A (en) * | 2021-06-25 | 2021-09-03 | 海信视像科技股份有限公司 | Window position detection method and display device |
| WO2023024563A1 (en) * | 2021-08-23 | 2023-03-02 | 中兴通讯股份有限公司 | Video processing method, server, and computer-readable storage medium |
| CN116437116A (en) * | 2023-03-03 | 2023-07-14 | 深圳市宏辉智通科技有限公司 | Audio and video scheduling method and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102243856A (en) * | 2010-05-13 | 2011-11-16 | 华为技术有限公司 | Method and device for dynamically switching screen data processing modes |
| CN102821278A (en) * | 2012-07-27 | 2012-12-12 | 深信服网络科技（深圳）有限公司 | Remote desktop image transmission method and remote desktop image transmission system |
| US20130208785A1 (en) * | 2012-02-14 | 2013-08-15 | Microsoft Corporation | Video Detection in Remote Desktop Protocols |
| CN104837013A (en) * | 2014-02-10 | 2015-08-12 | 富士通株式会社 | Information processing device, method, program, and terminal device |
| CN106161630A (en) * | 2016-07-20 | 2016-11-23 | 中霆云计算科技（上海）有限公司 | A kind of client screen based on RDP updates display packing |
-
2016
- 2016-07-08 CN CN201610533722.2A patent/CN106101830A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102243856A (en) * | 2010-05-13 | 2011-11-16 | 华为技术有限公司 | Method and device for dynamically switching screen data processing modes |
| US20130208785A1 (en) * | 2012-02-14 | 2013-08-15 | Microsoft Corporation | Video Detection in Remote Desktop Protocols |
| CN102821278A (en) * | 2012-07-27 | 2012-12-12 | 深信服网络科技（深圳）有限公司 | Remote desktop image transmission method and remote desktop image transmission system |
| CN104837013A (en) * | 2014-02-10 | 2015-08-12 | 富士通株式会社 | Information processing device, method, program, and terminal device |
| CN106161630A (en) * | 2016-07-20 | 2016-11-23 | 中霆云计算科技（上海）有限公司 | A kind of client screen based on RDP updates display packing |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110401875A (en) * | 2018-04-24 | 2019-11-01 | 深信服科技股份有限公司 | A kind of virtual desktop video pictures method of quality control, system and equipment |
| CN113347413A (en) * | 2021-06-25 | 2021-09-03 | 海信视像科技股份有限公司 | Window position detection method and display device |
| WO2023024563A1 (en) * | 2021-08-23 | 2023-03-02 | 中兴通讯股份有限公司 | Video processing method, server, and computer-readable storage medium |
| CN116437116A (en) * | 2023-03-03 | 2023-07-14 | 深圳市宏辉智通科技有限公司 | Audio and video scheduling method and system |
| CN116437116B (en) * | 2023-03-03 | 2024-01-30 | 深圳市宏辉智通科技有限公司 | Audio and video scheduling method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8254704B2 (en) | Remote computing platforms providing high-fidelity display and interactivity for clients | |
| CN104137146A (en) | Method and system for video coding with noise filtering of foreground object segmentation | |
| RU2506715C2 (en) | Transmission of variable visual content | |
| CN106101830A (en) | A kind of video flow detection method combined based on region detection and applying detection | |
| US11012742B2 (en) | Video scrambling method and device with adaptive mode selection, network camera and readable storage medium | |
| US20150117545A1 (en) | Layered Video Encoding and Decoding | |
| CN112035081A (en) | Screen projection method and device, computer equipment and storage medium | |
| US20130101014A1 (en) | Layered Screen Video Encoding | |
| AU2018250308B2 (en) | Video compression using down-sampling patterns in two phases | |
| Ko et al. | Implementation and evaluation of fast mobile VNC systems | |
| US7692562B1 (en) | System and method for representing digital media | |
| CN111182310A (en) | Video processing method and device, computer readable medium and electronic equipment | |
| US20130223525A1 (en) | Pixel patch collection for prediction in video coding system | |
| CN111083450A (en) | Vehicle-mounted-end image remote output method, device and system | |
| CN115361582B (en) | Video real-time super-resolution processing method, device, terminal and storage medium | |
| CN111314350A (en) | Image storage system, storage method, calling system and calling method | |
| WO2016082285A1 (en) | Video processing apparatus and method and terminal device | |
| WO2022110870A1 (en) | Image encoding and decoding method, encoding and decoding apparatus, encoder, and decoder | |
| CN116095341A (en) | Watermark embedding method, device, equipment and storage medium | |
| CN112492350B (en) | Video transcoding method, device, equipment and medium | |
| CN111491166A (en) | Dynamic compression system and method based on content analysis | |
| TWI735297B (en) | Coding of video and audio with initialization fragments | |
| EP2884742B1 (en) | Process for increasing the resolution and the visual quality of video streams exchanged between users of a video conference service | |
| CN112351282A (en) | Image data transmission method and device, nonvolatile storage medium and processor | |
| Yan et al. | Surveillance Data Capturing and Compression |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20180613 Address after: 523000 A2, 7 floor, home town plaza, South five village, Houjie Town, Dongguan, Guangdong Applicant after: Dongguan Zheng Xun Industrial Investment Co., Ltd. Address before: 200070 8005, room 3, 533 Po Chang Road, Zhabei District, Shanghai. Applicant before: Ting Yun computing technology (Shanghai) Co., Ltd. |
|
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20161109 |