CN111182079A - Universal system for screenshot and desktop video recording - Google Patents
Universal system for screenshot and desktop video recording Download PDFInfo
- Publication number
- CN111182079A CN111182079A CN202010008110.8A CN202010008110A CN111182079A CN 111182079 A CN111182079 A CN 111182079A CN 202010008110 A CN202010008110 A CN 202010008110A CN 111182079 A CN111182079 A CN 111182079A
- Authority
- CN
- China
- Prior art keywords
- screen capture
- video
- video recording
- desktop
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 claims abstract description 5
- 238000006243 chemical reaction Methods 0.000 claims description 10
- 238000004806 packaging method and process Methods 0.000 claims description 9
- 238000000034 method Methods 0.000 abstract description 13
- 230000007547 defect Effects 0.000 description 2
- 230000011664 signaling Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000009191 jumping Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4334—Recording operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47214—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8166—Monomedia components thereof involving executable data, e.g. software
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Business, Economics & Management (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The invention discloses a general system for screenshot and desktop video recording, which comprises a receiving layer, a processing layer and a storage layer, wherein the storage layer comprises picture storage and video recording storage, and a user configures a storage path of the picture and the video recording on a software interface; the receiving layer comprises a message monitor, is used for monitoring an HTTP port and receiving a request instruction of screen capture and video recording sent by third-party client software, and is distributed to the processing layer downwards according to the request type after receiving the request; the processing layer comprises a screen capture processing program and a video recording processing program. The invention provides a uniform standard interface for the outside, can be butted with any third-party client system, and does not need manual intervention in the working process of software; supporting high performance screenshots; the desktop video is supported, and audio and video parameters, recording areas and recording ending time can be flexibly controlled through the interface.
Description
Technical Field
The invention belongs to the technical field of screen capture, and relates to a universal system for screen capture and desktop video recording.
Background
the method has the following defects that ① is too complicated, all operations cannot be finished at one time, the player needs to miss the video played by the player in the screen capturing process, the user needs to restore the screen capturing progress to the desktop, and the screen capturing efficiency and the video recording efficiency of the video playing system cannot be improved once again.
Disclosure of Invention
In order to overcome the defects in the prior art, a universal system for screen capture and desktop video is provided.
The invention is realized by the following scheme:
a general system for screenshot and desktop video comprises a receiving layer, a processing layer and a storage layer, wherein the storage layer comprises a picture storage layer and a video storage layer, and a user configures a storage path of the picture and the video on a software interface;
the receiving layer comprises a message monitor, is used for monitoring an HTTP port and receiving a request instruction of screen capture and video recording sent by third-party client software, and is distributed to the processing layer downwards according to the request type after receiving the request;
the processing layer comprises a screen capture processing program and a video recording processing program; when the processing layer receives a screen capture request instruction, the screen capture processing program executes the screen capture request instruction, and finally stores the file into a specified directory by calling a screen capture function and a PNG format conversion function; when the processing layer receives a video recording request instruction, the video recording processing program executes the video recording request instruction, and the video recording processing program continuously writes files after calling a screen capture function, an x264 video encoder, a WaveIn audio acquisition interface, an AAC audio encoder and FLV packaging.
The screen capture function is a Mirrordriver screen capture or a DXGI Desktop duplicate API screen capture;
when the screen capture request instruction is processed, the picture is in the RGB format and is subjected to format conversion by using a PNG format conversion function, and the PNG format picture is stored, wherein the picture is returned after screen capture in the Mirrordriver screen capture mode or the DXGI Desktop duplicationPI screen capture mode.
In Win7 and systems below, the screen capture was performed using MirrorDriver technology, and in Win8 and systems above, the screen capture was performed using DXGI Desktop duplicate API technology.
When a video recording request instruction is processed, sending RGB images of continuous screen capture into an x264 video encoder, and outputting an H264 video stream; simultaneously starting a WaveIn audio acquisition interface to acquire the audio of the system, outputting the audio in a WAVE format, and then encoding the audio in the WAVE format into the audio in the AAC format by an AAC audio encoder; and performing FLV packaging on the H264 video stream and the AAC through an FLV container to finally generate an FLV file, and directly watching the FLV file by using a video player.
The method has the beneficial effects that:
the universal system for screen capture and desktop video recording is universal high-performance screen capture and desktop video recording software, provides a uniform standard interface for the outside, can be butted with any third-party client system, and does not need manual intervention in the working process of the software; supporting high-performance screenshots, using a Mirrordriver technology in Win7 and the systems below, and using a DXGI Desktop duplicate API technology in Win8 and the systems above; the desktop video is supported, and audio and video parameters, recording areas and recording ending time can be flexibly controlled through the interface.
Drawings
FIG. 1 is a block diagram of a generalized screenshot and desktop recording system of the present invention;
FIG. 2 is a flowchart of the general screenshot and desktop recording system of the present invention.
Detailed Description
The invention is further illustrated by the following specific examples:
a general system for screenshot and desktop video comprises a receiving layer, a processing layer and a storage layer, wherein the storage layer comprises a picture storage layer and a video storage layer, and a user configures a storage path of the picture and the video on a software interface;
the receiving layer comprises a message monitor, is used for monitoring an HTTP port and receiving a request instruction of screen capture and video recording sent by third-party client software, and is distributed to the processing layer downwards according to the request type after receiving the request;
the processing layer comprises a screen capture processing program and a video recording processing program; when the processing layer receives a screen capture request instruction, the screen capture processing program executes the screen capture request instruction, and finally stores the file into a specified directory by calling a screen capture function and a PNG format conversion function; when the processing layer receives a video recording request instruction, the video recording processing program executes the video recording request instruction, and the video recording processing program continuously writes files after calling a screen capture function, an x264 video encoder, a WaveIn audio acquisition interface, an AAC audio encoder and FLV packaging.
The screen capture function is a Mirrordriver screen capture or a DXGI Desktop duplicate API screen capture;
when a screen capture request instruction is processed, a picture is returned to be in an RGB format after screen capture in the Mirrordriver screen capture mode or the DXGI Desktop duplicate screenshot mode, and in order to save storage space, a PNG format conversion function is used for carrying out format conversion and storing the PNG format picture.
In Win7 and systems below, the screen capture was performed using MirrorDriver technology, and in Win8 and systems above, the screen capture was performed using DXGI Desktop duplicate API technology.
When a video recording request instruction is processed, sending RGB images of continuous screen capture into an x264 video encoder, and outputting an H264 video stream; simultaneously starting a WaveIn audio acquisition interface to acquire the audio of the system, outputting the audio in a WAVE format, and then encoding the audio in the WAVE format into the audio in the AAC format by an AAC audio encoder; and performing FLV packaging on the H264 video stream and the AAC through an FLV container to finally generate an FLV file, and directly watching the FLV file by using a video player.
The workflow of a general screenshot and desktop recording system is as follows:
the method comprises the steps of firstly, configuring a storage directory, ① configuring a picture storage directory, and ②, configuring a video storage directory.
II, judging the version of the operating system: when the application program is started, version details of the current operating system are obtained by calling a Windows API GetVersionEx function, whether the current operating system is Win7 or below or Win8 or above is judged, and when the subsequent screen capturing is realized, different screen capturing methods need to be called according to the version of the operating system.
and thirdly, message monitoring, namely after receiving the HTTP request of the third-party client software, the message is required to be handed to different subprograms to be executed according to ① request method, and the request instruction comprises ① screen capture request, ① video recording start request and ① video recording end request.
And fourthly, judging a request method, and requesting according to the request type.
4.1 if it is a screen capture request
a. Screen shot: and judging the type of the operating system, if the operating system is Win7 and the following systems, realizing screen capture through a Mirrordriver, and if the operating system is Win8 and the above systems, carrying out screen capture through a DXGI Desktop duplicate API.
PNG format conversion: and converting the RGB image obtained by screen capture into a PNG image, and storing the PNG image in a picture directory.
4.2 if it is a video recording start request
a. And configuring an encoder according to a frame rate and an area, and initializing an audio acquisition module according to parameters such as a sampling rate, the number of channels, the number of bits and the like.
b. And calling screen capture methods of different modules according to the types of the operating systems, if the system is Win7 or below, realizing screen capture through a Mirrordriver, and if the system is Win8 or above, carrying out screen capture through a DXGI Desktop duplicate API.
c. The RGB data of the screen is sent to an x264 video encoder, and an H264 video stream is output.
d. And recording audio through a WaveIn audio acquisition interface to obtain WAVE audio data.
e. WAVE audio is encoded into AAC formatted audio by an AAC audio encoder.
f. And carrying out FLV (flash video) packaging on the H264 video stream and the AAC format audio through an FLV container, and writing the FLV packaging into a file in real time.
g. And if the video recording is continuously executed, jumping to the step b for circular execution.
h. If the video recording is finished, closing the video recording file and finishing the video recording.
3.3, if the request is a video recording end request, setting a video recording end mark and waiting for the video recording circulation condition to end.
The application relates to a layered technical architecture and a workflow of screenshot and desktop video software; an HTTP-JSON interaction method (field definition) between the third-party client software and the system; initiating a method of screen capture and desktop video recording on third-party client software through an HTTP-JSON instruction; the method for acquiring the screen image by using the Mirrordriver technology under the Win7 system and the DXGI Desktop duplicate API under the Win8 system and above.
in the application, any third-party client software interacting with an ② universal system of screenshot and desktop video, which performs signaling transmission between the two parties through an HTTP protocol and performs signaling specification description through JSON, specifically comprises three interfaces, namely an ② screenshot request, an ② video starting request, an ② video ending request, and the following specific request fields:
A. screen shot request
Field meaning:
B. video recording start request
Field meaning:
| field(s) | Data of Type (B) | Must be used Filling-in | Description of the invention |
| left | Inte ger | tru e | Recording rectangular area upper left corner x-axis coordinate |
| top | Inte ger | tru e | Recording rectangular area upper left corner y-axis coordinate |
| width | Inte ger | tru e | Width of rectangular area for video recording |
| heigh t | Inte ger | tru e | Height of video rectangular area |
| frame rate | Inte ger | fal se | Video frame rate of video recording, default is 25 frames |
| hasAu dio | Bool ean | fal se | And if the audio is recorded, the default is not to record. When the device is started, 16 bits are collected according to 44100Hz |
| fileN ame | Stri ng | fal se | The stored file name is named and recorded according to the rule set by the software when the file name does not carry the parameter The image takes H264 as video coding, AAC as audio coding, and FLV packaging format is adopted |
| recor dID | Stri ng | tru e | The returned unique identifier of the recorded video is required to be controlled by the identifier when the recorded video is stopped |
C. Video recording end request
Field meaning:
| field(s) | Data type | Must fill in | Description of the invention |
| recordID | String | true | The only mark of the video to be stopped, the application program stops the screen video and closes the file |
The system provides a universal screen capture and desktop video recording capability for the third-party software application, the third-party client software application sends an HTTP request instruction to the system, and the system completes screen capture and video recording according to the instruction requirement. The system exists in the form of PC background service software, the HTTP interface can specify the screen areas of the image capture and the video recording, supports the configuration of the storage path and the naming format of the image and supports the start-stop time of the image capture action, achieves the purposes that the screen capture runs through the background, does not occupy the screen exclusively and does not interrupt the operation of a user, and improves the convenience and the working efficiency.
Although the invention has been described and illustrated in some detail, it should be understood that various modifications may be made to the described embodiments or equivalents may be substituted, as will be apparent to those skilled in the art, without departing from the spirit of the invention.
Claims (4)
1. A general system for screenshot and desktop recording is characterized in that: the system comprises a receiving layer, a processing layer and a storage layer, wherein the storage layer comprises picture storage and video storage, and a user configures a storage path of pictures and videos on a software interface;
the receiving layer comprises a message monitor, is used for monitoring an HTTP port and receiving a request instruction of screen capture and video recording sent by third-party client software, and is distributed to the processing layer downwards according to the request type after receiving the request;
the processing layer comprises a screen capture processing program and a video recording processing program; when the processing layer receives a screen capture request instruction, the screen capture processing program executes the screen capture request instruction, and finally stores the file into a specified directory by calling a screen capture function and a PNG format conversion function; when the processing layer receives a video recording request instruction, the video recording processing program executes the video recording request instruction, and the video recording processing program continuously writes files after calling a screen capture function, an x264 video encoder, a WaveIn audio acquisition interface, an AAC audio encoder and FLV packaging.
2. The system for universal screenshot and desktop recording according to claim 1, wherein: the screen capture function is a Mirrordriver screen capture or a DXGI Desktop duplicate API screen capture;
when the screen capture request instruction is processed, the picture is in the RGB format and is subjected to format conversion by using a PNG format conversion function, and the PNG format picture is stored, wherein the picture is returned after screen capture in the Mirrordriver screen capture mode or the DXGI Desktop duplicationPI screen capture mode.
3. The system for universal screenshot and desktop recording according to claim 2, wherein: in Win7 and systems below, the screen capture was performed using MirrorDriver technology, and in Win8 and systems above, the screen capture was performed using DXGI desktop application API technology.
4. The system for universal screenshot and desktop recording according to claim 1, wherein: when a video recording request instruction is processed, sending RGB images of continuous screen capture into an x264 video encoder, and outputting an H264 video stream; simultaneously starting a WaveIn audio acquisition interface to acquire the audio of the system, outputting the audio in a WAVE format, and then encoding the audio in the WAVE format into the audio in the AAC format by an AAC audio encoder; and performing FLV packaging on the H264 video stream and the AAC through an FLV container to finally generate an FLV file, and directly watching the FLV file by using a video player.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010008110.8A CN111182079A (en) | 2020-01-06 | 2020-01-06 | Universal system for screenshot and desktop video recording |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010008110.8A CN111182079A (en) | 2020-01-06 | 2020-01-06 | Universal system for screenshot and desktop video recording |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111182079A true CN111182079A (en) | 2020-05-19 |
Family
ID=70657824
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010008110.8A Pending CN111182079A (en) | 2020-01-06 | 2020-01-06 | Universal system for screenshot and desktop video recording |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111182079A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103414890A (en) * | 2013-07-08 | 2013-11-27 | 宇龙计算机通信科技(深圳)有限公司 | Realization method of remote desktop and device thereof |
| CN103560933A (en) * | 2013-11-08 | 2014-02-05 | 北京京东尚科信息技术有限公司 | Method, device and system for displayer-free image intercepting or/and recording |
| CN104967904A (en) * | 2014-04-10 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Method for recording and playing back terminal video and apparatus thereof |
| CN107801088A (en) * | 2016-08-31 | 2018-03-13 | 南京极域信息科技有限公司 | One kind throws screen and receives share system and implementation method |
| CN108965986A (en) * | 2017-12-29 | 2018-12-07 | 北京视联动力国际信息技术有限公司 | A kind of video recorded broadcast method, apparatus and system |
-
2020
- 2020-01-06 CN CN202010008110.8A patent/CN111182079A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103414890A (en) * | 2013-07-08 | 2013-11-27 | 宇龙计算机通信科技(深圳)有限公司 | Realization method of remote desktop and device thereof |
| CN103560933A (en) * | 2013-11-08 | 2014-02-05 | 北京京东尚科信息技术有限公司 | Method, device and system for displayer-free image intercepting or/and recording |
| CN104967904A (en) * | 2014-04-10 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Method for recording and playing back terminal video and apparatus thereof |
| CN107801088A (en) * | 2016-08-31 | 2018-03-13 | 南京极域信息科技有限公司 | One kind throws screen and receives share system and implementation method |
| CN108965986A (en) * | 2017-12-29 | 2018-12-07 | 北京视联动力国际信息技术有限公司 | A kind of video recorded broadcast method, apparatus and system |
Non-Patent Citations (1)
| Title |
|---|
| FANXIUSHU: ""windows远程桌面实现之一 （抓屏技术总览 MirrorDriver，DXGI，GDI)"", 《CSDN》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112291627B (en) | Video editing method and device, mobile terminal and storage medium | |
| CN1107408C (en) | Apparatus and method for generating digital still image files from digital moving images | |
| CN110430441B (en) | Cloud mobile phone video acquisition method, system, device and storage medium | |
| WO2016138844A1 (en) | Multimedia file live broadcast method, system and server | |
| CN109327728A (en) | One kind is one-to-many to shield together methods, devices and systems, with screen equipment and storage medium | |
| KR101859064B1 (en) | Video synchronous playback method, apparatus, and system | |
| WO2020215453A1 (en) | Video recording method and system | |
| US20230144483A1 (en) | Method for encoding video data, device, and storage medium | |
| CN110300322B (en) | Screen recording method, client and terminal equipment | |
| CN109729429B (en) | Video playing method, device, equipment and medium | |
| WO2021129830A1 (en) | Video transmission method, apparatus, device and system | |
| CN1225120C (en) | Image processing device, image processing method, recording medium and program | |
| CN104580837A (en) | Video director engine based on GPU+CPU+IO architecture and using method thereof | |
| CN112689197B (en) | File format conversion method and device and computer storage medium | |
| CN105451004A (en) | Intelligent set top box, and media processing system and method supporting video communication monitoring | |
| CN105933624A (en) | Method and device for recording website video | |
| CN106507115B (en) | Coding/decoding method, device and the terminal device of VR video based on iOS device | |
| US20140025782A1 (en) | System and method for playing and transmitting network video | |
| CN113645448A (en) | Video decoding method and device suitable for command scheduling | |
| CN113794924A (en) | Video playing method, device, equipment and computer readable storage medium | |
| CN111182079A (en) | Universal system for screenshot and desktop video recording | |
| CN112565671A (en) | Conference information capturing method and device in desktop sharing and readable storage medium | |
| CN201663666U (en) | Network video device | |
| WO2023207513A1 (en) | Video processing method and apparatus, and electronic device | |
| CN111918074A (en) | Live video fault early warning method and related equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200519 |
|
| RJ01 | Rejection of invention patent application after publication |