CN111866143A - Remote data transmission method, device and monitoring system - Google Patents

Remote data transmission method, device and monitoring system Download PDF

Info

Publication number
CN111866143A
CN111866143A CN202010711401.3A CN202010711401A CN111866143A CN 111866143 A CN111866143 A CN 111866143A CN 202010711401 A CN202010711401 A CN 202010711401A CN 111866143 A CN111866143 A CN 111866143A
Authority
CN
China
Prior art keywords
image
video
preset
server
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010711401.3A
Other languages
Chinese (zh)
Inventor
周强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
JD Digital Technology Holdings Co Ltd
Original Assignee
JD Digital Technology Holdings Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by JD Digital Technology Holdings Co Ltd filed Critical JD Digital Technology Holdings Co Ltd
Priority to CN202010711401.3A priority Critical patent/CN111866143A/en
Publication of CN111866143A publication Critical patent/CN111866143A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/90—Determination of colour characteristics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
    • H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
    • H04L63/0442—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload wherein the sending and receiving network entities apply asymmetric encryption, i.e. different keys for encryption and decryption
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]

Abstract

The application relates to a remote data transmission method, a device and a monitoring system, wherein the method comprises the following steps: screenshot is carried out on the screen display content of the remote equipment according to preset screenshot parameters to obtain at least two continuous first images; generating media data from the first image; and sending the media data to a server according to a preset communication protocol, and monitoring the remote equipment by the server according to the video data. According to the technical scheme, the screen capture of the remote equipment is converted into the media data and then transmitted to the server, so that the screen display video of the remote equipment can be checked without the remote equipment acquiring the Root authority, malicious software is prevented from acquiring the Root authority of the remote equipment, the safety of the equipment is guaranteed, and meanwhile, the screen display content of the remote equipment is monitored.

Description

Remote data transmission method, device and monitoring system
Technical Field
The present application relates to the field of communications technologies, and in particular, to a remote data transmission method, an apparatus, and a monitoring system.
Background
At present, some used remote devices have low hardware configuration and cannot support the upgrading of an Android operating system, and the operating system below the Android5.0 is still used. For these remote devices using the operating system below Android5.0, the screen display content still needs to be monitored. Remote access enables access to the remote device over a network, and displays an interface of the remote device on the local computer device, thereby enabling monitoring of the remote device.
An operating system below Android5.0 can realize a screen recording function only by opening Root (Root) permission on remote equipment. In the process of implementing the present invention, the inventor finds that if the system is irreparably damaged after the Root authority of the remote device is acquired by the malicious software, all the privacy stored on the device will be exposed to the malicious software, and the security of the remote device is greatly reduced, which brings unknown risks. The android5.0 or above system has a screen recording function, but the screen can be recorded only after the screen recording authorization is manually clicked, so that the unattended remote equipment is inconvenient to operate and use.
Disclosure of Invention
In order to solve the technical problem or at least partially solve the technical problem, embodiments of the present application provide a remote data transmission method, an apparatus, and a monitoring system.
According to an aspect of an embodiment of the present application, there is provided a remote data transmission method, including:
screenshot is carried out on the screen display content of the remote equipment according to preset screenshot parameters to obtain at least two continuous first images;
generating media data from the first image;
and sending the media data to a server according to a preset communication protocol, and monitoring the remote equipment by the server according to the media data.
Optionally, the preset screen capture parameter includes a screen capture frequency and/or a screen capture resolution;
the method further comprises the following steps:
acquiring performance information of the remote equipment and/or communication state information between the remote equipment and the server;
and determining the preset screen capture parameters according to the equipment information and/or the communication state information.
Optionally, the media data includes video data; the generating media data from the first image comprises:
coding each first image according to a preset color space to obtain a second image;
converting the second image into a video frame;
the video data is formed from the video frames.
Optionally, the media data includes image data; the generating media data from the first image comprises:
acquiring video parameters; generating image data comprising the first image and the video parameters.
Optionally, the first image adopts an RGB color space; the preset color space is a YUV color space;
the encoding each first image according to a preset color space to obtain a second image includes:
acquiring the RGB value of each pixel point in the first image;
calculating a YUV value corresponding to the pixel point according to the RGB value;
and generating the second image according to the YUV value corresponding to each pixel point.
Optionally, the forming the video data according to the video frame includes:
acquiring video parameters;
creating a video file according to the video parameters;
and writing the video frame into the video file to obtain the video data.
Optionally, the sending the media data to the server according to a preset communication protocol includes:
acquiring a key generated by negotiation after handshake with the server;
packaging the media data into a data packet according to the preset communication protocol;
encrypting the data packet through the key to obtain an encrypted data packet;
and sending the encrypted data packet to the server.
Optionally, the screenshot of the screen display content of the remote device according to the preset frequency to obtain at least two continuous first images includes:
calling a preset method to capture the screen display content of the remote equipment according to the preset frequency to obtain a screen view;
and converting the screen view into a bitmap format to obtain the first image.
According to another aspect of the embodiments of the present application, there is provided a remote data transmission apparatus, including:
the screen capture module is used for capturing screen of the screen display content of the remote equipment according to preset screen capture parameters to obtain at least two continuous first images;
the video generation module is used for generating media data according to the first image;
and the transmission module is used for sending the media data to a server according to a preset communication protocol, and the server monitors the remote equipment according to the media data.
According to another aspect of an embodiment of the present application, there is provided a monitoring system including: a server and at least one on-screen display enabled remote device in communication with the server;
the remote equipment is used for carrying out screenshot on the screen display content according to preset screenshot parameters to obtain at least two continuous first images; generating media data from the first image; sending the media data to the server according to a preset communication protocol;
and the server is used for monitoring the remote equipment according to the media data.
According to another aspect of an embodiment of the present application, there is provided an electronic device including: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;
the memory is used for storing a computer program;
the processor is configured to implement the above method steps when executing the computer program.
According to another aspect of embodiments of the present application, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the above-mentioned method steps.
Compared with the prior art, the technical scheme provided by the embodiment of the application has the following advantages:
by converting the screenshot of the remote equipment into media data and transmitting the media data to the server, the screenshot of the remote equipment can be checked without the remote equipment acquiring the Root authority for the equipment with the android5.0 and the system below, malicious software is prevented from acquiring the Root authority of the remote equipment, and the safety of the equipment is guaranteed. In addition, for the equipment with the android5.0 and above system, the operation of applying for the authorization permission of the remote equipment is reduced, and the operation and the use of the unattended remote equipment are facilitated. Meanwhile, the monitoring of the screen display content of the remote equipment is realized.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present invention, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.
Fig. 1 is a flowchart of a remote data transmission method according to an embodiment of the present application;
fig. 2 is a flowchart of a remote data transmission method according to another embodiment of the present application;
fig. 3 is a flowchart of a remote data transmission method according to another embodiment of the present application;
fig. 4 is a flowchart of a remote data transmission method according to another embodiment of the present application;
fig. 5 is a flowchart of a remote data transmission method according to another embodiment of the present application;
fig. 6 is a block diagram of a remote data transmission apparatus according to an embodiment of the present application;
fig. 7 is a block diagram of a monitoring system according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The remote equipment is equipment provided with an Android system and has a screen display function. According to the method and the device, the Root authority of the remote equipment does not need to be acquired, the screen of the remote equipment is subjected to screenshot by calling an Android system screenshot method, media data corresponding to the screen of the remote equipment is generated through images obtained by screenshot according to a certain frequency, the media data are transmitted to the server, and the monitoring on the screen of the remote equipment can be achieved on the premise that the safety of the remote equipment is guaranteed.
The server is in communication connection with at least one remote device, and can acquire media data sent by each remote device in real time and check the currently displayed content of the screen of each remote device in real time, so that each remote device is monitored.
First, a remote data transmission method provided by an embodiment of the present invention is described below.
Fig. 1 is a flowchart of a remote data transmission method according to an embodiment of the present application. As shown in fig. 1, the method comprises the steps of:
and step S11, performing screenshot on the screen display content of the remote equipment according to the preset screenshot parameters to obtain at least two continuous first images.
The preset screen capture parameters may include a screen capture frequency and/or a screen capture resolution.
For example, the screen capture frequency may be 10 screen captures per second, i.e., every 0.1 second. In this way, a continuous image sequence comprising a plurality of first images is obtained. The screen capture resolution may be 240P, 360P, 480P, 720P … …
Optionally, the preset screen capture parameter may be a default screen capture frequency and screen capture resolution of the remote device itself. The preset screen capture parameter can also be modified by the server, the server can send a message including screen capture configuration information to the remote equipment, and the remote equipment adjusts the preset screen capture parameter to a frequency value corresponding to the screen capture configuration information. Optionally, the server may add the screenshot configuration information to a Socket message when performing a communication handshake with the remote device, and send the screenshot configuration information to the remote device.
In step S12, media data is generated from the first image.
Optionally, the media data may include video data and/or image data.
In this step, the remote device may generate video data from the first image, or may directly transmit the first image to the server, and the server converts the first image into video data.
And step S13, sending the media data to the server according to the preset communication protocol, and monitoring the remote equipment by the server according to the media data.
Optionally, the preset communication protocol may be a Web Real-time communication (WebRTC) protocol. Through the WebRTC protocol, the remote device and the server can be connected in a point-to-point manner (Peer-to-Peer) manner without an intermediary, so that the transmission of video data is realized.
In the embodiment, the screenshot of the remote equipment is converted into the media data and then transmitted to the server, so that the screen display video of the remote equipment can be checked without the remote equipment acquiring the Root authority for the equipment with the android5.0 or below, malicious software is prevented from acquiring the Root authority of the remote equipment, and the safety of the equipment is guaranteed. In addition, for the equipment with the android5.0 and above system, the operation of applying for the authorization permission of the remote equipment is reduced, and the operation and the use of the unattended remote equipment are facilitated. Meanwhile, the monitoring of the screen display content of the remote equipment is realized.
Optionally, the corresponding preset screen capture parameters may be selected according to the performance of the remote device itself and/or the communication condition between the remote device and the server. Specifically, the method further comprises:
acquiring performance information of the remote equipment and/or communication state information between the remote equipment and the server; and determining the preset screen capture parameters according to the equipment information and/or the communication state information.
The performance information of the remote device includes but is not limited to: the CPU index (such as calculation speed, storage speed, main frequency, etc.) of the remote device, the storage index (such as the size of memory, external memory, cache, etc.), the display card index (such as core frequency and display memory frequency, etc.), and so on.
The communication condition information may include communication parameters between the remote device and the server, such as network speed, bandwidth, and the like.
The higher the screen capturing frequency is, the more the remote device captures the image in unit time, the higher the screen capturing resolution is, the clearer the image captured by the remote device is, but the more the image is and/or the clearer the image is, the larger the data volume to be transmitted is, and the higher the requirement on the communication state between the remote device and the server is.
Therefore, when the remote device has higher performance and/or the communication condition between the remote device and the server is better and the data transmission rate is higher, the screen capture frequency and/or the screen capture resolution can be increased, for example, the screen capture frequency is 20 times/s, the screen capture resolution is 480P, and more and clearer images can be captured per second. When the remote device has low performance or poor communication conditions, the screen capture frequency and/or screen capture resolution may be reduced, such as 5 screen capture frequencies/s and 240P screen capture resolutions, with fewer or lower resolution images being acquired per second.
In the embodiment, the corresponding preset screen capture parameters can be selected according to the performance information and/or the communication state information of the remote equipment, so that more and clearer screen images can be captured as far as possible under the condition that the normal operation of the remote equipment and the normal transmission between the remote equipment and the server are not influenced, and thus, the server side can more accurately monitor the playing content of the screen of the remote equipment.
Optionally, the step S11 includes the following steps:
step A1, calling a preset method to perform screenshot on the screen display content of the remote equipment according to a preset frequency to obtain a screen view;
step A2, converting the screen view into a bitmap format to obtain a first image.
And in the Android system, a View. getDrawingCache method can be called to capture the screen display content of the remote equipment. The screenshot method does not need to apply for Root permission of the remote equipment. The truncated screen view is converted into a first image in a Bitmap (Bitmap) format by a view.
Bitmaps use Pixel-array/Dot-matrix lattices to represent images. The pixels of the bitmap are assigned specific positions and color information, the color information of each pixel is represented by three color values of RGB, each color value can be represented by 1 byte (8 bits). Therefore, each Bitmap image is represented by 24-bit RGB combined data, so that the image in the Bitmap format occupies a larger storage space, and after the image in the Bitmap format is converted into video data, the video file size is larger, and when the image is transmitted remotely, the occupied network bandwidth is larger, and the transmission time is longer.
In order to reduce the size and transmission time of video data, the color coding mode of the image can be changed, and a color coding mode with lower bandwidth occupation, such as YUV coding, is adopted.
Fig. 2 is a flowchart of a remote data transmission method according to another embodiment of the present application. As shown in fig. 2, the media data includes video data, and the step S12 includes:
step S21, coding each first image according to a preset color space to obtain a second image;
step S22, converting the second image into a video frame;
in step S23, video data is formed from the video frames.
The first image in the Bitmap format adopts an RGB color space; the preset color space is a YUV color space. Fig. 3 is a flowchart of a remote data transmission method according to another embodiment of the present application. As shown in fig. 3, the step S21 includes the following steps:
step S31, acquiring the RGB value of each pixel point in the first image;
step S32, calculating a YUV value corresponding to the pixel point according to the RGB value;
step S33, a second image is generated according to the YUV value corresponding to each pixel point.
The YUV value corresponding to the pixel point can be calculated according to the RGB value by the following formula:
Y＝0.299R+0.587G+0.114B
U＝-0.147R-0.289G+0.436B
V＝0.615R-0.515G-0.100B
wherein R represents a red color value, G represents a green color value, and B represents a blue color value. Y represents a Luminance value (luminence or Luma), i.e., a gray scale value; u and V represent Chroma (Chroma) which is used to describe color and saturation for specifying the color of a pixel.
Compared with RGB video data transmission, when YUV is adopted to code images, more luminance information can be reserved and less chrominance information can be stored in consideration of the specific vision of human eyes, so that the bandwidth occupied by chrominance is reduced, the size of image files can be greatly reduced, the size of video data formed by images is reduced, the occupation of network bandwidth during video data transmission is reduced, the subsequent video transmission efficiency is improved, and the transmission time is reduced.
In this embodiment, there are a plurality of formulas for calculating YUV values according to RGB values, and only one formula is illustrated here, and other calculation formulas may also be used in this embodiment. Fig. 4 is a flowchart of a remote data transmission method according to another embodiment of the present application. As shown in fig. 4, the step S23 includes the following steps:
step S41, acquiring video parameters;
wherein the video parameters include at least one of: video name, frame rate (FPS), video quality (visual quality), bitrate (Bit rate or data rate), compression type, and encoding method.
Step S42, creating a video file according to the video parameters;
in the process of creating the video file, the path of the video frame needs to be acquired, and meanwhile, the sizes of the video frames are the same.
And step S43, writing the video frame into the video file to obtain the video data.
In this embodiment, a function for converting an image sequence into a video, for example, a frameToVideo function, may be called to convert a video frame into a video file in an AVI format, where specific codes are as follows:
functionvideo＝frames2Video(framesPath,videoName,quality,Compressed,fps,startFrame,endFrame)
% framesPath of image sequence, ensuring the image size to be same
% videoName indicating the name of the video file to be created
Quality of generated video 0-100
% Compressed type, 'Indeno 3' (default), 'Indeno 5', 'Cinepak', 'MSVC', 'RLE' or 'None'
% fps frame Rate
% startFrame, endFrame; indicating which frame to start with and which frame to end with
if(exist('videoName','file'))
delete videoName.avi
end
Parameter setting of% generated video
aviobj ═ avifilm (videoname); % creates an avi video file object that is initially empty
aviobj.Quality＝quality；
aviobj.Fps＝fps；
aviobj.compression＝Compressed；
% read-in picture
fori＝startFrame:endFrame
filinmene ═ sprintf ('% 08d', i); % is based on the file name, where the file name is 00000001.jpg 00000002.jpg.
frames＝imread([framesPath,fileName,'.jpg'])；
aviobj＝addframe(aviobj,uint8(frames))；
end
aviobj ═ close (aviobj); % off create video
end
There are many ways to convert a continuous sequence of images into video, and no further description is given here. And after the second image is converted into a video frame, loading the video frame to a video source acquisition interface for subsequent video data transmission.
In another alternative embodiment, the media data includes image data, and step S12 includes: acquiring video parameters; generating image data comprising the first image and the video parameters.
Wherein the video parameters include at least one of: video name, frame rate (FPS), video quality, bitrate (also called Bit rate or data rate), compression type and encoding method, etc., parameters that can instruct a server to convert an image into video.
The remote equipment sends the image obtained by screen capture and the video parameters to the server, and the server converts the image into video.
Optionally, whether the remote device or the server performs the conversion operation of the image video may be selected according to the performance information of the remote device, the performance information of the server, the communication state information between the remote device and the server, and the like.
Because the occupation of the bandwidth by the image transmission is far larger than that by the video data transmission, and the server is not only connected with a remote device, the image and video conversion operation is executed by the server, the computing resource of the server is occupied, and the normal operation of the server is influenced. Therefore, if the bandwidth between the remote device and the server is not high and the performance index of the remote device can support the image-video conversion operation, the remote device converts the image into video data and sends the video data to the server after screenshot.
Fig. 5 is a flowchart of a remote data transmission method according to another embodiment of the present application. As shown in fig. 5, the step S13 includes the following steps:
step S51, acquiring a key generated by negotiation after handshake with the server;
step S52, packaging the media data into data packets according to the preset communication protocol;
step S53, the data packet is encrypted through the key to obtain an encrypted data packet;
step S54, the encrypted packet is sent to the server.
The step S13 is described in detail below by taking the WebRTC communication protocol as an example for transmitting video data.
Since the WebRTC protocol transmits video data based on an encrypted channel, handshaking between the remote device and the server is performed based on a packet Transport Layer Security protocol (DTLS), and a pair of keys (a public key and a private key) is generated by negotiation.
The remote device encapsulates video data into a Real-time Transport Protocol (RTP) data packet (RTP packet), encrypts the data packet by using a private key obtained by negotiation, and transmits the encrypted data packet (SRTP packet) to the server through a User Datagram Protocol (UDP).
The following are embodiments of the apparatus of the present application that may be used to perform embodiments of the method of the present application.
Fig. 6 is a block diagram of a remote data transmission apparatus provided in an embodiment of the present application, which may be implemented as part of or all of an electronic device through software, hardware, or a combination of the two. As shown in fig. 6, the remote data transmission apparatus includes:
the screenshot module 61 is configured to perform screenshot on the screen display content of the remote device according to preset screenshot parameters to obtain at least two continuous first images;
a video generation module 62 for generating media data from the first image;
and the transmission module 63 is configured to send the media data to the server according to a preset communication protocol, and the server monitors the remote device according to the media data.
Fig. 7 is a block diagram of a monitoring system according to an embodiment of the present application, as shown in fig. 7, the system includes a server 71 and at least one remote device 72 with a screen display function, which is in communication with the server 71;
the remote equipment 72 is used for carrying out screenshot on the screen display content according to preset screenshot parameters to obtain at least two continuous first images; generating media data from the first image; transmitting the media data to the server 71 according to a preset communication protocol;
a server 71 for monitoring the remote device 72 according to the media data.
In this embodiment, the server 71 may send a control instruction to the remote device 72, control the remote device 72 to start a screenshot, convert the screenshot into video data, and transmit the video data to the server 71. Alternatively, the remote device 72 may perform screenshots in real-time or on a timed basis, after which the images are converted to video data for transmission.
An embodiment of the present application further provides an electronic device, as shown in fig. 8, the electronic device may include: the system comprises a processor 1501, a communication interface 1502, a memory 1503 and a communication bus 1504, wherein the processor 1501, the communication interface 1502 and the memory 1503 complete communication with each other through the communication bus 1504.
A memory 1503 for storing a computer program;
the processor 1501, when executing the computer program stored in the memory 1503, implements the steps of the method embodiments described below.
The communication bus mentioned in the electronic device may be a peripheral component interconnect (pci) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
The present application further provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the method embodiments of:
screenshot is carried out on the screen display content of the remote equipment according to preset screenshot parameters to obtain at least two continuous first images;
generating media data from the first image;
and sending the media data to a server according to a preset communication protocol, and monitoring the remote equipment by the server according to the media data.
Optionally, the preset screen capture parameter includes a screen capture frequency and/or a screen capture resolution;
the method further comprises the following steps:
acquiring performance information of the remote equipment and/or communication state information between the remote equipment and the server;
and determining the preset screen capture parameters according to the equipment information and/or the communication state information.
Optionally, the media data includes video data; the generating media data from the first image comprises:
coding each first image according to a preset color space to obtain a second image;
converting the second image into a video frame;
the video data is formed from the video frames.
Optionally, the media data includes image data; the generating media data from the first image comprises:
acquiring video parameters; generating image data comprising the first image and the video parameters.
Optionally, the first image adopts an RGB color space; the preset color space is a YUV color space;
the encoding each first image according to a preset color space to obtain a second image includes:
acquiring the RGB value of each pixel point in the first image;
calculating a YUV value corresponding to the pixel point according to the RGB value;
and generating the second image according to the YUV value corresponding to each pixel point.
Optionally, the forming the video data according to the video frame includes:
acquiring video parameters;
creating a video file according to the video parameters;
and writing the video frame into the video file to obtain the video data.
Optionally, the sending the media data to the server according to a preset communication protocol includes:
acquiring a key generated by negotiation after handshake with the server;
packaging the media data into a data packet according to the preset communication protocol;
encrypting the data packet through the key to obtain an encrypted data packet;
and sending the encrypted data packet to the server.
Optionally, the screenshot of the screen display content of the remote device according to the preset frequency to obtain at least two continuous first images includes:
calling a preset method to capture the screen display content of the remote equipment according to the preset frequency to obtain a screen view;
and converting the screen view into a bitmap format to obtain the first image.
It should be noted that, for the above-mentioned apparatus, electronic device and computer-readable storage medium embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiments.
It is further noted that, herein, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The foregoing are merely exemplary embodiments of the present invention, which enable those skilled in the art to understand or practice the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (12)

1. A method for remote data transmission, comprising:
screenshot is carried out on the screen display content of the remote equipment according to preset screenshot parameters to obtain at least two continuous first images;
generating media data from the first image;
and sending the media data to a server according to a preset communication protocol, and monitoring the remote equipment by the server according to the media data.
2. The method of claim 1, wherein the preset screen capture parameters comprise a screen capture frequency and/or a screen capture resolution;
the method further comprises the following steps:
acquiring performance information of the remote equipment and/or communication state information between the remote equipment and the server;
and determining the preset screen capture parameters according to the equipment information and/or the communication state information.
3. The method of claim 1, wherein the media data comprises video data; the generating media data from the first image comprises:
coding each first image according to a preset color space to obtain a second image;
converting the second image into a video frame;
the video data is formed from the video frames.
4. The method of claim 1, wherein the media data comprises image data; the generating media data from the first image comprises:
acquiring video parameters; generating image data comprising the first image and the video parameters.
5. The method of claim 3, wherein the first image employs an RGB color space; the preset color space is a YUV color space;
the encoding each first image according to a preset color space to obtain a second image includes:
acquiring the RGB value of each pixel point in the first image;
calculating a YUV value corresponding to the pixel point according to the RGB value;
and generating the second image according to the YUV value corresponding to each pixel point.
6. The method of claim 3, wherein said forming the video data from the video frames comprises:
acquiring video parameters;
creating a video file according to the video parameters;
and writing the video frame into the video file to obtain the video data.
7. The method according to claim 1, wherein the sending the video data to the server according to a preset communication protocol comprises:
acquiring a key generated by negotiation after handshake with the server;
packaging the media data into a data packet according to the preset communication protocol;
encrypting the data packet through the key to obtain an encrypted data packet;
and sending the encrypted data packet to the server.
8. The method of claim 1, wherein the screenshot of the remote device screen display content according to the preset frequency to obtain at least two consecutive first images comprises:
calling a preset method to capture the screen display content of the remote equipment according to the preset frequency to obtain a screen view;
and converting the screen view into a bitmap format to obtain the first image.
9. A remote data transmission apparatus, comprising:
the screen capture module is used for capturing screen of the screen display content of the remote equipment according to preset screen capture parameters to obtain at least two continuous first images;
the video generation module is used for generating media data according to the first image;
and the transmission module is used for sending the media data to a server according to a preset communication protocol, and the server monitors the remote equipment according to the media data.
10. A monitoring system, comprising: a server and at least one on-screen display enabled remote device in communication with the server;
the remote equipment is used for carrying out screenshot on the screen display content according to preset screenshot parameters to obtain at least two continuous first images; generating media data from the first image; sending the media data to the server according to a preset communication protocol;
and the server is used for monitoring the remote equipment according to the media data.
11. An electronic device, comprising: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;
the memory is used for storing a computer program;
the processor, when executing the computer program, implementing the method steps of any of claims 1-8.
12. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method steps of any one of claims 1 to 8.
CN202010711401.3A 2020-07-22 2020-07-22 Remote data transmission method, device and monitoring system Pending CN111866143A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010711401.3A CN111866143A (en) 2020-07-22 2020-07-22 Remote data transmission method, device and monitoring system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010711401.3A CN111866143A (en) 2020-07-22 2020-07-22 Remote data transmission method, device and monitoring system

Publications (1)

Publication Number Publication Date
CN111866143A true CN111866143A (en) 2020-10-30

Family

ID=72949174

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010711401.3A Pending CN111866143A (en) 2020-07-22 2020-07-22 Remote data transmission method, device and monitoring system

Country Status (1)

Country Link
CN (1) CN111866143A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112543348A (en) * 2020-11-27 2021-03-23 深圳市慧为智能科技股份有限公司 Remote screen recording method, device, equipment and computer readable storage medium
CN112700742A (en) * 2021-01-07 2021-04-23 中科网联数据科技有限公司 Advertising screen monitoring system and method
CN112929704A (en) * 2021-01-26 2021-06-08 游密科技(深圳)有限公司 Data transmission method, device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102609637A (en) * 2011-12-20 2012-07-25 北京友维科软件科技有限公司 Audit protection system for data leakage
CN103414890A (en) * 2013-07-08 2013-11-27 宇龙计算机通信科技(深圳)有限公司 Realization method of remote desktop and device thereof
CN103414751A (en) * 2013-07-16 2013-11-27 广东工业大学 PC screen content sharing/interaction control method
CN105988688A (en) * 2016-01-22 2016-10-05 腾讯科技（深圳）有限公司 Screen capture method and apparatus
CN110430467A (en) * 2019-07-11 2019-11-08 阿里巴巴集团控股有限公司 Remote-apparatus access method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102609637A (en) * 2011-12-20 2012-07-25 北京友维科软件科技有限公司 Audit protection system for data leakage
CN103414890A (en) * 2013-07-08 2013-11-27 宇龙计算机通信科技(深圳)有限公司 Realization method of remote desktop and device thereof
CN103414751A (en) * 2013-07-16 2013-11-27 广东工业大学 PC screen content sharing/interaction control method
CN105988688A (en) * 2016-01-22 2016-10-05 腾讯科技（深圳）有限公司 Screen capture method and apparatus
CN110430467A (en) * 2019-07-11 2019-11-08 阿里巴巴集团控股有限公司 Remote-apparatus access method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
李超: "基于流媒体的Android远程桌面的设计与实现", 《硕士论文》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112543348A (en) * 2020-11-27 2021-03-23 深圳市慧为智能科技股份有限公司 Remote screen recording method, device, equipment and computer readable storage medium
CN112700742A (en) * 2021-01-07 2021-04-23 中科网联数据科技有限公司 Advertising screen monitoring system and method
CN112929704A (en) * 2021-01-26 2021-06-08 游密科技(深圳)有限公司 Data transmission method, device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN111866143A (en) Remote data transmission method, device and monitoring system
US8259816B2 (en) System and method for streaming video to a mobile device
US9699099B2 (en) Method of transmitting data in a communication system
CN106470345B (en) Video encryption transmission method, video decryption method, video encryption transmission device, video decryption device and video encryption transmission system
US6445824B2 (en) Data transmission with receiver side control
JP6338688B2 (en) Video synchronized playback method, apparatus, and system
TWI443641B (en) Transmitting device, receiving device, screen frame transmission system and method
EP2272237B1 (en) Method of transmitting data in a communication system
EP2152004A2 (en) Image providing apparatus, image displaying apparatus, image transmitting system and image transmitting method using the same
CN106851172A (en) The call method of camera, apparatus and system
CN109729299A (en) A kind of sending, receiving method and device of ultra high-definition video
CN104639501B (en) A kind of method of data stream transmitting, equipment and system
JP2009171060A (en) Image processing device and its control method
CN111782876A (en) Data processing method, device and system and storage medium
AU760841B2 (en) Method and apparatus of supporting a video protocol in a network environment
CN108737877B (en) Image processing method and device and terminal equipment
US9936173B2 (en) Method for processing image and apparatus thereof
CN107995524A (en) A kind of FTP client FTP and its design, data processing method for connecting network video server
TWI543603B (en) Ip camera, communication method and communication system
CN113141352A (en) Multimedia data transmission method and device, computer equipment and storage medium
JP2007208931A (en) Encryption method of digital data, data transmission method and device, data receiver, data communication system, and imaging apparatus
KR102397813B1 (en) Composite data transfer system with HDMI image transmission cable
EP3079344B1 (en) Image pickup apparatus, image pickup method and image pickup system
JP2007300386A (en) Network decoding apparatus
TW201534125A (en) Remote video monitoring system and method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: Room 221, 2 / F, block C, 18 Kechuang 11th Street, Daxing District, Beijing, 100176

Applicant after: Jingdong Technology Holding Co.,Ltd.

Address before: Room 221, 2 / F, block C, 18 Kechuang 11th Street, Daxing District, Beijing, 100176

Applicant before: Jingdong Digital Technology Holding Co.,Ltd.

RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20201030