CN106412617B

CN106412617B - Remote debugging control method and device

Info

Publication number: CN106412617B
Application number: CN201610812349.4A
Authority: CN
Inventors: 曹雨
Original assignee: Guangzhou Huaduo Network Technology Co Ltd
Current assignee: Guangzhou Cubesili Information Technology Co Ltd
Priority date: 2016-09-08
Filing date: 2016-09-08
Publication date: 2019-12-06
Anticipated expiration: 2036-09-08
Also published as: CN106412617A

Abstract

The application discloses a remote debugging control method and a device, wherein the method comprises the following steps: the method comprises the steps that a controlled terminal obtains a screen image of a specific area in a user interface of the controlled terminal, performs preset high-definition compression on the screen image, generates a high-definition data packet meeting a high-definition standard, and transmits the high-definition data packet to a master control terminal with established remote control connection; the master control end receives the high-definition data packet, decompresses the high-definition data packet, restores a high-definition image meeting high-definition standards, displays the high-definition image, and transmits a picture debugging instruction to the controlled end through a remote control interface of the master control end based on the displayed high-definition image. By implementing the method and the device, the speed of restoring the high-definition image at the main control end is high, the time delay between the main control end and the played image of the controlled end is small, the image quality difference is small, and the high-quality image after debugging can be seen in real time while the controlled end image is debugged quickly and timely through the main control end.

Description

remote debugging control method and device

Technical Field

The application relates to the technical field of computers, in particular to a remote debugging control method and device.

Background

a webcast system is an internet system that broadcasts live video images of a host user to a plurality of viewer users for viewing. The live video images of the network live system are collected by client equipment of a main broadcast user, the client equipment of the main broadcast user collects the live video images of the main broadcast user, and the live video images are transmitted to a server. The server transmits the live video image to the corresponding audience client by the broadcast or multicast technology, and each audience client receives and displays the live video image.

in order to achieve a better live broadcast effect, the live broadcast video images collected by client equipment of a main broadcast user can be beautifully debugged, the beautifully debugged generally needs a remote end to perform auxiliary debugging, during auxiliary debugging, the remote end is firstly remote right the live broadcast video images are debugged in advance, then the debugging effect is checked through watching the live broadcast images in a live broadcast channel, and the beautifully debugged again according to the checked debugging effect.

however, after the pre-debugging is completed, the live broadcast image can be watched in the live broadcast channel for at least 2 to 4 seconds, so the method for debugging the beauty is difficult to adjust the picture quality of the live broadcast video image in time, and the timeliness of the debugging the beauty is poor.

disclosure of Invention

the application provides a remote debugging control method and device, which are used for solving the problem that the prior debugging technology is difficult to remotely and timely adjust the picture quality of a live video image.

according to a first aspect of embodiments of the present application, there is provided a remote debugging control method, including the steps of:

the method comprises the steps that a controlled terminal obtains a screen image of a specific area in a user interface of the controlled terminal, performs preset high-definition compression on the screen image to generate a high-definition data packet meeting a high-definition standard, and transmits the high-definition data packet to a main control terminal which establishes remote control connection, wherein the specific area at least comprises a partial picture playing area;

the master control end receives the high-definition data packet, decompresses the high-definition data packet, restores a high-definition image meeting high-definition standards, displays the high-definition image, and transmits a picture debugging instruction to the controlled end through a remote control interface of the master control end based on the displayed high-definition image.

in one embodiment, before the controlled terminal obtains the screen image of the specific area in the user interface, the method further includes:

the main control end outputs the image of the user interface on the remote control interface, acquires the area parameter triggered by the user through the remote control interface, generates a screen capturing instruction comprising the area parameter, and transmits the screen capturing instruction to the controlled end, wherein the area parameter is the boundary coordinate of the specific area in the user interface;

the controlled terminal acquires a screen image of a specific area in a user interface thereof, and the method comprises the following steps:

And the controlled terminal receives the screen intercepting instruction, responds to the screen intercepting instruction, acquires a full-screen image of the user interface, and intercepts the screen image from the full-screen image according to the area parameters.

in one embodiment, after the screen image is intercepted from the full-screen image according to the area parameter, the method further includes:

the method comprises the steps that a controlled terminal conducts preset low-definition compression on a intercepted full-screen image to generate a low-definition data packet meeting a low-definition standard, and the low-definition data packet is transmitted to a main control terminal;

And the main control end receives the low-definition data packet, decompresses the low-definition data packet, restores a low-definition image meeting a low-definition standard, superimposes the high-definition image to a specific area in the low-definition image based on the area parameter to generate a restored image, and displays the restored image on the remote control interface as the image of the user interface.

In one embodiment, the preset high definition compression rate is 10% to 20%, and the preset low definition compression rate is 2.5% to 10%.

In one embodiment, the screen debugging instruction comprises an instruction for debugging beauty parameters and/or an instruction for debugging camera parameters.

According to a second aspect of the embodiments of the present application, there is provided a remote debugging control method, including the steps of:

acquiring a screen image of a specific area in a user interface of a home terminal, wherein the specific area at least comprises a partial picture playing area;

Performing preset high-definition compression on the screen image to generate a high-definition data packet meeting a high-definition standard;

And transmitting the high-definition data packet to a master control end which establishes remote control connection with the home terminal so that the master control end can restore a high-definition image based on the high-definition data packet and transmit a picture debugging instruction to a controlled end through a remote control interface.

in one embodiment, the acquiring a screen image of a specific area in a user interface of the home terminal includes:

receiving a screen capture instruction transmitted by a main control end, wherein the screen capture instruction comprises area parameters of the specific area, and the screen capture instruction is triggered by a user of the main control end through the remote control interface;

responding to the screen interception instruction, and acquiring a full-screen image of the user interface;

and intercepting the screen image from the full-screen image according to the region parameter.

Performing preset low-definition compression on the intercepted full-screen image to generate a low-definition data packet meeting a low-definition standard;

And transmitting the low-definition data packet to a master control end so that the master control end transmits a picture debugging instruction to a controlled end through a remote control interface based on the image restored by the low-definition data packet and the high-definition data packet.

According to a third aspect of the embodiments of the present application, there is provided a remote debugging control method, including the steps of:

receiving a high-definition data packet which is transmitted by a controlled end and is in remote control connection with a home end and meets a high-definition standard, wherein the high-definition data packet is generated by preset high-definition compression of a screen image of a specific area in a user interface of the controlled end, and the specific area at least comprises a partial image playing area;

Decompressing the high-definition data packet to restore a high-definition image meeting a high-definition standard;

And displaying the high-definition image, and transmitting a picture debugging instruction to the controlled end through a remote control interface of the local end based on the displayed high-definition image.

In one embodiment, before receiving a high definition data packet that meets a high definition standard and is transmitted by a controlled end that has established a remote control connection with a home end, the method further includes:

Outputting an image of the user interface at the remote control interface;

acquiring area parameters triggered by a user through the remote control interface;

Generating a screen intercepting instruction comprising the area parameters, and transmitting the screen intercepting instruction to a controlled end so that the controlled end intercepts the screen image from a full-screen image of the user interface according to the screen intercepting instruction, wherein the area parameters are boundary coordinates of the specific area in the user interface.

In one embodiment, the method further comprises:

Receiving the low-definition data packet, wherein the low-definition data packet is generated by capturing a full-screen image of the screen image and performing preset low-definition compression;

Decompressing the low-definition data packet to restore a low-definition image meeting a low-definition standard;

Based on the region parameters, the high-definition image is superposed to a specific region in the low-definition image to generate a restored image;

and displaying the restored image on the remote control interface as an image of the user interface.

According to a fourth aspect of the embodiments of the present application, there is provided a remote debugging control apparatus, including a controlled end and a main control end that establishes a remote control connection with the controlled end, wherein:

the controlled end includes:

the system comprises a screen image acquisition module, a screen image acquisition module and a display module, wherein the screen image acquisition module is used for acquiring a screen image of a specific area in a user interface of a home terminal, and the specific area at least comprises a partial picture playing area;

The high-definition compression module is used for carrying out preset high-definition compression on the screen image to generate a high-definition data packet meeting a high-definition standard;

The high-definition data packet transmission module is used for transmitting the high-definition data packet to the main control end;

The main control end comprises:

The high-definition data packet receiving module is used for receiving the high-definition data packet;

the high-definition decompression module is used for decompressing the high-definition data packet to restore a high-definition image meeting a high-definition standard;

the image display module is used for displaying the high-definition image;

and the remote debugging module is used for transmitting a picture debugging instruction to the controlled end through a remote control interface of the local end based on the displayed high-definition image.

In one embodiment, the main control terminal further includes:

the interface image output module is used for outputting the image of the user interface on the remote control interface;

The area parameter acquisition module is used for acquiring area parameters triggered by a user through the remote control interface and generating a screen capture instruction comprising the area parameters;

the intercepting instruction transmitting module is used for transmitting the screen intercepting instruction to a controlled end, and the area parameter is a boundary coordinate of the specific area in the user interface;

the screen image acquisition module includes:

the interception instruction receiving module is used for receiving the screen interception instruction;

A full screen image obtaining module, configured to respond to the screen capture instruction and obtain a full screen image of the user interface;

and the screen image intercepting module is used for intercepting the screen image from the full-screen image according to the area parameters.

In one embodiment, the controlled terminal further comprises:

the low-definition compression module is used for performing preset low-definition compression on the intercepted full-screen image to generate a low-definition data packet meeting a low-definition standard;

The low-definition data packet transmission module is used for transmitting the low-definition data packet to the master control end;

The main control end also comprises:

The low-definition data packet receiving module is used for receiving the low-definition data packet;

The low-definition decompression module is used for decompressing the low-definition data packet to restore a low-definition image meeting a low-definition standard;

the image display module includes:

The image superposition module is used for superposing the high-definition image to a specific area in the low-definition image based on the area parameters to generate a restored image;

And the interface display module is used for displaying the restored image as the image of the user interface on the remote control interface.

according to a fifth aspect of embodiments of the present application, there is provided a remote debugging control apparatus, including:

And the high-definition data packet transmission module is used for transmitting the high-definition data packet to the master control end which establishes remote control connection with the home terminal so that the master control end transmits a picture debugging instruction to the controlled end through a remote control interface based on the high-definition image.

In one embodiment, the screen image acquisition module includes:

the intercepting instruction receiving module is used for receiving a screen intercepting instruction transmitted by the main control terminal, the screen intercepting instruction comprises area parameters of the specific area, and the screen intercepting instruction is triggered by the main control terminal user through the remote control interface;

in one embodiment, the apparatus further comprises:

And the low-definition data packet transmission module is used for transmitting the low-definition data packet to the master control end so that the master control end transmits a picture debugging instruction to the controlled end through a remote control interface based on the image restored by the low-definition data packet and the high-definition data packet.

according to a sixth aspect of the embodiments of the present application, there is provided a remote debugging control apparatus including:

the high-definition data packet receiving module is used for receiving a high-definition data packet which is transmitted by a controlled end and is in remote control connection with the local end and meets a high-definition standard, the high-definition data packet is generated by compressing a screen image of a specific area in a user interface of the controlled end through a preset high definition, and the specific area at least comprises a partial image playing area;

The image display module is used for displaying the high-definition image;

In one embodiment, the apparatus further comprises:

the area parameter acquisition module is used for acquiring an area parameter triggered by a user through the remote control interface, wherein the area parameter is a boundary coordinate of the specific area in the user interface;

and the interception instruction transmitting module is used for generating a screen interception instruction comprising the area parameters and transmitting the screen interception instruction to the controlled end so that the controlled end intercepts the screen image from the full-screen image of the user interface according to the screen interception instruction.

In one embodiment, the apparatus further comprises:

the low-definition data packet receiving module is used for receiving the low-definition data packet, and the low-definition data packet is generated by performing preset low-definition compression on a full-screen image obtained after the screen image is intercepted;

the image display module includes:

by applying the embodiment of the application, the screen image of the specific area at least including the partial picture playing area in the user interface of the controlled terminal is acquired, the screen image is subjected to preset high-definition compression, a high-definition data packet meeting high-definition standards is generated, and the high-definition data packet is transmitted to the main control terminal which is connected with the remote control, and then is received by the main control terminal, the high-definition data packet is decompressed, the high-definition image meeting the high-definition standards is restored, and the high-definition image is displayed and is transmitted to the controlled terminal through the remote control interface of the local terminal to debug the picture. The high-definition images can be restored at the speed of the main control end, the time delay between the restored high-definition images and the played images of the controlled end is small, the image quality difference is small, the main control end can adjust the image quality of the image playing window quickly and timely, and meanwhile the high-quality images after debugging can be seen in real time.

it is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.

FIG. 1 is a system architecture diagram of an embodiment of the present application implementing remote debug control;

FIG. 2a is a flow chart of an embodiment of a remote debugging control method of the present application;

FIG. 2b is a first schematic diagram of an image of a user interface in the remote debugging control method in the embodiment of the present application;

FIG. 2c is a second schematic diagram of an image of a user interface in the remote debugging control method in the embodiment of the present application;

FIG. 2d is a diagram illustrating a screen image of a specific area of a remote debugging control method in an embodiment of the present application;

FIG. 3 is a flow chart of another embodiment of a remote debug control method of the present application;

FIG. 4 is a flow chart of another embodiment of a remote debug control method of the present application;

Fig. 5 is a hardware structure diagram of a terminal where the remote debugging control device of the present application is located;

FIG. 6 is a block diagram of one embodiment of a remote commissioning control apparatus of the present application;

FIG. 7 is a block diagram of another embodiment of a remote commissioning control apparatus of the present application;

fig. 8 is a block diagram of another embodiment of a remote commissioning control apparatus according to the present application.

Detailed Description

reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

it is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present application. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.

referring to fig. 1, fig. 1 is a schematic structural diagram of a system for implementing remote debugging control according to an embodiment of the present application, where the system 100 includes a controlled end 110 and a main control end 120 establishing remote control connection with the controlled end 110, and the main control end 120 may establish remote control connection with the controlled end 110 through remote control software to perform remote control on the controlled end 110. When performing remote control, the command input by the main control terminal 120 through the keyboard and/or the mouse is transmitted to the controlled terminal 110, and the image of the user interface of the controlled terminal 110 can also be transmitted back through the communication line. The remote control software may be a TeamViewer, a VNC (Virtual Network Computer), or the like.

The controlled end 110 and the master end 120 are devices capable of processing pictures such as video and images, and the processing here includes operations such as playing, capturing, compressing, decompressing, and debugging the image quality. The user operates the main control end 120, and the image of the user interface of the controlled end 110 displayed on the remote control interface of the main control end 120 can be used to perform debugging control on the picture quality of the controlled end 110 remotely, where the debugging control may include debugging control of beauty parameters or debugging control of camera parameters.

When performing remote debugging control, in order to save the communication bandwidth between the master control end 120 and the controlled end 110, before the image of the user interface of the controlled end 110 is returned to the master control end 120 through the communication line, the controlled end 110 performs image compression on the image of the user interface, and the compression rate of the image compression is high, so that the distortion of the compressed image is large, and when a user of the master control end 120 performs debugging control based on the image quality of the controlled end 110 with large distortion, it is difficult to accurately and timely debug the image quality of the controlled end 110 to the degree that the user of the controlled end 110 is satisfied.

In the remote debugging control method according to the embodiment of the application, in the implementation process of returning the image of the user interface of the controlled end 110 to the main control end 120 through the communication line, the image of the picture playing area in the user interface of the controlled end 110 may be additionally subjected to high-definition compression, and then the data packet after the high-definition compression is transmitted to the main control end 120, the main control end 120 restores the high-definition image of the picture playing area and displays the restored high-definition image, when the user of the main control end 120 performs picture quality debugging control based on the high-definition image, the image of the picture playing area seen by the user of the main control end 120 is the high-definition image, and the distortion between the image of the picture playing area of the controlled end 110 and the image of the picture playing area is small, so that the picture quality debugging control can be performed on the controlled end 110 more accurately according to the high-definition image displayed by.

In addition, the image playing area of the present application is a smaller area in the current user interface of the controlled terminal 110, so that the bandwidth occupied by the high definition compressed data packet is smaller, and the influence on the fluency of the remote control operation is smaller.

in a certain scenario, the controlled terminal 110 is a live broadcast device equipped with a main broadcast client, and is capable of collecting a live broadcast video stream of a main broadcast user, playing the live broadcast video stream in a main broadcast video window of the controlled terminal, and transmitting the live broadcast video stream to a server, where the server transmits the live broadcast video stream to corresponding viewer clients through a broadcast or multicast technology, and each viewer client receives and displays the live broadcast video stream. By the remote debugging control method of the embodiment of the application, the user operating the main control end 120 can remotely debug and control the picture quality of the live broadcast picture of the controlled end 110, for example, debug and control the beauty parameters of the live broadcast picture or debug and control the shooting parameters of a camera acquiring the live broadcast video stream.

the embodiments of the present application will be described in detail below with reference to fig. 1.

referring to fig. 2a, fig. 2a is a flowchart of an embodiment of a remote debugging control method according to the present application, where the embodiment is implemented by interaction between a master control end and a controlled end shown in fig. 1, and includes the following steps 201 and 206:

Step 201: the controlled terminal obtains a screen image of a specific area in a user interface of the controlled terminal, wherein the specific area at least comprises a partial picture playing area.

in this application embodiment, the controlled end can be live broadcast equipment provided with a main broadcast client, and can acquire live broadcast video streams of live broadcast objects through a front camera or a rear camera of the controlled end, for example, desktop computers, handheld tablet computers and other equipment.

In practical application, when the screen image of the specific area is obtained, the screen image of the specific area can be obtained through the screen capture function of the controlled terminal, and the screen image of the specific area can also be obtained through the screen capture function of some applications. The specific area may refer to an entire picture playing area or a partial picture playing area of the controlled terminal, where the picture playing area is used for playing pictures such as videos and images. In some scenarios, the frame playing area may be a live video window of a live application, an on-demand video window of a video website, a video playing window of a video client, and the like.

In some examples, the screen image may be obtained through interaction between the controlled terminal and the main control terminal, and the obtaining process is as follows:

The method comprises the steps that a main control end outputs an image of a user interface on a remote control interface of the main control end, obtains area parameters triggered by a user through the remote control interface, generates a screen capture instruction comprising the area parameters, and transmits the screen capture instruction to a controlled end, wherein the area parameters are boundary coordinates of a specific area in the user interface.

In this example, the user may select a frame playing area of the remote control interface by frame to trigger the area parameter.

in some scenarios, the controlled end is a live device installed with a main broadcasting client, the image of the current user interface of the controlled end may be as shown in fig. 2b, the specific area may be as a black box area indicated by an arrow in fig. 2b, and the area parameters of the specific area may include vertex coordinates x and y at the upper left corner of the box area, and a width w and a height h of the box area.

after the screen image is cut out from the image shown in fig. 2b, the cut-out image is shown in fig. 2c, and the screen image is shown in fig. 2 d.

step 202: and the controlled terminal performs preset high-definition compression on the screen image to generate a high-definition data packet meeting a high-definition standard.

in the embodiment of the application, the preset compression ratio of the high definition compression is 10% to 20%, the high definition standard is determined by the compression ratio of the high definition compression, if the compression ratio of the image with the same resolution is high, the code rate is low, and the display effect is poor, namely the low definition standard in the embodiment of the application; if the compression ratio is low, the code rate is high, and the display effect is good, namely the high definition standard in the embodiment of the application.

Step 203: and the controlled end transmits the high-definition data packet to the master control end which establishes the remote control connection.

Step 204: and the master control end receives the high-definition data packet.

in the embodiment of the application, the master control end can remotely control the picture playing quality of the controlled end, such as intelligent devices like desktop computers and notebook computers.

Step 205: and the master control end decompresses the high-definition data packet to restore a high-definition image meeting a high-definition standard.

in the embodiment of the present application, the decompression performed on the high definition data packet corresponds to the preset high definition compression performed by the controlled end.

step 206: and displaying the high-definition image, and transmitting a picture debugging instruction to the controlled end through a remote control interface of the local end based on the displayed high-definition image.

In the embodiment of the application, when the master control end displays the high-definition image, the high-definition image can be superposed into the remote control interface displayed by the local end. When the picture quality debugging control is carried out, the image of the picture playing area of the controlled end, which is seen by the user of the main control end, is a high-definition image, and the distortion between the image and the image of the picture playing area of the controlled end is small.

In practical application, the picture debugging instruction comprises an instruction for debugging beauty parameters and/or an instruction for debugging camera parameters. The user triggers a corresponding button or menu in the remote control interface of the main control end to generate the picture debugging instruction.

In other examples, a pure color region exists in the intercepted full-screen image, such as a pure color block shown in fig. 2c, and the amount of information in the pure color region after encoding is small, so that the compression rate is high when compression is performed, and in order to further save the communication bandwidth between the master control end and the controlled end, the remote debugging control method in the embodiment of the present application may further include the following operations:

The controlled end can obtain a full screen image of a user interface of the controlled end, the screen image of the specific area is intercepted from the full screen image, preset high-definition compression is carried out on the screen image to generate a high-definition data packet meeting a high-definition standard, then preset low-definition compression is carried out on the intercepted full screen image to generate a low-definition data packet meeting a low-definition standard, and the high-definition data packet and the low-definition data packet are used as compressed data packets corresponding to the image of the user interface of the controlled end and are transmitted back to the main control end through a communication line.

the master control end receives the high-definition data packet and the low-definition data packet, respectively decompresses the high-definition data packet and the low-definition data packet, restores a high-definition image meeting a high-definition standard and a low-definition image meeting a low-definition standard, superimposes the high-definition image on a screen capture area in the low-definition image to generate a restored image, the screen capture area is a specific area represented by the area parameters, the restored image is displayed on a remote control interface of the master control end as an image of a current user interface of the controlled end, and remote debugging control is performed on the image quality of the controlled end on the remote control interface.

in this example, the preset high definition compression rate is 10% to 20%, and the preset low definition compression rate is 2.5% to 10%.

In addition, the intercepted full-screen image has a pure color area, namely the specific area, and the information amount of the pure color area after being encoded is less, so that the compression ratio is higher when low definition compression is carried out, and the bandwidth occupied by a low definition data packet can be further reduced. Moreover, the image of the picture playing area contained in the restored image is a high-definition image, and the distortion between the image of the picture playing area of the controlled end and the image of the picture playing area of the controlled end is small, so that the remote debugging control on the picture quality of the controlled end can be more accurately carried out according to the high-definition image displayed by the main control end.

when low-definition compression or high-definition compression is performed, an image with compression can be divided into a plurality of squares, each square is numbered, whether data in each square is changed or not is judged, the changed squares are selected, and the low-definition compression or the high-definition compression is performed according to a compression mode of a Joint Photographic Experts Group (JPEG) picture.

Referring to fig. 3, fig. 3 is a flowchart of another embodiment of the remote debugging control method of the present application, which can be applied to the controlled terminal shown in fig. 1, and includes the following steps 301 and 303:

Step 301: acquiring a screen image of a specific area in a user interface of a home terminal, wherein the specific area at least comprises a partial picture playing area.

In the embodiment of the application, the controlled terminal can be live broadcast equipment provided with a main broadcast client, and can acquire live broadcast video streams of live broadcast objects through a front camera or a rear camera of the controlled terminal, for example, equipment such as a smart phone and a handheld tablet computer.

In practical application, when the screen image of the specific area is obtained, the screen image of the specific area can be obtained through the screen capture function of the controlled terminal, and the screen image of the specific area can also be obtained through the screen capture function of some applications.

in some examples, the method may further include obtaining the screen image of the specific area in response to a screen capture instruction of the main control terminal, where the obtaining process is as follows:

Receiving a screen capture instruction transmitted by a main control end, wherein the screen capture instruction comprises the area parameters of the specific area, and the screen capture instruction is triggered by a user of the main control end through a remote control interface of the main control end.

And responding to the screen interception instruction, and acquiring a full-screen image of the user interface.

in some scenarios, the controlled end is a live device installed with a main broadcasting client, then the image of the current user interface of the controlled end is shown in fig. 2b, the specific area is a black box area indicated by an arrow in fig. 2b, and the area parameters of the specific area may include vertex coordinates x and y at the upper left corner of the box area, and a width w and a height h of the box area.

After the screen image is cut out of the image shown in fig. 2b, the cut-out image is shown in fig. 2c, the screen image is shown in fig. 2d,

Step 302: and carrying out preset high-definition compression on the screen image to generate a high-definition data packet meeting a high-definition standard.

in other examples, after the screen image is captured from the full-screen image according to the area parameter and a preset high-definition compression is performed on the screen image, because the captured full-screen image has a pure color area and the amount of information of the pure color area after encoding is small, when compression is performed, the compression rate is high, and in order to further save the communication bandwidth between the master control end and the controlled end, the remote debugging control method in the embodiment of the present application may further include the following operations:

and performing preset low-definition compression on the intercepted full-screen image to generate a low-definition data packet meeting a low-definition standard.

The preset low-definition compression rate is 2.5% to 10%, the low-definition standard is determined by the low-definition compression rate, if the compression ratio of the image with the same resolution is high, the code rate is low, and the display effect is poor, namely the low-definition standard in the embodiment of the application; if the compression ratio is low, the code rate is high, and the display effect is good, namely the high definition standard in the embodiment of the application.

in addition, in order to facilitate the master to restore the user interface based on the low-definition data packet and the high-definition data packet, the area parameter of the specific area may be transmitted to the master corresponding to the low-definition data packet.

Step 303: and transmitting the high-definition data packet to a master control end which establishes remote control connection with the home terminal so that the master control end can restore a high-definition image based on the high-definition data packet and transmit a picture debugging instruction to a controlled end through a remote control interface.

in the embodiment of the application, the high-definition data packet can be transmitted to the master control end through a signaling protocol between the master control end and the controlled end.

Referring to fig. 4, fig. 4 is a flowchart of another embodiment of the remote debugging control method of the present application, where the embodiment can be applied to the master control end shown in fig. 1, and includes the following steps 401 and 403:

step 401: receiving a high-definition data packet which is transmitted by a controlled end and is in remote control connection with the local end and meets a high-definition standard, wherein the high-definition data packet is generated by preset high-definition compression of a screen image of a specific area in a user interface of the controlled end, and the specific area at least comprises a partial image playing area.

in some examples, the user at the master control end may remotely control the controlled end to generate the high definition data packet, and the control process is as follows:

And outputting the image of the user interface at the remote control interface.

And acquiring the region parameters triggered by the user through the remote control interface.

In some scenarios, the image of the user interface is shown in fig. 2b, and the user determines that the box region is the specific region by selecting the box region in the user interface as indicated by an arrow in fig. 2b, and triggers a region parameter of the specific region.

step 402: and decompressing the high-definition data packet to restore a high-definition image meeting a high-definition standard.

step 403: and displaying the high-definition image, and transmitting a picture debugging instruction to the controlled end through a remote control interface of the local end based on the displayed high-definition image.

In the embodiment of the application, the control of the picture playing quality comprises the debugging of the beauty parameters or the debugging of the camera parameters. The picture debugging instruction is used for controlling the controlled terminal to carry out the debugging operation of the picture playing quality, and can be an instruction for debugging the beauty parameter and/or an instruction for debugging the camera shooting parameter.

In some examples, the image restored based on the low-definition data packet and the high-definition data packet transmitted by the controlled end may be replaced with the image of the user interface of the controlled end, and the operation process is as follows:

And receiving the low-definition data packet, wherein the low-definition data packet is generated by capturing a full-screen image of the screen image and performing preset low-definition compression.

And decompressing the low-definition data packet to restore a low-definition image meeting a low-definition standard.

and superposing the high-definition image to a specific area in the low-definition image based on the area parameters to generate a restored image.

In this example, the decompression performed on the low-definition packet corresponds to the preset low-definition compression performed by the controlled end.

in some scenarios, the restored low-definition image may be as shown in fig. 2c, and the restored high-definition image may be as shown in fig. 2 d.

corresponding to the embodiment of the remote debugging control method, the application also provides an embodiment of the remote debugging control device.

The embodiment of the remote debugging control device can be applied to the terminal. The device embodiments may be implemented by software, or by hardware, or by a combination of hardware and software. The software implementation is taken as an example, and as a logical device, the device is formed by reading corresponding computer program instructions in the nonvolatile memory into the memory for operation through the processor of the terminal where the device is located. From a hardware aspect, as shown in fig. 5, a hardware structure diagram of a terminal where the remote debugging control device is located in the present application is shown, except for the processor 510, the network interface 520, the memory 530, and the nonvolatile memory 540 shown in fig. 5, the terminal where the device is located in the embodiment may also include other hardware according to the actual function of the terminal, which is not described again.

Referring to fig. 6, fig. 6 is a block diagram of an embodiment of a remote commissioning control apparatus according to the present application, which may include: the controlled terminal 610 and the main control terminal 620 establishing remote control connection with the controlled terminal 610 may include a screen image obtaining module 611, a high definition compression module 612 and a high definition data packet transmission module 613, and the main control terminal 620 may include a high definition data packet receiving module 621, a high definition decompression module 622, an image display module 623 and a remote debugging module 624.

Wherein: the screen image obtaining module 611 is configured to obtain a screen image of a specific area in the user interface of the home terminal, where the specific area at least includes a partial picture playing area.

and the high-definition compression module 612 is configured to perform preset high-definition compression on the screen image to generate a high-definition data packet meeting a high-definition standard.

A high-definition data packet transmitting module 613, configured to transmit the high-definition data packet to the master control end.

A high definition packet receiving module 621, configured to receive the high definition packet.

and a high-definition decompression module 622, configured to decompress the high-definition data packet, and restore a high-definition image that meets a high-definition standard.

And an image display module 623, configured to display the high-definition image.

And the remote debugging module 624 is configured to transmit a picture debugging instruction to the controlled end through the remote control interface of the local end based on the displayed high-definition image.

In one example, the preset high definition compression rate is 10% to 20%, and the preset low definition compression rate is 2.5% to 10%.

In other examples, the screen debugging instructions include instructions for debugging beauty parameters, and/or instructions for debugging camera parameters.

In an alternative implementation, the main control end 620 may include (not shown in fig. 6):

and the interface image output module is used for outputting the image of the user interface on the remote control interface.

and the area parameter acquisition module is used for acquiring the area parameters triggered by the user through the remote control interface and generating a screen capturing instruction comprising the area parameters.

And the interception instruction transmission module is used for transmitting the screen interception instruction to a controlled end, and the area parameter is the boundary coordinate of the specific area in the user interface.

the screen image acquisition module 611 may include (not shown in fig. 6):

and the interception instruction receiving module is used for receiving the screen interception instruction.

And the full-screen image acquisition module is used for responding to the screen interception instruction and acquiring a full-screen image of the user interface.

In another alternative implementation, the controlled terminal 610 may include (not shown in fig. 6):

and the low-definition compression module is used for performing preset low-definition compression on the intercepted full-screen image to generate a low-definition data packet meeting a low-definition standard.

and the low-definition data packet transmission module is used for transmitting the low-definition data packet to the main control end.

the master 620 may also include (not shown in fig. 6):

and the low-definition data packet receiving module is used for receiving the low-definition data packet.

And the low-definition decompression module is used for decompressing the low-definition data packet to restore a low-definition image meeting the low-definition standard.

image display module 624 may include (not shown in fig. 6):

and the image superposition module is used for superposing the high-definition image to a specific area in the low-definition image based on the area parameters to generate a restored image.

referring to fig. 7, fig. 7 is a block diagram of another embodiment of a remote commissioning control apparatus according to the present application, which may include: a screen image acquisition module 710, a high definition compression module 720 and a high definition packet transfer module 730.

The screen image obtaining module 710 is configured to obtain a screen image of a specific area in the user interface of the home terminal.

And the high-definition compression module 720 is used for performing preset high-definition compression on the screen image to generate a high-definition data packet meeting the high-definition standard.

and the high-definition data packet transmission module 730 is configured to transmit the high-definition data packet to the master control end that has established the remote control connection with the home terminal, so that the master control end transmits a picture debugging instruction to the controlled end through the remote control interface based on the high-definition image.

In an alternative implementation, the screen image acquisition module 710 may include (not shown in fig. 7):

and the screen capturing instruction receiving module is used for receiving a screen capturing instruction transmitted by the main control terminal, the screen capturing instruction comprises the area parameters of the specific area, and the screen capturing instruction is triggered by the main control terminal user through the remote control interface.

in another optional implementation manner, the remote debugging control device of the embodiment of the present application may further include (not shown in fig. 7):

referring to fig. 8, fig. 8 is a block diagram of another embodiment of a remote commissioning control apparatus according to the present application, which may include: high-definition data packet receiving module 810, high-definition decompression module 820, image display module 830 and remote debugging module 840.

The high-definition data packet receiving module 810 is configured to receive a high-definition data packet that meets a high-definition standard and is transmitted by a controlled end that has established a remote control connection with a home end, where the high-definition data packet is generated by compressing a preset high-definition screen image of a specific area in a user interface of the controlled end.

and the high-definition decompression module 820 is configured to decompress the high-definition data packet to restore a high-definition image meeting a high-definition standard.

And an image display module 830, configured to display the high-definition image.

and the remote debugging module 840 is used for transmitting a picture debugging instruction to the controlled end through the remote control interface of the local end based on the displayed high-definition image.

in an optional implementation manner, the remote debugging control apparatus of the embodiment of the present application may further include (not shown in fig. 8):

And the area parameter acquisition module is used for acquiring an area parameter triggered by the user through the remote control interface, wherein the area parameter is a boundary coordinate of the specific area in the user interface.

In another optional implementation manner, the remote debugging control apparatus of the embodiment of the present application may further include (not shown in fig. 8):

And the low-definition data packet receiving module is used for receiving the low-definition data packet, and the low-definition data packet is generated by performing preset low-definition compression on a full-screen image obtained after the screen image is intercepted.

image display module 830 may include (not shown in fig. 8):

The implementation process of the functions and actions of each module in the above device is specifically described in the implementation process of the corresponding step in the above method, and is not described herein again.

for the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, wherein the modules described as separate parts may or may not be physically separate, and the parts displayed as modules may or may not be physical modules, may be located in one place, or may be distributed on a plurality of network modules. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the application.

one of ordinary skill in the art can understand and implement it without inventive effort. Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.

It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.

Claims

1. a remote debugging control method is characterized by comprising the following steps:

the method comprises the steps that a controlled terminal obtains a screen image of a specific area in a user interface of the controlled terminal through a screen capturing function, performs preset high-definition compression on the screen image to generate a high-definition data packet meeting a high-definition standard, and transmits the high-definition data packet to a main control terminal which establishes remote control connection, wherein the specific area at least comprises a partial picture playing area;

the master control end receives the high-definition data packet, decompresses the high-definition data packet, restores a high-definition image meeting high-definition standards, displays the high-definition image, and transmits a picture debugging instruction to the controlled end through a remote control interface of the master control end based on the displayed high-definition image, wherein the picture debugging instruction comprises an instruction for debugging beauty parameters and/or an instruction for debugging camera parameters.

2. The method according to claim 1, wherein before the controlled terminal obtains the screen image of the specific area in the user interface thereof through the screen capture function, the method further comprises:

the controlled terminal obtains the screen image of the specific area in the user interface through the screen capture function, and the method comprises the following steps:

3. The method of claim 2, wherein after the screen image is cut from the full-screen image according to the region parameter, the method further comprises:

4. The method according to claim 3, wherein the compression ratio of the preset high definition compression is 10% to 20%, and the compression ratio of the preset low definition compression is 2.5% to 10%.

5. a remote debugging control method is characterized by comprising the following steps:

acquiring a screen image of a specific area in a user interface of a home terminal through a screen capture function, wherein the specific area at least comprises a partial picture playing area;

And transmitting the high-definition data packet to a master control end which is in remote control connection with the home end so that the master control end can restore a high-definition image based on the high-definition data packet, and transmitting a picture debugging instruction to a controlled end through a remote control interface, wherein the picture debugging instruction comprises an instruction for debugging beauty parameters and/or an instruction for debugging camera parameters.

6. the method according to claim 5, wherein the acquiring a screen image of a specific area in the user interface of the home terminal by the screen capture function comprises:

7. The method of claim 6, wherein after the screen image is cut from the full-screen image according to the region parameter, the method further comprises:

8. a remote debugging control method is characterized by comprising the following steps:

Receiving a high-definition data packet which is transmitted by a controlled end and is in remote control connection with a home end and meets a high-definition standard, wherein the high-definition data packet is generated by preset high-definition compression of a screen image of a specific area in a user interface, which is acquired by the controlled end through a screen capturing function, and the specific area at least comprises a partial picture playing area;

And displaying the high-definition image, and transmitting a picture debugging instruction to the controlled end through a remote control interface of the local end based on the displayed high-definition image, wherein the picture debugging instruction comprises an instruction for debugging beauty parameters and/or an instruction for debugging camera parameters.

9. The method according to claim 8, wherein before receiving the high definition data packet meeting the high definition standard transmitted by the controlled end which has established the remote control connection with the local end, the method further comprises:

Outputting an image of the user interface at the remote control interface;

10. The method of claim 9, further comprising:

Receiving a low-definition data packet, wherein the low-definition data packet is generated by capturing a full-screen image of the screen image and performing preset low-definition compression;

11. the utility model provides a remote debugging controlling means which characterized in that, is controlled the end to reach the master control end of establishing remote control with controlled the end, wherein:

the controlled end includes:

The system comprises a screen image acquisition module, a screen image acquisition module and a screen display module, wherein the screen image acquisition module is used for acquiring a screen image of a specific area in a user interface of a home terminal through a screen capture function, and the specific area at least comprises a partial picture playing area;

the main control end comprises:

the image display module is used for displaying the high-definition image;

and the remote debugging module is used for transmitting a picture debugging instruction to the controlled end through a remote control interface of the local end based on the displayed high-definition image, wherein the picture debugging instruction comprises an instruction for debugging beauty parameters and/or an instruction for debugging camera parameters.

12. The apparatus of claim 11, wherein:

the main control end also comprises:

The screen image acquisition module includes:

13. the apparatus of claim 12, wherein:

the controlled end also comprises:

the main control end also comprises:

The image display module includes:

14. the apparatus of claim 13, wherein the compression ratio of the high definition pre-set compression is 10% to 20% and the compression ratio of the low definition pre-set compression is 2.5% to 10%.

15. A remote commissioning control apparatus, comprising:

the screen image acquisition module is used for acquiring a screen image of a specific area in a user interface of the home terminal through a screen capture function, wherein the specific area at least comprises a partial picture playing area;

And the high-definition data packet transmission module is used for transmitting the high-definition data packet to a master control terminal which is connected with the local terminal in a remote control manner, so that the master control terminal transmits a picture debugging instruction to a controlled terminal through a remote control interface based on the high-definition image, wherein the picture debugging instruction comprises an instruction for debugging beauty parameters and/or an instruction for debugging camera parameters.

16. The apparatus of claim 15, wherein the screen image capture module comprises:

17. The apparatus of claim 16, further comprising:

18. A remote commissioning control apparatus, comprising:

The high-definition data packet receiving module is used for receiving a high-definition data packet which is transmitted by a controlled end which establishes remote control connection with the local end and meets a high-definition standard, the high-definition data packet is generated by preset high-definition compression of a screen image of a specific area in a user interface, which is acquired by the controlled end through a screen capturing function, and the specific area at least comprises a partial picture playing area;

The image display module is used for displaying the high-definition image;

19. the apparatus of claim 18, further comprising:

20. the apparatus of claim 19, further comprising:

The low-definition data packet receiving module is used for receiving a low-definition data packet, and the low-definition data packet is generated by performing preset low-definition compression on a full-screen image obtained after the screen image is intercepted;

the image display module includes: