CN115766822A - Screen capture method and device, screen capture system, user equipment and cloud server - Google Patents

Screen capture method and device, screen capture system, user equipment and cloud server Download PDF

Info

Publication number
CN115766822A
CN115766822A CN202211312267.5A CN202211312267A CN115766822A CN 115766822 A CN115766822 A CN 115766822A CN 202211312267 A CN202211312267 A CN 202211312267A CN 115766822 A CN115766822 A CN 115766822A
Authority
CN
China
Prior art keywords
screen
capture
capturing
screen capture
cloud server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211312267.5A
Other languages
Chinese (zh)
Inventor
潘黎丽
余飞
朱辰阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba China Co Ltd
Original Assignee
Alibaba China Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba China Co Ltd filed Critical Alibaba China Co Ltd
Priority to CN202211312267.5A priority Critical patent/CN115766822A/en
Publication of CN115766822A publication Critical patent/CN115766822A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Transfer Between Computers (AREA)

Abstract

The embodiment of the application provides a screen capture method and a screen capture device, and the method comprises the following steps: responding to a screen capturing trigger operation, generating a screen capturing event and sending the screen capturing event to a cloud server; acquiring a screen capture request sent by a cloud server according to a screen capture event; calling a screen capturing tool according to the screen capturing request to capture the screen, and sending the obtained screen capturing content to a cloud server so that the cloud server can generate a screen capturing result according to the screen capturing content and the target cloud service application; and acquiring a screen capture result sent by the cloud server. According to the method and the device, under the condition that the cloud operating environment and the user equipment side operating environment are different in style, although the cloud side screen capture service is triggered and the screen capture process of the cloud side for the target cloud service application is involved, the actual screen capture content is obtained by processing the screen capture content of the desktop background of the user equipment, the screen capture content is consistent with the expectation of the user, and therefore the user can achieve the non-perception experience on whether the cloud service application or the local application is being used currently.

Description

Screen capture method and device, screen capture system, user equipment and cloud server
Technical Field
The present application relates to the field of computer technologies, and in particular, to a screen capture method, an apparatus, a screen capture system, a user equipment, a cloud server, and a machine-readable medium.
Background
The cloud service application is a virtualized cloud application, the running cost of the cloud service application can be borne by the cloud, and then a user can obtain a running window of the cloud service application through user equipment to display, so that the user side and the cloud side form a tightly coordinated whole.
In the related art, the implementation of the screen capture function for the cloud service application specifically includes: the user equipment side initiates a screen capture request through user operation, the cloud service application responds to the screen capture request, screen capture is carried out in the running environment of the cloud end to obtain a screen capture result, and the screen capture result is fed back to the user equipment.
However, the inventor finds that, in the current scheme, when the screen capturing is performed in the cloud operating environment, the difference between the screen capturing result and the expected result is large due to the difference between the cloud operating environment and the operating environment of the user equipment, and the user experience is reduced.
Disclosure of Invention
The embodiment of the application provides a screen capture method, and aims to solve the problems that in the related art, the difference between a screen capture result and an expectation is large, and the user experience is reduced.
Correspondingly, the embodiment of the application also provides a screen capture device, user equipment, a screen capture system, a cloud server and a machine readable medium, which are used for ensuring the implementation and application of the method.
In order to solve the above problem, an embodiment of the present application discloses a screen capture method, which is applied to a user equipment, and includes:
responding to screen capture triggering operation, generating a screen capture event and sending the screen capture event to a cloud server;
acquiring a screen capturing request sent by the cloud server according to the screen capturing event;
calling a screen capturing tool to capture a screen according to the screen capturing request, and sending the obtained screen capturing content to the cloud server so that the cloud server can generate a screen capturing result according to the screen capturing content and the target cloud service application;
and acquiring the screen capturing result sent by the cloud server.
The embodiment of the application discloses a screen capture method, which is applied to a cloud server and comprises the following steps:
acquiring a screen capture event sent by user equipment;
generating a screen capturing request according to the screen capturing event and sending the screen capturing request to the user equipment;
acquiring screenshot contents intercepted by the user equipment based on the screenshot request;
and generating a screen capturing result according to the screen capturing content and the target cloud service application, and sending the screen capturing result to the user equipment.
Optionally, the screen capture event is generated based on a screen capture trigger operation of a screen capture control displayed in an interface of a target cloud service application by a user equipment, and then a screen capture request is generated according to the screen capture event and sent to the user equipment, including:
calling a screen capturing service interface to trigger the screen capturing service of the cloud server according to the screen capturing event;
and starting screen capture aiming at the target cloud service application through the screen capture service of the cloud server, generating a screen capture request, and sending the screen capture request to the user equipment according to the cloud service transmission protocol.
Optionally, the screen capture content is content obtained after the user equipment responds to a screen capture operation on a screen capture interface, where the screen capture interface includes an interface of a target cloud service application displayed by the user equipment and a desktop background of the user equipment;
the generating of the screen capture result according to the screen capture content and the target cloud service application comprises:
storing the screen capture content to a memory slice area associated with the screen capture service of the target cloud service application, and generating a screen capture result containing an access address of the screen capture content in the memory slice area.
Optionally, the screen capture content is a full-screen display image displayed by the user equipment;
the generating of the screen capture result according to the screen capture content and the target cloud service application comprises:
calling a screen capture tool to capture the full-screen display image to obtain a screen capture image;
storing the screenshot image to a memory slice area associated with the screenshot service of the target cloud service application, and generating a screenshot result containing an access address of the screenshot image in the memory slice area.
Optionally, the invoking a screen capture tool to capture a screen of the full-screen display image to obtain a screen capture image includes:
replacing the full-screen display image with a current display picture;
acquiring a simulated screen capture cursor event sent by the user equipment, wherein the simulated screen capture cursor event is a cursor event generated aiming at a simulated screen capture interface displayed by the user equipment, and the simulated screen capture interface displays the full-screen display image;
and calling a screen capture tool to capture a screen capture image from the full-screen display image displayed by the cloud server according to the simulated screen capture cursor event.
Optionally, the generating and sending the screen capture result to the user equipment includes:
and sending the screen capturing result to the user equipment through the target cloud service application according to a preset cloud service transmission protocol.
The embodiment of the application discloses a screen capture device, is applied to user equipment, the device includes:
the response module is used for responding to screen capture triggering operation, generating a screen capture event and sending the screen capture event to the cloud server;
the first acquisition module is used for acquiring a screen capture request sent by the cloud server according to the screen capture event;
the screen capturing module is used for calling a screen capturing tool to capture a screen according to the screen capturing request, and sending the obtained screen capturing content to the cloud server so that the cloud server can generate a screen capturing result according to the screen capturing content and a target cloud service application;
and the second acquisition module is used for acquiring the screen capturing result sent by the cloud server.
The embodiment of the application discloses screen capture device is applied to cloud ware, the device includes:
the third acquisition module is used for acquiring a screen capture event sent by the user equipment;
the generating module is used for generating a screen capturing request according to the screen capturing event and sending the screen capturing request to the user equipment;
the fourth acquisition module is used for acquiring screenshot contents intercepted by the user equipment based on the screenshot request;
and the sending module is used for generating a screen capturing result according to the screen capturing content and the target cloud service application and sending the screen capturing result to the user equipment.
The embodiment of the application discloses screen capture system includes: a user device and a cloud server;
the user equipment is configured to: responding to a screen capturing trigger operation, generating a screen capturing event and sending the screen capturing event to a cloud server; acquiring a screen capture request sent by the cloud server according to the screen capture event; calling a screen capturing tool to capture a screen according to the screen capturing request, and sending the obtained screen capturing content to the cloud server so that the cloud server can generate a screen capturing result according to the screen capturing content and a target cloud service application; acquiring the screen capturing result sent by the cloud server;
the cloud server is configured to: acquiring a screen capture event sent by user equipment; generating a screen capturing request according to the screen capturing event and sending the screen capturing request to the user equipment; acquiring screenshot contents intercepted by the user equipment based on the screenshot request; and generating a screen capturing result according to the screen capturing content and the target cloud service application, and sending the screen capturing result to the user equipment.
The embodiment of the present application further discloses a user equipment, including: a processor; and a memory having executable code stored thereon that, when executed, causes the processor to perform a method as described in one or more of the embodiments of the application.
The embodiment of the application discloses a cloud server, includes: a processor; and a memory having executable code stored thereon, which when executed, causes the processor to perform a method as described in one or more of the embodiments of the application.
Embodiments of the present application also disclose one or more machine-readable media having executable code stored thereon that, when executed, cause a processor to perform a method as described in one or more of the embodiments of the present application.
Compared with the related art, the embodiment of the application has the following advantages:
according to the method and the device, under the condition that the cloud operating environment and the user equipment side operating environment are different in style, although the cloud side screen capture service is triggered and the screen capture process of the cloud side for the target cloud service application is involved, the actual screen capture content is obtained by processing the screen capture content of the desktop environment of the user equipment, the screen capture content is consistent with the expectation of the user, and therefore the user can use the cloud service application or the local application at present, the non-perception experience is achieved, and the fluency of the user in the process of using the cloud service application is improved.
Drawings
FIG. 1 is a system architecture diagram of a screen capture method according to an embodiment of the present application;
FIG. 2 is an interaction diagram of a screenshot implementation of an embodiment of the application;
FIG. 3 is an interaction diagram of another screenshot implementation of an embodiment of the present application;
fig. 4 is a schematic view of an implementation scenario of a video platform cloud service application according to an embodiment of the present application;
fig. 5 is a schematic view of an implementation scenario of an e-commerce cloud service application according to an embodiment of the present application;
fig. 6 is a schematic view of an implementation scenario of a logistics cloud service application according to an embodiment of the present application;
FIG. 7 is a flowchart of the steps of a screen capture method of an embodiment of the present application;
FIG. 8 is a flow chart of steps in another screen capture method of an embodiment of the present application;
FIG. 9 is a flowchart illustrating steps of a screen capture method according to an embodiment of the present application;
FIG. 10 is a flowchart illustrating steps of another exemplary screenshot method;
FIG. 11 is a block diagram of a screen capture device of an embodiment of the present application;
FIG. 12 is a block diagram of another screen capture device of an embodiment of the present application;
FIG. 13 is a block diagram of a screen capture system of an embodiment of the present application;
fig. 14 is a schematic structural diagram of an apparatus according to an embodiment of the present application.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, the present application is described in further detail with reference to the accompanying drawings and the detailed description.
To enable those skilled in the art to better understand the present application, the following description is provided to illustrate the concepts related to the present application:
the cloud server: the cloud service management method is characterized in that the cloud service management method is a computing unit deployed at the cloud end, user equipment can access cloud service application running on a cloud server to obtain service content provided by the cloud service application, the cloud server is simple and efficient to deploy, safe and reliable, the processing capacity can be elastically stretched, the cloud server management mode is simpler and more efficient than a physical server, and users can obtain the service content by accessing the cloud server without purchasing expensive hardware in advance.
Cloud service application: the cloud service application can transparently transmit the operation window to the user equipment for display, the interactive operation of the user on the user equipment side can be synchronized to the cloud end for the cloud service application to respond, the operation cost of the cloud service application is in the cloud end, and on the basis of reducing the cost of the user equipment side, the user can not sense the access of the cloud end, namely whether the current cloud service application is used or the local application is used, so that the non-sensing experience is achieved.
Screen capture triggering operation: the method comprises the steps that a user performs operation for triggering screen capture service aiming at an operation window of a cloud service application displayed on a user equipment side, wherein the screen capture triggering operation can be operation of clicking a screen capture control by the user through a cursor, and can also be triggering operation of a physical key of a screen capture function by the user.
Screen capture event: the event information that the current user equipment triggers the screen capture service can be informed to the cloud server, and the event information can include cursor operation information of clicking a screen capture control or triggering operation information of a physical key of a screen capture function.
Screen capture content: and the image intercepted by the specific screen-intercepting execution operation.
Screen capture results: and the user equipment can acquire the screen capturing content provided by the cloud service application through the screen capturing result.
Screen shot tool: the tool software for realizing the screen capture service can be operated by both the user equipment and the cloud server.
Screen shot service: and the service is used for realizing confirmation triggering of screen capture, calling of a screen capture tool, acquisition of screen capture content and content injection.
Cloud service transport protocol: and providing protocol content of information interaction between the user equipment side and the cloud server side.
The screen capturing method in the embodiment of the application can be particularly applied to a screen capturing scene in a process that a user device uses a cloud service application operated by a cloud, in a related technical process, the cloud service application responds to a screen capturing request initiated by the user device side, the screen capturing is performed in an operation environment of the cloud to obtain a screen capturing result, and the screen capturing result is fed back to the user device.
In order to solve the above problem, in the embodiment of the application, a user equipment generates a screen capture event according to a screen capture trigger operation in a process of using a target cloud service application, and sends the screen capture event to a cloud server, so that the cloud server triggers a screen capture service for the target cloud service application according to the screen capture event, and then the cloud server does not execute the screen capture operation on a cloud desktop, but generates a screen capture request to send to the user equipment, so that the user equipment starts the screen capture service on the user equipment, calls a screen capture tool to perform the screen capture operation on the desktop of the user equipment, and sends the screen capture content to the cloud server, the cloud server can bind the screen capture content with the target cloud service application according to the screen capture service of the cloud server, and simultaneously generates a screen capture result for obtaining the screen capture content and sends the screen capture result to the user equipment, and the user equipment can obtain the screen capture content according to the screen capture result when the screen capture content is needed. Therefore, even under the condition that the styles of the cloud operating environment and the operating environment of the user equipment side are different, the screen capture result of the user equipment side can still obtain the same screen capture result as the user expects, and therefore the user can achieve an imperceptible experience on whether the user uses the cloud service application or the local application currently.
Referring to fig. 1, which shows a system architecture diagram of a screen capture method provided in an embodiment of the present application, including: cloud server and user equipment. The cloud server runs a target cloud service application, a cloud side screen capture service and a cloud side screen capture tool, and is also provided with a screen capture detection module and a content injection module, wherein the screen capture detection module and the content injection module can be software functional modules contained in the target cloud service application respectively; the user equipment can receive and display an operation window of the target cloud service application transmitted by the cloud server, and the user equipment runs with an end-side screen capture service and an end-side screen capture tool. The cloud server and the user equipment can interact through a cloud service transmission protocol. The cloud service transmission protocol may specifically define a message, an event, a transmission mode of the message, and a data format.
In the embodiment of the application, referring to fig. 1, an implementation environment of a cloud service application specifically refers to that the cloud service application runs in a cloud server, so that the cloud server bears running overhead of the cloud service application, in order to enable a user to use the cloud service application, the cloud server can transmit a running window of the cloud service application to user equipment for displaying, and an interactive operation executed by the user on the running window of the user equipment can be fed back to the cloud server for the cloud service application to respond, thereby achieving the purpose that the user uses the cloud service application without sensing.
Specifically, the embodiment of the present application provides two screen capture implementation manners:
in a screenshot implementation manner, referring to fig. 2, an interaction diagram of the screenshot implementation manner provided in an embodiment of the present application is shown, when a screenshot operation is required in a process of running a target cloud service application, S11 may be executed, a user may execute a screenshot triggering operation on a user equipment (for example, click a "screenshot" button in a running window of the target cloud service application), the user equipment generates a screenshot event and sends the screenshot event to a cloud service application of a cloud server in response to the screenshot triggering operation, a screenshot detection module of the cloud service application may determine, according to the screenshot event, that the screenshot operation for the target cloud service application is currently being executed, and at this time, the screenshot detection module may execute S12 and further invoke a cloud-side screenshot service. And the cloud side screen capturing service executes S13 and intervenes in application screen capturing, generates a screen capturing request and sends the screen capturing request to the end side screen capturing service of the user equipment. The end-side screen capturing service can execute S14 according to the screen capturing request, call an end-side screen capturing tool to enter a screen capturing mode, the cloud service application can enter a screen capturing interface in an end-side running window of the user equipment at the moment, the user can further execute S15 and input screen capturing operation so that the end-side screen capturing service can execute S16, screen capturing content can be obtained according to the screen capturing operation, and the screen capturing content is sent to the cloud side screen capturing service of the cloud server. The cloud-side screen capture service may perform S17, bind the screen capture content with the target cloud service application (implemented by the content injection module), and generate a screen capture result. The screen capture result can be subsequently sent to the user equipment, and when the user needs to acquire the screen capture content, the screen capture content can be acquired according to the screen capture result.
In the screen capturing process of fig. 2, although the cloud-side screen capturing service is triggered and the screen capturing process of the cloud-side to the target cloud service application is involved, a specific screen capturing action occurs in the desktop environment of the end-side running window in the user equipment, so that the obtained screen capturing content is based on the desktop background of the user equipment and the content obtained by the end-side cloud-side window, and the screen capturing content is consistent with the expectation of the user (screen capturing content including the desktop background of the user equipment is obtained), so that the user can achieve an imperceptible experience no matter whether the user is currently using the cloud service application or the local application.
In another screen capturing embodiment, referring to fig. 3, which shows an interaction diagram of another screen capturing embodiment provided in this embodiment of the present application, when a screen capturing operation is required in a process of running a target cloud service application, S21 may be performed, a user may perform a screen capturing trigger operation on user equipment (for example, click a "screen capturing" button in an operating window of the target cloud service application), the user equipment generates a screen capturing event and sends the screen capturing event to a cloud service application of a cloud server in response to the screen capturing trigger operation, a screen capturing detection module of the cloud service application may determine, according to the screen capturing event, that a screen capturing operation for the target cloud service application is currently being performed, and at this time, the screen capturing detection module may perform S22 and further invoke a cloud-side screen capturing service. And the cloud side screen capturing service executes S23 and intervenes in application screen capturing, generates a screen capturing request and sends the screen capturing request to the end side screen capturing service of the user equipment. The end-side screen capturing service may execute S24 according to the screen capturing request, invoke an end-side screen capturing tool to capture a full-screen display image of a desktop of the user equipment as screen capturing content, and send the screen capturing content to the cloud-side screen capturing service of the cloud server. The cloud-side screen capture service can execute S25, replace the desktop background of the cloud side with a full-screen display image of the desktop of the user equipment, and further obtain screen capture content according to the screen capture operation of the user. The cloud-side screenshot service may then execute S26, bind the screenshot content with the target cloud service application (implemented by the content injection module), and generate a screenshot result. The screen capture result can be subsequently sent to the user equipment, and when the user needs to acquire the screen capture content, the screen capture content can be acquired according to the screen capture result.
In the screen capturing process of fig. 3, although the cloud-side screen capturing service is triggered and the screen capturing process of the cloud-side application to the target cloud service is involved, the full-screen display image of the desktop of the user equipment captured by the user equipment may be sent to the cloud-side screen capturing service, the cloud-side screen capturing service may replace the desktop background of the cloud side with the full-screen display image, further, the screen capturing of the cloud side may be performed based on the screen capturing operation of the user, the screen capturing content is obtained based on the full-screen display image of the user equipment, and the screen capturing content is consistent with the expectation of the user (screen capturing content including the desktop background of the user equipment is obtained), so that the user may use the cloud service application or the local application at present, and achieve an imperceptible experience.
It should be noted that, based on the screen capture method provided in the embodiment of the present application, several specific scenarios can be implemented as follows:
in an implementation manner, referring to fig. 4, a schematic diagram of an implementation scenario of a video platform cloud service application provided in an embodiment of the present application is shown, where the implementation scenario includes: the video platform cloud service application runs in the video platform cloud server, the user equipment can receive and display an operation window of the video platform cloud service application transmitted by the video platform cloud server, specifically, a user can watch video content provided by the video platform cloud service application through the operation window displayed in the user equipment, the system overhead of the user equipment is reduced due to the fact that the video platform cloud service application runs on a cloud side, when the user needs to perform screen capture, screen capture is performed according to the mode of the figure 2 or the figure 3, the screen capture content can be consistent with the expectation of the user, and therefore the user can use the cloud service application or the local application at present, and a non-perception experience is achieved.
In another implementation manner, referring to fig. 5, a schematic diagram of an implementation scenario of an e-commerce cloud service application provided in an embodiment of the present application is shown, where the implementation scenario includes: the electronic commerce cloud server comprises user equipment and an electronic commerce cloud server, wherein an electronic commerce cloud service application runs in the electronic commerce cloud server, the user equipment can receive and display an operation window of the electronic commerce cloud service application transmitted by the electronic commerce cloud server, specifically, a user can browse and purchase commodities through the operation window displayed in the user equipment, the system overhead of the user equipment is reduced due to the fact that the electronic commerce cloud service application runs on a cloud side, when the user needs to perform screen capture, screen capture is performed according to the mode of the figure 2 or the figure 3, screen capture content can be consistent with the expectation of the user, and therefore the user can use the local application or the cloud service application currently used, and the non-perception experience is achieved.
In another implementation manner, referring to fig. 6, which is a schematic diagram illustrating an implementation scenario of a logistics cloud service application provided in an embodiment of the present application, includes: the system comprises user equipment and a logistics cloud server, wherein a logistics cloud service application runs in the logistics cloud server, the user equipment can receive and display an operation window of the logistics cloud service application transmitted by the logistics cloud server, specifically, when a user can send or sign an express package through the operation window displayed in the user equipment, the logistics cloud service application runs on a cloud side, the system overhead of the user equipment is reduced, when the user needs to capture a screen, the screen capture is carried out according to the mode of the figure 2 or the figure 3, the screen capture content can be consistent with the expectation of the user, and therefore the user can achieve an unaware experience on whether the user uses the cloud service application or uses a local application currently.
It should be noted that, in the embodiment of the present application, the process of acquiring the screen capture event, the screen capture request, the screen capture content, the screen capture result, and other information, signals, or data used in the screen capture result, are performed under the premise of complying with the corresponding data protection regulation policy of the country in which the corresponding device is located, and under the condition of obtaining authorization given by the owner of the corresponding device.
According to the method and the device, under the condition that the cloud operating environment and the user equipment side operating environment are different in style, although the cloud side screen capture service is triggered and the screen capture process of the cloud side for the target cloud service application is involved, the actual screen capture content is obtained by processing the screen capture content of the desktop environment of the user equipment, the screen capture content is consistent with the expectation of the user, and therefore the user can use the cloud service application or the local application at present, the non-perception experience is achieved, and the fluency of the user in the process of using the cloud service application is improved.
Referring to fig. 7, which shows a flowchart of steps of a screen capture method provided in an embodiment of the present application, applied to a user equipment, the method includes:
step 101, responding to a screen capture triggering operation, generating a screen capture event and sending the screen capture event to a cloud server.
In the embodiment of the application, an implementation environment of the cloud service application specifically refers to that the cloud service application runs in a cloud server, so that the cloud server bears running overhead of the cloud service application, in order to enable a user to use the cloud service application, the cloud server can transmit a running window of the cloud service application to user equipment for displaying, and interactive operation executed by the user on the running window of the user equipment can be fed back to the cloud server for the cloud service application to respond, so that the purpose that the user uses the cloud service application without sensing is achieved.
Specifically, when a screen capture is required in the process of using the cloud service application, a user may execute a screen capture trigger operation (for example, clicking a "screen capture" button in an operating window of a target cloud service application) on the user equipment, and the user equipment generates a screen capture event and sends the screen capture event to the cloud service application of the cloud server in response to the screen capture trigger operation, where the screen capture event is used to inform the cloud service application that the current user has triggered the screen capture.
And step 102, acquiring a screen capture request sent by the cloud server according to the screen capture event.
In the embodiment of the application, in order to avoid the problem of reduced experience caused by the fact that the screen capturing result is greatly different from the user expectation in the screen capturing process based on the cloud server desktop environment in the related technology, the embodiment of the application can further screen capture the desktop environment of the user equipment to obtain the screen capturing content to ensure that the screen capturing content meets the user expectation, and specifically, although the screen capturing event triggers the screen capturing service of the cloud server and intervenes the screen capturing process of the cloud side for the target cloud service application, the cloud server can generate the screen capturing request to the user equipment, so that the desktop environment of the user equipment obtaining the screen capturing content is used as the screen capturing content.
Step 103, calling a screen capture tool according to the screen capture request to capture a screen, and sending the obtained screen capture content to the cloud server so that the cloud server can generate a screen capture result according to the screen capture content and the target cloud service application.
In the embodiment of the application, the user equipment can call a screen capturing tool of the user equipment according to the screen capturing request, screen capturing is carried out on the desktop environment of the user equipment to obtain screen capturing content, and the screen capturing content can be sent to the cloud server so that the cloud server can bind the screen capturing content and the target cloud service application according to the screen capturing content and the target cloud service application and generate a screen capturing result which is the same as the user expectation.
For example, the wallpaper of the cloud operating environment is a default black background, the wallpaper of the operating environment of the user equipment is a user-defined landscape photo, and the screen capture mode of the embodiment of the application can capture the screen based on the desktop environment of the user-defined landscape photo wallpaper of the user equipment to obtain the screen capture content, wherein the screen capture content is the same as the expectation of the user (the screen capture content containing the user-defined landscape wallpaper is obtained).
And step 104, acquiring a screen capture result sent by the cloud server.
In the embodiment of the application, the cloud server can bind the screenshot content with the target cloud service application, so that the original flow logic of the cloud-side screenshot service on the cloud server side is achieved (a screenshot file is intercepted for the target cloud service application), specifically, the binding action can be that the screenshot content is stored in a storage area associated with the target cloud service application, the binding association between the screenshot content and the target cloud service application is completed, further, the cloud server can generate a screenshot result including an access address for accessing the screenshot content and send the screenshot result to the user equipment, and when a subsequent user needs to obtain the screenshot content, the screenshot content can be obtained according to the access address in the screenshot result.
Optionally, step 104 may be specifically implemented by sending the screenshot content to a cloud server according to a cloud service transport protocol.
Specifically, the cloud service transmission protocol may specifically define a transmission mode and a data format of a message, an event and information. This enables interaction of screenshot content between the cloud server and the user device through a cloud service transport protocol.
In summary, in the embodiment of the application, under the condition that the cloud operating environment and the user equipment side operating environment are different in style, although the cloud side screenshot service is triggered and the screenshot process of the cloud side for the target cloud service application is involved, the actual screenshot content is obtained by processing the screenshot content of the desktop background of the user equipment, and the screenshot content is consistent with the expectation of the user, so that the user can use the cloud service application or the local application currently, a non-perception experience is achieved, and the fluency of the user in the process of using the cloud service application is improved.
Referring to fig. 8, which shows a flowchart of steps of another screen capturing method provided in the embodiment of the present application, where the method is applied to a cloud server, and the method includes:
step 201, acquiring a screen capture event sent by user equipment.
In the embodiment of the application, the screen capture event is event information generated by user equipment after a user executes screen capture triggering operation, and is used for informing the cloud service application that the current user triggers screen capture, and the cloud server calls a cloud-side screen capture service to intervene in a screen capture process for the target cloud service application.
Step 202, generating a screen capture request according to the screen capture event and sending the screen capture request to the user equipment.
In the embodiment of the application, in order to avoid the problem of reduced experience caused by the fact that the screen capturing result with a larger difference from the user expectation is obtained by the screen capturing based on the desktop environment of the cloud server in the related art, the cloud server can generate the screen capturing request according to the screen capturing event and send the screen capturing request to the user equipment so as to inform the user equipment to further capture the screen of the desktop environment of the user equipment to obtain the screen capturing content, and therefore the screen capturing content is guaranteed to meet the user expectation.
And step 203, acquiring screenshot contents intercepted by the user equipment based on the screenshot request.
In the step, the screen capture content is obtained by the user equipment based on the screen capture of the desktop environment of the user equipment, so that the screen capture content can meet the expectation of the user, the perception that the screen capture content is different is avoided, and the purpose that the user uses the cloud service application without perception is achieved.
And step 204, generating a screen capturing result according to the screen capturing content and the target cloud service application, and sending the screen capturing result to the user equipment.
In this embodiment of the application, the cloud server may bind the screenshot content with the target cloud service application, so as to implement an original flow logic of the cloud-side screenshot service on the cloud server side (a screenshot file is intercepted for the target cloud service application), specifically, the screenshot content may be stored in a storage area associated with the target cloud service application, binding and association of the screenshot content with the target cloud service application is completed, and further, the cloud server may generate a screenshot result including an access address for accessing the screenshot content and send the screenshot result to the user equipment.
In summary, in the embodiment of the application, under the condition that the cloud end operating environment and the user equipment side operating environment are different in style, although the cloud side screenshot service is triggered and the screenshot process of the cloud side for the target cloud service application is intervened, the actual screenshot content is obtained by processing the screenshot content of the desktop background of the user equipment, and the screenshot content is consistent with the expectation of the user, so that the user can use the cloud service application or the local application at present, a non-perception experience is achieved, and the fluency of the user in the cloud service application using process is improved.
Referring to fig. 9, which shows a flowchart of specific steps of a screen capture method provided in an embodiment of the present application, and is applied to a user equipment, the method includes:
step 301, in response to a screen capture trigger operation of a screen capture control displayed in an interface of a target cloud service application, generating a screen capture event through a screen capture service of user equipment, and sending the screen capture event to a cloud server according to a preset cloud service transmission protocol.
When a screen capture operation is required in the process of running the target cloud service application, a user may execute a screen capture trigger operation on a desktop of the user equipment, for example, click a "screen capture" button in a running window of the target cloud service application, or press a screen capture physical key of the user equipment to implement the screen capture trigger operation, and the user equipment responds to the screen capture trigger operation, generates a screen capture event, and sends the screen capture event to the cloud service application of the cloud server according to a preset cloud service transmission protocol.
Step 302, a screen capture request sent by the cloud server according to the screen capture event is obtained.
This step may specifically refer to step 102, which is not described herein.
Step 303, calling a screen capture tool to capture a screen according to the screen capture request, and sending the obtained screen capture content to the cloud server.
This step may refer to step 103, which is not described herein.
And step 304, acquiring a screen capture result sent by the cloud server.
This step may specifically refer to step 104, which is not described herein.
Optionally, in an implementation manner, step 303 may specifically include:
and substep 3031, calling a screen capture tool to enter a screen capture interface according to the screen capture request, wherein the screen capture interface comprises an interface of the target cloud service application and a desktop background of the user equipment.
And a substep 3032, responding to screen capturing operation of the screen capturing interface, obtaining screen capturing content containing the interface and/or the desktop background of the target cloud service application, and sending the screen capturing content to the cloud server so that the cloud server can generate a screen capturing result according to the screen capturing content and the target cloud service application.
In this embodiment, for sub-steps 3031 to 3032, referring to the screen capturing interaction mode of fig. 2, in this embodiment, a cloud-side screen capturing service is triggered and a screen capturing process of a cloud-side to a target cloud service application is intervened, but a specific screen capturing action occurs in a desktop environment of a middle-side operating window of a user device, that is, the user device may display a screen capturing interface including an interface (operating window) of the target cloud service application and a desktop background of the user device according to a screen capturing request sent by a cloud server, a further user may input a screen capturing operation in the screen capturing interface, the screen capturing operation is used to circle a screen capturing region in the screen capturing interface, and use the content in the screen capturing region as screen capturing content, which may be further sent to the cloud server, so that the cloud server imports the screen capturing content into the target cloud service application. In the implementation mode of the application, the screen capturing action is performed in a desktop environment of a side-end running window in the user equipment, the obtained screen capturing content is obtained based on a desktop background of the user equipment and a side-end cloud side window, and the screen capturing content is consistent with the expectation of a user (screen capturing content containing the desktop background of the user equipment is obtained), so that the user can achieve an unaware experience on whether the user uses the cloud service application or the local application currently.
According to different actual requirements, the screenshot content captured by the user may be only the screenshot content of the interface or the desktop background of the target cloud service application, or may include both the interface and the desktop background of the target cloud service application.
Optionally, the substep 3032 may specifically determine a screenshot area in the screenshot interface by acquiring a screenshot cursor event included in the screenshot operation and according to the screenshot cursor event; and sending the interface and/or the desktop background of the target cloud service application in the screen capture area to the cloud server as the screen capture content.
In this embodiment of the application, the screen capture operation may specifically be a region circling operation input by a user through a screen capture cursor in the screen capture interface, and the operation may be recorded as a screen capture cursor event (event information reflecting a screen capture cursor circling track), so that the end-side screen capture service of the user equipment may determine a screen capture region in the screen capture interface according to the screen capture cursor event, and send the content of the screen capture region as the screen capture content to the cloud server. The movement of the screen capture cursor in the screen capture cursor event can be controlled and executed by a user, the user can control the movement of the screen capture cursor through touch operation on a display screen of the user equipment, and the user can also control the movement of the screen capture cursor through operation on physical keys of the user equipment.
Optionally, in an implementation manner, step 303 may specifically include:
and a substep 3033 of calling a screen capturing tool according to the screen capturing request to obtain a full screen display image of the user equipment.
And a substep 3034 of adding the full-screen display image to the screen capturing content and sending the screen capturing content to the cloud server so that the cloud server captures all or a local area from the full-screen display image displayed by the cloud server for the screen capturing operation information subsequently sent by the user equipment.
In this embodiment of the application, for sub-steps 3033 to 3034, referring to the screen capturing interaction manner of fig. 3, the cloud-side screen capturing service is triggered and a screen capturing process of the cloud-side to the target cloud service application is involved in the embodiment of the application, but a full-screen display image of a desktop of the user equipment may be captured by the user equipment as the screen capturing content, and the screen capturing content may be sent to the cloud-side screen capturing service of the cloud server, so that the cloud-side screen capturing service replaces a desktop background of the cloud side with a full-screen display image of the desktop of the user equipment, and then the screen capturing content is captured from the replaced desktop background according to the screen capturing operation of the user sent by the user equipment.
Specifically, the user equipment can call a screen capturing tool through the end-side screen capturing service according to a screen capturing request, a full-screen display image of the user equipment is captured and obtained, the full-screen display image is added to the screen capturing content and is sent to the cloud server, the cloud-side screen capturing service further performs screen capturing operation after replacing a cloud-side desktop background with the full-screen display image, and the screen capturing content is obtained on the full-screen display image.
Optionally, in another implementation manner, step 303 may specifically include:
and substep 3035, calling a screen capture tool to enter a screen capture interface according to the screen capture request, wherein the screen capture interface comprises an interface of the target cloud service application and a desktop background of the user equipment.
And a sub-step 3036 of responding to the screen capturing operation of the screen capturing interface and obtaining a screen capturing area containing the interface and/or the desktop background of the target cloud service application.
And a substep 3037, responding to screen recording operation of the screen capturing region, recording screen recording contents with preset duration aiming at the screen capturing region, and sending the screen recording contents to the cloud server so that the cloud server can bind the screen recording contents with the target cloud service application to generate a screen capturing result.
In this embodiment, for substeps 3035-3037, the screen capturing method of this embodiment may be further specifically applied to a screen capturing and screen recording scene, where in this scene, the user equipment may first invoke a screen capturing tool according to a screen capturing request to enter a screen capturing interface including an interface of a target cloud service application and a desktop background of the user equipment, and then select a screen capturing region from the screen capturing interface according to a screen capturing operation input by the user to the screen capturing interface, and after the user has selected the screen capturing region, the user may trigger a screen recording control (click a screen recording button control in the interface or a screen recording physical button of the user equipment) to perform a screen recording operation on the screen capturing region, so that a screen recording content with a preset duration is obtained for the screen capturing region (the screen recording end time may be determined by the user equipment in response to the time of the screen capturing end operation input by the user equipment) and send the screen recording control to the cloud server, so that the cloud server binds the screen recording content with the target cloud service application to generate a screen capturing result, thereby further realizing the rich screen capturing function of the screen capturing operation on the basis of the screen capturing and improving the screen capturing function of the screen capturing.
In summary, in the embodiment of the application, under the condition that the cloud operating environment and the user equipment side operating environment are different in style, although the cloud side screenshot service is triggered and the screenshot process of the cloud side for the target cloud service application is involved, the actual screenshot content is obtained by processing the screenshot content of the desktop background of the user equipment, and the screenshot content is consistent with the expectation of the user, so that the user can use the cloud service application or the local application currently, a non-perception experience is achieved, and the fluency of the user in the process of using the cloud service application is improved.
Referring to fig. 10, which shows a flowchart of specific steps of a screen capture method provided in an embodiment of the present application, and is applied to a cloud server, the method includes:
step 401, acquiring a screen capture event sent by user equipment.
This step may specifically refer to step 201 described above, and is not described herein again.
Step 402, calling a screen capture service interface to trigger a screen capture service of the cloud server according to the screen capture event.
The screen capture event is generated based on screen capture trigger operation of the user equipment on a screen capture control displayed in an interface of the target cloud service application.
In this embodiment of the application, a screen capture service (a cloud-side screen capture service) of the cloud server may specifically determine that a screen capture operation for a target cloud service application is currently being executed according to a screen capture event, so as to intervene in a screen capture process for the target cloud service application.
And 403, starting screen capture aiming at the target cloud service application through the screen capture service of the cloud server, generating a screen capture request, and sending the screen capture request to the user equipment according to the cloud service transmission protocol.
In this step, after the cloud-side screen capture service intervenes in a screen capture process applied to the target cloud service, a screen capture request may be generated, and the screen capture request is sent to the user equipment according to the cloud service transmission protocol, so as to notify the user equipment of screen capture and return screen capture content. Although the cloud server triggers the cloud-side screen capture service and intervenes in the screen capture process of the cloud side for the target cloud service application, the specific screen capture action occurs in the desktop environment of the end-side running window of the user equipment, so that the screen capture content is consistent with the expectation of the user, and the user can achieve an unaware experience on whether the cloud service application is currently used or the local application is being used.
And step 404, screen capture content captured by the user equipment based on the screen capture request is obtained.
This step may specifically refer to step 203, which is not described herein again.
Step 405, generating a screen capturing result according to the screen capturing content and the target cloud service application, and sending the screen capturing result to the user equipment through the target cloud service application according to a preset cloud service transmission protocol.
This step may specifically refer to step 204, which is not described herein.
Optionally, in an implementation manner, the screenshot content is content obtained after the user equipment responds to a screenshot operation on a screenshot interface, where the screenshot interface includes an interface of a target cloud service application displayed by the user equipment and a desktop background of the user equipment, and step 405 may specifically include:
sub-step 4051, storing the screenshot content to a memory slice area associated with the screenshot service of the target cloud service application, and generating a screenshot result containing an access address of the screenshot content in the memory slice area.
In this implementation, reference may be made to the screenshot implementation of fig. 2, where a specific screenshot action occurs in a desktop environment of a middle-side operating window of the user equipment, so that the screenshot content obtained by the cloud service application of the cloud server is content obtained based on a desktop background of the user equipment and an end-side cloud-side window, and based on the obtained screenshot content, the cloud-side screenshot service needs to further bind the screenshot content with the target cloud service application, that is, injection of the screenshot content in the target cloud service application is implemented, thereby completing a process closed loop of the cloud-side screenshot service. Specifically, the binding of the screenshot content and the target cloud service application may be to store the screenshot content in a memory slice area associated with the screenshot service of the target cloud service application, where the memory slice area may be a local memory slice area of the cloud server or other external memory slice areas.
Finally, the cloud server can generate a screen capture result containing the access address of the screen capture content in the memory area and send the screen capture result to the user equipment, and when the user needs to acquire the screen capture content subsequently, the user can acquire the screen capture content from the memory area through the access address in the screen capture result.
Optionally, in another implementation manner, the screen capture content is a full-screen display image displayed by the user equipment; step 405 may specifically include:
substep 4052, invoking a screen capture tool to capture the full screen display image, and obtaining the screen capture image.
Sub-step 4053, storing the screenshot image to a memory slice area associated with the screenshot service of the target cloud service application, and generating a screenshot result containing an access address of the screenshot image in the memory slice area.
In the implementation manners of sub-steps 4052-4053, referring to the screenshot implementation manner of fig. 3, the user equipment may send a full-screen display image of a desktop of the user equipment captured by the user equipment to the cloud-side screenshot service, the cloud-side screenshot service may replace a desktop background of the cloud side with the full-screen display image, and further invoke a screenshot tool to screenshot the full-screen display image to obtain a screenshot image, where the obtained screenshot image is also based on content obtained by the full-screen display image of the user equipment, and the screenshot image is consistent with an expectation of the user (obtaining a screenshot image including the desktop background of the user equipment), so that the user achieves an imperceptible experience for whether the user is currently using a cloud service application or a local application.
Specifically, the cloud server may bind the screenshot image with the target cloud service application, specifically, store the screenshot image to a memory slice area associated with the screenshot service of the target cloud service application, where the memory slice area may be a local memory slice area of the cloud server or other external memory slice areas.
And finally, the cloud server can generate a screen capture result containing the access address of the screen capture image in the memory area and send the screen capture result to the user equipment, and when the user needs to acquire the screen capture image subsequently, the user can acquire the screen capture image from the memory area through the access address in the screen capture result.
Optionally, sub-step 4052 may specifically include:
and a substep A1, replacing the current display picture with the full-screen display picture.
And a substep A2, acquiring a simulated screenshot cursor event sent by the user equipment, wherein the simulated screenshot cursor event is a cursor event generated aiming at a simulated screenshot interface displayed by the user equipment, and a full-screen display image is displayed on the simulated screenshot interface.
And a substep A3, calling a screen capturing tool to capture a screen capturing image from the full-screen display image displayed by the cloud server according to the simulated screen capturing cursor event.
Aiming at the substeps A1-A3, in the process of obtaining the screenshot image by calling the screenshot tool to perform screenshot on the full-screen display image by the cloud server, the cloud server can firstly replace the full-screen display image with the current display picture, so that the desktop background of the cloud server is consistent with the desktop background of the user equipment, the user equipment can display a simulated screenshot interface, a user inputs a simulated screenshot cursor event in the simulated screenshot interface, the simulated screenshot cursor event does not trigger the screenshot action on the side of the user equipment and is sent to the cloud server, so that the cloud server calls the screenshot tool according to the simulated screenshot cursor event to intercept the screenshot image from the full-screen display image displayed by the cloud server, and the screenshot image consistent with the expectation of the user (obtaining the screenshot image containing the desktop background of the user equipment) is obtained.
In summary, in the embodiment of the application, under the condition that the cloud end operating environment and the user equipment side operating environment are different in style, although the cloud side screenshot service is triggered and the screenshot process of the cloud side for the target cloud service application is intervened, the actual screenshot content is obtained by processing the screenshot content of the desktop environment of the user equipment, and the screenshot content is consistent with the expectation of the user, so that the user can use the cloud service application or the local application at present, a non-perception experience is achieved, and the fluency of the user in the cloud service application using process is improved.
Referring to fig. 11, which shows a block diagram of a screen capture apparatus provided in an embodiment of the present application, applied to a user equipment, including:
the response module 501 is configured to generate a screen capture event in response to a screen capture trigger operation, and send the screen capture event to the cloud server;
a first obtaining module 502, configured to obtain a screen capture request sent by a cloud server according to a screen capture event;
the screen capture module 503 is configured to call a screen capture tool according to the screen capture request to capture a screen, and send the obtained screen capture content to the cloud server, so that the cloud server generates a screen capture result according to the screen capture content and the target cloud service application;
the second obtaining module 504 is configured to obtain a screen capture result sent by the cloud server.
Optionally, the screen capture module 503 includes:
the first calling sub-module is used for calling a screen capturing tool to enter a screen capturing interface according to the screen capturing request, and the screen capturing interface comprises an interface of the target cloud service application and a desktop background of the user equipment;
and the first screen capturing sub-module is used for responding to screen capturing operation of the screen capturing interface, obtaining screen capturing content containing the interface and/or the desktop background of the target cloud service application, and sending the screen capturing content to the cloud server so that the cloud server can generate a screen capturing result according to the screen capturing content and the target cloud service application.
Optionally, the first cut-screen submodule comprises:
the cursor unit is used for acquiring a screen capturing cursor event included in the screen capturing operation and determining a screen capturing area in the screen capturing interface according to the screen capturing cursor event;
and the screen capture unit is used for sending a screen capture area containing the interface and/or the desktop background of the target cloud service application to the cloud server as screen capture content.
Optionally, the screen capture module 503 includes:
the full screen capture sub-module is used for calling a screen capture tool according to the screen capture request to obtain a full screen display image of the user equipment;
and the screenshot sending submodule is used for adding the full-screen display image to the screenshot content and sending the screenshot content to the cloud server so that the cloud server can intercept all or part of the area from the full-screen display image displayed by the cloud server according to the screenshot operation information subsequently sent by the user equipment.
Optionally, the response module 501 includes:
the event generation sub-module is used for responding to screen capture triggering operation of a screen capture control displayed in an interface of a target cloud service application, generating a screen capture event through a screen capture service of user equipment, and sending the screen capture event to the cloud server according to a preset cloud service transmission protocol;
a screen capture module 503 comprising:
and the first protocol sending submodule is used for the event generating submodule and is used for sending the screen capture content to the cloud server according to the cloud service transmission protocol.
Optionally, the screen capture module 503 includes:
the second calling sub-module is used for calling a screen capturing tool to enter a screen capturing interface according to the screen capturing request, and the screen capturing interface comprises an interface of the target cloud service application and a desktop background of the user equipment;
the second screen capture submodule is used for responding to screen capture operation of a screen capture interface and obtaining a screen capture area containing an interface and/or a desktop background of the target cloud service application;
and the screen recording sub-module is used for responding to screen recording operation on the screen capturing area, recording screen recording contents with preset duration aiming at the screen capturing area and sending the screen recording contents to the cloud server so that the cloud server can bind the screen recording contents with the target cloud service application and generate a screen capturing result.
In summary, in the embodiment of the application, under the condition that the cloud end operating environment and the user equipment side operating environment are different in style, although the cloud side screenshot service is triggered and the screenshot process of the cloud side for the target cloud service application is intervened, the actual screenshot content is obtained by processing the screenshot content of the desktop background of the user equipment, and the screenshot content is consistent with the expectation of the user, so that the user can use the cloud service application or the local application at present, a non-perception experience is achieved, and the fluency of the user in the cloud service application using process is improved.
Referring to fig. 12, which shows a block diagram of another screen capture apparatus provided in the embodiment of the present application, applied to a cloud server, including:
a third obtaining module 601, configured to obtain a screen capture event sent by a user equipment;
the generating module 602 is configured to generate a screen capture request according to the screen capture event and send the screen capture request to the user equipment;
a fourth obtaining module 603, configured to obtain screenshot content captured by the user equipment based on the screenshot request;
the sending module 604 is configured to generate a screen capture result according to the screen capture content and the target cloud service application, and send the screen capture result to the user equipment.
Optionally, the screen capture event is generated based on a screen capture trigger operation of the user equipment on a screen capture control displayed in an interface of the target cloud service application, and the generating module 602 includes:
the third calling sub-module is used for calling the screen capturing service interface to trigger the screen capturing service of the cloud server according to the screen capturing event;
and the starting sub-module is used for starting screen capture aiming at the target cloud service application through the screen capture service of the cloud server, generating a screen capture request and sending the screen capture request to the user equipment according to the cloud service transmission protocol.
Optionally, the screen capture content is content obtained after the user equipment responds to screen capture operation of a screen capture interface, and the screen capture interface comprises an interface of a target cloud service application displayed by the user equipment and a desktop background of the user equipment;
a sending module 604, comprising:
the first binding submodule is used for storing the screenshot content into a memory slice area associated with the screenshot service of the target cloud service application and generating a screenshot result containing an access address of the screenshot content in the memory slice area.
Optionally, the screen capture content is a full-screen display image displayed by the user equipment;
a sending module 604, comprising:
the fourth calling sub-module is used for calling a screen capturing tool to capture a screen of the full-screen display image to obtain a screen captured image;
the second binding submodule is used for storing the screenshot image into a memory slice area associated with the screenshot service of the target cloud service application and generating a screenshot result containing an access address of the screenshot image in the memory slice area.
Optionally, the fourth calling sub-module includes:
the replacing submodule is used for replacing the current display picture with the full-screen display image;
the simulation sub-module is used for acquiring a simulation screen capture cursor event sent by the user equipment, wherein the simulation screen capture cursor event is a cursor event generated aiming at a simulation screen capture interface displayed by the user equipment, and a full-screen display image is displayed on the simulation screen capture interface;
and the screen capture submodule is used for calling a screen capture tool to capture a screen capture image from a full-screen display image displayed by the cloud server according to the simulated screen capture cursor event.
Optionally, the sending module 604 includes:
and the second protocol sending submodule is used for sending the screen capturing result to the user equipment through the target cloud service application according to a preset cloud service transmission protocol.
In summary, in the embodiment of the application, under the condition that the cloud end operating environment and the user equipment side operating environment are different in style, although the cloud side screenshot service is triggered and the screenshot process of the cloud side for the target cloud service application is intervened, the actual screenshot content is obtained by processing the screenshot content of the desktop background of the user equipment, and the screenshot content is consistent with the expectation of the user, so that the user can use the cloud service application or the local application at present, a non-perception experience is achieved, and the fluency of the user in the cloud service application using process is improved.
Referring to fig. 13, a block diagram of a screen capture system provided in an embodiment of the present application is shown, including: a user device 701 and a cloud server 702;
the user equipment 701 is configured to: responding to a screen capturing trigger operation, generating a screen capturing event and sending the screen capturing event to a cloud server; acquiring a screen capturing request sent by a cloud server according to a screen capturing event; calling a screen capturing tool according to the screen capturing request to capture a screen, and sending the obtained screen capturing content to a cloud server so that the cloud server can generate a screen capturing result according to the screen capturing content and the target cloud service application; acquiring a screen capture result sent by a cloud server;
the cloud server 702 is configured to: acquiring a screen capture event sent by user equipment; generating a screen capturing request according to the screen capturing event and sending the screen capturing request to the user equipment; acquiring screenshot content intercepted by user equipment based on a screenshot request; and generating a screen capturing result according to the screen capturing content and the target cloud service application, and sending the screen capturing result to the user equipment.
In summary, in the embodiment of the application, under the condition that the cloud operating environment and the user equipment side operating environment are different in style, although the cloud side screenshot service is triggered and the screenshot process of the cloud side for the target cloud service application is involved, the actual screenshot content is obtained by processing the screenshot content of the desktop background of the user equipment, and the screenshot content is consistent with the expectation of the user, so that the user can use the cloud service application or the local application currently, a non-perception experience is achieved, and the fluency of the user in the process of using the cloud service application is improved.
The present application further provides a non-volatile readable storage medium, where one or more modules (programs) are stored in the storage medium, and when the one or more modules are applied to a device, the one or more modules may cause the device to execute instructions (instructions) of method steps at each user equipment side in the present application.
An embodiment of the present application further provides a user equipment, including: a processor and a memory having executable code stored thereon which, when executed, causes the processor to perform the aforementioned method steps on the user equipment side.
Embodiments of the present application provide one or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause a user equipment to perform a method as described in one or more of the above embodiments. In the embodiment of the application, the user equipment comprises various types of equipment of the terminal equipment.
The embodiments of the present application further provide a non-volatile readable storage medium, where one or more modules are stored in the storage medium, and when the one or more modules are applied to a device, the device may execute instructions of the method steps at each server side in the embodiments of the present application.
An embodiment of the present application further provides a cloud server, including: a processor and a memory having executable code stored thereon that, when executed, causes the processor to perform the aforementioned cloud server-side method steps.
Embodiments of the present application provide one or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause a cloud server to perform a method as described in one or more of the above embodiments.
Embodiments of the present disclosure may be implemented as an apparatus, which may include a user device, a cloud server, etc., using any suitable hardware, firmware, software, or any combination thereof, for a desired configuration. Fig. 14 schematically illustrates an example apparatus 1000 that may be used to implement various embodiments described in embodiments of the present application.
For one embodiment, fig. 14 illustrates an example apparatus 1000 having one or more processors 1002, a control module (chipset) 1004 coupled to at least one of the processor(s) 1002, a Memory 1006 coupled to the control module 1004, a Non-Volatile Memory (NVM)/storage 1008 coupled to the control module 1004, one or more input/output devices 1010 coupled to the control module 1004, and a network interface 1012 coupled to the control module 1004.
The processor 1002 may include one or more single-core or multi-core processors, and the processor 1002 may include any combination of general-purpose or special-purpose processors (e.g., graphics processors, application processors, baseband processors, etc.). In some embodiments, the apparatus 1000 can be used as a terminal device, a server (cluster), or the like in this embodiment.
In some embodiments, the apparatus 1000 may include one or more computer-readable media (e.g., the memory 1006 or the non-volatile memory/storage device 1008) having instructions 1014 and one or more processors 1002 configured to execute the instructions 1014 to implement modules to perform the actions described in this disclosure, in conjunction with the one or more computer-readable media.
For one embodiment, control module 1004 may include any suitable interface controllers to provide any suitable interface to at least one of the processor(s) 1002 and/or any suitable device or component in communication with control module 1004.
Control module 1004 may include a memory controller module to provide an interface to memory 1006. The memory controller module may be a hardware module, a software module, and/or a firmware module.
Memory 1006 may be used, for example, to load and store data and/or instructions 1014 for device 1000. For one embodiment, memory 1006 may comprise any suitable volatile Memory, such as suitable Dynamic Random Access Memory (DRAM), for example. In some embodiments, the memory 1006 may comprise double Data Rate type four synchronous dynamic random access memory (Dual Data Rate 4DRAM, DDR4SDRAM).
For one embodiment, control module 1004 may include one or more input/output controllers to provide an interface to non-volatile memory/storage 1008 and input/output device(s) 1010.
For example, non-volatile memory/storage device 1008 can be used to store data and/or instructions 1014. The non-volatile memory/storage 1008 may include any suitable non-volatile memory (e.g., flash memory) and/or may include any suitable non-volatile storage device(s) (e.g., one or more Hard Disk Drive(s) (HDD (s)), one or more optical Disc (CD) Drive(s), and/or one or more Digital Video Disc (DVD) Drive (s)).
The non-volatile memory/storage 1008 may include storage resources that are physically part of a device on which the apparatus 1000 is installed, or it may be accessible by the device and need not be part of the device. For example, the non-volatile memory/storage 1008 is accessible over a network via the input/output device(s) 1010.
Input/output device(s) 1010 may provide an interface for apparatus 1000 to communicate with any other suitable device, input/output devices 1010 may include communication components, audio components, sensor components, and so forth. Network interface 1012 may provide an interface for apparatus 1000 to communicate over one or more networks, and apparatus 1000 may communicate wirelessly with one or more components of a wireless network according to any of one or more wireless network standards and/or protocols, e.g., access a wireless network based on a communication standard, such as a wireless fidelity (WiFi) network, a Second generation mobile communication system (2G) network, a third generation mobile communication system (3G) network, a fourth generation mobile communication system (4G) network, a fifth generation mobile communication system (5G) network, etc., or a combination thereof.
For one embodiment, at least one of the processor(s) 1002 may be packaged together with logic for one or more controllers of control module 1004 (e.g., memory controller module). For one embodiment, at least one of the processor(s) 1002 may be packaged together with logic for one or more controllers of the control module 1004 to form a System In a Package (SiP). For one embodiment, at least one of the processor(s) 1002 may be integrated on the same die with the logic of one or more controllers of the control module 1004. For one embodiment, at least one of the processor(s) 1002 may be integrated on the same die with logic for one or more controller(s) of control module 1004 to form a System on chip (SoC).
In various embodiments, the apparatus 1000 may be, but is not limited to: a server, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a tablet, a netbook, etc.), among other terminal devices. In various embodiments, the apparatus 1000 may have more or fewer components and/or different architectures. For example, in some embodiments, device 1000 includes one or more cameras, keyboards, liquid Crystal Display (LCD) screens (including touch screen displays), non-volatile memory ports, multiple antennas, graphics chips, application Specific Integrated Circuits (ASICs), and speakers.
The detection device can adopt a main control chip as a processor or a control module, sensor data, position information and the like are stored in a memory or a nonvolatile memory/storage device, a sensor group can be used as an input/output device, and a communication interface can comprise a network interface.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The embodiments in the present specification are all described in a progressive manner, and each embodiment focuses on differences from other embodiments, and portions that are the same and similar between the embodiments may be referred to each other.
Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present application have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the true scope of the embodiments of the application.
Finally, it should also be noted that, in this document, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrases "comprising one of \ 8230; \8230;" does not exclude the presence of additional like elements in a process, method, article, or terminal device that comprises the element.
The screen capturing method, the screen capturing device, the user equipment, the cloud server, the screen capturing system and the machine readable medium provided by the application are introduced in detail, specific examples are applied in the description to explain the principle and the implementation mode of the application, and the description of the above embodiments is only used for helping to understand the method and the core idea of the application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (14)

1. A screen capture method is applied to user equipment and comprises the following steps:
responding to a screen capturing trigger operation, generating a screen capturing event and sending the screen capturing event to a cloud server;
acquiring a screen capturing request sent by the cloud server according to the screen capturing event;
calling a screen capturing tool to capture a screen according to the screen capturing request, and sending the obtained screen capturing content to the cloud server so that the cloud server can generate a screen capturing result according to the screen capturing content and a target cloud service application;
and acquiring the screen capturing result sent by the cloud server.
2. The method according to claim 1, wherein the calling a screen capture tool to capture the screen according to the screen capture request and sending the obtained screen capture content to the cloud server includes:
calling a screen capture tool to enter a screen capture interface according to the screen capture request, wherein the screen capture interface comprises an interface of the target cloud service application and a desktop background of the user equipment;
and responding to the screen capturing operation of the screen capturing interface, acquiring the interface containing the target cloud service application and/or the screen capturing content of the desktop background, and sending the screen capturing content to the cloud server so that the cloud server can generate a screen capturing result according to the screen capturing content and the target cloud service application.
3. The method of claim 2, wherein the obtaining screenshot content containing the interface of the target cloud service application and/or the desktop background in response to the screenshot operation on the screenshot interface comprises:
acquiring a screen capture cursor event included in the screen capture operation, and determining a screen capture area in the screen capture interface according to the screen capture cursor event;
and sending the interface of the target cloud service application and/or the desktop background in the screen capture area as the screen capture content to the cloud server.
4. The method according to claim 1, wherein the calling a screen capture tool to capture the screen according to the screen capture request and sending the obtained screen capture content to the cloud server includes:
calling a screen capturing tool according to the screen capturing request to obtain a full-screen display image of the user equipment;
and adding the full-screen display image to the screen capturing content and sending the screen capturing content to the cloud server so that the cloud server can capture all or partial areas from the full-screen display image displayed by the cloud server aiming at screen capturing operation information subsequently sent by the user equipment.
5. The method according to claim 1, wherein the calling a screen capture tool to capture the screen capture according to the screen capture request and sending the obtained screen capture content to the cloud server comprises:
calling a screen capture tool to enter a screen capture interface according to the screen capture request, wherein the screen capture interface comprises an interface of the target cloud service application and a desktop background of the user equipment;
responding to screen capturing operation of the screen capturing interface, and obtaining a screen capturing area containing the interface of the target cloud service application and/or the desktop background;
responding to screen recording operation of the screen capturing area, recording screen recording contents with preset duration aiming at the screen capturing area, and sending the screen recording contents to the cloud server so that the cloud server can bind the screen recording contents with target cloud service application to generate a screen capturing result.
6. The method according to any one of claims 1 to 5, wherein the generating and sending the screen capture event to the cloud server in response to the screen capture trigger operation comprises:
responding to a screen capture trigger operation of a screen capture control displayed in an interface of a target cloud service application, generating a screen capture event through a screen capture service of user equipment, and sending the screen capture event to a cloud server according to a preset cloud service transmission protocol;
the sending the obtained screen capture content to the cloud server includes:
and sending the screen capture content to a cloud server according to the cloud service transmission protocol.
7. A screen capture method is applied to a cloud server, and comprises the following steps:
acquiring a screen capture event sent by user equipment;
generating a screen capturing request according to the screen capturing event and sending the screen capturing request to the user equipment;
acquiring screenshot content intercepted by the user equipment based on the screenshot request;
and generating a screen capturing result according to the screen capturing content and the target cloud service application, and sending the screen capturing result to the user equipment.
8. A screen capture device applied to user equipment, the device comprising:
the response module is used for responding to screen capture triggering operation, generating a screen capture event and sending the screen capture event to the cloud server;
the first acquisition module is used for acquiring a screen capture request sent by the cloud server according to the screen capture event;
the screen capturing module is used for calling a screen capturing tool to capture a screen according to the screen capturing request, and sending the obtained screen capturing content to the cloud server so that the cloud server can generate a screen capturing result according to the screen capturing content and a target cloud service application;
and the second acquisition module is used for acquiring the screen capturing result sent by the cloud server.
9. A screen capture device is applied to a cloud server, and the device comprises:
the third acquisition module is used for acquiring a screen capture event sent by the user equipment;
the generating module is used for generating a screen capturing request according to the screen capturing event and sending the screen capturing request to the user equipment;
the fourth acquisition module is used for acquiring screenshot contents intercepted by the user equipment based on the screenshot request;
and the sending module is used for generating a screen capturing result according to the screen capturing content and the target cloud service application and sending the screen capturing result to the user equipment.
10. A user device, comprising:
a processor; and
memory having stored thereon executable code which, when executed, causes the processor to perform the method of any of claims 1 to 6.
11. A cloud server, comprising:
a processor; and
a memory having executable code stored thereon that, when executed, causes the processor to perform the method of claim 7.
12. One or more machine-readable media having executable code stored thereon that, when executed, causes a processor to perform the method of any of claims 1 to 6.
13. One or more machine-readable media having executable code stored thereon that, when executed, causes a processor to perform the method of claim 7.
14. A screen capture system, comprising: a user device and a cloud server;
the user equipment is configured to: responding to a screen capturing trigger operation, generating a screen capturing event and sending the screen capturing event to a cloud server; acquiring a screen capture request sent by the cloud server according to the screen capture event; calling a screen capturing tool to capture a screen according to the screen capturing request, and sending the obtained screen capturing content to the cloud server so that the cloud server can generate a screen capturing result according to the screen capturing content and the target cloud service application; acquiring the screen capturing result sent by the cloud server;
the cloud server is configured to: acquiring a screen capture event sent by user equipment; generating a screen capturing request according to the screen capturing event and sending the screen capturing request to the user equipment; acquiring screenshot content intercepted by the user equipment based on the screenshot request; and generating a screen capturing result according to the screen capturing content and the target cloud service application, and sending the screen capturing result to the user equipment.
CN202211312267.5A 2022-10-25 2022-10-25 Screen capture method and device, screen capture system, user equipment and cloud server Pending CN115766822A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211312267.5A CN115766822A (en) 2022-10-25 2022-10-25 Screen capture method and device, screen capture system, user equipment and cloud server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211312267.5A CN115766822A (en) 2022-10-25 2022-10-25 Screen capture method and device, screen capture system, user equipment and cloud server

Publications (1)

Publication Number Publication Date
CN115766822A true CN115766822A (en) 2023-03-07

Family

ID=85353289

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211312267.5A Pending CN115766822A (en) 2022-10-25 2022-10-25 Screen capture method and device, screen capture system, user equipment and cloud server

Country Status (1)

Country Link
CN (1) CN115766822A (en)

Similar Documents

Publication Publication Date Title
WO2019100985A1 (en) Page processing method and mobile terminal
US20200195842A1 (en) Information pushing method, storage medium, terminal device, and server
CN110019464B (en) Page processing method and device
CN114168460B (en) Remote debugging method, device and storage medium for front-end codes in hybrid development
CN104899039A (en) Method and device for providing screen shooting service in terminal device
CN110933075B (en) Service calling method and device, electronic equipment and storage medium
CN111314445A (en) Method and device for controlling recycling machine to open door by mobile phone
WO2017113855A1 (en) Application program interaction method and terminal
CN114647390B (en) Enhanced screen sharing method and system and electronic equipment
WO2023179183A1 (en) Subprogram synchronization processing
CN114356591A (en) Inter-process communication method and device, Internet of things operating system and Internet of things equipment
CN111294500B (en) Image shooting method, terminal device and medium
CN116244029A (en) Control processing method, device, system and storage medium
CN115766822A (en) Screen capture method and device, screen capture system, user equipment and cloud server
CN116527978A (en) Multi-screen interaction control method and device
CN112527424A (en) Control method and device for popup window
CN111045758A (en) View processing method and device, electronic equipment and computer storage medium
CN111400137B (en) Storage method and device of monitoring event, mobile terminal and storage medium
WO2021129416A1 (en) Method and apparatus for controlling frame rate of mobile terminal, computer device and storage medium
CN114785887A (en) Screen projection control method and device, electronic equipment and computer readable storage medium
CN107623870A (en) Control method, device, equipment and computer-readable recording medium
CN107621903B (en) Double-touch-screen equipment and response control method thereof
CN113949684B (en) Video transmission method, device, medium and computing equipment
CN116708886B (en) Video processing method, device and storage medium
CN103686408A (en) Method, device and terminal equipment for projecting resources

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination