WO2018041087A1

WO2018041087A1 - Method and device for screenshot

Info

Publication number: WO2018041087A1
Application number: PCT/CN2017/099416
Authority: WO
Inventors: 王蔚
Original assignee: 中兴通讯股份有限公司
Priority date: 2016-08-29
Filing date: 2017-08-29
Publication date: 2018-03-08
Also published as: CN107783807B; CN107783807A

Abstract

A method and device for a screenshot. The method comprises: after opening a browser on a desktop screen, visiting a web page application on the basis of a Uniform Resource Locator (URL), and loading the web page application in the browser, the web page application running in an interface of the browser (101); minimizing the interface of the browser, toggling from the interface of the browser to the desktop screen, calling, via the web page application, a first interface capable of receiving a screenshot operation, and displaying the first interface on the desktop screen (102); receiving, via the first interface, the screenshot operation, generating a request for a screenshot, invoking, on the basis of the request for the screenshot, an operation of acquiring a current desktop screenshot, and executing, via a second interface capable of acquiring a screenshot, the operation of acquiring the current desktop screenshot (103).

Description

Method and device for screen shot

Technical field

The present application relates to the field of communications, and in particular, to a method and apparatus for a screenshot.

Background technique

Because web applications do not install applications on computers or mobile devices, but use browsers to access them, web applications are rapidly evolving with features that are available anywhere, anytime. Especially with the official release and extensive application of the hypertext markup language HTML 5, web applications can do things that can only be done by local applications, such as local file reading, desktop notification messages, peer-to-peer video communication and retrieval. Features such as desktop screens.

However, in the actual application of the new features of the hypertext markup language HTML 5, the web application running on the browser cannot take a screenshot of the desktop of the non-browser screen. The local application can perform screenshots after the local application is minimized by using the service process resident in the system, the desktop taskbar icon, the desktop floating window, etc., and the relevant operations in the local application are quickly performed without switching back to the local application. . The web application cannot implement the above-mentioned corresponding functions. When the browser is minimized, the screenshot cannot be made. Therefore, there is a need for a screenshot technique that takes a screenshot of the screen through the web application after the browser is minimized.

Summary of invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

The embodiment of the present invention provides a method for taking a screenshot for a problem of taking a screenshot of a screen by a webpage application after the browser is minimized.

The solution of the embodiment of the present invention is implemented as follows:

In one aspect, an embodiment of the present invention provides a method for a screenshot, the method comprising:

After the browser is opened in the desktop screen, the webpage application is accessed according to the uniform resource locator URL address, and the webpage application is loaded in the browser, wherein the webpage application runs on the browser In the interface of the browser, the interface of the browser is minimized, and the interface of the browser is switched to the desktop screen, and the first interface that receives the screen capture operation is invoked by the webpage application, and the first interface is Displayed in the desktop screen; receiving a screen capture operation through the first interface and generating a screenshot request, and initiating an operation of acquiring a current desktop screenshot according to the screenshot request; wherein the current desktop is obtained by acquiring a second interface of the screenshot Screenshot operation.

In the above solution, before the first interface that receives the screen capture operation is invoked by the webpage application, the desktop screen parameter is acquired by the webpage application, and a notification message window is generated according to the desktop screen parameter;

Displaying the first interface in the desktop screen includes:

Displaying the first interface in the desktop screen in the manner of the notification message window.

In the above solution, the method further includes:

Sending the obtained current desktop screenshot to the web application.

In the above solution, the method further includes:

Generating a screen sharing request when the webpage application receives the screen sharing operation;

Establishing a shared connection by using the webpage application and the sharing end corresponding to the screen sharing request according to the screen sharing request;

Acquiring a desktop screen video stream through the second interface; sending the desktop screen video stream to the webpage application, and sending, by the webpage application, the desktop screen video stream to the shared connection.

In the above solution, the performing the current desktop screenshot by acquiring the second interface of the screenshot includes:

The desktop screen video stream acquired through the second interface is truncated to a screenshot image, and the screenshot image is taken as a current desktop screenshot.

In the above solution, the second interface is an interface provided by the browser for acquiring a desktop screen.

In another aspect, an embodiment of the present invention further provides a device for a screenshot, where the device includes: an access unit, a display unit, and a screen capture unit;

The access unit is configured to open a browser in a desktop screen according to a uniform resource locator The web address accesses the webpage application, and the webpage application is loaded in a browser, and the webpage application runs in an interface of the browser;

The display unit is configured to minimize an interface of the browser, switch from the interface of the browser to the desktop screen, and invoke a first interface that receives a screen capture operation by the webpage application, and the first An interface is displayed on the desktop screen;

The screen capture unit is configured to receive a screen capture operation by the first interface and generate a screenshot request, and initiate an operation of acquiring a current desktop screenshot according to the screenshot request; wherein the current desktop screenshot is performed by acquiring a second interface of the screenshot operating.

In the above solution, before the webpage application calls the first interface that receives the screen capture operation, the display unit is further configured to acquire the desktop screen parameter by using the webpage application, and generate a notification message according to the desktop screen parameter. window;

Displaying the first interface in the desktop screen includes:

In the above solution, the device further includes: a sending unit,

Configuring to send the obtained current desktop screenshot to the web application.

In the above solution, the device further includes: a sharing unit configured to:

In the above solution, the operation of the current desktop screenshot by the screen capture unit through the second interface that can obtain the screenshot includes:

Embodiments of the present invention also provide a computer readable storage medium storing computer executable instructions that, when executed by a processor, implement the methods described above.

A method and a device for a screenshot according to an embodiment of the present invention include: after opening a browser in a desktop screen, accessing a webpage application according to a uniform resource locator URL address, loading the webpage application in a browser, the webpage application Running in an interface of the browser; minimizing an interface of the browser, switching back to the desktop screen by a screen of the browser, and calling a first interface that can receive a screen capture operation by using the webpage application, Displaying the first interface in the desktop screen; receiving a screen capture operation through the first interface and generating a screenshot request, and initiating an operation of acquiring a current desktop screenshot according to the screenshot request; wherein, the screenshot can be obtained through The second interface performs the operation of the current desktop screenshot. According to the embodiment of the present invention, after the browser is minimized, the webpage application running on the browser receives the screen capture operation of the user through the first interface displayed on the desktop screen, and can initiate the passage of the screen when receiving the screen capture operation of the user. The second interface obtains the screen capture operation of the desktop screenshot, and obtains the current desktop screenshot through the second interface, which can solve the problem that the browser cannot be screened through the web application after the browser is minimized, so that the user does not need to install a special client application directly, and uses the web application. At the same time as running the web application, the content of the desktop screen is screenshotd, which greatly improves the convenience of the system.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

BRIEF abstract

1 is a schematic flowchart of a method for displaying a screenshot according to Embodiment 1 of the present invention;

2 is a schematic structural diagram of a system for implementing a screen capture method according to Embodiment 3 of the present invention;

3 is a schematic diagram of a desktop screen of a method for displaying a screenshot according to Embodiment 3 of the present invention;

4 is a schematic flowchart of a method for displaying a screenshot according to Embodiment 3 of the present invention;

FIG. 5 is a schematic structural diagram of a system for implementing a screen capture method according to Embodiment 4 of the present invention; FIG.

FIG. 6 is a schematic structural diagram of a system for implementing a screen capture method according to Embodiment 5 of the present invention; FIG.

FIG. 7 is a schematic structural diagram of a system for implementing a screen capture method according to Embodiment 6 of the present invention; FIG.

FIG. 8 is a schematic structural diagram of an apparatus for displaying a screenshot according to Embodiment 7 of the present invention; FIG.

FIG. 9 is a schematic structural diagram of another apparatus for taking a screenshot according to Embodiment 7 of the present invention.

Detailed

The implementation of the solution will be further described in detail below with reference to the accompanying drawings.

Embodiment 1

A first embodiment of the present invention provides a method for displaying a screenshot. As shown in FIG. 1, the method includes:

S101. After the browser is opened in the desktop screen, the webpage application is accessed according to the uniform resource locator URL address, and the webpage application is loaded in the browser, and the webpage application runs in the interface of the browser.

A web application is an application that uses a web browser to operate on the Internet or an intranet. It is also an application written in a web language such as HTML, JavaScript, Java, etc., and can be executed by a browser. When the user accesses a webpage application, the browser accesses the webpage application provided by the webpage application server of the webpage application to access the webpage application, loads the content corresponding to the webpage application, and runs the loaded webpage application on the interface on the browser. Here, the webpage application may include various types of webpage applications such as a photo editing webpage application, a video conferencing webpage application, a remote collaboration webpage application, an online education webpage application, and the like.

Here, taking the video conference application server as an example, when the user accesses the video conference webpage application, the terminal receives the operation of opening the browser by the user, opens the browser, and connects to the video conference webpage application server to access the video conference application through the browser. The video conference webpage application server provides a video conference webpage application service, the terminal receives the video conference webpage application service provided by the video conference webpage application server, loads the video conference webpage application in the browser, and runs the video conference webpage application in the browser. At this time, it is presented as a video conference service webpage application in the browser.

S102. Minimize an interface of the browser, switch from the interface of the browser to the desktop screen, and invoke a first interface that can receive a screen capture operation by using the webpage application, and display the first interface on the first interface. In the desktop screen.

When the interface of the browser is minimized, the screen of the terminal is switched from the interface of the browser to the desktop screen, where the desktop screen is the screen after the browser is minimized, and any non-browser application can be displayed on the desktop screen. For example, when the terminal is running and opening the interface of the browser, the display screen of the terminal displays the interface of the browser, but at this time, the electronic device is also running on the background of the terminal. For applications such as mailboxes and words, when the interface of the browser is minimized, the interface of the email or the interface of the word is displayed on the desktop screen. When the interface of the email and the interface of the word are not displayed, the desktop interface is displayed. Here, the display of the desktop screen after the browser interface is minimized may adopt a technique known in the art, and details are not described herein again.

In the embodiment of the present invention, when the browser is minimized, the first interface of the browser is invoked by the webpage application, wherein the browser receives the screen capture operation of the user for the webpage application through the first interface, and at this time, the first interface is displayed. In the desktop screen.

Here, before the first interface that can receive the screen capture operation is invoked by the webpage application, the desktop screen parameter is acquired by the webpage application, and a notification message window is generated according to the desktop screen parameter;

Displaying the first interface in the desktop screen includes: displaying the first interface in the desktop screen in the manner of the notification message window.

The obtained desktop screen parameters include a size of the notification message window, a position of the notification message window displayed in the desktop screen, a color of the notification message window, a text content displayed by the notification message window, and the like, and a parameter for controlling display of the notification message window. Here, the notification message window may include a plurality of small windows. After acquiring the desktop screen control parameters, the notification message window is generated according to the desktop control parameter, to receive the user's screen capture operation on the first interface through the notification message window. The generated notification message window may include multiple small windows, each of which implements different functions related to the screenshot: for example, receiving a screenshot, confirming a screenshot, deleting a screenshot, etc., and may also include a full screen screenshot, an automatic screenshot, and a portion. Screenshots and other screenshot functions provide users with different functions, allowing users to perform different types of screen capture operations according to their needs, triggering related functions of different screenshots. Here, the notification message window can be displayed in the form of a control, a floating window, etc., and no limitation is made here.

Here, when the notification message window is displayed, the function description of the first interface may be configured in the window in the form of text, for example, a description of "screen capture" is displayed on the window.

In the embodiment of the present invention, the order of minimizing the browser and the order of obtaining the parameters of the desktop screen are not limited, and the desktop screen parameters may be acquired by the webpage application before the browser is minimized. For example, when the web application is accessed through a browser, the desktop screen parameter is acquired while the web application is being loaded, and a notification message window is generated when the web application is run on the browser. At this time, the display may or may not be displayed, and when the browser is minimized, when the first interface is invoked by the web application, the notification is cancelled. The display of the info window displays the first interface on the desktop screen. The desktop screen parameters may also be obtained through the web application after the browser is minimized, and a notification message window is generated according to the acquired desktop screen parameters. When the first interface is invoked by the web application, the first interface is displayed on the desktop screen by the display of the notification message window. Of course, the desktop screen parameter can also be obtained while the browser is minimized, and the notification message window is generated according to the desktop screen parameter. When the first interface is invoked by the web application, the first interface is displayed on the desktop screen by the display of the notification message window. .

S103: Receive a screen capture operation by using the first interface, and generate a screenshot request, and initiate an operation of acquiring a current desktop screenshot according to the screenshot request; wherein the current desktop screenshot operation is performed by using the second interface that can obtain the screenshot.

For example, when the terminal receives the screen capture operation of the user, the screen capture operation is a user operation received through the notification message window, that is, the screen capture operation is received through the first interface, and at this time, the terminal generates a screenshot request according to the received screen capture operation. At this time, based on the trigger of the screen capture request, the current desktop screenshot is obtained through the second interface of the browser; wherein the second interface is an interface provided by the browser to obtain the desktop screen. Here, the obtained current desktop screenshot may be a complete desktop screenshot or a partial desktop screenshot or the size and content of the desktop screenshot according to the current desktop display interface. The size and content of the acquired desktop screen can be determined according to the specific requirements of the received user operation.

The method for the screenshot provided by the embodiment of the present invention further includes: sending the acquired current desktop screenshot to the webpage application, and displaying the webpage application in the webpage application.

After obtaining the current desktop screenshot through the second interface of the browser, the current desktop screenshot obtained by the browser is sent to the web application, and at this time, the interface of the browser can be switched back to display the webpage application that triggers the screenshot operation, and the current desktop is displayed. After the screenshot is sent to the web application, it can be displayed directly on the browser or sent to the server or other device connected to the terminal. At this time, based on the browser, the web application is accessed, that is, the current desktop screenshot is displayed in the web application; or a prompt is given to ask the user whether to display the current desktop screenshot in the web application, when receiving the user's display indication. The current desktop screenshot is displayed in the web application. When the current desktop screenshot is displayed in the web application, the user can perform various operations, for example, using the current desktop screenshot as the background of the electronic whiteboard for the user to operate the screenshot in the electronic whiteboard.

Here, after obtaining the current desktop screenshot, the obtained desktop screenshot may be sent to the web application server to be saved in the web application server, so that the device accessing the web application server is accessed. You can get the current desktop screenshot.

The method of the screen shot provided by the embodiment of the present invention further includes: generating a screen sharing request when the webpage application receives the screen sharing operation; and sharing the webpage application with the screen sharing request according to the screen sharing request according to the screen sharing request Establishing a shared connection; acquiring a desktop screen video stream by using the second interface; sending the desktop screen video stream to the webpage application, and sending, by the webpage application, the desktop screen video stream to the shared connection.

At this time, the webpage application is a webpage application having a multi-terminal shared screen, such as a video conferencing application, a remote collaborative webpage application, and the like. When the browser of the terminal A runs the webpage application on the terminal A, the screen sharing operation is performed on the webpage application, and the terminal A receives the screen sharing operation of the operator user A of the terminal A through the webpage application, and generates a sharing request according to the screen sharing operation. The webpage application is used to establish a shared connection with the webpage application on the other terminal B, and the desktop of the terminal A is displayed in the webpage application of the terminal B. At this time, the terminal A obtains the desktop screen video stream of the current desktop screen through the second interface of the browser, and sends the obtained desktop screen video stream to the webpage application, and sends the desktop screen of the terminal A to the webpage application by using the webpage application. On terminal B. After receiving the video stream through the browser on the terminal B, the terminal B displays the received video stream through the web application, and presents the desktop of the terminal A on the terminal B. At this time, the content presented on the webpage application on the terminal B, that is, the content presented on the browser is the content of the current desktop screen of the terminal A. When the current desktop screen of the terminal A displays the browser, the browser is displayed in the webpage application of the terminal B. When the current desktop screen of the terminal A displays the document, the webpage application of the terminal B displays the document, and the display of the webpage application of the terminal B The content is synchronized with the content displayed on the desktop screen of the terminal A, and simultaneously displays the operation of the user A on the desktop screen.

At this time, the operation of the current desktop screenshot by the second interface that can obtain the screenshot includes: intercepting the desktop video stream acquired through the second interface to obtain a screenshot image, and using the screenshot image as the current desktop screenshot.

When the terminal A shares the desktop screen of the terminal A to the terminal B through the webpage application, in a case where the browser is minimized, the terminal A receives the screen capture operation of the user A through the first interface displayed by the notification message window. At this time, the desktop screen video stream is being acquired through the second interface, and the desktop screen video stream of the terminal A is sent to the terminal B through the webpage application, and the state of the desktop screen of the terminal A is shared with the terminal B. At this point, generate a screenshot request based on the screen capture operation, on the screen Under the trigger of the screenshot request, the screenshot of the desktop screen video stream minimized by the browser minimized interface is intercepted, and the screenshot image of the corresponding moment of the screen operation is intercepted, and the intercepted screenshot image is taken as the current desktop screenshot. Here, in the case of sharing the browser of the screen desktop of the terminal A itself, when the browser is minimized, the screen capture operation of the user A is received through the displayed notification message window, and the screenshot of the current desktop is acquired through the second interface of the browser. Implement a screenshot.

In the sharing process, the terminal B as the receiving shared screen can also call the first interface to display the first interface when the browser is minimized. Here, the form of the message window may also be notified for receiving the screen capture operation of the user through the displayed first interface, and when the screen capture operation is received, the current desktop screenshot is acquired by the second interface provided by the browser.

In the actual application, when the terminal A obtains the current desktop screenshot, the current desktop screenshot obtained is sent to the web application of the terminal A itself, and is sent to the terminal through the shared connection between the web application of the terminal A and the web application of the terminal B. B's browser is displayed on the web application on terminal B.

In the embodiment of the present invention, when the first interface of the browser running by the webpage application is minimized by the browser, the first interface of the browser is displayed on the desktop screen, and the screen capture operation of the user is received through the first interface. When the user's screen capture operation is received, the current desktop screenshot is obtained through the second interface of the browser, thereby implementing a screenshot of the non-browser interface in the case where the browser of the web application is minimized.

In addition, when in the scenario of sharing a desktop, in the case where the browser is minimized, the user's screen capture operation is received through the first interface displayed on the desktop screen. When the screen capture operation is received, the current desktop screenshot in the minimized state of the browser is obtained through the second interface, and can be sent to the web application, and the current desktop screenshot is sent between the plurality of shared ends through the web application.

Embodiment 2

In the second embodiment of the present invention, a method for displaying a screenshot provided by an embodiment of the present invention is described by using a webpage application loaded by a terminal as a photo editing webpage application as a specific application scenario, for example:

The user accesses the photo editing function provided in the photo editing webpage application by using the browser to access the uniform resource locator URL address provided by the photo editing webpage application server. At the same time, the browser has the ability to capture desktop screens.

The user accesses the photo editing web application in the browser, and when the browser is minimized, only one browser icon is displayed in the task bar. The terminal provides a desktop screen that allows the user to manipulate other applications on the desktop than the browser on the desktop. At this time, the first interface is displayed on the desktop screen in the form of a notification message window, and a desktop notification message is displayed on the window to indicate that the user's screen capture operation can be received through the notification message window. When the user triggers the screen capture operation through the webpage application, clicking the photo editing webpage application to display the desktop notification message of the photo editing webpage application displayed on the screen triggers the screen capture operation. Here, the notification message window of the edit picture webpage application is located in the task bar in the lower right corner of the desktop. Therefore, when the screen capture is performed, what is intercepted is the operation on the current desktop screen that the user is performing, and the content of the intercepted desktop screenshot is not in the browser because the browser needs to return to the image editing web application through the browser. The content of the photo editing web application.

Embodiment 3

In the third embodiment of the present invention, a method for performing a screen shot provided by an embodiment of the present invention is described in a specific application scenario.

The system architecture for the method of implementing this screenshot is shown in Figure 2:

The web application server is configured to provide a web application service that includes screen sharing and screenshot capabilities.

The desktop is the main screen area that you see when you open the terminal and log in to the operating system.

A browser is an application that can display the hypertext markup language HTML content of a web server or file system and allow users to interact with these files.

The user uses the browser to access the screen sharing and screenshot functions provided in the web application by accessing the uniform resource locator URL address provided by the web application server. At the same time, the browser has the ability to get a desktop screen of a computer.

The desktop screen after screen sharing in the web application in the embodiment of the present invention is as shown in FIG. 3:

After the user accesses the web application in the browser and triggers the screen sharing operation, after the browser is minimized on the desktop, only one browser icon is displayed in the task bar. The user can self-operate other applications on the desktop according to the shared screen content, and send the operation process to other people who are visiting the web application. Here, other applications outside the browser can be displayed on the desktop at the same time. If you pass the webpage The application triggers the screen capture operation, and the webpage application desktop notification message popped up before the screen sharing operation is clicked to trigger the screen capture operation. Here, the desktop notification message is content displayed by the notification message window displayed on the desktop screen, wherein the first interface is displayed in the form of a desktop notification message. The webpage application desktop notification message is located in the task bar in the lower right corner of the desktop. Therefore, when the screen is screened, the user intercepts the current desktop operation, and the user does not return to the webpage application through the browser. The intercepted screen is the web application operation in the browser.

In this embodiment, the desktop message window is displayed in the form of an icon in the task bar based on the desktop screen parameter. The notification message window is described as an example. In the actual application, the limitation is not limited, and the desktop screen parameter may be according to the user's needs. Set the location of the notification message window.

As shown in FIG. 4, the method for performing a screenshot in a web application includes:

S401. The terminal receives a screen sharing request.

The user accesses the web application through the browser and initiates a screen sharing request in the web application.

S402. The terminal performs screen sharing.

At this time, the webpage application invokes the interface of the browser to obtain the desktop screen, acquires the current desktop screen, and invokes the first interface that receives the user operation, displays the first window, and pops up a desktop notification window that can trigger the screenshot. At this point, the browser is minimized and the displayed interface is switched from the browser's interface to the desktop screen.

S403. The terminal receives a screen capture operation.

At this point, the user can perform other application operations on the desktop. When the screenshot is taken, the desktop notification window popped up by the previous web application is clicked to perform a screen capture operation, and the terminal receives the screen capture operation through the desktop notification window, and generates a screenshot according to the screen capture operation. Request and send a screenshot request to the web app.

S404. The terminal acquires a screenshot of the current desktop.

When the web application receives the screenshot request, it takes a screenshot of the content that the user is currently sharing on the desktop screen. Here, the second interface of the desktop screen provided by the browser can be used to take a screenshot to obtain the current desktop screenshot.

Embodiment 4

In this embodiment, the screenshot is taken as a specific process in the process of sharing the video conference screen. The application scenario describes a screenshot method provided by the embodiment of the invention.

The system architecture that implements this screenshot method is shown in Figure 5:

In the browser, the user accesses the video conference web application server and the media server through the browser, and uses the video conference web application.

The video conference web application server provides a video conference webpage application service, and the user accesses through the browser and presents the video conference webpage application in the browser.

The media server is configured to receive and send audio and video media streams of the video conference, and perform corresponding media processing, including synthesis, media format conversion, and the like.

The process of taking a screenshot during the sharing of a video conference screen is as follows:

Step 1: User A and User B access the video conference web application server through the browser, and join the same video conference in the video conference web application to perform video conference.

In step 2, user A initiates a screen sharing request in the video conference web application.

Step 3: The video conference webpage application invokes an interface for obtaining a desktop screen provided by the browser, acquires a desktop screen of the user A, and sends the video stream operated on the desktop screen of the user A to the media server. User B accesses the media server through the browser and plays the desktop screen video stream shared by user A.

Meanwhile, since the web application in the browser of the user A invokes the interface provided by the browser to acquire the desktop screen, the browser window of the user A is minimized, and the screen is cut back to the desktop shared by the user A. In order to enable user A to return to the browser for screenshots during the desktop sharing process, the video conference web application invokes the desktop notification message interface and pops up the desktop notification message while calling the interface provided by the browser to obtain the desktop screen. The content of the desktop notification message includes an action that can trigger a screenshot.

Step 4: During the process of desktop sharing, user A clicks on the screenshot operation in the desktop notification message to send a screenshot request.

Step 5: After receiving the screenshot request, the video conference webpage application takes a screenshot of the desktop video stream shared by the current user A, and uploads it to the video conference webpage application server for display in the video conference webpage application. In addition, the video conference web application can use the screenshot as the background of the electronic whiteboard, and the participant user A and user B can operate the screenshot in the electronic whiteboard.

For example, the implementation of the Chrome extension for screen sharing and screenshots in the Chrome browser is as follows:

When the Chrome browser is running, the listener is added by an external message event (for example, the onMessageExternal event). When the request message for the event is received to obtain a video stream (for example, getStream), the screen capture method provided by the Chrome browser is called to obtain The video stream of the user's current screen,

In the screen capture method, the user's current screen video stream number streamId is sent to the webpage code requesting the extension by sending a response method (eg, sendResponse), and further processing is performed to send the video stream to the media server.

Then, a desktop notification message object (for example, window.Notification) is created, a screen sharing desktop notification message is popped up, and a notification webpage application is performed to perform a screenshot in the event of a mouse click onclick of the desktop notification message. That is, when the user clicks on the desktop notification message, a request for sending a screenshot is sent to the web application by submitting the message postMessage method.

Embodiment 5

In this embodiment, a method of performing a screenshot in the process of remote assistance screen sharing to describe a screenshot provided by the embodiment of the invention for a specific scenario is described.

The system architecture for implementing this screenshot is shown in Figure 6,

Browser A, User A accesses the Remote Assistance web application server through browser A, using a remote collaborative web application.

Browser B, user B accesses the remote assistance web application server through browser B, and uses the remote collaborative web application. Browser A and browser B can directly transmit and receive audio and video media streams.

The remote assistance web application server provides a remote assistance web application service, which is accessed by the user through a browser and presented as a remote assistance web application in the browser.

The process of taking a screenshot during Remote Assistance screen sharing is as follows:

Step 1: User A and User B access the remote assistance web application server through browser A and browser B, respectively, and perform video communication in the remote assistance web application.

Step 2: User A initiates screen sharing in the remote assistance web application opened by browser A. begging.

Step 3: The remote assistance webpage application invokes an interface provided by the browser to obtain a desktop screen, acquires the desktop screen of the user A, and sends the video stream operated on the desktop screen of the user A to the browser B of the user B, in the browser B. The open remote assistance web application plays the received desktop screen video stream shared by user A.

Meanwhile, since the web application in the browser of the user A invokes the interface provided by the browser to acquire the desktop screen, the browser window of the user A is minimized, and the screen is cut back to the desktop shared by the user A. In order to enable user A to return to the browser for screenshots during the desktop sharing process, the remote assistance web application invokes the desktop notification message interface and pops up the desktop notification message while calling the interface provided by the browser to obtain the desktop screen. The content of the desktop notification message includes an action that can trigger a screenshot.

Step 5: After receiving the screenshot request, the remote assistance webpage application takes a screenshot of the desktop video stream shared by the current user A, and displays it in the remote collaborative webpage application of browser A. In addition, the remote assistance web application can send the screenshot to the browser B or upload to the remote assistance web application server for display, storage, electronic whiteboard sharing and the like.

Embodiment 6

In the embodiment of the present invention, a screenshot method provided by an embodiment of the present invention is described by taking a screenshot in the process of online education screen sharing for a specific application scenario.

The system architecture that implements this screenshot method is shown in Figure 7:

Browser (teacher): The teacher accesses the online education web application server and media server through the browser, and uses the online education web application to perform screen sharing, screenshots and the like.

Browser (student): Students access the online education web application server and media server through a browser, and use the online education web application to watch the teacher's live course.

The online education web application server provides an online education web application service, and the teacher and the student respectively access through the browser and present as an online education web application in the browser.

a media server configured to receive and send audio and video media streams of the course, and may be corresponding Media processing, including compositing, media format conversion, etc.

The process of taking screenshots during the online education screen sharing process is as follows:

Step 1. The teacher and the student respectively access the online education web application server through the browser, and join the same course live broadcast in the online education web application.

In step 2, the teacher initiates a screen sharing request in the online education web application.

Step 3: The online education webpage application invokes an interface provided by the browser to obtain a desktop screen, acquires a teacher's desktop screen, and sends the video stream operated on the teacher's desktop screen to the media server. Students access the media server through a browser and play the desktop screen video stream shared by the teacher.

At the same time, since the web application in the teacher's browser invokes the interface provided by the browser to obtain the desktop screen, the teacher's browser window is minimized, and the screen is cut back to the desktop shared by the teacher. In order to make the teacher in the process of desktop sharing, without going back to the browser for screenshots, the online education webpage application invokes the desktop notification message interface and pops up the desktop notification message while calling the interface provided by the browser to obtain the desktop screen. The content of the desktop notification message includes actions that trigger a screenshot.

Step 4: During the process of desktop sharing, the teacher clicks on the screenshot operation in the desktop notification message to send a screenshot request.

Step 5: After receiving the screenshot request, the online education webpage application takes a screenshot of the desktop video stream shared by the current teacher, and uploads it to the online education webpage application server for display in the online education webpage application. In addition, the online education web application can use the screenshot as the background of the electronic whiteboard, and the participant teacher can circle and mark the screenshot in the electronic whiteboard.

This program enables teachers to directly use the web application to conduct live courses without the need to install a dedicated client application. This allows the teacher to broadcast the course at any time, any place, any browser device that supports web real-time communication, greatly improving the system. Easy to use.

The method for the screenshot provided by the embodiment of the invention can access the related webpage application in the browser of the terminal such as the mobile phone, the tablet computer, the set top box device, etc. to perform the screen capture operation in the process of screen sharing.

Example 7

The embodiment of the present invention provides a device for taking a screenshot, The device is applied to a terminal. As shown in FIG. 8, the device includes an access unit 801, a display unit 802, and a screen capture unit 803.

The access unit 801 is configured to access the webpage application according to the uniform resource locator URL address after the browser is opened in the desktop screen, and load the webpage application in the browser, where the webpage application runs in the interface of the browser.

The display unit 802 is configured to minimize an interface of the browser, switch to the desktop screen by an interface of the browser, and invoke the first interface that can receive a screen capture operation by the webpage application, and the first The interface is displayed on the desktop screen.

The screen capture unit 803 is configured to receive a screen capture operation by the first interface and generate a screenshot request, and initiate an operation of acquiring a current desktop screenshot according to the screenshot request; wherein the current desktop screenshot is performed through the second interface that can obtain the screenshot operating.

Before the webpage application invokes the first interface that can receive the screen capture operation, the display unit 802 is further configured to acquire the desktop screen parameter by using the webpage application, and generate a notification message window according to the desktop screen parameter. Here, displaying the first interface in the desktop screen comprises: displaying the first interface in the desktop screen in the manner of the notification message window.

As shown in FIG. 9, the device further includes: a sending unit 804, configured to send the acquired current desktop screenshot to the webpage application, and perform related processing on the current desktop screenshot in the webpage application, such as displaying , sent to the server, and so on.

As shown in FIG. 9, the device further includes: a sharing unit 805, configured to: generate a screen sharing request when the webpage application receives the screen sharing operation; and use the webpage application and the screen according to the screen sharing request The shared terminal corresponding to the sharing request establishes a shared connection; the desktop screen video stream is obtained through the second interface; the desktop screen video stream is sent to the webpage application, and the desktop screen video stream is sent to the webpage application by the webpage application The shared connection.

The operation of the current desktop screenshot by the screen capture unit 803 by acquiring the second interface of the screenshot includes: intercepting the desktop screen video stream acquired through the second interface to obtain a screenshot image, and using the screenshot image as a current desktop screenshot. .

The embodiment of the invention further provides a computer readable storage medium, which stores a computer executable finger The method described above is implemented when the computer executable instructions are executed by a processor.

Those of ordinary skill in the art will appreciate that all or some of the steps, systems, and functional blocks/units of the methods disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be composed of several physical The components work together. Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on a computer readable medium, which may include computer storage media (or non-transitory media) and communication media (or transitory media). As is well known to those of ordinary skill in the art, the term computer storage medium includes volatile and nonvolatile, implemented in any method or technology for storing information, such as computer readable instructions, data structures, program modules or other data. Sex, removable and non-removable media. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridge, magnetic tape, magnetic disk storage or other magnetic storage device, or may Any other medium used to store the desired information and that can be accessed by the computer. Moreover, it is well known to those skilled in the art that communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and can include any information delivery media. .

The above is only an embodiment of the present application, and is not intended to limit the scope of protection of the present application.

Industrial applicability

Embodiments of the present invention provide a method and apparatus for a screenshot. The method includes: after opening a browser in a desktop screen, accessing a webpage application according to a uniform resource locator URL address, loading the webpage application in a browser, where the webpage application runs in an interface of the browser; The interface of the browser is minimized, and the screen of the browser is switched back to the desktop screen, and the first interface that can receive the screen capture operation is invoked by the webpage application, and the first interface is displayed on the desktop. Receiving a screen capture operation through the first interface and generating a screen shot request, and initiating an operation of acquiring a current desktop screenshot according to the screenshot request; wherein, by acquiring a screen cut The second interface of the figure performs the operation of the current desktop screenshot. According to the embodiment of the present invention, after the browser is minimized, the webpage application running on the browser receives the screen capture operation of the user through the first interface displayed on the desktop screen, and can initiate the passage of the screen when receiving the screen capture operation of the user. The second interface obtains the screen capture operation of the desktop screenshot, and obtains the current desktop screenshot through the second interface, which can solve the problem that the browser cannot be screened through the web application after the browser is minimized, so that the user does not need to install a special client application directly, and uses the web application. At the same time as running the web application, the content of the desktop screen is screenshotd, which greatly improves the convenience of the system. Therefore, the present invention has strong industrial applicability.

Claims

A method of screen shots, the method comprising:

After the browser is opened in the desktop screen, the webpage application is accessed according to the uniform resource locator URL address, and the webpage application is loaded in the browser; wherein the webpage application runs in the interface of the browser (101);

Minimizing an interface of the browser, switching from the interface of the browser to the desktop screen, and calling, by the web application, a first interface that receives a screen capture operation, and displaying the first interface on the desktop In the screen (102);

Receiving a screen capture operation by the first interface and generating a screenshot request, according to the screenshot request, an operation of acquiring a current desktop screenshot is initiated; wherein the current desktop screenshot operation is performed by acquiring a second interface of the screenshot (103).
The method according to claim 1, wherein the desktop screen parameter is acquired by the webpage application, and the notification message window is generated according to the desktop screen parameter, before the webpage application calls the first interface that receives the screen capture operation. ;

Displaying the first interface in the desktop screen includes:

Displaying the first interface in the desktop screen in the manner of the notification message window.
The method of claim 1 further comprising:

Sending the obtained current desktop screenshot to the web application.
The method of claim 1 further comprising:

Generating a screen sharing request when the webpage application receives the screen sharing operation;

Establishing a shared connection by using the webpage application and the sharing end corresponding to the screen sharing request according to the screen sharing request;

Acquiring a desktop screen video stream through the second interface; sending the desktop screen video stream to the webpage application, and sending, by the webpage application, the desktop screen video stream to the shared connection.
The method of claim 4, wherein the performing the current desktop screenshot by acquiring the second interface of the screenshot comprises:

The desktop screen video stream acquired through the second interface is truncated to a screenshot image, and the screenshot image is taken as a current desktop screenshot.
The method of any of claims 1, 4, 5, wherein the second interface is an interface provided by a browser to acquire a desktop screen.
A device for screen shots, comprising: an access unit (801), a display unit (802), and a screen capture unit (803); wherein

The access unit (801) is configured to: after the browser is opened in the desktop screen, access the webpage application according to the uniform resource locator URL address, and load the webpage application in a browser, where the webpage application runs on the browser In the interface;

The display unit (802) is configured to minimize an interface of the browser, switch to an interface of the browser by the interface of the browser, and invoke a first interface for receiving a screen capture operation by the webpage application, The first interface is displayed on the desktop screen;

The screen capture unit (803) is configured to receive a screen capture operation through the first interface and generate a screenshot request, and initiate an operation of acquiring a current desktop screenshot according to the screenshot request; wherein the current interface is obtained by acquiring a second interface of the screenshot The operation of the desktop screenshot.
The apparatus according to claim 7, wherein the display unit (802) is further configured to acquire the desktop screen parameter by the webpage application before the webpage application invokes the first interface that receives a screen capture operation, Generating a notification message window according to the desktop screen parameter;

Displaying the first interface in the desktop screen includes:

Displaying the first interface in the desktop screen in the manner of the notification message window.
The apparatus of claim 7, further comprising: a transmitting unit (804),

Configuring to send the obtained current desktop screenshot to the web application.
The apparatus of claim 7, further comprising: a sharing unit (805) configured to:

Generating a screen sharing request when the webpage application receives the screen sharing operation;

Establishing a shared connection by using the webpage application and the sharing end corresponding to the screen sharing request according to the screen sharing request;

Acquiring a desktop screen video stream through the second interface; sending the desktop screen video stream to the webpage application, and sending, by the webpage application, the desktop screen video stream to the shared connection.
The apparatus according to claim 10, wherein the operation of the current desktop screenshot by the screen capture unit (803) by acquiring the second interface of the screenshot comprises:

The desktop screen video stream acquired through the second interface is truncated to a screenshot image, and the screenshot image is taken as a current desktop screenshot.
The apparatus of any one of claims 7, 10, 11, wherein the second interface is an interface provided by a browser to acquire a desktop screen.
A computer readable storage medium storing computer executable instructions that, when executed by a processor, implement the screen shot method of any of claims 1-6.