WO2020042350A1 - 一种桌面投屏方法、装置、设备及存储介质 - Google Patents

一种桌面投屏方法、装置、设备及存储介质 Download PDF

Info

Publication number
WO2020042350A1
WO2020042350A1 PCT/CN2018/113698 CN2018113698W WO2020042350A1 WO 2020042350 A1 WO2020042350 A1 WO 2020042350A1 CN 2018113698 W CN2018113698 W CN 2018113698W WO 2020042350 A1 WO2020042350 A1 WO 2020042350A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
screen
screenshot
desktop
frequency
Prior art date
Application number
PCT/CN2018/113698
Other languages
English (en)
French (fr)
Inventor
陈明良
Original Assignee
广州视源电子科技股份有限公司
广州视睿电子科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州视源电子科技股份有限公司, 广州视睿电子科技有限公司 filed Critical 广州视源电子科技股份有限公司
Publication of WO2020042350A1 publication Critical patent/WO2020042350A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces

Definitions

  • the present invention relates to the field of computer intelligent interaction, and in particular, to a method, a device, a device, and a computer-readable storage medium for desktop projection.
  • the screen-casting device as the transmitting end intercepts the screen-casting content, and encapsulates the intercepted screen-casting content as transmittable data, and sends it to the receiving-end device through the wireless network, so that the receiving-end device receives the transmission when receiving After analyzing the data, it is parsed into the screen content of the receiving end, and the desktop synchronous display or operation is performed according to the analyzed screen content.
  • the transmitting end encapsulates the intercepted screen-casting content into transmittable data, and sends the transmittable data to the receiving end device for analysis and display.
  • the sender intercepts the screen content for package transmission based on its default settings.
  • the following problems will occur: First, the current transmission network status is not taken into account. Excessive data transmission content may result from poor network conditions. The transmission delay causes the receiving device to receive a delay, which causes the screen to freeze. Second, the functional limitations of the software and hardware devices of the receiving device are not considered. The screen content transmitted by the transmitting device may be due to the software and hardware facilities of the receiving device. The function limitation causes the display screen to be unclear, which seriously affects the user experience.
  • an object of the present invention is to provide a method, a device, a device, and a computer-readable storage medium for desktop screen projection, which dynamically adjust the screen capture frequency to meet the requirements of screen content of different attributes.
  • an embodiment of the present invention provides a desktop screen casting method, including:
  • the determining the attributes of the screencast content according to the first screen capture content is specifically:
  • the determining of the content of the screen-casting content is performed according to a residual between at least two adjacent frames of the first screenshot content Attributes, specifically:
  • the screen shot content is static screen shot content.
  • the adjusting the current screen capture frequency to the second screen capture frequency according to the properties of the screencasting content is specifically:
  • the time interval between two adjacent screenshots is adjusted.
  • an embodiment of the present invention provides a desktop projection screen method, including:
  • the method further includes:
  • the second screen capture frequency is 20 frames / second to 30 frames / second.
  • the third screen capture frequency is 5 frames / second to 20 frames / second.
  • an embodiment of the present invention provides a desktop screen projection device, including:
  • Projection screen startup module used to start desktop screen projection settings
  • a first screenshot content generation module configured to take a screenshot of the screencast content displayed on the current desktop according to the first screenshot frequency, and generate a first screenshot content
  • a screencast content attribute determination module configured to determine the attributes of the screencast content according to the first screencast content
  • a screen capture frequency adjustment module configured to adjust the current screen capture frequency to a second screen capture frequency according to the properties of the screencast content
  • a second screen shot content generating module configured to screen the screen shot content according to the second screen shot frequency to generate a second screen shot content
  • a second screenshot content transmission module configured to send the second screenshot content to a display terminal for display.
  • the screen-screen content attribute determination module specifically includes:
  • the content attribute determination submodule is configured to determine an attribute of the screen-casting content according to a residual between at least two adjacent frames of the first screen-captured content.
  • the content attribute determination submodule specifically includes:
  • a dynamic content determining unit configured to determine that the screen-casting content is dynamic screen-casting content when a residual between at least two adjacent frames of the first screenshot content is greater than a preset threshold
  • the static content determining unit is configured to determine that the screen-casting content is static screen-casting content when a residual between at least two adjacent frames of the first screenshot content is less than a preset threshold.
  • the screen capture frequency adjustment module specifically includes:
  • the time interval between two adjacent screenshots is adjusted.
  • an embodiment of the present invention provides a desktop screen projection device, including:
  • Projection screen startup module used to start desktop screen projection settings
  • a first screenshot content generation module configured to take a screenshot of the screencast content displayed on the current desktop according to the first screenshot frequency, and generate a first screenshot content
  • a dynamic content determining module configured to determine that the screen-casting content is dynamic screen-casting content when a residual between at least two adjacent frames of the first screenshot content is greater than a preset threshold
  • a second screen shot content generating module configured to screen the dynamic screen shot content according to a second screen shot frequency to generate a second screen shot content
  • a second screenshot content transmission module configured to send the second screenshot content to a display terminal for display
  • a static content determining module configured to determine that the screencast content is static screencast content when a residual between at least two adjacent frames of the first screencast content is less than a preset threshold
  • a third screen shot content generating module configured to screen the static screen shot content according to a third screen shot frequency to generate a third screen shot content; wherein the third screen shot frequency is less than the second screen shot frequency;
  • a third screenshot content transmission module configured to send the third screenshot content to a display terminal for display.
  • the method further includes:
  • Annotation information receiving module configured to receive annotation information for the screen-casting content; wherein the annotation information is generated by an input device operation;
  • a fourth screenshot information generation module configured to take a screenshot of the annotated projection content at a fourth screenshot frequency to generate a fourth screenshot content
  • a fourth screenshot information transmission module configured to send the fourth screenshot content to a display terminal for display.
  • the second screen capture frequency is 20 frames / second to 30 frames / second.
  • the third screen capture frequency is 5 frames / second to 20 frames / second.
  • an embodiment of the present invention provides a desktop projection screen device including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, where the processor executes the The computer program implements the desktop projection method according to any one of the first aspects.
  • an embodiment of the present invention provides a desktop projection device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, where the processor executes the The computer program implements the desktop projection method described in any one of the second aspects.
  • an embodiment of the present invention provides a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program, and when the computer program runs, controls a device where the computer-readable storage medium is located
  • the desktop projection screen method according to any one of the first aspects is executed.
  • an embodiment of the present invention provides a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program, wherein when the computer program runs, a device where the computer-readable storage medium is located is controlled
  • the desktop projection screen method according to any one of the second aspects is executed.
  • the desktop screencasting process launch the desktop screencasting setting, first determine the properties of the screencasting content, and then adjust the current screen capture frequency according to the properties of the screencasting content to perform the screencasting content on the screencasting content after the adjustment.
  • the screen capture is then sent to the display terminal.
  • the present invention dynamically adjusts the screen capture frequency according to the properties of the screen shot content, thereby achieving dynamic adjustment of the frame rate, so that the screen shot content displayed on the display terminal can be displayed based on
  • the display effect of its own attributes improves the user experience, and at the same time avoids the unreasonable setting of the screen capture frequency, which leads to the poor display of the screen content captured by the fixed screen capture frequency at the receiving end, thereby improving the good screen display technology. Applicability.
  • FIG. 1 is a schematic flowchart of a face-to-screen method provided by a first embodiment of the present invention.
  • FIG. 2 is a schematic flowchart of a method for providing a screen projection according to a second embodiment of the present invention.
  • FIG. 3 is a schematic structural diagram of a surface projection screen device provided by a third embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of a surface projection screen device provided by a fourth embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of a surface projection screen device provided by a fifth embodiment of the present invention.
  • a first embodiment of the present invention provides a desktop screen projection method, which can be executed by a desktop screen projection device.
  • the desktop screen projection device can be implemented by software and / or hardware.
  • the desktop screen projection device It can be composed of two or more physical entities, or it can be composed of one physical entity.
  • the desktop screen-casting device may be a computer, a mobile phone, a tablet computer, a mobile teaching terminal, or an intelligent interactive tablet.
  • a description is given by taking a mobile teaching terminal as a desktop projection screen device as an example, where the mobile teaching terminal is a teaching integrated device, and the content displayed on the mobile teaching terminal can be controlled by touch technology.
  • An integrated device for controlling and realizing human-computer interaction which integrates one or more functions such as camera, microphone, touchpad, presentation courseware, remote desktop control, file upload, mobile exhibition stand and so on.
  • the mobile teaching terminal may establish a data connection with at least one external device.
  • the external device includes, but is not limited to, a mobile phone, a notebook computer, a USB flash drive, an interactive smart tablet, a tablet computer, and a desktop computer.
  • the communication method of the data connection between the external device and the mobile teaching terminal is not limited in the embodiment, and may be a communication method such as a USB connection, the Internet, a local area network, Bluetooth, Wi-Fi, or the ZigBee protocol.
  • the mobile teaching terminal serves as a screen projection device in the process of desktop screen projection, and transmits screen projection content to an external device as a receiving terminal, so that all the The external device performs desktop synchronous display according to the transmitted projection screen content, and the external device as the receiving end is a device with a display screen, which includes, but is not limited to, a mobile phone, a notebook computer, an interactive smart tablet, a tablet computer, and a desktop computer.
  • the receiving end devices there may be one or more receiving end devices, which are set according to specific application scenarios, which are not limited in the embodiment.
  • the screen-casting device is a mobile teaching terminal
  • the receiving-end device is an interactive smart tablet.
  • a desktop screen-casting method provided by a first embodiment of the present invention includes:
  • a desktop screen setting is installed in the mobile teaching terminal and / or smart interactive tablet, and the desktop screen setting may be installed in the mobile teaching terminal and / or smart interactive tablet in advance, or
  • the desktop screen setting is downloaded and installed from a third-party device or server.
  • the third-party device is not limited in the embodiment.
  • the desktop screen setting of the mobile teaching terminal is used to obtain screen projection content and send the screen projection content directly or indirectly to a smart interactive tablet. If it is sent indirectly, the mobile teaching terminal can be sent to the smart interactive tablet through a transfer device, which can be a wireless screen transmission device or other devices with data transfer / processing functions.
  • the desktop projection screen setting of the intelligent interactive tablet is used to receive the screen projection content, which is convenient for the intelligent interactive tablet to display the received projection screen content.
  • a user needs to perform a desktop screen projection operation through the mobile teaching terminal, first issue a screen projection start instruction to enable the mobile teaching terminal to start a desktop screen projection setting according to the startup instruction, and a specific instruction form can be set according to actual conditions If, for example, the mobile teaching terminal detects that a trigger button (which may be a physical button or a virtual button) is clicked, double-clicked, or long-pressed, etc., the mobile teaching terminal determines to receive a screen-starting instruction, and The screen launching instruction described above launches the desktop screen setting.
  • a trigger button which may be a physical button or a virtual button
  • the mobile teaching terminal after the mobile teaching terminal starts the desktop screen setting, it calls a screen capture thread to obtain the current desktop, where the current desktop is the display interface of the mobile teaching terminal, and then uses the screen capture thread to Screen capture frequency Takes a screenshot of the current screen content displayed on the desktop.
  • the captured screen content is encoded by software or hardware to generate the first screen capture content in picture format. It should be noted that the first screen capture frequency
  • the specific value may be preset by the user, or may be a default screen capture frequency used by the screen capture thread, for example, setting the first screen capture frequency to 20 frames / second.
  • the mobile teaching terminal determines the properties of the screen-casting content according to the residuals between at least two adjacent frames of the first screen-shot content, and the properties of the screen-casting content are specifically the Dynamic properties or static properties of the screencasting content, which includes dynamic screencasting content such as videos, dynamic pictures (GIF images, etc.), and static screencasting content such as documents, presentations, static pictures, various graphic users
  • the interface displays content, etc.
  • the mobile teaching terminal performs intra prediction to obtain the predicted pixel value, and then obtains the actual pixel value according to the first screen capture content, and according to the actual pixel value and the predicted pixel value. Difference, obtain the residual, and then transform and quantize the residual, so as to determine the attributes of the screen-casting content according to the value of the residual.
  • the mobile teaching terminal when the mobile teaching terminal judges that the residual between at least two adjacent frames of the first screen shot content is greater than a preset threshold, it determines that the screen shot content is dynamic.
  • Screencasting content when the mobile teaching terminal determines that the residual between at least two adjacent frames of the first screencasting content is less than a preset threshold, determining that the screencasting content is static screencasting content, which needs to be explained Yes, the present invention does not place any limitation on the specific numerical setting of the preset threshold, and can be specifically set according to the actual situation.
  • the mobile teaching terminal dynamically adjusts the screen capture frequency according to the properties of the screencast content, thereby changing the display frame rate of the screencast content on the interactive smart tablet. Specifically, the mobile The teaching terminal adjusts the time interval between two consecutive screenshots according to the properties of the screencasting content. The mobile teaching terminal adjusts the time between two consecutive screenshots by setting the sleep time of the two consecutive screenshots by the screenshot thread.
  • Time interval thereby adjusting the current screen capture frequency to the second screen capture frequency; wherein, when the property of the screencast content is dynamic screen content, the mobile teaching terminal shortens the time interval between two screen captures next to the screen capture thread That is, reducing the sleep time of two screenshots next to the screenshot thread, thereby increasing the screenshot frequency, so that the adjusted second screenshot frequency is higher than the first screenshot frequency, and the adjusted second screenshot frequency is 20 frames / second. -30 frames / second; when the property of the screen-casting content is static screen-casting content, the mobile teaching terminal increases the time between two screen captures next to the screen capture thread. Interval, that is, increasing the sleep time of two screenshots next to the screenshot thread, thereby reducing the frequency of screenshots, so that the adjusted second screenshot frequency is lower than the first screenshot frequency, and the adjusted second screenshot frequency is 5 frames / 20 frames per second.
  • the mobile screen terminal uses the screen capture thread to adjust the screen capture frequency of the current desktop with the adjusted second screen capture frequency.
  • the content is screen shot, and the captured screen shot content is encoded by software or hardware to generate a second screen shot content in a picture format.
  • the second screen shot content is directly or indirectly sent to the display terminal, so that the display terminal receives the first screen shot content.
  • the content is decoded and displayed after the second screen capture.
  • the display terminal is an interactive smart tablet as an example. It should be noted that when the display terminal is an interactive smart tablet, the display terminal may be The large-sized interactive smart tablet used in a conference scene can also be a large-sized interactive smart tablet used in an education scene.
  • the second screen shot content is dynamic screen shot content, since the mobile teaching terminal takes a screen shot of the screen shot content at a second screen shot frequency higher than the first screen shot frequency, each frame is correspondingly increased. Data compression rate.
  • the code rate frame rate ⁇ the amount of data per frame.
  • the compression rate of each frame of data has increased, that is, the frame rate has increased, and the size of the data amount of each frame has been reduced accordingly.
  • Two screenshot frequencies which take screenshots of the screencast content, correspondingly reduce the compression rate of each frame of data.
  • bit rate frame rate ⁇ the amount of data per frame, and the compression of each frame of data The rate is reduced, that is, the frame rate is reduced, and the size of the data amount of each frame is correspondingly increased, so that the interactive smart tablet is more clear when displaying the static projection screen content, and the user experience is optimized.
  • the first embodiment of the present invention provides a method for screen projection on a desktop.
  • the setting of the screen projection on the desktop is started, and the properties of the screen projection content are determined first, and then the properties of the screen projection content are determined.
  • Adjusting the current screen capture frequency taking a screenshot of the screencast content with the adjusted screen capture frequency, and then sending the screencast content to the display terminal.
  • the present invention dynamically adjusts the screen capture frequency according to the properties of the screencast content, thereby achieving
  • the dynamic adjustment of the frame rate enables the screen-casting content displayed on the display terminal to present a display effect based on its own properties, improving the user experience, and also avoiding the use of a fixed screen capture frequency due to the unreasonable screen capture frequency setting.
  • the poor display of the screen content on the receiving end improves the good applicability of the screen technology.
  • a second embodiment of the present invention provides a desktop screen-casting method, including:
  • a desktop screen setting is installed in the mobile teaching terminal and / or smart interactive tablet, and the desktop screen setting may be installed in the mobile teaching terminal and / or smart interactive tablet in advance, or
  • the desktop screen setting is downloaded and installed from a third-party device or server.
  • the third-party device is not limited in the embodiment.
  • the desktop screen setting of the mobile teaching terminal is used to obtain screen projection content and send the screen projection content directly or indirectly to a smart interactive tablet. If it is sent indirectly, the mobile teaching terminal can be sent to the smart interactive tablet through a transfer device, which can be a wireless screen transmission device or other devices with data transfer / processing functions.
  • the desktop projection screen setting of the intelligent interactive tablet is used to receive the screen projection content, which is convenient for the intelligent interactive tablet to display the received projection screen content.
  • a user needs to perform a desktop screen projection operation through the mobile teaching terminal, first issue a screen projection start instruction to enable the mobile teaching terminal to start a desktop screen projection setting according to the startup instruction, and a specific instruction form can be set according to actual conditions If, for example, the mobile teaching terminal detects that a trigger button (which may be a physical button or a virtual button) is clicked, double-clicked, or long-pressed, etc., the mobile teaching terminal determines to receive a screen-starting instruction, and The screen launching instruction described above launches the desktop screen setting.
  • a trigger button which may be a physical button or a virtual button
  • the mobile teaching terminal after the mobile teaching terminal starts the desktop screen setting, it calls a screen capture thread to obtain the current desktop, where the current desktop is the display interface of the mobile teaching terminal, and then uses the screen capture thread to Screen capture frequency Takes a screenshot of the current screen content displayed on the desktop.
  • the captured screen content is encoded by software or hardware to generate the first screen capture content in picture format. It should be noted that the first screen capture frequency
  • the specific value may be preset by the user, or may be a default screen capture frequency used by the screen capture thread, for example, setting the first screen capture frequency to 20 frames / second.
  • the mobile teaching terminal calculates the residuals between at least two adjacent frames of the first screenshot content, and determines the residuals and predictions between the adjacent at least two frames of the first screenshot content.
  • the magnitude relationship between the set thresholds, when the residual between at least two adjacent frames of the first screen shot content is greater than a preset threshold the mobile teaching terminal determines that the screen shot content is dynamic screen shot content , Such as videos, dynamic pictures, etc., it should be noted that the application does not place any restrictions on the setting of the threshold, and can be specifically set according to the actual situation.
  • the mobile teaching terminal adjusts the time interval between two screen captures adjacent to the screen capture thread according to the dynamic screencasting content.
  • the mobile teaching terminal reduces the sleep time between two screen captures adjacent to the screen capture thread. Adjusting the time interval between two adjacent screenshots, thereby increasing the screenshot frequency, adjusting the current screenshot frequency to a second screenshot frequency, and using the screenshot thread to adjust the second screenshot frequency to the current screen of the screen
  • the content is screen shot.
  • the captured screen shot content is encoded by software or hardware to generate a second screen shot content in a picture format, where the second screen shot frequency is 20 frames / second to 30 frames / second.
  • the second screen shot content is directly or indirectly sent to the display terminal, so that the display terminal receives the first screen shot content.
  • the content is decoded and displayed after the second screen capture.
  • the display terminal is an interactive smart tablet as an example. It should be noted that when the display terminal is an interactive smart tablet, the display terminal may be The large-sized interactive smart tablet used in a conference scene may also be a large-sized interactive smart tablet used in an education scene. Since the mobile teaching terminal uses a second screen capture frequency higher than the first screen capture frequency, Performing a screen capture correspondingly increases the compression rate of each frame of data.
  • the code rate frame rate ⁇ the amount of data per frame.
  • the compression rate of each frame of data is increased, that is, the frame rate is increased.
  • the size of the data amount of each frame is more smooth when displaying the dynamic projection screen content, which optimizes the user's use of the body .
  • the mobile teaching terminal calculates the residuals between at least two adjacent frames of the first screenshot content, and determines the residuals and predictions between the adjacent at least two frames of the first screenshot content.
  • a static screen shot content Such as documents, presentations, pictures, display contents of various graphical user interfaces, etc., it should be noted that this application does not place any restrictions on the setting of the threshold, and can be specifically set according to the actual situation.
  • S27 Screen capture the static screen content according to a third screen capture frequency to generate a third screen capture content.
  • the third screen capture frequency is less than the second screen capture frequency.
  • the mobile teaching terminal adjusts the time interval between two screen captures adjacent to the screen capture thread according to the static screen content.
  • the mobile teaching terminal increases the sleep time between two screen captures adjacent to the screen capture thread. Adjusting the time interval between two adjacent screenshots, thereby reducing the screenshot frequency, adjusting the current screenshot frequency to a third screenshot frequency, and using the screenshot thread to adjust the third screenshot frequency to the current screen of the current screen.
  • the content is screen shot.
  • the captured screen shot content is encoded by software or hardware to generate a third screen shot content in a picture format, where the third screen shot frequency is 5 frames / second to 20 frames / second.
  • the mobile teaching terminal after generating the third screenshot content, sends the third screenshot content to the display terminal by a direct or indirect method, so that all the The display terminal decodes and displays the content after receiving the third screen capture.
  • the display terminal is used as an example of an interactive smart tablet for illustration. Since the mobile teaching terminal uses a frequency lower than the first screen capture, The third screen capture frequency, the screen captures the content of the screencast, correspondingly reducing the compression rate of each frame of data.
  • the code rate frame rate ⁇ the amount of data per frame, the data per frame
  • the compression rate is reduced, that is, the frame rate is reduced, and the size of the data amount of each frame is correspondingly increased, so that the interactive smart tablet is more clear when displaying the static projection screen content, and the user experience is optimized.
  • the second embodiment of the present invention provides a method for screen projection on a desktop.
  • the screen setting for the screen is started, and the attributes of the screen content are first determined.
  • the content is dynamically cast, adjust the current screen capture frequency to the second screen capture frequency, and take a screenshot of the screen capture content with the adjusted second screen capture frequency.
  • the invention dynamically adjusts the screen capture frequency according to the properties of the screen-casting content, thereby realizing the dynamic adjustment of the frame rate, so that the screen-casting content displayed on the display terminal can present a display effect based on its own attributes, and improve the user experience, and at the same time It also avoids the unreasonable setting of the screen capture frequency, which leads to the poor display of the screen content captured by the fixed screen capture frequency on the receiving end. And improve the good applicability of projection screen technology.
  • the desktop screen-casting method further includes:
  • the interactive smart tablet when the interactive smart tablet as the receiving end detects that the user performs an annotation operation on the screen content displayed on the display interface of the interactive smart tablet, the interactive intelligent tablet generates an annotation according to the annotation operation. Information, and send the annotation information to the mobile teaching terminal directly or indirectly through the desktop screen setting.
  • the annotation information is generated by input device operation, and the interactive smart tablet is After receiving the screen-casting content sent by the mobile teaching terminal and displaying it, when the interactive smart tablet detects that the input device is clicked, double-clicked, long-pressed, swiped, etc., the interactive smart tablet determines to receive To the annotation operation for the screen-casting content.
  • the annotation operation may be operations such as playing, pausing, fast-forwarding, slow-playing, and dragging the video;
  • the screen-casting content is static projection Screen content, such as a document
  • the annotation operations may be operations such as modifying, deleting, adding, dragging, and opening the document.
  • the mobile teaching terminal adjusts the time interval between two adjacent screenshots by shortening the setting of the sleep time between the two screenshots of the screenshot thread, thereby adjusting the current screenshot frequency to a fourth screenshot frequency, the fourth screenshot
  • the frequency is greater than the first screen capture frequency, and then the fourth screen capture frequency is used to screen the annotated screen shot content, and the captured screen shot content is encoded by software or hardware to generate a fourth screen shot content in a picture format.
  • the mobile teaching terminal sends the fourth screen capture content to the interactive smart tablet through a direct or indirect method, so that the interactive smart tablet decodes and displays the fourth screen capture content after receiving the fourth screen capture content.
  • the terminal captures the screencast content at a fourth screen capture frequency that is higher than the first screen capture frequency.
  • the code rate frame rate ⁇ the amount of data per frame
  • the compression rate of each frame of data has increased, that is, the frame rate has increased, and accordingly Reducing the size of the data amount per frame makes the interactive smart tablet smoother when displaying the fourth screen shot content, giving the user a smooth operation feeling, improving the fluency of operation, and optimizing the user experience.
  • a third embodiment of the present invention provides a desktop screen projection device, including:
  • Projection screen startup module 11 is used to start desktop screen projection settings.
  • a first screenshot content generating module 12 is configured to take a screenshot of the screencast content displayed on the current desktop according to the first screenshot frequency to generate the first screenshot content.
  • the screencast content attribute determining module 13 is configured to determine the attributes of the screencast content according to the first screencast content.
  • the screen capture frequency adjusting module 14 is configured to adjust the current screen capture frequency to a second screen capture frequency according to the properties of the screen-casting content.
  • a second screenshot content generation module 15 is configured to take a screenshot of the screencast content according to the second screenshot frequency to generate a second screenshot content.
  • the second screenshot content transmission module 16 is configured to send the second screenshot content to a display terminal for display.
  • the screen-screen content attribute determination module 13 specifically includes:
  • the content attribute determination submodule is configured to determine an attribute of the screen-casting content according to a residual between at least two adjacent frames of the first screen-captured content.
  • the content attribute determination submodule specifically includes:
  • a dynamic content determining unit is configured to determine that the screen-casting content is dynamic screen-casting content when a residual between at least two adjacent frames of the first screen-screening content is greater than a preset threshold.
  • the static content determining unit is configured to determine that the screen-casting content is static screen-casting content when a residual between at least two adjacent frames of the first screenshot content is less than a preset threshold.
  • the screen capture frequency adjustment module 14 specifically includes:
  • the time interval between two adjacent screenshots is adjusted.
  • a fourth embodiment of the present invention provides a desktop screen-casting device, including:
  • the screen launching module 21 is used to start the desktop screen setting.
  • the first screenshot content generating module 22 is configured to take a screenshot of the screencast content displayed on the current desktop according to the first screenshot frequency to generate the first screenshot content.
  • the dynamic content determining module 23 is configured to determine that the screen-casting content is dynamic screen-casting content when a residual between at least two adjacent frames of the first screen-screening content is greater than a preset threshold.
  • a second screen shot content generating module 24 is configured to screen the dynamic screen shot content according to a second screen shot frequency to generate a second screen shot content.
  • the second screenshot content transmission module 25 is configured to send the second screenshot content to a display terminal for display.
  • the static content determining module 26 is configured to determine that the screen-casting content is static screen-casting content when a residual between at least two adjacent frames of the first screenshot content is less than a preset threshold.
  • a third screenshot content generating module 27 is configured to take a screenshot of the static screen content according to a third screenshot frequency to generate a third screenshot content, wherein the third screenshot frequency is less than the second screenshot frequency.
  • the third screenshot content transmission module 28 is configured to send the third screenshot content to a display terminal for display.
  • the method further includes:
  • the annotation information receiving module is configured to receive annotation information for the screen-casting content; wherein the annotation information is generated by an input device operation.
  • a fourth screenshot information generating module is configured to take a screenshot of the annotated projection content at a fourth screenshot frequency to generate a fourth screenshot content.
  • a fourth screenshot information transmission module configured to send the fourth screenshot content to a display terminal for display.
  • the second screen capture frequency is 20 frames / second to 30 frames / second.
  • the third screen capture frequency is 5 frames / second to 20 frames / second.
  • the device embodiments described above are only schematic, and the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical Units can be located in one place or distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the objective of the solution of this embodiment.
  • the connection relationship between the modules indicates that there is a communication connection between them, which can be specifically implemented as one or more communication buses or signal lines.
  • a fifth embodiment of the present invention provides a desktop screen projection device.
  • the desktop synchronization-based display adjustment terminal device of this embodiment includes a processor 51, a memory 52, a display screen 53 with a touch function, and an input.
  • the processor 41 executes the computer program, the steps of the desktop projection screen embodiment in the first embodiment are implemented.
  • the processor 51 executes the computer program, the functions of each module / unit in the device embodiment of the third embodiment are realized.
  • the number of processors 51 in the desktop projection screen device may be one or more, and one processor 51 is taken as an example in FIG. 5.
  • the number of memories 52 in the desktop projection screen device may be one or more, and one memory 52 is taken as an example in FIG. 5.
  • the processor 51, the memory 52, the display screen 53, the input device 54, the output device 55, and the communication device 56 of the display adjustment terminal device based on the desktop synchronization may be connected through a bus or other methods. In FIG. 5, the connection through the bus is taken as an example.
  • the desktop screen projection device may be a computer, a mobile phone, a tablet, a mobile teaching terminal or an interactive smart tablet. In the embodiment, a description is given by taking a desktop projection device as a mobile teaching terminal as an example.
  • the computer program may be divided into one or more modules / units, and the one or more modules / units are stored in the memory 52 and executed by the processor 51 to complete the present program.
  • the one or more modules / units may be a series of computer program instruction segments capable of performing specific functions, and the instruction segments are used to describe an execution process of the computer program in the desktop projection screen device.
  • the desktop projection screen device may include, but is not limited to, a processor 51 and a memory 52.
  • a processor 51 and a memory 52 may include, but is not limited to, a processor 51 and a memory 52.
  • the schematic diagram is only an example of a desktop projection screen device, and does not constitute a limitation on the desktop projection screen device, and may include more or fewer components than shown in the figure, or combine some components, or Different components, for example, the desktop projection screen device may further include an input-output device, a network access device, a bus, and the like.
  • the so-called processor 51 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), Ready-made programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
  • the general-purpose processor may be a microprocessor, or the processor may be any conventional processor.
  • the processor 51 is a control center of the desktop projection device, and uses various interfaces and lines to connect the entire desktop projection device. The various parts.
  • the memory 52 may be used to store the computer program and / or module, and the processor 51 runs or executes the computer program and / or module stored in the memory 52 and calls data stored in the memory 52, Realize various functions of the desktop projection screen device.
  • the memory 52 may mainly include a storage program area and a storage data area, where the storage program area may store an operating system, application programs required for at least one function, and the like; the storage data area may store data created according to the use of the mobile phone, and the like.
  • the memory 52 may include a high-speed random access memory, and may also include a non-volatile memory, such as a hard disk, an internal memory, a plug-in hard disk, a Smart Media Card (SMC), and a Secure Digital (SD). Card, flash memory card (Flash card), at least one disk storage device, flash memory device, or other volatile solid-state storage device.
  • the display screen 53 is a display screen with a touch function, which may be a capacitive screen, an electromagnetic screen, or an infrared screen.
  • the display screen 53 is used to display data according to an instruction of the processor 51, and is also used to receive a touch operation acting on the display screen 53 and send corresponding signals to the processor 51 or other devices.
  • the display screen 53 is an infrared screen, it further includes an infrared touch frame.
  • the infrared touch frame is arranged around the display screen 53 and can also be used to receive an infrared signal and send the infrared signal to the processor. 51 or other equipment.
  • the communication device 56 is configured to establish a communication connection with other equipment, and may be a wired communication device 56 and / or a wireless communication device 56.
  • the input device 54 may be used to receive inputted numeric or character information, and generate key signal inputs related to user settings and function control of a desktop projection device, and may also be a camera for acquiring images and audio pickup for audio data. device.
  • the output device 55 may include an audio device such as a speaker. It should be noted that the specific composition of the input device 54 and the output device 55 can be set according to actual conditions.
  • the sixth embodiment of the present invention provides a computer-readable storage medium.
  • the module / unit integrated by the desktop projection device in the fifth embodiment is implemented in the form of a software functional unit and sold or used as an independent product, , Can be stored in a computer-readable storage medium.
  • the present invention implements all or part of the processes in the methods of the above embodiments, and may also be completed by a computer program instructing related hardware.
  • the computer program may be stored in a computer-readable storage medium.
  • the computer When the program is executed by a processor, the steps of the foregoing method embodiments can be implemented.
  • the computer program includes computer program code, and the computer program code may be in a source code form, an object code form, an executable file, or some intermediate form.
  • the computer-readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a mobile hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM, Read-Only Memory) , Random Access Memory (RAM, Random Access Memory), electric carrier signals, telecommunication signals, and software distribution media.
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • electric carrier signals telecommunication signals
  • software distribution media any entity or device capable of carrying the computer program code
  • a recording medium a U disk, a mobile hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM, Read-Only Memory) , Random Access Memory (RAM, Random Access Memory), electric carrier signals, telecommunication signals, and software distribution media.
  • the seventh embodiment of the present invention provides a desktop screen projection device.
  • the desktop synchronization-based display adjustment terminal device of this embodiment includes a processor, a memory, a display screen with a touch function, an input device, an output device, a communication device, and A computer program stored in the memory and executable on the processor, such as a desktop projection screen program.
  • the processor executes the computer program, the steps of the desktop projection screen embodiment in the second embodiment are implemented.
  • the processor executes the computer program, the functions of each module / unit in the device embodiment of the fourth embodiment are realized.
  • the number of processors in the desktop projection screen device may be one or more.
  • the number of memories in the desktop projection screen device may be one or more.
  • the processor, the memory, the display screen, the input device, the output device, and the communication device of the display adjustment terminal device based on the desktop synchronization may be connected through a bus or other methods.
  • the desktop screen projection device may be a computer, a mobile phone, a tablet, a mobile teaching terminal or an interactive smart tablet.
  • a description is given by taking a desktop projection device as a mobile teaching terminal as an example.
  • the computer program may be divided into one or more modules / units, and the one or more modules / units are stored in the memory and executed by the processor to complete the present invention.
  • the one or more modules / units may be a series of computer program instruction segments capable of performing specific functions, and the instruction segments are used to describe an execution process of the computer program in the desktop projection screen device.
  • the processor can be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), off-the-shelf Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
  • the general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.
  • the processor is the control center of the desktop projection device, and uses various interfaces and lines to connect the entire desktop projection device. Various parts.
  • the memory may be used to store the computer program and / or module, and the processor implements the desktop by running or executing the computer program and / or module stored in the memory, and calling data stored in the memory.
  • the memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, application programs required for at least one function, and the like; the storage data area may store data created according to the use of the mobile phone, and the like.
  • the memory may include a high-speed random access memory, and may also include a non-volatile memory, such as a hard disk, an internal memory, a plug-in hard disk, a Smart Media Card (SMC), and a Secure Digital (SD) card. , Flash card (Flash card), at least one disk storage device, flash memory device, or other volatile solid-state storage device.
  • the display screen is a display screen with a touch function, which may be a capacitive screen, an electromagnetic screen, or an infrared screen.
  • the display screen is used to display data according to the instructions of the processor, and is also used to receive touch operations on the display screen and send corresponding signals to the processor or other devices.
  • the display screen is an infrared screen, it also includes an infrared touch frame.
  • the infrared touch frame is arranged around the display screen. It can also be used to receive infrared signals and send the infrared signals to the processor or other device.
  • the communication device is configured to establish a communication connection with another device, and may be a wired communication device and / or a wireless communication device.
  • the input device may be used to receive inputted numeric or character information, and generate key signal inputs related to user settings and function control of a desktop projection device, a camera for acquiring images, and a sound pickup device for acquiring audio data.
  • the output device may include audio equipment such as a speaker. It should be noted that the specific composition of the input device and the output device can be set according to the actual situation.
  • the eighth embodiment of the present invention provides a computer-readable storage medium. If the module / unit integrated by the desktop projection device in the seventh embodiment is implemented in the form of a software functional unit and sold or used as an independent product, , Can be stored in a computer-readable storage medium. Based on such an understanding, the present invention implements all or part of the processes in the methods of the above embodiments, and may also be completed by a computer program instructing related hardware.
  • the computer program may be stored in a computer-readable storage medium.
  • the computer When the program is executed by a processor, the steps of the foregoing method embodiments can be implemented.
  • the computer program includes computer program code, and the computer program code may be in a source code form, an object code form, an executable file, or some intermediate form.
  • the computer-readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a mobile hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM, Read-Only Memory) , Random Access Memory (RAM, Random Access Memory), electric carrier signals, telecommunication signals, and software distribution media.
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • electric carrier signals telecommunication signals
  • software distribution media any entity or device capable of carrying the computer program code
  • a recording medium a U disk, a mobile hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM, Read-Only Memory) , Random Access Memory (RAM, Random Access Memory), electric carrier signals, telecommunication signals, and software distribution media.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本发明公开一种桌面投屏方法、装置、设备及计算机可读存储介质，其方法包括：启动桌面投屏设置；根据第一截屏频率，对当前桌面显示的投屏内容进行截屏，生成第一截屏内容；根据所述第一截屏内容，确定所述投屏内容的属性；根据所述投屏内容的属性，将当前的截屏频率调整为第二截屏频率；根据所述第二截屏频率，对所述投屏内容进行截屏，生成第二截屏内容；将所述第二截屏内容发送至显示终端用于显示。本发明实现动态调整截屏频率，满足不同属性的投屏内容的需求，优化用户使用体验。

Description

一种桌面投屏方法、装置、设备及存储介质 技术领域
本发明涉及计算机智能交互领域，尤其涉及一种桌面投屏方法、装置、设备及计算机可读存储介质。
背景技术
在交互智能平板领域，投屏技术作为交互智能平板越来越重要的应用之一，已经广泛的应用于在人们的工作和学习之中，极大的提高了人们的工作及学习效率。例如，在会议场景下，用户可以将其操作的笔记本电脑上显示的内容投屏到交互智能平板上，使其他与会人员通过交互智能平板观看该内容，通过这种分享，可以使得与会人员高效的与会及决策。在桌面投屏的过程中，作为发送端的投屏设备截取投屏内容，并将截取的投屏内容封装为可传输数据，通过无线网络发送给接收端设备，以使接收端设备在接收到传输的数据后，将其解析为接收端的投屏内容，并根据解析的投屏内容进行桌面同步显示或者操作的过程。
在实现本发明的过程中，发明人发现：在原有的桌面投屏方案，发送端在将截取的投屏内容封装为可传输数据，并将可传输数据发送给接收端设备进行解析及显示的过程中，发送端基于自身默认的设定截取投屏内容以进行封装传输，会出现以下问题：第一、没有考虑到当前传输的网络状况，过大的数据传输内容会因不佳的网络状况传输延迟，导致接收端设备接收延迟，从而导致画面卡顿现象；第二、没有考虑接收端设备的软硬件设备的功能限制，发送端传输的投屏内容可能会因为接收端设备软硬件设施的功能限制导致显示画面不清晰的情况，严重影响用户的使用体验。
发明内容
针对上述问题，本发明的目的在于提供一种桌面投屏方法、装置、设备及计算机可读存储介质，动态调整截屏频率，满足不同属性的投屏内容的需求。
第一方面，本发明实施例提供了一种桌面投屏方法，包括：
启动桌面投屏设置；
根据第一截屏频率，对当前桌面显示的投屏内容进行截屏，生成第一截屏内容；
根据所述第一截屏内容，确定所述投屏内容的属性；
根据所述投屏内容的属性，将当前的截屏频率调整为第二截屏频率；
根据所述第二截屏频率，对所述投屏内容进行截屏，生成第二截屏内容；
将所述第二截屏内容发送至显示终端用于显示。
在第一方面的第一种实现方式中，所述根据所述第一截屏内容，确定所述投屏内容的属性，具体为：
根据所述第一截屏内容的相邻至少两帧间的残差，确定所述投屏内容的属性。
根据第一方面的第一种实现方式，在第一方面的第二种实现方式中，所述根据所述第一截屏内容的相邻至少两帧间的残差，确定所述投屏内容的属性，具体为：
当所述第一截屏内容的相邻至少两帧间的残差大于预设的阀值时，确定所述投屏内容为动态投屏内容；
当所述第一截屏内容的相邻至少两帧间的残差小于预设的阀值时，确定所述投屏内容为静态投屏内容。
在第一方面的第三种实现方式中，所述根据所述投屏内容的属性，将当前的截屏频率调整为第二截屏频率，具体为：
根据所述投屏内容的属性，调整相邻两次截屏的时间间隔。
第二方面，本发明实施例提供了一种桌面投屏方法，包括：
启动桌面投屏设置；
根据第一截屏频率，对当前桌面显示的投屏内容进行截屏，生成第一截屏内容；
当所述第一截屏内容的相邻至少两帧间的残差大于预设的阀值时，确定所述投屏内容为动态投屏内容；
对所述动态投屏内容按照第二截屏频率进行截屏，生成第二截屏内容；
将所述第二截屏内容发送至显示终端用于显示；
当所述第一截屏内容的相邻至少两帧间的残差小于预设的阀值时，确定所述投屏内容为静态投屏内容；
对所述静态投屏内容按照第三截屏频率进行截屏，生成第三截屏内容；其中，所述第三截屏频率小于第二截屏频率；
将所述第三截屏内容发送至显示终端用于显示。
在第二方面的第一种实现方式中，还包括：
接收对于所述投屏内容的批注信息；其中，所述批注信息为通过输入设备操作而生成的；
以第四截屏频率，对经批注的投屏内容进行截屏，生成第四截屏内容；
将所述第四截屏内容发送至显示终端用于显示。
在第二方面的第三种实现方式中，所述第二截屏频率为20帧/秒-30帧/秒。
在第二方面的第四种实现方式中，所述第三截屏频率为5帧/秒-20帧/秒。
第三方面，本发明实施例提供了一种桌面投屏装置，包括：
投屏启动模块，用于启动桌面投屏设置；
第一截屏内容生成模块，用于根据第一截屏频率，对当前桌面显示的投屏内容进行截屏，生成第一截屏内容；
投屏内容属性确定模块，用于根据所述第一截屏内容，确定所述投屏内容的属性；
截屏频率调整模块，用于根据所述投屏内容的属性，将当前的截屏频率调整为第二截屏频率；
第二截屏内容生成模块，用于根据所述第二截屏频率，对所述投屏内容进行截屏，生成第二截屏内容；
第二截屏内容传输模块，用于将所述第二截屏内容发送至显示终端用于显示。
在第三方面的第一种实现方式中，所述投屏内容属性确定模块具体包括：
内容属性确定子模块，用于根据所述第一截屏内容的相邻至少两帧间的残差，确定所述投屏内容的属性。
根据第三方面的第一种实现方式，在第三方面的第二种实现方式中，所述内容属性确定子模块，具体包括：
动态内容确定单元，用于当所述第一截屏内容的相邻至少两帧间的残差大于预设的阀值时，确定所述投屏内容为动态投屏内容；
静态内容确定单元，用于当所述第一截屏内容的相邻至少两帧间的残差小于预设的阀值时，确定所述投屏内容为静态投屏内容。
在第三方面的第四种实现方式中，所述截屏频率调整模块，具体包括：
根据所述投屏内容的属性，调整相邻两次截屏的时间间隔。
第四方面，本发明实施例提供了一种桌面投屏装置，包括：
投屏启动模块，用于启动桌面投屏设置；
第一截屏内容生成模块，用于根据第一截屏频率，对当前桌面显示的投屏内容进行截屏，生成第一截屏内容；
动态内容确定模块，用于当所述第一截屏内容的相邻至少两帧间的残差大于预设的阀值时，确定所述投屏内容为动态投屏内容；
第二截屏内容生成模块，用于对所述动态投屏内容按照第二截屏频率进行截屏，生成第二截屏内容；
第二截屏内容传输模块，用于将所述第二截屏内容发送至显示终端用于显示；
静态内容确定模块，用于当所述第一截屏内容的相邻至少两帧间的残差小于预设的阀值时，确定所述投屏内容为静态投屏内容；
第三截屏内容生成模块，用于对所述静态投屏内容按照第三截屏频率进行截屏，生成第三截屏内容；其中，所述第三截屏频率小于第二截屏频率；
第三截屏内容传输模块，用于将所述第三截屏内容发送至显示终端用于显示。
在第四方面的第一种实现方式中，还包括：
批注信息接收模块，用于接收对于所述投屏内容的批注信息；其中，所述批注信息为通过输入设备操作而生成的；
第四截屏信息生成模块，用于以第四截屏频率，对经批注的投屏内容进行截屏，生成第四截屏内容；
第四截屏信息传输模块，用于将所述第四截屏内容发送至显示终端用于显示。
在第四方面的第二种实现方式中，所述第二截屏频率为20帧/秒-30帧/秒。
在第四方面的第三种实现方式中，所述第三截屏频率为5帧/秒-20帧/秒。
第五方面，本发明实施例提供了一种桌面投屏设备，包括处理器、存储器以及存储在所述存储器中且被配置为由所述处理器执行的计算机程序，所述处理器执行所述计算机程序时实现第一方面中任意一项所述的桌面投屏方法。
第六方面，本发明实施例提供了一种桌面投屏设备，包括处理器、存储器以及存储在所述存储器中且被配置为由所述处理器执行的计算机程序，所述处理器执行所述计算机程序时实现第二方面中任意一项所述的桌面投屏方法。
第七方面，本发明实施例提供了一种计算机可读存储介质，所述计算机可读存储介质包括存储的计算机程序，其中，在所述计算机程序运行时控制所述计算机可读存储介质所在设备执行如第一方面中任意一项所述的桌面投屏方法。
第八方面，本发明实施例提供了一种计算机可读存储介质，所述计算机可读存储介质包括存储的计算机程序，其中，在所述计算机程序运行时控制所述计算机可读存储介质所在设备执行如第二方面中任意一项所述的桌面投屏方法。
以上一个实施例具有如下有益效果：
在桌面投屏过程中，启动桌面投屏设置，首先确定投屏内容的属性，然后根据所述投屏内容的属性，调整当前的截屏频率，以调整后的截屏频率对所述投屏内容进行截屏，再将截屏后的内容发送至显示终端，本发明根据投屏内容的属性对截屏频率进行动态调整，从而实现帧率的动态调整，使得在显示终端上显示的投屏内容能够呈现出基于自身属性的显示效果，提高用户的使用体验，同时也避免因截屏频率设置的不合理，导致使用固定的截屏频率截取的投屏内容在接收端显示不佳的情况，从而提高投屏技术的良好的适用性。
附图说明
为了更清楚地说明本发明的技术方案，下面将对实施方式中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施方式，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是本发明第一实施例提供面投屏方法的流程示意图。
图2是本发明第二实施例提供面投屏方法的流程示意图。
图3是本发明第三实施例提供面投屏装置的结构示意图。
图4是本发明第四实施例提供面投屏装置的结构示意图。
图5是本发明第五实施例提供面投屏设备的结构示意图。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
请参阅图1，本发明第一实施例提供了一种桌面投屏方法，其可由桌面投屏设备来执行，该桌面投屏设备可以通过软件和/或硬件的方式实现，该桌面投屏设备可以是两个或多个物理实体构成，也可以是一个物理实体构成。该桌面投屏设备可以是电脑，手机，平板电脑、移动授课终端或智能交互平板等。在本发明实施例中，以移动授课终端为桌面投屏设备为例进行描述，其中，所述移动授课终端作为一种教学集成设备，可以是通过触控技术对显示在移动授课终端上的内容进行操控和实现人机交互操作的一体化设备，其集成了摄影机、麦克风、触摸板、演示课件、远程桌面控制、文件上传、移动展台等一种或多种功能。
在本发明实施例中，所述移动授课终端可与至少一个外部装置建立数据连接。其中，所述外部装置包括但不限于：手机、笔记本电脑、USB闪存盘、交互智能平板、平板电脑及台式电脑等。所述外部装置与所述移动授课终端的数据连接的通信方式实施例中不作限定，可以通过USB连接、互联网、局域网、蓝牙、Wi-Fi或紫峰协议(ZigBee)等通信方式。
进一步的，所述移动授课终端与至少一个外部装置进行桌面同步的过程中，所述移动授课终端作为桌面投屏过程中的投屏设备，向作为接收端的外部装置传输投屏内容，以使所述外部装置根据传输的投屏内容进行桌面同步显示，所述作为接收端的外部设备为具有显示屏幕的设备，其包括但不限于：手机、笔记本电脑、交互智能平板、平板电脑及台式电脑等，一般而言，接收端设备可以有一个或者多个，视具体的应用场景来设置，实施例不做限定。
实施例中以投屏设备为移动授课终端，接收端设备为交互智能平板为例。来对本发明进行示例性描述。
具体地，请参阅图1，本发明第一实施例提供的桌面投屏方法，包括：
S11，启动桌面投屏设置。
在本发明实施例中，所述移动授课终端和/或智能交互平板中安装有桌面投屏设置，该桌面投屏设置可以预先安装在所述移动授课终端和/或智能交互平板中，也可以是在所述移动授课终端和/或智能交互平板中要启动桌面投屏设置时，从第三方设备或服务器进行下载并安装使用。其中，第三方设备在实施例中不作限定。所述移动授课终端的桌面投屏设置用于获取投屏内容，并将投屏内容直接或间接发送至智能交互平板。如果是间接发送的话，所述移动授课终端可以通过中转设备发送至所述智能交互平板，该中转设备可以是无线传屏装置，也可以是具有数据中转/处理功能的其它设备。智能交互平板的桌面投屏设置用于接收投屏内容，便于智能交互平板对接收的投屏内容进行显示。在用户需要通过所述移动授课终端进行桌面投屏操作时，首先下达投屏启动指令以使所述移动授课终端根据所述启动指令启动桌面投屏设置，其具体的指令形式可以根据实际情况设定，例如所述移动授课终端检测到触发按键(可以是实体按键或者是虚拟按键)被点击、被双击或者长按等等，则所述移动授课终端确定接收到投屏启动指令，并根据所述投屏启动指令启动桌面投屏设置。
S12，根据第一截屏频率，对当前桌面显示的投屏内容进行截屏，生成第一截屏内容。
在本发明实施例中，所述移动授课终端在启动桌面投屏设置之后，调用截屏线程获取当前桌面，所述当前桌面为所述移动授课终端的显示界面，然后通过所述截屏线程以第一截屏频率对当前桌面上显示的投屏内容进行截屏，对截取的投屏内容通过软件方式或者硬件方式进行编码，以生成图片格式的第一截屏内容，需要说明的是，所述第一截屏频率的具体数值可以是用户预先设置的，也可以是所述截屏线程采用的默认的截屏频率，例如设置所述第一截屏频率为20帧/秒等。
S13，根据所述第一截屏内容，确定所述投屏内容的属性。
在本发明实施例中，所述移动授课终端根据所述第一截屏内容的相邻至少两帧间的残差，确定所述投屏内容的属性，所述投屏内容的属性具体为所述投屏内容的动态属性或者静态属性，所述投屏内容包括动态投屏内容如视频、动态图片(GIF图片等)等，及静态投屏内容如文档、演示文稿、静态图片、各种图形用户界面显示内容等，具体地，所述移动授课终端进行帧内预测，以获取预测像素值，然后根据所述第一截屏内容获取实际像素值，根据所述实际像素值与所述预测像素值之差，获取残差，再对所述残差进行变换与量化，从而根据所述残差的值确定所述投屏内容的属性。
在本发明实施例中，更进一步地，当所述移动授课终端判断所述第一截屏内容的相邻至少两帧间的残差大于预设的阀值时，确定所述投屏内容为动态投屏内容，当所述移动授课终端判断所述第一截屏内容的相邻至少两帧间的残差小于预设的阀值时，确定所述投屏内容为静态投屏内容，需要说明的是，本发明对于所述预设的阈值的具体数值设定不做任何限制，可依据实际情况进行具体设置。
S14，根据所述投屏内容的属性，将当前的截屏频率调整为第二截屏频率。
在本发明实施例中，所述移动授课终端根据所述投屏内容的属性动态调整截屏频率，从而改变所述投屏内容在所述交互智能平板上的显示帧率，具体地，所述移动授课终端根据所述投屏内容的属性，调整截屏线程相邻两次截屏的时间间隔，所述移动授课终端通过对截屏线程相邻两次截屏的睡眠时间的设置来调整相邻两次截屏的时间间隔，从而将当前的截屏频率调整为第二截屏频率；其中，当所述投屏内容的属性为动态投屏内容时，则所述移动授课终端缩短截屏线程相邻两次截屏的时间间隔，即减少截屏线程相邻两次截屏的睡眠时间，从而提高截屏频率，使得调整后的第二截屏频率高于所述第一截屏频率，所述调整后的第二截屏频率为20帧/秒-30帧/秒；当所述投屏内容的属性为静态投屏内容时，则所述移动授课终端增加截屏线程相邻两次截屏的时间间隔，即增加截屏线程相邻两次截屏的睡眠时间，从而降低截屏频率，使得调整后的第二截屏频率低于所述第一截屏频率，所述调整后的第二截屏频率为5帧/秒-20帧/秒。
S15，根据所述第二截屏频率，对所述投屏内容进行截屏，生成第二截屏内容。
在本发明实施例中，所述移动授课终端在根据所述投屏内容的属性调整截屏线程的截屏频率之后，通过所述截屏线程以调整后的第二截屏频率对当前桌面的所述投屏内容进行截屏，对截取的投屏内容通过软件方式或者硬件方式进行编码，以生成图片格式的第二截屏内容。
S16，将所述第二截屏内容发送至显示终端用于显示。
在本发明实施例中，所述移动授课终端在生成所述第二截屏内容之后，通过直接或者间接的方法将所述第二截屏内容发送给显示终端，以使得所述显示终端接收所述第二截屏内容后进行解码并显示，在本实施例中以所述显示终端为交互智能平板为例进行说明，需要说明的是，当所述显示终端为交互智能平板时，所述显示终端可以是会议场景使用的大尺寸交互智能平板，也可以是教育场景使用的大尺寸交互智能平板。当所述第二截屏内容为动态投屏内容时，由于所述移动授课终端以高于所述第一截屏频率的第二截屏频率，对所述投屏内容进行截屏，相应地提高了每帧数据的压缩率，在码率固定的情况下，码率＝帧率×每帧的数据量大小，每帧数据的压缩率提高了，即帧率提高了，相应地降低每帧数据量的大小，使得所述交互智能平板在显示所述动态投屏内容时更加流畅；当所述第二截屏内容为静态投屏内容时，由于所述移动授课终端以低于所述第一截屏频率的第二截屏频率，对所述投屏内容进行截屏，相应地降低了每帧数据的压缩率，在码率固定的情况下，码率＝帧率×每帧的数据量大小，每帧数据的压缩率降低了，即帧率降低了，相应地提高每帧数据量的大小，使得所述交互智能平板在显示所述静态投屏内容时更加清晰，优化用户的使用体验。
综上所述，本发明第一实施例提供了一种桌面投屏方法，在桌面投屏过程中，启动桌面投屏设置，首先确定投屏内容的属性，然后根据所述投屏内容的属性，调整当前的截屏频率，以调整后的截屏频率对所述投屏内容进行截屏，再将截屏后的内容发送至显示终端，本发明根据投屏内容的属性对截屏频率进行动态调整，从而实现帧率的动态调整，使得在显示终端上显示的投屏内容能够呈现出基于自身属性的显示效果，提高用户的使用体验，同时也避免因截屏频率设置的不合理，导致使用固定的截屏频率截取的投屏内容在接收端显示不佳的情况，从而提高投屏技术的良好的适用性。
请参阅图2，本发明第二实施例提供了一种桌面投屏方法，包括：
S21，启动桌面投屏设置。
在本发明实施例中，所述移动授课终端和/或智能交互平板中安装有桌面投屏设置，该桌面投屏设置可以预先安装在所述移动授课终端和/或智能交互平板中，也可以是在所述移动授课终端和/或智能交互平板中要启动桌面投屏设置时，从第三方设备或服务器进行下载并安装使用。其中，第三方设备在实施例中不作限定。所述移动授课终端的桌面投屏设置用于获取投屏内容，并将投屏内容直接或间接发送至智能交互平板。如果是间接发送的话，所述移动授课终端可以通过中转设备发送至所述智能交互平板，该中转设备可以是无线传屏装置，也可以是具有数据中转/处理功能的其它设备。智能交互平板的桌面投屏设置用于接收投屏内容，便于智能交互平板对接收的投屏内容进行显示。在用户需要通过所述移动授课终端进行桌面投屏操作时，首先下达投屏启动指令以使所述移动授课终端根据所述启动指令启动桌面投屏设置，其具体的指令形式可以根据实际情况设定，例如所述移动授课终端检测到触发按键(可以是实体按键或者是虚拟按键)被点击、被双击或者长按等等，则所述移动授课终端确定接收到投屏启动指令，并根据所述投屏启动指令启动桌面投屏设置。
S22，根据第一截屏频率，对当前桌面显示的投屏内容进行截屏，生成第一截屏内容。
在本发明实施例中，所述移动授课终端在启动桌面投屏设置之后，调用截屏线程获取当前桌面，所述当前桌面为所述移动授课终端的显示界面，然后通过所述截屏线程以第一截屏频率对当前桌面上显示的投屏内容进行截屏，对截取的投屏内容通过软件方式或者硬件方式进行编码，以生成图片格式的第一截屏内容，需要说明的是，所述第一截屏频率的具体数值可以是用户预先设置的，也可以是所述截屏线程采用的默认的截屏频率，例如设置所述第一截屏频率为20帧/秒等。
S23，当所述第一截屏内容的相邻至少两帧间的残差大于预设的阀值时，确定所述投屏内容为动态投屏内容。
在本发明实施例中，所述移动授课终端计算所述第一截屏内容的相邻至少两帧之间的残差，判断所述第一截屏内容的相邻至少两帧间的残差与预设的阈值之间的大小关系，当所述第一截屏内容的相邻至少两帧间的残差大于预设的阀值时，所述移动授课终端确定所述投屏内容为动态投屏内容，如视频、动态图片等，需要说明的是，本申请对于阈值的设置不做任何限制，可依据实际情况进行具体设置。
S24，对所述动态投屏内容按照第二截屏频率进行截屏，生成第二截屏内容。
在本发明实施例中，所述移动授课终端根据所述动态投屏内容，调整截屏线程相邻两次截屏的时间间隔，所述移动授课终端通过缩短截屏线程相邻两次截屏的睡眠时间来调整相邻两次截屏的时间间隔，从而提高截屏频率，将当前的截屏频率调整为第二截屏频率，通过所述截屏线程以调整后的所述第二截屏频率对当前桌面的所述投屏内容进行截屏，对截取的投屏内容通过软件方式或者硬件方式进行编码，以生成图片格式的第二截屏内容，其中所述第二截屏频率为20帧/秒-30帧/秒。
S25，将所述第二截屏内容发送至显示终端用于显示。
在本发明实施例中，所述移动授课终端在生成所述第二截屏内容之后，通过直接或者间接的方法将所述第二截屏内容发送给显示终端，以使得所述显示终端接收所述第二截屏内容后进行解码并显示，在本实施例中以所述显示终端为交互智能平板为例进行说明，需要说明的是，当所述显示终端为交互智能平板时，所述显示终端可以是会议场景使用的大尺寸交互智能平板，也可以是教育场景使用的大尺寸交互智能平板，由于所述移动授课终端以高于所述第一截屏频率的第二截屏频率，对所述投屏内容进行截屏，相应地提高了每帧数据的压缩率，在码率固定的情况下，码率＝帧率×每帧的数据量大小，每帧数据的压缩率提高了，即帧率提高了，相应地降低每帧数据量的大小，使得所述交互智能平板在显示所述动态投屏内容时更加流畅，优化了用户使用体验。
S26，当所述第一截屏内容的相邻至少两帧间的残差小于预设的阀值时，确定所述投屏内容为静态投屏内容。
在本发明实施例中，所述移动授课终端计算所述第一截屏内容的相邻至少两帧之间的残差，判断所述第一截屏内容的相邻至少两帧间的残差与预设的阈值之间的大小关系，当所述第一截屏内容的相邻至少两帧间的残差小于预设的阀值时，所述移动授课终端确定所述投屏内容为静态投屏内容，如文档、演示文稿、图片、各种图形用户界面显示内容等，需要说明的是，本申请对于阈值的设置不做任何限制，可依据实际情况进行具体设置。
S27，对所述静态投屏内容按照第三截屏频率进行截屏，生成第三截屏内容；其中，所述第三截屏频率小于第二截屏频率。
在本发明实施例中，所述移动授课终端根据所述静态投屏内容，调整截屏线程相邻两次截屏的时间间隔，所述移动授课终端通过增加截屏线程相邻两次截屏的睡眠时间来调整相邻两次截屏的时间间隔，从而降低截屏频率，将当前的截屏频率调整为第三截屏频率，通过所述截屏线程以调整后的所述第三截屏频率对当前桌面的所述投屏内容进行截屏，对截取的投屏内容通过软件方式或者硬件方式进行编码，以生成图片格式的第三截屏内容，其中所述第三截屏频率为5帧/秒-20帧/秒。
S28，将所述第三截屏内容发送至显示终端用于显示。
在本发明实施例中，在本发明实施例中，所述移动授课终端在生成所述第三截屏内容之后，通过直接或者间接的方法将所述第三截屏内容发送给显示终端，以使得所述显示终端接收所述第三截屏内容后进行解码并显示，在本实施例中以所述显示终端为交互智能平板为例进行说明，由于所述移动授课终端以低于所述第一截屏频率的第三截屏频率，对所述投屏内容进行截屏，相应地降低了每帧数据的压缩率，在码率固定的情况下，码率＝帧率×每帧的数据量大小，每帧数据的压缩率降低了，即帧率降低了，相应地提高每帧数据量的大小，使得所述交互智能平板在显示所述静态投屏内容时更加清晰，优化用户的使用体验。
综上所述，本发明第二实施例提供了一种桌面投屏方法，在桌面投屏过程中，启动桌面投屏设置，首先确定投屏内容的属性，当所述投屏内容的属性为动态投屏内容时，调整当前的截屏频率为第二截 屏频率，以调整后的第二截屏频率对所述投屏内容进行截屏，当所述投屏内容的属性为静态投屏内容时，调整当前的截屏频率为第三截屏频率，以调整后的第三截屏频率对所述投屏内容进行截屏，所述第三截屏频率小于第二截屏频率，最后将截屏后的内容发送至显示终端，本发明根据投屏内容的属性对截屏频率进行动态调整，从而实现帧率的动态调整，使得在显示终端上显示的投屏内容能够呈现出基于自身属性的显示效果，提高用户的使用体验，同时也避免因截屏频率设置的不合理，导致使用固定的截屏频率截取的投屏内容在接收端显示不佳的情况，从而提高投屏技术的良好的适用性。
在本发明另一实施例中：
在所述第二实施例的基础上，所述桌面投屏方法还包括：
接收对于所述投屏内容的批注信息；其中，所述批注信息为通过输入设备操作而生成的。
以第四截屏频率，对经批注的投屏内容进行截屏，生成第四截屏内容。
将所述第四截屏内容发送至显示终端用于显示。
在本发明实施例中，当作为接收端的交互智能平板检测到用户对显示于所述交互智能平板的显示界面上的投屏内容进行批注操作时，所述交互智能平板根据所述批注操作生成批注信息，并将所述批注信息通过桌面投屏设置以直接或者间接方式发送给所述移动授课终端，需要说明的是，所述批注信息为通过输入设备操作而生成的，所述交互智能平板在接收到所述移动授课终端发送的投屏内容并进行显示之后，当所述交互智能平板检测到输入设备被点击、被双击或者被长按、被滑动等等，则所述交互智能平板确定接收到对于所述投屏内容的批注操作。当所述投屏内容为动态投屏内容时，例如视频，所述批注操作可以是对视频的播放、暂停、快进、慢速播放、拖动等操作；当所述投屏内容为静态投屏内容，例如文档，所述批注操作可以是对文档的修改、删除、增加、拖动，打开文档等操作。所述移动授课终端在通过桌面投屏设置接收到对于所述投屏内容的批注信息之后，根据所述批注信息对所述投屏内容进行相应操作，同时调整截屏线程相邻两次截屏的时间间隔，所述移动授课终端通过缩短截屏线程相邻两次截屏的睡眠时间的设置来调整相邻两次截屏的时间间隔，从而将当前的截屏频率调整为第四截屏频率，所述第四截屏频率大于所述第一截屏频率，然后以第四截屏频率，对经批注的投屏内容进行截屏，对截取的投屏内容通过软件方式或者硬件方式进行编码，以生成图片格式的第四截屏内容，所述移动授课终端通过直接或者间接的方法将所述第四截屏内容发送给交互智能平板，以使得所述交互智能平板接收所述第四截屏内容后进行解码并显示，由于所述移动授课终端以高于所述第一截屏频率的第四截屏频率，对所述投屏内容进行截屏，相应地提高了每帧数据的压缩率，在码率固定的情况下，码率＝帧率×每帧的数据量大小，每帧数据的压缩率提高了，即帧率提高了，相应地降低每帧数据量的大小，使得所述交互智能平板在显示所述第四截屏内容时更加流畅，给用户一种操作流畅的感觉，提高操作流畅性，优化用户的使用体验。
请参阅图3，本发明第三实施例提供了一种桌面投屏装置，包括：
投屏启动模块11，用于启动桌面投屏设置。
第一截屏内容生成模块12，用于根据第一截屏频率，对当前桌面显示的投屏内容进行截屏，生成第一截屏内容。
投屏内容属性确定模块13，用于根据所述第一截屏内容，确定所述投屏内容的属性。
截屏频率调整模块14，用于根据所述投屏内容的属性，将当前的截屏频率调整为第二截屏频率。
第二截屏内容生成模块15，用于根据所述第二截屏频率，对所述投屏内容进行截屏，生成第二截屏内容。
第二截屏内容传输模块16，用于将所述第二截屏内容发送至显示终端用于显示。
在第三实施例的第一种实现方式中，所述投屏内容属性确定模块13具体包括：
内容属性确定子模块，用于根据所述第一截屏内容的相邻至少两帧间的残差，确定所述投屏内容的属性。
根据第三实施例的第一种实现方式，在第三实施例的第二种实现方式中，所述内容属性确定子模块，具体包括：
动态内容确定单元，用于当所述第一截屏内容的相邻至少两帧间的残差大于预设的阀值时，确定所述投屏内容为动态投屏内容。
静态内容确定单元，用于当所述第一截屏内容的相邻至少两帧间的残差小于预设的阀值时，确定所述投屏内容为静态投屏内容。
在第三实施例的第四种实现方式中，所述截屏频率调整模块14，具体包括：
根据所述投屏内容的属性，调整相邻两次截屏的时间间隔。
请参阅图4，本发明第四实施例提供了一种桌面投屏装置，包括：
投屏启动模块21，用于启动桌面投屏设置。
第一截屏内容生成模块22，用于根据第一截屏频率，对当前桌面显示的投屏内容进行截屏，生成第一截屏内容。
动态内容确定模块23，用于当所述第一截屏内容的相邻至少两帧间的残差大于预设的阀值时，确定所述投屏内容为动态投屏内容。
第二截屏内容生成模块24，用于对所述动态投屏内容按照第二截屏频率进行截屏，生成第二截屏内容。
第二截屏内容传输模块25，用于将所述第二截屏内容发送至显示终端用于显示。
静态内容确定模块26，用于当所述第一截屏内容的相邻至少两帧间的残差小于预设的阀值时，确定所述投屏内容为静态投屏内容。
第三截屏内容生成模块27，用于对所述静态投屏内容按照第三截屏频率进行截屏，生成第三截屏内容；其中，所述第三截屏频率小于第二截屏频率。
第三截屏内容传输模块28，用于将所述第三截屏内容发送至显示终端用于显示。
在第四实施例的第一种实现方式中，还包括：
批注信息接收模块，用于接收对于所述投屏内容的批注信息；其中，所述批注信息为通过输入设备操作而生成的。
第四截屏信息生成模块，用于以第四截屏频率，对经批注的投屏内容进行截屏，生成第四截屏内容。
第四截屏信息传输模块，用于将所述第四截屏内容发送至显示终端用于显示。
在第四实施例的第二种实现方式中，所述第二截屏频率为20帧/秒-30帧/秒。
在第四实施例的第三种实现方式中，所述第三截屏频率为5帧/秒-20帧/秒。
需说明的是，以上所描述的装置实施例仅仅是示意性的，其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。另外，本发明提供的装置实施例附图中，模块之间的连接关系表示它们之间具有通信连接，具体可以实现为一条或多条通信总线或信号线。本领域普通技术人员在不付出创造性劳动的情况下，即可以理解并实施。
请参阅图5，本发明第五实施例提供了一种桌面投屏设备，该实施例的基于桌面同步的显示调整终端设备包括：处理器51、存储器52、具有触摸功能的显示屏53、输入装置54、输出装置55、通信装置56以及存储在所述存储器52中并可在所述处理器51上运行的计算机程序，例如桌面投屏程序。所述处理器41执行所述计算机程序时实现第一实施例中的桌面投屏实施例的步骤。或者，所述处理器51执行所述计算机程序时实现第三实施例的装置实施例中各模块/单元的功能。该桌面投屏设备中处理器51的数量可以是一个或者多个，图5中以一个处理器51为例。该桌面投屏设备中存储器52的数量可以是一个或者多个，图5中以一个存储器52为例。该基于桌面同步的显示调整终端设备的处理器51、存储器52、显示屏53、输入装置54、输出装置55以及通信装置56可以通过总线或者其他方式连接，图5中以通过总线连接为例。实施例中，桌面投屏设备可以是电脑，手机，平板，移动授课终端或交互智能平板等。实施例中，以桌面投屏设备为移动授课终端为例，进行描述。
示例性的，所述计算机程序可以被分割成一个或多个模块/单元，所述一个或者多个模块/单元被存储在所述存储器52中，并由所述处理器51执行，以完成本发明。所述一个或多个模块/单元可以是能够完成特定功能的一系列计算机程序指令段，该指令段用于描述所述计算机程序在所述桌面投屏设备中的执行过程。
所述桌面投屏设备可包括，但不仅限于，处理器51、存储器52。本领域技术人员可以理解，所述示意图仅仅是桌面投屏设备的示例，并不构成对桌面投屏设备的限定，可以包括比图示更多或更少 的部件，或者组合某些部件，或者不同的部件，例如所述桌面投屏设备还可以包括输入输出设备、网络接入设备、总线等。
所称处理器51可以是中央处理单元(Central Processing Unit，CPU)，还可以是其他通用处理器、数字信号处理器(Digital Signal Processor，DSP)、专用集成电路(Application Specific Integrated Circuit，ASIC)、现成可编程门阵列(Field-Programmable Gate Array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等，所述处理器51是所述桌面投屏设备的控制中心，利用各种接口和线路连接整个桌面投屏设备的各个部分。
所述存储器52可用于存储所述计算机程序和/或模块，所述处理器51通过运行或执行存储在所述存储器52内的计算机程序和/或模块，以及调用存储在存储器52内的数据，实现所述桌面投屏设备的各种功能。所述存储器52可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序等；存储数据区可存储根据手机的使用所创建的数据等。此外，存储器52可以包括高速随机存取存储器，还可以包括非易失性存储器，例如硬盘、内存、插接式硬盘，智能存储卡(Smart Media Card,SMC)，安全数字(Secure Digital,SD)卡，闪存卡(Flash Card)、至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
所述显示屏53为具有触摸功能的显示屏，其可以是电容屏、电磁屏或者红外屏。一般而言，显示屏53用于根据处理器51的指示显示数据，还用于接收作用于显示屏53的触摸操作，并将相应的信号发送至处理器51或其他装置。可选的，当显示屏53为红外屏时，其还包括红外触摸框，该红外触摸框设置在显示屏53的四周，其还可以用于接收红外信号，并将该红外信号发送至处理器51或者其他设备。
所述通信装置56，用于与其他设备建立通信连接，其可以是有线通信装置56和/或无线通信装置56。所述输入装置54可用于接收输入的数字或者字符信息，以及产生与桌面投屏设备的用户设置以及功能控制有关的键信号输入，还可以是用于获取图像的摄像头以及获取音频数据的拾音设备。所述输出装置55可以包括扬声器等音频设备。需要说明的是，输入装置54和输出装置55的具体组成可以根据实际情况设定。
本发明第六实施例提供了一种计算机可读存储介质，第五实施例中的所述桌面投屏设备集成的模块/单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本发明实现上述实施例方法中的全部或部分流程，也可以通过计算机程序来指令相关的硬件来完成，所述的计算机程序可存储于一计算机可读存储介质中，该计算机程序在被处理器执行时，可实现上述各个方法实施例的步骤。其中，所述计算机程序包括计算机程序代码，所述计算机程序代码可以为源代码形式、对象代码形式、可执行文件或某些中间形式等。所述计算机可读介质可以包括：能够携带所述计算机程序代码的任何实体或装置、记录介质、U盘、移动硬 盘、磁碟、光盘、计算机存储器、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、电载波信号、电信信号以及软件分发介质等。需要说明的是，所述计算机可读介质包含的内容可以根据司法管辖区内立法和专利实践的要求进行适当的增减，例如在某些司法管辖区，根据立法和专利实践，计算机可读介质不包括电载波信号和电信信号。
本发明第七实施例提供了一种桌面投屏设备，该实施例的基于桌面同步的显示调整终端设备包括：处理器、存储器、具有触摸功能的显示屏、输入装置、输出装置、通信装置以及存储在所述存储器中并可在所述处理器上运行的计算机程序，例如桌面投屏程序。所述处理器执行所述计算机程序时实现第二实施例中的桌面投屏实施例的步骤。或者，所述处理器执行所述计算机程序时实现第四实施例的装置实施例中各模块/单元的功能。该桌面投屏设备中处理器的数量可以是一个或者多个。该桌面投屏设备中存储器的数量可以是一个或者多个。该基于桌面同步的显示调整终端设备的处理器、存储器、显示屏、输入装置、输出装置以及通信装置可以通过总线或者其他方式连接。实施例中，桌面投屏设备可以是电脑，手机，平板，移动授课终端或交互智能平板等。实施例中，以桌面投屏设备为移动授课终端为例，进行描述。
示例性的，所述计算机程序可以被分割成一个或多个模块/单元，所述一个或者多个模块/单元被存储在所述存储器中，并由所述处理器执行，以完成本发明。所述一个或多个模块/单元可以是能够完成特定功能的一系列计算机程序指令段，该指令段用于描述所述计算机程序在所述桌面投屏设备中的执行过程。
所称处理器可以是中央处理单元(Central Processing Unit，CPU)，还可以是其他通用处理器、数字信号处理器(Digital Signal Processor，DSP)、专用集成电路(Application Specific Integrated Circuit，ASIC)、现成可编程门阵列(Field-Programmable Gate Array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等，所述处理器是所述桌面投屏设备的控制中心，利用各种接口和线路连接整个桌面投屏设备的各个部分。
所述存储器可用于存储所述计算机程序和/或模块，所述处理器通过运行或执行存储在所述存储器内的计算机程序和/或模块，以及调用存储在存储器内的数据，实现所述桌面投屏设备的各种功能。所述存储器可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序等；存储数据区可存储根据手机的使用所创建的数据等。此外，存储器可以包括高速随机存取存储器，还可以包括非易失性存储器，例如硬盘、内存、插接式硬盘，智能存储卡(Smart Media Card,SMC)，安全数字(Secure Digital,SD)卡，闪存卡(Flash Card)、至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
所述显示屏为具有触摸功能的显示屏，其可以是电容屏、电磁屏或者红外屏。一般而言，显示屏用于根据处理器的指示显示数据，还用于接收作用于显示屏的触摸操作，并将相应的信号发送至处理器或其他装置。可选的，当显示屏为红外屏时，其还包括红外触摸框，该红外触摸框设置在显示屏的四周，其还可以用于接收红外信号，并将该红外信号发送至处理器或者其他设备。
所述通信装置，用于与其他设备建立通信连接，其可以是有线通信装置和/或无线通信装置。所述输入装置可用于接收输入的数字或者字符信息，以及产生与桌面投屏设备的用户设置以及功能控制有关的键信号输入，还可以是用于获取图像的摄像头以及获取音频数据的拾音设备。所述输出装置可以包括扬声器等音频设备。需要说明的是，输入装置和输出装置的具体组成可以根据实际情况设定。
本发明第八实施例提供了一种计算机可读存储介质，第七实施例中的所述桌面投屏设备集成的模块/单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本发明实现上述实施例方法中的全部或部分流程，也可以通过计算机程序来指令相关的硬件来完成，所述的计算机程序可存储于一计算机可读存储介质中，该计算机程序在被处理器执行时，可实现上述各个方法实施例的步骤。其中，所述计算机程序包括计算机程序代码，所述计算机程序代码可以为源代码形式、对象代码形式、可执行文件或某些中间形式等。所述计算机可读介质可以包括：能够携带所述计算机程序代码的任何实体或装置、记录介质、U盘、移动硬盘、磁碟、光盘、计算机存储器、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、电载波信号、电信信号以及软件分发介质等。需要说明的是，所述计算机可读介质包含的内容可以根据司法管辖区内立法和专利实践的要求进行适当的增减，例如在某些司法管辖区，根据立法和专利实践，计算机可读介质不包括电载波信号和电信信号。
以上所述是本发明的优选实施方式，应当指出，对于本技术领域的普通技术人员来说，在不脱离本发明原理的前提下，还可以做出若干改进和润饰，这些改进和润饰也视为本发明的保护范围。

Claims (20)

  1. 一种桌面投屏方法，其特征在于，包括：
    启动桌面投屏设置；
    根据第一截屏频率，对当前桌面显示的投屏内容进行截屏，生成第一截屏内容；
    根据所述第一截屏内容，确定所述投屏内容的属性；
    根据所述投屏内容的属性，将当前的截屏频率调整为第二截屏频率；
    根据所述第二截屏频率，对所述投屏内容进行截屏，生成第二截屏内容；
    将所述第二截屏内容发送至显示终端用于显示。
  2. 根据权利要求1所述的桌面投屏方法，其特征在于，所述根据所述第一截屏内容，确定所述投屏内容的属性，具体为：
    根据所述第一截屏内容的相邻至少两帧间的残差，确定所述投屏内容的属性。
  3. 根据权利要求2所述的桌面投屏方法，其特征在于，所述根据所述第一截屏内容的相邻至少两帧间的残差，确定所述投屏内容的属性，具体为：
    当所述第一截屏内容的相邻至少两帧间的残差大于预设的阀值时，确定所述投屏内容为动态投屏内容；
    当所述第一截屏内容的相邻至少两帧间的残差小于预设的阀值时，确定所述投屏内容为静态投屏内容。
  4. 根据权利要求1所述的桌面投屏方法，其特征在于，所述根据所述投屏内容的属性，将当前的截屏频率调整为第二截屏频率，具体为：
    根据所述投屏内容的属性，调整相邻两次截屏的时间间隔。
  5. 一种桌面投屏方法，其特征在于，包括：
    启动桌面投屏设置；
    根据第一截屏频率，对当前桌面显示的投屏内容进行截屏，生成第一截屏内容；
    当所述第一截屏内容的相邻至少两帧间的残差大于预设的阀值时，确定所述投屏内容为动态投屏内容；
    对所述动态投屏内容按照第二截屏频率进行截屏，生成第二截屏内容；
    将所述第二截屏内容发送至显示终端用于显示；
    当所述第一截屏内容的相邻至少两帧间的残差小于预设的阀值时，确定所述投屏内容为静态投屏内容；
    对所述静态投屏内容按照第三截屏频率进行截屏，生成第三截屏内容；其中，所述第三截屏频率小于第二截屏频率；
    将所述第三截屏内容发送至显示终端用于显示。
  6. 根据权利要求5所述的桌面投屏方法，其特征在于，还包括：
    接收对于所述投屏内容的批注信息；其中，所述批注信息为通过输入设备操作而生成的；
    以第四截屏频率，对经批注的投屏内容进行截屏，生成第四截屏内容；
    将所述第四截屏内容发送至显示终端用于显示。
  7. 根据权利要求5所述的桌面投屏方法，其特征在于，所述第二截屏频率为20帧/秒-30帧/秒。
  8. 根据权利要求5所述的桌面投屏方法，其特征在于，所述第三截屏频率为5帧/秒-20帧/秒。
  9. 一种桌面投屏装置，其特征在于，包括：
    投屏启动模块，用于启动桌面投屏设置；
    第一截屏内容生成模块，用于根据第一截屏频率，对当前桌面显示的投屏内容进行截屏，生成第一截屏内容；
    投屏内容属性确定模块，用于根据所述第一截屏内容，确定所述投屏内容的属性；
    截屏频率调整模块，用于根据所述投屏内容的属性，将当前的截屏频率调整为第二截屏频率；
    第二截屏内容生成模块，用于根据所述第二截屏频率，对所述投屏内容进行截屏，生成第二截屏内容；
    第二截屏内容传输模块，用于将所述第二截屏内容发送至显示终端用于显示。
  10. 根据权利要求9所述的桌面投屏装置，其特征在于，所述投屏内容属性确定模块具体包括：
    内容属性确定子模块，用于根据所述第一截屏内容的相邻至少两帧间的残差，确定所述投屏内容的属性。
  11. 根据权利要求10所述的桌面投屏装置，其特征在于，所述内容属性确定子模块，具体包括：
    动态内容确定单元，用于当所述第一截屏内容的相邻至少两帧间的残差大于预设的阀值时，确定所述投屏内容为动态投屏内容；
    静态内容确定单元，用于当所述第一截屏内容的相邻至少两帧间的残差小于预设的阀值时，确定所述投屏内容为静态投屏内容。
  12. 根据权利要求9所述的桌面投屏装置，其特征在于，所述截屏频率调整模块，具体包括：
    根据所述投屏内容的属性，调整相邻两次截屏的时间间隔。
  13. 一种桌面投屏装置，其特征在于，包括：
    投屏启动模块，用于启动桌面投屏设置；
    第一截屏内容生成模块，用于根据第一截屏频率，对当前桌面显示的投屏内容进行截屏，生成第一截屏内容；
    动态内容确定模块，用于当所述第一截屏内容的相邻至少两帧间的残差大于预设的阀值时，确定所述投屏内容为动态投屏内容；
    第二截屏内容生成模块，用于对所述动态投屏内容按照第二截屏频率进行截屏，生成第二截屏内容；
    第二截屏内容传输模块，用于将所述第二截屏内容发送至显示终端用于显示；
    静态内容确定模块，用于当所述第一截屏内容的相邻至少两帧间的残差小于预设的阀值时，确定所述投屏内容为静态投屏内容；
    第三截屏内容生成模块，用于对所述静态投屏内容按照第三截屏频率进行截屏，生成第三截屏内容；其中，所述第三截屏频率小于第二截屏频率；
    第三截屏内容传输模块，用于将所述第三截屏内容发送至显示终端用于显示。
  14. 根据权利要求13所述的桌面投屏装置，其特征在于，还包括：
    批注信息接收模块，用于接收对于所述投屏内容的批注信息；其中，所述批注信息为通过输入设备操作而生成的；
    第四截屏信息生成模块，用于以第四截屏频率，对经批注的投屏内容进行截屏，生成第四截屏内容；
    第四截屏信息传输模块，用于将所述第四截屏内容发送至显示终端用于显示。
  15. 根据权利要求13所述的桌面投屏装置，其特征在于，所述第二截屏频率为20帧/秒-30帧/秒。
  16. 根据权利要求13所述的桌面投屏装置，其特征在于，所述第三截屏频率为5帧/秒-20帧/秒。
  17. 一种桌面投屏设备，包括处理器、存储器以及存储在所述存储器中且被配置为由所述处理器执行的计算机程序，所述处理器执行所述计算机程序时实现如权利要求1至4中任意一项所述的桌面投屏方法。
  18. 一种桌面投屏设备，包括处理器、存储器以及存储在所述存储器中且被配置为由所述处理器执行的计算机程序，所述处理器执行所述计算机程序时实现如权利要求5至8中任意一项所述的桌面投屏方法。
  19. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质包括存储的计算机程序，其中，在所述计算机程序运行时控制所述计算机可读存储介质所在设备执行如权利要求1至4中任意一项所述的桌面投屏方法。
  20. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质包括存储的计算机程序，其中，在所述计算机程序运行时控制所述计算机可读存储介质所在设备执行如权利要求5至8中任意一项所述的桌面投屏方法。
PCT/CN2018/113698 2018-08-27 2018-11-02 一种桌面投屏方法、装置、设备及存储介质 WO2020042350A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810992918.7A CN109240629A (zh) 2018-08-27 2018-08-27 一种桌面投屏方法、装置、设备及存储介质
CN201810992918.7 2018-08-27

Publications (1)

Publication Number Publication Date
WO2020042350A1 true WO2020042350A1 (zh) 2020-03-05

Family

ID=65068719

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/113698 WO2020042350A1 (zh) 2018-08-27 2018-11-02 一种桌面投屏方法、装置、设备及存储介质

Country Status (2)

Country Link
CN (1) CN109240629A (zh)
WO (1) WO2020042350A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112995776A (zh) * 2021-01-26 2021-06-18 北京字跳网络技术有限公司 共享屏幕内容抓屏帧率确定方法、装置、设备和存储介质

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111294857B (zh) * 2019-03-25 2023-09-12 深圳市鸿合创新信息技术有限责任公司 智能显示屏、控制方法、存储介质及电子设备
CN111831242A (zh) * 2019-04-23 2020-10-27 阿里巴巴集团控股有限公司 信息显示方法、投屏端、显示端、存储介质及系统
CN111182342A (zh) * 2019-12-24 2020-05-19 腾讯科技（深圳）有限公司 基于dlna的媒体数据播放方法、装置、设备以及存储介质
CN111277875B (zh) * 2020-01-10 2022-03-25 京东方科技集团股份有限公司 发射器及无线投屏装置
CN111427523B (zh) 2020-01-19 2022-08-02 杭州海康威视数字技术股份有限公司 窗口叠加显示处理方法、装置及电子设备
CN111522619B (zh) * 2020-05-03 2023-11-10 渴创技术(深圳)有限公司 基于软件类型和鼠标指针位置自动降低扩展屏幕刷新频率方法
CN112203126B (zh) * 2020-09-18 2022-11-04 北京小米松果电子有限公司 投屏方法、投屏装置及存储介质
CN112399215A (zh) * 2020-10-26 2021-02-23 努比亚技术有限公司 一种投屏参数调控方法、设备及计算机可读存储介质
CN114756158A (zh) * 2020-12-29 2022-07-15 广州视源电子科技股份有限公司 应用窗口投屏切换方法、装置、系统、介质以及电子设备
CN112822538A (zh) * 2020-12-31 2021-05-18 努比亚技术有限公司 投屏显示方法、投屏方法、投屏设备、终端及存储介质
CN112929704B (zh) * 2021-01-26 2023-06-30 游密科技(深圳)有限公司 数据传输方法、装置、电子设备以及存储介质
CN114786060A (zh) * 2022-02-28 2022-07-22 长沙朗源电子科技有限公司 基于安卓平台无线投屏实现帧率控制的方法及其装置

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105404490A (zh) * 2015-12-07 2016-03-16 联想(北京)有限公司 一种信息处理方法及电子设备
CN106375841A (zh) * 2015-07-23 2017-02-01 阿里巴巴集团控股有限公司 无线投屏数据处理、视频数据显示方法、装置及电子设备
KR20170081486A (ko) * 2016-01-04 2017-07-12 엘지전자 주식회사 디스플레이 장치 및 그 동작 방법

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102413323B (zh) * 2010-01-13 2014-03-12 中国移动通信集团广东有限公司中山分公司 一种基于h.264的视频压缩方法
CN104216630B (zh) * 2014-08-21 2019-01-11 小米科技有限责任公司 界面共享方法及装置
CN104902279B (zh) * 2015-05-25 2018-11-13 浙江大学 一种视频处理方法及装置
CN106445436A (zh) * 2016-08-29 2017-02-22 武汉启目科技有限公司 一种电脑终端投屏的控制方法
CN106547469B (zh) * 2016-11-25 2019-08-06 北京恒泰实达科技股份有限公司 无线触控一体实现方法以及无线触控一体机

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106375841A (zh) * 2015-07-23 2017-02-01 阿里巴巴集团控股有限公司 无线投屏数据处理、视频数据显示方法、装置及电子设备
CN105404490A (zh) * 2015-12-07 2016-03-16 联想(北京)有限公司 一种信息处理方法及电子设备
KR20170081486A (ko) * 2016-01-04 2017-07-12 엘지전자 주식회사 디스플레이 장치 및 그 동작 방법

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112995776A (zh) * 2021-01-26 2021-06-18 北京字跳网络技术有限公司 共享屏幕内容抓屏帧率确定方法、装置、设备和存储介质
CN112995776B (zh) * 2021-01-26 2023-04-07 北京字跳网络技术有限公司 共享屏幕内容抓屏帧率确定方法、装置、设备和存储介质

Also Published As

Publication number Publication date
CN109240629A (zh) 2019-01-18

Similar Documents

Publication Publication Date Title
WO2020042350A1 (zh) 一种桌面投屏方法、装置、设备及存储介质
US20220312049A1 (en) Method for processing live-streaming interaction video and server
WO2017173793A1 (zh) 一种视频投屏方法及装置
CN112394895B (zh) 画面跨设备显示方法与装置、电子设备
KR102157634B1 (ko) 영상 획득 방법 및 로컬 엔드포인트 호스트 장치
US20200106708A1 (en) Load Balancing Multimedia Conferencing System, Device, and Methods
KR20120079454A (ko) 스크린 공유 장치 및 방법
US9344678B2 (en) Information processing apparatus, information processing method and computer-readable storage medium
US9060033B2 (en) Generation and caching of content in anticipation of presenting content in web conferences
WO2020088059A1 (zh) 视频播放方法、视频播放装置、电子设备及存储介质
WO2023143299A1 (zh) 消息展示方法、装置、设备及存储介质
TW201539312A (zh) 顯示裝置及其圖像顯示方法
CN113923498A (zh) 一种处理方法及装置
US20150099492A1 (en) Information processing apparatus that controls transfer of image, control method therefor, and storage medium
US9467655B2 (en) Computer readable recording medium, communication terminal device and teleconferencing method
CN112203126A (zh) 投屏方法、投屏装置及存储介质
US20220353462A1 (en) Managing a call on a communication system with an external display device
US9560105B2 (en) Server device and information processing method
JP6396342B2 (ja) オーディオ−ビデオ用のワイヤレスドッキングシステム
CN109194653A (zh) 一种基于辅助屏的会议平板控制方法和系统
US11916982B2 (en) Techniques for signaling multiple audio mixing gains for teleconferencing and telepresence for remote terminals using RTCP feedback
CN113727183B (zh) 直播推流方法、装置、设备、存储介质及计算机程序产品
WO2022007750A1 (zh) 屏幕共享方法、终端和存储介质
US20210192853A1 (en) Method and system for wireless transmission of audio/video media content to a display device
JP6485352B2 (ja) 受信装置、方法、コンピュータプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18931904

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 28.05.2021)

122 Ep: pct application non-entry in european phase

Ref document number: 18931904

Country of ref document: EP

Kind code of ref document: A1