CN115209117A - Screen projection method and device - Google Patents

Screen projection method and device Download PDF

Info

Publication number
CN115209117A
CN115209117A CN202210857837.2A CN202210857837A CN115209117A CN 115209117 A CN115209117 A CN 115209117A CN 202210857837 A CN202210857837 A CN 202210857837A CN 115209117 A CN115209117 A CN 115209117A
Authority
CN
China
Prior art keywords
screen
canvas
screen projection
module
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210857837.2A
Other languages
Chinese (zh)
Other versions
CN115209117B (en
Inventor
杜成立
任思锜
夏正冬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zitiao Network Technology Co Ltd
Original Assignee
Beijing Zitiao Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zitiao Network Technology Co Ltd filed Critical Beijing Zitiao Network Technology Co Ltd
Priority to CN202210857837.2A priority Critical patent/CN115209117B/en
Publication of CN115209117A publication Critical patent/CN115209117A/en
Application granted granted Critical
Publication of CN115209117B publication Critical patent/CN115209117B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Transforming Electric Information Into Light Information (AREA)

Abstract

The application discloses a screen projection method, wherein a middle module of screen projection equipment can decode screen stream data by using an operating system of the screen projection equipment to obtain decoded data. In addition, the intermediate module may obtain information of a canvas corresponding to the screen stream data. After the intermediate module obtains the information of the canvas, the information of the canvas can be transmitted to the operating system, and the operating system renders the decoded data on the screen of the screen projection device based on the information and the decoded data of the canvas. Therefore, by the scheme, the operating system of the screen projection equipment can render the decoded data on the screen of the screen projection equipment based on the information of the canvas corresponding to the screen stream data and the decoded data, and when the operating system renders the decoded data on the screen, the resolution of the operating system is matched with the resolution of the screen stream. Therefore, the definition of the content displayed on the screen of the screen projection equipment can be improved by utilizing the scheme.

Description

Screen projection method and device
Technical Field
The present application relates to the field of computer technologies, and in particular, to a screen projection method and apparatus.
Background
In the screen projection scene, the user can project the content displayed on the screen of the sharing device to the screen of the screen projection device for display. The definition of the content displayed on the screen of the screen projection device is affected by the resolution of the screen projection device and the resolution of the received screen projection video stream.
At present, in a screen projection scene, even if the resolution of the screen projection device is higher than the resolution of the screen projection video stream, the resolution of the content displayed on the screen of the screen projection device cannot reach the resolution of the screen projection video stream. In other words, the resolution of the content displayed on the screen of the projection device is not so high as to match the resolution of the projected video stream.
Therefore, a solution is urgently needed to improve the definition of the content displayed on the screen of the screen projection device.
Disclosure of Invention
In order to solve or at least partially solve the technical problems, embodiments of the present application provide a screen projection method and apparatus.
In a first aspect, an embodiment of the present application provides a screen projection method, where the method includes:
the method comprises the steps that an intermediate module of the screen projection equipment decodes screen stream data by using an operating system of the screen projection equipment to obtain decoded data;
the intermediate module acquires information of a canvas corresponding to the screen flow data;
the intermediate module transmits the information of the canvas to the operating system, and the operating system renders the decoding data on the screen of the screen projection device based on the information of the canvas and the decoding data.
Optionally, the obtaining, by the intermediate module, information of a canvas corresponding to the screen stream data includes:
the intermediate module acquires information of the canvas sent by a service module of the screen projection equipment, wherein the service module is a module related to screen projection service, and the canvas is created by the service module in response to screen projection operation triggered by a user.
Optionally, the information of the canvas is set by the business module when creating the canvas.
Optionally, the information of the canvas is set by the service module when receiving a canvas adjustment notification message sent by the intermediate module, where the intermediate module sends the canvas adjustment notification message to the service module when the position and/or size of the screen stream data display is changed, and the canvas adjustment notification message carries the changed position and size of the screen stream data display.
Optionally, the method further includes:
the intermediate module receives a first notification message sent by the operating system, wherein the first notification message is used for indicating the rendering end of the screen stream data;
and the intermediate module sends a second notification message to the service module based on the first notification message, wherein the second notification message is used for notifying the service module to destroy the canvas.
Optionally, the obtaining, by the intermediate module, information of a canvas corresponding to the screen stream data includes:
the intermediate module acquires information of a canvas corresponding to the screen flow data under the condition that the screen projection equipment supports high-definition rendering, wherein the screen projection equipment supports high-definition rendering and is used for indicating that the screen projection equipment supports rendering by directly using a hardware driving module in the operating system without using a Graphics Processing Unit (GPU) of the operating system.
In a second aspect, an embodiment of the present application provides a screen projection method, where the method includes:
a service module of screen projection equipment responds to screen projection operation triggered by a user and creates a canvas, wherein the service module is a module related to screen projection service;
and the service module transmits the information of the canvas to an operating system through an intermediate module, and the operating system renders the decoded data on a screen of the screen projection equipment based on the information of the canvas and decoded data obtained by decoding screen stream data.
Optionally, the information of the canvas is set by the business module when creating the canvas.
Optionally, the service module sets the information of the canvas in the following manner:
the service module monitors the position and/or size of the screen stream data display through the intermediate module;
when the position and/or size of the screen stream data display is changed, the service module receives a canvas adjustment notification message sent by the intermediate module, wherein the canvas adjustment notification message carries the changed position and size of the screen stream data display;
and the service module sets the information of the canvas based on the position and the size of the changed screen flow data display carried in the canvas adjustment notification message.
In a third aspect, an embodiment of the present application provides a screen projection apparatus, which is applied to a middle module of a screen projection device, and the apparatus includes:
the decoding unit is used for decoding screen stream data by using an operating system of the screen projection equipment to obtain decoded data;
the acquisition unit is used for acquiring the information of the canvas corresponding to the screen flow data;
the first sending unit is used for transmitting the information of the canvas to the operating system, and the operating system renders the decoding data on the screen of the screen projection equipment based on the information of the canvas and the decoding data.
Optionally, the obtaining unit is configured to:
acquiring information of the canvas sent by a service module of the screen projection equipment, wherein the service module is a module related to screen projection service, and the canvas is created by the service module in response to screen projection operation triggered by a user.
Optionally, the information of the canvas is set by the business module when creating the canvas.
Optionally, the information of the canvas is set by the service module when receiving a canvas adjustment notification message sent by the intermediate module, where the intermediate module sends the canvas adjustment notification message to the service module when the position and/or size of the screen stream data display is changed, and the canvas adjustment notification message carries the changed position and size of the screen stream data display.
Optionally, the apparatus further comprises:
the receiving unit is used for receiving a first notification message sent by the operating system, wherein the first notification message is used for indicating the rendering end of the screen stream data;
a second sending unit, configured to send a second notification message to the service module based on the first notification message, where the second notification message is used to notify the service module to destroy the canvas.
Optionally, the obtaining unit is configured to:
and under the condition that the screen projection equipment is determined to support high-definition rendering, acquiring information of a canvas corresponding to the screen flow data, wherein the screen projection equipment supports high-definition rendering and is used for indicating that the screen projection equipment supports rendering by directly using a hardware driving module in the operating system without using a Graphics Processing Unit (GPU) of the operating system.
In a fourth aspect, an embodiment of the present application provides a screen projection apparatus, which is applied to a service module of a screen projection device, and the apparatus includes:
the system comprises a creating unit, a display unit and a service module, wherein the creating unit is used for responding to screen projection operation triggered by a user and creating a canvas, and the service module is a module related to screen projection service;
and the sending unit is used for transmitting the information of the canvas to an operating system through an intermediate module, and the operating system renders the decoded data on the screen of the screen projection equipment based on the information of the canvas and the decoded data obtained by decoding screen stream data.
Optionally, the information of the canvas is set by the business module when the canvas is created.
Optionally, the service module sets the information of the canvas by:
the service module monitors the position and/or size of the screen flow data display through the intermediate module;
when the position and/or size of the screen stream data display is changed, the service module receives a canvas adjustment notification message sent by the intermediate module, wherein the canvas adjustment notification message carries the changed position and size of the screen stream data display;
and the service module sets the information of the canvas based on the position and the size of the changed screen flow data display carried in the canvas adjustment notification message.
In a fifth aspect, an embodiment of the present application provides an apparatus, which includes a processor and a memory;
the processor is configured to execute instructions stored in the memory to cause the apparatus to perform the method of any of the above first aspects or to cause the apparatus to perform the method of any of the above second aspects.
In a sixth aspect, embodiments of the present application provide a computer-readable storage medium, including instructions that instruct a device to perform the method of any one of the above first aspects, or instruct a device to perform the method of any one of the above second aspects.
In a seventh aspect, the present application provides a computer program product, which when run on a computer, causes the computer to execute the method of any one of the above first aspects, or causes the computer to execute the method of any one of the above second aspects.
Compared with the prior art, the embodiment of the application has the following advantages:
the embodiment of the application provides a screen projection method, which can be applied to an intermediate module of screen projection equipment, wherein the intermediate module of the screen projection equipment can decode screen stream data by using an operating system of the screen projection equipment to obtain decoded data. In addition, the intermediate module may acquire information of a canvas corresponding to the screen stream data. After the intermediate module obtains the information of the canvas, the information of the canvas can be transmitted to the operating system, and the operating system renders the decoded data on the screen of the screen projection device based on the information of the canvas and the decoded data. Therefore, according to the scheme, the operating system of the screen projection device can render the decoded data on the screen of the screen projection device based on the information of the canvas corresponding to the screen stream data and the decoded data, and when the operating system renders the decoded data on the screen, the resolution of the decoded data is matched with the resolution of the screen stream. Therefore, the definition of the content displayed on the screen of the screen projection equipment can be improved by utilizing the scheme.
The embodiment of the application provides a screen projection method. The method can be applied to a business module of the screen projection equipment, and the business module is a module related to the screen projection business. In one example, after a user triggers a screen-drop operation, the business module can create a canvas in response to the screen-drop operation. Further, the service module may transmit information of the canvas to an operating system through an intermediate module, and the operating system may render decoded data on a screen of the screen projection device based on the information of the canvas and decoded data obtained by decoding screen stream data. Therefore, according to the scheme, the operating system of the screen projection device can render the decoded data on the screen of the screen projection device based on the information of the canvas corresponding to the screen stream data and the decoded data, and when the operating system renders the decoded data on the screen, the resolution of the rendered picture is matched with the resolution of the screen stream, for example, when the resolution of the screen is not lower than the resolution of the screen stream, the resolution of the decoded data when the operating system renders the decoded data on the screen is the same as the resolution of the screen stream. Therefore, the definition of the content displayed on the screen of the screen projection equipment can be improved by utilizing the scheme.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present application, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic flowchart of a screen projection method according to an embodiment of the present application;
fig. 2 is a schematic flowchart of another screen projection method provided in the embodiment of the present application;
fig. 3 is a signaling interaction diagram of a screen projection method according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a screen projection apparatus according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of another screen projection device according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The inventor of the present application has found through research that, at present, in a screen projection scene, even if the resolution of the screen projection device is higher than that of the screen projection video stream, the resolution of content displayed on the screen of the screen projection device cannot reach the resolution of the screen projection video stream. For example, the screen of the screen projection device has a resolution of 4k, and the resolution of the screen projection video stream has a resolution of 2k, but when the screen projection device renders the screen projection video stream onto the screen, the displayed resolution cannot reach 2k. The reason for this is that:
currently, when a screen projection device renders a screen projection video stream, a User Interface (UI) display layer is used to render the screen projection video stream, and when the UI display layer renders the screen projection video stream, a certain limitation is imposed on a resolution of a rendered picture. For example, the resolution of rendered pictures is limited to 1080p, and even if the resolution of a projected video stream is higher than 1080p and the resolution of pictures rendered on the screen by a ui display layer can only reach 1080p.
In order to solve the above problem, the embodiments of the present application provide a screen projection method and apparatus.
Various non-limiting embodiments of the present application are described in detail below with reference to the attached drawing figures.
Exemplary method
Referring to fig. 1, the figure is a schematic flowchart of a screen projection method provided in the embodiment of the present application. In this embodiment, the screen projection method shown in fig. 1 may be applied to a middle module of a screen projection device, where the middle module of the screen projection device may be a functional module in the screen projection device.
In one example, the method shown in fig. 1 may include, for example, the steps of: S101-S103.
S101: and the intermediate module decodes the screen stream data by using the operating system of the screen projection equipment to obtain decoded data.
The operating system is not particularly limited by embodiments of the application, and in one example, the operating system may be, for example, an android operating system.
In the embodiment of the present application, the screen stream data received by the screen projection device may be data after being compressed. Therefore, before the screen projection device renders the screen stream data, the screen stream data can be decoded to obtain decoded data. In an embodiment of the present application, the screen stream data may be decoded by an operating system of the screen projection device.
In one example, the intermediate module may send a decoding instruction to the operating system, and the operating system decodes the screen stream data based on the decoding instruction to obtain decoded data.
S102: and the intermediate module acquires the information of the canvas corresponding to the screen flow data.
In one example, the intermediary module may obtain canvas information corresponding to the screen flow data from other modules. The other modules are not specifically limited in the embodiment of the present application, and it is considered that the screen projection device includes a module related to the screen projection service (hereinafter referred to as a service module), and the service module can process data processing operations related to the screen projection service. Thus, in one example, the other module may be the business module. In other words, in one example, S102 can obtain the information of the canvas sent by the business module when it is implemented specifically.
With respect to the canvas, it is to be noted that the canvas may be created by the business module, for example, in one example, the business module may create the canvas in response to a screen-dropping operation after the user triggers the screen-dropping operation. In an example, the shared device may include a control for triggering the screen-projecting operation, and the user may trigger the screen-projecting operation through the control.
In one example, the business module can set information for the canvas when the canvas is created. The information of the canvas includes, but is not limited to, a display position of the canvas and/or a size of the canvas. For example, the business module can set information for a canvas to default canvas information when the canvas is created.
In yet another example, consider that the position and/or size of the screen flow data display may change during the course of a screen shot. For example, the user changes the display position and size of the screen projection window on the screen of the screen projection device. Accordingly, the intermediary module may monitor the location and/or size of the screen stream data display, and upon a change in the location and/or size of the screen stream data display, may generate a canvas adjustment notification message to the business module, which may include the location and size of the changed screen stream data display in one example. Correspondingly, after the service module receives the canvas adjustment notification message, the service module may set the information of the canvas based on the position and size carried in the canvas adjustment notification message.
In one example, the intermediate module may obtain information of a canvas corresponding to the screen flow data if the screen projection device supports high definition rendering. The screen projection device supports high-definition rendering, and may support a Graphics Processing Unit (GPU) that is not suitable for the operating system to perform rendering, but may directly use a hardware driver module in the operating system to perform rendering. If the screen projection device supports high-definition rendering, S102 and the following steps may be performed. If the screen projection device does not support high definition rendering, the service module may render the decoded data on a screen of the screen projection device based on the information of the canvas and the decoded data.
S103: the intermediate module transmits the information of the canvas to the operating system, and the operating system renders the decoding data on the screen of the screen projection device based on the information of the canvas and the decoding data.
After the intermediate module obtains the information of the canvas, the intermediate module may transfer the information of the canvas to the operating system, and after the operating system obtains the information of the canvas, the intermediate module may render the decoded data on the screen of the screen projection device based on the information of the canvas and decoded data obtained by decoding screen stream data. In one example, the operating system may render the decoded data on a screen of the screen projection device using a hardware driver module of the operating system.
In the embodiment of the present application, when the operating system renders the decoded data on the screen, the resolution of the picture rendered on the screen by the operating system is affected by the screen resolution and the resolution of the screen stream data. The resolution of the picture rendered on the screen by the operating system cannot be higher than the resolution of the screen. When the screen resolution is not lower than the resolution of the screen stream, the operating system renders the decoded data on the screen, and the resolution of the rendered picture is the same as the resolution of the screen stream. When the screen resolution is lower than that of the screen stream, the operating system renders the decoded data on the screen, and the resolution of the rendered pictures is the same as that of the screen.
Therefore, by the aid of the screen projection equipment, definition of content displayed on the screen of the screen projection equipment can be improved. Especially, in the case that the screen resolution is not lower than the resolution of the screen stream, when the operating system renders the decoded data on the screen, the resolution of the rendered pictures can reach the resolution of the screen stream.
In one example, after the screen stream data rendering is finished, the operating system may send a first notification message to the intermediate module, the first notification message indicating that the screen stream data rendering is finished. After receiving the first notification message, the intermediate module may generate a second notification message, and send the second notification message to the service module, where the second notification message is used to instruct the service module to destroy the canvas. Accordingly, the service module may destroy the canvas after receiving the second notification message. In this way, the service module can destroy the canvas after receiving the second notification message (after the rendering of the screen stream data is finished), so as to avoid the situation that the operating system still uses the canvas for picture rendering after the service module destroys the canvas.
The embodiment of the application provides a screen projection method, which can be executed by the service module. Referring to fig. 2, the figure is a schematic flow chart of another screen projection method provided in the embodiment of the present application. The method shown in fig. 2 may be applied to a service module, and may include, for example, the following S201-S202.
S201: and a service module of the screen projection equipment responds to a screen projection operation triggered by a user and creates a canvas, wherein the service module is a module related to the screen projection service.
S202: and the service module transmits the information of the canvas to an operating system through an intermediate module, and the operating system renders the decoded data on a screen of the screen projection equipment based on the information of the canvas and decoded data obtained by decoding screen stream data.
In one example, the information of the canvas is set by the business module when the canvas is created.
In one example, the business module sets the information of the canvas by:
the service module monitors the position and/or size of the screen stream data display through the intermediate module;
when the position and/or size of the screen stream data display is changed, the service module receives a canvas adjustment notification message sent by the intermediate module, wherein the canvas adjustment notification message carries the changed position and size of the screen stream data display;
and the service module sets the information of the canvas based on the position and the size of the changed screen flow data display carried in the canvas adjustment notification message.
With respect to the screen projection method shown in fig. 2, reference may be made to the relevant description of the screen projection method shown in fig. 1, and a repeated description will not be made here.
The screen projection method shown in fig. 1 and the screen projection method shown in fig. 2 may be combined or referred to each other without conflict.
Next, from the perspective of signaling interaction, the scheme of the embodiment of the present application is introduced.
Referring to fig. 3, the signaling interaction diagram of a screen projection method according to an embodiment of the present application is shown. The method shown in fig. 3, for example, may include S301-S305 as follows.
S301: the business module creates a canvas in response to a user-triggered screen-in operation.
S302: the business module sends the information of the canvas to the intermediate module.
S303: the intermediate module sends the information of the canvas to the operating system.
S304: the operating system obtains the screen stream data and decodes the screen stream data to obtain decoded data.
S305: and rendering the decoding data on the screen of the screen projection device by an operating system based on the information of the canvas and the decoding data.
It should be noted that S304 may be executed between S301 and S305, and the specific execution sequence of S304 is not limited to the sequence shown in fig. 3.
With regard to the specific implementation of the method shown in fig. 3, reference may be made to the relevant description above with respect to fig. 1 and 2, and a repeated description is not made here.
Exemplary device
Based on the method provided by the above embodiment, the embodiment of the present application further provides an apparatus, which is described below with reference to the accompanying drawings.
Referring to fig. 4, the figure is a schematic structural diagram of a screen projection device provided in an embodiment of the present application. The screen projection device 400 shown in fig. 4 may be applied to a middle module of a screen projection apparatus. The apparatus 400 may specifically include, for example: decoding unit 401, acquisition unit 402, and first transmission unit 403.
A decoding unit 401, configured to decode screen stream data by using an operating system of the screen projection device to obtain decoded data;
an obtaining unit 402, configured to obtain information of a canvas corresponding to the screen stream data;
a first sending unit 403, configured to transfer the information of the canvas to the operating system, and render, by the operating system, the decoded data on the screen of the screen projection device based on the information of the canvas and the decoded data.
Optionally, the obtaining unit 402 is configured to:
acquiring information of the canvas sent by a service module of the screen projection equipment, wherein the service module is a module related to screen projection service, and the canvas is created by the service module in response to screen projection operation triggered by a user.
Optionally, the information of the canvas is set by the business module when the canvas is created.
Optionally, the information of the canvas is set by the service module when receiving a canvas adjustment notification message sent by the intermediate module, where the intermediate module sends the canvas adjustment notification message to the service module when the position and/or size of the screen stream data display is changed, and the canvas adjustment notification message carries the changed position and size of the screen stream data display.
Optionally, the apparatus further comprises:
the receiving unit is used for receiving a first notification message sent by the operating system, wherein the first notification message is used for indicating the rendering end of the screen stream data;
a second sending unit, configured to send a second notification message to the service module based on the first notification message, where the second notification message is used to notify the service module to destroy the canvas.
Optionally, the obtaining unit 402 is configured to:
and under the condition that the screen projection equipment is determined to support high-definition rendering, acquiring information of a canvas corresponding to the screen flow data, wherein the screen projection equipment supports high-definition rendering and is used for indicating that the screen projection equipment supports rendering by directly using a hardware driving module in the operating system without using a Graphics Processing Unit (GPU) of the operating system.
Since the apparatus 400 is a device corresponding to the screen projection method executed by the middle module in the above method embodiment, and the specific implementation of each unit of the apparatus 400 is the same as that in the above method embodiment, reference may be made to the relevant description part of the above method embodiment for the specific implementation of each unit of the apparatus 400, and details are not repeated here.
The embodiment of the present application further provides a screen projection device, and refer to fig. 5, which is a schematic structural diagram of another screen projection device provided in the embodiment of the present application. The screen projection device 500 shown in fig. 5 can be applied to a service module of a screen projection device. The apparatus 500 may specifically include, for example: a creating unit 501 and a sending unit 502.
A creating unit 501, configured to create a canvas in response to a screen-casting operation triggered by a user, where the service module is a module related to a screen-casting service;
a sending unit 502, configured to transmit the information of the canvas to an operating system through an intermediate module, and render, by the operating system, decoded data obtained by decoding screen stream data based on the information of the canvas, the decoded data on a screen of the screen projection device.
Optionally, the information of the canvas is set by the business module when creating the canvas.
Optionally, the service module sets the information of the canvas in the following manner:
the service module monitors the position and/or size of the screen stream data display through the intermediate module;
when the position and/or size of the screen stream data display is changed, the service module receives a canvas adjustment notification message sent by the intermediate module, wherein the canvas adjustment notification message carries the changed position and size of the screen stream data display;
and the service module sets the information of the canvas based on the position and the size of the changed screen flow data display carried in the canvas adjustment notification message.
Since the apparatus 500 is a device corresponding to the screen projection method executed by the service module provided in the above method embodiment, and the specific implementation of each unit of the apparatus 500 is the same concept as the above method embodiment, reference may be made to the relevant description part of the above method embodiment for the specific implementation of each unit of the apparatus 500, and details are not repeated here.
An embodiment of the present application provides an apparatus, which includes a processor and a memory;
the processor is configured to execute instructions stored in the memory to cause the apparatus to perform the screen projection method of any of the above method embodiments.
The embodiment of the application provides a computer-readable storage medium, which comprises instructions for instructing a device to execute the screen projection method in any one of the above method embodiments.
The embodiment of the application provides a computer program product, which when running on a computer, causes the computer to execute the screen projection method of any one of the above method embodiments.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice in the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims (13)

1. A method of screen projection, the method comprising:
an intermediate module of the screen projection equipment decodes screen stream data by using an operating system of the screen projection equipment to obtain decoded data;
the intermediate module acquires information of a canvas corresponding to the screen flow data;
the intermediate module transmits the information of the canvas to the operating system, and the operating system renders the decoding data on the screen of the screen projection device based on the information of the canvas and the decoding data.
2. The method of claim 1, wherein the intermediate module obtains information of a canvas corresponding to the screen flow data, and comprises:
the intermediate module acquires information of the canvas sent by a service module of the screen projection equipment, wherein the service module is a module related to screen projection service, and the canvas is created by the service module in response to screen projection operation triggered by a user.
3. The method of claim 2, wherein the information about the canvas is set by the business module when the canvas is created.
4. The method according to claim 2, wherein the information of the canvas is set by the business module when receiving a canvas adjustment notification message sent by the intermediate module, wherein the intermediate module sends the canvas adjustment notification message to the business module when the position and/or size of the screen flow data display changes, and the canvas adjustment notification message carries the changed position and size of the screen flow data display.
5. The method of claim 1, further comprising:
the intermediate module receives a first notification message sent by the operating system, wherein the first notification message is used for indicating the rendering end of the screen stream data;
the intermediate module sends a second notification message to the service module based on the first notification message, wherein the second notification message is used for notifying the service module to destroy the canvas.
6. The method of claim 1, wherein the intermediate module obtains information of a canvas corresponding to the screen flow data, and comprises:
the intermediate module acquires information of a canvas corresponding to the screen flow data under the condition that the screen projection equipment supports high-definition rendering, wherein the screen projection equipment supports high-definition rendering and is used for indicating that the screen projection equipment supports rendering by directly using a hardware driving module in the operating system without using a Graphics Processing Unit (GPU) of the operating system.
7. A method of screen projection, the method comprising:
a service module of screen projection equipment responds to screen projection operation triggered by a user and creates a canvas, wherein the service module is a module related to screen projection service;
and the service module transmits the information of the canvas to an operating system through an intermediate module, and the operating system renders the decoded data on a screen of the screen projection equipment based on the information of the canvas and decoded data obtained by decoding screen stream data.
8. The method of claim 7, wherein the information about the canvas is set by the business module when the canvas is created.
9. The method of claim 7, wherein the business module sets the information of the canvas by:
the service module monitors the position and/or size of the screen flow data display through the intermediate module;
when the position and/or size of the screen stream data display is changed, the service module receives a canvas adjustment notification message sent by the intermediate module, wherein the canvas adjustment notification message carries the changed position and size of the screen stream data display;
and the service module sets the information of the canvas based on the position and the size of the changed screen flow data display carried in the canvas adjustment notification message.
10. A screen projection device is applied to a middle module of screen projection equipment, and the screen projection device comprises:
the decoding unit is used for decoding screen stream data by using an operating system of the screen projection equipment to obtain decoded data;
an acquisition unit configured to acquire information of a canvas corresponding to the screen stream data;
and the first sending unit is used for transmitting the information of the canvas to the operating system, and rendering the decoded data on the screen of the screen projection equipment by the operating system based on the information of the canvas and the decoded data.
11. A screen projection device is characterized in that the screen projection device is applied to a business module of screen projection equipment, and the screen projection device comprises:
the system comprises a creating unit, a display unit and a service module, wherein the creating unit is used for responding to screen projection operation triggered by a user and creating a canvas, and the service module is a module related to screen projection service;
and the sending unit is used for transmitting the information of the canvas to an operating system through an intermediate module, and the operating system renders the decoded data on the screen of the screen projection equipment based on the information of the canvas and the decoded data obtained by decoding screen stream data.
12. An apparatus, comprising a processor and a memory;
the processor is to execute instructions stored in the memory to cause the device to perform the method of any of claims 1 to 9.
13. A computer-readable storage medium comprising instructions that direct a device to perform the method of any of claims 1-9.
CN202210857837.2A 2022-07-20 2022-07-20 Screen projection method and device Active CN115209117B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210857837.2A CN115209117B (en) 2022-07-20 2022-07-20 Screen projection method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210857837.2A CN115209117B (en) 2022-07-20 2022-07-20 Screen projection method and device

Publications (2)

Publication Number Publication Date
CN115209117A true CN115209117A (en) 2022-10-18
CN115209117B CN115209117B (en) 2024-06-18

Family

ID=83581552

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210857837.2A Active CN115209117B (en) 2022-07-20 2022-07-20 Screen projection method and device

Country Status (1)

Country Link
CN (1) CN115209117B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102801941A (en) * 2012-09-04 2012-11-28 山东大学 Embedded type wireless projection access device
US20140362096A1 (en) * 2013-06-07 2014-12-11 Sony Computer Entertainment Inc. Display controller, screen transfer device, and screen transfer method
CN105096373A (en) * 2015-06-30 2015-11-25 华为技术有限公司 Media content rendering method, user device and rendering system
CN111402349A (en) * 2019-01-03 2020-07-10 百度在线网络技术（北京）有限公司 Rendering method, rendering device and rendering engine
CN112672147A (en) * 2020-12-15 2021-04-16 深圳乐播科技有限公司 Decoding method, device and system based on screen projection
CN113596571A (en) * 2021-07-27 2021-11-02 广州方硅信息技术有限公司 Screen sharing method, device, system, storage medium and computer equipment
CN114510191A (en) * 2022-02-16 2022-05-17 北京字跳网络技术有限公司 Screen projection method and device
CN114730326A (en) * 2019-11-08 2022-07-08 微软技术许可有限责任公司 Selective electronic content projection

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102801941A (en) * 2012-09-04 2012-11-28 山东大学 Embedded type wireless projection access device
US20140362096A1 (en) * 2013-06-07 2014-12-11 Sony Computer Entertainment Inc. Display controller, screen transfer device, and screen transfer method
CN105096373A (en) * 2015-06-30 2015-11-25 华为技术有限公司 Media content rendering method, user device and rendering system
CN111402349A (en) * 2019-01-03 2020-07-10 百度在线网络技术（北京）有限公司 Rendering method, rendering device and rendering engine
CN114730326A (en) * 2019-11-08 2022-07-08 微软技术许可有限责任公司 Selective electronic content projection
CN112672147A (en) * 2020-12-15 2021-04-16 深圳乐播科技有限公司 Decoding method, device and system based on screen projection
CN113596571A (en) * 2021-07-27 2021-11-02 广州方硅信息技术有限公司 Screen sharing method, device, system, storage medium and computer equipment
CN114510191A (en) * 2022-02-16 2022-05-17 北京字跳网络技术有限公司 Screen projection method and device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
S. VIJAY ANAND; S.P SUMAN KUMAR: ""Design and implementation of DLNA enabled NEXT GEN Digital Picture Frame (NGDPF)"", 《2008 2ND INTERNATIONAL CONFERENCE ON INTERNET MULTIMEDIA SERVICES ARCHITECTURE AND APPLICATIONS》, 19 January 2009 (2009-01-19) *
梁志坚: ""面向4K/8K超分发的内容保护需求分析"", 《广播电视信息》, no. 12, 31 December 2021 (2021-12-31) *

Also Published As

Publication number Publication date
CN115209117B (en) 2024-06-18

Similar Documents

Publication Publication Date Title
CN111432070B (en) Application screen projection control method, device, equipment and medium
US9645784B2 (en) Screen splicing system and video data stream processing method
CN110324671B (en) Webpage video playing method and device, electronic equipment and storage medium
CN107027068B (en) Rendering method, decoding method, and method and device for playing multimedia data stream
CN109302637B (en) Image processing method, image processing device and electronic equipment
US10924782B2 (en) Method of providing streaming service based on image segmentation and electronic device supporting the same
WO2014141425A1 (en) Video display system, source device, sink device, and video display method
CN111694625B (en) Method and equipment for projecting screen from car box to car machine
CN110457624A (en) Video generation method, device, server and storage medium
CN112422868A (en) Data processing method, terminal device and server
US20190045109A1 (en) Information processing apparatus, information processing method, and storage medium
CN116450149B (en) Hardware decoding method, device and storage medium
CN116781924A (en) Video decoder chipset
CN115209117B (en) Screen projection method and device
CN113316022B (en) Video playing method, device, equipment, system and storage medium
CN113038137B (en) Video data output method, system, device and computer readable storage medium
CN115297357A (en) Cross-system screen projection method, device and system
US8279207B2 (en) Information processing apparatus, information processing method, and program
CN114567806A (en) Cross-page switching method and system
CN112672147A (en) Decoding method, device and system based on screen projection
CN112199147A (en) Screen recording method and system applied to intelligent terminal and computer readable storage medium
JP2010161670A (en) Image transmission device and image display system
JP2007201816A (en) Video image display system and video image receiver
CN115082583B (en) Image rendering method and device, storage medium and electronic equipment
CN117319592B (en) Cloud desktop camera redirection method, system and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant