CN113918108A - Screen projection method and corresponding electronic equipment and system - Google Patents
Screen projection method and corresponding electronic equipment and system Download PDFInfo
- Publication number
- CN113918108A CN113918108A CN202111204630.7A CN202111204630A CN113918108A CN 113918108 A CN113918108 A CN 113918108A CN 202111204630 A CN202111204630 A CN 202111204630A CN 113918108 A CN113918108 A CN 113918108A
- Authority
- CN
- China
- Prior art keywords
- screen
- input
- projected
- redirected
- electronic device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/08—Protocols for interworking; Protocol conversion
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
A screen projection method and corresponding electronic equipment and system are disclosed. A screen projection method performed by a screen projection electronic device includes: establishing connection with the projected screen electronic equipment; sending a request for inquiring the equipment input capability of the screen-projected electronic equipment to the screen-projected electronic equipment; receiving and storing response information for the request from the screen-projected electronic device; when the user determines to screen the screen-projected electronic equipment, determining the redirected equipment input capacity of the screen-projected electronic equipment supported by the current application on the screen-projected electronic equipment based on the response information, and projecting the screen to the screen-projected electronic equipment; sending a redirected input service request regarding redirected device input capabilities to the projected screen electronic device; receiving redirection input service data for the redirection input service request from the screen-thrown electronic device; configuring an adapter of the screen projection electronic equipment based on the response information; initiating a remote input service of the redirected input service based on the redirected input service data and the configured adapter.
Description
Technical Field
The present disclosure relates generally to the field of screen projection technologies, and in particular, to a screen projection method and a corresponding electronic device and system for input redirection based on device capabilities.
Background
With the development of electronic devices, screen projection functions are becoming more popular, and electronic devices used in our daily lives basically have screen projection functions. In the field of screen projection technologies, currently, technologies for implementing a screen projection function mainly include MiraCast, AirPlay, DNLA, and other screen projection technologies. However, with the spread of screen projection functions, in some scenes (such as video calls, learning education, games) where screen projection is performed, there is often a disadvantage that an input terminal when using the screen projection function is limited to a screen projection-side electronic device for projecting a screen to another electronic device. That is, the input of the existing screen projection technology still needs to depend on the input of the electronic device at the screen projection end, for example, in a screen projection scene of a video call, a user needs to use a camera and a microphone of a mobile phone for screen projection to perform video input; in a game screen projection scene, a user needs to input game operation on a mobile phone for projecting a screen, so that the user cannot directly watch content from a projected screen end, and the content of the projected screen is only watched by a third party; in the learning education screen projection scene, a user needs to use equipment at a screen projection end for operation input and voice input.
The above information is presented merely as background information to aid in understanding the present disclosure. No decisions or assertions have been made regarding whether any of the above can be applied as prior art with respect to the present disclosure.
Disclosure of Invention
Technical problem
In order to solve the above and other disadvantages in the prior art, a screen projection method, and a corresponding electronic device and system are provided.
Technical scheme
A screen projection method performed by a screen projection electronic device according to the present disclosure may include: establishing connection with the projected screen electronic equipment; sending a request for inquiring the equipment input capability of the screen-projected electronic equipment to the screen-projected electronic equipment; receiving and storing response information for the request from the screen-projected electronic device; when the user determines to screen the screen-projected electronic equipment, determining the redirected equipment input capability of the screen-projected electronic equipment supported by the current application on the screen-projected electronic equipment based on the response information, and projecting the screen to the screen-projected electronic equipment; sending a redirected input service request regarding the redirected device input capabilities to a projected screen electronic device; receiving, from the screen-thrown electronic device, redirect input service data for the redirect input service request; configuring an adapter of the screen projection electronic equipment based on the response information; and starting the remote input service of the redirection input service based on the redirection input service data and the configured adapter.
In the screen projection method according to the present disclosure, the response information may include: the device input capabilities, protocol types, and/or protocol addresses of the projected electronic device.
In a screen-casting method according to the present disclosure, the step of determining the redirected device input capability based on the response information may include: and matching the device input capability of the screen projection electronic device used by the current application with the device input capability of the screen projection electronic device included in the response message, and determining the redirected device input capability supported by the current application.
In the screen projection method according to the present disclosure, the step of configuring the adapter based on the response information may include: configuring the adapter based on the protocol type and the protocol address included in the response information.
In the screen projection method according to the present disclosure, the step of starting the remote input service of the redirected input service based on the redirected input service data and the configured adapter may include: adapting, by the adapter, the redirected incoming service data to local data; creating the remote input service based on the local data; and initiating a drive corresponding to the remote input service by using the local data as a local input.
A screen projection method performed by a screen projected electronic device according to the present disclosure may include: establishing connection with screen projection electronic equipment; receiving a request for querying device input capabilities from a screen-casting electronic device; querying the device input capabilities in response to a request to query the device input capabilities; sending response information for the request based on a result of querying device input capabilities; receiving a redirected input service request from the screen-casting electronic device regarding redirected device input capabilities; initiating a redirected input service corresponding to the redirected device input capability in response to the redirected input service request; sending redirection input service data for the redirection input service to the screen-casting electronic device.
In the screen projection method according to the present disclosure, the step of querying the input capability of the device may include: the device input capabilities are queried by retrieving locally supported software and/or hardware for input services.
In the screen projection method according to the present disclosure, the response information may include: the device input capabilities, protocol types, and/or protocol addresses of the projected electronic device.
A screen projection electronic device according to the present disclosure may include: the screen projection frame module is connected with the projected screen electronic equipment; an input redirection management module; an adapter management module; an adapter module; and at least one processor configured to: controlling the input redirection management module to send a request for inquiring the equipment input capability of the screen-projected electronic equipment to the screen-projected electronic equipment; controlling the input redirection management module to receive response information aiming at the request from the screen-projected electronic equipment and store the response information; controlling the screen projection framework module to determine the redirected equipment input capability of the projected electronic equipment supported by the current application on the screen projection electronic equipment based on the response information when the user determines to project the screen to the projected electronic equipment and project the screen to the projected electronic equipment; controlling the screen projection framework module to send a redirected input service request for the redirected device input capability to a projected screen electronic device via the input redirection management module; control the input redirection management module to receive redirection input service data for the redirection input service request from the screen-projected electronic device; controlling the input redirection management module to configure the adapter management module based on the response information to cause the adapter management module to configure an adapter included in an adapter module based on the response information; controlling the adapter module to initiate a remote input service of a redirected input service based on the redirected input service data and the configured adapter.
In the screen projection electronic device according to the present disclosure, the response information may include: the device input capabilities, protocol types, and/or protocol addresses of the projected electronic device.
In a screen-casting electronic device according to the present disclosure, the operation of controlling the screen-casting framework module to determine the redirected device input capability based on the response information may include: and matching the device input capability of the screen projection electronic device used by the current application with the device input capability of the screen projection electronic device included in the response message through the screen projection frame module, and determining the redirected device input capability supported by the current application.
In the screen-casting electronic device according to the present disclosure, the operation of controlling the input redirection management module to configure the adapter management module based on the response information so that the adapter management module configures an adapter included in the adapter module based on the response information may include: controlling the input redirection management module to configure the adapter management module based on a protocol type and a protocol address included in the response information to cause the adapter management module to configure an adapter included in the adapter module based on the protocol type and the protocol address.
In the screen-casting electronic device according to the present disclosure, the operation of controlling the adapter module to start the redirection input service based on the redirection input service data and the configured adapter may include: control the adapter module to adapt the redirected input service data to local data, create the remote input service based on the local data, and initiate a driver corresponding to the remote input service using the local data as local input.
A projected-screen electronic device according to the present disclosure may include: a device capability management module, a service module, and at least one processor, wherein the at least one processor is configured to: controlling the equipment capacity management module to establish connection with the screen projection electronic equipment; controlling the equipment capacity management module to receive a request for inquiring equipment input capacity from the screen projection electronic equipment; controlling the device capability management module to query device input capabilities in response to a request to query device input capabilities; controlling the device capability management module to transmit response information for the request based on a result of querying device input capabilities; controlling the equipment capacity management module to receive a redirected input service request corresponding to redirected equipment input capacity from the screen projection electronic equipment; controlling the device capability management module to initiate a redirected input service corresponding to the redirected device input capability in the service module in response to the redirected input service request; and controlling the equipment capacity management module to send redirection input service data aiming at the redirection input service in the service module to the screen projection electronic equipment.
In a projected screen electronic device according to the present disclosure, the operation of querying the device input capability may include: the device input capabilities are queried by retrieving locally supported software and/or hardware for input services.
In the projected-screen electronic device according to the present disclosure, the response information may include: the device input capabilities, protocol types, and/or protocol addresses of the projected electronic device.
A system for projecting a screen according to the present disclosure may include: any one of the above-mentioned screen projection electronic devices and any one of the above-mentioned screen projected electronic devices.
A computer-readable storage medium according to the present disclosure, when executed by at least one processor, may cause the at least one processor to perform any one of the screen projection methods described above.
Other aspects, advantages, and salient features of the disclosure will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses various embodiments of the disclosure.
Technical effects
According to the specific embodiment disclosed in the specification, the screen projection method, the corresponding electronic device and the system are provided, input redirection is performed based on device capabilities, so that device capability input (video input, voice input, game operation input and the like) of the electronic device at the screen projection end is redirected to the screen projection end, and the input of the electronic device at the screen projection end is converted into the input of the electronic device at the screen projection end. In this way, the screen projection end can receive not only the control information from the screen projection end, but also input information including multimedia information (such as camera input information and microphone input information) and other extensible and multiple formats. The method and the device can be applied to various scenes (such as video call scenes, game scenes and learning and education scenes) needing to use the input capability of the screen projected end. The defect that a user depends on input of the screen projection end when using the screen projection function is effectively overcome, so that the user can only pay attention to the content and input of the electronic equipment of the screen projection end, and the user experience is improved.
Additionally, various features and advantages may be provided which are understood directly or indirectly through the present disclosure.
Drawings
The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, in which:
fig. 1 is a flowchart illustrating exemplary operations of a screen projection method performed by a screen projection electronic device according to an embodiment;
fig. 2 is a flowchart illustrating exemplary operations of a screen projection method performed by a projected screen electronic device according to an embodiment;
fig. 3 is a diagram showing an exemplary configuration of a screen projection electronic apparatus according to an embodiment;
fig. 4 is a diagram showing an exemplary configuration of a screen-projected electronic apparatus according to the embodiment;
fig. 5 is a diagram showing an exemplary configuration of a system including a screen-projecting electronic device and a screen-projected electronic device according to an embodiment;
fig. 6 is a timing diagram illustrating exemplary operations of a screen-projecting method performed by a screen-projecting electronic device and a screen-projected electronic device according to an embodiment;
FIG. 7 is an exemplary diagram illustrating use of a screen projection function in a video call scenario according to an embodiment; and
fig. 8 is an exemplary diagram illustrating use of a screen projection function in a game scene according to an embodiment.
Detailed Description
Hereinafter, various embodiments of the present disclosure may be described with reference to the accompanying drawings. The examples and terms used in relation to the examples are not intended to limit the technology described herein to the particular embodiments, and should be understood to include various modifications, equivalents, and/or alternatives to the embodiments.
Examples of screen-casting/screen-cast electronic devices according to embodiments of the present disclosure may include smart phones, tablet Personal Computers (PCs), mobile phones, projectors, Television Sets (TVs), Digital Versatile Disc (DVD) players, set-top boxes, home automation control panels, media boxes (e.g., Samsung HomeSync)TM、Apple TVTMOr Google TVTM) Game console (e.g., Xbox)TM、PlayStationTMEtc.), electronic photo frame, electronic book reader, desktop PC, laptop computer, netbook computer, Personal Digital Assistant (PDA), portable multimediaAt least one of a player (PMP), MP3 player, camera, or wearable device.
In the present disclosure, the term "module" or "component" may perform at least one function or operation, may be implemented as hardware, software, or a combination of hardware and software, and may be used interchangeably with the terms "unit," logic block, "" component, "and" circuit.
Additionally, various features and advantages may be provided which are understood directly or indirectly through the disclosure.
Fig. 1 is a flowchart illustrating exemplary operations of a screen projection method performed by a screen projection electronic device according to an embodiment.
Referring to fig. 1, in step S101, a connection may be established with a projected electronic device. Specifically, the screen-casting electronic device may discover the screen-cast electronic device through broadcasting and establish a connection with the screen-cast electronic device.
In step S102, a request for querying device input capabilities of the projected electronic device may be sent to the projected electronic device.
The device input capabilities of the projected screen electronic device may include: input capabilities of the external device (e.g., externally accessible camera input capabilities, microphone input capabilities, joystick input capabilities), as well as capabilities of the projected screen electronic device itself (e.g., touch input capabilities, video input capabilities, voice input capabilities, etc. of the projected screen electronic device).
In step S103, response information for the request may be received and stored from the screen-projected electronic device. Specifically, the response information may include: the device input capabilities, protocol types, and/or protocol addresses of the projected electronic device.
In step S104, when the user determines to screen the projected electronic device, the redirected device input capability of the projected electronic device supported by the current application on the projected electronic device may be determined based on the response information and the projected screen may be projected to the projected electronic device.
In particular, when the user determines to screen-up the screened electronic device, the device input capabilities of the screened electronic device used by the current application may be matched to the device input capabilities of the screened electronic device included in the response message and the redirected device input capabilities supported by the current application may be determined. In an example, when the current application is a video telephony application, the device capabilities of the screen projection electronic device used by the current application may be, for example, camera input capabilities, microphone input capabilities, and speaker output capabilities. In an example, when the current application is a gaming application, the device capabilities of the screen projection electronic device used by the current application may be, for example, a handle input capability and a speaker output capability.
The redirect operation may be an operation that diverts various network requests to other locations, where the redirect input operation may be an operation that diverts/maps various input operations to the projected screen electronic device.
The screen-projecting electronic device may project a screen onto the projected screen electronic device using a screen-projecting protocol, wherein the screen-projecting protocol may be various types of common screen-projecting protocols, such as Miracast, Airplay, DNLA, and the like.
When a screen is projected onto the projected-screen electronic device, the screen-projection frame module may query the user whether to use the determined re-oriented device input capabilities. In particular, the screen-casting electronic device may provide a user with a selection of redirected device input capabilities to determine, by the user, one or more redirected device input capabilities of the screen-cast electronic device to use.
In step S105, a redirected input service request for redirected device input capabilities may be sent to the projected electronic device.
In step S106, redirect input service data for the redirect input service request may be received from the screened electronic device. Specifically, redirecting the incoming service data may include: real-time streaming protocol service (RTSP) data and/or Transmission Control Protocol (TCP) -based full-duplex communication protocol service (Web Socket) data.
In step S107, an adapter of the screen projection electronic device may be configured based on the response information. In particular, the adapter may be configured based on the protocol type and protocol address included in the response information.
In step S108, a remote input service of the redirected input service may be initiated based on the redirected input service data and the configured adapter. In particular, the redirected input service data may be adapted to local data by an adapter, a remote input service may be created based on the local data, and a driver corresponding to the remote input service may be launched by using the local data as a local input. Here, the remote input service may be an input service regarding device input capabilities of the electronic device being screened.
Fig. 2 is a flowchart illustrating exemplary operations of a screen projection method performed by a projected screen electronic device according to an embodiment.
Referring to fig. 2, in step S201, a connection may be established with the screen-projecting electronic device.
In step S202, a request to query device input capabilities may be received from a screen-casting electronic device.
In step S203, the device input capabilities may be queried in response to a request to query the device input capabilities. In particular, device input capabilities may be queried by retrieving locally supported software and/or hardware for input services.
In step S204, response information for the request may be transmitted based on the result of querying the device input capabilities. Specifically, the response information may include: the device input capabilities, protocol types, and/or protocol addresses of the electronic device being screened, etc.
In step S205, a redirected input service request for redirected device input capabilities may be received from the screen-casting electronic device.
In step S206, a redirect input service corresponding to the redirected device input capability may be initiated in response to the redirect input service request. The redirect input service may include, for example, an RTSP service generated for a camera and a microphone and/or a Web Socket service generated for a game pad, etc.
In step S207, the redirected input service data for the redirected input service may be sent to the screen-casting electronic device. Specifically, the redirection input service data may include RTSP service data and/or Web Socket service data, etc.
Fig. 3 is a diagram showing an exemplary configuration of the screen-projecting electronic apparatus 100 according to the embodiment.
Referring to fig. 3, a screen projection electronic device 100 according to an embodiment may include a screen projection framework module 101, an input redirection management module 102, an adapter management module 103, an adapter module 104, and at least one processor (not shown).
The screen frame module 101 according to embodiments may be configured to: establishing connection with the projected screen electronic equipment; determining whether to perform screen projection by a user; and matching the device input capabilities of the screen-projected electronic device used by the current application with the device input capabilities of the screen-projected electronic device to determine the redirected device input capabilities.
The input redirection management module 102 according to embodiments may be configured to: sending a request, data, information and the like (for example, a connection request, a request for inquiring the input capability of the equipment, a request for redirecting an input service and the like) sent by the screen projection framework module to the screen projected electronic equipment; sending responses, data, information, and the like (e.g., a response to a connection, a response to a request to query device input capabilities, redirect input service data, and the like) received from the screen-projected electronic device to the screen-projection framework module 101, the adapter management module 103, or the adapter module 104 of the screen-projected electronic device 100; and configuring the adapter management module 103 based on response information from the projected electronic device, and the like. In an embodiment, configuring the adapter management module 103 based on the response information from the projected electronic device may be configuring the adapter management module 103 based on the protocol type and/or address included in the response information to obtain the configuration parameters.
Herein, "response" and "response information" may have the same or similar meanings. According to an embodiment, the response information may include: the device input capabilities, protocol types, and/or protocol addresses of the electronic device being screened, etc.
The adapter management module 103 according to embodiments may be configured to: after being configured by the input redirection management module 102, the adapters included in the adapter module 104 are configured based on the configuration parameters received from the input redirection management module 102. In an embodiment, configuring the adapters included in the adapter module 104 based on the configuration parameters may include selecting an adapter to use among a plurality of adapters included in the adapter module based on the configuration parameters (e.g., protocol type and/or address).
The adapter module 104 according to embodiments may be configured to: the redirected input service data is adapted to local data to simulate local input and initiate a corresponding driver. In particular, the adapter included in the adapter module 104 may adapt various types of redirected input service data to local data, may create a remote input service based on the local data, and may launch a driver corresponding to the remote input service by using the local data as a local input. For example, when the received redirected input service data is RTSP data, the adapter may adapt the RTSP data to local data, create, for example, a camera remote input service and/or a microphone remote input service based on the local data, and use the local data as local input to enable a camera driver and/or a microphone driver corresponding to the camera remote input service and/or the microphone remote input service. For example, when the received redirected input service data is RTSP data, the adapter may adapt the RTSP data to local data and create, for example, a camera remote input service and/or a microphone remote input service based on the local data, and use the local data as a local input to enable a camera driver and/or a microphone driver corresponding to the camera remote input service and/or the microphone remote input service.
The process of the screen projection by the screen projection electronic apparatus 100 will be described below.
In particular, the screen-casting frame module 101 may discover the screened electronic device through broadcasting and establish a connection with the screened electronic device. According to an embodiment, the at least one process may be configured for: the control input redirection management module 102 sends a request for inquiring the device input capability of the projected electronic device to the projected electronic device; the control input redirection management module 102 receives response information for the request from the screen-projected electronic device and stores the response information; when the user determines to screen the projected electronic device, the screen projection framework module 101 is controlled to determine the redirected device input capability of the projected electronic device supported by the current application on the projected electronic device based on the response information and project the screen to the projected electronic device; the control screen projection framework module 101 sends a redirection input service request about the redirected device input capability to the projected screen electronic device via the input redirection management module 102; the control input redirection management module 102 receives redirection input service data for the redirection input service request from the screen-projected electronic device; the control input redirection management module 102 configures the adapter management module 103 based on the response information to cause the adapter management module 103 to configure the adapter included in the adapter module 104 based on the response information; the control adapter module 104 initiates a remote input service of the redirected input service based on the redirected input service data and the configured adapter.
According to an embodiment, the operation of controlling the screen projection framework module 101 to determine the redirected device input capability based on the response information may include: the redirected device input capabilities supported by the current application are determined by the screen projection framework module 101 matching the device input capabilities of the screen projection electronic device used by the current application with the device input capabilities of the screen projected electronic device included in the response message.
According to an embodiment, controlling the input redirection management module 102 to configure the adapter management module 103 based on the response information such that the adapter management module 103 configures the adapter included in the adapter module 104 based on the response information may include: the control input redirection management module 102 configures the adapter management module 103 based on the protocol type and the protocol address included in the response information to cause the adapter management module 103 to configure the adapter included in the adapter module 104 based on the protocol type and the protocol address.
According to an embodiment, the operation of the control adapter module 104 to initiate the redirect input service based on the redirect input service data and the configured adapter may include: the control adapter module 104 adapts the redirected input service data to local data, creates a remote input service based on the local data, and initiates a driver corresponding to the remote input service by using the local data as local input.
According to an embodiment, the redirection input service may include, for example, an RTSP service generated for a camera and a microphone, and/or a Web Socket service generated for a game pad, and the like. The redirection input service data may include RTSP service data and/or Web Socket service data.
Fig. 4 is a diagram showing an exemplary configuration of the screen-projected electronic apparatus 200 according to the embodiment.
Referring to fig. 4, the projected electronic device 200 according to an embodiment may include a device capability management module 201, a service module 202, and at least one processor (not shown).
According to an embodiment, the device capability management module 201 may be configured to establish a connection with a screen-projection electronic device, receive a request from the screen-projection electronic device to query device input capabilities, query the device input capabilities in response to the request to query device input capabilities, send response information for the request based on a result of querying the device input capabilities, and receive a redirected input service request corresponding to the redirected device input capabilities from the screen-projection electronic device.
According to an embodiment, the service module 202 may be configured to send redirected input service data for the redirected input service to the screen projection electronic device in response to the redirected input service request initiating a redirected input service corresponding to the redirected device input capability.
The process of the screen projection by the screen-projected electronic apparatus 200 will be described below.
According to an embodiment, the at least one processor may be configured to: the control equipment capacity management module 201 is connected with the screen projection electronic equipment; the control device capability management module 201 receives a request for inquiring the input capability of the device from the screen projection electronic device; the control device capability management module 201 inquires the device input capability in response to the request for inquiring the device input capability; the control device capability management module 201 transmits response information for the request based on the result of querying the device input capability; the control device capability management module 201 receives a redirection input service request corresponding to the redirected device input capability from the screen-casting electronic device; the control device capability management module 201 responds to the redirection input service request to initiate a redirection input service corresponding to the redirection device input capability in the service module; the controlling device capability management module 201 sends the redirected input service data for the redirected input service in the service module 202 to the screen-casting electronic device.
According to an embodiment, querying device input capabilities may include: the device input capabilities are queried by retrieving locally supported software and/or hardware for input services.
According to an embodiment, the response information may include: the device input capabilities, protocol types, and/or protocol addresses of the electronic device being screened, etc.
According to an embodiment, the redirection input service data may include RTSP service data and/or Web Socket service data.
Fig. 5 is a diagram showing an exemplary configuration of a system for screen projection including a screen projecting electronic device and a screen-projected electronic device according to an embodiment.
Referring to fig. 5, a system 1000 for screen projection according to an embodiment may include a screen projection electronic device 100 and a screen projected electronic device 200. Since the screen-projecting electronic device 100 and the screen-projected electronic device 200 included in the system 1000 have configurations similar to the exemplary configurations of the screen-projecting electronic device 100 and the screen-projected electronic device 200 described with reference to fig. 3 and 4, respectively, detailed description thereof will not be given.
Fig. 6 is a timing diagram illustrating exemplary operations of a screen-projecting method performed by a screen-projecting electronic device and a screen-projected electronic device according to an embodiment.
Exemplary operations of the screen projecting method performed by the screen projecting electronic device and the screen-projected electronic device are described with reference to fig. 6.
When a user runs an application on the screen-casting electronic device, the screen-casting frame module of the screen-casting electronic device according to embodiments may discover the screen-cast electronic device (e.g., by broadcasting) and may send a connection message to the device capability management module of the screen-cast electronic device via the input redirection management module, and the screen-cast electronic device sends a response of the connection to the screen-casting electronic device after receiving the connection message.
Then, the screen-projecting frame module of the screen-projecting electronic device may send a request to a device capability management module of the screen-projected electronic device via the input redirection management module to query device input capabilities of the screen-projected electronic device based on the response of the connection of the screen-projected electronic device. The device capability management module of the screen-projected electronic device queries the device input capability in response to a request for querying the device input capability, and transmits response information for the request based on a result of querying the device input capability.
When the user determines to screen the projected-screen electronic device, the screen-projecting frame module may determine, based on the response information, a redirected device input capability of the projected-screen electronic device that is supported by a current application on the projected-screen electronic device and project a screen to the projected-screen electronic device.
When a screen is projected onto the projected-screen electronic device, the screen-projection frame module may query the user whether to use the determined re-oriented device input capabilities. When the user determines to use the redirected device input capabilities, the screen projection framework module may send a redirected input service request for the redirected device input capabilities to a device capability management module of the projected electronic device via the input redirection management module.
The device capability management module of the screen-projected electronic device may initiate a redirection input service in the service module corresponding to the redirected device input capability in response to the redirection input service request and send redirection input service data for the redirection input service in the service module to the screen-projected electronic device.
An input redirection management module of the screen-casting electronic device may configure the adapter management module based on response information to the request to query the device input capabilities to cause the adapter management module to configure an adapter included in the adapter module based on the response information.
When the configuration of the adapter is complete, the screen-projection-side electronic device may determine to switch to the remote input service.
The adapter module may adapt the redirected input service data to local data, create a remote input service of the redirected input service based on the local data, and launch a driver corresponding to the remote input service using the local data as local input.
Fig. 7 is an exemplary diagram illustrating the use of a screen projection function in a video call scenario according to an embodiment.
According to an embodiment, referring to fig. 7, when a user uses a video call application on a screen-projecting electronic device (e.g., a mobile phone in fig. 7), the screen-projecting function may be selected to be used during a video call, the screen-projecting electronic device projects an interface of the screen-projecting electronic device to a screen-projected electronic device (e.g., a television in fig. 7), a redirect input service (e.g., a camera input service and a microphone input service) function for determining whether to use the screen-projected electronic device is provided to the user through a screen-projecting frame module, and in response to the user determining to use the redirect input service function, the user may conduct a video call by using the input service function of the screen-projected electronic device without using the input service function of the screen-projecting electronic device.
Fig. 8 is an exemplary diagram illustrating use of a screen projection function in a game scene according to an embodiment.
According to an embodiment, referring to fig. 8, when a user uses a game application on a screen-casting electronic device (e.g., a mobile phone in fig. 7), it is possible to select to use a screen-casting function during a game, the screen-casting electronic device casts an interface of the screen-casting electronic device onto a screen-cast electronic device (e.g., a television in fig. 7), a redirect input service (e.g., a handle input service) function for determining whether to use the screen-cast electronic device is provided to the user through a screen-casting frame module, and in response to the user determining to use the redirect input service function, the user can play the game by using the input service function of the screen-cast electronic device without using the input service function of the screen-casting electronic device.
Instructions in a computer-readable storage medium according to an embodiment, when executed by at least one processor, may cause the at least one processor to perform any of the screen projection methods described above.
Some of the above-described embodiments of the present disclosure may be implemented in hardware, firmware, or by executing software or computer code that may be stored in a recording medium such as a CD ROM, a Digital Versatile Disk (DVD), a magnetic tape, a RAM, a floppy disk, a hard disk, or a magneto-optical disk, or by executing computer code that is initially stored on a remote recording medium or a non-transitory machine-readable medium and is to be stored on a local recording medium, downloaded via a network, so that the methods described herein may be presented via such software stored on the recording medium using a general-purpose computer or a dedicated processor, or stored in programmable or dedicated hardware such as an ASIC or FPGA. As will be understood in the art, a computer, processor, microprocessor controller, or programmable hardware includes memory components (e.g., RAM, ROM, flash memory, etc.) that can store or receive software or computer code that, when accessed and executed by a computer, processor, or hardware, implements the processing methods described herein.
While the disclosure has been shown and described with reference to various embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the disclosure as defined by the appended claims and their equivalents.
Claims (12)
1. A screen projection method performed by a screen projection electronic device, comprising:
establishing connection with the projected screen electronic equipment;
sending a request for inquiring the equipment input capability of the screen-projected electronic equipment to the screen-projected electronic equipment;
receiving and storing response information for the request from the screen-projected electronic device;
when the user determines to screen the screen-projected electronic equipment, determining the redirected equipment input capability of the screen-projected electronic equipment supported by the current application on the screen-projected electronic equipment based on the response information, and projecting the screen to the screen-projected electronic equipment;
sending a redirected input service request regarding the redirected device input capabilities to a projected screen electronic device;
receiving, from the screen-thrown electronic device, redirect input service data for the redirect input service request;
configuring an adapter of the screen projection electronic equipment based on the response information;
and starting the remote input service of the redirection input service based on the redirection input service data and the configured adapter.
2. The screen projection method according to claim 1, wherein the response information includes: the device input capabilities, protocol types, and/or protocol addresses of the projected electronic device.
3. The screen projection method of claim 1, wherein the step of determining the redirected device input capability based on the response information comprises: and matching the device input capability of the screen projection electronic device used by the current application with the device input capability of the screen projection electronic device included in the response message, and determining the redirected device input capability supported by the current application.
4. The screen projection method of claim 2, wherein the step of configuring the adapter based on the response information comprises: configuring the adapter based on the protocol type and the protocol address included in the response information.
5. The screen projection method of claim 4, wherein the step of initiating a remote input service of the redirected input service based on the redirected input service data and the configured adapter comprises:
adapting, by the adapter, the redirected incoming service data to local data;
creating the remote input service based on the local data; and is
Initiating a drive corresponding to the remote input service by using the local data as a local input.
6. A screen projection method performed by a screen-projected electronic device, comprising:
establishing connection with screen projection electronic equipment;
receiving a request for querying device input capabilities from a screen-casting electronic device;
querying the device input capabilities in response to a request to query the device input capabilities;
sending response information for the request based on a result of querying device input capabilities;
receiving a redirected input service request from the screen-casting electronic device regarding redirected device input capabilities;
initiating a redirected input service corresponding to the redirected device input capability in response to the redirected input service request;
sending redirection input service data for the redirection input service to the screen-casting electronic device.
7. The screen projection method of claim 6, wherein the step of querying device input capabilities comprises: the device input capabilities are queried by retrieving locally supported software and/or hardware for input services.
8. The screen projection method according to claim 6, wherein the response information includes: the device input capabilities, protocol types, and/or protocol addresses of the projected electronic device.
9. A screen-projecting electronic device comprising:
the screen projection frame module is connected with the projected screen electronic equipment;
an input redirection management module;
an adapter management module;
an adapter module; and
at least one processor configured to:
controlling the input redirection management module to send a request for inquiring the equipment input capability of the screen-projected electronic equipment to the screen-projected electronic equipment;
controlling the input redirection management module to receive response information aiming at the request from the screen-projected electronic equipment and store the response information;
controlling the screen projection framework module to determine the redirected equipment input capability of the projected electronic equipment supported by the current application on the screen projection electronic equipment based on the response information when the user determines to project the screen to the projected electronic equipment and project the screen to the projected electronic equipment;
controlling the screen projection framework module to send a redirected input service request for the redirected device input capability to a projected screen electronic device via the input redirection management module;
control the input redirection management module to receive redirection input service data for the redirection input service request from the screen-projected electronic device;
controlling the input redirection management module to configure the adapter management module based on the response information to cause the adapter management module to configure an adapter included in an adapter module based on the response information;
controlling the adapter module to initiate a remote input service of a redirected input service based on the redirected input service data and the configured adapter.
10. A projected-screen electronic device comprising:
a device capability management module, a service module, and at least one processor,
wherein the at least one processor is configured to:
controlling the equipment capacity management module to establish connection with the screen projection electronic equipment;
controlling the equipment capacity management module to receive a request for inquiring equipment input capacity from the screen projection electronic equipment;
controlling the device capability management module to query device input capabilities in response to a request to query device input capabilities;
controlling the device capability management module to transmit response information for the request based on a result of querying device input capabilities;
controlling the equipment capacity management module to receive a redirected input service request corresponding to redirected equipment input capacity from the screen projection electronic equipment;
controlling the device capability management module to initiate a redirected input service corresponding to the redirected device input capability in the service module in response to the redirected input service request;
and controlling the equipment capacity management module to send redirection input service data aiming at the redirection input service in the service module to the screen projection electronic equipment.
11. A system for projecting a screen, comprising: a screen-projected electronic device as recited in claim 9 and a screen-projected electronic device as recited in claim 10.
12. A computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by at least one processor, cause the at least one processor to perform the screen projection method of any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111204630.7A CN113918108A (en) | 2021-10-15 | 2021-10-15 | Screen projection method and corresponding electronic equipment and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111204630.7A CN113918108A (en) | 2021-10-15 | 2021-10-15 | Screen projection method and corresponding electronic equipment and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113918108A true CN113918108A (en) | 2022-01-11 |
Family
ID=79241041
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111204630.7A Pending CN113918108A (en) | 2021-10-15 | 2021-10-15 | Screen projection method and corresponding electronic equipment and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113918108A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115802113A (en) * | 2022-10-27 | 2023-03-14 | 北京奇艺世纪科技有限公司 | Screen projection control method, system and device and computer readable storage medium |
-
2021
- 2021-10-15 CN CN202111204630.7A patent/CN113918108A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115802113A (en) * | 2022-10-27 | 2023-03-14 | 北京奇艺世纪科技有限公司 | Screen projection control method, system and device and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9318152B2 (en) | Super share | |
| US9024995B2 (en) | Video calling using a remote camera device to stream video to a local endpoint host acting as a proxy | |
| WO2019090902A1 (en) | Screen sharing method and apparatus, electronic device, and storage medium | |
| CN106464965B (en) | Method and apparatus for displaying application data in wireless communication system | |
| US8966138B2 (en) | Communication between a host device and an accessory using multiple-endpoint identification | |
| WO2016165584A1 (en) | Communication method and device between terminal | |
| US9749373B2 (en) | System and method for improved content streaming | |
| CN112350981B (en) | Method, device and system for switching communication protocol | |
| EP3276973B1 (en) | Content projection method and mobile terminal | |
| CN111984215A (en) | Multimedia data playing method, terminal and storage medium | |
| CN103139529A (en) | Video call switchover method between session initiation protocol (SIP) server and video call devices | |
| CN105187871A (en) | NFC-based data transmission method for mobile terminal and television terminal and system thereof | |
| CN113630574A (en) | Video call method and terminal equipment | |
| CN112839238B (en) | Screen projection playing method and device and storage medium | |
| WO2017096851A1 (en) | Method, system, and server for pushing video file | |
| CN113741762A (en) | Multimedia playing method, device, electronic equipment and storage medium | |
| CN107040825B (en) | Terminal, television, multi-screen interaction system and screen capture parameter setting method | |
| CN111654450A (en) | Data transmission method and device and storage medium | |
| CN113918108A (en) | Screen projection method and corresponding electronic equipment and system | |
| EP2696591A2 (en) | Video calling using a remote camera device to stream video to a local endpoint host acting as a proxy | |
| EP3160101A1 (en) | Multi-media resource management method, cloud server and electronic device | |
| CN110248347B (en) | Call abnormity detection method, device, equipment and storage medium | |
| CN105392048A (en) | Video delivery control method and system | |
| WO2015169005A1 (en) | Method, system and main sharing end for sharing screen and operation control | |
| KR20110092713A (en) | System and method for offering real time multimedia service |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |