CN117596431A - Cross-equipment control method and system based on wireless screen throwing and intelligent television - Google Patents

Cross-equipment control method and system based on wireless screen throwing and intelligent television Download PDF

Info

Publication number
CN117596431A
CN117596431A CN202311626682.2A CN202311626682A CN117596431A CN 117596431 A CN117596431 A CN 117596431A CN 202311626682 A CN202311626682 A CN 202311626682A CN 117596431 A CN117596431 A CN 117596431A
Authority
CN
China
Prior art keywords
screen
equipment
throwing
current
data stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311626682.2A
Other languages
Chinese (zh)
Inventor
郭斌
周胜杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Konka Electronic Technology Co Ltd
Original Assignee
Shenzhen Konka Electronic Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Konka Electronic Technology Co Ltd filed Critical Shenzhen Konka Electronic Technology Co Ltd
Priority to CN202311626682.2A priority Critical patent/CN117596431A/en
Publication of CN117596431A publication Critical patent/CN117596431A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43078—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen for seamlessly watching content streams when changing device, e.g. when watching the same program sequentially on a TV and then on a tablet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Abstract

The invention discloses a cross-equipment control method and system based on wireless screen projection and an intelligent television, wherein the method comprises the following steps: when receiving a specified screen content viewing instruction of the current equipment, determining target equipment according to the specified screen content viewing instruction; acquiring a target data stream of the current screen of the target equipment, sending the target data stream to the current equipment, and controlling the target data stream to be displayed on the current equipment; and receiving a target data stream operation instruction sent by the current equipment, and synchronously displaying a control interface of the current equipment for operating the target data stream according to the target data stream operation instruction. When receiving a control request instruction of the current equipment to the target equipment, the invention can control the screen content of the target equipment by the current equipment after obtaining the authorization permission of the target equipment, thereby realizing the cross-equipment data transmission and control between the screen equipment.

Description

Cross-equipment control method and system based on wireless screen throwing and intelligent television
Technical Field
The invention relates to the technical field of screen projection, in particular to a cross-equipment control method and system based on wireless screen projection, an intelligent television and a computer storage medium.
Background
With the progress of science and technology, wireless screen throwing can establish data connection with television without connecting wires, is popular in equipment, and mobile phones, computers and televisions with wireless screen throwing are widely popularized at present, and are well applied in the fields of home, office, education and the like.
The traditional scheme is that after a user throws a screen to a television, the television can reversely control the content of the screen, and other devices cannot control the content of the screen. For example: in the process of the user (user a) throwing a screen, another user (user B) wants to control the content of the transmission screen (for example, for the content of the screen throwing, the user B can only tell the user a about which page you turn, which file to play, where to mark, modify, and so on by shouting), and can only transmit the appeal to the user (user a) who throws the screen, and the user (user a) performs control of the control response.
Accordingly, the prior art is still in need of improvement and development.
Disclosure of Invention
The invention mainly aims to provide a cross-equipment control method and system based on wireless screen projection, an intelligent television and a computer readable storage medium, and aims to solve the problem that other equipment cannot control screen projection content when screen projection equipment exists in the prior art.
In order to achieve the above purpose, the present invention provides a cross-device control method based on wireless screen projection, the cross-device control method based on wireless screen projection includes the following steps:
when receiving a specified screen-throwing content viewing instruction of a current device, determining a target device according to the specified screen-throwing content viewing instruction;
acquiring a target data stream of the current screen of the target equipment, sending the target data stream to the current equipment, and controlling the target data stream to be displayed on the current equipment;
and receiving a target data stream operation instruction sent by the current equipment, and synchronously displaying a control interface of the current equipment for operating the target data stream according to the target data stream operation instruction.
Optionally, in the cross-device control method based on wireless screen projection, when receiving a specified screen projection content viewing instruction of a current device, determining a target device according to the specified screen projection content viewing instruction specifically includes:
when receiving a specified screen-throwing content viewing instruction of the current equipment, analyzing the specified screen-throwing content viewing instruction to obtain an analysis result;
and determining target equipment for viewing the screen-throwing content of the current equipment according to the analysis result, and transmitting the appointed screen-throwing content viewing instruction to the target equipment when the target equipment is in a screen-throwing state.
Optionally, the method for controlling the cross-device based on wireless screen projection, wherein the obtaining the target data stream of the current screen projection of the target device, sending the target data stream to the current device, and controlling the target data stream to be displayed on the current device specifically includes:
when a first authorization passing instruction generated by the target equipment according to the specified screen-throwing content viewing instruction is received, acquiring a target data stream of the current screen throwing of the target equipment according to the first authorization passing instruction;
and sending the target data stream to the current equipment, and controlling the target data stream to be displayed on the current equipment.
Optionally, the method for controlling the cross-device based on wireless screen projection, wherein the receiving the target data stream operation instruction sent by the current device and synchronously displaying the control interface of the current device on the target data stream operation according to the target data stream operation instruction specifically includes:
when a target data stream operation instruction sent by the current equipment is received, the target data stream operation instruction is sent to the target equipment for authorization confirmation;
when a second authorization passing instruction sent by the target equipment is received, opening the control authority of the target equipment to the target data stream to the current equipment;
and acquiring a control interface of the current equipment for operating the target data stream based on the control authority, and synchronizing the control interface to the target equipment.
Optionally, the cross-device control method based on wireless screen projection, wherein when receiving a specified screen projection content viewing instruction of a current device, determining a target device according to the specified screen projection content viewing instruction, and then further includes:
when a multi-window screen-throwing instruction of the current equipment is received, acquiring a current data stream of the current equipment according to the multi-window screen-throwing instruction;
decoding the current data stream, creating a new display window according to the decoded current data stream, and jointly performing screen projection display on the new display window and a plurality of display windows of the screen projection equipment.
Optionally, the cross-device control method based on wireless screen projection, wherein when receiving a specified screen projection content viewing instruction of a current device, determining a target device according to the specified screen projection content viewing instruction, and then further includes:
when a screen-throwing viewing instruction of the current equipment is received, acquiring a screen-throwing equipment list of the screen-throwing equipment according to the screen-throwing viewing instruction;
and acquiring the equipment state of the current equipment, and controlling the screen-throwing equipment list to display on the current equipment according to the equipment state.
Optionally, in the cross-device control method based on wireless screen projection, the screen projection device list includes screen projection device information and screen projection window information; the method for obtaining the equipment state of the current equipment and controlling the screen-throwing equipment list to display on the current equipment according to the equipment state specifically comprises the following steps:
when the current equipment is in a vertical screen state, sending the screen throwing equipment information to the current equipment, and controlling the screen throwing equipment information to be displayed on the current equipment;
when the current equipment is in a horizontal screen state and a content transmission request instruction of the current equipment is received, acquiring the screen-throwing window information of the screen-throwing equipment according to the content transmission request instruction;
and sending the screen-throwing window information to the current equipment, and controlling the screen-throwing window information to be displayed on the current equipment.
In addition, in order to achieve the above object, the present invention further provides a cross-device control system based on wireless screen projection, where the cross-device control system based on wireless screen projection includes:
the target equipment confirming module is used for determining target equipment according to the specified screen-throwing content viewing instruction when receiving the specified screen-throwing content viewing instruction of the current equipment;
the target data stream acquisition module is used for acquiring a target data stream of the current screen of the target equipment, sending the target data stream to the current equipment and controlling the target data stream to be displayed on the current equipment;
and the target data flow control module is used for receiving a target data flow operation instruction sent by the current equipment and synchronously displaying a control interface of the current equipment for operating the target data flow according to the target data flow operation instruction.
In addition, in order to achieve the above object, the present invention further provides a smart television, where the smart television includes: the system comprises a memory, a processor and a cross-device control program based on wireless screen projection, wherein the cross-device control program based on wireless screen projection is stored in the memory and can run on the processor, and the steps of the cross-device control method based on wireless screen projection are realized when the cross-device control program based on wireless screen projection is executed by the processor.
In addition, in order to achieve the above object, the present invention further provides a computer readable storage medium, where the computer readable storage medium stores a cross-device control program based on wireless screen projection, where the cross-device control program based on wireless screen projection implements the steps of the cross-device control method based on wireless screen projection as described above when executed by a processor.
When receiving a specified screen content viewing instruction of a current device, determining a target device according to the specified screen content viewing instruction; acquiring a target data stream of the current screen of the target equipment, sending the target data stream to the current equipment, and controlling the target data stream to be displayed on the current equipment; and receiving a target data stream operation instruction sent by the current equipment, and synchronously displaying a control interface of the current equipment for operating the target data stream according to the target data stream operation instruction. According to the invention, when the screen-throwing control request of the current equipment to the target equipment is received, the screen-throwing data stream and the control authority can be selected to be shared to the current equipment according to the authorization result of the target equipment, the control interface of the current equipment to the screen-throwing data stream is obtained in real time, and the control interface is synchronized to the screen-throwing interface of the intelligent television and the display interface of the target equipment, so that the cross-equipment data transmission and control between the screen-throwing equipment are realized.
Drawings
FIG. 1 is a flow chart of a preferred embodiment of a wireless screen-casting based cross-device control method of the present invention;
FIG. 2 is a block diagram of cross-device control of a preferred embodiment of a wireless screen-casting based cross-device control method of the present invention;
FIG. 3 is a flow chart of cross-device control of a preferred embodiment of the wireless screen-casting based cross-device control method of the present invention;
FIG. 4 is a schematic diagram of a video-on-screen television device of a preferred embodiment of a wireless video-on-screen based cross-device control method of the present invention;
FIG. 5 is a schematic diagram of the screen connection and screen control of the user A handset of the preferred embodiment of the wireless screen-based cross-device control method of the invention;
FIG. 6 is a schematic diagram of the screen connection and screen control of a user B handset of a preferred embodiment of a wireless screen-based cross-device control method of the invention;
FIG. 7 is a schematic diagram of multi-window screen projection and cross-screen projection content viewing of a screen-projected device of a preferred embodiment of a wireless screen-projection-based cross-device control method of the present invention;
FIG. 8 is a schematic diagram of a vertical screen view of projected device information for a preferred embodiment of a wireless projected based cross device control method of the present invention;
FIG. 9 is a block diagram of a preferred embodiment of a wireless screen-based cross-device control system of the present invention;
fig. 10 is a block diagram of a preferred embodiment of the smart tv of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more clear and clear, the present invention will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
With the progress of science and technology, wireless screen throwing can establish data connection with television without connecting wires, so that the wireless screen throwing device is popular with users, mobile phones, computers and televisions with wireless screen throwing are widely popularized, and the wireless screen throwing device is well applied to the fields of home, office, education and the like.
Currently, single-machine screen projection (for example, one device projects onto a television) or multi-machine screen projection (for example, a plurality of devices project onto a television and are presented at the same time) wireless screen projection is very popular, but when a single machine or a plurality of machines project, users want to control the content of devices of other users which have projected onto the television, the control of the screen projection state across the devices is difficult, and is a problem to be solved at present.
The traditional scheme is that after a user throws a screen to a television, the television can reversely control the content of the screen, and other devices cannot control the content of the screen. For example: in the process of the user (user a) throwing a screen, another user (user B) wants to control the content of the transmission screen (for example, for the content of the screen throwing, the user B can only tell the user a about which page you turn, which file to play, where to mark, modify, and so on by shouting), and can only transmit the appeal to the user (user a) who throws the screen, and the user (user a) performs control of the control response.
The invention is a cross-equipment control method based on wireless screen-throwing, the invention is that under the condition that the screen-throwing equipment of the user A has already established the screen-throwing connection with the intelligent terminal (such as the intelligent television), other terminals (user B) initiate the screen-throwing request with the television, if the current television has already the screen-throwing equipment (user A) on the screen, the current screen-throwing connection link list of the television is obtained, if the current television has not the screen-throwing equipment on the screen, the screen is automatically thrown; other users (user B) acquire the screen throwing equipment presented by the current television and the presenting content of the screen throwing through the screen throwing link list; the other users (user B) can click to request the screen-throwing content of the designated screen-throwing device (user a) to be transmitted to the own device, and can also control the screen-throwing content (user a) which is already throwing the screen by obtaining the authorized permission of the screen-throwing device.
The cross-device control method based on wireless screen projection according to the preferred embodiment of the invention, as shown in fig. 1, 2 and 3, comprises the following steps:
and step S10, when a specified screen throwing content viewing instruction of the current equipment is received, determining a target equipment according to the specified screen throwing content viewing instruction.
In the embodiment of the invention, the smart television A is connected with the mobile phone A of the user A (namely the target equipment in the screen-cast equipment), the display content of the mobile phone A of the user A is cast to the smart television A, the smart television A receives a viewing instruction of the screen-cast content of the mobile phone B of the user A (namely the current equipment in the invention) which wants to control the mobile phone A of the user B, and the screen-cast content of the user A is requested to be displayed on the mobile phone B for example.
As shown in fig. 4 and fig. 5, the smart tv a is started, a network is started, a screen projection system is started (a screen projection protocol is started), the screen projection protocol of the smart tv acquires a screen projection request of the current smart tv, acquires the number of screen projection connections and equipment information (abbreviated as a screen projection equipment list) established by the current smart tv, the information is broadcast to the network along with the screen projection protocol, and other equipment for the screen projection request analyzes after receiving the broadcast, so as to acquire the number of connection of the current television and corresponding equipment information (for example, if the mobile phone X is connected with the television C at the moment), the television C broadcasts information (equipment name: smart tv C, connection equipment: 1; connection equipment name: mobile phone X; equipment ID: MMX 00012345X).
As shown in fig. 4, the smart tv a sends the device information to the user a, and at this time, the device information of the smart tv a is (device name: smart tv a, connection device: 0, connection device name: null, device ID: null). When the mobile phone of the user A is started, the network is started, and the screen is started (a screen-throwing protocol is started). The user A mobile phone screen-throwing protocol acquires the broadcasting information of the current screen-throwing protocol, analyzes a device list which can be thrown by the user A mobile phone, such as an intelligent television A (without device connection), and analyzes the connection quantity and corresponding device information of the current television screen-throwing protocol as follows: (device name: smart television A, connection device: 0, connection device name: null; device ID: null), and broadcast information of Smart television B (if television Y has multiple connections to throw screen) are exemplified as follows, and corresponding parsing is performed when Mobile phone A obtains broadcast information: 1. (device name: smart television B, connection device: 3; connection device name: mobile phone Y; device ID: MMX 00012345Y); 2. (device name: smart television B, connection device: 3; connection device name: mobile phone Z; device ID: MMX 00012345Z); 3. (device name: smart television B, connection device: 3, connection device name: mobile phone N, device ID: MMX 00012345N).
If the mobile phone of the user a is on the screen, the television a is selected, and the message broadcast by the television a (the television a has no device connection, and the number of device connections is 0) is: (device name: smart television A, connected device: 0, connected device name: empty; device ID: empty)).
As shown in fig. 5, when the smart television a (without device connection) receives a screen-throwing request of the user a, connection is established with the user a according to a screen-throwing protocol of the smart television a, screen-throwing content of the user a is acquired for display, and device information of the smart television a is updated according to a new connection relationship. (after the mobile phone screen-throwing protocol of the user A analyzes the screen-throwing protocol broadcast of the intelligent television A, judging that no other screen-throwing equipment is throwing the screen at present, establishing pairing between the mobile phone screen-throwing protocol of the user A and the screen-throwing protocol of the television A, directly throwing the screen of the content of the mobile phone A of the user to the television A, and presenting the screen-throwing content of the mobile phone of the user A in the screen-throwing system of the intelligent television A).
At this time, the screen-casting protocol broadcast of the intelligent television A changes, and updated broadcast information is: (device name: smart television A, connection device: 1, connection device name: mobile A; device ID: MMX 00012345A) because there is already a Screen connection established with user A's Mobile phone screen.
Specifically, when receiving a specified screen-throwing content viewing instruction of the current equipment, analyzing the specified screen-throwing content viewing instruction to obtain an analysis result; and determining target equipment for viewing the screen-throwing content of the current equipment according to the analysis result, and transmitting the appointed screen-throwing content viewing instruction to the target equipment when the target equipment is in a screen-throwing state. When the target device is not in the screen-throwing state, the display content of the target device cannot be acquired.
As shown in fig. 3, when the smart tv a receives a view screen-throwing request instruction or a request screen-throwing control instruction of a user B (current device), it determines, according to the view screen-throwing request instruction or the request screen-throwing control instruction, that the user B needs to view and control (the user a may be one of a plurality of devices that are already connected to the smart tv a to throw a screen), and the smart tv a may determine, by analyzing the view screen-throwing request instruction or the request screen-throwing control instruction of the user B, the screen-throwing content of the target device that the user B needs to view.
The user B sends a view screen throwing request and request screen throwing control to a screen throwing protocol stack of the intelligent television A (view screen throwing request instruction example, terminal equipment is television A, target equipment is mobile phone A, request content is a screen throwing data stream, request equipment name is mobile phone B and equipment ID is MMX 00012345B), the intelligent television A analyzes the direction of the view screen throwing request instruction (target equipment is mobile phone A), instruction content (request content is screen throwing data stream) and sends the view screen throwing request instruction to the protocol stack of the user A.
As shown in fig. 6, the user B turns on the mobile phone, turns on the network, and starts the screen (starts the screen-casting protocol). The mobile phone screen-throwing protocol of the user B acquires the broadcasting information of the current screen-throwing protocol, analyzes a device list (such as an intelligent television A and an intelligent television B) of which the mobile phone of the user B can throw a screen, and analyzes the screen-throwing protocol broadcasting of the intelligent television A at the moment. The method comprises the steps of obtaining the screen-throwing connection number and corresponding equipment information of the intelligent television A: (device name: smart television A, connection device: 1, connection device name: mobile A; device ID: MMX 00012345A).
As shown in fig. 6, after the screen-throwing protocol of the mobile phone of the user B is analyzed, if the smart television already has the device to throw the screen, the screen-throwing request window displays a selection of viewing the screen throwing or multi-window screen throwing.
Further, when a multi-window screen projection instruction of the current equipment is received, acquiring a current data stream of the current equipment according to the multi-window screen projection instruction; decoding the current data stream, creating a new display window according to the decoded current data stream, and jointly performing screen projection display on the new display window and a plurality of display windows of the screen projection equipment.
As shown in fig. 7, if the user B selects the multi-window button, the mobile phone B screen-throwing protocol sends a screen-throwing request to the screen-throwing protocol of the smart television a (screen-throwing request: screen throwing; window display: multi-window spelling), the screen-throwing protocol of the smart television a parses the request, sends a confirmation command to the screen-throwing protocol of the mobile phone B, and after receiving the confirmation, the screen-throwing protocol of the mobile phone B transmits a screen-throwing data stream to the screen-throwing protocol of the smart television a, and the screen-throwing protocol of the smart television a acquires a data stream for decoding, and the window of the data stream of the screen throwing of the user of the mobile phone a are simultaneously presented in the window of the television a (this is a multi-channel screen-throwing, and simultaneously displayed in the screen-throwing system of the television), such as the screen-throwing contents of the device X, the device Y and the device Z in fig. 7 are simultaneously displayed in the form of a small window on the smart television a).
Further, when a screen projection viewing instruction of the current device is received, a screen projection device list of the screen projected device is obtained according to the screen projection viewing instruction, and the screen projection device list comprises screen projection device information and screen projection window information.
As shown in fig. 4, if the user B selects to view the screen-throwing button, the mobile phone opens an interface of a list of the screen-throwing device (the list is resolved by dynamic broadcasting of the television screen-throwing protocol, and the list updates information of the list of the screen-throwing device according to the dynamic broadcasting of the television screen-throwing protocol). The user B selects a certain screen-throwing device list and can click to view the screen-throwing content and request screen-throwing control.
When the current equipment is in a vertical screen state, the screen throwing equipment information is sent to the current equipment, and the screen throwing equipment information is controlled to be displayed on the current equipment.
When the current equipment is in a horizontal screen state and a content transmission request instruction of the current equipment is received, acquiring the screen-throwing window information of the screen-throwing equipment according to the content transmission request instruction; and sending the screen-throwing window information to the current equipment, and controlling the screen-throwing window information to be displayed on the current equipment.
As shown in fig. 7 and fig. 8, the present invention provides two interfaces for viewing the device list of the screen, one is that only the ID and information of the device list can be viewed in the case of the vertical screen of the mobile phone B, and the other is that the mobile phone screen-throwing protocol sends a content transmission request to the television screen-throwing protocol in the case of the horizontal screen of the mobile phone B, and the screen-throwing content presented by the television end is transmitted to the mobile phone end in a window style at one time (the screen-throwing device is required to allow retransmission, and generally defaults to open and allow retransmission). In both cases, the user may select the device information and the window information, and perform viewing and screen-throwing (at this time, viewing the screen-throwing, and then viewing the data stream of a certain designated window on the mobile phone end in full screen, where the screen-throwing device is required to allow retransmission, and generally defaulting is performed to allow retransmission) and request the screen-throwing control operation.
And step S20, acquiring a target data stream of the current screen of the target equipment, sending the target data stream to the current equipment, and controlling the target data stream to be displayed on the current equipment.
Specifically, when a first authorization passing instruction generated by the target device according to the specified screen-throwing content viewing instruction is received, target data of the current screen throwing of the target device is obtained according to the first authorization passing instruction.
The user A acquires the request to judge whether the current request device is authorized or not, if not, the box is popped up to allow or not, and if the current request device is not allowed, the box is popped up to allow the user A to reconsider the authorization. The flow of the screen-throwing control operation is consistent with the flow, and the instruction content is replaced by the screen-throwing control operation.
And sending the target data stream to the current equipment, and controlling the target data stream to be displayed on the current equipment.
As shown in fig. 3, when receiving an authorization instruction of a user a to view a screen-throwing request or request a screen-throwing control operation, the smart television a obtains a data stream of the user a currently throwing a screen according to the authorization instruction, and sends the data stream of the user a currently throwing a screen to the user B.
After clicking the permission to check the screen throwing request and requesting the screen throwing control operation, the user A returns an instruction to the television A (the terminal equipment is the television A, the target equipment is the mobile phone A, the request content is the screen throwing data stream, the request equipment name is the mobile phone B, the equipment ID is the MMX00012345B, the request result is the permission), and after acquiring the instruction, the intelligent television A analyzes the related instruction and transmits the screen throwing data stream to the mobile phone B.
And step S30, receiving a target data stream operation instruction sent by the current equipment, and synchronously displaying a control interface of the current equipment for operating the target data stream according to the target data stream operation instruction.
And the mobile phone B acquires the mobile phone A data stream transmitted by the intelligent television, and the screen contents of the mobile phone A are checked in the mobile phone B. The flow of the screen-throwing control operation is consistent with the flow, and the instruction content is replaced by the screen-throwing control operation.
Specifically, when a target data stream operation instruction sent by the current equipment is received, the target data stream operation instruction is sent to the target equipment for authorization confirmation; when a second authorization passing instruction sent by the target equipment is received, opening the control authority of the target equipment to the target data stream to the current equipment; and acquiring a control interface of the current equipment for operating the target data stream based on the control authority, and synchronizing the control interface to the target equipment.
As shown in fig. 3, when the smart television a sends the current data stream of the user a to the user B, the smart television a continuously acquires the control interface of the user to the data stream of the user a, performs screen display on the content of the control interface, and simultaneously, synchronously sends the content to the display interface of the user a.
After obtaining the authorization of the screen-throwing control operation of the mobile phone a (the authorization includes the authorization of viewing the screen-throwing content, that is, when the authorization of the screen-throwing control is requested, the user B defaults to obtain the authorization of viewing the screen-throwing request, and the user B can simultaneously view the screen-throwing content and operate the content on the mobile phone B, and can operate the screen-throwing content of the mobile phone a (such as PPT page turning), and the operations are synchronized to the screen-throwing window of the television a and the screen-throwing sending window of the mobile phone a.
The invention relates to a scheme for realizing reverse control by other mobile phone equipment to acquire the content of a screen in a screen-throwing state of a user. (the traditional scheme is that after a user throws a screen to a television, the television can reversely control the content of the screen, and other devices cannot control the content of the screen.) the invention realizes cross-device data transmission and control among the screen throwing devices based on a wireless screen throwing system.
The invention provides a new, quick and efficient method for transmitting and controlling screen throwing data, solves the problem that other users (users B) want to control screen throwing contents and can only transmit the appeal to the screen throwing user (users A) in the process of throwing the screen of the user (users A), and the user (users B) with the appeal can quickly and efficiently request the control authority of the screen throwing contents (users A) through a screen throwing tool after the implementation of the invention, thereby quickly and efficiently realizing the control of the screen throwing contents, and the screen throwing user (users A) can be controlled for the user (users B) requesting the control authority.
Further, as shown in fig. 9, the present invention further provides a cross-device control system based on wireless screen projection based on the above-mentioned cross-device control method based on wireless screen projection, where the cross-device control system based on wireless screen projection includes:
the target device confirmation module 51 is configured to determine, when receiving a specified screen content viewing instruction of a current device, a target device according to the specified screen content viewing instruction;
a target data stream obtaining module 52, configured to obtain a target data stream of the target device that is currently on screen, send the target data stream to the current device, and control the target data stream to be displayed on the current device;
and the target data flow control module 53 is configured to receive a target data flow operation instruction sent by the current device, and synchronously display a control interface of the current device for operating the target data flow according to the target data flow operation instruction.
Further, as shown in fig. 10, based on the above-mentioned cross-device control method and system based on wireless screen projection, the present invention further provides a smart television, which includes a processor 10, a memory 20 and a display 30. Fig. 10 shows only some of the components of the intelligent television, but it should be understood that not all of the illustrated components are required to be implemented, and more or fewer components may alternatively be implemented.
The memory 20 may be an internal storage unit of the smart tv, such as a hard disk or a memory of the smart tv, in some embodiments. The memory 20 may also be an external storage device of the Smart tv in other embodiments, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash Card (Flash Card) or the like. Further, the memory 20 may also include both an internal storage unit and an external storage device of the smart tv. The memory 20 is used for storing application software and various data installed on the smart tv, for example, program codes for installing the smart tv. The memory 20 may also be used to temporarily store data that has been output or is to be output. In an embodiment, the memory 20 stores a cross-device control program 40 based on wireless screen projection, and the cross-device control program 40 based on wireless screen projection can be executed by the processor 10, so as to implement a cross-device control method based on wireless screen projection in the present application.
The processor 10 may in some embodiments be a central processing unit (Central Processing Unit, CPU), microprocessor or other data processing chip for executing program code or processing data stored in the memory 20, such as performing the wireless screen-drop based cross-device control method, etc.
The display 30 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch, or the like in some embodiments. The display 30 is used for displaying information on the smart television and displaying a visual device interface. The components 10-30 of the smart television communicate with each other via a system bus.
In one embodiment, the following steps are implemented when the processor 10 executes the wireless drop-based cross-device control program 40 in the memory 20:
when receiving a specified screen-throwing content viewing instruction of a current device, determining a target device according to the specified screen-throwing content viewing instruction;
acquiring a target data stream of the current screen of the target equipment, sending the target data stream to the current equipment, and controlling the target data stream to be displayed on the current equipment;
and receiving a target data stream operation instruction sent by the current equipment, and synchronously displaying a control interface of the current equipment for operating the target data stream according to the target data stream operation instruction.
When receiving a specified screen content viewing instruction of a current device, determining a target device according to the specified screen content viewing instruction, wherein the method specifically comprises the following steps:
when receiving a specified screen-throwing content viewing instruction of the current equipment, analyzing the specified screen-throwing content viewing instruction to obtain an analysis result;
and determining target equipment for viewing the screen-throwing content of the current equipment according to the analysis result, and transmitting the appointed screen-throwing content viewing instruction to the target equipment when the target equipment is in a screen-throwing state.
The method for obtaining the target data stream of the current screen of the target device, sending the target data stream to the current device, and controlling the target data stream to be displayed on the current device specifically comprises the following steps:
when a first authorization passing instruction generated by the target equipment according to the specified screen-throwing content viewing instruction is received, acquiring a target data stream of the current screen throwing of the target equipment according to the first authorization passing instruction;
and sending the target data stream to the current equipment, and controlling the target data stream to be displayed on the current equipment.
The method specifically includes the steps of receiving a target data stream operation instruction sent by the current device, and synchronously displaying a control interface of the current device for operating the target data stream according to the target data stream operation instruction:
when a target data stream operation instruction sent by the current equipment is received, the target data stream operation instruction is sent to the target equipment for authorization confirmation;
when a second authorization passing instruction sent by the target equipment is received, opening the control authority of the target equipment to the target data stream to the current equipment;
and acquiring a control interface of the current equipment for operating the target data stream based on the control authority, and synchronizing the control interface to the target equipment.
When receiving a specified screen content viewing instruction of the current device, determining a target device according to the specified screen content viewing instruction, and then further comprising:
when a multi-window screen-throwing instruction of the current equipment is received, acquiring a current data stream of the current equipment according to the multi-window screen-throwing instruction;
decoding the current data stream, creating a new display window according to the decoded current data stream, and jointly performing screen projection display on the new display window and a plurality of display windows of the screen projection equipment.
When receiving a specified screen content viewing instruction of the current device, determining a target device according to the specified screen content viewing instruction, and then further comprising:
when a screen-throwing viewing instruction of the current equipment is received, acquiring a screen-throwing equipment list of the screen-throwing equipment according to the screen-throwing viewing instruction;
and acquiring the equipment state of the current equipment, and controlling the screen-throwing equipment list to display on the current equipment according to the equipment state.
The screen throwing device list comprises screen throwing device information and screen throwing window information; the method for obtaining the equipment state of the current equipment and controlling the screen-throwing equipment list to display on the current equipment according to the equipment state specifically comprises the following steps:
when the current equipment is in a vertical screen state, sending the screen throwing equipment information to the current equipment, and controlling the screen throwing equipment information to be displayed on the current equipment;
when the current equipment is in a horizontal screen state and a content transmission request instruction of the current equipment is received, acquiring the screen-throwing window information of the screen-throwing equipment according to the content transmission request instruction;
and sending the screen-throwing window information to the current equipment, and controlling the screen-throwing window information to be displayed on the current equipment.
The invention also provides a computer readable storage medium, wherein the computer readable storage medium stores a cross-device control program based on wireless screen projection, and the cross-device control program based on wireless screen projection realizes the steps of the cross-device control method based on wireless screen projection when being executed by a processor.
In summary, the present invention provides a cross-device control method based on wireless screen projection and related devices, where the method includes: when receiving a specified screen-throwing content viewing instruction of a current device, determining a target device according to the specified screen-throwing content viewing instruction; acquiring a target data stream of the current screen of the target equipment, sending the target data stream to the current equipment, and controlling the target data stream to be displayed on the current equipment; and receiving a target data stream operation instruction sent by the current equipment, and synchronously displaying a control interface of the current equipment for operating the target data stream according to the target data stream operation instruction. According to the invention, when the screen-throwing control request of the current equipment to the screen-throwing equipment is received, the screen-throwing data stream and the control authority can be selected to be shared to the current equipment according to the authorized result of the screen-throwing equipment, the control interface of the current equipment to the screen-throwing data stream is obtained in real time, and the control interface is synchronized to the screen-throwing interface of the intelligent television and the display interface of the screen-throwing equipment, so that the cross-equipment data transmission and control between the screen-throwing equipment are realized.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or intelligent television that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or intelligent television. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude that an additional identical element is present in a process, method, article, or smart television comprising the element.
Of course, those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by a computer program for instructing relevant hardware (e.g., processor, controller, etc.), the program may be stored on a computer readable storage medium, and the program may include the above described methods when executed. The computer readable storage medium may be a memory, a magnetic disk, an optical disk, etc.
It is to be understood that the invention is not limited in its application to the examples described above, but is capable of modification and variation in light of the above teachings by those skilled in the art, and that all such modifications and variations are intended to be included within the scope of the appended claims.

Claims (10)

1. The cross-device control method based on the wireless screen projection is characterized by comprising the following steps of:
when receiving a specified screen-throwing content viewing instruction of a current device, determining a target device according to the specified screen-throwing content viewing instruction;
acquiring a target data stream of the current screen of the target equipment, sending the target data stream to the current equipment, and controlling the target data stream to be displayed on the current equipment;
and receiving a target data stream operation instruction sent by the current equipment, and synchronously displaying a control interface of the current equipment for operating the target data stream according to the target data stream operation instruction.
2. The wireless screen-based cross-device control method according to claim 1, wherein when receiving a specified screen content viewing instruction of a current device, determining a target device according to the specified screen content viewing instruction specifically comprises:
when receiving a specified screen-throwing content viewing instruction of the current equipment, analyzing the specified screen-throwing content viewing instruction to obtain an analysis result;
and determining target equipment for viewing the screen-throwing content of the current equipment according to the analysis result, and transmitting the appointed screen-throwing content viewing instruction to the target equipment when the target equipment is in a screen-throwing state.
3. The cross-device control method based on wireless screen projection according to claim 1, wherein the obtaining the target data stream of the target device when the target device is currently screen projection, sending the target data stream to the current device, and controlling the target data stream to be displayed on the current device specifically comprises:
when a first authorization passing instruction generated by the target equipment according to the specified screen-throwing content viewing instruction is received, acquiring a target data stream of the current screen throwing of the target equipment according to the first authorization passing instruction;
and sending the target data stream to the current equipment, and controlling the target data stream to be displayed on the current equipment.
4. The cross-device control method based on wireless screen projection according to claim 1, wherein the receiving the target data stream operation instruction sent by the current device and synchronously displaying the control interface of the current device on the target data stream according to the target data stream operation instruction specifically comprises:
when a target data stream operation instruction sent by the current equipment is received, the target data stream operation instruction is sent to the target equipment for authorization confirmation;
when a second authorization passing instruction sent by the target equipment is received, opening the control authority of the target equipment to the target data stream to the current equipment;
and acquiring a control interface of the current equipment for operating the target data stream based on the control authority, and synchronizing the control interface to the target equipment.
5. The wireless screen-based cross-device control method according to claim 1, wherein when receiving a specified screen content viewing instruction of a current device, determining a target device according to the specified screen content viewing instruction, and further comprising:
when a multi-window screen-throwing instruction of the current equipment is received, acquiring a current data stream of the current equipment according to the multi-window screen-throwing instruction;
decoding the current data stream, creating a new display window according to the decoded current data stream, and jointly performing screen projection display on the new display window and a plurality of display windows of the screen projection equipment.
6. The wireless screen-based cross-device control method according to claim 1, wherein when receiving a specified screen content viewing instruction of a current device, determining a target device according to the specified screen content viewing instruction, and further comprising:
when a screen-throwing viewing instruction of the current equipment is received, acquiring a screen-throwing equipment list of the screen-throwing equipment according to the screen-throwing viewing instruction;
and acquiring the equipment state of the current equipment, and controlling the screen-throwing equipment list to display on the current equipment according to the equipment state.
7. The wireless screen-based cross-device control method according to claim 6, wherein the screen-projection device list comprises screen-projection device information and screen-projection window information; the method for obtaining the equipment state of the current equipment and controlling the screen-throwing equipment list to display on the current equipment according to the equipment state specifically comprises the following steps:
when the current equipment is in a vertical screen state, sending the screen throwing equipment information to the current equipment, and controlling the screen throwing equipment information to be displayed on the current equipment;
when the current equipment is in a horizontal screen state and a content transmission request instruction of the current equipment is received, acquiring the screen-throwing window information of the screen-throwing equipment according to the content transmission request instruction;
and sending the screen-throwing window information to the current equipment, and controlling the screen-throwing window information to be displayed on the current equipment.
8. The cross-device control system based on wireless screen projection is characterized by comprising:
the target equipment confirming module is used for determining target equipment according to the specified screen-throwing content viewing instruction when receiving the specified screen-throwing content viewing instruction of the current equipment;
the target data stream acquisition module is used for acquiring a target data stream of the current screen of the target equipment, sending the target data stream to the current equipment and controlling the target data stream to be displayed on the current equipment;
and the target data flow control module is used for receiving a target data flow operation instruction sent by the current equipment and synchronously displaying a control interface of the current equipment for operating the target data flow according to the target data flow operation instruction.
9. An intelligent television, characterized in that, the intelligent television includes: a memory, a processor and a wireless screen-based cross-device control program stored on the memory and executable on the processor, which when executed by the processor, implements the steps of the wireless screen-based cross-device control method of any of claims 1-7.
10. A computer readable storage medium, characterized in that the computer readable storage medium stores a wireless screen-based cross-device control program, which when executed by a processor, implements the steps of the wireless screen-based cross-device control method according to any one of claims 1-7.
CN202311626682.2A 2023-11-29 2023-11-29 Cross-equipment control method and system based on wireless screen throwing and intelligent television Pending CN117596431A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311626682.2A CN117596431A (en) 2023-11-29 2023-11-29 Cross-equipment control method and system based on wireless screen throwing and intelligent television

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311626682.2A CN117596431A (en) 2023-11-29 2023-11-29 Cross-equipment control method and system based on wireless screen throwing and intelligent television

Publications (1)

Publication Number Publication Date
CN117596431A true CN117596431A (en) 2024-02-23

Family

ID=89921674

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311626682.2A Pending CN117596431A (en) 2023-11-29 2023-11-29 Cross-equipment control method and system based on wireless screen throwing and intelligent television

Country Status (1)

Country Link
CN (1) CN117596431A (en)

Similar Documents

Publication Publication Date Title
US11416113B2 (en) Apparatus and method for remotely controlling peripheral devices in mobile communication terminal
US20200221157A1 (en) System and method for ubiquitous appliance control
CN100464525C (en) Method and system for identifying device on universal plug and play network and playing content using the device
CN102932695B (en) A kind of remote control thereof, intelligent terminal and intelligent remote control system
US9024734B2 (en) Remote control device, a far-end device, a multimedia system and a control method thereof
US10423139B2 (en) Device control method and apparatus, and device control system
CN102752369B (en) The supplying method of TV applications service and virtual content service platform
CN105337984A (en) Account logining method and device
US9473617B2 (en) Terminal apparatus, control system, and control method for controlling collaboration among a plurality of devices
US9886844B2 (en) Information processing apparatus, information processing method, and program
CN113766329B (en) Playing request processing method and display device
US9418539B2 (en) Remote control apparatus and electronic device remotely controlled by the same
CN113992958B (en) Multi-window same-screen interaction method, terminal and storage medium
CN103873943A (en) OSD (on-screen display) interaction interface display method and system, and terminals
US20120331096A1 (en) Telecommunications terminal, broadcast receiving terminal and computer program
CN104836820A (en) Method and system for client interaction, and client terminals
CN117596431A (en) Cross-equipment control method and system based on wireless screen throwing and intelligent television
CN112003928B (en) Multifunctional screen synchronous control method, device and equipment
CN114520806A (en) Screen application remote control interaction method and system, electronic equipment and storage medium
CN112860367B (en) Equipment interface visualization method, intelligent terminal and computer readable storage medium
US20160006793A1 (en) Osd subject file obtaining and providing method and device, updating system
KR100445005B1 (en) Home network system capable of transferring e-mail and e-mail transfer method in the home network
CN117615195A (en) Screen-throwing control method based on multi-channel video fusion and related equipment
CN114063960A (en) Large and small screen interaction method and device and computer readable storage medium
CN116502205A (en) Display device, server and application program login device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination