CN114063949A - Remote control method and system thereof - Google Patents

Remote control method and system thereof Download PDF

Info

Publication number
CN114063949A
CN114063949A CN202010782400.8A CN202010782400A CN114063949A CN 114063949 A CN114063949 A CN 114063949A CN 202010782400 A CN202010782400 A CN 202010782400A CN 114063949 A CN114063949 A CN 114063949A
Authority
CN
China
Prior art keywords
screen
projector
transmission box
signal
usb link
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202010782400.8A
Other languages
Chinese (zh)
Inventor
刘德建
黄晨帆
张新洲
邹祖军
杜建强
郭玉湖
陈宏�
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujian Tianquan Educational Technology Ltd
Original Assignee
Fujian Tianquan Educational Technology Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujian Tianquan Educational Technology Ltd filed Critical Fujian Tianquan Educational Technology Ltd
Priority to CN202010782400.8A priority Critical patent/CN114063949A/en
Publication of CN114063949A publication Critical patent/CN114063949A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/4401Bootstrapping
    • G06F9/4411Configuring for operating with peripheral devices; Loading of device drivers
    • G06F9/4413Plug-and-play [PnP]
    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/02Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Projection Apparatus (AREA)

Abstract

The invention provides a remote control method and a system thereof, wherein the method comprises the following steps: a method of remote control, comprising: after the screen projector and the screen transmission box are paired through a USB link and establish wireless connection, disconnecting the USB link; the sending terminal and the screen projector are connected through a Type-C interface; the screen projector acquires a DP screen projecting signal of a sending end and converts the DP screen projecting signal into corresponding screen projecting data; the screen projector wirelessly transmits the screen projection data to the screen transmission box; and the screen transmission box transmits the screen projection data to a receiving end of the receiving end through a USB link. The invention fully utilizes the characteristics of hardware, reduces the software development amount, and particularly saves the software development of a sending end; when the screen projector is applied, the operations of software installation, configuration and the like of a user can be reduced as much as possible, screen projection work such as network connection, network transmission of screen projection data and the like can be automatically completed by directly inserting the screen projector, and the convenience of operation is obviously improved; greatly simplifying deployment.

Description

Remote control method and system thereof
Technical Field
The invention relates to the field of remote control, in particular to a remote control method and a remote control system.
Background
The existing remote control mode is to develop a corresponding screen-casting software main control end and a controlled end on windows, Android and iOS operating systems, acquire a controlled end screen, transmit the acquired screen to the main control end through a network, and analyze and display the acquired screen at the main control end.
The existing remote control is mainly realized in a software mode, and needs to be developed in windows, Android and iOS operating systems at the same time.
There is a need to minimize the impact of differences between different operating systems when the software development for remote control involves different operating systems.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: the method and the system for providing remote control can be compatible with different operating systems, and software development of a transmitting end can be omitted.
In order to solve the technical problems, the invention adopts the technical scheme that:
a method of remote control, comprising:
after the screen projector and the screen transmission box are paired through a USB link and establish wireless connection, disconnecting the USB link;
the sending terminal and the screen projector are connected through a Type-C interface;
the screen projector acquires a DP screen projecting signal of a sending end and converts the DP screen projecting signal into corresponding screen projecting data;
the screen projector wirelessly transmits the screen projection data to the screen transmission box;
and the screen transmission box transmits the screen projection data to a receiving end of the receiving end through a USB link.
The invention provides another technical scheme as follows:
a remote control system comprises a sending end, a screen projector, a screen transmission box and a receiving end;
the sending end is connected with the screen projector through a USB link; the screen projector is wirelessly connected with the screen transmission box; the screen transmission box is connected with the receiving end through a USB link;
the screen projector is used for completing pairing and establishing wireless connection with the screen transmission box through a USB link, establishing connection with the sending terminal through a Type-C interface, collecting a DP screen projection signal of the sending terminal, converting the DP screen projection signal into corresponding screen projection data, and wirelessly transmitting the screen projection data sent by the sending terminal to the screen transmission box;
the sending terminal is used for establishing connection with the screen projector through a Type-C interface;
the screen transmission box is used for completing pairing with the screen projector through a USB link to establish wireless connection, and transmitting received screen projection data to a receiving end through the USB link.
The invention has the beneficial effects that: according to the invention, the hardware and the functional characteristics of the USB Type-C interface are fully utilized in a mode of combining software and hardware, so that after the screen transmitter is inserted into the transmitting end through the Type-C interface, the transmitting end can regard the equipment as a receiving end and directly output DP screen transmitting signals to the equipment, and therefore, no additional software is required to be installed on the transmitting end; when the screen projector is applied, screen projecting work such as network connection, network sending of screen projecting data and the like can be automatically completed by directly inserting the screen projector, and convenience of operation can be remarkably improved; meanwhile, the compatibility with different operating systems can be realized without being limited by the operating systems of the transmitting end and the receiving end; the deployment is greatly simplified, whether the environment where the user is located has a network or not and the requirements on various parameters of the network are not required any more, and the screen projection of the ad hoc network can be realized.
Drawings
FIG. 1 is a flow chart illustrating a method of remote control according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of the components and connections of a screen projector according to an embodiment of the present invention;
FIG. 3 is a schematic diagram illustrating the structural components and connections of a remote control system according to an embodiment of the present invention;
FIG. 4 is a schematic diagram illustrating data processing of a USB Type-C interface in a remote control method according to an embodiment of the present invention;
FIG. 5 is a timing diagram of a general Wi-Fi pairing process of a remote control method according to an embodiment of the present invention;
FIG. 6 is a screen shot timing chart of a remote control method according to a second embodiment of the present invention;
fig. 7 is an operation diagram of a remote control method and a system thereof according to a fourth embodiment of the present invention.
Detailed Description
In order to explain technical contents, achieved objects, and effects of the present invention in detail, the following description is made with reference to the accompanying drawings in combination with the embodiments.
The most key concept of the invention is as follows: the method has the advantages that the network is quickly constructed and data transmission is realized by using a hardware screen projector and a screen transmission box, different operating systems are compatible, and software deployment is reduced; utilize the DP of Type-C interface direct acquisition transmitting terminal to throw the screen signal, the transmitting terminal need not extra external software and can realize throwing the screen.
The technical terms related to the invention are explained as follows:
Figure BDA0002620712870000031
Figure BDA0002620712870000041
referring to fig. 1 and fig. 2, the present invention provides a remote control method, including:
after the screen projector and the screen transmission box are paired through a USB link and establish wireless connection, disconnecting the USB link;
the sending terminal and the screen projector are connected through a Type-C interface;
the screen projector acquires a DP screen projecting signal of a sending end and converts the DP screen projecting signal into corresponding screen projecting data;
the screen projector wirelessly transmits the screen projection data to the screen transmission box;
and the screen transmission box transmits the screen projection data to a receiving end of the receiving end through a USB link.
From the above description, the beneficial effects of the present invention are: by combining software and hardware, the characteristics of hardware and a Type-C interface are fully utilized, and the software development amount is reduced; when the method is applied, the operations of software installation, configuration and the like of a user are reduced as much as possible, particularly at a sending end, screen projection work such as network connection, network sending of screen projection data and the like can be automatically completed by directly inserting a screen projector without additionally installing software, and the convenience of operation is obviously improved; meanwhile, the compatibility of different operating systems of the sending end and the receiving end is realized, and the deployment is greatly simplified; in addition, whether the environment where the user is located has a network or not and requirements for various parameters of the network are not required, and the ad hoc network screen projection can be achieved.
Further, still include:
the screen transmission box acquires control data received by the receiving end and wirelessly transmits the control data to the screen projector;
and the screen projector converts the control data into a corresponding DP control signal and then sends the DP control signal to the sending end.
According to the description, the remote control of the screen transmission of the sending end can be realized by the receiving end, and the remote control can be realized at the sending end without additionally installing software.
Further, the screen projector acquires a DP screen projecting signal of the sending terminal, and converts the DP screen projecting signal into corresponding screen projecting data, and the screen projecting method includes the following steps:
the screen projector acquires a DP screen projecting signal of a sending end;
converting the DP screen-casting signal into a corresponding MIPI screen-casting signal;
and converting the MIPI screen projection signal into corresponding screen transmission data.
According to the description, the DP signals collected by the screen projector from the sending end cannot be directly used, but only simple format conversion is needed, so that the DP signals can be used by the receiving end, and therefore, technical support is provided for the sending end to directly collect the screen transmission signals without additionally installing software.
Further, the screen projector and the screen transmission box complete pairing through a USB link to establish wireless connection, and the method comprises the following steps:
the screen projector and the screen transmission box are in wired connection through a USB link;
the screen transmission box sends the information of the built-in wireless router to the screen projector;
and the screen projector returns a response corresponding to the information of the wireless router to the screen transmission box, and the screen projector and the screen transmission box successfully establish wireless connection.
According to the description, the simple screen projector is quickly built between the screen projector and the screen transmission box based on the USB link.
Further, the sending end and the screen projector establish connection through a Type-C interface, including:
after detecting that the screen projector is accessed through the Type-C interface, a sending end starts initialization;
the application layer in the screen projector is connected with the kernel layer;
the application layer of the screen projector is connected with the screen transmission box;
the screen transmission box returns a connection success message to the application layer;
the application layer reports the connection success message to the kernel layer;
the kernel layer queries the application layer for a hardware readiness state;
the application layer reports the ready state of the hardware to the kernel layer;
the kernel layer returns a hardware ready state to a sending end through a Type-C interface;
the screen projector prompts the state of hardware readiness. .
According to the description, after the connection link is established among the screen projector, the screen transmission box and the sending end, the connection link is reported to the sending end in real time, and the hardware is marked to be ready; and after the hardware is ready, the sending end can start screen-casting and screen-transmitting operation and send a DP screen-casting signal without auxiliary software to output screen-transmitting data in a specified format. In particular, the invention can be realized without additionally installing an application program on the PC end system for support, namely, no application program is running on the PC end system, so that the screen projector hardware entity presents relevant states (states of successful connection, screen projection starting and the like).
Further, the screen projector wirelessly transmits the screen projection data to the screen transmission box, and the screen projector comprises:
after receiving a screen projection data stream sent by a sending end, a kernel layer of the screen projector transmits the screen projection data stream to an application layer;
and the application layer wirelessly transmits the screen projection data stream to a screen transmission box.
According to the description, the screen projection data are transmitted in a wired transmission mode and then in a short-distance wireless transmission mode, and the transmission data can be guaranteed to accurately and quickly reach the screen transmission box.
Further, the screen transmission box transmits the screen projection data to a receiving end through a USB link, including:
after receiving the screen projection data stream, the screen transmission box analyzes the screen projection data stream to obtain corresponding screen projection data;
and the screen transmission box transmits the screen projection data to a receiving end through a USB link.
According to the description, the data stream is analyzed by the transmission screen box and then transmitted to the display screen, the display screen can be directly synchronized without analysis, and the synchronization efficiency can be improved.
The invention provides another technical scheme as follows:
a remote control system comprises a sending end, a screen projector, a screen transmission box and a receiving end;
the sending end is connected with the screen projector through a USB link; the screen projector is wirelessly connected with the screen transmission box; the screen transmission box is connected with the receiving end through a USB link;
the screen projector is used for completing pairing and establishing wireless connection with the screen transmission box through a USB link, establishing connection with the sending terminal through a Type-C interface, collecting a DP screen projection signal of the sending terminal, converting the DP screen projection signal into corresponding screen projection data, and wirelessly transmitting the screen projection data sent by the sending terminal to the screen transmission box;
the sending terminal is used for establishing connection with the screen projector through a Type-C interface;
the screen transmission box is used for completing pairing with the screen projector through a USB link to establish wireless connection, and transmitting received screen projection data to a receiving end through the USB link.
Furthermore, the screen transmission box is also used for acquiring control data received by the receiving end and wirelessly transmitting the control data to the screen projector;
and the screen projector is also used for converting the control data into a corresponding DP control signal and then sending the DP control signal to the sending end.
Further, the screen projector is specifically configured to collect a DP screen projecting signal of a sending end, convert the DP screen projecting signal into a corresponding MIPI screen projecting signal, and convert the MIPI screen projecting signal into corresponding screen transmission data.
Further, the screen projector is specifically configured to return a response corresponding to the information of the wireless router to the screen transmission box after establishing a wired connection with the screen transmission box through a USB link, and successfully establish a wireless connection with the screen transmission box;
the screen transmission box is specifically used for sending built-in wireless router information to the screen projector after establishing wired connection with the screen projector through a USB link, and successfully establishing wireless connection with the screen projector after the screen projector returns a response corresponding to the wireless router information.
Further, the screen projector comprises an application layer and a kernel layer;
the screen transmission box is also used for reporting a connection success message to the application layer when the application layer is connected with the kernel layer;
the application layer is used for connecting the screen transmission box, reporting the received connection success message to the kernel layer, and returning the state to the kernel layer when receiving the query state request of the kernel layer;
the kernel layer is used for inquiring the state of the application layer when receiving an inquiry state request of a sending end and returning the state to the sending end through a USB link;
the screen projector is also used for prompting the ready state of hardware.
Further, the kernel layer is further configured to transmit the screen-casting data stream sent by the sending end to the application layer after receiving the screen-casting data stream,
the application layer is also used for wirelessly transmitting the received screen projection data stream to the screen transmission box;
and the screen transmission box is used for analyzing the screen projection data stream to obtain corresponding screen projection data after receiving the screen projection data stream, and transmitting the screen projection data to a receiving end through a USB link.
Example one
Referring to fig. 1, fig. 2, fig. 4 and fig. 5, the present embodiment provides a method for implementing remote control by combining software and hardware, and by introducing hardware devices: the screen projector and the screen transmission box can realize screen transmission control in a soft and hard combined mode, reduce software development amount, reduce operations such as software installation and configuration and the like for a user, and particularly can save the software development process of a sending end; meanwhile, different operating systems are compatible; the deployment is greatly simplified, whether the environment where the user is located has a network or not and requirements on various parameters of the network are not required any more, and the ad hoc network screen projection can be realized; more importantly, the screen transmission and the screen transmission control of the receiving end to the sending end can be realized without additionally installing software at the sending end.
The method of the embodiment comprises the following steps:
s1: the screen projector is inserted into a USB port of the screen transmission box, and the screen projector and the screen transmission box are paired through a USB link to establish wireless connection;
referring to fig. 5, the specific process includes:
s11: the screen projector and the screen transmission box are in wired connection through a USB link;
s12: the screen transmission box sends the information of the built-in wireless router to the screen projector;
s13: the screen projector returns a response corresponding to the information of the wireless router to the screen transmission box, the screen projector and the screen transmission box successfully establish wireless connection, and therefore the screen projector and the screen transmission box complete self-networking.
S2: the screen projector is disconnected with the screen transmission box by a wire, namely the screen projector is pulled out from the screen transmission box. But both still maintain the established wireless Wi-Fi connection.
S3: the screen projector and a sending end (such as a PC) establish a wired connection relationship through a Type-C interface;
s4: the method comprises the steps that a sending end outputs a DP screen-casting signal to a screen-casting device through a Type-C interface;
here, it should be particularly noted that the present embodiment utilizes the functional characteristics of Type-C, so that after a device of Type-C interface is plugged into a PC, the PC may consider the device as a receiving end, and directly output a DP audio/video signal, i.e., a DP screen transmission signal, to the device of Type-C interface. Compared with the method that software needs to be installed in a PC (personal computer) of the sending end and the PC assists in acquiring the audio and video signals, the method can save the operation of deploying the software at the sending end and reduce the software development amount at the same time.
S5: the screen projector converts the acquired DP audio and video signals into corresponding screen projection data;
the method specifically comprises the following steps:
s51: the screen projector acquires a DP screen projecting signal of a sending end;
s52: and converting the DP screen projection signal into a corresponding MIPI screen projection signal through a conversion module, and converting the MIPI screen projection signal into corresponding screen transmission data.
S6: the screen projector wirelessly transmits the screen projection data to the screen transmission box;
s7: and the screen transmission box receives the screen projection data through the USB link, analyzes the screen projection data, and transmits the analyzed screen projection data to a receiving end connected with the screen transmission box.
Therefore, remote screen transmission control between the sending end and the receiving end is completed.
Example two
Referring to fig. 2, fig. 3 and fig. 6, the present embodiment is further defined on the basis of the first embodiment.
The method comprises the following steps:
1. after the screen projector is inserted into the USB port of the screen transmission box, the screen projector is initialized; the screen projector performs self-checking; and the screen projector and the screen transmission box complete the ad hoc network through Wi-Fi information configuration. For the screen projector, an application layer (Firmware App layer) of the screen projector matches Wi-Fi information through a Kernel layer (Kernel layer), and the Firmware App layer receives responded Wi-Fi data through the Kernel layer.
2. After the screen projector is pulled out of the screen transmission box and is inserted into the PC, the screen projector is connected with the screen transmission box according to the paired Wi-Fi information.
Specifically, the process of successfully establishing the connection between the PC and the screen projector includes:
after detecting that the screen projector is accessed through the Type-C interface, a sending end starts initialization; the application layer in the screen projector is connected with the kernel layer; the application layer of the screen projector is connected with the screen transmission box; the screen transmission box returns a connection success message to the application layer; the application layer reports the connection success message to the kernel layer; the kernel layer queries the application layer for a hardware readiness state; the application layer reports the ready state of the hardware to the kernel layer; the screen projector prompts the ready state of hardware through an indicator lamp of the screen projector.
3. A sending end receives a screen-casting starting instruction; here, the screen projection may be triggered by a specific key on the transmitting end or by other means.
4. As shown in fig. 2, after the sending end triggers the start of the screen-casting operation, it will output the audio/video signal in DP format; the conversion module (interface conversion chip) in the screen projector is responsible for collecting video signals and is equivalent to a device similar to a display screen. A conversion module of the screen projector is connected with a DP interface of a PC, and the conversion module acquires audio and video signals in a DP format output by a sending end to the screen projector; then, the conversion module converts the audio and video signals in the DP format into audio and video signals (CSI signals) in the MIPI format, sends the audio and video signals (CSI signals) to the kernel layer for carrying out corresponding processing after CSI image acquisition, transmits the processed CSI images to the application layer for coding and packaging, and sends out audio and video data streams through the Wi-Fi by the application layer through the screen transmission box.
5. A screen projector receiving end (screen transmission box) receives the audio and video data stream, analyzes the audio and video data stream and obtains corresponding audio and video data; and then transmitting the audio and video data to a receiving end through a USB interface (or an HDMI interface), and displaying the audio and video data on a display screen of the receiving end through software.
6. The receiving end PC collects data of a mouse, a keyboard and a touch event through software; then, sending data of the mouse, the keyboard and the touch event to a screen projector through a Wi-Fi network; after receiving the data, the screen projector analyzes the data and restores the data into hardware information, namely DP format information, which is an information format that a sending end can directly receive and process through a USB Type-C interface; the information is input to a sending terminal PC; the sending terminal PC directly takes the data given by the USB Type-C as the original data of the hardware for processing (processing into a mouse, a keyboard and a touch event).
This embodiment can throw the screen signal through throwing the DP that the screen ware directly gathered the sending end through throwing the screen ware through the mode that software and hardware combines, carries out format conversion back, sends to the biography screen box through the network, then analyzes and show through the receiving terminal. By this technique is achieved: 1. the corresponding software development amount of a sending end can be reduced, and the development efficiency is improved; a user can start to project the screen by directly inserting the screen projector without installing screen projecting software at a sending end. Based on the characteristics of the Type-C interface, a PC needing screen projection can acquire screen transmission signals of the PC end only by inserting a screen projector; the screen projector finishes the work of network connection, video data acquisition, network transmission and the like, so that the development work on different operating systems can save the related content of the network and only take charge of acquisition. 2. The screen transmission operation of the sending end can be remotely controlled by the receiving end, and additional software development at the sending end is not needed; but also can bypass the restriction of the calling system API by incompatible operating systems or similar antivirus software and operating system systems. 3. Greatly simplifying the deployment. The screen projection does not require the working environment of the user to have a network and various parameters of the network.
EXAMPLE III
Referring to fig. 7, the present embodiment provides a specific application scenario corresponding to the first embodiment or the second embodiment:
in a smart classroom, when only one PC and one receiving end are provided, one PC is inserted into a hardware screen projector to serve as a sending end, and the other PC is inserted into a screen projector box to serve as a receiving end. Then, through simple configuration, a simple screen projection system application in the local area network is built between the screen projector and the screen projection box. The user can project the image on the PC to the receiving end. The deployment time and the flow operation steps are greatly reduced.
For another example, in a large conference site, guests temporarily need to project the related PPT data, and at this time, the screen projector and the screen transmission box can be used to insert the screen transmission box into the display screen or the projector (the playing end); the screen transmission device is firstly inserted into the screen transmission box for automatic pairing, after the self-networking is completed to realize Wi-Fi connection, the screen transmission device is pulled out of the screen transmission box and inserted into a notebook computer (sending end), a temporary network environment and a screen projection application system can be rapidly built, and a user can perform on-site demonstration.
The specific process of the above example is as follows:
1. connecting a display screen supporting an HDMI interface to a screen transmission box;
2. and after the screen transmission box is started, the screen projector is connected to the USB port of the screen transmission box.
The step is mainly to synchronize the router information built in the screen transmission box to the screen projector, and after synchronization, the screen projector can be connected to the screen transmission box through the router built in the screen transmission box, and the screen transmission box and the screen projector realize ad hoc network. This process is also referred to as pairing.
3. Inserting the paired screen projector into a USB Type-C interface of a PC (personal computer) to be subjected to screen projection;
4. the screen projector can virtually form a CDROM on a PC (personal computer) at a sending end, and automatically run a PC end program in the CDROM; in the process, the firmware on the screen projector can be automatically connected with the screen projector;
5. after the screen projector and the screen transmission box are successfully connected, the screen projector can tell the running PC end application program; the UI of the application program displays the corresponding state, and when a user sees the ready related information, the user can press a key to screen;
6. at this time, the user can see that the display screen connected on the transmission screen box presents the desktop content of the sending terminal PC; thus, the screen projection process is completed.
Example four
Corresponding to the first to third embodiments, this embodiment provides a system for implementing remote control by combining software and hardware, as shown in fig. 6, including a sending end, a screen projector, a screen transmission box, and a receiving end;
the sending end is connected with the screen projector through a USB link; the screen projector is wirelessly connected with the screen transmission box; the screen transmission box is connected with the receiving end through a USB link;
the screen projector is used for completing pairing and establishing wireless connection with the screen transmission box through a USB link, establishing connection with the sending terminal through a Type-C interface, collecting a DP screen projection signal of the sending terminal, converting the DP screen projection signal into corresponding screen projection data, and wirelessly transmitting the screen projection data sent by the sending terminal to the screen transmission box;
the sending terminal is used for establishing connection with the screen projector through a Type-C interface;
the screen transmission box is used for completing pairing with the screen projector through a USB link to establish wireless connection, and transmitting received screen projection data to a receiving end through the USB link.
Furthermore, the screen transmission box is also used for acquiring control data received by the receiving end and wirelessly transmitting the control data to the screen projector;
and the screen projector is also used for converting the control data into a corresponding DP control signal and then sending the DP control signal to the sending end.
Further, the screen projector is specifically configured to collect a DP screen projecting signal of a sending end, convert the DP screen projecting signal into a corresponding MIPI screen projecting signal, and convert the MIPI screen projecting signal into corresponding screen transmission data.
Further, the screen projector is specifically configured to return a response corresponding to the information of the wireless router to the screen transmission box after establishing a wired connection with the screen transmission box through a USB link, and successfully establish a wireless connection with the screen transmission box;
the screen transmission box is specifically used for sending built-in wireless router information to the screen projector after establishing wired connection with the screen projector through a USB link, and successfully establishing wireless connection with the screen projector after the screen projector returns a response corresponding to the wireless router information.
Further, the screen projector comprises an application layer and a kernel layer;
the screen transmission box is also used for reporting a connection success message to the application layer when the application layer is connected with the kernel layer;
the application layer is used for connecting the screen transmission box, reporting the received connection success message to the kernel layer, and returning the state to the kernel layer when receiving the query state request of the kernel layer;
the kernel layer is used for inquiring the state of the application layer when receiving an inquiry state request of a sending end and returning the state to the sending end through a USB link;
the screen projector is also used for prompting the ready state of hardware.
Further, the kernel layer is further configured to transmit the screen-casting data stream sent by the sending end to the application layer after receiving the screen-casting data stream,
the application layer is also used for wirelessly transmitting the received screen projection data stream to the screen transmission box;
and the screen transmission box is used for analyzing the screen projection data stream to obtain corresponding screen projection data after receiving the screen projection data stream, and transmitting the screen projection data to a receiving end through a USB link.
In summary, the method and the system for remote control provided by the invention make full use of the characteristics of hardware and the Type-C interface, reduce the development amount of system software, and even omit the software development of the sending end; when the screen projector is applied, the operations of software installation, configuration and the like of a user can be reduced as much as possible, screen projection work such as network connection, network transmission of screen projection data and the like can be automatically completed by directly inserting the screen projector, and the convenience of operation is obviously improved; aiming at the double ends, various operating systems can be compatible, and the practicability is improved; the deployment is greatly simplified, whether the environment where the user is located has a network or not and the requirements on various parameters of the network are not required any more, and the screen projection of the ad hoc network can be realized; when the screen transmission operation of the receiving end remote control transmitting end is realized, the limitation of incompatible operating systems or similar antivirus software and operating system systems on the calling system API can be bypassed; therefore, the method has the characteristics of simple and convenient operation, accurate synchronization, high development efficiency and the like.
The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all equivalent changes made by using the contents of the present specification and the drawings, or applied directly or indirectly to the related technical fields, are included in the scope of the present invention.

Claims (10)

1. A method of remote control, comprising:
after the screen projector and the screen transmission box are paired through a USB link and establish wireless connection, disconnecting the USB link;
the sending terminal and the screen projector are connected through a Type-C interface;
the screen projector acquires a DP screen projecting signal of a sending end and converts the DP screen projecting signal into corresponding screen projecting data;
the screen projector wirelessly transmits the screen projection data to the screen transmission box;
and the screen transmission box transmits the screen projection data to a receiving end of the receiving end through a USB link.
2. The method of remote control according to claim 1, further comprising:
the screen transmission box acquires control data received by the receiving end and wirelessly transmits the control data to the screen projector;
and the screen projector converts the control data into a corresponding DP control signal and then sends the DP control signal to the sending end.
3. The remote control method according to claim 1, wherein the screen projector collects a DP screen projection signal of a transmitting end and converts the DP screen projection signal into corresponding screen projection data, and comprises:
the screen projector acquires a DP screen projecting signal of a sending end;
converting the DP screen-casting signal into a corresponding MIPI screen-casting signal;
and converting the MIPI screen projection signal into corresponding screen transmission data.
4. The method of claim 1, wherein the screen projector and the screen transmission box are paired through a USB link to establish a wireless connection, and the method comprises the following steps:
the screen projector and the screen transmission box are in wired connection through a USB link;
the screen transmission box sends the information of the built-in wireless router to the screen projector;
and the screen projector returns a response corresponding to the information of the wireless router to the screen transmission box, and the screen projector and the screen transmission box successfully establish wireless connection.
5. The remote control method of claim 1, wherein the establishing of the connection between the sending end and the screen projector through a Type-C interface comprises:
after detecting that the screen projector is accessed through the Type-C interface, a sending end starts initialization;
the application layer in the screen projector is connected with the kernel layer;
the application layer of the screen projector is connected with the screen transmission box;
the screen transmission box returns a connection success message to the application layer;
the application layer reports the connection success message to the kernel layer;
the kernel layer queries the application layer for a hardware readiness state;
the application layer reports the ready state of the hardware to the kernel layer;
the screen projector prompts the state of hardware readiness.
6. The method of claim 5, wherein the screen projector wirelessly transmits the screen projection data to a screen box, comprising:
after receiving a screen projection data stream sent by a sending end, a kernel layer of the screen projector transmits the screen projection data stream to an application layer;
and the application layer wirelessly transmits the screen projection data stream to a screen transmission box.
7. The method of claim 6, wherein the screen-transmitting box transmits the screen-shot data to a receiving end through a USB link, comprising:
after receiving the screen projection data stream, the screen transmission box analyzes the screen projection data stream to obtain corresponding screen projection data;
and the screen transmission box transmits the screen projection data to a receiving end through a USB link.
8. A remote control system is characterized by comprising a sending end, a screen projector, a screen transmission box and a receiving end;
the sending end is connected with the screen projector through a USB link; the screen projector is wirelessly connected with the screen transmission box; the screen transmission box is connected with the receiving end through a USB link;
the screen projector is used for completing pairing and establishing wireless connection with the screen transmission box through a USB link, establishing connection with the sending terminal through a Type-C interface, collecting a DP screen projection signal of the sending terminal, converting the DP screen projection signal into corresponding screen projection data, and wirelessly transmitting the screen projection data sent by the sending terminal to the screen transmission box;
the sending terminal is used for establishing connection with the screen projector through a Type-C interface;
the screen transmission box is used for completing pairing with the screen projector through a USB link to establish wireless connection, and transmitting received screen projection data to a receiving end through the USB link.
9. The remote control system of claim 8, wherein the screen transmitting box is further configured to collect control data received by the receiving end and wirelessly transmit the control data to the screen projector;
and the screen projector is also used for converting the control data into a corresponding DP control signal and then sending the DP control signal to the sending end.
10. The remote control system according to claim 8, wherein the screen projector is specifically configured to collect a DP screen projection signal from a transmitting end; converting the DP screen-casting signal into a corresponding MIPI screen-casting signal; and converting the MIPI screen projection signal into corresponding screen transmission data.
CN202010782400.8A 2020-08-06 2020-08-06 Remote control method and system thereof Withdrawn CN114063949A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010782400.8A CN114063949A (en) 2020-08-06 2020-08-06 Remote control method and system thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010782400.8A CN114063949A (en) 2020-08-06 2020-08-06 Remote control method and system thereof

Publications (1)

Publication Number Publication Date
CN114063949A true CN114063949A (en) 2022-02-18

Family

ID=80232292

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010782400.8A Withdrawn CN114063949A (en) 2020-08-06 2020-08-06 Remote control method and system thereof

Country Status (1)

Country Link
CN (1) CN114063949A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024119484A1 (en) * 2022-12-09 2024-06-13 广州视臻信息科技有限公司 Data transmission method, screen mirroring receiving apparatus, and display device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107104947A (en) * 2017-03-20 2017-08-29 福建天泉教育科技有限公司 Multi-screen interaction method
CN208258096U (en) * 2018-06-11 2018-12-18 广州视源电子科技股份有限公司 Receiving device and wireless screen transmission system
WO2018227816A1 (en) * 2017-06-16 2018-12-20 广州视源电子科技股份有限公司 Dvb-based screen transmission device and method and dvb receiver
CN109144396A (en) * 2018-09-05 2019-01-04 广州视源电子科技股份有限公司 Touch information processing method, device, equipment and storage medium
CN110691275A (en) * 2019-09-10 2020-01-14 上海明我信息技术有限公司 Wireless screen transmission equipment, method and computer storage medium
CN111277875A (en) * 2020-01-10 2020-06-12 京东方科技集团股份有限公司 Transmitter and wireless screen projection device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107104947A (en) * 2017-03-20 2017-08-29 福建天泉教育科技有限公司 Multi-screen interaction method
WO2018227816A1 (en) * 2017-06-16 2018-12-20 广州视源电子科技股份有限公司 Dvb-based screen transmission device and method and dvb receiver
CN208258096U (en) * 2018-06-11 2018-12-18 广州视源电子科技股份有限公司 Receiving device and wireless screen transmission system
CN109144396A (en) * 2018-09-05 2019-01-04 广州视源电子科技股份有限公司 Touch information processing method, device, equipment and storage medium
CN110691275A (en) * 2019-09-10 2020-01-14 上海明我信息技术有限公司 Wireless screen transmission equipment, method and computer storage medium
CN111277875A (en) * 2020-01-10 2020-06-12 京东方科技集团股份有限公司 Transmitter and wireless screen projection device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024119484A1 (en) * 2022-12-09 2024-06-13 广州视臻信息科技有限公司 Data transmission method, screen mirroring receiving apparatus, and display device

Similar Documents

Publication Publication Date Title
CN105493621B (en) Terminal, server and terminal control method
US20190129681A1 (en) Wireless Screen Transmission Method, Extension Device, and Wireless Screen Transmission System
CN103559150A (en) Realizing method and device for external camera of host, and mobile terminal
CN117055833A (en) Screen transmission method, device and storage medium
CN104170317A (en) Communication control system and control device
CN104023191A (en) Android-based camera projection system and implementation method
CN102855866A (en) Terminal, display terminal, display system and display method
CN105389534A (en) Two-dimensional-code-based information transmission method and system of mobile terminal
AU2020305669B2 (en) Special effect synchronization method, device, and storage medium
CN104796308A (en) Method and system for network interconnection of devices
US10877914B2 (en) Electronic apparatus device and control method including a host communicating with a plurality of connectors in a lump through a bus line
CN114063949A (en) Remote control method and system thereof
CN106954088B (en) Touch control method and touch control all-in-one machine
CN106354462A (en) Method, equipment and system for synchronously displaying document in multiple equipment
CN111586451A (en) Television and mobile phone bidirectional operation system
KR100676366B1 (en) Method and system for controlling computer using touchscrren of portable wireless terminal
CN111601121A (en) Equipment connection method and system in wireless video transmission system
CN109361915B (en) Wired network camera installation test method
US20140085486A1 (en) Information processing terminal, information processing method, and apparatus control system
CN112003928B (en) Multifunctional screen synchronous control method, device and equipment
CN101969479B (en) Network interconnection method of joined screen control systems and device thereof
CN117859130A (en) Data transmission method, device, conference system, wireless screen transmitter and storage medium
CN113934396A (en) On-screen display method, device and system
WO2022021482A1 (en) Multi-interface wireless same-screen apparatus and wireless same-screen method
EP3439311B1 (en) Image transmission equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20220218