CN107948565B - Method and device for realizing wired screen transmission - Google Patents

Method and device for realizing wired screen transmission Download PDF

Info

Publication number
CN107948565B
CN107948565B CN201611039423.XA CN201611039423A CN107948565B CN 107948565 B CN107948565 B CN 107948565B CN 201611039423 A CN201611039423 A CN 201611039423A CN 107948565 B CN107948565 B CN 107948565B
Authority
CN
China
Prior art keywords
equipment
usb
usb interface
port
audio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201611039423.XA
Other languages
Chinese (zh)
Other versions
CN107948565A (en
Inventor
庞远杨
侯旻翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Shiyuan Electronics Thecnology Co Ltd
Guangzhou Shirui Electronics Co Ltd
Original Assignee
Guangzhou Shiyuan Electronics Thecnology Co Ltd
Guangzhou Shirui Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Shiyuan Electronics Thecnology Co Ltd, Guangzhou Shirui Electronics Co Ltd filed Critical Guangzhou Shiyuan Electronics Thecnology Co Ltd
Priority to PCT/CN2017/103469 priority Critical patent/WO2018090722A1/en
Publication of CN107948565A publication Critical patent/CN107948565A/en
Application granted granted Critical
Publication of CN107948565B publication Critical patent/CN107948565B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43632—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wired protocol, e.g. IEEE 1394
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43632—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wired protocol, e.g. IEEE 1394
    • H04N21/43635—HDMI

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Information Transfer Systems (AREA)

Abstract

The invention relates to a method and a device for realizing wired screen transmission. The method comprises the following steps: the method comprises the steps that a plurality of communication protocol ports are provided for first equipment through a first USB interface of a home terminal, the communication protocol ports can be identified by a general driver of the first equipment, and USB communication connection between the home terminal and the first equipment is established through the communication protocol ports and the first USB interface; detecting that the first USB interface has information from first equipment, detecting a communication protocol port for transmitting the information, and identifying the information as audio and video data if the port is used for transmitting the audio and video data; audio and video data are forwarded to second equipment through a second USB interface of the home terminal; and when detecting that the second USB interface has the control signal from the second equipment, adapting the control signal to a port for transmitting the control signal, and sending the control signal to the first equipment through the first USB interface. The invention can simplify the wiring during screen transmission and reduce the wiring difficulty for users.

Description

Method and device for realizing wired screen transmission
Technical Field
The invention relates to the technical field of data transmission, in particular to a method and a device for realizing wired screen transmission.
Background
The screen transmission realization mode is that the display source equipment such as a computer intercepts the screen page and the sound data of the system and sends the data to the display equipment, and the display equipment decodes, displays and plays the sent pictures and sound. The pass screen is often used in meeting or teaching field, and the user needs to show the audio and video signal of computer on projecting the liquid crystal whiteboard or the projector of large-size screen, and audio and video data on the computer is sent to display device through corresponding data line. However, in the conventional display mode of the transmission screen, the display device is only used as an information display function, and does not have the functions of receiving the operation instruction of the user and returning the operation instruction to the display source, so that the user is inconvenient to perform the demonstration operation.
Based on this, in a screen transmission mode based on the touch screen display device, it is proposed that an operation signal of the first device detected by the display device is fed back to the computer terminal, and correspondingly, a connecting line for transmitting the control signal needs to be added between the computer and the display device. Therefore, two or more connecting wires (HDMI cable + USB cable/RS 232 cable, VGA cable + audio cable + USB cable or RS232 cable, etc.) are required between the computer and the display device. The problem that the wiring is complex and the requirement on the professional level of a user is high exists.
Disclosure of Invention
Based on this, the method and the device for realizing wired screen transmission provided by the embodiment of the invention can simplify the wiring during screen transmission display and reduce the wiring difficulty for users.
One aspect of the present invention provides a method for implementing wired screen transmission, including:
providing a plurality of communication protocol ports for first equipment through a first USB interface of a local terminal, wherein the communication protocol ports can be identified by a universal driver of the first equipment; the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, the communication protocol port comprising at least: the port used for transmitting audio and video data and the port used for transmitting the control signal;
establishing a USB communication connection between the local terminal and the first device through the communication protocol port and the first USB interface;
detecting that the first USB interface has information from first equipment, detecting a communication protocol port for transmitting the information, and identifying the information as audio and video data if the port is used for transmitting the audio and video data; the audio and video data are forwarded to second equipment through a second USB interface of the local terminal, and the second equipment is instructed to play corresponding audio and video after receiving the audio and video data;
and when detecting that the second USB interface has the control signal from the second equipment, adapting the control signal to a port for transmitting the control signal, sending the control signal to the first equipment through the first USB interface, and indicating the first equipment to execute an action corresponding to the control signal after receiving the control signal.
Another aspect of the present invention provides a method for implementing wired screen transmission, including:
identifying a communication protocol port provided by USB equipment accessed to a USB interface of first equipment through a pre-installed universal driver; the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, the communication protocol port comprising at least: the port used for transmitting audio and video data and the port used for transmitting the control signal; the USB equipment is provided with a first USB interface, the USB equipment is accessed to the first equipment USB interface through the first USB interface, and a plurality of communication protocol ports which can be identified by the universal drive of the first equipment are provided through the first USB interface;
capturing a picture and audio played by first equipment; transmitting the intercepted audio and video data to a first USB interface of the USB equipment through a corresponding port of the USB interface of the first equipment, wherein the corresponding port is adapted to a port for transmitting the audio and video data;
receiving information from a first USB interface of the USB equipment through the USB interface of the first equipment, and detecting a communication protocol port for transmitting the information; and if the port is used for transmitting the control signal, identifying the information as the control signal, and enabling the first equipment to execute the action corresponding to the control signal.
The invention also provides a method for realizing wired screen transmission, which comprises the following steps:
detecting that a USB device is accessed to a USB interface of second equipment, and identifying whether the USB device meets the requirement or not; the USB equipment is provided with a second USB interface, and the USB equipment is accessed to the USB interface of the second equipment through the second USB interface;
if the USB equipment meets the requirements, receiving audio and video data forwarded through a second USB interface of the USB equipment through the USB interface of the second equipment, and playing corresponding audio and video on the second equipment;
the method comprises the steps of obtaining a control signal of first equipment, detected by second equipment, sending the control signal to a second USB interface of the USB equipment through a USB interface of the second equipment, returning to the first equipment through a first USB interface of the USB equipment, and indicating the first equipment to execute an action corresponding to the control signal after receiving the control signal.
The invention also provides a device for realizing wired screen transmission, which comprises:
the port simulation module is used for providing a plurality of communication protocol ports for the first equipment through a first USB interface of the local terminal, and the communication protocol ports can be identified by a universal driver of the first equipment; the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, the communication protocol port comprising at least: the port used for transmitting audio and video data and the port used for transmitting the control signal;
the connection establishing module is used for establishing the USB communication connection between the local terminal and the first equipment through the communication protocol port and the first USB interface;
the audio and video data forwarding module is used for detecting that the first USB interface has information from the first equipment, detecting a communication protocol port for transmitting the information, and identifying the information as audio and video data if the port is used for transmitting the audio and video data; the audio and video data are forwarded to second equipment through a second USB interface of the local terminal, and the second equipment is instructed to play corresponding audio and video after receiving the audio and video data;
and the control signal returning module is used for adapting the control signal to a port for transmitting the control signal when detecting that the second USB interface has the control signal from the second equipment, transmitting the control signal to the first equipment through the first USB interface, and indicating the first equipment to execute an action corresponding to the control signal after receiving the control signal.
The invention also provides a device for realizing wired screen transmission, which comprises:
a USB identification module, configured to identify, through a pre-installed generic driver, a communication protocol port provided by a USB device connected to a USB interface of a first device, where the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, and the communication protocol port at least includes: the port used for transmitting audio and video data and the port used for transmitting the control signal; the USB equipment is provided with a first USB interface, the USB equipment is accessed to the first equipment USB interface through the first USB interface, and a plurality of communication protocol ports which can be identified by the universal drive of the first equipment are provided through the first USB interface;
the audio and video capture module is used for capturing the picture and the audio played by the first equipment;
the audio and video transmission module is used for transmitting the intercepted audio and video data to a first USB interface of the USB equipment through a corresponding port of the USB interface of the first equipment, and the corresponding port is adapted to a port for transmitting the audio and video data;
the control signal receiving module is used for receiving information from a first USB interface of the USB equipment through the USB interface of the first equipment and detecting a communication protocol port for transmitting the information; and if the port is used for transmitting the control signal, identifying the information as the control signal, and enabling the first equipment to execute the action corresponding to the control signal.
The invention also provides a device for realizing wired screen transmission, which comprises:
the USB access detection module is used for detecting that the USB equipment is accessed into the USB interface of the second equipment and identifying whether the USB equipment meets the requirement; the USB equipment is provided with a second USB interface, and the USB equipment is accessed to the USB interface of the second equipment through the second USB interface;
the audio and video data receiving module is used for receiving audio and video data forwarded by a second USB interface of the USB equipment through the second USB interface of the second equipment if the USB equipment meets the requirement, and playing corresponding audio and video on the second equipment;
and the control signal sending module is used for acquiring a control signal of second equipment, sending the control signal to a second USB interface of the USB equipment through a USB interface of the second equipment, and returning the control signal to the first equipment through a first USB interface of the USB equipment so that the first equipment executes an action corresponding to the control signal.
According to the technical scheme, standard USB equipment is simulated in advance, a plurality of communication protocol ports required by the display source equipment are provided for the display source equipment through a USB interface of the simulated USB equipment, and wired screen transmission connection between the display source equipment and the display equipment is established through the simulated USB equipment; when detecting that a first USB interface of the simulated USB equipment has information from display source equipment, detecting a communication protocol port for transmitting the information, and if the port is used for transmitting audio and video data, identifying the information as the audio and video data; the audio and video data are forwarded to display equipment through a second USB interface of the local terminal, so that corresponding audio and video are played on the display equipment; when the second USB interface of the simulated USB equipment is detected to have the control signal from the display equipment, the control signal is adapted to a port for transmitting the control signal and is sent to the display source equipment through the first USB interface, so that the display source equipment executes the action corresponding to the control signal, and the effect of controlling the display source equipment at the display equipment end is realized. Based on the simulation USB device, the display source device and the display device can realize the screen transmission display of audio and video data only by one connecting wire, and meanwhile, the back transmission of control signals of the display device can also be realized, so that the wiring for screen transmission display is simplified, and the wiring difficulty of a user is reduced.
Drawings
FIG. 1 is a schematic diagram of a system environment for implementing a method for wired screen transmission according to the present invention;
FIG. 2 is a schematic flow chart diagram of a method of implementing wired pass screen according to an embodiment;
FIG. 3 is a detailed flowchart of a method for implementing cable screen transmission according to an embodiment;
FIG. 4 is a schematic flow chart of a method for implementing wired screen transmission according to a second embodiment;
fig. 5 is a detailed flowchart of a method for implementing wired screen transmission by a display source device according to a second embodiment;
FIG. 6 is a schematic flow chart of a method for implementing wired screen transmission according to a third embodiment;
fig. 7 is a detailed flowchart of a method for implementing wired screen transmission by a display device according to a third embodiment;
FIG. 8 is a schematic block diagram of an apparatus implementing wired pass screen according to an embodiment;
fig. 9 is a schematic configuration diagram of an apparatus for implementing wired screen transmission of the second embodiment;
fig. 10 is a schematic configuration diagram of an apparatus for implementing wired screen transmission of the third embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Fig. 1 is a schematic diagram of a system environment for implementing the method for wired screen transmission according to the present invention. As shown in fig. 1, the system environment of the embodiment of the present invention includes a display source device (i.e., a first device), a circuit a (i.e., an analog USB device), and a display device (i.e., a second device). The display source device can be a device or a system such as a PC (personal computer), a mobile phone and the like running with an operating system, and the system is provided with at least one pre-installed universal driver which provides a universal communication protocol for communication between the first device and the standard USB device. The display source device is also provided with at least one USB interface (namely a USB interface D/a third USB interface), and the attribute of the USB interface is set as a USB host. The display device is a device or system running an operating system, such as a large-screen electronic whiteboard, and is further provided with at least one USB interface (i.e., a USB interface a/a fourth USB interface), and the attribute of the USB interface is set as a USB host.
The circuit A is provided with a USB interface, a memory and a processor. The USB interfaces comprise a USB interface C and a USB interface B (namely a first USB interface and a second USB interface), and the attributes of the two USB interfaces are USB devices which are respectively used for being connected with the display source equipment and the display equipment. An embedded operating system can be operated in the circuit A and is connected with the display source equipment through a USB interface C; the USB interface B may be a common USB interface, and is used for being connected to a display device such as an intelligent tablet (or other large-screen device), and is driven and identified by a system of the display device. The circuit A can be combined with the USB wire to form a customized special USB wire, and can also exist in a mode of combining the USB dongle with the circuit A and the standard USB wire. One of the purposes of the memory is a downloader required for storing a specific program or programs required for the display source device or the display device. The circuit a may obtain power directly through the USB interface of the display source device or the USB interface of the display device.
Based on the system environment diagram shown in fig. 1, fig. 2 is a schematic flow chart of a method for implementing wired screen transmission according to an embodiment; in this embodiment, the method is applied to a circuit a as an example, where the circuit a includes a first USB interface and a second USB interface, and the first USB interface and the second USB interface are respectively used for accessing a display source device and a display device.
As shown in fig. 2, the method for implementing wired screen transmission in this embodiment includes the steps of:
s11, providing a plurality of communication protocol ports to the first device through the first USB interface of the local terminal, where the communication protocol ports can be identified by a generic driver of the first device, and the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, and the communication protocol ports at least include: the port used for transmitting audio and video data and the port used for transmitting the control signal;
in this embodiment, the first device is a display source device, and the local terminal is referred to as a circuit a. The circuit A can be simulated into a plurality of types of standard USB equipment and provides corresponding communication protocol ports, and the pre-installed universal driver of the display source equipment can independently drive the different types of standard USB equipment. Circuit a simulates a standard USB device, showing that the source device can recognize it without driving (i.e., by a generic driver, without a specific generic driver).
In this embodiment, the USB interface is a physical concept, and the communication protocol ports provided through the USB interface are abstract concepts facing the USB connection service, and different communication protocol ports can be distinguished through corresponding port identifiers, for example, through port numbers. In this embodiment, the port identifier of each communication protocol port can be identified by the universal USB driver, and the processor in the circuit a also transmits and receives various types of information (including audio and video data or control signals) through the port identifier of the communication protocol port, so as to realize transmission and reception of various types of information through the same physical interface.
Correspondingly, the circuit a can be simulated as a plurality of types of standard USB devices, which means that the circuit a can enumerate a plurality of standard USB communication protocol ports based on a common standard USB communication protocol, and different USB communication protocol ports are distinguished by using different port identifiers.
S12, establishing a USB communication connection between the local terminal and the first device through the communication protocol port and the first USB interface;
preferably, the communication protocol port further includes: and a port for transmitting connection information. When the circuit A confirms that the USB communication connection between the local terminal and the first equipment is established, a connection success instruction can be generated; and adapting the connection success instruction to a port for transmitting connection information, and sending the connection success instruction to the first equipment through the first USB interface.
S13, detecting that the first USB interface has information from the first device, detecting a communication protocol port for transmitting the information, and identifying the information as audio and video data if the port is used for transmitting the audio and video data; the audio and video data are forwarded to second equipment through a second USB interface of the local terminal, and the second equipment is instructed to play corresponding audio and video after receiving the audio and video data;
in this embodiment, the second device is a display device.
And S14, when detecting that the second USB interface has the control signal from the second device, adapting the control signal to a port for transmitting the control signal, and sending the control signal to the first device through the first USB interface, so that the first device executes an action corresponding to the control signal.
The execution sequence of steps S13 and S14 is not limited to the above sequence, and the execution sequence of the two parts may be switched or may be executed simultaneously.
The display source equipment is provided with corresponding client software for receiving screen transmission operation of a user. The communication protocol port further comprises: a port for accessing a memory space. After the display source equipment is successfully connected with the circuit A, if a software program for intercepting a currently played display picture and audio is installed in advance in the display source equipment, the currently played display picture and audio are intercepted through the software program, and are sent to the circuit A after being packaged (at this time, the circuit A is equivalent to a simulated USB device); if the display source device is not provided with a software program for intercepting the currently played display picture and audio, the data or the software program for intercepting the currently played display picture and audio stored in the memory of the circuit A can be read by accessing the memory (storage space) of the circuit A, and the software program is packaged (at this moment, the circuit A is equivalent to an external USB flash disk), and then the packaged audio and video data is sent to the circuit A (at this moment, the circuit A is equivalent to an analog USB device). The second method has lower requirements on the display source device, and even if the corresponding program is not installed in advance, the relevant functions can be realized by accessing the memory of the circuit a, and for the display source device (such as a PC), when the circuit a is inserted, a "removable disk", namely the storage space of the circuit a, can be seen in the root directory of the my computer, so that the display source device can run the application program stored in advance from the "removable disk", and further realize the plug and play effect. And after the circuit A receives the audio and video data from the USB interface C, the audio and video data are forwarded to the display equipment through the USB interface B, so that the transmission screen display of the audio and video data is realized.
On the other hand, the circuit a can also receive a control signal of the display device from the USB interface B, the control information can be sent between the display device and the circuit a based on the predetermined port information, and after receiving the control signal of the display device, the circuit a adapts the control signal to a port for transmitting the manipulation signal, so that the manipulation signal of the display device can be transmitted back to the display source device through the USB interface C, so that the display source device converts the manipulation signal into a corresponding manipulation event and executes a corresponding manipulation action. For example: the circuit a converts the touch event into an HID touch event, which is simulated as an HID touch device, and submits the HID touch event to the display source device system through the USB interface C, in a manner that is conventional for the display source device system to handle touch events of the HID touch device. The types of the manipulation signal include: touch control signals, infrared remote control signals or mouse/keyboard control signals and the like; the action corresponding to the control signal can be any action which can be executed at the display source device.
Based on the circuit A, on one hand, various USB communication protocol ports required to be used can be provided for common display source equipment, the display source equipment can recognize the display source equipment without driving, and the corresponding audio and video data interception function can be completed according to the data information stored in the circuit A, so that the plug-and-play effect is realized; based on circuit A, only need a connecting wire alright realize that display source equipment and display device pass the screen and connect, can also realize the passback of display device control signal simultaneously, simplified the wiring that passes the screen display and show.
It is understood that, in the present embodiment, the port for transmitting connection information and the port for transmitting audio/video information may be an HID1 port and an HID2 port, respectively; the port for transmitting the memory access instruction may be a Mass port. In other words, the circuit a in this embodiment can be simulated as multiple types of communication protocol ports capable of being recognized by the display source terminal without driving through the USB interface C thereof according to actual needs, and can be driven by the universal driver of the display source terminal respectively and independently for transmitting different types of data information.
FIG. 3 is a detailed flowchart of a method for implementing cable screen transmission according to an embodiment; referring to fig. 3, a circuit a detects that the USB interface C has information from the display source device, detects a communication protocol port for transmitting the information, and identifies the information as a backhaul request command if the port is a port for transmitting a backhaul request; and forwarding the return request instruction to the display equipment through the USB interface B so that the display equipment returns the detected control signal. Specifically, the circuit a needs to execute the following steps:
s101, after a processor program of the circuit A starts to run, the circuit A is simulated into a standard USB device through USB interfaces B and C, and the display source device provided with the universal drive can recognize the standard USB device without driving.
S102, detecting whether the USB interface C has the display source equipment which meets the requirement;
and detecting whether the USB interface C is connected with equipment, and if so, further detecting whether the equipment is display source equipment meeting the requirements.
S103, detecting whether the USB interface B has the display equipment which meets the requirement to be accessed;
and detecting whether the USB interface B is connected with equipment, and if so, further detecting whether the equipment is display equipment meeting the requirements.
It is understood that the execution sequence of steps S102 and S103 is not limited to the example in the figure, and step S103 may be executed first, and then step S102 may be executed; or both parts may be performed simultaneously.
S104, generating a connection success instruction and confirming that the screen transmission connection is successful;
in this embodiment, the connection success instruction is adapted to a port for transmitting connection information, and is sent to the first device through the USB interface C; meanwhile, based on the protocol rule preset with the display device, a connection success instruction is sent to the display device through the USB interface B.
S105, detecting whether the USB interface C has audio and video file streams from the display source equipment;
in this embodiment, after detecting that the USB interface C has information from the display source device, the circuit a further detects a communication protocol port that transmits the information, and if the port is used for transmitting audio and video data, the circuit a may identify the information as audio and video data.
In this embodiment, the circuit a further provides a port for accessing the memory space to the display source device. Before the step, after detecting that the USB interface C has information from the display source device, the circuit a further detects a communication protocol port for transmitting the information, and if the communication protocol port is a port for accessing a storage space, the circuit a identifies the information as a storage space access instruction, and displays content information of a preset storage space to the display source device, so that a system interface of the display source device can be used for intercepting and capturing images and audio played by the display source device by running a program of the storage space. An exe executable program for intercepting audio and video data or download information of the corresponding program is stored in the storage space of the circuit A. Therefore, the display source device is used for capturing the currently played picture or audio by accessing the information of the storage space of the circuit a.
And S106, forwarding the audio and video file stream received by the USB interface C to the display equipment through the USB interface B.
In this embodiment, after the audio and video data is received by the circuit a, the received audio and video data can be identified according to the communication protocol port adopted by the circuit a, and the received audio and video data is directly forwarded to the second device through the USB interface B.
As a preferred embodiment, after recognizing that the received audio and video data is audio and video data, the circuit a may also monitor whether there is a preset trigger control signal for indicating information forwarding, and if the trigger control signal is monitored, forward the audio and video data to the second device through the USB interface B. The trigger control signal may be an operation signal that a preset button of the circuit a is pressed, or may be a specific touch control signal generated on a human-computer interaction interface provided by the circuit a, that is, a user may control the forwarding of the audio and video data by the circuit a in a hardware trigger mode/a software trigger mode, so as to flexibly control the effect of the screen transmission display.
S107, detecting whether the USB interface C has a return request instruction from the display source equipment;
in this embodiment, if the circuit a detects that the USB interface C has information from the display source device, the circuit a detects a communication protocol port for transmitting the information, and if the port is a port for transmitting the backhaul request, the circuit a may identify the information as the backhaul request command.
And S108, forwarding the received return request instruction to the display equipment through the USB interface B.
It can be understood that the above-mentioned trigger mechanism for forwarding audio/video data is also applicable to forwarding the return request instruction by the trigger circuit a, that is, the forwarding of the return request instruction by the circuit a can be controlled by a hardware trigger mode/a software trigger mode.
In this embodiment, the circuit a sends the received return request command to the display device through the USB interface B according to the protocol rule agreed between the circuit a and the display device.
It is understood that the execution sequence of steps S105 and S106 and steps S107 and S108 is not limited to the example in the figure, and steps S107 and S108 may be executed first, and then steps S105 and S106 may be executed; or both parts are executed in parallel according to respectively set time intervals.
S109, detecting whether the USB interface B has a control signal from the display equipment;
in this embodiment, the circuit a may detect whether the information received by the USB interface B from the display device is a control signal according to a protocol rule agreed with the display device.
S110, the control signal is adapted to a corresponding port which is provided by the circuit A for the display source equipment and used for transmitting control information, and the control signal is sent to the display source equipment through the USB interface C, so that the display source equipment executes an action corresponding to the control signal, and the effect of controlling the display source equipment at the display equipment end is achieved.
It can be understood that the above-mentioned trigger mechanism for forwarding audio/video data is also suitable for forwarding the control signal by the trigger circuit a, that is, the forwarding of the control signal by the circuit a can be controlled by a hardware trigger mode/a software trigger mode, so as to flexibly control the effect of multi-terminal control.
According to the wired screen transmission method, standard USB equipment is simulated in advance, a plurality of communication protocol ports required by the display source equipment are provided for the display source equipment through a USB interface of the simulated USB equipment, and wired screen transmission connection between the display source equipment and the display equipment is established through the simulated USB equipment; when detecting that a first USB interface of the simulated USB equipment has information from display source equipment, detecting a communication protocol port for transmitting the information, and if the port is used for transmitting audio and video data, identifying the information as the audio and video data; the audio and video data are forwarded to display equipment through a second USB interface of the local terminal, so that corresponding audio and video are played on the display equipment; when the second USB interface of the simulated USB equipment is detected to have the control signal from the display equipment, the control signal is adapted to the port for transmitting the control signal and is sent to the display source equipment through the first USB interface, so that the display source equipment executes the action corresponding to the control signal, and the effect of controlling the display source equipment at the display equipment end is achieved. Based on the simulation USB device, the display source device and the display device can realize the screen transmission display of audio and video data only by one connecting wire, and meanwhile, the back transmission of control signals of the display device can also be realized, so that the wiring for screen transmission display is simplified, and the wiring difficulty of a user is reduced.
FIG. 4 is a schematic flow chart of a method for implementing wired screen transmission according to a second embodiment; the present embodiment is applicable to a display source device. As shown in fig. 4, the method for implementing wired screen transmission in the present embodiment includes the following steps.
Step S21, identifying a communication protocol port provided by the currently accessed USB device (circuit a) through a pre-installed generic driver of the first device (display source device), where the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, and the communication protocol port at least includes: the port used for transmitting audio and video data and the port used for transmitting the control signal; the USB equipment is provided with a first USB interface, the USB equipment is accessed to the first equipment USB interface through the first USB interface, and a plurality of communication protocol ports which can be identified by the universal drive of the first equipment are provided through the first USB interface;
in this embodiment, a USB interface C of a circuit a is docked with a USB interface D of a display source device, where the attribute of the USB interface D is USB host; the display source device refers to a device serving as a display source.
Step S22, capturing the picture and audio played by the first device; transmitting the intercepted audio and video data to a first USB interface of the USB equipment through a corresponding port of the USB interface of the first equipment, wherein the corresponding port is adapted to a port for transmitting the audio and video data;
in this embodiment, the communication protocol port further includes: a port for accessing a memory space. The way of capturing the picture and audio played by the display source device may be: the implementation is realized by operating a program stored in the circuit a, specifically for example: generating a storage space access instruction according to user operation of a display source device, adapting the access instruction to a port for accessing a storage space, sending the access instruction to a USB interface C of the USB device so as to access a preset storage space of the USB device, and operating a program of the preset storage space through a system interface of the display source device so as to intercept and capture pictures and audio played by the display source device. Therefore, the corresponding program does not need to be installed in the display source equipment in advance, and convenience is provided for the user.
Preferably, the program of the preset storage space of the USB device can be run through a system interface of the display source device to compress and/or encode the captured audio and video data, so as to facilitate transmission.
Step S23, receiving information from the first USB interface of the USB device, and detecting the communication protocol port for transmitting the information; and if the port is used for transmitting the control signal, identifying the information as the control signal, and enabling the first equipment to execute the action corresponding to the control signal.
The execution sequence of steps S22 and S23 is not limited to the above sequence, and the execution sequence of the two parts may be switched or may be executed simultaneously.
Preferably, the user of the display source device may select whether to start the control signal backhaul function according to actual needs, and if so, after the connection is successfully established, the user may send a backhaul request to the display device through the circuit a, and correspondingly, the communication protocol port further includes: a port for transmitting backhaul requests. The specific mode is as follows: acquiring return request identification bit information preset by display source equipment, and determining whether a return request function of the display source equipment is in an open state or not according to the return request identification bit information; if yes, generating a return request instruction; and the return request instruction is adapted to a port for transmitting the return request, is sent to a USB interface C of the circuit A, and is sent to the display equipment through a USB interface B of the circuit A.
FIG. 5 is a detailed flowchart of a method for implementing cable screen transmission according to a second embodiment; referring to fig. 5, the steps to be performed by the source device are shown as follows:
s201, running a general driver of a display source device, and detecting whether a USB device (namely a circuit A) with a specific ID (PID/VID) conforming to the characteristics of the circuit A is accessed in a system background;
s202, if yes, whether a connection success instruction sent by the circuit A is received is confirmed;
in this embodiment, the universal driver of the display source device detects information from the USB interface C of the circuit a received by the USB interface D of the display source device, detects a communication protocol port for transmitting the information, and if the port is used for transmitting connection information, can identify whether the information is a connection success instruction according to the signal content.
S203, if the video and/or audio are received, the currently played picture and/or audio of the display source equipment are intercepted, then the video and/or audio are compressed or coded into a specific file format, and then the video and audio are sent to a connected circuit A;
preferably, a port for accessing the memory space is available from a communication protocol port provided by the circuit a to the display source device; and generating a storage space access instruction according to the user operation of the display source end, adapting the access instruction to the port for accessing the storage space, sending the access instruction to the USB interface C of the circuit A to access the preset storage space of the circuit A, and operating a program of the preset storage space through a system interface of the display source equipment to intercept and capture the picture and the audio played by the display source equipment. Therefore, the display source equipment does not need to be pre-installed with a corresponding program, and convenience is provided for a user.
And the audio and video data can be compressed and/or encoded by a program of a preset storage space of the display source device operating circuit A through a system interface of the display source device so as to be convenient for transmission. Because the interception code is stored in a U disk simulated by the circuit A, after the display source equipment is connected into the circuit A, exe program data stored in the circuit A can be viewed through a USB communication protocol port simulated in advance by a USB interface of the circuit A, and pictures and/or audios (including sound data and audio adjustment information such as volume, sound channels and the like) played currently by the display source equipment can be intercepted by operating related programs in the circuit A.
S204, confirming whether a return request function switch of the display source equipment is turned on (the user can select to turn on or turn off);
in this embodiment, after the connection is successful, whether the current backhaul request function of the display source device is in an on state may be determined by reading backhaul request flag bit information preset by the display source device.
S205, if the circuit is opened, a return request instruction is sent to the circuit A;
if the current return request function of the display source equipment is in an open state, generating a return request instruction according to user operation; acquiring a port for transmitting a return request from a communication protocol port provided by the circuit A to the display source equipment; and the data is sent to the USB interface C of the circuit A and is sent to the display equipment through the USB interface B of the circuit A.
S206, detecting whether a control signal returned by the USB interface C of the circuit A is received;
s207, if the control signal returned by the circuit a is received, a corresponding response action is executed.
In this embodiment, the detection USB interface D receives information from the USB interface C of the circuit a, detects a communication protocol port for transmitting the information, and if the detection USB interface D is a port for transmitting the control signal, can identify the returned control signal according to a conventional manner of processing the control signal of the external HID device, and enable the first device to execute an action corresponding to the control signal.
It is understood that the execution sequence of steps S204 and S205 and steps S206 to S207 is not limited to the example in the figure, and steps S206 to S207 may be executed first, and then steps S204 and S205 may be executed; or both parts are executed in parallel according to respectively set time intervals.
According to the wired screen transmission method, standard USB equipment is simulated in advance, a plurality of communication protocol ports required by the display source equipment are provided for the display source equipment through a USB interface of the simulated USB equipment, and wired screen transmission connection between the display source equipment and the display equipment is established through the simulated USB equipment; the requirement on the display source equipment is reduced, plug-and-play is realized, the display source equipment and the display equipment can realize the screen transmission display of audio and video data only by one connecting line, the back transmission of control signals of the display equipment can also be realized, the effect of controlling the display source equipment at the display equipment end is realized, the wiring of screen transmission display is simplified, and the wiring difficulty of a user is reduced.
FIG. 6 is a schematic flow chart of a method for implementing wired screen transmission according to a third embodiment; the present embodiment is applicable to a display device. As shown in fig. 6, the method for implementing wired screen transmission in the present embodiment includes the following steps.
S31, detecting that the USB device is accessed in the USB interface of the second device, and identifying whether the USB device is the USB device meeting the requirement; the USB equipment is provided with a second USB interface, and the USB equipment is accessed to the USB interface of the second equipment through the second USB interface;
in this embodiment, when it is detected that the USB interface a of the display device has a USB device access, whether the current access is the circuit a may be determined according to the PID and/or VID of the USB device. The display device is used for displaying audio and video information, and the attribute of the USB interface A is a USB host.
S32, if the device is a USB device which meets the requirement, receiving audio and video data forwarded by a second USB interface of the USB device through the USB interface of the second device, and playing corresponding audio and video on the second device;
preferably, after detecting that the USB interface a of the display device has the circuit a meeting the requirement, a connection response signal may be generated and sent to the USB interface B of the circuit a to inform the circuit a that the display device meets the requirement of audio/video transmission display, and the circuit a may confirm whether the connection is successful according to the information.
In this embodiment, in order to facilitate transmission, the audio/video data is compressed and/or encoded at the display source, and correspondingly decompressed and/or de-encoded at the display device, and then the corresponding picture and/or audio is played at the display device after the processing.
S33, acquiring a control signal of the first device detected by the second device, and sending the control signal to the second USB interface of the USB device, so as to return to the first device through the first USB interface of the USB device, and instruct the first device to execute an action corresponding to the control signal after receiving the control signal;
the types of the control signal in this embodiment may include: a touch control signal, an infrared remote control signal or a mouse/keyboard control signal; the action corresponding to the control signal can be any action which can be executed at the display source device.
FIG. 7 is a detailed flowchart of a method for implementing cable screen transmission according to a third embodiment; referring to fig. 7, the steps to be performed by the display device are as follows:
s301, after the display device system program runs, whether a USB device (namely, a circuit A) with a specific ID is accessed or not is detected.
In this embodiment, the ID is a USB ID (PID or VID) of the circuit a preset in the program; thus, whether the circuit a is connected to the USB interface a of the display device is detected.
S302, if the circuit A is detected to be accessed, sending data information with a specified format through a USB interface A, and informing the circuit A that the home terminal meets the requirement of audio and video transmission and display;
s303, detecting whether the USB interface B of the circuit A has audio and video file stream transmission;
since the display device can be a customized terminal, the type of the signal transmitted by the USB interface B of the circuit a can be automatically identified. Namely, the display device can identify whether the audio/video data or the returned request instruction or the instruction of successful connection is sent by the circuit a.
In this embodiment, the audio/video file stream is data that is subjected to compression and encoding processing.
S304, if the audio and video file stream transmitted by the circuit A is received, the audio and video data are obtained through decompression or decoding, and then corresponding pictures and audio are output, and screen transmission display of the display device and the display source device is achieved.
Preferably, the display device may further reply a preset message to the circuit a, and forward the preset message to the display source device through a communication protocol port pre-simulated by the circuit a, so as to notify the display source device that the screen transmission display is successful.
S305, detecting whether a control signal return request is transmitted from the USB interface B of the circuit A or not;
in this embodiment, the display device may detect the information from the USB interface B of the circuit a, and identify whether the information is a return request command.
And S306, if the control signal feedback request is detected, acquiring a control signal of the display source device detected by the local terminal, and sending the control signal to the circuit A.
The display device obtains a control signal for controlling the display source device, which is detected by the local terminal, by running a preset program, wherein the signal type includes but is not limited to a touch control signal, an infrared remote control signal or a mouse/keyboard control signal.
Through the method for realizing the wired screen transmission of the embodiment, the circuit A can be simulated into a plurality of types of USB equipment through the USB interface, so that the display source equipment can be free from special drive identification. The circuit A also obtains the data stream of the control signal from the display equipment and adapts to the corresponding port provided for the display source equipment for transmission; the code for intercepting the audio and video data is a system interface of the display source equipment, but the corresponding exe program data can be stored in a U disk simulated by the circuit A. The circuit A is also simulated into a USB storage device, and program data or a program downloader used for data communication and capturing audio and video data of the display source device is stored. After the display source device establishes a USB connection with circuit a, the USB storage device emulated by circuit a may be accessed to run corresponding exe program data for capturing the picture or audio of the display source device. The display source equipment can also pack audio and video data according to an agreed protocol by operating corresponding exe program data stored in the circuit A, the audio and video data are provided for a corresponding communication protocol port of the display source equipment through the circuit A and are transmitted to the circuit A, and the circuit A receives a data packet from the USB interface C, does not change the content of the packet and directly forwards the data packet to the display equipment through the USB interface B. And the display equipment receives the data packet, analyzes the protocol and the packet content, and then decodes the audio and video data for playing.
The display device software can also acquire a touch operation signal (or other types of control signals) of the user to the display source device through the display device, and the touch operation signal is returned to the circuit A through the USB interface A, and the circuit A adapts the operation signal to the corresponding communication protocol port, so that the operation signal is submitted to the display source device to be executed. The display source device identifies the transmitted touch operation signal according to the corresponding communication protocol port provided by the USB interface C of the circuit a, and converts the touch operation signal into a control event (the process of converting the touch operation signal into the touch event is supported by the operating system of the display source device, and WINDOWS/MAC both have the function), so that the display source device executes an action corresponding to the control signal.
It should be noted that, for the sake of simplicity, the foregoing method embodiments are described as a series of acts or combinations, but those skilled in the art should understand that the present invention is not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the present invention.
Based on the same idea as the method for realizing the wired screen transmission in the embodiment, the invention also provides a device and a system for realizing the wired screen transmission, and the device and the system can be used for executing the method for realizing the wired screen transmission. For convenience of illustration, the schematic structural diagrams of the embodiments of the device and the system for implementing wired screen transmission only show the parts related to the embodiments of the present invention, and those skilled in the art will understand that the illustrated structures do not constitute a limitation to the devices and the systems, and may include more or less components than those illustrated, or combine some components, or arrange different components.
Fig. 8 is a schematic structural diagram of an apparatus for implementing wired screen transmission according to an embodiment of the present invention, and as shown in fig. 8, the apparatus for implementing wired screen transmission according to the embodiment includes: the port simulation module 510, the connection establishment module 520, the audio/video data forwarding module 530, and the control signal returning module 540 are described in detail as follows:
the port simulation module 510 is configured to provide a plurality of communication protocol ports to the first device through the first USB interface of the local terminal, where the communication protocol ports are capable of being identified by a generic driver of the first device, the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, and the communication protocol ports at least include: the port used for transmitting audio and video data and the port used for transmitting the control signal;
the connection establishing module 520 is configured to establish a USB communication connection between the local terminal and the first device through the communication protocol port and the first USB interface;
the audio/video data forwarding module 530 is configured to detect that the first USB interface has information from the first device, detect a communication protocol port for transmitting the information, and identify the information as audio/video data if the port is used for transmitting the audio/video data; the audio and video data are forwarded to second equipment through a second USB interface of the local terminal, and the second equipment is instructed to play corresponding audio and video after receiving the audio and video data;
as a preferred embodiment, after the audio/video data forwarding module 530 identifies the information as audio/video data, it further monitors whether there is a preset trigger control signal for indicating information forwarding, and if it monitors the preset trigger control signal for indicating information forwarding, forwards the audio/video data to the second device through the second USB interface of the local terminal. The trigger control signal comprises an operation signal that a preset control button is pressed down and can also comprise a touch control signal monitored through a preset human-computer interaction interface. Therefore, the user can flexibly control the screen transmission display effect.
The control signal returning module 540 is configured to adapt the control signal to a port for transmitting the control signal when detecting that the second USB interface has the control signal from the second device, and send the control signal to the first device through the first USB interface, so as to instruct the first device to execute an action corresponding to the control signal after receiving the control signal.
Preferably, the communication protocol port further includes: a port for transmitting connection information; correspondingly, the device for realizing wired screen transmission further comprises a connection confirmation module (not shown in the figure) for generating a connection success instruction, adapting the connection success instruction to a port for transmitting connection information, and sending the connection success instruction to the first device through the first USB interface.
Preferably, the communication protocol port further includes: a port for transmitting a backhaul request; correspondingly, the device for realizing wired screen transmission further includes a return request module (not shown in the figure) for detecting that the first USB interface has information from the first device, detecting a communication protocol port for transmitting the information, and identifying the information as a return request instruction if the port is used for transmitting a return request; and forwarding the return request instruction to the second equipment through the second USB interface, so that the second equipment returns the detected control signal of the first equipment.
Preferably, the communication protocol port further includes: a port for accessing a memory space; correspondingly, the device for implementing wired screen transmission further includes a storage module 550, configured to detect that the first USB interface has information from the first device, detect a communication protocol port for transmitting the information, and identify the information as a storage space access instruction if the port is a port for accessing a storage space; and displaying the preset storage space to the first equipment, so that a system interface of the first equipment intercepts and captures the picture and the audio played by the first equipment by operating a program of the storage space.
In this embodiment, the attributes of the first USB interface and the second USB interface are both USB device; the first device is a display source device, and the second device is a display device.
Fig. 9 is a schematic configuration diagram of an apparatus for implementing wired screen transmission of the second embodiment. As shown in fig. 9, the apparatus for implementing wired screen transmission of the present embodiment includes:
a USB identification module 610, configured to identify, through a pre-installed generic driver, a communication protocol port provided by a USB device accessing a USB interface of a first device, where the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, and the communication protocol port at least includes: the port used for transmitting audio and video data and the port used for transmitting the control signal; the USB equipment is provided with a first USB interface, the USB equipment is accessed to the first equipment USB interface through the first USB interface, and a plurality of communication protocol ports which can be identified by the universal drive of the first equipment are provided through the first USB interface;
the audio/video capture module 620 is configured to capture a picture and an audio played by the first device;
the audio/video transmitting module 630 is configured to transmit the audio/video data to the first USB interface of the first device through a corresponding port of the USB interface of the first device, where the corresponding port is adapted to a port for transmitting the audio/video data.
The control signal receiving module 640 is configured to receive information from the first USB interface of the USB device, and detect a communication protocol port for transmitting the information; and if the port is used for transmitting the control signal, identifying the information as the control signal, and enabling the first equipment to execute the action corresponding to the control signal.
Preferably, the communication protocol port further includes: a port for accessing a memory space; correspondingly, the audio/video capture module 620: the method specifically comprises the steps of adapting a generated access instruction to a port for accessing a storage space, sending the access instruction to a first USB interface of the USB device through a USB interface of the first device to access a preset storage space of the USB device, and operating a program of the preset storage space through a system interface of the first device to intercept and capture pictures and audio played by the first device.
In this embodiment, the first device is a display source device; the attribute of the first USB interface is USB device.
Fig. 10 is a schematic configuration diagram of an apparatus for implementing wired screen transmission of the third embodiment. As shown in fig. 10, the apparatus for implementing wired screen transmission of the present embodiment includes:
the USB access detection module 710 is configured to detect that a USB device is accessed to the USB interface of the second device, and identify whether the USB device is a USB device that meets the requirement; the USB equipment is provided with a second USB interface, and the USB equipment is accessed to the USB interface of the second equipment through the second USB interface;
the audio/video data receiving module 720 is configured to receive, through a USB interface of a second device, audio/video data forwarded through a second USB interface of the USB device if the USB device meets the requirement, and play corresponding audio/video on the second device;
and a control signal sending module 730, configured to obtain a control signal of the first device detected by the second device, and send the control signal to the second USB interface of the USB device, so as to return to the first device through the first USB interface of the USB device, and instruct the first device to execute an action corresponding to the control signal after receiving the control signal.
In this embodiment, the second device is a display device, and the attribute of the second USB interface is USB device.
It should be noted that, in the above-mentioned embodiment of the device for implementing wired screen transmission, contents such as information interaction and execution process between modules/units are the same as those of the foregoing method embodiment of the present invention, and the technical effect brought by the above-mentioned method embodiment of the present invention is the same as that of the foregoing method embodiment of the present invention, and specific contents may refer to descriptions in the method embodiment of the present invention, and are not described herein again.
In addition, in the above-mentioned exemplary embodiment of the device for implementing a wired touch screen, the logical division of the functional modules is only an example, and in practical applications, the above-mentioned function distribution may be performed by different functional modules according to needs, for example, due to configuration requirements of corresponding hardware or due to convenience of implementation of software, that is, the internal structure of the device for implementing a wired touch screen is divided into different functional modules to perform all or part of the above-mentioned functions. The functional modules can be realized in a hardware mode or a software functional module mode.
It will be understood by those skilled in the art that all or part of the processes of the methods of the above embodiments may be implemented by a computer program, which is stored in a computer readable storage medium and sold or used as a stand-alone product. The program, when executed, may perform all or a portion of the steps of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments. It will be understood that the terms "first," "second," and the like as used herein are used herein to distinguish one object from another, but the objects are not limited by these terms.
The above-described examples merely represent several embodiments of the present invention and should not be construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (27)

1. A method for realizing wired screen transmission is characterized by comprising the following steps:
providing a plurality of communication protocol ports for first equipment through a first USB interface of a local terminal, wherein the communication protocol ports can be identified by a universal driver of the first equipment; the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, the communication protocol port comprising at least: the terminal generates a customized USB wire rod for combining with the USB wire rod, or exists in a mode of being carried in the USB dongle and combining the USB dongle with the USB wire rod;
establishing a USB communication connection between the local terminal and the first device through the communication protocol port and the first USB interface;
detecting that the first USB interface has information from first equipment, detecting a communication protocol port for transmitting the information, and identifying the information as audio and video data if the port is used for transmitting the audio and video data; the audio and video data are forwarded to second equipment through a second USB interface of the local terminal, and the second equipment is instructed to play corresponding audio and video after receiving the audio and video data;
detecting that the second USB interface has a control signal from the second equipment, adapting the control signal to a port for transmitting the control signal, and sending the control signal to the first equipment through the first USB interface, and instructing the first equipment to execute an action corresponding to the control signal after receiving the control signal.
2. The method for implementing wired screen transmission according to claim 1, wherein the communication protocol port further comprises: a port for transmitting connection information;
after establishing the USB communication connection between the local terminal and the first device through the communication protocol port and the first USB interface, the method further includes:
and generating a connection success instruction, adapting the connection success instruction to a port for transmitting connection information, and sending the connection success instruction to the first equipment through the first USB interface.
3. The method for implementing wired screen transmission according to claim 1, wherein the communication protocol port further comprises: a port for transmitting a backhaul request;
the method for detecting the information from the first device on the first USB interface further comprises the following steps after detecting a communication protocol port for transmitting the information:
if the port is used for transmitting the return request, the information is identified as a return request instruction; and forwarding the return request instruction to the second equipment through the second USB interface, so that the second equipment returns the detected control signal of the first equipment.
4. The method for implementing wired screen transmission according to claim 1, wherein the communication protocol port further comprises: a port for accessing a memory space;
the method for detecting the information from the first device on the first USB interface further comprises the following steps after detecting a communication protocol port for transmitting the information:
if the port is used for accessing the storage space, the information is identified as a storage space access instruction; and displaying the preset storage space to the first equipment, so that a system interface of the first equipment intercepts and captures the picture and the audio played by the first equipment by operating a program of the storage space.
5. The method for realizing wired screen transmission according to claim 1, wherein the step of forwarding the audio/video data to the second device through the second USB interface of the local terminal includes:
and if a preset trigger control signal for indicating information forwarding is monitored, forwarding the audio and video data to second equipment through a second USB interface of the local terminal.
6. The method for realizing the wired screen transmission according to claim 5, wherein the trigger control signal comprises an operation signal that a control button preset at the home terminal is pressed.
7. The method for realizing wired screen transmission according to any one of claims 1 to 6, wherein the attributes of the first USB interface and the second USB interface are both USB device;
the first device is a display source device and the second device is a display device.
8. A method for realizing wired screen transmission is characterized by comprising the following steps:
identifying a communication protocol port provided by USB equipment accessed to a USB interface of first equipment through a pre-installed universal driver; the generic driver provides a generic communication protocol for communication between the first device and the USB device, the communication protocol port comprising at least: the port used for transmitting audio and video data and the port used for transmitting the control signal; the USB equipment is provided with a first USB interface, the USB equipment is accessed to the USB interface of the first equipment through the first USB interface, and a plurality of communication protocol ports which can be identified by the universal drive of the first equipment are provided through the first USB interface, and the USB equipment generates a customized USB wire rod for being combined with the USB wire rod or exists in a mode of being carried in the USB wire rod and combining the USB wire rod with the USB wire rod;
capturing a picture and audio played by first equipment; transmitting the intercepted audio and video data to a first USB interface of the USB equipment through a corresponding port of the USB interface of the first equipment, wherein the corresponding port is adapted to a port for transmitting the audio and video data;
receiving information from a first USB interface of the USB equipment through the USB interface of the first equipment, and detecting a communication protocol port for transmitting the information; and if the port is used for transmitting the control signal, identifying the information as the control signal, and enabling the first equipment to execute the action corresponding to the control signal.
9. The method for implementing wired screen transmission according to claim 8, wherein the communication protocol port further comprises: a port for accessing a memory space;
the step of capturing the picture and the audio played by the first device comprises the following steps:
and the generated access instruction is adapted to a port for accessing a storage space, and is sent to a first USB interface of the USB equipment through a first equipment USB interface so as to access a preset storage space of the USB equipment, and a program of the preset storage space is operated through a first equipment system interface so as to intercept and capture pictures and audio played by the first equipment.
10. The method for implementing wired screen transmission according to claim 8, wherein the communication protocol port further comprises: a port for transmitting a backhaul request;
after identifying a communication protocol port provided by a USB device connected to the USB interface of the first device through the pre-installed universal driver, the method further comprises the following steps:
acquiring backhaul request identification bit information preset by first equipment, and determining whether a backhaul request function of the first equipment is in an open state according to the backhaul request identification bit information; if yes, generating a return request instruction;
and adapting the return request instruction to a port for transmitting the return request, and sending the return request instruction to a first USB interface of the USB equipment through the USB interface of the first equipment.
11. The method for implementing wired screen transmission according to claim 9, wherein before adapting the captured audio-video data to the communication protocol port, further comprising:
and operating a program of a preset storage space of the USB device through a first device system interface to compress and/or encode the intercepted audio and video data.
12. The method for realizing the wired screen transmission according to any one of claims 8 to 11, wherein the first device is a display source device, and the attribute of the USB interface of the first device is USB host; the attribute of the first USB interface is USB device.
13. A method for realizing wired screen transmission is characterized by comprising the following steps:
detecting that a USB device is accessed to a USB interface of second equipment, and identifying whether the USB device meets the requirement or not; the USB equipment is provided with a second USB interface, the USB equipment is accessed to the USB interface of the second equipment through the second USB interface, and the USB equipment generates a customized USB wire rod for combining with the USB wire rod or exists in a mode of being carried in a USB dongle and combining the USB dongle with the USB wire rod;
if the USB equipment meets the requirements, receiving audio and video data forwarded through a second USB interface of the USB equipment through the USB interface of the second equipment, and playing corresponding audio and video on the second equipment;
the method comprises the steps of obtaining a detected control signal for first equipment, sending the control signal to a second USB interface of the USB equipment through a USB interface of the second equipment, and returning to the first equipment through the first USB interface of the USB equipment to enable the first equipment to execute an action corresponding to the control signal.
14. The method for implementing wired screen transmission according to claim 13, wherein after identifying the USB device as a USB device meeting the requirements, the method further comprises:
and generating a connection response signal, and sending the connection response signal to a second USB interface of the USB equipment through the second equipment USB interface.
15. The method for realizing wired screen transmission according to claim 13, wherein after receiving the audio and video data forwarded through the second USB interface of the USB device through the second USB interface of the second device, the method further comprises:
and decompressing and/or decoding the audio and video data.
16. The method for implementing wired screen transmission according to claim 13, wherein the types of the manipulation signals include: touch control signals, infrared remote control signals, or mouse/keyboard control signals.
17. The method for realizing wired screen transmission according to any one of claims 13 to 16,
the second equipment is display equipment, and the attribute of the USB interface of the second equipment is USB host;
the attribute of the second USB interface is USB device.
18. An apparatus for implementing wired screen transmission, comprising:
a port simulation module, configured to provide a plurality of communication protocol ports to a first device through a first USB interface of a local terminal, where the communication protocol ports are identifiable by a generic driver of the first device, and the generic driver provides a generic communication protocol for communication between the first device and a standard USB device, and the communication protocol ports at least include: the terminal generates a customized USB wire rod for combining with the USB wire rod, or exists in a mode of being carried in the USB dongle and combining the USB dongle with the USB wire rod;
the connection establishing module is used for establishing the USB communication connection between the local terminal and the first equipment through the communication protocol port and the first USB interface;
the audio and video data forwarding module is used for detecting that the first USB interface has information from the first equipment, detecting a communication protocol port for transmitting the information, and identifying the information as audio and video data if the port is used for transmitting the audio and video data; the audio and video data are forwarded to second equipment through a second USB interface of the local terminal, and the second equipment is instructed to play corresponding audio and video after receiving the audio and video data;
and the control signal returning module is used for adapting the control signal to a port for transmitting the control signal when detecting that the second USB interface has the control signal from the second equipment, transmitting the control signal to the first equipment through the first USB interface, and indicating the first equipment to execute an action corresponding to the control signal after receiving the control signal.
19. The device for implementing wired screen transmission according to claim 18, wherein the communication protocol port further comprises: a port for transmitting connection information;
the device for realizing wired screen transmission further comprises:
and the connection confirmation module is used for generating a connection success instruction, adapting the connection success instruction to a port for transmitting connection information, and sending the connection success instruction to the first equipment through the first USB interface.
20. The device for implementing wired screen transmission according to claim 18, wherein the communication protocol port further comprises: a port for transmitting a backhaul request;
the device for realizing wired screen transmission further comprises:
the return request module is used for detecting that the first USB interface has information from the first equipment and detecting a communication protocol port for transmitting the information; if the port is used for transmitting the return request, the information is identified as a return request instruction; and forwarding the return request instruction to the second equipment through the second USB interface, so that the second equipment returns the detected control signal of the first equipment.
21. The device for implementing wired screen transmission according to claim 18, wherein the communication protocol port further comprises: a port for accessing a memory space;
the device for realizing wired screen transmission further comprises:
the storage module is used for detecting that the first USB interface has information from the first equipment and detecting a communication protocol port for transmitting the information; if the port is used for accessing the storage space, the information is identified as a storage space access instruction; and displaying the preset storage space to the first equipment, so that a system interface of the first equipment is used for intercepting and capturing pictures and audio played by the first equipment by operating a program of the storage space.
22. A device for realizing wired screen transmission according to any one of claims 18 to 21, wherein the attributes of the first USB interface and the second USB interface are USB device;
the first device is a display source device and the second device is a display device.
23. An apparatus for implementing wired screen transmission, comprising:
the USB identification module is used for identifying a communication protocol port provided by the USB equipment accessed to the USB interface of the first equipment through the pre-installed universal driver; the generic driver provides a generic communication protocol for communication between the first device and the USB device, the communication protocol port comprising at least: the port used for transmitting audio and video data and the port used for transmitting the control signal; the USB equipment is provided with a first USB interface, the USB equipment is accessed to the USB interface of the first equipment through the first USB interface, and a plurality of communication protocol ports which can be identified by the universal drive of the first equipment are provided through the first USB interface, and the USB equipment generates a customized USB wire rod for being combined with the USB wire rod or exists in a mode of being carried in the USB wire rod and combining the USB wire rod with the USB wire rod;
the audio and video capture module is used for capturing the picture and the audio played by the first equipment;
the audio and video transmission module is used for transmitting the intercepted audio and video data to a first USB interface of the USB equipment through a corresponding port of the USB interface of the first equipment, and the corresponding port is adapted to a port for transmitting the audio and video data;
the control signal receiving module is used for receiving information from a first USB interface of the USB equipment through the USB interface of the first equipment and detecting a communication protocol port for transmitting the information; and if the port is used for transmitting the control signal, identifying the information as the control signal, and enabling the first equipment to execute the action corresponding to the control signal.
24. The device for implementing wired screen transmission according to claim 23, wherein the communication protocol port further comprises: a port for accessing a memory space;
the audio and video capture module: and the system interface is used for adapting the generated access instruction to a port for accessing a storage space, sending the access instruction to a first USB interface of the USB equipment through the USB interface of the first equipment so as to access a preset storage space of the USB equipment, and operating a program of the preset storage space through the system interface of the first equipment so as to intercept and capture pictures and audio played by the first equipment.
25. The device for realizing wired screen transmission according to claim 23 or 24,
the first equipment is display source equipment, and the attribute of a USB interface of the first equipment is a USB host;
the attribute of the first USB interface is USB device.
26. An apparatus for implementing wired screen transmission, comprising:
the USB access detection module is used for detecting that the USB equipment is accessed into the USB interface of the second equipment and identifying whether the USB equipment meets the requirement; the USB equipment is provided with a second USB interface, the USB equipment is accessed to the USB interface of the second equipment through the second USB interface, and the USB equipment generates a customized USB wire rod for combining with the USB wire rod or exists in a mode of being carried in a USB dongle and combining the USB dongle with the USB wire rod;
the audio and video data receiving module is used for receiving audio and video data forwarded by a second USB interface of the USB equipment through the second USB interface of the second equipment if the USB equipment meets the requirement, and playing corresponding audio and video on the second equipment;
and the control signal sending module is used for acquiring the detected control signal for the first equipment, sending the control signal to a second USB interface of the USB equipment through a USB interface of the second equipment, and returning the control signal to the first equipment through the first USB interface of the USB equipment so as to enable the first equipment to execute an action corresponding to the control signal.
27. The device for realizing wired screen transmission according to claim 26,
the second equipment is display equipment, and the attribute of the USB interface of the second equipment is USB host;
the attribute of the second USB interface is USB device.
CN201611039423.XA 2016-10-12 2016-11-21 Method and device for realizing wired screen transmission Active CN107948565B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/103469 WO2018090722A1 (en) 2016-10-12 2017-09-26 Method and apparatus for realizing wired screen delivery

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610892653 2016-10-12
CN2016108926534 2016-10-12

Publications (2)

Publication Number Publication Date
CN107948565A CN107948565A (en) 2018-04-20
CN107948565B true CN107948565B (en) 2021-08-20

Family

ID=61929012

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611039423.XA Active CN107948565B (en) 2016-10-12 2016-11-21 Method and device for realizing wired screen transmission

Country Status (2)

Country Link
CN (1) CN107948565B (en)
WO (1) WO2018090722A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN208258096U (en) * 2018-06-11 2018-12-18 广州视源电子科技股份有限公司 Receiving device and wireless screen transmission system
CN110275855B (en) * 2018-07-05 2023-09-05 威锋电子股份有限公司 Signal transmission direction adjusting method and device and bidirectional signal repeater integrated circuit
CN112740168B (en) * 2019-07-26 2023-09-12 西安诺瓦星云科技股份有限公司 Wireless screen projection method and LED display
CN111314097A (en) * 2020-04-08 2020-06-19 上海明我信息技术有限公司 Data transmission method, transmission equipment and display equipment
CN112000374B (en) * 2020-07-13 2024-01-02 深圳市智微智能软件开发有限公司 USB touch screen replacement method, device, equipment and medium applied to android system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102404377A (en) * 2010-09-13 2012-04-04 现代自动车株式会社 Terminal having content interworking function and method thereof
TW201317879A (en) * 2011-10-20 2013-05-01 Magic Control Technology Corp Synchronized operation system and method for touch device
CN104572003A (en) * 2015-01-30 2015-04-29 深圳市国华光电科技有限公司 Second screen terminal and communication system with same
CN105045548A (en) * 2015-06-16 2015-11-11 广州视睿电子科技有限公司 Wireless screen transmission method, expansion equipment and wireless screen transmission system
CN205507739U (en) * 2016-02-04 2016-08-24 白思稼 Smart mobile phone expands screen device
WO2016142713A1 (en) * 2015-03-10 2016-09-15 Displaylink (Uk) Limited System for connecting external displays to a mobile device
CN105955685A (en) * 2016-04-25 2016-09-21 广州视睿电子科技有限公司 Control method, device and system for screen transmission demonstration content

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102404377A (en) * 2010-09-13 2012-04-04 现代自动车株式会社 Terminal having content interworking function and method thereof
TW201317879A (en) * 2011-10-20 2013-05-01 Magic Control Technology Corp Synchronized operation system and method for touch device
CN104572003A (en) * 2015-01-30 2015-04-29 深圳市国华光电科技有限公司 Second screen terminal and communication system with same
WO2016142713A1 (en) * 2015-03-10 2016-09-15 Displaylink (Uk) Limited System for connecting external displays to a mobile device
CN105045548A (en) * 2015-06-16 2015-11-11 广州视睿电子科技有限公司 Wireless screen transmission method, expansion equipment and wireless screen transmission system
CN205507739U (en) * 2016-02-04 2016-08-24 白思稼 Smart mobile phone expands screen device
CN105955685A (en) * 2016-04-25 2016-09-21 广州视睿电子科技有限公司 Control method, device and system for screen transmission demonstration content

Also Published As

Publication number Publication date
CN107948565A (en) 2018-04-20
WO2018090722A1 (en) 2018-05-24

Similar Documents

Publication Publication Date Title
CN107948568B (en) Method and device for realizing wired screen transmission
CN107948566B (en) Method and device for realizing plug-and-play screen transmission
CN107948567B (en) USB wired screen transmission method and device
CN107948565B (en) Method and device for realizing wired screen transmission
US10922041B2 (en) Wireless screen transmission method, extension device, and wireless screen transmission system
US10726068B2 (en) App processing method and apparatus
CN108769795B (en) Video signal realizing system and method
US10606367B2 (en) Command relay device, system and method for providing remote assistance/remote control
WO2021169495A1 (en) Network configuration method for intelligent device, and related apparatuses
CN111629239B (en) Screen projection processing method, device, equipment and computer readable storage medium
CN107948569B (en) Method and device for realizing wired screen transmission
US20050185102A1 (en) Single touch launch of remote applications over video
EP2995086B1 (en) Paired devices
CN109587536A (en) A kind of long-distance remote-control method, equipment, server and system
CN114281288A (en) Screen projection processing method and device and electronic equipment
CN107038024B (en) Operation configuration method and equipment thereof
US11379397B2 (en) Transmission device capable of control feedback and control feedback method
CN116939283A (en) Equipment control method, device, electronic equipment and storage medium
CN205490969U (en) Multimedia playing system based on mobile terminal
CN105578232A (en) Multimedia playing system and playing method based on mobile terminal
US20060142991A1 (en) Remote USB network device control
CN103607640A (en) Audio control method, device thereof and system thereof
WO2012151917A1 (en) Method, apparatus and system for remote controlling network multimedia service
CN113382299B (en) Screen transmission method, system and storage medium
CN103414931A (en) Method and device for play control over media files

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant