WO2024114434A1 - 通过无线信道实现uac和uvc设备远程连接的系统和方法 - Google Patents
通过无线信道实现uac和uvc设备远程连接的系统和方法 Download PDFInfo
- Publication number
- WO2024114434A1 WO2024114434A1 PCT/CN2023/132755 CN2023132755W WO2024114434A1 WO 2024114434 A1 WO2024114434 A1 WO 2024114434A1 CN 2023132755 W CN2023132755 W CN 2023132755W WO 2024114434 A1 WO2024114434 A1 WO 2024114434A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- usb
- dongle
- receiver
- channel
- screen projection
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 230000011664 signaling Effects 0.000 claims abstract description 68
- 230000008859 change Effects 0.000 claims abstract description 34
- 125000004122 cyclic group Chemical group 0.000 claims abstract description 6
- 230000004044 response Effects 0.000 claims description 58
- 230000005540 biological transmission Effects 0.000 claims description 25
- 230000008569 process Effects 0.000 claims description 13
- 238000012545 processing Methods 0.000 claims description 10
- 230000002441 reversible effect Effects 0.000 claims description 10
- 230000001960 triggered effect Effects 0.000 claims description 8
- 238000000060 site-specific infrared dichroism spectroscopy Methods 0.000 claims description 6
- 230000002457 bidirectional effect Effects 0.000 claims description 3
- 239000002131 composite material Substances 0.000 claims description 3
- 230000006855 networking Effects 0.000 abstract description 2
- 238000005516 engineering process Methods 0.000 description 4
- 101001121408 Homo sapiens L-amino-acid oxidase Proteins 0.000 description 2
- 102100026388 L-amino-acid oxidase Human genes 0.000 description 2
- 101100012902 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FIG2 gene Proteins 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000008014 freezing Effects 0.000 description 2
- 238000007710 freezing Methods 0.000 description 2
- 101100233916 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) KAR5 gene Proteins 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/38—Information transfer, e.g. on bus
- G06F13/42—Bus transfer protocol, e.g. handshake; Synchronisation
- G06F13/4282—Bus transfer protocol, e.g. handshake; Synchronisation on a serial bus, e.g. I2C bus, SPI bus
Definitions
- the present application relates to the field of wireless communication technology, and in particular to a system and method for realizing remote connection between UAC and UVC devices through a wireless channel.
- the USB-C Dongle is connected to the PC, and the video and audio information displayed on the PC can be sent to the remote receiver RX through a wireless channel.
- RX converts the video and audio information into HDMI and outputs it to the TV for display.
- the PC screen projection requires the remote UAC and UVC devices for video conferencing, the PC needs to connect another USB cable to the UAC and UVC through RX.
- the original UAC and UVC device remote connection system consists of a screen projector Dongle and a receiver RX.
- the screen projection Dongle is used to provide a USB-C interface, a screen projection button and a WIFI hardware interface.
- the USB-C interface is used for the PC to power the Dongle, the PC to send audio and video data to the Dongle, and to construct a touch screen HID USB device;
- the screen projection button is used to provide functions such as screen projection, screen projection cancellation and freezing;
- the WIFI hardware interface works in WIFI STA mode and actively connects to RX; the wireless channel carries signaling and screen projection media.
- the screen projection Dongle mainly includes a signaling module and a screen projection sending module; the signaling module is responsible for establishing and maintaining a signaling channel with the receiver RX, and is responsible for signaling processing between the screen projection Dongle and the receiver RX; the screen projection sending module is used to encode the audio and video data received from the USB-C interface to the PC and send it to the receiver RX through the screen projection media channel on the wireless channel; the HID device information of the receiver RX is received from the screen projection media channel to create a HID device, and the received HID message is sent to the PC through the USB-C interface.
- the signaling module is responsible for establishing and maintaining a signaling channel with the receiver RX, and is responsible for signaling processing between the screen projection Dongle and the receiver RX
- the screen projection sending module is used to encode the audio and video data received from the USB-C interface to the PC and send it to the receiver RX through the screen projection media channel on the wireless channel
- the HID device information of the receiver RX is received from the screen projection media
- the receiver RX is used to provide external USB device interface, USB Host interface, HDMI output and WIFI hardware interface.
- the USB device interface is used to realize the access of UAC, UVC, HID and other devices;
- the USB Host interface connects the PC to communicate with the USB device through the USB HUB;
- the HDMI output realizes the external output of HDMI for screen projection;
- the WIFI hardware interface works in WIFI AP mode, accepts and manages the connection of the screen projection Dongle.
- the receiver RX mainly includes a signaling module and a screen projection receiving function module; the signaling module is responsible for managing the signaling channel established by the screen projection Dongle, and is responsible for the signaling processing between the screen projection Dongle and the receiver RX; the screen projection receiving function module is used to receive the audio data encoded by the screen projection Dongle of the screen projection media channel on the wireless channel, parse and convert it into HDMI output, manage HID devices, and send HID device information and HID messages to the screen projection media channel.
- the main signaling process of screen projection is shown in Figure 4.
- USB cables are limited, while wireless transmission does not. It can cover various large, medium and small conference rooms, and the conference room layout is flexible and convenient.
- PC users need to project the screen and open a video conference room at the same time, they need to connect a Dongle device and a USB cable, which is not as good as connecting one device to complete this function.
- the present application proposes a system and method with a reasonable concept that can be used for convenient and flexible networking in large, medium and small conference room scenarios. Users only need to insert a screen projection dongle into the PC to project the screen and hold a video conference, which simplifies the user's wiring operation and improves the user experience. It realizes remote connection of UAC and UVC devices through wireless channels.
- the present application provides a system for realizing remote connection between UAC and UVC devices through a wireless channel, which is composed of a screen projection Dongle and a receiver RX;
- the screen projection Dongle is used to provide a USB-C interface, a screen projection button and a WIFI hardware interface to the outside;
- the USB-C interface is used for the PC to power the screen projection Dongle and for the PC to send audio and video data to the screen projection Dongle;
- the WIFI hardware interface works in WIFI STA mode and actively connects to the receiver RX;
- the wireless channel of the WIFI hardware interface carries signaling and screen projection media;
- the screen projection Dongle mainly includes a Dongle signaling module and a Dongle screen projection sending module;
- the Dongle signaling module is responsible for establishing and maintaining a signaling channel with the receiver RX, and is responsible for signaling processing between the screen projection Dongle and the receiver RX;
- the Dongle screen projection sending module is used to encode the audio and video data received from the USB-C interface to the PC and send it to the receiver RX through the screen projection media channel on the wireless channel, receive the HID device information of the receiver RX from the screen projection media channel to create a HID device, and receive the HID message and send it to the PC through the USB-C interface;
- the receiver RX is used to provide a USB interface, an HDMI output interface and a WIFI hardware interface to the outside world;
- the receiver RX includes an RX signaling module and an RX screen projection receiving module;
- the RX signaling module is responsible for managing the signaling channel established by the screen projection Dongle, and is responsible for the signaling processing between the receiver RX and the screen projection Dongle;
- the RX screen projection receiving module is used to receive the Dongle-encoded audio data of the screen projection media channel on the wireless channel, parse and convert it into HDMI output, manage HID devices, and send HID device information and HID messages to the screen projection media channel;
- the USB-C interface is also used to present a USB combination device to the PC;
- the wireless channel of the WIFI hardware interface also carries USB control, Camera media, Speaker media and MIC media channels;
- the screen projection Dongle is also used to connect to an external key hardware interface; and the connection key hardware interface has the function of realizing a preemptible USB connection and a reversible disconnection function;
- the screen projector Dongle also includes a USB combination device; the receiver RX also includes a USB control function module; the USB combination device is used to request the USB combination device descriptor from the receiver RX through signaling control to build a combination device, and create a transmission channel between the USB combination device and the USB control function module; the transmission channel is used for the transmission of USB control and USB media information and includes USB control and USB media channels; and the USB media channels include Camera media, Speaker media and MIC media channels; the USB control function module is used to complete the management of the USB device connected to the receiver RX, negotiate with the specified screen projector Dongle to provide a USB combination device descriptor, and create a control and media channel for the screen projector Dongle to send and receive USB control and media information.
- a method for realizing remote connection between UAC and UVC devices through a wireless channel based on the above-mentioned system for realizing remote connection between UAC and UVC devices through a wireless channel, mainly comprises the following steps:
- connection button of the screen projection dongle is pressed when it is disconnected; the screen projection dongle without a connection button can be triggered by plugging it into a PC;
- the screen projection Dongle sends a USB connection request to the receiver RX.
- the request includes the maximum number of endpoints supported by USB, the available port range for media reception, the maximum bandwidth supported by WIFI, etc.
- the screen projection Dongle receives the USB connection request response. If the response code is success, it means the USB connection request is successful.
- the USB control channel between the screen projector Dongle and the receiver RX is bidirectional; the screen projector Dongle reads the control information from the USB composite device 0 endpoint, encapsulates it into a control message and sends it to the receiver RX.
- the receiver RX receives the control message and parses it and sends it to the corresponding UAC or UVC device, and feeds back the operation result to the screen projector Dongle;
- the change notification includes the message type, USB combined device description, the number of endpoints used, and the endpoint information array information; the change type includes connection, disconnection, and connection update;
- the screen projection Dongle receives the USB change notification from the receiver RX, processes the USB combination device according to the change type, and sends a response to the receiver RX;
- the receiver RX receives the USB change notification response from the projection device Dongle. When the return code is successful, it processes the USB endpoint reading and media channel sending and receiving according to the change type;
- connection button of the projection device Dongle is pressed when it is in the connection state; the projection device Dongle without a connection button can be triggered by removing it from the PC, and the receiver RX detects that the signaling channel is closed and performs a reversible disconnection process, and then releases the USB control and media channel resources of the projection device Dongle;
- the screen projection Dongle receives the receiver RX disconnect request response, and the return code is success, indicating that the USB disconnection is successful;
- step (2.3) The method for realizing remote connection between UAC and UVC devices through a wireless channel, wherein the specific steps of step (2.3) are as follows:
- the receiver RX When the receiver RX has no screen projection dongle connected, open the UAC, UVC and HID devices connected to the USB interface, generate a request response based on the request information and send it to the screen projection dongle.
- the request response includes a response code, USB combined device description, the number of endpoints used and an array of endpoint information.
- the endpoint information includes the endpoint number, type, and receiving port.
- the types include USB control, MIC data, speaker data and camera data. Create endpoints corresponding to the MIC data, speaker data and camera data of the UAC and UVC devices for reading and writing, and their corresponding media channels for sending and receiving.
- the receiver RX When the receiver RX is connected to the screen projector Dongle, if the receiver RX is not in the preemption strategy, it returns failure. If the receiver RX is in the preemption strategy, it sends a change notification message to the USB-connected screen projector Dongle and turns off the USB combination device. After the receiver RX receives the change notification response from the screen projector Dongle, it turns off the USB control and USB media channel data reception and transmission; generates a request response based on the USB connection request information initiated by the new screen projector Dongle and sends it to the newly connected screen projector Dongle; the receiver RX creates a new screen projector Dongle media channel for transmission and reception.
- step (4.3) The method for realizing remote connection between UAC and UVC devices through a wireless channel, wherein the specific steps of step (4.3) are as follows:
- the receiver RX reads the MIC data from the corresponding endpoint of the MIC data and encapsulates it into an RTP packet, and sends it to the screen projection Dongle from the MIC data channel.
- the screen projection Dongle receives the RTP packet, parses the RTP packet, and writes it to the corresponding endpoint of the USB combination device MIC;
- the receiver RX reads the camera data from the corresponding endpoint of the camera data, encapsulates it into an RTP packet, and sends it from the camera data channel to the screen projection Dongle.
- the screen projection Dongle receives the RTP packet, parses the RTP packet, and writes it to the corresponding endpoint of the USB combination device Camera;
- the projection Dongle receives the RTP packets from the MIC and Camera from the media channel, sorts them by RTP sequence number, aligns them by RTP timestamp, and sends them to the corresponding endpoint of the USB combination device;
- the projection device Dongle reads the speaker data from the endpoint corresponding to the speaker data, encapsulates it into an RTP packet, and sends it from the speaker data channel to the receiver RX.
- the receiver RX receives the RTP packet, parses the RTP packet, and writes it to the endpoint corresponding to the speaker data.
- step (6.3) The method for realizing remote connection between UAC and UVC devices through a wireless channel, wherein the specific steps of step (6.3) are as follows:
- step (1) specifically includes the following steps:
- the screen projection Dongle uses the SSID and password to connect to the WIFI of the receiver RX.
- the SSID and password are obtained by pairing with the receiver RX;
- the screen projection Dongle uses the specified IP and PORT to establish a TCP connection with the receiver RX;
- the screen projection Dongle sends a request to create a signaling channel to the receiver RX, and the request contains the device type and access code information;
- the receiver RX After receiving the request, the receiver RX sends a request response to create a signaling channel to the projection device Dongle, and the request response includes a response code, a unique client identifier, an access code type, a RX device type, and a capability set;
- step (3) The method for realizing remote connection between UAC and UVC devices through a wireless channel, wherein the specific steps of step (3) are: the screen projection Dongle creates a USB combination device according to the USB combination device descriptor in the USB connection request response, and creates the corresponding endpoint reading and writing of the USB combination device and its corresponding media channel sending and receiving according to the endpoint information array.
- step (4.4) The method for realizing remote connection between UAC and UVC devices through a wireless channel, wherein the control operation steps of step (4.4) are as follows:
- step (7) the screen projection dongle closes the USB media channel, the USB control channel and the USB combination device.
- step (8) The method for realizing remote connection between UAC and UVC devices through a wireless channel, wherein the specific method of step (8) is: closing the signaling channel when the screen projection dongle has neither screen projection nor USB combination device.
- the present application has the following beneficial effects:
- the system and method for realizing remote connection of UAC and UVC devices through wireless channels in this application are well-conceived and can be conveniently and flexibly networked in large, medium and small conference room scenarios. Users only need to insert the projection dongle into the PC to project the screen and hold a video conference, which simplifies the user's wiring operation and improves the user experience.
- This application supports multiple PCs to be plugged into the dongle at the same time, and can flexibly switch the USB host according to the user's connection command, and can automatically fall back to the previous USB host after disconnection.
- FIG1 is a structural diagram of a system for realizing remote connection between UAC and UVC devices through a wireless channel in the present application
- FIG2 is a flow chart of a method for realizing remote connection between UAC and UVC devices through a wireless channel in the present application
- FIG3 is a structural diagram of the original UAC and UVC device remote connection system
- FIG. 4 is a flow chart of the original UAC and UVC device remote connection method.
- PC stands for Personal Computer, that is, personal computer
- USB stands for Universal Serial Bus, which means: Universal Serial Bus
- USB Audio Class which means USB audio class
- UVC stands for USB Video Class, that is, USB video class
- USB-C stands for USB Type-C
- HID Human Interface Device, which means human-computer interaction device
- Camera means camera;
- Speaker means loudspeaker
- MIC stands for microphone, that is, microphone
- WIFI AP stands for WIFI Access Point, that is, WIFI access point
- WIFI STA stands for WIFI Station, that is, WIFI client.
- the system of the present application for realizing remote connection between UAC and UVC devices through a wireless channel is composed of a screen projection Dongle and a receiver RX.
- the screen projector Dongle is used to provide a USB-C interface, a screen projection button, a WIFI hardware interface and a connection button hardware interface.
- the USB-C interface is used for the PC to power the screen projector Dongle, the PC to send audio and video data to the screen projector Dongle, and to present a USB combination device to the PC.
- the screen projection button has the functions of providing screen projection, canceling screen projection and freezing.
- the WIFI hardware interface works in WIFI STA mode, actively connects to the receiver RX, and the wireless channel of the WIFI hardware interface carries signaling, screen projection media, USB control, Camera media, Speaker media and MIC media channels.
- the connection button hardware interface has the function of realizing preemptible USB connection and reversible disconnection.
- the USB connection can be triggered by the insertion of the screen projector Dongle, and the USB reversible disconnection function can be triggered by the receiver RX detecting that the USB connection to the screen projector Dongle is offline.
- the screen projection Dongle mainly includes a Dongle signaling module, a Dongle screen projection sending module and a USB combination device.
- the Dongle signaling module is responsible for establishing and maintaining a signaling channel with the receiver RX, and is responsible for signaling processing between the screen projection Dongle and the receiver RX.
- the Dongle screen projection sending module is used to encode the audio and video data received from the USB-C interface to the PC, and then send it to the receiver RX through the screen projection media channel on the wireless channel, receive the HID device information of the receiver RX from the screen projection media channel to create a HID device, and receive the HID message to send it to the PC through the USB-C interface.
- the USB combination device is used to request the USB combination device descriptor to the receiver RX through signaling control to build a combination device, and create a transmission channel between the USB combination device and the USB control function module of the receiver RX.
- the channel is used for the transmission of USB control and USB media information.
- the channel includes USB control and USB media channels, and the USB media channel includes Camera media, Speaker media and MIC media channels.
- the receiver RX is used to provide USB interface, HDMI output interface and WIFI hardware interface.
- the USB interface is used to realize the access of UAC, UVC, HID and other devices.
- the HDMI output interface is used to realize the HDMI output of the projection screen.
- the WIFI hardware interface works in WIFI AP mode and is used to accept and manage the projection device Dongle connection.
- the receiver RX mainly includes an RX signaling module, an RX screen projection receiving module and a USB control function module.
- the RX signaling module is responsible for managing the signaling channel established by the screen projection Dongle, and is responsible for the signaling processing between the receiver RX and the screen projection Dongle.
- the RX screen projection receiving module is used to receive the Dongle-encoded audio data of the screen projection media channel on the wireless channel, parse and convert it into HDMI output, and manage the HID device, sending HID device information and HID messages to the screen projection media channel.
- the USB control function module is used to complete the management of the USB device connected to the receiver RX, negotiate with the specified screen projection Dongle to provide a USB combined device descriptor, and create a control and media channel with the screen projection Dongle to send and receive USB control and media information.
- the method for realizing remote connection between UAC and UVC devices through a wireless channel in the present application is based on the above-mentioned system for realizing remote connection between UAC and UVC devices through a wireless channel, and specifically includes the following steps:
- S110 and the projection device Dongle use the SSID and password to connect to the WIFI of the receiver RX.
- the SSID and password are obtained by pairing with the receiver RX.
- screen projection Dongle uses the specified IP and PORT to establish a TCP connection with the receiver RX;
- the screen projection Dongle sends a request to create a signaling channel to the receiver RX, and the request includes device type and access code information;
- the receiver RX after receiving the request, sends a request response to create a signaling channel to the projection device Dongle, where the request response includes a response code, a unique identifier of the client, an access code type, an RX device type, and a capability set;
- the screen projection Dongle receives a response to the request to create a signaling channel. If the response code is success, it means that the signaling channel is successfully created;
- connection button of the screen projection Dongle is pressed when it is in disconnected state; the screen projection Dongle without a connection button can be triggered by plugging into a PC;
- the screen projection Dongle sends a USB connection request to the receiver RX, the request includes the maximum number of endpoints supported by USB, the available port range for media reception, the maximum bandwidth supported by WIFI, etc.;
- the receiver RX when the receiver RX is not connected to the screen projection Dongle: open the UAC, UVC and HID devices connected to the USB interface, generate a request response according to the request information and send it to the screen projection Dongle, the request response includes a response code, a USB combined device description, the number of endpoints used and an endpoint information array (the endpoint information includes the endpoint number, type, and receiving port, and the types include USB control, MIC data, Speaker data and Camera data); create endpoints corresponding to the MIC data, Speaker data and Camera data of the UAC and UVC devices for reading and writing, and their corresponding media channel transceiver;
- the receiver RX when the receiver RX is connected to the screen projector Dongle, if the receiver RX is not in the preemption strategy, it returns failure. If the receiver RX is in the preemption strategy, it sends a change notification message to the screen projector Dongle connected to the USB, closes the USB combination device, and after the receiver RX receives the change notification response from the screen projector Dongle, it closes the USB control and USB media channel data reception and transmission; generates a request response according to the USB connection request information initiated by the new screen projector Dongle and sends it to the newly connected screen projector Dongle; the receiver RX creates a new screen projector Dongle media channel for transmission and reception;
- the screen projection Dongle receives a response to the USB connection request.
- the response code is success, it indicates that the USB connection request is successful;
- the screen projection Dongle creates a USB combination device according to the USB combination device descriptor in the USB connection request response, and creates the corresponding endpoint reading and writing of the USB combination device and the corresponding media channel sending and receiving of the USB combination device according to the endpoint information array;
- the USB control channel between the screen projector Dongle and the receiver RX is bidirectional; the screen projector Dongle reads the control information from the USB composite device 0 endpoint, encapsulates it into a control message and sends it to the receiver RX.
- the receiver RX receives the control message and parses it and sends it to the corresponding UAC or UVC device, and feeds back the operation result to the screen projector Dongle;
- the receiver RX reads the MIC data from the corresponding endpoint of the MIC data, encapsulates it into an RTP packet, and sends it to the screen projection Dongle from the MIC data channel.
- the screen projection Dongle receives the RTP packet, parses the RTP packet, and writes it to the corresponding endpoint of the USB combination device MIC;
- the receiver RX reads the camera data from the corresponding endpoint of the camera data, encapsulates it into an RTP packet, and sends it to the screen projection Dongle from the camera data channel.
- the screen projection Dongle receives the RTP packet, parses the RTP packet, and then writes it to the corresponding endpoint of the USB combination device Camera;
- the projection device Dongle receives the RTP packets of the MIC and the Camera from the media channel, sorts them by RTP sequence number, aligns them by RTP timestamp, and sends them to the corresponding endpoint of the USB combination device;
- the projection device Dongle reads the speaker data from the endpoint corresponding to the speaker data, encapsulates it into an RTP packet, and sends it from the speaker data channel to the receiver RX.
- the receiver RX receives the RTP packet, parses the RTP packet, and writes it to the endpoint corresponding to the speaker data.
- USB connection request when the USB connection request is preempted, the USB disconnection request is rolled back, and the USB of the receiver RX is updated, a USB change notification is sent to the screen projection device Dongle;
- the change notification includes the message type, USB combined device description, the number of endpoints used, and the endpoint information array information;
- the change type includes connection, disconnection, and connection update;
- the screen projection Dongle receives the USB change notification from the receiver RX, processes the USB combination device according to the change type, and sends a response to the receiver RX;
- the receiver RX receives the USB change notification response from the projection device Dongle. When the return code is successful, the receiver RX processes the USB endpoint reading and media channel sending and receiving according to the change type.
- connection button of the screen projection Dongle is pressed in the connection state;
- the screen projection Dongle without a connection button can be triggered by removing it from the PC, and the receiver RX performs a reversible disconnection process when detecting that the signaling channel is closed, and then releases the USB control and media channel resources of the screen projection Dongle;
- the screen projection Dongle receives the disconnection request response from the receiver RX, and when the return code is success, it indicates that the USB disconnection is successful;
- the screen projection Dongle closes the USB media channel, USB control channel and USB combination device
- the signaling channel is closed when the screen projection dongle has neither screen projection nor USB combination device.
- This application is well-conceived and can be easily and flexibly networked in large, medium and small conference room scenarios. Users only need to insert a dongle into the PC to project the screen and hold a video conference, which simplifies user wiring operations, improves user experience, and is suitable for promotion and application.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Projection Apparatus (AREA)
Abstract
本申请提供了一种通过无线信道实现UAC和UVC设备远程连接的系统和方法，该系统由投屏器Dongle和接收器RX组成；投屏器Dongle包含Dongle信令模块、Dongle投屏发送模块和USB组合设备；接收器RX用于对外提供USB接口、HDMI输出和WIFI硬件接口；接收器RX包含RX信令模块、RX投屏接收模块和USB控制功能模块。该方法包括：创建信令通道、 USB连接、创建USB控制和媒体通道、循环数据收发、USB变更通知、USB断开连接、关闭USB控制和媒体通道、信令通道关闭。本申请可在大中小会议室场景中方便灵活组网，用户只需在PC插入投屏器Dongle即可投屏又可以开视频会议，简化了用户接线操作，提升了用户体验。
Description
本申请要求于2022年11月29日在中国专利局提交的、申请号为202211503784.0、发明名称为“通过无线信道实现UAC和UVC设备远程连接的系统和方法”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
本申请涉及无线通信技术领域，具体涉及一种通过无线信道实现UAC和UVC设备远程连接的系统和方法。
USB-C的Dongle连接PC，可以将PC显示的视频和音频信息通过无线信道发送到远端的接收器RX，RX将视频和音频信息转换成HDMI输出到TV显示。PC投屏同时需要远端的UAC和UVC设备开视频会议时，PC需要再接一条USB线缆通过RX连接UAC和UVC。
如图3所示，原UAC和UVC设备远程连接系统，由投屏器Dongle和接收器RX组成。
该投屏器Dongle用于对外提供USB-C接口、投屏按键和WIFI硬件接口。其中，该USB-C接口用于PC向Dongle供电，PC向Dongle发送音视频数据以及构造触控屏HID USB设备；该投屏按键用于提供投屏、取消投屏和冻结等功能；该WIFI硬件接口工作在WIFI STA模式，主动连接RX；无线信道承载信令和投屏媒体。该投屏器Dongle主要包含信令模块和投屏发送模块；该信令模块负责与接收器RX建立和维护信令通道，负责投屏器Dongle和接收器RX之间信令处理；该投屏发送模块用于把USB-C接口接收到PC的音视频数据经过编码通过无线信道上的投屏媒体通道发送给接收器RX；从投屏媒体通道接收接收器RX的HID设备信息创建HID设备，接收HID报文通过USB-C接口送给PC。
该接收器RX用于对外提供USB设备接口、USB Host接口、HDMI输出和WIFI硬件接口。其中，该USB设备接口用于实现UAC、UVC、HID等设备接入；该USB Host接口连接PC经过USB HUB与USB设备互通；该HDMI输出实现外输出投屏的HDMI；该WIFI硬件接口工作在WIFI AP模式，接受和管理投屏器Dongle连接。该接收器RX主要包含信令模块和投屏接收功能模块；该信令模块用于负责管理投屏器Dongle建立的信令通道，负责投屏器Dongle与接收器RX之间信令处理；该投屏接收功能模块用于接收无线信道上投屏媒体通道的投屏器Dongle编码的音频数据，解析转换成HDMI输出，管理HID设备，向投屏媒体通道发送HID设备信息和HID报文，投屏主要信令流程如图4所示。
上述技术的缺点为：使用USB线缆长度有限，无线传输则没有，可以覆盖大中小各种会议室，会议室布局灵活方便；PC用户需要投屏同时开视频会议室时，需要接入Dongle设备和USB线缆，不如接入一个设备完成此功能的体验好。
综上可知，有必要对现有技术做进一步完善和创新。
针对上述背景技术中存在的技术问题，本申请提出了一种构思合理，可以在大中小会议室场景中方便灵活组网，用户只需在PC插入投屏器Dongle即可投屏又可以开视频会议，简化了用户接线操作，提升了用户体验的通过无线信道实现UAC和UVC设备远程连接的系统和方法。
为解决上述技术问题，本申请提供的一种通过无线信道实现UAC和UVC设备远程连接的系统，由投屏器Dongle和接收器RX组成；
所述投屏器Dongle用于对外提供USB-C接口、投屏按键和WIFI硬件接口；所述USB-C接口用于PC向所述投屏器Dongle供电及PC向所述投屏器Dongle发送音视频数据；所述WIFI硬件接口工作在WIFI STA模式，主动连接所述接收器RX;所述WIFI硬件接口的无线信道承载信令和投屏媒体；
所述投屏器Dongle主要包含Dongle信令模块和Dongle投屏发送模块；所述Dongle信令模块用于负责与所述接收器RX建立和维护信令通道，负责所述投屏器Dongle与接收器RX之间信令处理；所述Dongle投屏发送模块用于把USB-C接口接收到PC的音视频数据经过编码通过无线信道上的投屏媒体通道发送给所述接收器RX，从投屏媒体通道接收所述接收器RX的HID设备信息创建HID设备，接收HID报文通过USB-C接口送给PC；
所述接收器RX用于对外提供USB接口、HDMI输出接口和WIFI硬件接口；所述接收器RX包含RX信令模块和RX投屏接收模块；所述RX信令模块用于负责管理所述投屏器Dongle建立的信令通道，负责所述接收器RX与投屏器Dongle之间信令处理；所述RX投屏接收模块用于接收无线信道上投屏媒体通道的Dongle编码的音频数据，解析转换成HDMI输出，并管理HID设备，向投屏媒体通道发送HID设备信息和HID报文；
所述USB-C接口还用于向PC呈现一个USB组合设备；所述WIFI硬件接口的无线信道还承载有USB控制、Camera媒体、Speaker媒体和MIC媒体通道；
所述投屏器Dongle还用于对外连接按键硬件接口；且所述连接按键硬件接口具有实现可抢占的USB连接和可回退的断开连接功能；
所述投屏器Dongle还包含USB组合设备；所述接收器RX还包含USB控制功能模块；所述USB组合设备用于通过信令控制向接收器RX请求USB组合设备描述符构建组合设备，创建所述USB组合设备与所述USB控制功能模块之间传输通道;所述传输通道用于USB控制和USB媒体信息的传输且包含USB控制和USB媒体通道;且所述USB媒体通道包含Camera媒体、Speaker媒体和MIC媒体通道；所述USB控制功能模块用于完成所述接收器RX连接的USB设备的管理，与指定所述投屏器Dongle协商提供USB组合设备描述符，创建与所述投屏器Dongle的控制和媒体通道收发USB的控制和媒体信息。
一种通过无线信道实现UAC和UVC设备远程连接的方法，基于上述的通过无线信道实现UAC和UVC设备远程连接的系统，主要包括以下步骤：
（1）创建信令通道；
（2）USB连接
（2.1）投屏器Dongle的连接按键在断开状态时被按下；无连接按键的投屏器Dongle可通过插入PC触发；
（2.2）投屏器Dongle向接收器RX发送USB连接请求，请求包含USB支持最大端点个数、媒体接收可用端口范围、WIFI支持最大带宽等；
（2.3）接收器RX收到USB连接请求时进行可抢占的连接处理；
（2.4）投屏器Dongle收到USB连接请求响应，响应码是成功时，表示USB连接请求成功；
（3）创建USB控制和媒体通道；
（4）循环数据收发
（4.1）投屏器Dongle与接收器RX之间的USB控制通道是双向的；投屏器Dongle从USB组合设备0端点读取控制信息，封装成控制消息发送给接收器RX，接收器RX接收到控制消息解析之后发送给对应UAC或者UVC设备，并把操作结果反馈给投屏器Dongle；
（4.2）通过USB控制通道打开MIC、Speaker和Camera；
（4.3）循环收发MIC、Speaker和Camera的数据；
（4.4）USB控制通道控制操作；
（4.5）通过USB控制通道关闭MIC、Speaker和Camera；
（5）USB变更通知
（5.1）USB连接请求的抢占、USB断开连接请求的回退和接收器RX的USB更新时向投屏器Dongle发送USB变更通知，变更通知包含消息类型、USB组合设备描述、使用端点个数和端点信息数组信息；变更类型包含连接、断开连接和连接更新；
（5.2）投屏器Dongle收到接收器RX的USB变更通知，根据变更类型处理USB组合设备，给接收器RX发送响应；
（5.3）接收器RX收到投屏器Dongle的USB变更通知响应，返回码成功时，根据变更类型处理USB端点读取和媒体通道收发；
（6）USB断开连接
（6.1）投屏器Dongle的连接按键在连接状态时被按下；无连接按键的投屏器Dongle可通过从PC移除触发,接收器RX检测信令通道关闭时进行可回退的断开连接处理，然后释放与该投屏器Dongle的USB控制和媒体通道资源；
（6.2）投屏器Dongle向接收器RX发送USB断开连接请求；
（6.3）接收器RX收到断开连接请求时进行可回退的断开连接处理;
（6.4）投屏器Dongle收到接收器RX断开连接请求响应，返回码是成功表示USB断开连接成功；
（7）关闭USB控制和媒体通道；
（8）信令通道关闭。
所述通过无线信道实现UAC和UVC设备远程连接的方法，其中，所述步骤（2.3）的具体步骤如下：
（2.3.1）接收器RX没有投屏器Dongle连接时，打开USB接口连接的UAC、UVC和HID设备，根据请求信息生成请求响应并发送给投屏器Dongle，请求响应包含响应码、USB组合设备描述、使用端点个数和端点信息数组，且端点信息包含端点编号、类型、接收端口，类型有USB控制、MIC数据、Speaker数据和Camera数据；创建UAC、UVC设备的MIC数据、Speaker数据和Camera数据对应端点读写及其对应媒体通道收发；
（2.3.2）接收器RX与投屏器Dongle连接时，接收器RX不是抢占策略则返回失败，接收器RX是抢占策略则：向USB连接的投屏器Dongle发送变更通知消息，关闭USB组合设备，接收器RX收到投屏器Dongle的变更通知响应后，关闭USB控制和USB媒体通道的数据接收和发送；根据新投屏器Dongle发起的USB连接请求信息生成请求响应并发送给新连接的投屏器Dongle；接收器RX创建新投屏器Dongle媒体通道收发。
所述通过无线信道实现UAC和UVC设备远程连接的方法，其中，所述步骤（4.3）的具体步骤如下：
（4.3.1）接收器RX从MIC数据对应端点读取MIC数据封装成RTP包，从MIC数据通道发送给投屏器Dongle，投屏器Dongle接收到RTP包，解析RTP包之后写入USB组合设备MIC对应端点；
（4.3.2）接收器RX从Camera数据对应端点读取Camera数据封装成RTP包，从Camera数据通道发送给投屏器Dongle，投屏器Dongle接收到RTP包，解析RTP包之后写入USB组合设备Camera对应端点；
（4.3.3）投屏器Dongle从媒体通道接收到MIC和Camera的RTP包，先分别按RTP序号排序之后，按RTP时戳对齐之后送入USB组合设备对应端点；
（4.3.4）投屏器Dongle从Speaker数据对应端点读取Speaker数据封装成RTP包，从Speaker数据通道发送给接收器RX，接收器RX接收到RTP包，解析RTP包之后写入Speaker数据对应端点。
所述通过无线信道实现UAC和UVC设备远程连接的方法，其中，所述步骤（6.3）的具体步骤如下：
（6.3.1）没有投屏器Dongle连接时，关闭UAC、UVC设备的MIC数据、Speaker数据和Camera数据对应端点读写及其对应媒体通道收发，关闭UAC、UVC和HID设备，向投屏器Dongle发送USB断开连接请求响应；
（6.3.2）有投屏器Dongle连接时，关闭媒体通道收发，向请求的投屏器Dongle发送USB断开连接请求响应；向上一个USB连接的投屏器Dongle发送USB变更消息打开USB组合设备，收到响应后，创建媒体通道收发。
所述通过无线信道实现UAC和UVC设备远程连接的方法，其中，所述步骤（1）具体包括以下步骤：
（1.1）投屏器Dongle使用SSID和密码连接接收器RX的WIFI, SSID和密码通过与接收器RX配对获取；
（1.2）投屏器Dongle使用指定IP和PORT与接收器RX建立TCP连接；
（1.3）投屏器Dongle向接收器RX发送创建信令通道请求，请求包含设备类型和接入码信息；
（1.4）接收器RX收到请求处理之后向投屏器Dongle发送创建信令通道请求响应，且请求响应包含响应码、客户端唯一标识、接入码类型、RX设备类型和能力集；
（1.5）投屏器Dongle收到创建信令通道请求响应，响应码是成功时，表示信令通道创建成功。
所述通过无线信道实现UAC和UVC设备远程连接的方法，其中，所述步骤（3）的具体步骤为：投屏器Dongle根据USB连接请求响应中的USB组合设备描述符创建USB组合设备，根据端点信息数组创建USB组合设备对应端点读写及其对应媒体通道收发。
所述通过无线信道实现UAC和UVC设备远程连接的方法，其中，所述步骤（4.4）的控制操作步骤如下：
（4.4.1）MIC和Speaker的静音和取消静音；
（4.4.2）MIC和Speaker的音量加减；
（4.4.3）Camera的移动和缩放；
（4.4.4）Camera的对比度和亮度调节。
所述通过无线信道实现UAC和UVC设备远程连接的方法，其中，所述步骤（7）具体方式为：投屏器Dongle关闭USB媒体通道、USB控制通道和USB组合设备。
所述通过无线信道实现UAC和UVC设备远程连接的方法，其中，所述步骤（8）具体方式为：投屏器Dongle既没有投屏又没有USB组合设备时关闭信令通道。
采用上述技术方案，本申请具有如下有益效果：
本申请通过无线信道实现UAC和UVC设备远程连接的系统和方法构思合理，可以在大中小会议室场景中方便灵活组网，用户只需在PC插入投屏器Dongle即可投屏又可以开视频会议，简化了用户接线操作，提升了用户体验。本申请支持多个PC同时插入Dongle使用，可根据用户的连接命令进行USB host的灵活切换，断开连接后可以自动回退到上一个USB host。
为了更清楚地说明本申请具体实施方式或现有技术中的技术方案下面将对具体实施方式或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图是本申请的一些实施方式，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本申请通过无线信道实现UAC和UVC设备远程连接的系统的结构组成图；
图2为本申请通过无线信道实现UAC和UVC设备远程连接的方法的流程图；
图3为原UAC和UVC设备远程连接系统的结构组成图；
图4为原UAC和UVC设备远程连接方法的流程图。
下面将结合附图对本申请的技术方案进行清楚、完整地描述，显然，所描述的实施例是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
下面结合具体的实施方式对本申请做进一步的解释说明。
名词解释:
PC全称为Personal Computer，即：个人计算机;
USB全称为Universal Serial Bus，即：通用串行总线;
UAC全称为USB Audio Class，即：USB音频类;
UVC全称为USB Video Class，即：USB视频类;
USB-C全称为USB Type-C;
HID全称为Human Interface Device，即：人机交互设备;
Camera即：摄像头;
Speaker即：扬声器;
MIC全称为microphone，即：麦克风;
WIFI AP全称为WIFI Access Point，即：WIFI接入点;
WIFI STA全称为WIFI Station，即：WIFI客户端。
如图1所示，本申请通过无线信道实现UAC和UVC设备远程连接的系统，由投屏器Dongle和接收器RX组成。
该投屏器Dongle用于对外提供USB-C接口、投屏按键、WIFI硬件接口和连接按键硬件接口。其中，该USB-C接口用于PC向投屏器Dongle供电、PC向投屏器Dongle发送音视频数据以及向PC呈现一个USB组合设备。该投屏按键具有提供投屏、取消投屏和冻结等功能。该WIFI硬件接口工作在WIFI STA模式，主动连接接收器RX，WIFI硬件接口的无线信道承载信令、投屏媒体、USB控制、Camera媒体、Speaker媒体和MIC媒体通道。该连接按键硬件接口具有实现可抢占的USB连接和可回退的断开连接功能。USB连接可以通过投屏器Dongle插入触发，USB可回退的断开连接功能可以通过接收器RX检测USB连接投屏器Dongle离线触发。
该投屏器Dongle主要包含Dongle信令模块、Dongle投屏发送模块和USB组合设备。其中，该Dongle信令模块用于负责与接收器RX建立和维护信令通道，负责投屏器Dongle与接收器RX之间信令处理。该Dongle投屏发送模块用于把USB-C接口接收到PC的音视频数据经过编码后，通过无线信道上的投屏媒体通道发送给接收器RX，从投屏媒体通道接收接收器RX的HID设备信息创建HID设备，接收HID报文通过USB-C接口送给PC。该USB组合设备用于通过信令控制向接收器RX请求USB组合设备描述符构建组合设备，创建USB组合设备与接收器RX的USB控制功能模块之间传输通道，该通道用于USB控制和USB媒体信息的传输，该通道包含USB控制和USB媒体通道，且USB媒体通道包含Camera媒体、Speaker媒体和MIC媒体通道。
该接收器RX用于对外提供USB接口、HDMI输出接口和WIFI硬件接口。其中，该USB接口用于实现UAC、UVC、HID等设备接入。该HDMI输出接口用于实现向外输出投屏的HDMI。该WIFI硬件接口工作在WIFI AP模式，用于接受和管理投屏器Dongle连接。
该接收器RX主要包含RX信令模块、RX投屏接收模块和USB控制功能模块。其中，该RX信令模块用于负责管理投屏器Dongle建立的信令通道，负责接收器RX与投屏器Dongle之间信令处理。该RX投屏接收模块用于接收无线信道上投屏媒体通道的Dongle编码的音频数据，解析转换成HDMI输出，并管理HID设备，向投屏媒体通道发送HID设备信息和HID报文。该USB控制功能模块用于完成接收器RX连接的USB设备的管理，与指定投屏器Dongle协商提供USB组合设备描述符，创建与投屏器Dongle的控制和媒体通道收发USB的控制和媒体信息。
如图2所示，本申请通过无线信道实现UAC和UVC设备远程连接的方法，基于上述的通过无线信道实现UAC和UVC设备远程连接的系统，具体包括以下步骤：
S100、创建信令通道：
S110、投屏器Dongle使用SSID和密码连接接收器RX的WIFI, SSID和密码通过与接收器RX配对获取；
S120、投屏器Dongle使用指定IP和PORT与接收器RX建立TCP连接；
S130、投屏器Dongle向接收器RX发送创建信令通道请求，请求包含设备类型和接入码信息；
S140、接收器RX收到请求处理之后向投屏器Dongle发送创建信令通道请求响应，该请求响应包含响应码、客户端唯一标识、接入码类型、RX设备类型和能力集；
S150、投屏器Dongle收到创建信令通道请求响应，响应码是成功时，表示信令通道创建成功；
S200、USB连接：
S210、投屏器Dongle的连接按键在断开状态时被按下；无连接按键的投屏器Dongle可以通过插入PC触发；
S220、投屏器Dongle向接收器RX发送USB连接请求，请求包含USB支持最大端点个数、媒体接收可用端口范围、WIFI支持最大带宽等；
S230、接收器RX收到USB连接请求时进行可抢占的连接处理：
S231、接收器RX没有与投屏器Dongle连接时：打开USB接口连接的UAC、UVC和HID设备，根据请求信息生成请求响应并发送给投屏器Dongle，请求响应包含响应码、USB组合设备描述、使用端点个数和端点信息数组（端点信息包含端点编号、类型、接收端口，类型有USB控制、MIC数据、Speaker数据和Camera数据)；创建UAC、UVC设备的MIC数据、Speaker数据和Camera数据对应端点读写及其对应媒体通道收发；
S232、接收器RX与投屏器Dongle连接时，接收器RX不是抢占策略则返回失败，接收器RX是抢占策略则：向USB连接的投屏器Dongle发送变更通知消息，关闭USB组合设备，接收器RX收到投屏器Dongle的变更通知响应后，关闭USB控制和USB媒体通道的数据接收和发送；根据新投屏器Dongle发起的USB连接请求信息生成请求响应并发送给新连接的投屏器Dongle；接收器RX创建新投屏器Dongle媒体通道收发；
S240、投屏器Dongle收到USB连接请求响应，响应码是成功时，表示USB连接请求成功；
S300、创建USB控制和媒体通道
投屏器Dongle根据USB连接请求响应中的USB组合设备描述符创建USB组合设备，根据端点信息数组创建USB组合设备对应端点读写及USB组合设备对应媒体通道收发；
S400、循环数据收发：
S410、投屏器Dongle与接收器RX之间的USB控制通道是双向的；投屏器Dongle从USB组合设备0端点读取控制信息，封装成控制消息发送给接收器RX，接收器RX接收到控制消息解析之后发送给对应UAC或者UVC设备，并把操作结果反馈给投屏器Dongle；
S420、通过USB控制通道打开MIC、Speaker和Camera；
S430、循环收发MIC、Speaker和Camera的数据：
S431、接收器RX从MIC数据对应端点读取MIC数据封装成RTP包，从MIC数据通道发送给投屏器Dongle，投屏器Dongle接收到RTP包，解析RTP包之后写入USB组合设备MIC对应端点；
S432、接收器RX从Camera数据对应端点读取Camera数据封装成RTP包，从Camera数据通道发送给投屏器Dongle，投屏器Dongle接收到RTP包，解析RTP包之后写入USB组合设备Camera对应端点；
S433、投屏器Dongle从媒体通道接收到MIC和Camera的RTP包，先分别按RTP序号排序之后，按RTP时戳对齐之后送入USB组合设备对应端点；
S434、投屏器Dongle从Speaker数据对应端点读取Speaker数据封装成RTP包，从Speaker数据通道发送给接收器RX，接收器RX接收到RTP包，解析RTP包之后写入Speaker数据对应端点；
S440、通过USB控制通道控制操作：
S441、MIC和Speaker的静音和取消静音；
S442、MIC和Speaker的音量加减；
S443、Camera的移动和缩放等；
S444、Camera的对比度、亮度等调节；
S450、通过USB控制通道关闭MIC、Speaker和Camera；
S500、USB变更通知：
S510、USB连接请求的抢占、USB断开连接请求的回退和接收器RX的USB更新时，向投屏器Dongle发送USB变更通知；变更通知包含消息类型、USB组合设备描述、使用端点个数和端点信息数组信息；变更类型包含连接、断开连接和连接更新；
S520、投屏器Dongle收到接收器RX的USB变更通知，根据变更类型处理USB组合设备，给接收器RX发送响应；
S530、接收器RX收到投屏器Dongle的USB变更通知响应，返回码成功时，根据变更类型处理USB端点读取和媒体通道收发；
S600、USB断开连接：
S610、投屏器Dongle的连接按键在连接状态时被按下；无连接按键的投屏器Dongle可以通过从PC移除触发,接收器RX检测信令通道关闭时进行可回退的断开连接处理，然后释放与该投屏器Dongle的USB控制和媒体通道资源；
S620、投屏器Dongle向接收器RX发送USB断开连接请求；
S630、接收器RX收到断开连接请求时进行可回退的断开连接处理：
S631、没有投屏器Dongle连接时，关闭UAC、UVC设备的MIC数据、Speaker数据和Camera数据对应端点读写及其对应媒体通道收发，关闭UAC、UVC和HID设备，向投屏器Dongle发送USB断开连接请求响应；
S632、有投屏器Dongle连接时，关闭媒体通道收发，向请求的投屏器Dongle发送USB断开连接请求响应；向上一个USB连接的投屏器Dongle发送USB变更消息打开USB组合设备，收到响应后，创建媒体通道收发；
S640、投屏器Dongle收到接收器RX断开连接请求响应，返回码是成功时表示USB断开连接成功；
S700、关闭USB控制和媒体通道：
投屏器Dongle关闭USB媒体通道、USB控制通道和USB组合设备；
S800、信令通道关闭
投屏器Dongle既没有投屏又没有USB组合设备时关闭信令通道。
本申请构思合理，可以在大中小会议室场景中方便灵活组网，用户只需在PC插入Dongle即可投屏又可以开视频会议，简化了用户接线操作，提升了用户体验，适于推广与应用。
最后应说明的是：以上各实施例仅用以说明本申请的技术方案，而非对其限制；尽管参照前述各实施例对本申请进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分或者全部技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。
Claims (10)
- 一种通过无线信道实现UAC和UVC设备远程连接的系统，由投屏器Dongle和接收器RX组成；所述投屏器Dongle用于对外提供USB-C接口、投屏按键和WIFI硬件接口；所述USB-C接口用于PC向所述投屏器Dongle供电及PC向所述投屏器Dongle发送音视频数据；所述WIFI硬件接口工作在WIFI STA模式，主动连接所述接收器RX;所述WIFI硬件接口的无线信道承载信令和投屏媒体；所述投屏器Dongle主要包含Dongle信令模块和Dongle投屏发送模块；所述Dongle信令模块用于负责与所述接收器RX建立和维护信令通道，负责所述投屏器Dongle与接收器RX之间信令处理；所述Dongle投屏发送模块用于把USB-C接口接收到PC的音视频数据经过编码通过无线信道上的投屏媒体通道发送给所述接收器RX，从投屏媒体通道接收所述接收器RX的HID设备信息创建HID设备，接收HID报文通过USB-C接口送给PC；所述接收器RX用于对外提供USB接口、HDMI输出接口和WIFI硬件接口；所述接收器RX包含RX信令模块和RX投屏接收模块；所述RX信令模块用于负责管理所述投屏器Dongle建立的信令通道，负责所述接收器RX与投屏器Dongle之间信令处理；所述RX投屏接收模块用于接收无线信道上投屏媒体通道的Dongle编码的音频数据，解析转换成HDMI输出，并管理HID设备，向投屏媒体通道发送HID设备信息和HID报文；其特征在于：所述USB-C接口还用于向PC呈现一个USB组合设备；所述WIFI硬件接口的无线信道还承载有USB控制、Camera媒体、Speaker媒体和MIC媒体通道；所述投屏器Dongle还用于对外连接按键硬件接口；且所述连接按键硬件接口具有实现可抢占的USB连接和可回退的断开连接功能；所述投屏器Dongle还包含USB组合设备；所述接收器RX还包含USB控制功能模块；所述USB组合设备用于通过信令控制向接收器RX请求USB组合设备描述符构建组合设备，创建所述USB组合设备与所述USB控制功能模块之间传输通道;所述传输通道用于USB控制和USB媒体信息的传输且包含USB控制和USB媒体通道;且所述USB媒体通道包含Camera媒体、Speaker媒体和MIC媒体通道；所述USB控制功能模块用于完成所述接收器RX连接的USB设备的管理，与指定所述投屏器Dongle协商提供USB组合设备描述符，创建与所述投屏器Dongle的控制和媒体通道收发USB的控制和媒体信息。
- 一种通过无线信道实现UAC和UVC设备远程连接的方法，基于上述权利要求1所述的通过无线信道实现UAC和UVC设备远程连接的系统，其特征在于，主要包括以下步骤：（1）创建信令通道；（2）USB连接（2.1）投屏器Dongle的连接按键在断开状态时被按下；无连接按键的投屏器Dongle可通过插入PC触发;（2.2）投屏器Dongle向接收器RX发送USB连接请求，请求包含USB支持最大端点个数、媒体接收可用端口范围、WIFI支持最大带宽等；（2.3）接收器RX收到USB连接请求时进行可抢占的连接处理；（2.4）投屏器Dongle收到USB连接请求响应，响应码是成功时，表示USB连接请求成功；（3）创建USB控制和媒体通道；（4）循环数据收发（4.1）投屏器Dongle与接收器RX之间的USB控制通道是双向的；投屏器Dongle从USB组合设备0端点读取控制信息，封装成控制消息发送给接收器RX，接收器RX接收到控制消息解析之后发送给对应UAC或者UVC设备，并把操作结果反馈给投屏器Dongle；（4.2）通过USB控制通道打开MIC、Speaker和Camera；（4.3）循环收发MIC、Speaker和Camera的数据；（4.4）USB控制通道控制操作；（4.5）通过USB控制通道关闭MIC、Speaker和Camera；（5）USB变更通知（5.1）USB连接请求的抢占、USB断开连接请求的回退和接收器RX的USB更新时向投屏器Dongle发送USB变更通知，变更通知包含消息类型、USB组合设备描述、使用端点个数和端点信息数组信息；变更类型包含连接、断开连接和连接更新；（5.2）投屏器Dongle收到接收器RX的USB变更通知，根据变更类型处理USB组合设备，给接收器RX发送响应；（5.3）接收器RX收到投屏器Dongle的USB变更通知响应，返回码成功时，根据变更类型处理USB端点读取和媒体通道收发；（6）USB断开连接（6.1）投屏器Dongle的连接按键在连接状态时被按下；无连接按键的投屏器Dongle可通过从PC移除触发,接收器RX检测信令通道关闭时进行可回退的断开连接处理，然后释放与该投屏器Dongle的USB控制和媒体通道资源;（6.2）投屏器Dongle向接收器RX发送USB断开连接请求；（6.3）接收器RX收到断开连接请求时进行可回退的断开连接处理;（6.4）投屏器Dongle收到接收器RX断开连接请求响应，返回码是成功表示USB断开连接成功；（7）关闭USB控制和媒体通道；（8）信令通道关闭。
- 如权利要求2所述的通过无线信道实现UAC和UVC设备远程连接的方法，其特征在于，所述步骤（2.3）的具体步骤如下：（2.3.1）接收器RX没有投屏器Dongle连接时，打开USB接口连接的UAC、UVC和HID设备，根据请求信息生成请求响应并发送给投屏器Dongle，请求响应包含响应码、USB组合设备描述、使用端点个数和端点信息数组，且端点信息包含端点编号、类型、接收端口，类型有USB控制、MIC数据、Speaker数据和Camera数据；创建UAC、UVC设备的MIC数据、Speaker数据和Camera数据对应端点读写及其对应媒体通道收发；（2.3.2）接收器RX与投屏器Dongle连接时，接收器RX不是抢占策略则返回失败，接收器RX是抢占策略则：向USB连接的投屏器Dongle发送变更通知消息，关闭USB组合设备，接收器RX收到投屏器Dongle的变更通知响应后，关闭USB控制和USB媒体通道的数据接收和发送；根据新投屏器Dongle发起的USB连接请求信息生成请求响应并发送给新连接的投屏器Dongle；接收器RX创建新投屏器Dongle媒体通道收发。
- 如权利要求3所述的通过无线信道实现UAC和UVC设备远程连接的方法，其特征在于，所述步骤（4.3）的具体步骤如下：（4.3.1）接收器RX从MIC数据对应端点读取MIC数据封装成RTP包，从MIC数据通道发送给投屏器Dongle，投屏器Dongle接收到RTP包，解析RTP包之后写入USB组合设备MIC对应端点；（4.3.2）接收器RX从Camera数据对应端点读取Camera数据封装成RTP包，从Camera数据通道发送给投屏器Dongle，投屏器Dongle接收到RTP包，解析RTP包之后写入USB组合设备Camera对应端点；（4.3.3）投屏器Dongle从媒体通道接收到MIC和Camera的RTP包，先分别按RTP序号排序之后，按RTP时戳对齐之后送入USB组合设备对应端点；（4.3.4）投屏器Dongle从Speaker数据对应端点读取Speaker数据封装成RTP包，从Speaker数据通道发送给接收器RX，接收器RX接收到RTP包，解析RTP包之后写入Speaker数据对应端点。
- 如权利要求3所述的通过无线信道实现UAC和UVC设备远程连接的方法，其特征在于，所述步骤（6.3）的具体步骤如下：（6.3.1）没有投屏器Dongle连接时，关闭UAC、UVC设备的MIC数据、Speaker数据和Camera数据对应端点读写及其对应媒体通道收发，关闭UAC、UVC和HID设备，向投屏器Dongle发送USB断开连接请求响应；（6.3.2）有投屏器Dongle连接时，关闭媒体通道收发，向请求的投屏器Dongle发送USB断开连接请求响应；向上一个USB连接的投屏器Dongle发送USB变更消息打开USB组合设备，收到响应后，创建媒体通道收发。
- 如权利要求2所述的通过无线信道实现UAC和UVC设备远程连接的方法，其特征在于，所述步骤（1）具体包括以下步骤：（1.1）投屏器Dongle使用SSID和密码连接接收器RX的WIFI, SSID和密码通过与接收器RX配对获取；（1.2）投屏器Dongle使用指定IP和PORT与接收器RX建立TCP连接；（1.3）投屏器Dongle向接收器RX发送创建信令通道请求，请求包含设备类型和接入码信息；（1.4）接收器RX收到请求处理之后向投屏器Dongle发送创建信令通道请求响应，且请求响应包含响应码、客户端唯一标识、接入码类型、RX设备类型和能力集；（1.5）投屏器Dongle收到创建信令通道请求响应，响应码是成功时，表示信令通道创建成功。
- 如权利要求2所述的通过无线信道实现UAC和UVC设备远程连接的方法，其特征在于，所述步骤（3）的具体步骤为：投屏器Dongle根据USB连接请求响应中的USB组合设备描述符创建USB组合设备，根据端点信息数组创建USB组合设备对应端点读写及其对应媒体通道收发。
- 如权利要求2所述的通过无线信道实现UAC和UVC设备远程连接的方法，其特征在于，所述步骤（4.4）的控制操作步骤如下：（4.4.1）MIC和Speaker的静音和取消静音；（4.4.2）MIC和Speaker的音量加减；（4.4.3）Camera的移动和缩放；（4.4.4）Camera的对比度和亮度调节。
- 如权利要求2所述的通过无线信道实现UAC和UVC设备远程连接的方法，其特征在于，所述步骤（7）具体方式为：投屏器Dongle关闭USB媒体通道、USB控制通道和USB组合设备。
- 如权利要求2所述的通过无线信道实现UAC和UVC设备远程连接的方法，其特征在于，所述步骤（8）具体方式为：投屏器Dongle既没有投屏又没有USB组合设备时关闭信令通道。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211503784.0 | 2022-11-29 | ||
| CN202211503784.0A CN115543250B (zh) | 2022-11-29 | 2022-11-29 | 通过无线信道实现uac和uvc设备远程连接的系统和方法 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024114434A1 true WO2024114434A1 (zh) | 2024-06-06 |
Family
ID=84721987
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2023/132755 WO2024114434A1 (zh) | 2022-11-29 | 2023-11-20 | 通过无线信道实现uac和uvc设备远程连接的系统和方法 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN115543250B (zh) |
| WO (1) | WO2024114434A1 (zh) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115543250B (zh) * | 2022-11-29 | 2023-03-28 | 深圳市拔超科技股份有限公司 | 通过无线信道实现uac和uvc设备远程连接的系统和方法 |
| CN118433683A (zh) * | 2024-07-04 | 2024-08-02 | 深圳市拔超科技股份有限公司 | 采用无线信道实现uac和uvc设备远程连接的app及方法 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170293347A1 (en) * | 2016-04-07 | 2017-10-12 | Dell Products L.P. | Intelligent Power Dongle |
| CN113257289A (zh) * | 2021-06-17 | 2021-08-13 | 成都天软信息技术有限公司 | 一种便携式车载影音系统 |
| CN113365118A (zh) * | 2021-05-24 | 2021-09-07 | 杭州楷知科技有限公司 | 基于大屏智能设备的智能终端外设操作方法、装置及系统 |
| CN115543250A (zh) * | 2022-11-29 | 2022-12-30 | 深圳市拔超科技股份有限公司 | 通过无线信道实现uac和uvc设备远程连接的系统和方法 |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB0208317D0 (en) * | 2002-04-11 | 2002-05-22 | Koninkl Philips Electronics Nv | Controlling a home electronics system |
| CN101620522A (zh) * | 2009-07-20 | 2010-01-06 | 大道计算机技术(上海)有限公司 | 运行具有投屏功能的移动存储器的控制方法 |
| JP6442836B2 (ja) * | 2014-02-28 | 2018-12-26 | セイコーエプソン株式会社 | 表示装置、および、表示装置の制御方法 |
| CN209118258U (zh) * | 2018-03-19 | 2019-07-16 | 广州视源电子科技股份有限公司 | 一种无线传屏器 |
-
2022
- 2022-11-29 CN CN202211503784.0A patent/CN115543250B/zh active Active
-
2023
- 2023-11-20 WO PCT/CN2023/132755 patent/WO2024114434A1/zh unknown
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170293347A1 (en) * | 2016-04-07 | 2017-10-12 | Dell Products L.P. | Intelligent Power Dongle |
| CN113365118A (zh) * | 2021-05-24 | 2021-09-07 | 杭州楷知科技有限公司 | 基于大屏智能设备的智能终端外设操作方法、装置及系统 |
| CN113257289A (zh) * | 2021-06-17 | 2021-08-13 | 成都天软信息技术有限公司 | 一种便携式车载影音系统 |
| CN115543250A (zh) * | 2022-11-29 | 2022-12-30 | 深圳市拔超科技股份有限公司 | 通过无线信道实现uac和uvc设备远程连接的系统和方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115543250B (zh) | 2023-03-28 |
| CN115543250A (zh) | 2022-12-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2024114434A1 (zh) | 通过无线信道实现uac和uvc设备远程连接的系统和方法 | |
| US8300079B2 (en) | Apparatus and method for transferring video | |
| US10425454B2 (en) | Device and method for transferring the rendering of multimedia content | |
| US10992978B2 (en) | Method and system for controlling smart television | |
| US20080025414A1 (en) | Apparatus and method for transmitting moving picture stream using bluetooth | |
| CN109348167B (zh) | 基于视频会议系统的无线辅流数据传输方法及系统 | |
| CN103327384A (zh) | 一种互联系统的模式控制方法及互联系统 | |
| TW201338508A (zh) | 多重畫面切換方法及其系統 | |
| TW200400716A (en) | Broadcast network access-management system and method for management of receivers operating within broadcast network | |
| CN111654450A (zh) | 数据传输方法及装置、存储介质 | |
| CN114258003A (zh) | 音频播放控制方法、系统、设备及存储介质 | |
| CN102948116A (zh) | 用于将内容发送到多个装置的方法和设备 | |
| TW202232926A (zh) | 可避免聲音中斷的藍牙通信系統及相關的藍牙設備群 | |
| CN113612857A (zh) | 一种传送设备、接收设备、信息传输系统及信息传输方法 | |
| CN101883034A (zh) | 一种用于3c融合的互联设备 | |
| JP4130542B2 (ja) | マルチメディアコンテンツ変換装置およびテレビ電話端末 | |
| CN115278324B (zh) | 一种显示设备、蓝牙设备和bis音频传输方法 | |
| CN114844736B (zh) | 一种设备及通话控制方法 | |
| JP2006140973A (ja) | ホームゲートウェイ、双方向映像通信機器、および双方向映像通信システム | |
| WO2024001362A1 (zh) | 显示设备、蓝牙设备和数据处理方法 | |
| WO2005050944A1 (ja) | ネットワーク回線を用いたアナログ信号入出力システム | |
| CN118433683A (zh) | 采用无线信道实现uac和uvc设备远程连接的app及方法 | |
| CN113965788B (zh) | 一种局域网内教学同屏互动系统 | |
| WO2023035630A1 (zh) | 一种音频控制方法及显示设备 | |
| CN112653925B (zh) | 媒体播放的跨设备转移方法、系统、设备及存储介质 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23896586 Country of ref document: EP Kind code of ref document: A1 |